2026-03-26 22:45:06 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-26 22:45:06 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-26 22:45:06 [ayvens.be] INFO: Starting spider ayvens.be
2026-03-26 22:45:06 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-26 22:45:06 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-26 22:45:06 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-26 22:45:06 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-26 22:45:06 [scrapy.extensions.telnet] INFO: Telnet Password: 893c0a04532b42b4
2026-03-26 22:45:06 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2026-03-26 22:45:06 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'DOWNLOAD_MAXSIZE': 52428800,
 'DOWNLOAD_WARNSIZE': 10485760,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/ayvens.be/task_34_2026-03-26T22_45_00.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'MEMUSAGE_LIMIT_MB': 2048,
 'MEMUSAGE_WARNING_MB': 1536,
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2026-03-26 22:45:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-26 22:45:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-26 22:45:06 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-26 22:45:06 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-26 22:45:06 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
 'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-26 22:45:06 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2026-03-26 22:45:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-26 22:45:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2118
2026-03-26 22:45:06 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-26 22:45:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-26 22:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:06 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: en
2026-03-26 22:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27en%27%20and%20RowKey%20eq%20%27en%27 HTTP/1.1" 200 None
2026-03-26 22:45:06 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-26 22:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-26 22:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-26 22:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-26 22:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-26 22:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-26 22:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-26 22:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-26 22:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-26 22:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-26 22:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-26 22:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-26 22:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-26 22:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-26 22:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-26 22:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-26 22:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-26 22:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-26 22:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-26 22:45:06 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-26 22:45:06 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
 'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
 'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-26 22:45:06 [scrapy.core.engine] INFO: Spider opened
2026-03-26 22:45:06 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-26 22:45:06 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-03-26 22:45:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 141MiB
2026-03-26 22:45:06 [scrapy-playwright] INFO: Starting download handler
2026-03-26 22:45:06 [scrapy-playwright] INFO: Starting download handler
2026-03-26 22:45:11 [scrapy-playwright] INFO: Launching browser firefox
2026-03-26 22:45:12 [scrapy-playwright] INFO: Browser firefox launched
2026-03-26 22:45:12 [scrapy-playwright] DEBUG: Browser context started: 'default' (persistent=False, remote=False)
2026-03-26 22:45:12 [scrapy-playwright] DEBUG: [Context=default] New page created, page count is 1 (1 for all contexts)
2026-03-26 22:45:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/lots> (resource type: document)
2026-03-26 22:45:13 [scrapy-playwright] DEBUG: [Context=default] Response: <407 https://carmarket.ayvens.com/en-gb/lots>
2026-03-26 22:45:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/lots> (resource type: document)
2026-03-26 22:45:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/lots>
2026-03-26 22:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Medium.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 22:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Regular.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 22:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Semibold.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 22:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Bold.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 22:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Medium.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 22:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Regular.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 22:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-SemiBold.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 22:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/styles-ETA5EMQJ.css> (resource type: stylesheet, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-R5GGQAWE.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-YI6GGZZZ.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-NAGGRITV.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-BBQ7R2BV.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-HPL7GXW6.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-ADG3G2OJ.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7JYRLYWD.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-2S63FZXS.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-K7GQAXGO.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-PMQRMPGY.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/polyfills-FFHMD2TL.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/main-NKPAFEH2.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Regular-IWU2LEHA.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Medium-NIVAGDSI.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Semibold-YNVWM5XA.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/logo-ayvens-carmarket.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/logo-ayvens-carmarket.svg>
2026-03-26 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/flags/round-gb.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/flags/round-gb.svg>
2026-03-26 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/line.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/line.svg>
2026-03-26 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/chevron-down.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/chevron-down.svg>
2026-03-26 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/loader.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/loader.svg>
2026-03-26 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Medium.woff2>
2026-03-26 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Regular.woff2>
2026-03-26 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Semibold.woff2>
2026-03-26 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Medium.woff2>
2026-03-26 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Bold.woff2>
2026-03-26 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Regular.woff2>
2026-03-26 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-SemiBold.woff2>
2026-03-26 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-YI6GGZZZ.js>
2026-03-26 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-R5GGQAWE.js>
2026-03-26 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-BBQ7R2BV.js>
2026-03-26 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-HPL7GXW6.js>
2026-03-26 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-5567JMUS.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-YI6GGZZZ.js)
2026-03-26 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-4CLCTAJ7.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-YI6GGZZZ.js)
2026-03-26 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-QV3UPEBS.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-R5GGQAWE.js)
2026-03-26 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-AQBI4CYB.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-R5GGQAWE.js)
2026-03-26 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-EIXBRKXP.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-R5GGQAWE.js)
2026-03-26 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-QZ2M64VL.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-BBQ7R2BV.js)
2026-03-26 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-HQZHDCQG.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-BBQ7R2BV.js)
2026-03-26 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-EVZDJ3YH.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-26 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-2BYH6G4C.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-26 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-AHM2LY2L.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-26 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VGUEXTON.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-26 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-SUQC6PCL.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-26 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7DYAUIPQ.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-26 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-6BXXUPPN.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-26 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-CQOH37XC.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-26 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/styles-ETA5EMQJ.css>
2026-03-26 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-NAGGRITV.js>
2026-03-26 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7JYRLYWD.js>
2026-03-26 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-ADG3G2OJ.js>
2026-03-26 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-2S63FZXS.js>
2026-03-26 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-K7GQAXGO.js>
2026-03-26 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-PMQRMPGY.js>
2026-03-26 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/polyfills-FFHMD2TL.js>
2026-03-26 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/main-NKPAFEH2.js>
2026-03-26 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-SALCXTDR.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-K7GQAXGO.js)
2026-03-26 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Regular-IWU2LEHA.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-03-26 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Medium-NIVAGDSI.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-03-26 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/SourceSans3-Bold-OH3V3LEB.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-03-26 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/SourceSans3-Regular-VMJBJIXS.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-03-26 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Semibold-YNVWM5XA.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-03-26 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/SourceSans3-SemiBold-NPKTOIJ5.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-03-26 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Regular-IWU2LEHA.woff2>
2026-03-26 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Medium-NIVAGDSI.woff2>
2026-03-26 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Semibold-YNVWM5XA.woff2>
2026-03-26 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-OF6JT4KC.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-26 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-Y6LYHJ33.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-26 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-ELPOVYM7.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-26 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VBU7AOHF.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-26 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-SPE4D2IX.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-26 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-N2FZW7V7.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-26 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VPLHK2CL.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-26 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-AVZZH6AV.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-26 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-KLKMSQPH.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-26 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-2FANG3NP.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-26 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-ABBXN5WQ.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-26 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-NPJHDJ36.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-26 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-MLMYZRAG.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-26 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-5D4JF6DX.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-26 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7IEPAGTW.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-26 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-ZYL3EWWF.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-26 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-WWYAPULQ.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-26 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-XXARMH2T.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-26 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-AYT4KML6.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-26 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-CX65R3QQ.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-26 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-XGLUMAK5.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-26 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-EHSUL3RU.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-26 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7UDVUMWJ.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-26 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-WRLSZEDX.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-26 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-XCHSKDZH.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-26 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-5567JMUS.js>
2026-03-26 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-4CLCTAJ7.js>
2026-03-26 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-QV3UPEBS.js>
2026-03-26 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-AQBI4CYB.js>
2026-03-26 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-EIXBRKXP.js>
2026-03-26 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-QZ2M64VL.js>
2026-03-26 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-HQZHDCQG.js>
2026-03-26 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-AHM2LY2L.js>
2026-03-26 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-2BYH6G4C.js>
2026-03-26 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-EVZDJ3YH.js>
2026-03-26 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VGUEXTON.js>
2026-03-26 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-SUQC6PCL.js>
2026-03-26 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7DYAUIPQ.js>
2026-03-26 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-6BXXUPPN.js>
2026-03-26 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-CQOH37XC.js>
2026-03-26 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Regular-IWU2LEHA.woff2>
2026-03-26 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-SALCXTDR.js>
2026-03-26 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Medium-NIVAGDSI.woff2>
2026-03-26 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/SourceSans3-Regular-VMJBJIXS.woff2>
2026-03-26 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/SourceSans3-Bold-OH3V3LEB.woff2>
2026-03-26 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/SourceSans3-SemiBold-NPKTOIJ5.woff2>
2026-03-26 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-OF6JT4KC.js>
2026-03-26 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Semibold-YNVWM5XA.woff2>
2026-03-26 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-Y6LYHJ33.js>
2026-03-26 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-ELPOVYM7.js>
2026-03-26 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VBU7AOHF.js>
2026-03-26 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-SPE4D2IX.js>
2026-03-26 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-N2FZW7V7.js>
2026-03-26 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-AVZZH6AV.js>
2026-03-26 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VPLHK2CL.js>
2026-03-26 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-ABBXN5WQ.js>
2026-03-26 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-2FANG3NP.js>
2026-03-26 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-KLKMSQPH.js>
2026-03-26 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-NPJHDJ36.js>
2026-03-26 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-MLMYZRAG.js>
2026-03-26 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7IEPAGTW.js>
2026-03-26 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-5D4JF6DX.js>
2026-03-26 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-WWYAPULQ.js>
2026-03-26 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-ZYL3EWWF.js>
2026-03-26 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-XXARMH2T.js>
2026-03-26 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-AYT4KML6.js>
2026-03-26 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-CX65R3QQ.js>
2026-03-26 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-XGLUMAK5.js>
2026-03-26 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-EHSUL3RU.js>
2026-03-26 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7UDVUMWJ.js>
2026-03-26 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-WRLSZEDX.js>
2026-03-26 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-XCHSKDZH.js>
2026-03-26 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://js.monitor.azure.com/scripts/b/ai.config.1.cfg.json> (resource type: fetch, referrer: https://carmarket.ayvens.com/)
2026-03-26 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-U3DCL5KE.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-26 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7HVTDVUE.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-26 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/favicon/ayvens-white-bg_192x192.png> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/favicon/ayvens-white-bg_192x192.png>
2026-03-26 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/favicon/ayvens.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/favicon/ayvens.svg>
2026-03-26 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-U3DCL5KE.js>
2026-03-26 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7HVTDVUE.js>
2026-03-26 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VPZ5PCFV.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-7HVTDVUE.js)
2026-03-26 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VPZ5PCFV.js>
2026-03-26 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-R57BLUBZ.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-VPZ5PCFV.js)
2026-03-26 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://js.monitor.azure.com/scripts/b/ai.config.1.cfg.json>
2026-03-26 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-R57BLUBZ.js>
2026-03-26 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-XI7MA6UU.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-26 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-253AOQV4.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-26 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-Y26P6NOT.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-VPZ5PCFV.js)
2026-03-26 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-XI7MA6UU.js>
2026-03-26 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-E2QM5VHP.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-XI7MA6UU.js)
2026-03-26 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-QVU7EFJH.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-XI7MA6UU.js)
2026-03-26 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-CJQ6ZMFR.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-XI7MA6UU.js)
2026-03-26 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-253AOQV4.js>
2026-03-26 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-Y26P6NOT.js>
2026-03-26 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-PU5AH4GE.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-Y26P6NOT.js)
2026-03-26 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-6AWK7DQQ.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-Y26P6NOT.js)
2026-03-26 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-JMKQRIJX.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-Y26P6NOT.js)
2026-03-26 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-OXIZJZO4.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-Y26P6NOT.js)
2026-03-26 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-H7VMIGZK.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-Y26P6NOT.js)
2026-03-26 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-E2QM5VHP.js>
2026-03-26 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-QVU7EFJH.js>
2026-03-26 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-CJQ6ZMFR.js>
2026-03-26 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-PU5AH4GE.js>
2026-03-26 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-6AWK7DQQ.js>
2026-03-26 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-JMKQRIJX.js>
2026-03-26 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-OXIZJZO4.js>
2026-03-26 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-H7VMIGZK.js>
2026-03-26 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/loader.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/loader.svg>
2026-03-26 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/flags/round-gb.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/flags/round-gb.svg>
2026-03-26 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/line.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/line.svg>
2026-03-26 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/chevron-down.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/chevron-down.svg>
2026-03-26 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/logo-ayvens-carmarket.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/logo-ayvens-carmarket.svg>
2026-03-26 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://dc.services.visualstudio.com/v2/track> (resource type: xhr, referrer: https://carmarket.ayvens.com/)
2026-03-26 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-BQLC5RJD.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-Y26P6NOT.js)
2026-03-26 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-HGLYMGTS.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-PU5AH4GE.js)
2026-03-26 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VNA57F7Z.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-253AOQV4.js)
2026-03-26 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-EXKYPD3J.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-253AOQV4.js)
2026-03-26 22:45:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://carmarket.ayvens.com/en-gb/lots> (referer: None) ['playwright']
2026-03-26 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-BQLC5RJD.js>
2026-03-26 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/down.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/down.svg>
2026-03-26 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-HGLYMGTS.js>
2026-03-26 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-AZBPSD4I.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HGLYMGTS.js)
2026-03-26 22:45:18 [ayvens.be] INFO: Cookies from Playwright: [{'name': 'ai_user', 'value': 'CjTpIvx/I07G9yOMYuzvIx|2026-03-26T22:45:16.648Z', 'domain': 'carmarket.ayvens.com', 'path': '/', 'expires': 1806101116, 'httpOnly': False, 'secure': True, 'sameSite': 'None'}, {'name': 'user_culture', 'value': 'en-gb', 'domain': 'carmarket.ayvens.com', 'path': '/', 'expires': -1, 'httpOnly': False, 'secure': False, 'sameSite': 'None'}, {'name': 'ai_session', 'value': 'UyE7f/a4IBTzr7zLqozORV|1774565118016|1774565118016', 'domain': 'carmarket.ayvens.com', 'path': '/', 'expires': 1774566918, 'httpOnly': False, 'secure': True, 'sameSite': 'None'}]
2026-03-26 22:45:18 [ayvens.be] INFO: Scrapy-formatted cookies: [{'name': 'ai_user', 'value': 'CjTpIvx/I07G9yOMYuzvIx|2026-03-26T22:45:16.648Z', 'domain': 'carmarket.ayvens.com', 'path': '/'}, {'name': 'user_culture', 'value': 'en-gb', 'domain': 'carmarket.ayvens.com', 'path': '/'}, {'name': 'ai_session', 'value': 'UyE7f/a4IBTzr7zLqozORV|1774565118016|1774565118016', 'domain': 'carmarket.ayvens.com', 'path': '/'}]
2026-03-26 22:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /SpiderData(PartitionKey='Ayvens',RowKey='cookies') HTTP/1.1" 204 0
2026-03-26 22:45:18 [ayvens.be] INFO: Intercepting token...
2026-03-26 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-2NCM5KDW.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HGLYMGTS.js)
2026-03-26 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-EXKYPD3J.js>
2026-03-26 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VNA57F7Z.js>
2026-03-26 22:45:18 [ayvens.be] INFO: Scrolling element to trigger lazy load...
2026-03-26 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/bell.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/next-breadcrumb.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://dc.services.visualstudio.com/v2/track> (resource type: xhr, referrer: https://carmarket.ayvens.com/)
2026-03-26 22:45:18 [ayvens.be] INFO: GraphQL headers: {'host': 'api-carmarket.ayvens.com', 'user-agent': 'Mozilla/5.0 (X11; Linux x86_64; rv:125.0) Gecko/20100101 Firefox/125.0', 'accept': 'application/json, text/plain, */*', 'accept-language': 'en-US,en;q=0.5', 'accept-encoding': 'gzip, deflate, br', 'content-type': 'application/json', 'content-length': '839', 'referer': 'https://carmarket.ayvens.com/', 'x-ald-subscription-key': '3b2cc62fd26c4e29a762db3de181266b', 'x-tenant': 'ald', 'x-country': 'gb', 'origin': 'https://carmarket.ayvens.com', 'sec-fetch-dest': 'empty', 'sec-fetch-mode': 'cors', 'sec-fetch-site': 'same-site', 'proxy-authorization': 'Basic Y3VzdG9tZXItaW5maW5pdF9zb3VyY2luZ192Ml9XQjdOUi1jYy1HQjozY35+YWdLUmM2MlZaQUw=', 'connection': 'keep-alive'}
2026-03-26 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VUZVFPNF.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-26 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://api-carmarket.ayvens.com/graphql/saleevents> (resource type: xhr, referrer: https://carmarket.ayvens.com/)
2026-03-26 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://dc.services.visualstudio.com/v2/track>
2026-03-26 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://dc.services.visualstudio.com/v2/track> (resource type: xhr, referrer: https://carmarket.ayvens.com/)
2026-03-26 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/logo-ayvens.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-fr.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-AZBPSD4I.js>
2026-03-26 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/bell.svg>
2026-03-26 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-es.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-be.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-de.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-it.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/loader.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/chevron-down.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/next-breadcrumb.svg>
2026-03-26 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-2NCM5KDW.js>
2026-03-26 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VUZVFPNF.js>
2026-03-26 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-FX6676C7.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-VUZVFPNF.js)
2026-03-26 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://dc.services.visualstudio.com/v2/track>
2026-03-26 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/logo-ayvens.svg>
2026-03-26 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://dc.services.visualstudio.com/v2/track>
2026-03-26 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/down.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/loader.svg>
2026-03-26 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/chevron-down.svg>
2026-03-26 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-FX6676C7.js>
2026-03-26 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/scripttemplates/otSDKStub.js> (resource type: script, referrer: https://carmarket.ayvens.com/)
2026-03-26 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-BK6NFD4R.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-26 22:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/down.svg>
2026-03-26 22:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-de.svg>
2026-03-26 22:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/flags/be.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 22:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/flags/gr.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 22:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-75KGV5DF.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-OXIZJZO4.js)
2026-03-26 22:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-es.svg>
2026-03-26 22:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-it.svg>
2026-03-26 22:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-fr.svg>
2026-03-26 22:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-be.svg>
2026-03-26 22:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-BK6NFD4R.js>
2026-03-26 22:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/flags/be.svg>
2026-03-26 22:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/flags/gr.svg>
2026-03-26 22:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-75KGV5DF.js>
2026-03-26 22:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/scripttemplates/otSDKStub.js>
2026-03-26 22:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/consent/019908df-58e4-7710-aaa7-4d6e79279bd9/019908df-58e4-7710-aaa7-4d6e79279bd9.json> (resource type: xhr, referrer: https://carmarket.ayvens.com/)
2026-03-26 22:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/consent/019908df-58e4-7710-aaa7-4d6e79279bd9/019908df-58e4-7710-aaa7-4d6e79279bd9.json>
2026-03-26 22:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/scripttemplates/202601.1.0/otBannerSdk.js> (resource type: script, referrer: https://carmarket.ayvens.com/)
2026-03-26 22:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/scripttemplates/202601.1.0/otBannerSdk.js>
2026-03-26 22:45:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/consent/019908df-58e4-7710-aaa7-4d6e79279bd9/019b4fc7-396b-7b6c-9b76-7b67f1d26cca/en.json> (resource type: fetch, referrer: https://carmarket.ayvens.com/)
2026-03-26 22:45:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/consent/019908df-58e4-7710-aaa7-4d6e79279bd9/019b4fc7-396b-7b6c-9b76-7b67f1d26cca/en.json>
2026-03-26 22:45:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/scripttemplates/202601.1.0/assets/otCenterRounded.json> (resource type: fetch, referrer: https://carmarket.ayvens.com/)
2026-03-26 22:45:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/scripttemplates/202601.1.0/assets/v2/otPcTab.json> (resource type: fetch, referrer: https://carmarket.ayvens.com/)
2026-03-26 22:45:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/scripttemplates/202601.1.0/assets/otCommonStyles.css> (resource type: fetch, referrer: https://carmarket.ayvens.com/)
2026-03-26 22:45:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/scripttemplates/202601.1.0/assets/otCenterRounded.json>
2026-03-26 22:45:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/scripttemplates/202601.1.0/assets/v2/otPcTab.json>
2026-03-26 22:45:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/scripttemplates/202601.1.0/assets/otCommonStyles.css>
2026-03-26 22:45:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/logos/14efa178-aa53-42e6-9a86-5229303798da/019908c4-f46e-7d64-b942-26aa1fec3635/2ab431a1-8f8c-4a55-9e1a-e5de23079c22/ayvens-logo.png> (resource type: image, referrer: https://carmarket.ayvens.com/)
2026-03-26 22:45:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/logos/static/powered_by_logo.svg> (resource type: image, referrer: https://carmarket.ayvens.com/)
2026-03-26 22:45:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/logos/static/ot_guard_logo.svg> (resource type: fetch, referrer: https://carmarket.ayvens.com/)
2026-03-26 22:45:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.googletagmanager.com/gtm.js?id=GTM-W3J7744> (resource type: script, referrer: https://carmarket.ayvens.com/)
2026-03-26 22:45:20 [ayvens.be] INFO: ✅ Intercepted token: 3b2cc62fd26c4e29a762db3de181266b
2026-03-26 22:45:20 [ayvens.be] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 0
2026-03-26 22:45:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-26 22:45:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/logos/14efa178-aa53-42e6-9a86-5229303798da/019908c4-f46e-7d64-b942-26aa1fec3635/2ab431a1-8f8c-4a55-9e1a-e5de23079c22/ayvens-logo.png>
2026-03-26 22:45:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-03-26 22:45:30 [ayvens.be] INFO: Found listing with ID: 1982154
2026-03-26 22:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982154%27 HTTP/1.1" 200 None
2026-03-26 22:45:30 [ayvens.be] INFO: Scrape type for 1982154: 2
2026-03-26 22:45:30 [ayvens.be] INFO: Extracting data for car ID: 1982154
2026-03-26 22:45:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2adc822b-9525-57aa-a6fd-5dac6ff9009c with identifier: 1982154
2026-03-26 22:45:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2adc822b-9525-57aa-a6fd-5dac6ff9009c with scrape type 2
2026-03-26 22:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2adc822b-9525-57aa-a6fd-5dac6ff9009c with scrape type 2
2026-03-26 22:45:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 2adc822b-9525-57aa-a6fd-5dac6ff9009c, identifier: 1982154
2026-03-26 22:45:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 2adc822b-9525-57aa-a6fd-5dac6ff9009c with identifier: 1982154
2026-03-26 22:45:30 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 22:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 22:45:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 2adc822b-9525-57aa-a6fd-5dac6ff9009c with identifier: 1982154
2026-03-26 22:45:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 2adc822b-9525-57aa-a6fd-5dac6ff9009c with identifier: 1982154 to the API
2026-03-26 22:45:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:45:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:45:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T10:00:00Z',
 'fuel_type': 'diesel',
 'id': '2adc822b-9525-57aa-a6fd-5dac6ff9009c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41006',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 44923,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-02',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-03-26 22:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982154%27 HTTP/1.1" 200 None
2026-03-26 22:45:30 [ayvens.be] INFO: Saving data for 1982154: {'auction_closing_time': 1775037600.0, 'created_time': 1774478725.315373, 'last_price_update_time': 1774565130.590997}
2026-03-26 22:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982154') HTTP/1.1" 204 0
2026-03-26 22:45:30 [ayvens.be] INFO: Found listing with ID: 1982155
2026-03-26 22:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982155%27 HTTP/1.1" 200 None
2026-03-26 22:45:30 [ayvens.be] INFO: Scrape type for 1982155: 0
2026-03-26 22:45:30 [ayvens.be] INFO: Found listing with ID: 1982156
2026-03-26 22:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982156%27 HTTP/1.1" 200 None
2026-03-26 22:45:30 [ayvens.be] INFO: Scrape type for 1982156: 0
2026-03-26 22:45:30 [ayvens.be] INFO: Found listing with ID: 1982157
2026-03-26 22:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982157%27 HTTP/1.1" 200 None
2026-03-26 22:45:30 [ayvens.be] INFO: Scrape type for 1982157: 0
2026-03-26 22:45:30 [ayvens.be] INFO: Found listing with ID: 1982158
2026-03-26 22:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982158%27 HTTP/1.1" 200 None
2026-03-26 22:45:30 [ayvens.be] INFO: Scrape type for 1982158: 0
2026-03-26 22:45:30 [ayvens.be] INFO: Found listing with ID: 1982159
2026-03-26 22:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982159%27 HTTP/1.1" 200 None
2026-03-26 22:45:30 [ayvens.be] INFO: Scrape type for 1982159: 0
2026-03-26 22:45:30 [ayvens.be] INFO: Found listing with ID: 1982160
2026-03-26 22:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982160%27 HTTP/1.1" 200 None
2026-03-26 22:45:30 [ayvens.be] INFO: Scrape type for 1982160: 0
2026-03-26 22:45:30 [ayvens.be] INFO: Found listing with ID: 1982161
2026-03-26 22:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982161%27 HTTP/1.1" 200 None
2026-03-26 22:45:30 [ayvens.be] INFO: Scrape type for 1982161: 0
2026-03-26 22:45:30 [ayvens.be] INFO: Found listing with ID: 1982162
2026-03-26 22:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982162%27 HTTP/1.1" 200 None
2026-03-26 22:45:30 [ayvens.be] INFO: Scrape type for 1982162: 0
2026-03-26 22:45:30 [ayvens.be] INFO: Found listing with ID: 1982163
2026-03-26 22:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982163%27 HTTP/1.1" 200 None
2026-03-26 22:45:30 [ayvens.be] INFO: Scrape type for 1982163: 0
2026-03-26 22:45:30 [ayvens.be] INFO: Found listing with ID: 1982164
2026-03-26 22:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982164%27 HTTP/1.1" 200 None
2026-03-26 22:45:30 [ayvens.be] INFO: Scrape type for 1982164: 0
2026-03-26 22:45:30 [ayvens.be] INFO: Found listing with ID: 1982165
2026-03-26 22:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982165%27 HTTP/1.1" 200 None
2026-03-26 22:45:30 [ayvens.be] INFO: Scrape type for 1982165: 0
2026-03-26 22:45:30 [ayvens.be] INFO: Found listing with ID: 1982166
2026-03-26 22:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982166%27 HTTP/1.1" 200 None
2026-03-26 22:45:30 [ayvens.be] INFO: Scrape type for 1982166: 0
2026-03-26 22:45:30 [ayvens.be] INFO: Found listing with ID: 1982167
2026-03-26 22:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982167%27 HTTP/1.1" 200 None
2026-03-26 22:45:30 [ayvens.be] INFO: Scrape type for 1982167: 0
2026-03-26 22:45:30 [ayvens.be] INFO: Found listing with ID: 1982168
2026-03-26 22:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982168%27 HTTP/1.1" 200 None
2026-03-26 22:45:30 [ayvens.be] INFO: Scrape type for 1982168: 0
2026-03-26 22:45:30 [ayvens.be] INFO: Found listing with ID: 1982169
2026-03-26 22:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982169%27 HTTP/1.1" 200 None
2026-03-26 22:45:30 [ayvens.be] INFO: Scrape type for 1982169: 0
2026-03-26 22:45:30 [ayvens.be] INFO: Found listing with ID: 1982170
2026-03-26 22:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982170%27 HTTP/1.1" 200 None
2026-03-26 22:45:30 [ayvens.be] INFO: Scrape type for 1982170: 0
2026-03-26 22:45:30 [ayvens.be] INFO: Found listing with ID: 1982171
2026-03-26 22:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982171%27 HTTP/1.1" 200 None
2026-03-26 22:45:30 [ayvens.be] INFO: Scrape type for 1982171: 0
2026-03-26 22:45:30 [ayvens.be] INFO: Found listing with ID: 1982172
2026-03-26 22:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982172%27 HTTP/1.1" 200 None
2026-03-26 22:45:30 [ayvens.be] INFO: Scrape type for 1982172: 0
2026-03-26 22:45:30 [ayvens.be] INFO: Found listing with ID: 1982173
2026-03-26 22:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982173%27 HTTP/1.1" 200 None
2026-03-26 22:45:30 [ayvens.be] INFO: Scrape type for 1982173: 0
2026-03-26 22:45:30 [ayvens.be] INFO: Found listing with ID: 1982174
2026-03-26 22:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982174%27 HTTP/1.1" 200 None
2026-03-26 22:45:31 [ayvens.be] INFO: Scrape type for 1982174: 0
2026-03-26 22:45:31 [ayvens.be] INFO: Found listing with ID: 1982175
2026-03-26 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982175%27 HTTP/1.1" 200 None
2026-03-26 22:45:31 [ayvens.be] INFO: Scrape type for 1982175: 0
2026-03-26 22:45:31 [ayvens.be] INFO: Found listing with ID: 1982176
2026-03-26 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982176%27 HTTP/1.1" 200 None
2026-03-26 22:45:31 [ayvens.be] INFO: Scrape type for 1982176: 0
2026-03-26 22:45:31 [ayvens.be] INFO: Found listing with ID: 1982177
2026-03-26 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982177%27 HTTP/1.1" 200 None
2026-03-26 22:45:31 [ayvens.be] INFO: Scrape type for 1982177: 0
2026-03-26 22:45:31 [ayvens.be] INFO: Found listing with ID: 1982178
2026-03-26 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982178%27 HTTP/1.1" 200 None
2026-03-26 22:45:31 [ayvens.be] INFO: Scrape type for 1982178: 0
2026-03-26 22:45:31 [ayvens.be] INFO: Found listing with ID: 1982179
2026-03-26 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982179%27 HTTP/1.1" 200 None
2026-03-26 22:45:31 [ayvens.be] INFO: Scrape type for 1982179: 0
2026-03-26 22:45:31 [ayvens.be] INFO: Found listing with ID: 1982180
2026-03-26 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982180%27 HTTP/1.1" 200 None
2026-03-26 22:45:31 [ayvens.be] INFO: Scrape type for 1982180: 0
2026-03-26 22:45:31 [ayvens.be] INFO: Found listing with ID: 1982181
2026-03-26 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982181%27 HTTP/1.1" 200 None
2026-03-26 22:45:31 [ayvens.be] INFO: Scrape type for 1982181: 0
2026-03-26 22:45:31 [ayvens.be] INFO: Found listing with ID: 1982182
2026-03-26 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982182%27 HTTP/1.1" 200 None
2026-03-26 22:45:31 [ayvens.be] INFO: Scrape type for 1982182: 0
2026-03-26 22:45:31 [ayvens.be] INFO: Found listing with ID: 1982183
2026-03-26 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982183%27 HTTP/1.1" 200 None
2026-03-26 22:45:31 [ayvens.be] INFO: Scrape type for 1982183: 0
2026-03-26 22:45:31 [ayvens.be] INFO: Found listing with ID: 1982184
2026-03-26 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982184%27 HTTP/1.1" 200 None
2026-03-26 22:45:31 [ayvens.be] INFO: Scrape type for 1982184: 0
2026-03-26 22:45:31 [ayvens.be] INFO: Found listing with ID: 1982185
2026-03-26 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982185%27 HTTP/1.1" 200 None
2026-03-26 22:45:31 [ayvens.be] INFO: Scrape type for 1982185: 0
2026-03-26 22:45:31 [ayvens.be] INFO: Found listing with ID: 1982186
2026-03-26 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982186%27 HTTP/1.1" 200 None
2026-03-26 22:45:31 [ayvens.be] INFO: Scrape type for 1982186: 0
2026-03-26 22:45:31 [ayvens.be] INFO: Found listing with ID: 1982187
2026-03-26 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982187%27 HTTP/1.1" 200 None
2026-03-26 22:45:31 [ayvens.be] INFO: Scrape type for 1982187: 0
2026-03-26 22:45:31 [ayvens.be] INFO: Found listing with ID: 1982188
2026-03-26 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982188%27 HTTP/1.1" 200 None
2026-03-26 22:45:31 [ayvens.be] INFO: Scrape type for 1982188: 0
2026-03-26 22:45:31 [ayvens.be] INFO: Found listing with ID: 1982189
2026-03-26 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982189%27 HTTP/1.1" 200 None
2026-03-26 22:45:31 [ayvens.be] INFO: Scrape type for 1982189: 0
2026-03-26 22:45:31 [ayvens.be] INFO: Found listing with ID: 1982190
2026-03-26 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982190%27 HTTP/1.1" 200 None
2026-03-26 22:45:31 [ayvens.be] INFO: Scrape type for 1982190: 0
2026-03-26 22:45:31 [ayvens.be] INFO: Found listing with ID: 1982191
2026-03-26 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982191%27 HTTP/1.1" 200 None
2026-03-26 22:45:31 [ayvens.be] INFO: Scrape type for 1982191: 0
2026-03-26 22:45:31 [ayvens.be] INFO: Found listing with ID: 1982192
2026-03-26 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982192%27 HTTP/1.1" 200 None
2026-03-26 22:45:31 [ayvens.be] INFO: Scrape type for 1982192: 0
2026-03-26 22:45:31 [ayvens.be] INFO: Found listing with ID: 1982193
2026-03-26 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982193%27 HTTP/1.1" 200 None
2026-03-26 22:45:31 [ayvens.be] INFO: Scrape type for 1982193: 0
2026-03-26 22:45:31 [ayvens.be] INFO: Found listing with ID: 1982194
2026-03-26 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982194%27 HTTP/1.1" 200 None
2026-03-26 22:45:31 [ayvens.be] INFO: Scrape type for 1982194: 0
2026-03-26 22:45:31 [ayvens.be] INFO: Found listing with ID: 1982195
2026-03-26 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982195%27 HTTP/1.1" 200 None
2026-03-26 22:45:31 [ayvens.be] INFO: Scrape type for 1982195: 0
2026-03-26 22:45:31 [ayvens.be] INFO: Found listing with ID: 1982196
2026-03-26 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982196%27 HTTP/1.1" 200 None
2026-03-26 22:45:31 [ayvens.be] INFO: Scrape type for 1982196: 0
2026-03-26 22:45:31 [ayvens.be] INFO: Found listing with ID: 1982197
2026-03-26 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982197%27 HTTP/1.1" 200 None
2026-03-26 22:45:31 [ayvens.be] INFO: Scrape type for 1982197: 0
2026-03-26 22:45:31 [ayvens.be] INFO: Found listing with ID: 1982198
2026-03-26 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982198%27 HTTP/1.1" 200 None
2026-03-26 22:45:31 [ayvens.be] INFO: Scrape type for 1982198: 0
2026-03-26 22:45:31 [ayvens.be] INFO: Found listing with ID: 1982199
2026-03-26 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982199%27 HTTP/1.1" 200 None
2026-03-26 22:45:31 [ayvens.be] INFO: Scrape type for 1982199: 0
2026-03-26 22:45:31 [ayvens.be] INFO: Found listing with ID: 1982200
2026-03-26 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982200%27 HTTP/1.1" 200 None
2026-03-26 22:45:31 [ayvens.be] INFO: Scrape type for 1982200: 0
2026-03-26 22:45:31 [ayvens.be] INFO: Found listing with ID: 1982201
2026-03-26 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982201%27 HTTP/1.1" 200 None
2026-03-26 22:45:31 [ayvens.be] INFO: Scrape type for 1982201: 0
2026-03-26 22:45:31 [ayvens.be] INFO: Found listing with ID: 1982202
2026-03-26 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982202%27 HTTP/1.1" 200 None
2026-03-26 22:45:31 [ayvens.be] INFO: Scrape type for 1982202: 0
2026-03-26 22:45:31 [ayvens.be] INFO: Found listing with ID: 1982203
2026-03-26 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982203%27 HTTP/1.1" 200 None
2026-03-26 22:45:31 [ayvens.be] INFO: Scrape type for 1982203: 0
2026-03-26 22:45:31 [ayvens.be] INFO: Found listing with ID: 1982204
2026-03-26 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982204%27 HTTP/1.1" 200 None
2026-03-26 22:45:31 [ayvens.be] INFO: Scrape type for 1982204: 0
2026-03-26 22:45:31 [ayvens.be] INFO: Found listing with ID: 1982205
2026-03-26 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982205%27 HTTP/1.1" 200 None
2026-03-26 22:45:31 [ayvens.be] INFO: Scrape type for 1982205: 0
2026-03-26 22:45:31 [ayvens.be] INFO: Found listing with ID: 1982206
2026-03-26 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982206%27 HTTP/1.1" 200 None
2026-03-26 22:45:31 [ayvens.be] INFO: Scrape type for 1982206: 0
2026-03-26 22:45:31 [ayvens.be] INFO: Found listing with ID: 1982207
2026-03-26 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982207%27 HTTP/1.1" 200 None
2026-03-26 22:45:31 [ayvens.be] INFO: Scrape type for 1982207: 0
2026-03-26 22:45:31 [ayvens.be] INFO: Found listing with ID: 1982208
2026-03-26 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982208%27 HTTP/1.1" 200 None
2026-03-26 22:45:31 [ayvens.be] INFO: Scrape type for 1982208: 0
2026-03-26 22:45:31 [ayvens.be] INFO: Found listing with ID: 1986030
2026-03-26 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986030%27 HTTP/1.1" 200 None
2026-03-26 22:45:31 [ayvens.be] INFO: Scrape type for 1986030: 1
2026-03-26 22:45:31 [ayvens.be] INFO: Extracting data for car ID: 1986030
2026-03-26 22:45:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bef7e0b6-b1d5-5839-a4f0-59265aa25b31 with identifier: 1986030
2026-03-26 22:45:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bef7e0b6-b1d5-5839-a4f0-59265aa25b31 with scrape type 1
2026-03-26 22:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bef7e0b6-b1d5-5839-a4f0-59265aa25b31
2026-03-26 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ug%252Fbb06516bcce948e997bd3eaee2f3435f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ug/bb06516bcce948e997bd3eaee2f3435f/images/large/1.jpg not downloaded yet
2026-03-26 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ug%252Fbb06516bcce948e997bd3eaee2f3435f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ug/bb06516bcce948e997bd3eaee2f3435f/images/large/2.jpg not downloaded yet
2026-03-26 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ug%252Fbb06516bcce948e997bd3eaee2f3435f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ug/bb06516bcce948e997bd3eaee2f3435f/images/large/3.jpg not downloaded yet
2026-03-26 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ug%252Fbb06516bcce948e997bd3eaee2f3435f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ug/bb06516bcce948e997bd3eaee2f3435f/images/large/4.jpg not downloaded yet
2026-03-26 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ug%252Fbb06516bcce948e997bd3eaee2f3435f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ug/bb06516bcce948e997bd3eaee2f3435f/images/large/5.jpg not downloaded yet
2026-03-26 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ug%252Fbb06516bcce948e997bd3eaee2f3435f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ug/bb06516bcce948e997bd3eaee2f3435f/images/large/6.jpg not downloaded yet
2026-03-26 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ug%252Fbb06516bcce948e997bd3eaee2f3435f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ug/bb06516bcce948e997bd3eaee2f3435f/images/large/7.jpg not downloaded yet
2026-03-26 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ug%252Fbb06516bcce948e997bd3eaee2f3435f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ug/bb06516bcce948e997bd3eaee2f3435f/images/large/8.jpg not downloaded yet
2026-03-26 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ug%252Fbb06516bcce948e997bd3eaee2f3435f%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ug/bb06516bcce948e997bd3eaee2f3435f/images/large/9.jpg not downloaded yet
2026-03-26 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ug%252Fbb06516bcce948e997bd3eaee2f3435f%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ug/bb06516bcce948e997bd3eaee2f3435f/images/large/10.jpg not downloaded yet
2026-03-26 22:45:31 [ayvens.be] INFO: Found listing with ID: 1986031
2026-03-26 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986031%27 HTTP/1.1" 200 None
2026-03-26 22:45:31 [ayvens.be] INFO: Scrape type for 1986031: 1
2026-03-26 22:45:31 [ayvens.be] INFO: Extracting data for car ID: 1986031
2026-03-26 22:45:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8c10ba7-dcda-584c-b6d0-87c4bf987176 with identifier: 1986031
2026-03-26 22:45:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8c10ba7-dcda-584c-b6d0-87c4bf987176 with scrape type 1
2026-03-26 22:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f8c10ba7-dcda-584c-b6d0-87c4bf987176
2026-03-26 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252F050ba0a64c3e4e17b40825de497728ef%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/050ba0a64c3e4e17b40825de497728ef/images/large/1.jpg not downloaded yet
2026-03-26 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252F050ba0a64c3e4e17b40825de497728ef%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/050ba0a64c3e4e17b40825de497728ef/images/large/2.jpg not downloaded yet
2026-03-26 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252F050ba0a64c3e4e17b40825de497728ef%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/050ba0a64c3e4e17b40825de497728ef/images/large/3.jpg not downloaded yet
2026-03-26 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252F050ba0a64c3e4e17b40825de497728ef%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/050ba0a64c3e4e17b40825de497728ef/images/large/4.jpg not downloaded yet
2026-03-26 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252F050ba0a64c3e4e17b40825de497728ef%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/050ba0a64c3e4e17b40825de497728ef/images/large/5.jpg not downloaded yet
2026-03-26 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252F050ba0a64c3e4e17b40825de497728ef%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/050ba0a64c3e4e17b40825de497728ef/images/large/6.jpg not downloaded yet
2026-03-26 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252F050ba0a64c3e4e17b40825de497728ef%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/050ba0a64c3e4e17b40825de497728ef/images/large/7.jpg not downloaded yet
2026-03-26 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252F050ba0a64c3e4e17b40825de497728ef%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/050ba0a64c3e4e17b40825de497728ef/images/large/8.jpg not downloaded yet
2026-03-26 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252F050ba0a64c3e4e17b40825de497728ef%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/050ba0a64c3e4e17b40825de497728ef/images/large/9.jpg not downloaded yet
2026-03-26 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252F050ba0a64c3e4e17b40825de497728ef%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/050ba0a64c3e4e17b40825de497728ef/images/large/10.jpg not downloaded yet
2026-03-26 22:45:32 [ayvens.be] INFO: Found listing with ID: 1986032
2026-03-26 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986032%27 HTTP/1.1" 200 None
2026-03-26 22:45:32 [ayvens.be] INFO: Scrape type for 1986032: 1
2026-03-26 22:45:32 [ayvens.be] INFO: Extracting data for car ID: 1986032
2026-03-26 22:45:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2cb1b635-e8bd-5d2b-b2e9-f8ab404a9da8 with identifier: 1986032
2026-03-26 22:45:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2cb1b635-e8bd-5d2b-b2e9-f8ab404a9da8 with scrape type 1
2026-03-26 22:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2cb1b635-e8bd-5d2b-b2e9-f8ab404a9da8
2026-03-26 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vu%252F9b7ddb97a28f4899b10f5ea87306b7d0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vu/9b7ddb97a28f4899b10f5ea87306b7d0/images/large/1.jpg not downloaded yet
2026-03-26 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vu%252F9b7ddb97a28f4899b10f5ea87306b7d0%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vu/9b7ddb97a28f4899b10f5ea87306b7d0/images/large/2.jpg not downloaded yet
2026-03-26 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vu%252F9b7ddb97a28f4899b10f5ea87306b7d0%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vu/9b7ddb97a28f4899b10f5ea87306b7d0/images/large/3.jpg not downloaded yet
2026-03-26 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vu%252F9b7ddb97a28f4899b10f5ea87306b7d0%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vu/9b7ddb97a28f4899b10f5ea87306b7d0/images/large/4.jpg not downloaded yet
2026-03-26 22:45:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ug/bb06516bcce948e997bd3eaee2f3435f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vu%252F9b7ddb97a28f4899b10f5ea87306b7d0%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vu/9b7ddb97a28f4899b10f5ea87306b7d0/images/large/5.jpg not downloaded yet
2026-03-26 22:45:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ug/bb06516bcce948e997bd3eaee2f3435f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vu%252F9b7ddb97a28f4899b10f5ea87306b7d0%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vu/9b7ddb97a28f4899b10f5ea87306b7d0/images/large/6.jpg not downloaded yet
2026-03-26 22:45:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ug/bb06516bcce948e997bd3eaee2f3435f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vu%252F9b7ddb97a28f4899b10f5ea87306b7d0%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vu/9b7ddb97a28f4899b10f5ea87306b7d0/images/large/7.jpg not downloaded yet
2026-03-26 22:45:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ug/bb06516bcce948e997bd3eaee2f3435f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vu%252F9b7ddb97a28f4899b10f5ea87306b7d0%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vu/9b7ddb97a28f4899b10f5ea87306b7d0/images/large/8.jpg not downloaded yet
2026-03-26 22:45:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ug/bb06516bcce948e997bd3eaee2f3435f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vu%252F9b7ddb97a28f4899b10f5ea87306b7d0%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vu/9b7ddb97a28f4899b10f5ea87306b7d0/images/large/9.jpg not downloaded yet
2026-03-26 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vu%252F9b7ddb97a28f4899b10f5ea87306b7d0%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vu/9b7ddb97a28f4899b10f5ea87306b7d0/images/large/10.jpg not downloaded yet
2026-03-26 22:45:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-03-26 22:45:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-03-26 22:45:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7292290>
2026-03-26 22:45:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-26 22:45:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2106
2026-03-26 22:45:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-03-26 22:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bef7e0b6-b1d5-5839-a4f0-59265aa25b31/bef7e0b6-b1d5-5839-a4f0-59265aa25b31_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ug%252Fbb06516bcce948e997bd3eaee2f3435f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ug/bb06516bcce948e997bd3eaee2f3435f/images/large/5.jpg saved to cache
2026-03-26 22:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bef7e0b6-b1d5-5839-a4f0-59265aa25b31
2026-03-26 22:45:32 [ayvens.be] INFO: Found listing with ID: 1986033
2026-03-26 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986033%27 HTTP/1.1" 200 None
2026-03-26 22:45:32 [ayvens.be] INFO: Scrape type for 1986033: 1
2026-03-26 22:45:32 [ayvens.be] INFO: Extracting data for car ID: 1986033
2026-03-26 22:45:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d534795d-7047-5bbb-884f-a5faa15342d5 with identifier: 1986033
2026-03-26 22:45:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d534795d-7047-5bbb-884f-a5faa15342d5 with scrape type 1
2026-03-26 22:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d534795d-7047-5bbb-884f-a5faa15342d5
2026-03-26 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1we%252Ff03c39eaeb884932912013040822ffea%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1we/f03c39eaeb884932912013040822ffea/images/large/1.jpg not downloaded yet
2026-03-26 22:45:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ug/bb06516bcce948e997bd3eaee2f3435f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ug/bb06516bcce948e997bd3eaee2f3435f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1we%252Ff03c39eaeb884932912013040822ffea%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1we/f03c39eaeb884932912013040822ffea/images/large/2.jpg not downloaded yet
2026-03-26 22:45:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b727d3d0>
2026-03-26 22:45:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bef7e0b6-b1d5-5839-a4f0-59265aa25b31/bef7e0b6-b1d5-5839-a4f0-59265aa25b31_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ug%252Fbb06516bcce948e997bd3eaee2f3435f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ug/bb06516bcce948e997bd3eaee2f3435f/images/large/3.jpg saved to cache
2026-03-26 22:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bef7e0b6-b1d5-5839-a4f0-59265aa25b31
2026-03-26 22:45:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b78778d0>
2026-03-26 22:45:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bef7e0b6-b1d5-5839-a4f0-59265aa25b31/bef7e0b6-b1d5-5839-a4f0-59265aa25b31_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ug%252Fbb06516bcce948e997bd3eaee2f3435f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ug/bb06516bcce948e997bd3eaee2f3435f/images/large/4.jpg saved to cache
2026-03-26 22:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bef7e0b6-b1d5-5839-a4f0-59265aa25b31
2026-03-26 22:45:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b787d850>
2026-03-26 22:45:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bef7e0b6-b1d5-5839-a4f0-59265aa25b31/bef7e0b6-b1d5-5839-a4f0-59265aa25b31_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ug%252Fbb06516bcce948e997bd3eaee2f3435f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ug/bb06516bcce948e997bd3eaee2f3435f/images/large/2.jpg saved to cache
2026-03-26 22:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bef7e0b6-b1d5-5839-a4f0-59265aa25b31
2026-03-26 22:45:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76618d0>
2026-03-26 22:45:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bef7e0b6-b1d5-5839-a4f0-59265aa25b31/bef7e0b6-b1d5-5839-a4f0-59265aa25b31_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ug%252Fbb06516bcce948e997bd3eaee2f3435f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ug/bb06516bcce948e997bd3eaee2f3435f/images/large/8.jpg saved to cache
2026-03-26 22:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bef7e0b6-b1d5-5839-a4f0-59265aa25b31
2026-03-26 22:45:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ug/bb06516bcce948e997bd3eaee2f3435f/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1we%252Ff03c39eaeb884932912013040822ffea%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1we/f03c39eaeb884932912013040822ffea/images/large/3.jpg not downloaded yet
2026-03-26 22:45:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1uq/050ba0a64c3e4e17b40825de497728ef/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1uq/050ba0a64c3e4e17b40825de497728ef/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1we%252Ff03c39eaeb884932912013040822ffea%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1we/f03c39eaeb884932912013040822ffea/images/large/4.jpg not downloaded yet
2026-03-26 22:45:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ug/bb06516bcce948e997bd3eaee2f3435f/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7474950>
2026-03-26 22:45:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bef7e0b6-b1d5-5839-a4f0-59265aa25b31/bef7e0b6-b1d5-5839-a4f0-59265aa25b31_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ug%252Fbb06516bcce948e997bd3eaee2f3435f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ug/bb06516bcce948e997bd3eaee2f3435f/images/large/6.jpg saved to cache
2026-03-26 22:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bef7e0b6-b1d5-5839-a4f0-59265aa25b31
2026-03-26 22:45:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7490a50>
2026-03-26 22:45:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bef7e0b6-b1d5-5839-a4f0-59265aa25b31/bef7e0b6-b1d5-5839-a4f0-59265aa25b31_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ug%252Fbb06516bcce948e997bd3eaee2f3435f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ug/bb06516bcce948e997bd3eaee2f3435f/images/large/7.jpg saved to cache
2026-03-26 22:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bef7e0b6-b1d5-5839-a4f0-59265aa25b31
2026-03-26 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1we%252Ff03c39eaeb884932912013040822ffea%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1we/f03c39eaeb884932912013040822ffea/images/large/5.jpg not downloaded yet
2026-03-26 22:45:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ug/bb06516bcce948e997bd3eaee2f3435f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1uq/050ba0a64c3e4e17b40825de497728ef/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1we%252Ff03c39eaeb884932912013040822ffea%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1we/f03c39eaeb884932912013040822ffea/images/large/6.jpg not downloaded yet
2026-03-26 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1we%252Ff03c39eaeb884932912013040822ffea%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1we/f03c39eaeb884932912013040822ffea/images/large/7.jpg not downloaded yet
2026-03-26 22:45:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74a4e50>
2026-03-26 22:45:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bef7e0b6-b1d5-5839-a4f0-59265aa25b31/bef7e0b6-b1d5-5839-a4f0-59265aa25b31_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ug%252Fbb06516bcce948e997bd3eaee2f3435f%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ug/bb06516bcce948e997bd3eaee2f3435f/images/large/9.jpg saved to cache
2026-03-26 22:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bef7e0b6-b1d5-5839-a4f0-59265aa25b31
2026-03-26 22:45:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7661490>
2026-03-26 22:45:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8c10ba7-dcda-584c-b6d0-87c4bf987176/f8c10ba7-dcda-584c-b6d0-87c4bf987176_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252F050ba0a64c3e4e17b40825de497728ef%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/050ba0a64c3e4e17b40825de497728ef/images/large/1.jpg saved to cache
2026-03-26 22:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f8c10ba7-dcda-584c-b6d0-87c4bf987176
2026-03-26 22:45:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cb0dd0>
2026-03-26 22:45:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8c10ba7-dcda-584c-b6d0-87c4bf987176/f8c10ba7-dcda-584c-b6d0-87c4bf987176_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252F050ba0a64c3e4e17b40825de497728ef%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/050ba0a64c3e4e17b40825de497728ef/images/large/2.jpg saved to cache
2026-03-26 22:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f8c10ba7-dcda-584c-b6d0-87c4bf987176
2026-03-26 22:45:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76cd310>
2026-03-26 22:45:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bef7e0b6-b1d5-5839-a4f0-59265aa25b31/bef7e0b6-b1d5-5839-a4f0-59265aa25b31_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ug%252Fbb06516bcce948e997bd3eaee2f3435f%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ug/bb06516bcce948e997bd3eaee2f3435f/images/large/10.jpg saved to cache
2026-03-26 22:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bef7e0b6-b1d5-5839-a4f0-59265aa25b31
2026-03-26 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1we%252Ff03c39eaeb884932912013040822ffea%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1we/f03c39eaeb884932912013040822ffea/images/large/8.jpg not downloaded yet
2026-03-26 22:45:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1uq/050ba0a64c3e4e17b40825de497728ef/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1uq/050ba0a64c3e4e17b40825de497728ef/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1we%252Ff03c39eaeb884932912013040822ffea%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1we/f03c39eaeb884932912013040822ffea/images/large/9.jpg not downloaded yet
2026-03-26 22:45:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1vu/9b7ddb97a28f4899b10f5ea87306b7d0/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1vu/9b7ddb97a28f4899b10f5ea87306b7d0/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cbf9d0>
2026-03-26 22:45:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bef7e0b6-b1d5-5839-a4f0-59265aa25b31/bef7e0b6-b1d5-5839-a4f0-59265aa25b31_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ug%252Fbb06516bcce948e997bd3eaee2f3435f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ug/bb06516bcce948e997bd3eaee2f3435f/images/large/1.jpg saved to cache
2026-03-26 22:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bef7e0b6-b1d5-5839-a4f0-59265aa25b31
2026-03-26 22:45:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bef7e0b6-b1d5-5839-a4f0-59265aa25b31, skipping ID generation
2026-03-26 22:45:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bef7e0b6-b1d5-5839-a4f0-59265aa25b31 with scrape type 1
2026-03-26 22:45:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bef7e0b6-b1d5-5839-a4f0-59265aa25b31 sending to next pipeline
2026-03-26 22:45:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: bef7e0b6-b1d5-5839-a4f0-59265aa25b31, identifier: 1986030
2026-03-26 22:45:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c75e10>
2026-03-26 22:45:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8c10ba7-dcda-584c-b6d0-87c4bf987176/f8c10ba7-dcda-584c-b6d0-87c4bf987176_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252F050ba0a64c3e4e17b40825de497728ef%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/050ba0a64c3e4e17b40825de497728ef/images/large/3.jpg saved to cache
2026-03-26 22:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f8c10ba7-dcda-584c-b6d0-87c4bf987176
2026-03-26 22:45:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1vu/9b7ddb97a28f4899b10f5ea87306b7d0/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1vu/9b7ddb97a28f4899b10f5ea87306b7d0/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1we%252Ff03c39eaeb884932912013040822ffea%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1we/f03c39eaeb884932912013040822ffea/images/large/10.jpg not downloaded yet
2026-03-26 22:45:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: bef7e0b6-b1d5-5839-a4f0-59265aa25b31 with identifier: 1986030
2026-03-26 22:45:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: bef7e0b6-b1d5-5839-a4f0-59265aa25b31 with identifier: 1986030
2026-03-26 22:45:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: bef7e0b6-b1d5-5839-a4f0-59265aa25b31 with identifier: 1986030 to the API
2026-03-26 22:45:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:45:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:45:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1ug/bb06516bcce948e997bd3eaee2f3435f/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'bef7e0b6-b1d5-5839-a4f0-59265aa25b31',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT 2T 350M FOU MWB HR DSL',
 'odometer': 117305,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bef7e0b6-b1d5-5839-a4f0-59265aa25b31/bef7e0b6-b1d5-5839-a4f0-59265aa25b31_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 424727,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ug/bb06516bcce948e997bd3eaee2f3435f/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bef7e0b6-b1d5-5839-a4f0-59265aa25b31/bef7e0b6-b1d5-5839-a4f0-59265aa25b31_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 438954,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ug/bb06516bcce948e997bd3eaee2f3435f/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bef7e0b6-b1d5-5839-a4f0-59265aa25b31/bef7e0b6-b1d5-5839-a4f0-59265aa25b31_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 555117,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ug/bb06516bcce948e997bd3eaee2f3435f/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bef7e0b6-b1d5-5839-a4f0-59265aa25b31/bef7e0b6-b1d5-5839-a4f0-59265aa25b31_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 554463,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ug/bb06516bcce948e997bd3eaee2f3435f/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bef7e0b6-b1d5-5839-a4f0-59265aa25b31/bef7e0b6-b1d5-5839-a4f0-59265aa25b31_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 479586,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ug/bb06516bcce948e997bd3eaee2f3435f/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bef7e0b6-b1d5-5839-a4f0-59265aa25b31/bef7e0b6-b1d5-5839-a4f0-59265aa25b31_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 306983,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ug/bb06516bcce948e997bd3eaee2f3435f/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bef7e0b6-b1d5-5839-a4f0-59265aa25b31/bef7e0b6-b1d5-5839-a4f0-59265aa25b31_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 404325,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ug/bb06516bcce948e997bd3eaee2f3435f/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bef7e0b6-b1d5-5839-a4f0-59265aa25b31/bef7e0b6-b1d5-5839-a4f0-59265aa25b31_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 482083,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ug/bb06516bcce948e997bd3eaee2f3435f/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bef7e0b6-b1d5-5839-a4f0-59265aa25b31/bef7e0b6-b1d5-5839-a4f0-59265aa25b31_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 392833,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ug/bb06516bcce948e997bd3eaee2f3435f/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bef7e0b6-b1d5-5839-a4f0-59265aa25b31/bef7e0b6-b1d5-5839-a4f0-59265aa25b31_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 421747,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ug/bb06516bcce948e997bd3eaee2f3435f/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-08',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FORD TRANSIT 2T 350M FOU MWB HR DSL 2.0 TDCi L2H2 Trend',
 'transmission': 'manual',
 'trim': '2.0 TDCi L2H2 Trend',
 'vin': None,
 'year': 2018}
2026-03-26 22:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986030%27 HTTP/1.1" 200 None
2026-03-26 22:45:34 [ayvens.be] INFO: Saving data for 1986030: {'created_time': 1774565134.638848, 'last_price_update_time': 1774565134.638859, 'auction_closing_time': 1775028600.0}
2026-03-26 22:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986030') HTTP/1.1" 204 0
2026-03-26 22:45:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1uq/050ba0a64c3e4e17b40825de497728ef/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1vu/9b7ddb97a28f4899b10f5ea87306b7d0/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:34 [ayvens.be] INFO: Found listing with ID: 1986034
2026-03-26 22:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986034%27 HTTP/1.1" 200 None
2026-03-26 22:45:34 [ayvens.be] INFO: Scrape type for 1986034: 1
2026-03-26 22:45:34 [ayvens.be] INFO: Extracting data for car ID: 1986034
2026-03-26 22:45:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 274ec52a-7bd4-5d37-b9e6-692b9194f3b0 with identifier: 1986034
2026-03-26 22:45:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 274ec52a-7bd4-5d37-b9e6-692b9194f3b0 with scrape type 1
2026-03-26 22:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 274ec52a-7bd4-5d37-b9e6-692b9194f3b0
2026-03-26 22:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F0b409d9e577849b4bc1dea34a18003da%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/0b409d9e577849b4bc1dea34a18003da/images/large/1.jpg not downloaded yet
2026-03-26 22:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F0b409d9e577849b4bc1dea34a18003da%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/0b409d9e577849b4bc1dea34a18003da/images/large/2.jpg not downloaded yet
2026-03-26 22:45:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5ca5850>
2026-03-26 22:45:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8c10ba7-dcda-584c-b6d0-87c4bf987176/f8c10ba7-dcda-584c-b6d0-87c4bf987176_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252F050ba0a64c3e4e17b40825de497728ef%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/050ba0a64c3e4e17b40825de497728ef/images/large/5.jpg saved to cache
2026-03-26 22:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f8c10ba7-dcda-584c-b6d0-87c4bf987176
2026-03-26 22:45:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b784d850>
2026-03-26 22:45:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8c10ba7-dcda-584c-b6d0-87c4bf987176/f8c10ba7-dcda-584c-b6d0-87c4bf987176_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252F050ba0a64c3e4e17b40825de497728ef%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/050ba0a64c3e4e17b40825de497728ef/images/large/6.jpg saved to cache
2026-03-26 22:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f8c10ba7-dcda-584c-b6d0-87c4bf987176
2026-03-26 22:45:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b777b2d0>
2026-03-26 22:45:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2cb1b635-e8bd-5d2b-b2e9-f8ab404a9da8/2cb1b635-e8bd-5d2b-b2e9-f8ab404a9da8_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vu%252F9b7ddb97a28f4899b10f5ea87306b7d0%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vu/9b7ddb97a28f4899b10f5ea87306b7d0/images/large/3.jpg saved to cache
2026-03-26 22:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2cb1b635-e8bd-5d2b-b2e9-f8ab404a9da8
2026-03-26 22:45:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b75036d0>
2026-03-26 22:45:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2cb1b635-e8bd-5d2b-b2e9-f8ab404a9da8/2cb1b635-e8bd-5d2b-b2e9-f8ab404a9da8_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vu%252F9b7ddb97a28f4899b10f5ea87306b7d0%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vu/9b7ddb97a28f4899b10f5ea87306b7d0/images/large/6.jpg saved to cache
2026-03-26 22:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2cb1b635-e8bd-5d2b-b2e9-f8ab404a9da8
2026-03-26 22:45:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7500e50>
2026-03-26 22:45:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2cb1b635-e8bd-5d2b-b2e9-f8ab404a9da8/2cb1b635-e8bd-5d2b-b2e9-f8ab404a9da8_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vu%252F9b7ddb97a28f4899b10f5ea87306b7d0%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vu/9b7ddb97a28f4899b10f5ea87306b7d0/images/large/8.jpg saved to cache
2026-03-26 22:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2cb1b635-e8bd-5d2b-b2e9-f8ab404a9da8
2026-03-26 22:45:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76e0e50>
2026-03-26 22:45:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2cb1b635-e8bd-5d2b-b2e9-f8ab404a9da8/2cb1b635-e8bd-5d2b-b2e9-f8ab404a9da8_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vu%252F9b7ddb97a28f4899b10f5ea87306b7d0%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vu/9b7ddb97a28f4899b10f5ea87306b7d0/images/large/4.jpg saved to cache
2026-03-26 22:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2cb1b635-e8bd-5d2b-b2e9-f8ab404a9da8
2026-03-26 22:45:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1vu/9b7ddb97a28f4899b10f5ea87306b7d0/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F0b409d9e577849b4bc1dea34a18003da%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/0b409d9e577849b4bc1dea34a18003da/images/large/3.jpg not downloaded yet
2026-03-26 22:45:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1we/f03c39eaeb884932912013040822ffea/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1we/f03c39eaeb884932912013040822ffea/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F0b409d9e577849b4bc1dea34a18003da%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/0b409d9e577849b4bc1dea34a18003da/images/large/4.jpg not downloaded yet
2026-03-26 22:45:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7590210>
2026-03-26 22:45:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8c10ba7-dcda-584c-b6d0-87c4bf987176/f8c10ba7-dcda-584c-b6d0-87c4bf987176_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252F050ba0a64c3e4e17b40825de497728ef%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/050ba0a64c3e4e17b40825de497728ef/images/large/4.jpg saved to cache
2026-03-26 22:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f8c10ba7-dcda-584c-b6d0-87c4bf987176
2026-03-26 22:45:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7400610>
2026-03-26 22:45:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2cb1b635-e8bd-5d2b-b2e9-f8ab404a9da8/2cb1b635-e8bd-5d2b-b2e9-f8ab404a9da8_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vu%252F9b7ddb97a28f4899b10f5ea87306b7d0%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vu/9b7ddb97a28f4899b10f5ea87306b7d0/images/large/7.jpg saved to cache
2026-03-26 22:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2cb1b635-e8bd-5d2b-b2e9-f8ab404a9da8
2026-03-26 22:45:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1we/f03c39eaeb884932912013040822ffea/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1vu/9b7ddb97a28f4899b10f5ea87306b7d0/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1vu/9b7ddb97a28f4899b10f5ea87306b7d0/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F0b409d9e577849b4bc1dea34a18003da%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/0b409d9e577849b4bc1dea34a18003da/images/large/5.jpg not downloaded yet
2026-03-26 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F0b409d9e577849b4bc1dea34a18003da%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/0b409d9e577849b4bc1dea34a18003da/images/large/6.jpg not downloaded yet
2026-03-26 22:45:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1we/f03c39eaeb884932912013040822ffea/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1we/f03c39eaeb884932912013040822ffea/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F0b409d9e577849b4bc1dea34a18003da%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/0b409d9e577849b4bc1dea34a18003da/images/large/7.jpg not downloaded yet
2026-03-26 22:45:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7425e50>
2026-03-26 22:45:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2cb1b635-e8bd-5d2b-b2e9-f8ab404a9da8/2cb1b635-e8bd-5d2b-b2e9-f8ab404a9da8_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vu%252F9b7ddb97a28f4899b10f5ea87306b7d0%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vu/9b7ddb97a28f4899b10f5ea87306b7d0/images/large/10.jpg saved to cache
2026-03-26 22:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2cb1b635-e8bd-5d2b-b2e9-f8ab404a9da8
2026-03-26 22:45:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e3d450>
2026-03-26 22:45:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d534795d-7047-5bbb-884f-a5faa15342d5/d534795d-7047-5bbb-884f-a5faa15342d5_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1we%252Ff03c39eaeb884932912013040822ffea%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1we/f03c39eaeb884932912013040822ffea/images/large/2.jpg saved to cache
2026-03-26 22:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d534795d-7047-5bbb-884f-a5faa15342d5
2026-03-26 22:45:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7429b10>
2026-03-26 22:45:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d534795d-7047-5bbb-884f-a5faa15342d5/d534795d-7047-5bbb-884f-a5faa15342d5_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1we%252Ff03c39eaeb884932912013040822ffea%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1we/f03c39eaeb884932912013040822ffea/images/large/1.jpg saved to cache
2026-03-26 22:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d534795d-7047-5bbb-884f-a5faa15342d5
2026-03-26 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F0b409d9e577849b4bc1dea34a18003da%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/0b409d9e577849b4bc1dea34a18003da/images/large/8.jpg not downloaded yet
2026-03-26 22:45:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1we/f03c39eaeb884932912013040822ffea/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F0b409d9e577849b4bc1dea34a18003da%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/0b409d9e577849b4bc1dea34a18003da/images/large/9.jpg not downloaded yet
2026-03-26 22:45:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1we/f03c39eaeb884932912013040822ffea/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1vu/9b7ddb97a28f4899b10f5ea87306b7d0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7475150>
2026-03-26 22:45:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d534795d-7047-5bbb-884f-a5faa15342d5/d534795d-7047-5bbb-884f-a5faa15342d5_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1we%252Ff03c39eaeb884932912013040822ffea%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1we/f03c39eaeb884932912013040822ffea/images/large/3.jpg saved to cache
2026-03-26 22:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d534795d-7047-5bbb-884f-a5faa15342d5
2026-03-26 22:45:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7778410>
2026-03-26 22:45:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2cb1b635-e8bd-5d2b-b2e9-f8ab404a9da8/2cb1b635-e8bd-5d2b-b2e9-f8ab404a9da8_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vu%252F9b7ddb97a28f4899b10f5ea87306b7d0%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vu/9b7ddb97a28f4899b10f5ea87306b7d0/images/large/5.jpg saved to cache
2026-03-26 22:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2cb1b635-e8bd-5d2b-b2e9-f8ab404a9da8
2026-03-26 22:45:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e4dc50>
2026-03-26 22:45:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2cb1b635-e8bd-5d2b-b2e9-f8ab404a9da8/2cb1b635-e8bd-5d2b-b2e9-f8ab404a9da8_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vu%252F9b7ddb97a28f4899b10f5ea87306b7d0%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vu/9b7ddb97a28f4899b10f5ea87306b7d0/images/large/9.jpg saved to cache
2026-03-26 22:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2cb1b635-e8bd-5d2b-b2e9-f8ab404a9da8
2026-03-26 22:45:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c82250>
2026-03-26 22:45:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d534795d-7047-5bbb-884f-a5faa15342d5/d534795d-7047-5bbb-884f-a5faa15342d5_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1we%252Ff03c39eaeb884932912013040822ffea%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1we/f03c39eaeb884932912013040822ffea/images/large/5.jpg saved to cache
2026-03-26 22:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d534795d-7047-5bbb-884f-a5faa15342d5
2026-03-26 22:45:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5ca7450>
2026-03-26 22:45:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d534795d-7047-5bbb-884f-a5faa15342d5/d534795d-7047-5bbb-884f-a5faa15342d5_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1we%252Ff03c39eaeb884932912013040822ffea%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1we/f03c39eaeb884932912013040822ffea/images/large/4.jpg saved to cache
2026-03-26 22:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d534795d-7047-5bbb-884f-a5faa15342d5
2026-03-26 22:45:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1vu/9b7ddb97a28f4899b10f5ea87306b7d0/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F0b409d9e577849b4bc1dea34a18003da%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/0b409d9e577849b4bc1dea34a18003da/images/large/10.jpg not downloaded yet
2026-03-26 22:45:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1we/f03c39eaeb884932912013040822ffea/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:36 [ayvens.be] INFO: Found listing with ID: 1986035
2026-03-26 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986035%27 HTTP/1.1" 200 None
2026-03-26 22:45:36 [ayvens.be] INFO: Scrape type for 1986035: 1
2026-03-26 22:45:36 [ayvens.be] INFO: Extracting data for car ID: 1986035
2026-03-26 22:45:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 989f5ad8-eedf-5233-b3f7-d3719562d97e with identifier: 1986035
2026-03-26 22:45:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 989f5ad8-eedf-5233-b3f7-d3719562d97e with scrape type 1
2026-03-26 22:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 989f5ad8-eedf-5233-b3f7-d3719562d97e
2026-03-26 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F716ad00bc0ee4ed38c9ee8e872bd7084%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/716ad00bc0ee4ed38c9ee8e872bd7084/images/large/1.jpg not downloaded yet
2026-03-26 22:45:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1we/f03c39eaeb884932912013040822ffea/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F716ad00bc0ee4ed38c9ee8e872bd7084%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/716ad00bc0ee4ed38c9ee8e872bd7084/images/large/2.jpg not downloaded yet
2026-03-26 22:45:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5ca7a50>
2026-03-26 22:45:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d534795d-7047-5bbb-884f-a5faa15342d5/d534795d-7047-5bbb-884f-a5faa15342d5_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1we%252Ff03c39eaeb884932912013040822ffea%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1we/f03c39eaeb884932912013040822ffea/images/large/7.jpg saved to cache
2026-03-26 22:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d534795d-7047-5bbb-884f-a5faa15342d5
2026-03-26 22:45:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b15a50>
2026-03-26 22:45:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d534795d-7047-5bbb-884f-a5faa15342d5/d534795d-7047-5bbb-884f-a5faa15342d5_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1we%252Ff03c39eaeb884932912013040822ffea%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1we/f03c39eaeb884932912013040822ffea/images/large/6.jpg saved to cache
2026-03-26 22:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d534795d-7047-5bbb-884f-a5faa15342d5
2026-03-26 22:45:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7451bd0>
2026-03-26 22:45:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2cb1b635-e8bd-5d2b-b2e9-f8ab404a9da8/2cb1b635-e8bd-5d2b-b2e9-f8ab404a9da8_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vu%252F9b7ddb97a28f4899b10f5ea87306b7d0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vu/9b7ddb97a28f4899b10f5ea87306b7d0/images/large/1.jpg saved to cache
2026-03-26 22:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2cb1b635-e8bd-5d2b-b2e9-f8ab404a9da8
2026-03-26 22:45:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1we/f03c39eaeb884932912013040822ffea/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F716ad00bc0ee4ed38c9ee8e872bd7084%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/716ad00bc0ee4ed38c9ee8e872bd7084/images/large/3.jpg not downloaded yet
2026-03-26 22:45:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1uq/050ba0a64c3e4e17b40825de497728ef/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F716ad00bc0ee4ed38c9ee8e872bd7084%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/716ad00bc0ee4ed38c9ee8e872bd7084/images/large/4.jpg not downloaded yet
2026-03-26 22:45:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c6a6d0>
2026-03-26 22:45:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2cb1b635-e8bd-5d2b-b2e9-f8ab404a9da8/2cb1b635-e8bd-5d2b-b2e9-f8ab404a9da8_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vu%252F9b7ddb97a28f4899b10f5ea87306b7d0%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vu/9b7ddb97a28f4899b10f5ea87306b7d0/images/large/2.jpg saved to cache
2026-03-26 22:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2cb1b635-e8bd-5d2b-b2e9-f8ab404a9da8
2026-03-26 22:45:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2cb1b635-e8bd-5d2b-b2e9-f8ab404a9da8, skipping ID generation
2026-03-26 22:45:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2cb1b635-e8bd-5d2b-b2e9-f8ab404a9da8 with scrape type 1
2026-03-26 22:45:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2cb1b635-e8bd-5d2b-b2e9-f8ab404a9da8 sending to next pipeline
2026-03-26 22:45:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 2cb1b635-e8bd-5d2b-b2e9-f8ab404a9da8, identifier: 1986032
2026-03-26 22:45:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b746e690>
2026-03-26 22:45:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d534795d-7047-5bbb-884f-a5faa15342d5/d534795d-7047-5bbb-884f-a5faa15342d5_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1we%252Ff03c39eaeb884932912013040822ffea%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1we/f03c39eaeb884932912013040822ffea/images/large/9.jpg saved to cache
2026-03-26 22:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d534795d-7047-5bbb-884f-a5faa15342d5
2026-03-26 22:45:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e12850>
2026-03-26 22:45:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d534795d-7047-5bbb-884f-a5faa15342d5/d534795d-7047-5bbb-884f-a5faa15342d5_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1we%252Ff03c39eaeb884932912013040822ffea%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1we/f03c39eaeb884932912013040822ffea/images/large/8.jpg saved to cache
2026-03-26 22:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d534795d-7047-5bbb-884f-a5faa15342d5
2026-03-26 22:45:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 2cb1b635-e8bd-5d2b-b2e9-f8ab404a9da8 with identifier: 1986032
2026-03-26 22:45:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 2cb1b635-e8bd-5d2b-b2e9-f8ab404a9da8 with identifier: 1986032
2026-03-26 22:45:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 2cb1b635-e8bd-5d2b-b2e9-f8ab404a9da8 with identifier: 1986032 to the API
2026-03-26 22:45:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:45:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:45:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1vu/9b7ddb97a28f4899b10f5ea87306b7d0/images/large/2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '2cb1b635-e8bd-5d2b-b2e9-f8ab404a9da8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT 2T 350M FOU MWB HR DSL',
 'odometer': 92238,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cb1b635-e8bd-5d2b-b2e9-f8ab404a9da8/2cb1b635-e8bd-5d2b-b2e9-f8ab404a9da8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 259800,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1vu/9b7ddb97a28f4899b10f5ea87306b7d0/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cb1b635-e8bd-5d2b-b2e9-f8ab404a9da8/2cb1b635-e8bd-5d2b-b2e9-f8ab404a9da8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 261493,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1vu/9b7ddb97a28f4899b10f5ea87306b7d0/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cb1b635-e8bd-5d2b-b2e9-f8ab404a9da8/2cb1b635-e8bd-5d2b-b2e9-f8ab404a9da8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 281755,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1vu/9b7ddb97a28f4899b10f5ea87306b7d0/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cb1b635-e8bd-5d2b-b2e9-f8ab404a9da8/2cb1b635-e8bd-5d2b-b2e9-f8ab404a9da8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 279222,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1vu/9b7ddb97a28f4899b10f5ea87306b7d0/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cb1b635-e8bd-5d2b-b2e9-f8ab404a9da8/2cb1b635-e8bd-5d2b-b2e9-f8ab404a9da8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 265376,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1vu/9b7ddb97a28f4899b10f5ea87306b7d0/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cb1b635-e8bd-5d2b-b2e9-f8ab404a9da8/2cb1b635-e8bd-5d2b-b2e9-f8ab404a9da8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 218571,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1vu/9b7ddb97a28f4899b10f5ea87306b7d0/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cb1b635-e8bd-5d2b-b2e9-f8ab404a9da8/2cb1b635-e8bd-5d2b-b2e9-f8ab404a9da8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 426868,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1vu/9b7ddb97a28f4899b10f5ea87306b7d0/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cb1b635-e8bd-5d2b-b2e9-f8ab404a9da8/2cb1b635-e8bd-5d2b-b2e9-f8ab404a9da8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 293671,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1vu/9b7ddb97a28f4899b10f5ea87306b7d0/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cb1b635-e8bd-5d2b-b2e9-f8ab404a9da8/2cb1b635-e8bd-5d2b-b2e9-f8ab404a9da8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 285532,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1vu/9b7ddb97a28f4899b10f5ea87306b7d0/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cb1b635-e8bd-5d2b-b2e9-f8ab404a9da8/2cb1b635-e8bd-5d2b-b2e9-f8ab404a9da8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 298878,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1vu/9b7ddb97a28f4899b10f5ea87306b7d0/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-05',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FORD TRANSIT 2T 350M FOU MWB HR DSL 2.0 TDCi L2H2 Trend',
 'transmission': 'manual',
 'trim': '2.0 TDCi L2H2 Trend',
 'vin': None,
 'year': 2019}
2026-03-26 22:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986032%27 HTTP/1.1" 200 None
2026-03-26 22:45:37 [ayvens.be] INFO: Saving data for 1986032: {'created_time': 1774565137.768081, 'last_price_update_time': 1774565137.768091, 'auction_closing_time': 1775028600.0}
2026-03-26 22:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986032') HTTP/1.1" 204 0
2026-03-26 22:45:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/0b409d9e577849b4bc1dea34a18003da/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F716ad00bc0ee4ed38c9ee8e872bd7084%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/716ad00bc0ee4ed38c9ee8e872bd7084/images/large/5.jpg not downloaded yet
2026-03-26 22:45:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/0b409d9e577849b4bc1dea34a18003da/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1uq/050ba0a64c3e4e17b40825de497728ef/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F716ad00bc0ee4ed38c9ee8e872bd7084%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/716ad00bc0ee4ed38c9ee8e872bd7084/images/large/6.jpg not downloaded yet
2026-03-26 22:45:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b75a7c90>
2026-03-26 22:45:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d534795d-7047-5bbb-884f-a5faa15342d5/d534795d-7047-5bbb-884f-a5faa15342d5_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1we%252Ff03c39eaeb884932912013040822ffea%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1we/f03c39eaeb884932912013040822ffea/images/large/10.jpg saved to cache
2026-03-26 22:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d534795d-7047-5bbb-884f-a5faa15342d5
2026-03-26 22:45:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d534795d-7047-5bbb-884f-a5faa15342d5, skipping ID generation
2026-03-26 22:45:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d534795d-7047-5bbb-884f-a5faa15342d5 with scrape type 1
2026-03-26 22:45:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d534795d-7047-5bbb-884f-a5faa15342d5 sending to next pipeline
2026-03-26 22:45:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d534795d-7047-5bbb-884f-a5faa15342d5, identifier: 1986033
2026-03-26 22:45:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e37050>
2026-03-26 22:45:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8c10ba7-dcda-584c-b6d0-87c4bf987176/f8c10ba7-dcda-584c-b6d0-87c4bf987176_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252F050ba0a64c3e4e17b40825de497728ef%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/050ba0a64c3e4e17b40825de497728ef/images/large/10.jpg saved to cache
2026-03-26 22:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f8c10ba7-dcda-584c-b6d0-87c4bf987176
2026-03-26 22:45:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/0b409d9e577849b4bc1dea34a18003da/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/0b409d9e577849b4bc1dea34a18003da/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F716ad00bc0ee4ed38c9ee8e872bd7084%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/716ad00bc0ee4ed38c9ee8e872bd7084/images/large/7.jpg not downloaded yet
2026-03-26 22:45:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d534795d-7047-5bbb-884f-a5faa15342d5 with identifier: 1986033
2026-03-26 22:45:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d534795d-7047-5bbb-884f-a5faa15342d5 with identifier: 1986033
2026-03-26 22:45:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d534795d-7047-5bbb-884f-a5faa15342d5 with identifier: 1986033 to the API
2026-03-26 22:45:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:45:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:45:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1we/f03c39eaeb884932912013040822ffea/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'd534795d-7047-5bbb-884f-a5faa15342d5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT 2T 350M FOU MWB HR DSL',
 'odometer': 95016,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d534795d-7047-5bbb-884f-a5faa15342d5/d534795d-7047-5bbb-884f-a5faa15342d5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 503433,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1we/f03c39eaeb884932912013040822ffea/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d534795d-7047-5bbb-884f-a5faa15342d5/d534795d-7047-5bbb-884f-a5faa15342d5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 379137,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1we/f03c39eaeb884932912013040822ffea/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d534795d-7047-5bbb-884f-a5faa15342d5/d534795d-7047-5bbb-884f-a5faa15342d5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 576524,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1we/f03c39eaeb884932912013040822ffea/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d534795d-7047-5bbb-884f-a5faa15342d5/d534795d-7047-5bbb-884f-a5faa15342d5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 552657,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1we/f03c39eaeb884932912013040822ffea/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d534795d-7047-5bbb-884f-a5faa15342d5/d534795d-7047-5bbb-884f-a5faa15342d5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 473520,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1we/f03c39eaeb884932912013040822ffea/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d534795d-7047-5bbb-884f-a5faa15342d5/d534795d-7047-5bbb-884f-a5faa15342d5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 333348,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1we/f03c39eaeb884932912013040822ffea/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d534795d-7047-5bbb-884f-a5faa15342d5/d534795d-7047-5bbb-884f-a5faa15342d5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 451175,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1we/f03c39eaeb884932912013040822ffea/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d534795d-7047-5bbb-884f-a5faa15342d5/d534795d-7047-5bbb-884f-a5faa15342d5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 507100,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1we/f03c39eaeb884932912013040822ffea/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d534795d-7047-5bbb-884f-a5faa15342d5/d534795d-7047-5bbb-884f-a5faa15342d5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 401253,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1we/f03c39eaeb884932912013040822ffea/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d534795d-7047-5bbb-884f-a5faa15342d5/d534795d-7047-5bbb-884f-a5faa15342d5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 363039,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1we/f03c39eaeb884932912013040822ffea/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-14',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FORD TRANSIT 2T 350M FOU MWB HR DSL 2.0 TDCi L2H2 Trend',
 'transmission': 'manual',
 'trim': '2.0 TDCi L2H2 Trend',
 'vin': None,
 'year': 2019}
2026-03-26 22:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986033%27 HTTP/1.1" 200 None
2026-03-26 22:45:38 [ayvens.be] INFO: Saving data for 1986033: {'created_time': 1774565138.457957, 'last_price_update_time': 1774565138.457968, 'auction_closing_time': 1775028600.0}
2026-03-26 22:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986033') HTTP/1.1" 204 0
2026-03-26 22:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F716ad00bc0ee4ed38c9ee8e872bd7084%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/716ad00bc0ee4ed38c9ee8e872bd7084/images/large/8.jpg not downloaded yet
2026-03-26 22:45:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd3c41d0>
2026-03-26 22:45:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_274ec52a-7bd4-5d37-b9e6-692b9194f3b0/274ec52a-7bd4-5d37-b9e6-692b9194f3b0_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F0b409d9e577849b4bc1dea34a18003da%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/0b409d9e577849b4bc1dea34a18003da/images/large/2.jpg saved to cache
2026-03-26 22:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 274ec52a-7bd4-5d37-b9e6-692b9194f3b0
2026-03-26 22:45:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7565dd0>
2026-03-26 22:45:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_274ec52a-7bd4-5d37-b9e6-692b9194f3b0/274ec52a-7bd4-5d37-b9e6-692b9194f3b0_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F0b409d9e577849b4bc1dea34a18003da%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/0b409d9e577849b4bc1dea34a18003da/images/large/3.jpg saved to cache
2026-03-26 22:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 274ec52a-7bd4-5d37-b9e6-692b9194f3b0
2026-03-26 22:45:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7410f10>
2026-03-26 22:45:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8c10ba7-dcda-584c-b6d0-87c4bf987176/f8c10ba7-dcda-584c-b6d0-87c4bf987176_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252F050ba0a64c3e4e17b40825de497728ef%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/050ba0a64c3e4e17b40825de497728ef/images/large/9.jpg saved to cache
2026-03-26 22:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f8c10ba7-dcda-584c-b6d0-87c4bf987176
2026-03-26 22:45:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1uq/050ba0a64c3e4e17b40825de497728ef/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/0b409d9e577849b4bc1dea34a18003da/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/0b409d9e577849b4bc1dea34a18003da/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F716ad00bc0ee4ed38c9ee8e872bd7084%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/716ad00bc0ee4ed38c9ee8e872bd7084/images/large/9.jpg not downloaded yet
2026-03-26 22:45:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e1e490>
2026-03-26 22:45:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_274ec52a-7bd4-5d37-b9e6-692b9194f3b0/274ec52a-7bd4-5d37-b9e6-692b9194f3b0_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F0b409d9e577849b4bc1dea34a18003da%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/0b409d9e577849b4bc1dea34a18003da/images/large/1.jpg saved to cache
2026-03-26 22:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 274ec52a-7bd4-5d37-b9e6-692b9194f3b0
2026-03-26 22:45:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c5ce90>
2026-03-26 22:45:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_274ec52a-7bd4-5d37-b9e6-692b9194f3b0/274ec52a-7bd4-5d37-b9e6-692b9194f3b0_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F0b409d9e577849b4bc1dea34a18003da%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/0b409d9e577849b4bc1dea34a18003da/images/large/4.jpg saved to cache
2026-03-26 22:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 274ec52a-7bd4-5d37-b9e6-692b9194f3b0
2026-03-26 22:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F716ad00bc0ee4ed38c9ee8e872bd7084%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/716ad00bc0ee4ed38c9ee8e872bd7084/images/large/10.jpg not downloaded yet
2026-03-26 22:45:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1uq/050ba0a64c3e4e17b40825de497728ef/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:39 [ayvens.be] INFO: Found listing with ID: 1986036
2026-03-26 22:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986036%27 HTTP/1.1" 200 None
2026-03-26 22:45:39 [ayvens.be] INFO: Scrape type for 1986036: 1
2026-03-26 22:45:39 [ayvens.be] INFO: Extracting data for car ID: 1986036
2026-03-26 22:45:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9c31b26-dc78-56c7-b825-76271aa2099c with identifier: 1986036
2026-03-26 22:45:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9c31b26-dc78-56c7-b825-76271aa2099c with scrape type 1
2026-03-26 22:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c9c31b26-dc78-56c7-b825-76271aa2099c
2026-03-26 22:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fba3720cd0d1340b8b03120b4e36effb6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/ba3720cd0d1340b8b03120b4e36effb6/images/large/1.jpg not downloaded yet
2026-03-26 22:45:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7401e10>
2026-03-26 22:45:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8c10ba7-dcda-584c-b6d0-87c4bf987176/f8c10ba7-dcda-584c-b6d0-87c4bf987176_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252F050ba0a64c3e4e17b40825de497728ef%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/050ba0a64c3e4e17b40825de497728ef/images/large/8.jpg saved to cache
2026-03-26 22:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f8c10ba7-dcda-584c-b6d0-87c4bf987176
2026-03-26 22:45:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd3b5a50>
2026-03-26 22:45:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_274ec52a-7bd4-5d37-b9e6-692b9194f3b0/274ec52a-7bd4-5d37-b9e6-692b9194f3b0_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F0b409d9e577849b4bc1dea34a18003da%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/0b409d9e577849b4bc1dea34a18003da/images/large/6.jpg saved to cache
2026-03-26 22:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 274ec52a-7bd4-5d37-b9e6-692b9194f3b0
2026-03-26 22:45:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e4d090>
2026-03-26 22:45:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_274ec52a-7bd4-5d37-b9e6-692b9194f3b0/274ec52a-7bd4-5d37-b9e6-692b9194f3b0_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F0b409d9e577849b4bc1dea34a18003da%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/0b409d9e577849b4bc1dea34a18003da/images/large/5.jpg saved to cache
2026-03-26 22:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 274ec52a-7bd4-5d37-b9e6-692b9194f3b0
2026-03-26 22:45:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/0b409d9e577849b4bc1dea34a18003da/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/0b409d9e577849b4bc1dea34a18003da/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fba3720cd0d1340b8b03120b4e36effb6%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/ba3720cd0d1340b8b03120b4e36effb6/images/large/2.jpg not downloaded yet
2026-03-26 22:45:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/0b409d9e577849b4bc1dea34a18003da/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fba3720cd0d1340b8b03120b4e36effb6%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/ba3720cd0d1340b8b03120b4e36effb6/images/large/3.jpg not downloaded yet
2026-03-26 22:45:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c63690>
2026-03-26 22:45:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8c10ba7-dcda-584c-b6d0-87c4bf987176/f8c10ba7-dcda-584c-b6d0-87c4bf987176_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252F050ba0a64c3e4e17b40825de497728ef%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/050ba0a64c3e4e17b40825de497728ef/images/large/7.jpg saved to cache
2026-03-26 22:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f8c10ba7-dcda-584c-b6d0-87c4bf987176
2026-03-26 22:45:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f8c10ba7-dcda-584c-b6d0-87c4bf987176, skipping ID generation
2026-03-26 22:45:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8c10ba7-dcda-584c-b6d0-87c4bf987176 with scrape type 1
2026-03-26 22:45:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f8c10ba7-dcda-584c-b6d0-87c4bf987176 sending to next pipeline
2026-03-26 22:45:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f8c10ba7-dcda-584c-b6d0-87c4bf987176, identifier: 1986031
2026-03-26 22:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fba3720cd0d1340b8b03120b4e36effb6%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/ba3720cd0d1340b8b03120b4e36effb6/images/large/4.jpg not downloaded yet
2026-03-26 22:45:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f8c10ba7-dcda-584c-b6d0-87c4bf987176 with identifier: 1986031
2026-03-26 22:45:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f8c10ba7-dcda-584c-b6d0-87c4bf987176 with identifier: 1986031
2026-03-26 22:45:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f8c10ba7-dcda-584c-b6d0-87c4bf987176 with identifier: 1986031 to the API
2026-03-26 22:45:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:45:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:45:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1uq/050ba0a64c3e4e17b40825de497728ef/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'f8c10ba7-dcda-584c-b6d0-87c4bf987176',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT 2T 350M FOU MWB HR DSL',
 'odometer': 67891,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8c10ba7-dcda-584c-b6d0-87c4bf987176/f8c10ba7-dcda-584c-b6d0-87c4bf987176_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 426753,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1uq/050ba0a64c3e4e17b40825de497728ef/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8c10ba7-dcda-584c-b6d0-87c4bf987176/f8c10ba7-dcda-584c-b6d0-87c4bf987176_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 442342,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1uq/050ba0a64c3e4e17b40825de497728ef/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8c10ba7-dcda-584c-b6d0-87c4bf987176/f8c10ba7-dcda-584c-b6d0-87c4bf987176_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 594379,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1uq/050ba0a64c3e4e17b40825de497728ef/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8c10ba7-dcda-584c-b6d0-87c4bf987176/f8c10ba7-dcda-584c-b6d0-87c4bf987176_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 585424,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1uq/050ba0a64c3e4e17b40825de497728ef/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8c10ba7-dcda-584c-b6d0-87c4bf987176/f8c10ba7-dcda-584c-b6d0-87c4bf987176_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 512292,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1uq/050ba0a64c3e4e17b40825de497728ef/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8c10ba7-dcda-584c-b6d0-87c4bf987176/f8c10ba7-dcda-584c-b6d0-87c4bf987176_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 418671,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1uq/050ba0a64c3e4e17b40825de497728ef/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8c10ba7-dcda-584c-b6d0-87c4bf987176/f8c10ba7-dcda-584c-b6d0-87c4bf987176_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 434079,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1uq/050ba0a64c3e4e17b40825de497728ef/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8c10ba7-dcda-584c-b6d0-87c4bf987176/f8c10ba7-dcda-584c-b6d0-87c4bf987176_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 505185,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1uq/050ba0a64c3e4e17b40825de497728ef/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8c10ba7-dcda-584c-b6d0-87c4bf987176/f8c10ba7-dcda-584c-b6d0-87c4bf987176_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 440628,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1uq/050ba0a64c3e4e17b40825de497728ef/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8c10ba7-dcda-584c-b6d0-87c4bf987176/f8c10ba7-dcda-584c-b6d0-87c4bf987176_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 412568,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1uq/050ba0a64c3e4e17b40825de497728ef/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-10',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FORD TRANSIT 2T 350M FOU MWB HR DSL 2.0 TDCi L2H2 Trend',
 'transmission': 'manual',
 'trim': '2.0 TDCi L2H2 Trend',
 'vin': None,
 'year': 2018}
2026-03-26 22:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986031%27 HTTP/1.1" 200 None
2026-03-26 22:45:40 [ayvens.be] INFO: Saving data for 1986031: {'created_time': 1774565140.133907, 'last_price_update_time': 1774565140.133917, 'auction_closing_time': 1775028600.0}
2026-03-26 22:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986031') HTTP/1.1" 204 0
2026-03-26 22:45:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/0b409d9e577849b4bc1dea34a18003da/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fba3720cd0d1340b8b03120b4e36effb6%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/ba3720cd0d1340b8b03120b4e36effb6/images/large/5.jpg not downloaded yet
2026-03-26 22:45:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b782fc50>
2026-03-26 22:45:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_274ec52a-7bd4-5d37-b9e6-692b9194f3b0/274ec52a-7bd4-5d37-b9e6-692b9194f3b0_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F0b409d9e577849b4bc1dea34a18003da%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/0b409d9e577849b4bc1dea34a18003da/images/large/7.jpg saved to cache
2026-03-26 22:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 274ec52a-7bd4-5d37-b9e6-692b9194f3b0
2026-03-26 22:45:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b72efc50>
2026-03-26 22:45:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_274ec52a-7bd4-5d37-b9e6-692b9194f3b0/274ec52a-7bd4-5d37-b9e6-692b9194f3b0_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F0b409d9e577849b4bc1dea34a18003da%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/0b409d9e577849b4bc1dea34a18003da/images/large/10.jpg saved to cache
2026-03-26 22:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 274ec52a-7bd4-5d37-b9e6-692b9194f3b0
2026-03-26 22:45:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b787e910>
2026-03-26 22:45:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_274ec52a-7bd4-5d37-b9e6-692b9194f3b0/274ec52a-7bd4-5d37-b9e6-692b9194f3b0_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F0b409d9e577849b4bc1dea34a18003da%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/0b409d9e577849b4bc1dea34a18003da/images/large/9.jpg saved to cache
2026-03-26 22:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 274ec52a-7bd4-5d37-b9e6-692b9194f3b0
2026-03-26 22:45:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/716ad00bc0ee4ed38c9ee8e872bd7084/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fba3720cd0d1340b8b03120b4e36effb6%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/ba3720cd0d1340b8b03120b4e36effb6/images/large/6.jpg not downloaded yet
2026-03-26 22:45:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/716ad00bc0ee4ed38c9ee8e872bd7084/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fba3720cd0d1340b8b03120b4e36effb6%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/ba3720cd0d1340b8b03120b4e36effb6/images/large/7.jpg not downloaded yet
2026-03-26 22:45:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7425b10>
2026-03-26 22:45:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_274ec52a-7bd4-5d37-b9e6-692b9194f3b0/274ec52a-7bd4-5d37-b9e6-692b9194f3b0_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F0b409d9e577849b4bc1dea34a18003da%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/0b409d9e577849b4bc1dea34a18003da/images/large/8.jpg saved to cache
2026-03-26 22:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 274ec52a-7bd4-5d37-b9e6-692b9194f3b0
2026-03-26 22:45:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 274ec52a-7bd4-5d37-b9e6-692b9194f3b0, skipping ID generation
2026-03-26 22:45:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 274ec52a-7bd4-5d37-b9e6-692b9194f3b0 with scrape type 1
2026-03-26 22:45:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 274ec52a-7bd4-5d37-b9e6-692b9194f3b0 sending to next pipeline
2026-03-26 22:45:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 274ec52a-7bd4-5d37-b9e6-692b9194f3b0, identifier: 1986034
2026-03-26 22:45:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/716ad00bc0ee4ed38c9ee8e872bd7084/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 274ec52a-7bd4-5d37-b9e6-692b9194f3b0 with identifier: 1986034
2026-03-26 22:45:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 274ec52a-7bd4-5d37-b9e6-692b9194f3b0 with identifier: 1986034
2026-03-26 22:45:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 274ec52a-7bd4-5d37-b9e6-692b9194f3b0 with identifier: 1986034 to the API
2026-03-26 22:45:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:45:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:45:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bf/0b409d9e577849b4bc1dea34a18003da/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '274ec52a-7bd4-5d37-b9e6-692b9194f3b0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'CITROAu2039N',
 'model': 'GRAND C4 SPACETOURER',
 'odometer': 107725,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_274ec52a-7bd4-5d37-b9e6-692b9194f3b0/274ec52a-7bd4-5d37-b9e6-692b9194f3b0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 594956,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/0b409d9e577849b4bc1dea34a18003da/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_274ec52a-7bd4-5d37-b9e6-692b9194f3b0/274ec52a-7bd4-5d37-b9e6-692b9194f3b0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 595309,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/0b409d9e577849b4bc1dea34a18003da/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_274ec52a-7bd4-5d37-b9e6-692b9194f3b0/274ec52a-7bd4-5d37-b9e6-692b9194f3b0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 547396,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/0b409d9e577849b4bc1dea34a18003da/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_274ec52a-7bd4-5d37-b9e6-692b9194f3b0/274ec52a-7bd4-5d37-b9e6-692b9194f3b0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 614668,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/0b409d9e577849b4bc1dea34a18003da/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_274ec52a-7bd4-5d37-b9e6-692b9194f3b0/274ec52a-7bd4-5d37-b9e6-692b9194f3b0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 528522,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/0b409d9e577849b4bc1dea34a18003da/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_274ec52a-7bd4-5d37-b9e6-692b9194f3b0/274ec52a-7bd4-5d37-b9e6-692b9194f3b0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 567700,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/0b409d9e577849b4bc1dea34a18003da/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_274ec52a-7bd4-5d37-b9e6-692b9194f3b0/274ec52a-7bd4-5d37-b9e6-692b9194f3b0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 582831,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/0b409d9e577849b4bc1dea34a18003da/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_274ec52a-7bd4-5d37-b9e6-692b9194f3b0/274ec52a-7bd4-5d37-b9e6-692b9194f3b0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 631034,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/0b409d9e577849b4bc1dea34a18003da/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_274ec52a-7bd4-5d37-b9e6-692b9194f3b0/274ec52a-7bd4-5d37-b9e6-692b9194f3b0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 477028,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/0b409d9e577849b4bc1dea34a18003da/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_274ec52a-7bd4-5d37-b9e6-692b9194f3b0/274ec52a-7bd4-5d37-b9e6-692b9194f3b0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 512679,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/0b409d9e577849b4bc1dea34a18003da/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-09',
 'seats_number': 7,
 'seller_name': None,
 'title': 'CITROAu2039N GRAND C4 SPACETOURER 1.5 BLUEHDI 130 S-S FEEL AUTO',
 'transmission': 'automatic',
 'trim': '1.5 BLUEHDI 130 S-S FEEL AUTO',
 'vin': None,
 'year': 2021}
2026-03-26 22:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986034%27 HTTP/1.1" 200 None
2026-03-26 22:45:41 [ayvens.be] INFO: Saving data for 1986034: {'created_time': 1774565141.238941, 'last_price_update_time': 1774565141.238953, 'auction_closing_time': 1775028600.0}
2026-03-26 22:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986034') HTTP/1.1" 204 0
2026-03-26 22:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fba3720cd0d1340b8b03120b4e36effb6%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/ba3720cd0d1340b8b03120b4e36effb6/images/large/8.jpg not downloaded yet
2026-03-26 22:45:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/716ad00bc0ee4ed38c9ee8e872bd7084/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/716ad00bc0ee4ed38c9ee8e872bd7084/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fba3720cd0d1340b8b03120b4e36effb6%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/ba3720cd0d1340b8b03120b4e36effb6/images/large/9.jpg not downloaded yet
2026-03-26 22:45:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7279ad0>
2026-03-26 22:45:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_989f5ad8-eedf-5233-b3f7-d3719562d97e/989f5ad8-eedf-5233-b3f7-d3719562d97e_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F716ad00bc0ee4ed38c9ee8e872bd7084%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/716ad00bc0ee4ed38c9ee8e872bd7084/images/large/1.jpg saved to cache
2026-03-26 22:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 989f5ad8-eedf-5233-b3f7-d3719562d97e
2026-03-26 22:45:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e132d0>
2026-03-26 22:45:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_989f5ad8-eedf-5233-b3f7-d3719562d97e/989f5ad8-eedf-5233-b3f7-d3719562d97e_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F716ad00bc0ee4ed38c9ee8e872bd7084%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/716ad00bc0ee4ed38c9ee8e872bd7084/images/large/3.jpg saved to cache
2026-03-26 22:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 989f5ad8-eedf-5233-b3f7-d3719562d97e
2026-03-26 22:45:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7403090>
2026-03-26 22:45:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_989f5ad8-eedf-5233-b3f7-d3719562d97e/989f5ad8-eedf-5233-b3f7-d3719562d97e_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F716ad00bc0ee4ed38c9ee8e872bd7084%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/716ad00bc0ee4ed38c9ee8e872bd7084/images/large/2.jpg saved to cache
2026-03-26 22:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 989f5ad8-eedf-5233-b3f7-d3719562d97e
2026-03-26 22:45:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/716ad00bc0ee4ed38c9ee8e872bd7084/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/716ad00bc0ee4ed38c9ee8e872bd7084/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fba3720cd0d1340b8b03120b4e36effb6%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/ba3720cd0d1340b8b03120b4e36effb6/images/large/10.jpg not downloaded yet
2026-03-26 22:45:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd4d0410>
2026-03-26 22:45:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_989f5ad8-eedf-5233-b3f7-d3719562d97e/989f5ad8-eedf-5233-b3f7-d3719562d97e_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F716ad00bc0ee4ed38c9ee8e872bd7084%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/716ad00bc0ee4ed38c9ee8e872bd7084/images/large/7.jpg saved to cache
2026-03-26 22:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 989f5ad8-eedf-5233-b3f7-d3719562d97e
2026-03-26 22:45:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e3df90>
2026-03-26 22:45:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_989f5ad8-eedf-5233-b3f7-d3719562d97e/989f5ad8-eedf-5233-b3f7-d3719562d97e_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F716ad00bc0ee4ed38c9ee8e872bd7084%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/716ad00bc0ee4ed38c9ee8e872bd7084/images/large/5.jpg saved to cache
2026-03-26 22:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 989f5ad8-eedf-5233-b3f7-d3719562d97e
2026-03-26 22:45:41 [ayvens.be] INFO: Found listing with ID: 1986037
2026-03-26 22:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986037%27 HTTP/1.1" 200 None
2026-03-26 22:45:41 [ayvens.be] INFO: Scrape type for 1986037: 1
2026-03-26 22:45:41 [ayvens.be] INFO: Extracting data for car ID: 1986037
2026-03-26 22:45:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c7d428a-e542-54a6-9d6b-4241d510c1db with identifier: 1986037
2026-03-26 22:45:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c7d428a-e542-54a6-9d6b-4241d510c1db with scrape type 1
2026-03-26 22:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8c7d428a-e542-54a6-9d6b-4241d510c1db
2026-03-26 22:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Ff3a9365bb8a94c4eb3c85ba31b43d646%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/f3a9365bb8a94c4eb3c85ba31b43d646/images/large/1.jpg not downloaded yet
2026-03-26 22:45:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/716ad00bc0ee4ed38c9ee8e872bd7084/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/716ad00bc0ee4ed38c9ee8e872bd7084/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Ff3a9365bb8a94c4eb3c85ba31b43d646%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/f3a9365bb8a94c4eb3c85ba31b43d646/images/large/2.jpg not downloaded yet
2026-03-26 22:45:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5ca7450>
2026-03-26 22:45:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_989f5ad8-eedf-5233-b3f7-d3719562d97e/989f5ad8-eedf-5233-b3f7-d3719562d97e_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F716ad00bc0ee4ed38c9ee8e872bd7084%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/716ad00bc0ee4ed38c9ee8e872bd7084/images/large/6.jpg saved to cache
2026-03-26 22:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 989f5ad8-eedf-5233-b3f7-d3719562d97e
2026-03-26 22:45:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cbd690>
2026-03-26 22:45:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_989f5ad8-eedf-5233-b3f7-d3719562d97e/989f5ad8-eedf-5233-b3f7-d3719562d97e_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F716ad00bc0ee4ed38c9ee8e872bd7084%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/716ad00bc0ee4ed38c9ee8e872bd7084/images/large/4.jpg saved to cache
2026-03-26 22:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 989f5ad8-eedf-5233-b3f7-d3719562d97e
2026-03-26 22:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Ff3a9365bb8a94c4eb3c85ba31b43d646%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/f3a9365bb8a94c4eb3c85ba31b43d646/images/large/3.jpg not downloaded yet
2026-03-26 22:45:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/716ad00bc0ee4ed38c9ee8e872bd7084/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Ff3a9365bb8a94c4eb3c85ba31b43d646%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/f3a9365bb8a94c4eb3c85ba31b43d646/images/large/4.jpg not downloaded yet
2026-03-26 22:45:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e28b90>
2026-03-26 22:45:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_989f5ad8-eedf-5233-b3f7-d3719562d97e/989f5ad8-eedf-5233-b3f7-d3719562d97e_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F716ad00bc0ee4ed38c9ee8e872bd7084%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/716ad00bc0ee4ed38c9ee8e872bd7084/images/large/8.jpg saved to cache
2026-03-26 22:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 989f5ad8-eedf-5233-b3f7-d3719562d97e
2026-03-26 22:45:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b746c9d0>
2026-03-26 22:45:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_989f5ad8-eedf-5233-b3f7-d3719562d97e/989f5ad8-eedf-5233-b3f7-d3719562d97e_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F716ad00bc0ee4ed38c9ee8e872bd7084%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/716ad00bc0ee4ed38c9ee8e872bd7084/images/large/9.jpg saved to cache
2026-03-26 22:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 989f5ad8-eedf-5233-b3f7-d3719562d97e
2026-03-26 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Ff3a9365bb8a94c4eb3c85ba31b43d646%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/f3a9365bb8a94c4eb3c85ba31b43d646/images/large/5.jpg not downloaded yet
2026-03-26 22:45:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/ba3720cd0d1340b8b03120b4e36effb6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Ff3a9365bb8a94c4eb3c85ba31b43d646%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/f3a9365bb8a94c4eb3c85ba31b43d646/images/large/6.jpg not downloaded yet
2026-03-26 22:45:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/ba3720cd0d1340b8b03120b4e36effb6/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/ba3720cd0d1340b8b03120b4e36effb6/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Ff3a9365bb8a94c4eb3c85ba31b43d646%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/f3a9365bb8a94c4eb3c85ba31b43d646/images/large/7.jpg not downloaded yet
2026-03-26 22:45:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74257d0>
2026-03-26 22:45:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_989f5ad8-eedf-5233-b3f7-d3719562d97e/989f5ad8-eedf-5233-b3f7-d3719562d97e_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F716ad00bc0ee4ed38c9ee8e872bd7084%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/716ad00bc0ee4ed38c9ee8e872bd7084/images/large/10.jpg saved to cache
2026-03-26 22:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 989f5ad8-eedf-5233-b3f7-d3719562d97e
2026-03-26 22:45:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 989f5ad8-eedf-5233-b3f7-d3719562d97e, skipping ID generation
2026-03-26 22:45:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 989f5ad8-eedf-5233-b3f7-d3719562d97e with scrape type 1
2026-03-26 22:45:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 989f5ad8-eedf-5233-b3f7-d3719562d97e sending to next pipeline
2026-03-26 22:45:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 989f5ad8-eedf-5233-b3f7-d3719562d97e, identifier: 1986035
2026-03-26 22:45:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/ba3720cd0d1340b8b03120b4e36effb6/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 989f5ad8-eedf-5233-b3f7-d3719562d97e with identifier: 1986035
2026-03-26 22:45:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 989f5ad8-eedf-5233-b3f7-d3719562d97e with identifier: 1986035
2026-03-26 22:45:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 989f5ad8-eedf-5233-b3f7-d3719562d97e with identifier: 1986035 to the API
2026-03-26 22:45:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:45:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:45:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bn/716ad00bc0ee4ed38c9ee8e872bd7084/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '989f5ad8-eedf-5233-b3f7-d3719562d97e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'E-CLASS BREAK',
 'odometer': 156232,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_989f5ad8-eedf-5233-b3f7-d3719562d97e/989f5ad8-eedf-5233-b3f7-d3719562d97e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 776924,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/716ad00bc0ee4ed38c9ee8e872bd7084/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_989f5ad8-eedf-5233-b3f7-d3719562d97e/989f5ad8-eedf-5233-b3f7-d3719562d97e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 757711,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/716ad00bc0ee4ed38c9ee8e872bd7084/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_989f5ad8-eedf-5233-b3f7-d3719562d97e/989f5ad8-eedf-5233-b3f7-d3719562d97e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 674107,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/716ad00bc0ee4ed38c9ee8e872bd7084/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_989f5ad8-eedf-5233-b3f7-d3719562d97e/989f5ad8-eedf-5233-b3f7-d3719562d97e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 765929,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/716ad00bc0ee4ed38c9ee8e872bd7084/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_989f5ad8-eedf-5233-b3f7-d3719562d97e/989f5ad8-eedf-5233-b3f7-d3719562d97e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 602014,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/716ad00bc0ee4ed38c9ee8e872bd7084/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_989f5ad8-eedf-5233-b3f7-d3719562d97e/989f5ad8-eedf-5233-b3f7-d3719562d97e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 698022,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/716ad00bc0ee4ed38c9ee8e872bd7084/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_989f5ad8-eedf-5233-b3f7-d3719562d97e/989f5ad8-eedf-5233-b3f7-d3719562d97e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 563527,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/716ad00bc0ee4ed38c9ee8e872bd7084/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_989f5ad8-eedf-5233-b3f7-d3719562d97e/989f5ad8-eedf-5233-b3f7-d3719562d97e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 751821,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/716ad00bc0ee4ed38c9ee8e872bd7084/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_989f5ad8-eedf-5233-b3f7-d3719562d97e/989f5ad8-eedf-5233-b3f7-d3719562d97e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 539953,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/716ad00bc0ee4ed38c9ee8e872bd7084/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_989f5ad8-eedf-5233-b3f7-d3719562d97e/989f5ad8-eedf-5233-b3f7-d3719562d97e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 670145,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/716ad00bc0ee4ed38c9ee8e872bd7084/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ E-CLASS BREAK 2.0 E 300 DE AUTO BUSINESS SOL AUTO 4MT',
 'transmission': 'automatic',
 'trim': '2.0 E 300 DE AUTO BUSINESS SOL AUTO 4MT',
 'vin': None,
 'year': 2022}
2026-03-26 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986035%27 HTTP/1.1" 200 None
2026-03-26 22:45:42 [ayvens.be] INFO: Saving data for 1986035: {'created_time': 1774565142.827526, 'last_price_update_time': 1774565142.82754, 'auction_closing_time': 1775028600.0}
2026-03-26 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986035') HTTP/1.1" 204 0
2026-03-26 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Ff3a9365bb8a94c4eb3c85ba31b43d646%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/f3a9365bb8a94c4eb3c85ba31b43d646/images/large/8.jpg not downloaded yet
2026-03-26 22:45:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/ba3720cd0d1340b8b03120b4e36effb6/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Ff3a9365bb8a94c4eb3c85ba31b43d646%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/f3a9365bb8a94c4eb3c85ba31b43d646/images/large/9.jpg not downloaded yet
2026-03-26 22:45:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7436ad0>
2026-03-26 22:45:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9c31b26-dc78-56c7-b825-76271aa2099c/c9c31b26-dc78-56c7-b825-76271aa2099c_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fba3720cd0d1340b8b03120b4e36effb6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/ba3720cd0d1340b8b03120b4e36effb6/images/large/1.jpg saved to cache
2026-03-26 22:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c9c31b26-dc78-56c7-b825-76271aa2099c
2026-03-26 22:45:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b787e450>
2026-03-26 22:45:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9c31b26-dc78-56c7-b825-76271aa2099c/c9c31b26-dc78-56c7-b825-76271aa2099c_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fba3720cd0d1340b8b03120b4e36effb6%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/ba3720cd0d1340b8b03120b4e36effb6/images/large/3.jpg saved to cache
2026-03-26 22:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c9c31b26-dc78-56c7-b825-76271aa2099c
2026-03-26 22:45:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74a49d0>
2026-03-26 22:45:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9c31b26-dc78-56c7-b825-76271aa2099c/c9c31b26-dc78-56c7-b825-76271aa2099c_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fba3720cd0d1340b8b03120b4e36effb6%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/ba3720cd0d1340b8b03120b4e36effb6/images/large/4.jpg saved to cache
2026-03-26 22:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c9c31b26-dc78-56c7-b825-76271aa2099c
2026-03-26 22:45:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7268d50>
2026-03-26 22:45:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9c31b26-dc78-56c7-b825-76271aa2099c/c9c31b26-dc78-56c7-b825-76271aa2099c_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fba3720cd0d1340b8b03120b4e36effb6%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/ba3720cd0d1340b8b03120b4e36effb6/images/large/2.jpg saved to cache
2026-03-26 22:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c9c31b26-dc78-56c7-b825-76271aa2099c
2026-03-26 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Ff3a9365bb8a94c4eb3c85ba31b43d646%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/f3a9365bb8a94c4eb3c85ba31b43d646/images/large/10.jpg not downloaded yet
2026-03-26 22:45:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/ba3720cd0d1340b8b03120b4e36effb6/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/ba3720cd0d1340b8b03120b4e36effb6/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:43 [ayvens.be] INFO: Found listing with ID: 1986038
2026-03-26 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986038%27 HTTP/1.1" 200 None
2026-03-26 22:45:43 [ayvens.be] INFO: Scrape type for 1986038: 1
2026-03-26 22:45:43 [ayvens.be] INFO: Extracting data for car ID: 1986038
2026-03-26 22:45:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a785095c-c896-5b3b-9fac-f87b2e173115 with identifier: 1986038
2026-03-26 22:45:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a785095c-c896-5b3b-9fac-f87b2e173115 with scrape type 1
2026-03-26 22:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a785095c-c896-5b3b-9fac-f87b2e173115
2026-03-26 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Fb4ee761506504f42bcc30c4636d70bd1%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/b4ee761506504f42bcc30c4636d70bd1/images/large/1.jpg not downloaded yet
2026-03-26 22:45:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7778b50>
2026-03-26 22:45:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9c31b26-dc78-56c7-b825-76271aa2099c/c9c31b26-dc78-56c7-b825-76271aa2099c_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fba3720cd0d1340b8b03120b4e36effb6%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/ba3720cd0d1340b8b03120b4e36effb6/images/large/5.jpg saved to cache
2026-03-26 22:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c9c31b26-dc78-56c7-b825-76271aa2099c
2026-03-26 22:45:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/f3a9365bb8a94c4eb3c85ba31b43d646/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/ba3720cd0d1340b8b03120b4e36effb6/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Fb4ee761506504f42bcc30c4636d70bd1%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/b4ee761506504f42bcc30c4636d70bd1/images/large/2.jpg not downloaded yet
2026-03-26 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Fb4ee761506504f42bcc30c4636d70bd1%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/b4ee761506504f42bcc30c4636d70bd1/images/large/3.jpg not downloaded yet
2026-03-26 22:45:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/f3a9365bb8a94c4eb3c85ba31b43d646/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b727b310>
2026-03-26 22:45:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9c31b26-dc78-56c7-b825-76271aa2099c/c9c31b26-dc78-56c7-b825-76271aa2099c_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fba3720cd0d1340b8b03120b4e36effb6%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/ba3720cd0d1340b8b03120b4e36effb6/images/large/7.jpg saved to cache
2026-03-26 22:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c9c31b26-dc78-56c7-b825-76271aa2099c
2026-03-26 22:45:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7482ad0>
2026-03-26 22:45:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9c31b26-dc78-56c7-b825-76271aa2099c/c9c31b26-dc78-56c7-b825-76271aa2099c_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fba3720cd0d1340b8b03120b4e36effb6%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/ba3720cd0d1340b8b03120b4e36effb6/images/large/8.jpg saved to cache
2026-03-26 22:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c9c31b26-dc78-56c7-b825-76271aa2099c
2026-03-26 22:45:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/ba3720cd0d1340b8b03120b4e36effb6/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/ba3720cd0d1340b8b03120b4e36effb6/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Fb4ee761506504f42bcc30c4636d70bd1%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/b4ee761506504f42bcc30c4636d70bd1/images/large/4.jpg not downloaded yet
2026-03-26 22:45:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/f3a9365bb8a94c4eb3c85ba31b43d646/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Fb4ee761506504f42bcc30c4636d70bd1%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/b4ee761506504f42bcc30c4636d70bd1/images/large/5.jpg not downloaded yet
2026-03-26 22:45:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/f3a9365bb8a94c4eb3c85ba31b43d646/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Fb4ee761506504f42bcc30c4636d70bd1%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/b4ee761506504f42bcc30c4636d70bd1/images/large/6.jpg not downloaded yet
2026-03-26 22:45:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b75a46d0>
2026-03-26 22:45:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c7d428a-e542-54a6-9d6b-4241d510c1db/8c7d428a-e542-54a6-9d6b-4241d510c1db_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Ff3a9365bb8a94c4eb3c85ba31b43d646%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/f3a9365bb8a94c4eb3c85ba31b43d646/images/large/1.jpg saved to cache
2026-03-26 22:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8c7d428a-e542-54a6-9d6b-4241d510c1db
2026-03-26 22:45:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7434590>
2026-03-26 22:45:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9c31b26-dc78-56c7-b825-76271aa2099c/c9c31b26-dc78-56c7-b825-76271aa2099c_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fba3720cd0d1340b8b03120b4e36effb6%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/ba3720cd0d1340b8b03120b4e36effb6/images/large/6.jpg saved to cache
2026-03-26 22:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c9c31b26-dc78-56c7-b825-76271aa2099c
2026-03-26 22:45:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74e5810>
2026-03-26 22:45:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c7d428a-e542-54a6-9d6b-4241d510c1db/8c7d428a-e542-54a6-9d6b-4241d510c1db_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Ff3a9365bb8a94c4eb3c85ba31b43d646%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/f3a9365bb8a94c4eb3c85ba31b43d646/images/large/2.jpg saved to cache
2026-03-26 22:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8c7d428a-e542-54a6-9d6b-4241d510c1db
2026-03-26 22:45:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/f3a9365bb8a94c4eb3c85ba31b43d646/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/f3a9365bb8a94c4eb3c85ba31b43d646/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Fb4ee761506504f42bcc30c4636d70bd1%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/b4ee761506504f42bcc30c4636d70bd1/images/large/7.jpg not downloaded yet
2026-03-26 22:45:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/f3a9365bb8a94c4eb3c85ba31b43d646/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Fb4ee761506504f42bcc30c4636d70bd1%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/b4ee761506504f42bcc30c4636d70bd1/images/large/8.jpg not downloaded yet
2026-03-26 22:45:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b72ef410>
2026-03-26 22:45:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9c31b26-dc78-56c7-b825-76271aa2099c/c9c31b26-dc78-56c7-b825-76271aa2099c_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fba3720cd0d1340b8b03120b4e36effb6%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/ba3720cd0d1340b8b03120b4e36effb6/images/large/10.jpg saved to cache
2026-03-26 22:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c9c31b26-dc78-56c7-b825-76271aa2099c
2026-03-26 22:45:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7660710>
2026-03-26 22:45:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9c31b26-dc78-56c7-b825-76271aa2099c/c9c31b26-dc78-56c7-b825-76271aa2099c_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fba3720cd0d1340b8b03120b4e36effb6%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/ba3720cd0d1340b8b03120b4e36effb6/images/large/9.jpg saved to cache
2026-03-26 22:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c9c31b26-dc78-56c7-b825-76271aa2099c
2026-03-26 22:45:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c9c31b26-dc78-56c7-b825-76271aa2099c, skipping ID generation
2026-03-26 22:45:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9c31b26-dc78-56c7-b825-76271aa2099c with scrape type 1
2026-03-26 22:45:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c9c31b26-dc78-56c7-b825-76271aa2099c sending to next pipeline
2026-03-26 22:45:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c9c31b26-dc78-56c7-b825-76271aa2099c, identifier: 1986036
2026-03-26 22:45:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c83390>
2026-03-26 22:45:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c7d428a-e542-54a6-9d6b-4241d510c1db/8c7d428a-e542-54a6-9d6b-4241d510c1db_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Ff3a9365bb8a94c4eb3c85ba31b43d646%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/f3a9365bb8a94c4eb3c85ba31b43d646/images/large/3.jpg saved to cache
2026-03-26 22:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8c7d428a-e542-54a6-9d6b-4241d510c1db
2026-03-26 22:45:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e4dc50>
2026-03-26 22:45:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c7d428a-e542-54a6-9d6b-4241d510c1db/8c7d428a-e542-54a6-9d6b-4241d510c1db_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Ff3a9365bb8a94c4eb3c85ba31b43d646%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/f3a9365bb8a94c4eb3c85ba31b43d646/images/large/7.jpg saved to cache
2026-03-26 22:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8c7d428a-e542-54a6-9d6b-4241d510c1db
2026-03-26 22:45:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/f3a9365bb8a94c4eb3c85ba31b43d646/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/f3a9365bb8a94c4eb3c85ba31b43d646/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Fb4ee761506504f42bcc30c4636d70bd1%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/b4ee761506504f42bcc30c4636d70bd1/images/large/9.jpg not downloaded yet
2026-03-26 22:45:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c9c31b26-dc78-56c7-b825-76271aa2099c with identifier: 1986036
2026-03-26 22:45:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c9c31b26-dc78-56c7-b825-76271aa2099c with identifier: 1986036
2026-03-26 22:45:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c9c31b26-dc78-56c7-b825-76271aa2099c with identifier: 1986036 to the API
2026-03-26 22:45:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:45:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:45:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bd/ba3720cd0d1340b8b03120b4e36effb6/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'c9c31b26-dc78-56c7-b825-76271aa2099c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLB',
 'odometer': 131190,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9c31b26-dc78-56c7-b825-76271aa2099c/c9c31b26-dc78-56c7-b825-76271aa2099c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 762259,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/ba3720cd0d1340b8b03120b4e36effb6/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9c31b26-dc78-56c7-b825-76271aa2099c/c9c31b26-dc78-56c7-b825-76271aa2099c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 766055,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/ba3720cd0d1340b8b03120b4e36effb6/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9c31b26-dc78-56c7-b825-76271aa2099c/c9c31b26-dc78-56c7-b825-76271aa2099c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 777713,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/ba3720cd0d1340b8b03120b4e36effb6/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9c31b26-dc78-56c7-b825-76271aa2099c/c9c31b26-dc78-56c7-b825-76271aa2099c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 782377,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/ba3720cd0d1340b8b03120b4e36effb6/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9c31b26-dc78-56c7-b825-76271aa2099c/c9c31b26-dc78-56c7-b825-76271aa2099c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 814843,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/ba3720cd0d1340b8b03120b4e36effb6/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9c31b26-dc78-56c7-b825-76271aa2099c/c9c31b26-dc78-56c7-b825-76271aa2099c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 781599,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/ba3720cd0d1340b8b03120b4e36effb6/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9c31b26-dc78-56c7-b825-76271aa2099c/c9c31b26-dc78-56c7-b825-76271aa2099c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 702947,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/ba3720cd0d1340b8b03120b4e36effb6/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9c31b26-dc78-56c7-b825-76271aa2099c/c9c31b26-dc78-56c7-b825-76271aa2099c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 767373,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/ba3720cd0d1340b8b03120b4e36effb6/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9c31b26-dc78-56c7-b825-76271aa2099c/c9c31b26-dc78-56c7-b825-76271aa2099c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 730268,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/ba3720cd0d1340b8b03120b4e36effb6/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9c31b26-dc78-56c7-b825-76271aa2099c/c9c31b26-dc78-56c7-b825-76271aa2099c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 801280,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/ba3720cd0d1340b8b03120b4e36effb6/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-13',
 'seats_number': 7,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLB 2.0 GLB 180 D BUSINESS SOLUTION',
 'transmission': 'automatic',
 'trim': '2.0 GLB 180 D BUSINESS SOLUTION',
 'vin': None,
 'year': 2021}
2026-03-26 22:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986036%27 HTTP/1.1" 200 None
2026-03-26 22:45:45 [ayvens.be] INFO: Saving data for 1986036: {'created_time': 1774565145.033028, 'last_price_update_time': 1774565145.033038, 'auction_closing_time': 1775028600.0}
2026-03-26 22:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986036') HTTP/1.1" 204 0
2026-03-26 22:45:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/f3a9365bb8a94c4eb3c85ba31b43d646/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/b4ee761506504f42bcc30c4636d70bd1/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Fb4ee761506504f42bcc30c4636d70bd1%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/b4ee761506504f42bcc30c4636d70bd1/images/large/10.jpg not downloaded yet
2026-03-26 22:45:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7482e90>
2026-03-26 22:45:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c7d428a-e542-54a6-9d6b-4241d510c1db/8c7d428a-e542-54a6-9d6b-4241d510c1db_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Ff3a9365bb8a94c4eb3c85ba31b43d646%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/f3a9365bb8a94c4eb3c85ba31b43d646/images/large/6.jpg saved to cache
2026-03-26 22:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8c7d428a-e542-54a6-9d6b-4241d510c1db
2026-03-26 22:45:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74b7850>
2026-03-26 22:45:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c7d428a-e542-54a6-9d6b-4241d510c1db/8c7d428a-e542-54a6-9d6b-4241d510c1db_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Ff3a9365bb8a94c4eb3c85ba31b43d646%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/f3a9365bb8a94c4eb3c85ba31b43d646/images/large/5.jpg saved to cache
2026-03-26 22:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8c7d428a-e542-54a6-9d6b-4241d510c1db
2026-03-26 22:45:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b98410>
2026-03-26 22:45:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c7d428a-e542-54a6-9d6b-4241d510c1db/8c7d428a-e542-54a6-9d6b-4241d510c1db_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Ff3a9365bb8a94c4eb3c85ba31b43d646%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/f3a9365bb8a94c4eb3c85ba31b43d646/images/large/4.jpg saved to cache
2026-03-26 22:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8c7d428a-e542-54a6-9d6b-4241d510c1db
2026-03-26 22:45:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5ccae90>
2026-03-26 22:45:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c7d428a-e542-54a6-9d6b-4241d510c1db/8c7d428a-e542-54a6-9d6b-4241d510c1db_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Ff3a9365bb8a94c4eb3c85ba31b43d646%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/f3a9365bb8a94c4eb3c85ba31b43d646/images/large/9.jpg saved to cache
2026-03-26 22:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8c7d428a-e542-54a6-9d6b-4241d510c1db
2026-03-26 22:45:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7587210>
2026-03-26 22:45:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c7d428a-e542-54a6-9d6b-4241d510c1db/8c7d428a-e542-54a6-9d6b-4241d510c1db_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Ff3a9365bb8a94c4eb3c85ba31b43d646%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/f3a9365bb8a94c4eb3c85ba31b43d646/images/large/10.jpg saved to cache
2026-03-26 22:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8c7d428a-e542-54a6-9d6b-4241d510c1db
2026-03-26 22:45:45 [ayvens.be] INFO: Found listing with ID: 1986039
2026-03-26 22:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986039%27 HTTP/1.1" 200 None
2026-03-26 22:45:45 [ayvens.be] INFO: Scrape type for 1986039: 1
2026-03-26 22:45:45 [ayvens.be] INFO: Extracting data for car ID: 1986039
2026-03-26 22:45:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a8b13729-051a-5f0f-82ed-76c5c3e0e89b with identifier: 1986039
2026-03-26 22:45:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8b13729-051a-5f0f-82ed-76c5c3e0e89b with scrape type 1
2026-03-26 22:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a8b13729-051a-5f0f-82ed-76c5c3e0e89b
2026-03-26 22:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252F7aa792483a9f44daa88653c1f21ea3d0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/7aa792483a9f44daa88653c1f21ea3d0/images/large/1.jpg not downloaded yet
2026-03-26 22:45:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/b4ee761506504f42bcc30c4636d70bd1/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/b4ee761506504f42bcc30c4636d70bd1/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/b4ee761506504f42bcc30c4636d70bd1/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252F7aa792483a9f44daa88653c1f21ea3d0%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/7aa792483a9f44daa88653c1f21ea3d0/images/large/2.jpg not downloaded yet
2026-03-26 22:45:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cc9d10>
2026-03-26 22:45:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c7d428a-e542-54a6-9d6b-4241d510c1db/8c7d428a-e542-54a6-9d6b-4241d510c1db_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Ff3a9365bb8a94c4eb3c85ba31b43d646%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/f3a9365bb8a94c4eb3c85ba31b43d646/images/large/8.jpg saved to cache
2026-03-26 22:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8c7d428a-e542-54a6-9d6b-4241d510c1db
2026-03-26 22:45:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8c7d428a-e542-54a6-9d6b-4241d510c1db, skipping ID generation
2026-03-26 22:45:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c7d428a-e542-54a6-9d6b-4241d510c1db with scrape type 1
2026-03-26 22:45:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8c7d428a-e542-54a6-9d6b-4241d510c1db sending to next pipeline
2026-03-26 22:45:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 8c7d428a-e542-54a6-9d6b-4241d510c1db, identifier: 1986037
2026-03-26 22:45:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7584310>
2026-03-26 22:45:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a785095c-c896-5b3b-9fac-f87b2e173115/a785095c-c896-5b3b-9fac-f87b2e173115_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Fb4ee761506504f42bcc30c4636d70bd1%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/b4ee761506504f42bcc30c4636d70bd1/images/large/1.jpg saved to cache
2026-03-26 22:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a785095c-c896-5b3b-9fac-f87b2e173115
2026-03-26 22:45:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/b4ee761506504f42bcc30c4636d70bd1/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 8c7d428a-e542-54a6-9d6b-4241d510c1db with identifier: 1986037
2026-03-26 22:45:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 8c7d428a-e542-54a6-9d6b-4241d510c1db with identifier: 1986037
2026-03-26 22:45:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 8c7d428a-e542-54a6-9d6b-4241d510c1db with identifier: 1986037 to the API
2026-03-26 22:45:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:45:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:45:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yv/f3a9365bb8a94c4eb3c85ba31b43d646/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '8c7d428a-e542-54a6-9d6b-4241d510c1db',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '5 SERIES BERLINE',
 'odometer': 97195,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c7d428a-e542-54a6-9d6b-4241d510c1db/8c7d428a-e542-54a6-9d6b-4241d510c1db_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 436290,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/f3a9365bb8a94c4eb3c85ba31b43d646/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c7d428a-e542-54a6-9d6b-4241d510c1db/8c7d428a-e542-54a6-9d6b-4241d510c1db_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 454418,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/f3a9365bb8a94c4eb3c85ba31b43d646/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c7d428a-e542-54a6-9d6b-4241d510c1db/8c7d428a-e542-54a6-9d6b-4241d510c1db_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 398145,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/f3a9365bb8a94c4eb3c85ba31b43d646/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c7d428a-e542-54a6-9d6b-4241d510c1db/8c7d428a-e542-54a6-9d6b-4241d510c1db_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 450359,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/f3a9365bb8a94c4eb3c85ba31b43d646/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c7d428a-e542-54a6-9d6b-4241d510c1db/8c7d428a-e542-54a6-9d6b-4241d510c1db_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 367371,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/f3a9365bb8a94c4eb3c85ba31b43d646/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c7d428a-e542-54a6-9d6b-4241d510c1db/8c7d428a-e542-54a6-9d6b-4241d510c1db_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 290393,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/f3a9365bb8a94c4eb3c85ba31b43d646/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c7d428a-e542-54a6-9d6b-4241d510c1db/8c7d428a-e542-54a6-9d6b-4241d510c1db_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 252834,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/f3a9365bb8a94c4eb3c85ba31b43d646/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c7d428a-e542-54a6-9d6b-4241d510c1db/8c7d428a-e542-54a6-9d6b-4241d510c1db_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 347916,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/f3a9365bb8a94c4eb3c85ba31b43d646/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c7d428a-e542-54a6-9d6b-4241d510c1db/8c7d428a-e542-54a6-9d6b-4241d510c1db_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 268492,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/f3a9365bb8a94c4eb3c85ba31b43d646/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c7d428a-e542-54a6-9d6b-4241d510c1db/8c7d428a-e542-54a6-9d6b-4241d510c1db_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 325849,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/f3a9365bb8a94c4eb3c85ba31b43d646/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 5 SERIES BERLINE 2.0 518D 100KW AUTO',
 'transmission': 'automatic',
 'trim': '2.0 518D 100KW AUTO',
 'vin': None,
 'year': 2021}
2026-03-26 22:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986037%27 HTTP/1.1" 200 None
2026-03-26 22:45:46 [ayvens.be] INFO: Saving data for 1986037: {'created_time': 1774565146.082988, 'last_price_update_time': 1774565146.082997, 'auction_closing_time': 1775028600.0}
2026-03-26 22:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986037') HTTP/1.1" 204 0
2026-03-26 22:45:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/b4ee761506504f42bcc30c4636d70bd1/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252F7aa792483a9f44daa88653c1f21ea3d0%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/7aa792483a9f44daa88653c1f21ea3d0/images/large/3.jpg not downloaded yet
2026-03-26 22:45:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/b4ee761506504f42bcc30c4636d70bd1/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e1c190>
2026-03-26 22:45:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a785095c-c896-5b3b-9fac-f87b2e173115/a785095c-c896-5b3b-9fac-f87b2e173115_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Fb4ee761506504f42bcc30c4636d70bd1%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/b4ee761506504f42bcc30c4636d70bd1/images/large/3.jpg saved to cache
2026-03-26 22:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a785095c-c896-5b3b-9fac-f87b2e173115
2026-03-26 22:45:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7875c90>
2026-03-26 22:45:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a785095c-c896-5b3b-9fac-f87b2e173115/a785095c-c896-5b3b-9fac-f87b2e173115_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Fb4ee761506504f42bcc30c4636d70bd1%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/b4ee761506504f42bcc30c4636d70bd1/images/large/5.jpg saved to cache
2026-03-26 22:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a785095c-c896-5b3b-9fac-f87b2e173115
2026-03-26 22:45:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7cccb50>
2026-03-26 22:45:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a785095c-c896-5b3b-9fac-f87b2e173115/a785095c-c896-5b3b-9fac-f87b2e173115_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Fb4ee761506504f42bcc30c4636d70bd1%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/b4ee761506504f42bcc30c4636d70bd1/images/large/2.jpg saved to cache
2026-03-26 22:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a785095c-c896-5b3b-9fac-f87b2e173115
2026-03-26 22:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252F7aa792483a9f44daa88653c1f21ea3d0%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/7aa792483a9f44daa88653c1f21ea3d0/images/large/4.jpg not downloaded yet
2026-03-26 22:45:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/b4ee761506504f42bcc30c4636d70bd1/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7875950>
2026-03-26 22:45:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a785095c-c896-5b3b-9fac-f87b2e173115/a785095c-c896-5b3b-9fac-f87b2e173115_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Fb4ee761506504f42bcc30c4636d70bd1%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/b4ee761506504f42bcc30c4636d70bd1/images/large/4.jpg saved to cache
2026-03-26 22:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a785095c-c896-5b3b-9fac-f87b2e173115
2026-03-26 22:45:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/b4ee761506504f42bcc30c4636d70bd1/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252F7aa792483a9f44daa88653c1f21ea3d0%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/7aa792483a9f44daa88653c1f21ea3d0/images/large/5.jpg not downloaded yet
2026-03-26 22:45:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7663290>
2026-03-26 22:45:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a785095c-c896-5b3b-9fac-f87b2e173115/a785095c-c896-5b3b-9fac-f87b2e173115_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Fb4ee761506504f42bcc30c4636d70bd1%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/b4ee761506504f42bcc30c4636d70bd1/images/large/7.jpg saved to cache
2026-03-26 22:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a785095c-c896-5b3b-9fac-f87b2e173115
2026-03-26 22:45:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b728fc50>
2026-03-26 22:45:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a785095c-c896-5b3b-9fac-f87b2e173115/a785095c-c896-5b3b-9fac-f87b2e173115_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Fb4ee761506504f42bcc30c4636d70bd1%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/b4ee761506504f42bcc30c4636d70bd1/images/large/6.jpg saved to cache
2026-03-26 22:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a785095c-c896-5b3b-9fac-f87b2e173115
2026-03-26 22:45:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/b4ee761506504f42bcc30c4636d70bd1/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2em/7aa792483a9f44daa88653c1f21ea3d0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252F7aa792483a9f44daa88653c1f21ea3d0%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/7aa792483a9f44daa88653c1f21ea3d0/images/large/6.jpg not downloaded yet
2026-03-26 22:45:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76cf850>
2026-03-26 22:45:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a785095c-c896-5b3b-9fac-f87b2e173115/a785095c-c896-5b3b-9fac-f87b2e173115_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Fb4ee761506504f42bcc30c4636d70bd1%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/b4ee761506504f42bcc30c4636d70bd1/images/large/8.jpg saved to cache
2026-03-26 22:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a785095c-c896-5b3b-9fac-f87b2e173115
2026-03-26 22:45:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7448250>
2026-03-26 22:45:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a785095c-c896-5b3b-9fac-f87b2e173115/a785095c-c896-5b3b-9fac-f87b2e173115_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Fb4ee761506504f42bcc30c4636d70bd1%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/b4ee761506504f42bcc30c4636d70bd1/images/large/9.jpg saved to cache
2026-03-26 22:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a785095c-c896-5b3b-9fac-f87b2e173115
2026-03-26 22:45:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2em/7aa792483a9f44daa88653c1f21ea3d0/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252F7aa792483a9f44daa88653c1f21ea3d0%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/7aa792483a9f44daa88653c1f21ea3d0/images/large/7.jpg not downloaded yet
2026-03-26 22:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252F7aa792483a9f44daa88653c1f21ea3d0%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/7aa792483a9f44daa88653c1f21ea3d0/images/large/8.jpg not downloaded yet
2026-03-26 22:45:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6d82d10>
2026-03-26 22:45:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a785095c-c896-5b3b-9fac-f87b2e173115/a785095c-c896-5b3b-9fac-f87b2e173115_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Fb4ee761506504f42bcc30c4636d70bd1%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/b4ee761506504f42bcc30c4636d70bd1/images/large/10.jpg saved to cache
2026-03-26 22:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a785095c-c896-5b3b-9fac-f87b2e173115
2026-03-26 22:45:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a785095c-c896-5b3b-9fac-f87b2e173115, skipping ID generation
2026-03-26 22:45:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a785095c-c896-5b3b-9fac-f87b2e173115 with scrape type 1
2026-03-26 22:45:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a785095c-c896-5b3b-9fac-f87b2e173115 sending to next pipeline
2026-03-26 22:45:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a785095c-c896-5b3b-9fac-f87b2e173115, identifier: 1986038
2026-03-26 22:45:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e1d990>
2026-03-26 22:45:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8b13729-051a-5f0f-82ed-76c5c3e0e89b/a8b13729-051a-5f0f-82ed-76c5c3e0e89b_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252F7aa792483a9f44daa88653c1f21ea3d0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/7aa792483a9f44daa88653c1f21ea3d0/images/large/1.jpg saved to cache
2026-03-26 22:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a8b13729-051a-5f0f-82ed-76c5c3e0e89b
2026-03-26 22:45:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2em/7aa792483a9f44daa88653c1f21ea3d0/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a785095c-c896-5b3b-9fac-f87b2e173115 with identifier: 1986038
2026-03-26 22:45:47 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 22:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 22:45:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a785095c-c896-5b3b-9fac-f87b2e173115 with identifier: 1986038
2026-03-26 22:45:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a785095c-c896-5b3b-9fac-f87b2e173115 with identifier: 1986038 to the API
2026-03-26 22:45:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:45:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:45:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2au/b4ee761506504f42bcc30c4636d70bd1/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'a785095c-c896-5b3b-9fac-f87b2e173115',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'LEON ST',
 'odometer': 48154,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a785095c-c896-5b3b-9fac-f87b2e173115/a785095c-c896-5b3b-9fac-f87b2e173115_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 341325,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/b4ee761506504f42bcc30c4636d70bd1/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a785095c-c896-5b3b-9fac-f87b2e173115/a785095c-c896-5b3b-9fac-f87b2e173115_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 373540,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/b4ee761506504f42bcc30c4636d70bd1/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a785095c-c896-5b3b-9fac-f87b2e173115/a785095c-c896-5b3b-9fac-f87b2e173115_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 367116,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/b4ee761506504f42bcc30c4636d70bd1/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a785095c-c896-5b3b-9fac-f87b2e173115/a785095c-c896-5b3b-9fac-f87b2e173115_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 399533,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/b4ee761506504f42bcc30c4636d70bd1/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a785095c-c896-5b3b-9fac-f87b2e173115/a785095c-c896-5b3b-9fac-f87b2e173115_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 376450,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/b4ee761506504f42bcc30c4636d70bd1/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a785095c-c896-5b3b-9fac-f87b2e173115/a785095c-c896-5b3b-9fac-f87b2e173115_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 266816,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/b4ee761506504f42bcc30c4636d70bd1/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a785095c-c896-5b3b-9fac-f87b2e173115/a785095c-c896-5b3b-9fac-f87b2e173115_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 222777,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/b4ee761506504f42bcc30c4636d70bd1/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a785095c-c896-5b3b-9fac-f87b2e173115/a785095c-c896-5b3b-9fac-f87b2e173115_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 428078,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/b4ee761506504f42bcc30c4636d70bd1/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a785095c-c896-5b3b-9fac-f87b2e173115/a785095c-c896-5b3b-9fac-f87b2e173115_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 323588,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/b4ee761506504f42bcc30c4636d70bd1/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a785095c-c896-5b3b-9fac-f87b2e173115/a785095c-c896-5b3b-9fac-f87b2e173115_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 308518,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/b4ee761506504f42bcc30c4636d70bd1/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT LEON ST 1.5 TSI 130 MOVE!',
 'transmission': 'manual',
 'trim': '1.5 TSI 130 MOVE!',
 'vin': None,
 'year': 2021}
2026-03-26 22:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986038%27 HTTP/1.1" 200 None
2026-03-26 22:45:47 [ayvens.be] INFO: Saving data for 1986038: {'created_time': 1774565147.428513, 'last_price_update_time': 1774565147.428523, 'auction_closing_time': 1775028600.0}
2026-03-26 22:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986038') HTTP/1.1" 204 0
2026-03-26 22:45:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2em/7aa792483a9f44daa88653c1f21ea3d0/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252F7aa792483a9f44daa88653c1f21ea3d0%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/7aa792483a9f44daa88653c1f21ea3d0/images/large/9.jpg not downloaded yet
2026-03-26 22:45:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e3ee50>
2026-03-26 22:45:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8b13729-051a-5f0f-82ed-76c5c3e0e89b/a8b13729-051a-5f0f-82ed-76c5c3e0e89b_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252F7aa792483a9f44daa88653c1f21ea3d0%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/7aa792483a9f44daa88653c1f21ea3d0/images/large/2.jpg saved to cache
2026-03-26 22:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a8b13729-051a-5f0f-82ed-76c5c3e0e89b
2026-03-26 22:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252F7aa792483a9f44daa88653c1f21ea3d0%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/7aa792483a9f44daa88653c1f21ea3d0/images/large/10.jpg not downloaded yet
2026-03-26 22:45:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2em/7aa792483a9f44daa88653c1f21ea3d0/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cc9810>
2026-03-26 22:45:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8b13729-051a-5f0f-82ed-76c5c3e0e89b/a8b13729-051a-5f0f-82ed-76c5c3e0e89b_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252F7aa792483a9f44daa88653c1f21ea3d0%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/7aa792483a9f44daa88653c1f21ea3d0/images/large/3.jpg saved to cache
2026-03-26 22:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a8b13729-051a-5f0f-82ed-76c5c3e0e89b
2026-03-26 22:45:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2em/7aa792483a9f44daa88653c1f21ea3d0/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:47 [ayvens.be] INFO: Found listing with ID: 1986040
2026-03-26 22:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986040%27 HTTP/1.1" 200 None
2026-03-26 22:45:47 [ayvens.be] INFO: Scrape type for 1986040: 1
2026-03-26 22:45:47 [ayvens.be] INFO: Extracting data for car ID: 1986040
2026-03-26 22:45:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7d88768-9bf6-5f29-90de-1b51ec377c95 with identifier: 1986040
2026-03-26 22:45:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7d88768-9bf6-5f29-90de-1b51ec377c95 with scrape type 1
2026-03-26 22:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b7d88768-9bf6-5f29-90de-1b51ec377c95
2026-03-26 22:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F389a15ad4b374c9b974d0a116678093b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/389a15ad4b374c9b974d0a116678093b/images/large/1.jpg not downloaded yet
2026-03-26 22:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F389a15ad4b374c9b974d0a116678093b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/389a15ad4b374c9b974d0a116678093b/images/large/2.jpg not downloaded yet
2026-03-26 22:45:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b34f50>
2026-03-26 22:45:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8b13729-051a-5f0f-82ed-76c5c3e0e89b/a8b13729-051a-5f0f-82ed-76c5c3e0e89b_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252F7aa792483a9f44daa88653c1f21ea3d0%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/7aa792483a9f44daa88653c1f21ea3d0/images/large/4.jpg saved to cache
2026-03-26 22:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a8b13729-051a-5f0f-82ed-76c5c3e0e89b
2026-03-26 22:45:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76ef590>
2026-03-26 22:45:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8b13729-051a-5f0f-82ed-76c5c3e0e89b/a8b13729-051a-5f0f-82ed-76c5c3e0e89b_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252F7aa792483a9f44daa88653c1f21ea3d0%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/7aa792483a9f44daa88653c1f21ea3d0/images/large/6.jpg saved to cache
2026-03-26 22:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a8b13729-051a-5f0f-82ed-76c5c3e0e89b
2026-03-26 22:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F389a15ad4b374c9b974d0a116678093b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/389a15ad4b374c9b974d0a116678093b/images/large/3.jpg not downloaded yet
2026-03-26 22:45:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76ed790>
2026-03-26 22:45:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8b13729-051a-5f0f-82ed-76c5c3e0e89b/a8b13729-051a-5f0f-82ed-76c5c3e0e89b_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252F7aa792483a9f44daa88653c1f21ea3d0%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/7aa792483a9f44daa88653c1f21ea3d0/images/large/5.jpg saved to cache
2026-03-26 22:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a8b13729-051a-5f0f-82ed-76c5c3e0e89b
2026-03-26 22:45:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2em/7aa792483a9f44daa88653c1f21ea3d0/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F389a15ad4b374c9b974d0a116678093b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/389a15ad4b374c9b974d0a116678093b/images/large/4.jpg not downloaded yet
2026-03-26 22:45:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2em/7aa792483a9f44daa88653c1f21ea3d0/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F389a15ad4b374c9b974d0a116678093b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/389a15ad4b374c9b974d0a116678093b/images/large/5.jpg not downloaded yet
2026-03-26 22:45:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2em/7aa792483a9f44daa88653c1f21ea3d0/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F389a15ad4b374c9b974d0a116678093b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/389a15ad4b374c9b974d0a116678093b/images/large/6.jpg not downloaded yet
2026-03-26 22:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F389a15ad4b374c9b974d0a116678093b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/389a15ad4b374c9b974d0a116678093b/images/large/7.jpg not downloaded yet
2026-03-26 22:45:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2em/7aa792483a9f44daa88653c1f21ea3d0/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F389a15ad4b374c9b974d0a116678093b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/389a15ad4b374c9b974d0a116678093b/images/large/8.jpg not downloaded yet
2026-03-26 22:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F389a15ad4b374c9b974d0a116678093b%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/389a15ad4b374c9b974d0a116678093b/images/large/9.jpg not downloaded yet
2026-03-26 22:45:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76cdd90>
2026-03-26 22:45:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8b13729-051a-5f0f-82ed-76c5c3e0e89b/a8b13729-051a-5f0f-82ed-76c5c3e0e89b_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252F7aa792483a9f44daa88653c1f21ea3d0%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/7aa792483a9f44daa88653c1f21ea3d0/images/large/7.jpg saved to cache
2026-03-26 22:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a8b13729-051a-5f0f-82ed-76c5c3e0e89b
2026-03-26 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F389a15ad4b374c9b974d0a116678093b%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/389a15ad4b374c9b974d0a116678093b/images/large/10.jpg not downloaded yet
2026-03-26 22:45:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7874450>
2026-03-26 22:45:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8b13729-051a-5f0f-82ed-76c5c3e0e89b/a8b13729-051a-5f0f-82ed-76c5c3e0e89b_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252F7aa792483a9f44daa88653c1f21ea3d0%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/7aa792483a9f44daa88653c1f21ea3d0/images/large/8.jpg saved to cache
2026-03-26 22:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a8b13729-051a-5f0f-82ed-76c5c3e0e89b
2026-03-26 22:45:48 [ayvens.be] INFO: Found listing with ID: 1986041
2026-03-26 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986041%27 HTTP/1.1" 200 None
2026-03-26 22:45:48 [ayvens.be] INFO: Scrape type for 1986041: 1
2026-03-26 22:45:48 [ayvens.be] INFO: Extracting data for car ID: 1986041
2026-03-26 22:45:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 773e2031-4730-5eec-ada3-05f112376a35 with identifier: 1986041
2026-03-26 22:45:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 773e2031-4730-5eec-ada3-05f112376a35 with scrape type 1
2026-03-26 22:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 773e2031-4730-5eec-ada3-05f112376a35
2026-03-26 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fa48e18b761144587a9e48f2d4b8aa5b9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/a48e18b761144587a9e48f2d4b8aa5b9/images/large/1.jpg not downloaded yet
2026-03-26 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fa48e18b761144587a9e48f2d4b8aa5b9%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/a48e18b761144587a9e48f2d4b8aa5b9/images/large/2.jpg not downloaded yet
2026-03-26 22:45:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b741c6d0>
2026-03-26 22:45:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8b13729-051a-5f0f-82ed-76c5c3e0e89b/a8b13729-051a-5f0f-82ed-76c5c3e0e89b_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252F7aa792483a9f44daa88653c1f21ea3d0%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/7aa792483a9f44daa88653c1f21ea3d0/images/large/9.jpg saved to cache
2026-03-26 22:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a8b13729-051a-5f0f-82ed-76c5c3e0e89b
2026-03-26 22:45:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c5c990>
2026-03-26 22:45:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8b13729-051a-5f0f-82ed-76c5c3e0e89b/a8b13729-051a-5f0f-82ed-76c5c3e0e89b_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252F7aa792483a9f44daa88653c1f21ea3d0%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/7aa792483a9f44daa88653c1f21ea3d0/images/large/10.jpg saved to cache
2026-03-26 22:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a8b13729-051a-5f0f-82ed-76c5c3e0e89b
2026-03-26 22:45:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a8b13729-051a-5f0f-82ed-76c5c3e0e89b, skipping ID generation
2026-03-26 22:45:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8b13729-051a-5f0f-82ed-76c5c3e0e89b with scrape type 1
2026-03-26 22:45:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a8b13729-051a-5f0f-82ed-76c5c3e0e89b sending to next pipeline
2026-03-26 22:45:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a8b13729-051a-5f0f-82ed-76c5c3e0e89b, identifier: 1986039
2026-03-26 22:45:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a8b13729-051a-5f0f-82ed-76c5c3e0e89b with identifier: 1986039
2026-03-26 22:45:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a8b13729-051a-5f0f-82ed-76c5c3e0e89b with identifier: 1986039
2026-03-26 22:45:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a8b13729-051a-5f0f-82ed-76c5c3e0e89b with identifier: 1986039 to the API
2026-03-26 22:45:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:45:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:45:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2em/7aa792483a9f44daa88653c1f21ea3d0/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'a8b13729-051a-5f0f-82ed-76c5c3e0e89b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'CROSSLAND',
 'odometer': 50993,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8b13729-051a-5f0f-82ed-76c5c3e0e89b/a8b13729-051a-5f0f-82ed-76c5c3e0e89b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 203589,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2em/7aa792483a9f44daa88653c1f21ea3d0/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8b13729-051a-5f0f-82ed-76c5c3e0e89b/a8b13729-051a-5f0f-82ed-76c5c3e0e89b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 226182,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2em/7aa792483a9f44daa88653c1f21ea3d0/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8b13729-051a-5f0f-82ed-76c5c3e0e89b/a8b13729-051a-5f0f-82ed-76c5c3e0e89b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 246407,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2em/7aa792483a9f44daa88653c1f21ea3d0/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8b13729-051a-5f0f-82ed-76c5c3e0e89b/a8b13729-051a-5f0f-82ed-76c5c3e0e89b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 235290,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2em/7aa792483a9f44daa88653c1f21ea3d0/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8b13729-051a-5f0f-82ed-76c5c3e0e89b/a8b13729-051a-5f0f-82ed-76c5c3e0e89b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 279104,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2em/7aa792483a9f44daa88653c1f21ea3d0/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8b13729-051a-5f0f-82ed-76c5c3e0e89b/a8b13729-051a-5f0f-82ed-76c5c3e0e89b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 256487,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2em/7aa792483a9f44daa88653c1f21ea3d0/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8b13729-051a-5f0f-82ed-76c5c3e0e89b/a8b13729-051a-5f0f-82ed-76c5c3e0e89b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 264159,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2em/7aa792483a9f44daa88653c1f21ea3d0/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8b13729-051a-5f0f-82ed-76c5c3e0e89b/a8b13729-051a-5f0f-82ed-76c5c3e0e89b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 311236,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2em/7aa792483a9f44daa88653c1f21ea3d0/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8b13729-051a-5f0f-82ed-76c5c3e0e89b/a8b13729-051a-5f0f-82ed-76c5c3e0e89b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 385313,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2em/7aa792483a9f44daa88653c1f21ea3d0/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8b13729-051a-5f0f-82ed-76c5c3e0e89b/a8b13729-051a-5f0f-82ed-76c5c3e0e89b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 329784,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2em/7aa792483a9f44daa88653c1f21ea3d0/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-11-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL CROSSLAND 1.2 81KW TURBO S-S GS  Driving SchoolrnDouble Pedal',
 'transmission': 'manual',
 'trim': '1.2 81KW TURBO S-S GS  Driving SchoolrnDouble Pedal',
 'vin': None,
 'year': 2023}
2026-03-26 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986039%27 HTTP/1.1" 200 None
2026-03-26 22:45:48 [ayvens.be] INFO: Saving data for 1986039: {'created_time': 1774565148.890421, 'last_price_update_time': 1774565148.890432, 'auction_closing_time': 1775028600.0}
2026-03-26 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986039') HTTP/1.1" 204 0
2026-03-26 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fa48e18b761144587a9e48f2d4b8aa5b9%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/a48e18b761144587a9e48f2d4b8aa5b9/images/large/3.jpg not downloaded yet
2026-03-26 22:45:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cl/389a15ad4b374c9b974d0a116678093b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cl/389a15ad4b374c9b974d0a116678093b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cl/389a15ad4b374c9b974d0a116678093b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cl/389a15ad4b374c9b974d0a116678093b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cl/389a15ad4b374c9b974d0a116678093b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cl/389a15ad4b374c9b974d0a116678093b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fa48e18b761144587a9e48f2d4b8aa5b9%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/a48e18b761144587a9e48f2d4b8aa5b9/images/large/4.jpg not downloaded yet
2026-03-26 22:45:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cl/389a15ad4b374c9b974d0a116678093b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fa48e18b761144587a9e48f2d4b8aa5b9%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/a48e18b761144587a9e48f2d4b8aa5b9/images/large/5.jpg not downloaded yet
2026-03-26 22:45:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cl/389a15ad4b374c9b974d0a116678093b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fa48e18b761144587a9e48f2d4b8aa5b9%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/a48e18b761144587a9e48f2d4b8aa5b9/images/large/6.jpg not downloaded yet
2026-03-26 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fa48e18b761144587a9e48f2d4b8aa5b9%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/a48e18b761144587a9e48f2d4b8aa5b9/images/large/7.jpg not downloaded yet
2026-03-26 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fa48e18b761144587a9e48f2d4b8aa5b9%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/a48e18b761144587a9e48f2d4b8aa5b9/images/large/8.jpg not downloaded yet
2026-03-26 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fa48e18b761144587a9e48f2d4b8aa5b9%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/a48e18b761144587a9e48f2d4b8aa5b9/images/large/9.jpg not downloaded yet
2026-03-26 22:45:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74dd4d0>
2026-03-26 22:45:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7d88768-9bf6-5f29-90de-1b51ec377c95/b7d88768-9bf6-5f29-90de-1b51ec377c95_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F389a15ad4b374c9b974d0a116678093b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/389a15ad4b374c9b974d0a116678093b/images/large/1.jpg saved to cache
2026-03-26 22:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b7d88768-9bf6-5f29-90de-1b51ec377c95
2026-03-26 22:45:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c5d850>
2026-03-26 22:45:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7d88768-9bf6-5f29-90de-1b51ec377c95/b7d88768-9bf6-5f29-90de-1b51ec377c95_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F389a15ad4b374c9b974d0a116678093b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/389a15ad4b374c9b974d0a116678093b/images/large/6.jpg saved to cache
2026-03-26 22:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b7d88768-9bf6-5f29-90de-1b51ec377c95
2026-03-26 22:45:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd3bb3d0>
2026-03-26 22:45:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7d88768-9bf6-5f29-90de-1b51ec377c95/b7d88768-9bf6-5f29-90de-1b51ec377c95_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F389a15ad4b374c9b974d0a116678093b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/389a15ad4b374c9b974d0a116678093b/images/large/3.jpg saved to cache
2026-03-26 22:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b7d88768-9bf6-5f29-90de-1b51ec377c95
2026-03-26 22:45:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7501c90>
2026-03-26 22:45:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7d88768-9bf6-5f29-90de-1b51ec377c95/b7d88768-9bf6-5f29-90de-1b51ec377c95_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F389a15ad4b374c9b974d0a116678093b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/389a15ad4b374c9b974d0a116678093b/images/large/2.jpg saved to cache
2026-03-26 22:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b7d88768-9bf6-5f29-90de-1b51ec377c95
2026-03-26 22:45:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd8e0450>
2026-03-26 22:45:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7d88768-9bf6-5f29-90de-1b51ec377c95/b7d88768-9bf6-5f29-90de-1b51ec377c95_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F389a15ad4b374c9b974d0a116678093b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/389a15ad4b374c9b974d0a116678093b/images/large/5.jpg saved to cache
2026-03-26 22:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b7d88768-9bf6-5f29-90de-1b51ec377c95
2026-03-26 22:45:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c759d0>
2026-03-26 22:45:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7d88768-9bf6-5f29-90de-1b51ec377c95/b7d88768-9bf6-5f29-90de-1b51ec377c95_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F389a15ad4b374c9b974d0a116678093b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/389a15ad4b374c9b974d0a116678093b/images/large/8.jpg saved to cache
2026-03-26 22:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b7d88768-9bf6-5f29-90de-1b51ec377c95
2026-03-26 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fa48e18b761144587a9e48f2d4b8aa5b9%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/a48e18b761144587a9e48f2d4b8aa5b9/images/large/10.jpg not downloaded yet
2026-03-26 22:45:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76c56d0>
2026-03-26 22:45:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7d88768-9bf6-5f29-90de-1b51ec377c95/b7d88768-9bf6-5f29-90de-1b51ec377c95_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F389a15ad4b374c9b974d0a116678093b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/389a15ad4b374c9b974d0a116678093b/images/large/4.jpg saved to cache
2026-03-26 22:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b7d88768-9bf6-5f29-90de-1b51ec377c95
2026-03-26 22:45:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cl/389a15ad4b374c9b974d0a116678093b/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:49 [ayvens.be] INFO: Found listing with ID: 1986042
2026-03-26 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986042%27 HTTP/1.1" 200 None
2026-03-26 22:45:49 [ayvens.be] INFO: Scrape type for 1986042: 1
2026-03-26 22:45:49 [ayvens.be] INFO: Extracting data for car ID: 1986042
2026-03-26 22:45:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed with identifier: 1986042
2026-03-26 22:45:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed with scrape type 1
2026-03-26 22:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed
2026-03-26 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F027f18fe5b6b4c37b7522ca0aed8c0ae%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/027f18fe5b6b4c37b7522ca0aed8c0ae/images/large/1.jpg not downloaded yet
2026-03-26 22:45:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd3c45d0>
2026-03-26 22:45:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7d88768-9bf6-5f29-90de-1b51ec377c95/b7d88768-9bf6-5f29-90de-1b51ec377c95_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F389a15ad4b374c9b974d0a116678093b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/389a15ad4b374c9b974d0a116678093b/images/large/7.jpg saved to cache
2026-03-26 22:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b7d88768-9bf6-5f29-90de-1b51ec377c95
2026-03-26 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F027f18fe5b6b4c37b7522ca0aed8c0ae%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/027f18fe5b6b4c37b7522ca0aed8c0ae/images/large/2.jpg not downloaded yet
2026-03-26 22:45:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cl/389a15ad4b374c9b974d0a116678093b/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F027f18fe5b6b4c37b7522ca0aed8c0ae%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/027f18fe5b6b4c37b7522ca0aed8c0ae/images/large/3.jpg not downloaded yet
2026-03-26 22:45:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e122d0>
2026-03-26 22:45:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7d88768-9bf6-5f29-90de-1b51ec377c95/b7d88768-9bf6-5f29-90de-1b51ec377c95_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F389a15ad4b374c9b974d0a116678093b%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/389a15ad4b374c9b974d0a116678093b/images/large/10.jpg saved to cache
2026-03-26 22:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b7d88768-9bf6-5f29-90de-1b51ec377c95
2026-03-26 22:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F027f18fe5b6b4c37b7522ca0aed8c0ae%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/027f18fe5b6b4c37b7522ca0aed8c0ae/images/large/4.jpg not downloaded yet
2026-03-26 22:45:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/a48e18b761144587a9e48f2d4b8aa5b9/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/a48e18b761144587a9e48f2d4b8aa5b9/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/a48e18b761144587a9e48f2d4b8aa5b9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/a48e18b761144587a9e48f2d4b8aa5b9/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F027f18fe5b6b4c37b7522ca0aed8c0ae%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/027f18fe5b6b4c37b7522ca0aed8c0ae/images/large/5.jpg not downloaded yet
2026-03-26 22:45:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/a48e18b761144587a9e48f2d4b8aa5b9/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b727bb50>
2026-03-26 22:45:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7d88768-9bf6-5f29-90de-1b51ec377c95/b7d88768-9bf6-5f29-90de-1b51ec377c95_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F389a15ad4b374c9b974d0a116678093b%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/389a15ad4b374c9b974d0a116678093b/images/large/9.jpg saved to cache
2026-03-26 22:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b7d88768-9bf6-5f29-90de-1b51ec377c95
2026-03-26 22:45:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b7d88768-9bf6-5f29-90de-1b51ec377c95, skipping ID generation
2026-03-26 22:45:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7d88768-9bf6-5f29-90de-1b51ec377c95 with scrape type 1
2026-03-26 22:45:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b7d88768-9bf6-5f29-90de-1b51ec377c95 sending to next pipeline
2026-03-26 22:45:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b7d88768-9bf6-5f29-90de-1b51ec377c95, identifier: 1986040
2026-03-26 22:45:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/a48e18b761144587a9e48f2d4b8aa5b9/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F027f18fe5b6b4c37b7522ca0aed8c0ae%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/027f18fe5b6b4c37b7522ca0aed8c0ae/images/large/6.jpg not downloaded yet
2026-03-26 22:45:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b7d88768-9bf6-5f29-90de-1b51ec377c95 with identifier: 1986040
2026-03-26 22:45:50 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 22:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 22:45:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b7d88768-9bf6-5f29-90de-1b51ec377c95 with identifier: 1986040
2026-03-26 22:45:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b7d88768-9bf6-5f29-90de-1b51ec377c95 with identifier: 1986040 to the API
2026-03-26 22:45:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:45:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:45:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cl/389a15ad4b374c9b974d0a116678093b/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'electric',
 'id': 'b7d88768-9bf6-5f29-90de-1b51ec377c95',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'E-TRON',
 'odometer': 77898,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7d88768-9bf6-5f29-90de-1b51ec377c95/b7d88768-9bf6-5f29-90de-1b51ec377c95_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 522753,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cl/389a15ad4b374c9b974d0a116678093b/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7d88768-9bf6-5f29-90de-1b51ec377c95/b7d88768-9bf6-5f29-90de-1b51ec377c95_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 496874,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cl/389a15ad4b374c9b974d0a116678093b/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7d88768-9bf6-5f29-90de-1b51ec377c95/b7d88768-9bf6-5f29-90de-1b51ec377c95_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 501009,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cl/389a15ad4b374c9b974d0a116678093b/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7d88768-9bf6-5f29-90de-1b51ec377c95/b7d88768-9bf6-5f29-90de-1b51ec377c95_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 540448,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cl/389a15ad4b374c9b974d0a116678093b/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7d88768-9bf6-5f29-90de-1b51ec377c95/b7d88768-9bf6-5f29-90de-1b51ec377c95_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 338073,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cl/389a15ad4b374c9b974d0a116678093b/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7d88768-9bf6-5f29-90de-1b51ec377c95/b7d88768-9bf6-5f29-90de-1b51ec377c95_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 309069,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cl/389a15ad4b374c9b974d0a116678093b/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7d88768-9bf6-5f29-90de-1b51ec377c95/b7d88768-9bf6-5f29-90de-1b51ec377c95_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 352425,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cl/389a15ad4b374c9b974d0a116678093b/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7d88768-9bf6-5f29-90de-1b51ec377c95/b7d88768-9bf6-5f29-90de-1b51ec377c95_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 292005,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cl/389a15ad4b374c9b974d0a116678093b/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7d88768-9bf6-5f29-90de-1b51ec377c95/b7d88768-9bf6-5f29-90de-1b51ec377c95_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 333578,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cl/389a15ad4b374c9b974d0a116678093b/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7d88768-9bf6-5f29-90de-1b51ec377c95/b7d88768-9bf6-5f29-90de-1b51ec377c95_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 296912,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cl/389a15ad4b374c9b974d0a116678093b/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI E-TRON BEV 71KWH 50 QUATTRO S-LINE',
 'transmission': 'automatic',
 'trim': 'BEV 71KWH 50 QUATTRO S-LINE',
 'vin': None,
 'year': 2022}
2026-03-26 22:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986040%27 HTTP/1.1" 200 None
2026-03-26 22:45:50 [ayvens.be] INFO: Saving data for 1986040: {'created_time': 1774565150.63926, 'last_price_update_time': 1774565150.639268, 'auction_closing_time': 1775028600.0}
2026-03-26 22:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986040') HTTP/1.1" 204 0
2026-03-26 22:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F027f18fe5b6b4c37b7522ca0aed8c0ae%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/027f18fe5b6b4c37b7522ca0aed8c0ae/images/large/7.jpg not downloaded yet
2026-03-26 22:45:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76637d0>
2026-03-26 22:45:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_773e2031-4730-5eec-ada3-05f112376a35/773e2031-4730-5eec-ada3-05f112376a35_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fa48e18b761144587a9e48f2d4b8aa5b9%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/a48e18b761144587a9e48f2d4b8aa5b9/images/large/2.jpg saved to cache
2026-03-26 22:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 773e2031-4730-5eec-ada3-05f112376a35
2026-03-26 22:45:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76ce590>
2026-03-26 22:45:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_773e2031-4730-5eec-ada3-05f112376a35/773e2031-4730-5eec-ada3-05f112376a35_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fa48e18b761144587a9e48f2d4b8aa5b9%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/a48e18b761144587a9e48f2d4b8aa5b9/images/large/4.jpg saved to cache
2026-03-26 22:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 773e2031-4730-5eec-ada3-05f112376a35
2026-03-26 22:45:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7572290>
2026-03-26 22:45:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_773e2031-4730-5eec-ada3-05f112376a35/773e2031-4730-5eec-ada3-05f112376a35_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fa48e18b761144587a9e48f2d4b8aa5b9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/a48e18b761144587a9e48f2d4b8aa5b9/images/large/1.jpg saved to cache
2026-03-26 22:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 773e2031-4730-5eec-ada3-05f112376a35
2026-03-26 22:45:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e1cbd0>
2026-03-26 22:45:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_773e2031-4730-5eec-ada3-05f112376a35/773e2031-4730-5eec-ada3-05f112376a35_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fa48e18b761144587a9e48f2d4b8aa5b9%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/a48e18b761144587a9e48f2d4b8aa5b9/images/large/3.jpg saved to cache
2026-03-26 22:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 773e2031-4730-5eec-ada3-05f112376a35
2026-03-26 22:45:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76ed650>
2026-03-26 22:45:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_773e2031-4730-5eec-ada3-05f112376a35/773e2031-4730-5eec-ada3-05f112376a35_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fa48e18b761144587a9e48f2d4b8aa5b9%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/a48e18b761144587a9e48f2d4b8aa5b9/images/large/5.jpg saved to cache
2026-03-26 22:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 773e2031-4730-5eec-ada3-05f112376a35
2026-03-26 22:45:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c7d1d0>
2026-03-26 22:45:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_773e2031-4730-5eec-ada3-05f112376a35/773e2031-4730-5eec-ada3-05f112376a35_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fa48e18b761144587a9e48f2d4b8aa5b9%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/a48e18b761144587a9e48f2d4b8aa5b9/images/large/6.jpg saved to cache
2026-03-26 22:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 773e2031-4730-5eec-ada3-05f112376a35
2026-03-26 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F027f18fe5b6b4c37b7522ca0aed8c0ae%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/027f18fe5b6b4c37b7522ca0aed8c0ae/images/large/8.jpg not downloaded yet
2026-03-26 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F027f18fe5b6b4c37b7522ca0aed8c0ae%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/027f18fe5b6b4c37b7522ca0aed8c0ae/images/large/9.jpg not downloaded yet
2026-03-26 22:45:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/027f18fe5b6b4c37b7522ca0aed8c0ae/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/027f18fe5b6b4c37b7522ca0aed8c0ae/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/027f18fe5b6b4c37b7522ca0aed8c0ae/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F027f18fe5b6b4c37b7522ca0aed8c0ae%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/027f18fe5b6b4c37b7522ca0aed8c0ae/images/large/10.jpg not downloaded yet
2026-03-26 22:45:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/a48e18b761144587a9e48f2d4b8aa5b9/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:51 [ayvens.be] INFO: Found listing with ID: 1986043
2026-03-26 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986043%27 HTTP/1.1" 200 None
2026-03-26 22:45:51 [ayvens.be] INFO: Scrape type for 1986043: 1
2026-03-26 22:45:51 [ayvens.be] INFO: Extracting data for car ID: 1986043
2026-03-26 22:45:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a75d91fb-83ba-554c-931a-fd5238a3de47 with identifier: 1986043
2026-03-26 22:45:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a75d91fb-83ba-554c-931a-fd5238a3de47 with scrape type 1
2026-03-26 22:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a75d91fb-83ba-554c-931a-fd5238a3de47
2026-03-26 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fs%252F9d9081947f1543f89c1797a8fd2e435a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fs/9d9081947f1543f89c1797a8fd2e435a/images/large/1.jpg not downloaded yet
2026-03-26 22:45:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/027f18fe5b6b4c37b7522ca0aed8c0ae/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fs%252F9d9081947f1543f89c1797a8fd2e435a%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fs/9d9081947f1543f89c1797a8fd2e435a/images/large/2.jpg not downloaded yet
2026-03-26 22:45:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/a48e18b761144587a9e48f2d4b8aa5b9/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76cf810>
2026-03-26 22:45:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed/1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F027f18fe5b6b4c37b7522ca0aed8c0ae%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/027f18fe5b6b4c37b7522ca0aed8c0ae/images/large/2.jpg saved to cache
2026-03-26 22:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed
2026-03-26 22:45:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7567910>
2026-03-26 22:45:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed/1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F027f18fe5b6b4c37b7522ca0aed8c0ae%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/027f18fe5b6b4c37b7522ca0aed8c0ae/images/large/1.jpg saved to cache
2026-03-26 22:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed
2026-03-26 22:45:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7585850>
2026-03-26 22:45:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed/1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F027f18fe5b6b4c37b7522ca0aed8c0ae%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/027f18fe5b6b4c37b7522ca0aed8c0ae/images/large/3.jpg saved to cache
2026-03-26 22:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed
2026-03-26 22:45:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/a48e18b761144587a9e48f2d4b8aa5b9/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/a48e18b761144587a9e48f2d4b8aa5b9/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fs%252F9d9081947f1543f89c1797a8fd2e435a%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fs/9d9081947f1543f89c1797a8fd2e435a/images/large/3.jpg not downloaded yet
2026-03-26 22:45:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cb07d0>
2026-03-26 22:45:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_773e2031-4730-5eec-ada3-05f112376a35/773e2031-4730-5eec-ada3-05f112376a35_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fa48e18b761144587a9e48f2d4b8aa5b9%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/a48e18b761144587a9e48f2d4b8aa5b9/images/large/7.jpg saved to cache
2026-03-26 22:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 773e2031-4730-5eec-ada3-05f112376a35
2026-03-26 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fs%252F9d9081947f1543f89c1797a8fd2e435a%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fs/9d9081947f1543f89c1797a8fd2e435a/images/large/4.jpg not downloaded yet
2026-03-26 22:45:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/027f18fe5b6b4c37b7522ca0aed8c0ae/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fs%252F9d9081947f1543f89c1797a8fd2e435a%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fs/9d9081947f1543f89c1797a8fd2e435a/images/large/5.jpg not downloaded yet
2026-03-26 22:45:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b742aa10>
2026-03-26 22:45:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed/1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F027f18fe5b6b4c37b7522ca0aed8c0ae%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/027f18fe5b6b4c37b7522ca0aed8c0ae/images/large/4.jpg saved to cache
2026-03-26 22:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed
2026-03-26 22:45:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e28410>
2026-03-26 22:45:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_773e2031-4730-5eec-ada3-05f112376a35/773e2031-4730-5eec-ada3-05f112376a35_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fa48e18b761144587a9e48f2d4b8aa5b9%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/a48e18b761144587a9e48f2d4b8aa5b9/images/large/9.jpg saved to cache
2026-03-26 22:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 773e2031-4730-5eec-ada3-05f112376a35
2026-03-26 22:45:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/027f18fe5b6b4c37b7522ca0aed8c0ae/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/027f18fe5b6b4c37b7522ca0aed8c0ae/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/027f18fe5b6b4c37b7522ca0aed8c0ae/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/027f18fe5b6b4c37b7522ca0aed8c0ae/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fs%252F9d9081947f1543f89c1797a8fd2e435a%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fs/9d9081947f1543f89c1797a8fd2e435a/images/large/6.jpg not downloaded yet
2026-03-26 22:45:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b727b7d0>
2026-03-26 22:45:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_773e2031-4730-5eec-ada3-05f112376a35/773e2031-4730-5eec-ada3-05f112376a35_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fa48e18b761144587a9e48f2d4b8aa5b9%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/a48e18b761144587a9e48f2d4b8aa5b9/images/large/8.jpg saved to cache
2026-03-26 22:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 773e2031-4730-5eec-ada3-05f112376a35
2026-03-26 22:45:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e2bc10>
2026-03-26 22:45:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_773e2031-4730-5eec-ada3-05f112376a35/773e2031-4730-5eec-ada3-05f112376a35_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fa48e18b761144587a9e48f2d4b8aa5b9%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/a48e18b761144587a9e48f2d4b8aa5b9/images/large/10.jpg saved to cache
2026-03-26 22:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 773e2031-4730-5eec-ada3-05f112376a35
2026-03-26 22:45:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 773e2031-4730-5eec-ada3-05f112376a35, skipping ID generation
2026-03-26 22:45:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 773e2031-4730-5eec-ada3-05f112376a35 with scrape type 1
2026-03-26 22:45:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 773e2031-4730-5eec-ada3-05f112376a35 sending to next pipeline
2026-03-26 22:45:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 773e2031-4730-5eec-ada3-05f112376a35, identifier: 1986041
2026-03-26 22:45:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 773e2031-4730-5eec-ada3-05f112376a35 with identifier: 1986041
2026-03-26 22:45:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 773e2031-4730-5eec-ada3-05f112376a35 with identifier: 1986041
2026-03-26 22:45:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 773e2031-4730-5eec-ada3-05f112376a35 with identifier: 1986041 to the API
2026-03-26 22:45:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:45:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:45:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bn/a48e18b761144587a9e48f2d4b8aa5b9/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '773e2031-4730-5eec-ada3-05f112376a35',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLASS A (W177)',
 'odometer': 77912,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_773e2031-4730-5eec-ada3-05f112376a35/773e2031-4730-5eec-ada3-05f112376a35_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 686370,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/a48e18b761144587a9e48f2d4b8aa5b9/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_773e2031-4730-5eec-ada3-05f112376a35/773e2031-4730-5eec-ada3-05f112376a35_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 724738,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/a48e18b761144587a9e48f2d4b8aa5b9/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_773e2031-4730-5eec-ada3-05f112376a35/773e2031-4730-5eec-ada3-05f112376a35_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 700961,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/a48e18b761144587a9e48f2d4b8aa5b9/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_773e2031-4730-5eec-ada3-05f112376a35/773e2031-4730-5eec-ada3-05f112376a35_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 756380,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/a48e18b761144587a9e48f2d4b8aa5b9/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_773e2031-4730-5eec-ada3-05f112376a35/773e2031-4730-5eec-ada3-05f112376a35_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 739059,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/a48e18b761144587a9e48f2d4b8aa5b9/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_773e2031-4730-5eec-ada3-05f112376a35/773e2031-4730-5eec-ada3-05f112376a35_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 820418,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/a48e18b761144587a9e48f2d4b8aa5b9/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_773e2031-4730-5eec-ada3-05f112376a35/773e2031-4730-5eec-ada3-05f112376a35_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 641169,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/a48e18b761144587a9e48f2d4b8aa5b9/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_773e2031-4730-5eec-ada3-05f112376a35/773e2031-4730-5eec-ada3-05f112376a35_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 854353,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/a48e18b761144587a9e48f2d4b8aa5b9/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_773e2031-4730-5eec-ada3-05f112376a35/773e2031-4730-5eec-ada3-05f112376a35_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 785614,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/a48e18b761144587a9e48f2d4b8aa5b9/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_773e2031-4730-5eec-ada3-05f112376a35/773e2031-4730-5eec-ada3-05f112376a35_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 825419,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/a48e18b761144587a9e48f2d4b8aa5b9/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLASS A (W177) A 250 e PHEV Business Solution',
 'transmission': 'automatic',
 'trim': 'A 250 e PHEV Business Solution',
 'vin': None,
 'year': 2022}
2026-03-26 22:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986041%27 HTTP/1.1" 200 None
2026-03-26 22:45:52 [ayvens.be] INFO: Saving data for 1986041: {'created_time': 1774565152.544676, 'last_price_update_time': 1774565152.544685, 'auction_closing_time': 1775028600.0}
2026-03-26 22:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986041') HTTP/1.1" 204 0
2026-03-26 22:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fs%252F9d9081947f1543f89c1797a8fd2e435a%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fs/9d9081947f1543f89c1797a8fd2e435a/images/large/7.jpg not downloaded yet
2026-03-26 22:45:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b787cf90>
2026-03-26 22:45:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed/1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F027f18fe5b6b4c37b7522ca0aed8c0ae%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/027f18fe5b6b4c37b7522ca0aed8c0ae/images/large/6.jpg saved to cache
2026-03-26 22:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed
2026-03-26 22:45:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7492290>
2026-03-26 22:45:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed/1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F027f18fe5b6b4c37b7522ca0aed8c0ae%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/027f18fe5b6b4c37b7522ca0aed8c0ae/images/large/9.jpg saved to cache
2026-03-26 22:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed
2026-03-26 22:45:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7500290>
2026-03-26 22:45:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed/1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F027f18fe5b6b4c37b7522ca0aed8c0ae%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/027f18fe5b6b4c37b7522ca0aed8c0ae/images/large/7.jpg saved to cache
2026-03-26 22:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed
2026-03-26 22:45:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7493210>
2026-03-26 22:45:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed/1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F027f18fe5b6b4c37b7522ca0aed8c0ae%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/027f18fe5b6b4c37b7522ca0aed8c0ae/images/large/5.jpg saved to cache
2026-03-26 22:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed
2026-03-26 22:45:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b741d750>
2026-03-26 22:45:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed/1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F027f18fe5b6b4c37b7522ca0aed8c0ae%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/027f18fe5b6b4c37b7522ca0aed8c0ae/images/large/8.jpg saved to cache
2026-03-26 22:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed
2026-03-26 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fs%252F9d9081947f1543f89c1797a8fd2e435a%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fs/9d9081947f1543f89c1797a8fd2e435a/images/large/8.jpg not downloaded yet
2026-03-26 22:45:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/027f18fe5b6b4c37b7522ca0aed8c0ae/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fs%252F9d9081947f1543f89c1797a8fd2e435a%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fs/9d9081947f1543f89c1797a8fd2e435a/images/large/9.jpg not downloaded yet
2026-03-26 22:45:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fs/9d9081947f1543f89c1797a8fd2e435a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fs/9d9081947f1543f89c1797a8fd2e435a/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fs%252F9d9081947f1543f89c1797a8fd2e435a%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fs/9d9081947f1543f89c1797a8fd2e435a/images/large/10.jpg not downloaded yet
2026-03-26 22:45:53 [ayvens.be] INFO: Found listing with ID: 1986044
2026-03-26 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986044%27 HTTP/1.1" 200 None
2026-03-26 22:45:53 [ayvens.be] INFO: Scrape type for 1986044: 1
2026-03-26 22:45:53 [ayvens.be] INFO: Extracting data for car ID: 1986044
2026-03-26 22:45:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d16ce74-aed5-5916-80bb-e5a1ac156184 with identifier: 1986044
2026-03-26 22:45:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d16ce74-aed5-5916-80bb-e5a1ac156184 with scrape type 1
2026-03-26 22:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7d16ce74-aed5-5916-80bb-e5a1ac156184
2026-03-26 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F76531d0ed07a41629163a03ceb057d96%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/76531d0ed07a41629163a03ceb057d96/images/large/1.jpg not downloaded yet
2026-03-26 22:45:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fs/9d9081947f1543f89c1797a8fd2e435a/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fs/9d9081947f1543f89c1797a8fd2e435a/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fs/9d9081947f1543f89c1797a8fd2e435a/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F76531d0ed07a41629163a03ceb057d96%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/76531d0ed07a41629163a03ceb057d96/images/large/2.jpg not downloaded yet
2026-03-26 22:45:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74ac0d0>
2026-03-26 22:45:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed/1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F027f18fe5b6b4c37b7522ca0aed8c0ae%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/027f18fe5b6b4c37b7522ca0aed8c0ae/images/large/10.jpg saved to cache
2026-03-26 22:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed
2026-03-26 22:45:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed, skipping ID generation
2026-03-26 22:45:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed with scrape type 1
2026-03-26 22:45:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed sending to next pipeline
2026-03-26 22:45:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed, identifier: 1986042
2026-03-26 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F76531d0ed07a41629163a03ceb057d96%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/76531d0ed07a41629163a03ceb057d96/images/large/3.jpg not downloaded yet
2026-03-26 22:45:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed with identifier: 1986042
2026-03-26 22:45:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed with identifier: 1986042
2026-03-26 22:45:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed with identifier: 1986042 to the API
2026-03-26 22:45:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:45:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:45:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bn/027f18fe5b6b4c37b7522ca0aed8c0ae/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 100444,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed/1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 380635,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/027f18fe5b6b4c37b7522ca0aed8c0ae/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed/1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 362499,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/027f18fe5b6b4c37b7522ca0aed8c0ae/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed/1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 432716,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/027f18fe5b6b4c37b7522ca0aed8c0ae/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed/1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 403655,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/027f18fe5b6b4c37b7522ca0aed8c0ae/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed/1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 354182,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/027f18fe5b6b4c37b7522ca0aed8c0ae/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed/1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 241488,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/027f18fe5b6b4c37b7522ca0aed8c0ae/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed/1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 370952,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/027f18fe5b6b4c37b7522ca0aed8c0ae/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed/1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 343858,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/027f18fe5b6b4c37b7522ca0aed8c0ae/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed/1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 278326,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/027f18fe5b6b4c37b7522ca0aed8c0ae/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed/1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 371524,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/027f18fe5b6b4c37b7522ca0aed8c0ae/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 1.6 PHEV 225 E-AUTO8 GT PACK',
 'transmission': 'automatic',
 'trim': '1.6 PHEV 225 E-AUTO8 GT PACK',
 'vin': None,
 'year': 2022}
2026-03-26 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986042%27 HTTP/1.1" 200 None
2026-03-26 22:45:53 [ayvens.be] INFO: Saving data for 1986042: {'created_time': 1774565153.697382, 'last_price_update_time': 1774565153.697391, 'auction_closing_time': 1775028600.0}
2026-03-26 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986042') HTTP/1.1" 204 0
2026-03-26 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F76531d0ed07a41629163a03ceb057d96%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/76531d0ed07a41629163a03ceb057d96/images/large/4.jpg not downloaded yet
2026-03-26 22:45:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7488410>
2026-03-26 22:45:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a75d91fb-83ba-554c-931a-fd5238a3de47/a75d91fb-83ba-554c-931a-fd5238a3de47_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fs%252F9d9081947f1543f89c1797a8fd2e435a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fs/9d9081947f1543f89c1797a8fd2e435a/images/large/1.jpg saved to cache
2026-03-26 22:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a75d91fb-83ba-554c-931a-fd5238a3de47
2026-03-26 22:45:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b75035d0>
2026-03-26 22:45:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a75d91fb-83ba-554c-931a-fd5238a3de47/a75d91fb-83ba-554c-931a-fd5238a3de47_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fs%252F9d9081947f1543f89c1797a8fd2e435a%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fs/9d9081947f1543f89c1797a8fd2e435a/images/large/2.jpg saved to cache
2026-03-26 22:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a75d91fb-83ba-554c-931a-fd5238a3de47
2026-03-26 22:45:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b768a310>
2026-03-26 22:45:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a75d91fb-83ba-554c-931a-fd5238a3de47/a75d91fb-83ba-554c-931a-fd5238a3de47_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fs%252F9d9081947f1543f89c1797a8fd2e435a%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fs/9d9081947f1543f89c1797a8fd2e435a/images/large/3.jpg saved to cache
2026-03-26 22:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a75d91fb-83ba-554c-931a-fd5238a3de47
2026-03-26 22:45:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b72903d0>
2026-03-26 22:45:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a75d91fb-83ba-554c-931a-fd5238a3de47/a75d91fb-83ba-554c-931a-fd5238a3de47_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fs%252F9d9081947f1543f89c1797a8fd2e435a%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fs/9d9081947f1543f89c1797a8fd2e435a/images/large/4.jpg saved to cache
2026-03-26 22:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a75d91fb-83ba-554c-931a-fd5238a3de47
2026-03-26 22:45:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74888d0>
2026-03-26 22:45:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a75d91fb-83ba-554c-931a-fd5238a3de47/a75d91fb-83ba-554c-931a-fd5238a3de47_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fs%252F9d9081947f1543f89c1797a8fd2e435a%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fs/9d9081947f1543f89c1797a8fd2e435a/images/large/5.jpg saved to cache
2026-03-26 22:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a75d91fb-83ba-554c-931a-fd5238a3de47
2026-03-26 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F76531d0ed07a41629163a03ceb057d96%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/76531d0ed07a41629163a03ceb057d96/images/large/5.jpg not downloaded yet
2026-03-26 22:45:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fs/9d9081947f1543f89c1797a8fd2e435a/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F76531d0ed07a41629163a03ceb057d96%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/76531d0ed07a41629163a03ceb057d96/images/large/6.jpg not downloaded yet
2026-03-26 22:45:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fs/9d9081947f1543f89c1797a8fd2e435a/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fs/9d9081947f1543f89c1797a8fd2e435a/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fs/9d9081947f1543f89c1797a8fd2e435a/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fs/9d9081947f1543f89c1797a8fd2e435a/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F76531d0ed07a41629163a03ceb057d96%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/76531d0ed07a41629163a03ceb057d96/images/large/7.jpg not downloaded yet
2026-03-26 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F76531d0ed07a41629163a03ceb057d96%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/76531d0ed07a41629163a03ceb057d96/images/large/8.jpg not downloaded yet
2026-03-26 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F76531d0ed07a41629163a03ceb057d96%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/76531d0ed07a41629163a03ceb057d96/images/large/9.jpg not downloaded yet
2026-03-26 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F76531d0ed07a41629163a03ceb057d96%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/76531d0ed07a41629163a03ceb057d96/images/large/10.jpg not downloaded yet
2026-03-26 22:45:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/76531d0ed07a41629163a03ceb057d96/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/76531d0ed07a41629163a03ceb057d96/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:54 [ayvens.be] INFO: Found listing with ID: 1986045
2026-03-26 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986045%27 HTTP/1.1" 200 None
2026-03-26 22:45:54 [ayvens.be] INFO: Scrape type for 1986045: 1
2026-03-26 22:45:54 [ayvens.be] INFO: Extracting data for car ID: 1986045
2026-03-26 22:45:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d010e538-ecc5-5d8b-87d0-d392c7fd8842 with identifier: 1986045
2026-03-26 22:45:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d010e538-ecc5-5d8b-87d0-d392c7fd8842 with scrape type 1
2026-03-26 22:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d010e538-ecc5-5d8b-87d0-d392c7fd8842
2026-03-26 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F786a70f29ae14639811fe53e5df11d5e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/786a70f29ae14639811fe53e5df11d5e/images/large/1.jpg not downloaded yet
2026-03-26 22:45:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5ca5c90>
2026-03-26 22:45:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a75d91fb-83ba-554c-931a-fd5238a3de47/a75d91fb-83ba-554c-931a-fd5238a3de47_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fs%252F9d9081947f1543f89c1797a8fd2e435a%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fs/9d9081947f1543f89c1797a8fd2e435a/images/large/10.jpg saved to cache
2026-03-26 22:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a75d91fb-83ba-554c-931a-fd5238a3de47
2026-03-26 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F786a70f29ae14639811fe53e5df11d5e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/786a70f29ae14639811fe53e5df11d5e/images/large/2.jpg not downloaded yet
2026-03-26 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F786a70f29ae14639811fe53e5df11d5e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/786a70f29ae14639811fe53e5df11d5e/images/large/3.jpg not downloaded yet
2026-03-26 22:45:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e2ba50>
2026-03-26 22:45:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a75d91fb-83ba-554c-931a-fd5238a3de47/a75d91fb-83ba-554c-931a-fd5238a3de47_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fs%252F9d9081947f1543f89c1797a8fd2e435a%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fs/9d9081947f1543f89c1797a8fd2e435a/images/large/6.jpg saved to cache
2026-03-26 22:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a75d91fb-83ba-554c-931a-fd5238a3de47
2026-03-26 22:45:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7401390>
2026-03-26 22:45:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a75d91fb-83ba-554c-931a-fd5238a3de47/a75d91fb-83ba-554c-931a-fd5238a3de47_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fs%252F9d9081947f1543f89c1797a8fd2e435a%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fs/9d9081947f1543f89c1797a8fd2e435a/images/large/7.jpg saved to cache
2026-03-26 22:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a75d91fb-83ba-554c-931a-fd5238a3de47
2026-03-26 22:45:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7875e50>
2026-03-26 22:45:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a75d91fb-83ba-554c-931a-fd5238a3de47/a75d91fb-83ba-554c-931a-fd5238a3de47_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fs%252F9d9081947f1543f89c1797a8fd2e435a%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fs/9d9081947f1543f89c1797a8fd2e435a/images/large/8.jpg saved to cache
2026-03-26 22:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a75d91fb-83ba-554c-931a-fd5238a3de47
2026-03-26 22:45:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74b7050>
2026-03-26 22:45:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a75d91fb-83ba-554c-931a-fd5238a3de47/a75d91fb-83ba-554c-931a-fd5238a3de47_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fs%252F9d9081947f1543f89c1797a8fd2e435a%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fs/9d9081947f1543f89c1797a8fd2e435a/images/large/9.jpg saved to cache
2026-03-26 22:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a75d91fb-83ba-554c-931a-fd5238a3de47
2026-03-26 22:45:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a75d91fb-83ba-554c-931a-fd5238a3de47, skipping ID generation
2026-03-26 22:45:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a75d91fb-83ba-554c-931a-fd5238a3de47 with scrape type 1
2026-03-26 22:45:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a75d91fb-83ba-554c-931a-fd5238a3de47 sending to next pipeline
2026-03-26 22:45:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a75d91fb-83ba-554c-931a-fd5238a3de47, identifier: 1986043
2026-03-26 22:45:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7475350>
2026-03-26 22:45:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d16ce74-aed5-5916-80bb-e5a1ac156184/7d16ce74-aed5-5916-80bb-e5a1ac156184_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F76531d0ed07a41629163a03ceb057d96%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/76531d0ed07a41629163a03ceb057d96/images/large/1.jpg saved to cache
2026-03-26 22:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7d16ce74-aed5-5916-80bb-e5a1ac156184
2026-03-26 22:45:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7481c10>
2026-03-26 22:45:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d16ce74-aed5-5916-80bb-e5a1ac156184/7d16ce74-aed5-5916-80bb-e5a1ac156184_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F76531d0ed07a41629163a03ceb057d96%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/76531d0ed07a41629163a03ceb057d96/images/large/2.jpg saved to cache
2026-03-26 22:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7d16ce74-aed5-5916-80bb-e5a1ac156184
2026-03-26 22:45:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a75d91fb-83ba-554c-931a-fd5238a3de47 with identifier: 1986043
2026-03-26 22:45:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a75d91fb-83ba-554c-931a-fd5238a3de47 with identifier: 1986043
2026-03-26 22:45:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a75d91fb-83ba-554c-931a-fd5238a3de47 with identifier: 1986043 to the API
2026-03-26 22:45:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:45:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:45:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2fs/9d9081947f1543f89c1797a8fd2e435a/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'electric',
 'id': 'a75d91fb-83ba-554c-931a-fd5238a3de47',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'EX30',
 'odometer': 16659,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a75d91fb-83ba-554c-931a-fd5238a3de47/a75d91fb-83ba-554c-931a-fd5238a3de47_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 554639,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fs/9d9081947f1543f89c1797a8fd2e435a/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a75d91fb-83ba-554c-931a-fd5238a3de47/a75d91fb-83ba-554c-931a-fd5238a3de47_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 576088,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fs/9d9081947f1543f89c1797a8fd2e435a/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a75d91fb-83ba-554c-931a-fd5238a3de47/a75d91fb-83ba-554c-931a-fd5238a3de47_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 598789,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fs/9d9081947f1543f89c1797a8fd2e435a/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a75d91fb-83ba-554c-931a-fd5238a3de47/a75d91fb-83ba-554c-931a-fd5238a3de47_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 575276,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fs/9d9081947f1543f89c1797a8fd2e435a/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a75d91fb-83ba-554c-931a-fd5238a3de47/a75d91fb-83ba-554c-931a-fd5238a3de47_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 545665,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fs/9d9081947f1543f89c1797a8fd2e435a/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a75d91fb-83ba-554c-931a-fd5238a3de47/a75d91fb-83ba-554c-931a-fd5238a3de47_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 490866,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fs/9d9081947f1543f89c1797a8fd2e435a/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a75d91fb-83ba-554c-931a-fd5238a3de47/a75d91fb-83ba-554c-931a-fd5238a3de47_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 623358,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fs/9d9081947f1543f89c1797a8fd2e435a/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a75d91fb-83ba-554c-931a-fd5238a3de47/a75d91fb-83ba-554c-931a-fd5238a3de47_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 566681,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fs/9d9081947f1543f89c1797a8fd2e435a/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a75d91fb-83ba-554c-931a-fd5238a3de47/a75d91fb-83ba-554c-931a-fd5238a3de47_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 467209,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fs/9d9081947f1543f89c1797a8fd2e435a/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a75d91fb-83ba-554c-931a-fd5238a3de47/a75d91fb-83ba-554c-931a-fd5238a3de47_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 386246,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fs/9d9081947f1543f89c1797a8fd2e435a/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-07-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO EX30 BEV 69KWH SINGLE MOTOR EXT. RANGE CORE',
 'transmission': 'automatic',
 'trim': 'BEV 69KWH SINGLE MOTOR EXT. RANGE CORE',
 'vin': None,
 'year': 2024}
2026-03-26 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986043%27 HTTP/1.1" 200 None
2026-03-26 22:45:55 [ayvens.be] INFO: Saving data for 1986043: {'created_time': 1774565155.759483, 'last_price_update_time': 1774565155.759493, 'auction_closing_time': 1775028600.0}
2026-03-26 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986043') HTTP/1.1" 204 0
2026-03-26 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F786a70f29ae14639811fe53e5df11d5e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/786a70f29ae14639811fe53e5df11d5e/images/large/4.jpg not downloaded yet
2026-03-26 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F786a70f29ae14639811fe53e5df11d5e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/786a70f29ae14639811fe53e5df11d5e/images/large/5.jpg not downloaded yet
2026-03-26 22:45:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/76531d0ed07a41629163a03ceb057d96/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F786a70f29ae14639811fe53e5df11d5e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/786a70f29ae14639811fe53e5df11d5e/images/large/6.jpg not downloaded yet
2026-03-26 22:45:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/76531d0ed07a41629163a03ceb057d96/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/76531d0ed07a41629163a03ceb057d96/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F786a70f29ae14639811fe53e5df11d5e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/786a70f29ae14639811fe53e5df11d5e/images/large/7.jpg not downloaded yet
2026-03-26 22:45:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/76531d0ed07a41629163a03ceb057d96/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/76531d0ed07a41629163a03ceb057d96/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F786a70f29ae14639811fe53e5df11d5e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/786a70f29ae14639811fe53e5df11d5e/images/large/8.jpg not downloaded yet
2026-03-26 22:45:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7476bd0>
2026-03-26 22:45:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d16ce74-aed5-5916-80bb-e5a1ac156184/7d16ce74-aed5-5916-80bb-e5a1ac156184_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F76531d0ed07a41629163a03ceb057d96%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/76531d0ed07a41629163a03ceb057d96/images/large/3.jpg saved to cache
2026-03-26 22:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7d16ce74-aed5-5916-80bb-e5a1ac156184
2026-03-26 22:45:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cc35d0>
2026-03-26 22:45:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d16ce74-aed5-5916-80bb-e5a1ac156184/7d16ce74-aed5-5916-80bb-e5a1ac156184_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F76531d0ed07a41629163a03ceb057d96%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/76531d0ed07a41629163a03ceb057d96/images/large/4.jpg saved to cache
2026-03-26 22:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7d16ce74-aed5-5916-80bb-e5a1ac156184
2026-03-26 22:45:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e4ff10>
2026-03-26 22:45:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d16ce74-aed5-5916-80bb-e5a1ac156184/7d16ce74-aed5-5916-80bb-e5a1ac156184_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F76531d0ed07a41629163a03ceb057d96%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/76531d0ed07a41629163a03ceb057d96/images/large/7.jpg saved to cache
2026-03-26 22:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7d16ce74-aed5-5916-80bb-e5a1ac156184
2026-03-26 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F786a70f29ae14639811fe53e5df11d5e%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/786a70f29ae14639811fe53e5df11d5e/images/large/9.jpg not downloaded yet
2026-03-26 22:45:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/76531d0ed07a41629163a03ceb057d96/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/76531d0ed07a41629163a03ceb057d96/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/76531d0ed07a41629163a03ceb057d96/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F786a70f29ae14639811fe53e5df11d5e%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/786a70f29ae14639811fe53e5df11d5e/images/large/10.jpg not downloaded yet
2026-03-26 22:45:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7571d10>
2026-03-26 22:45:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d16ce74-aed5-5916-80bb-e5a1ac156184/7d16ce74-aed5-5916-80bb-e5a1ac156184_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F76531d0ed07a41629163a03ceb057d96%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/76531d0ed07a41629163a03ceb057d96/images/large/5.jpg saved to cache
2026-03-26 22:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7d16ce74-aed5-5916-80bb-e5a1ac156184
2026-03-26 22:45:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e12150>
2026-03-26 22:45:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d16ce74-aed5-5916-80bb-e5a1ac156184/7d16ce74-aed5-5916-80bb-e5a1ac156184_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F76531d0ed07a41629163a03ceb057d96%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/76531d0ed07a41629163a03ceb057d96/images/large/8.jpg saved to cache
2026-03-26 22:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7d16ce74-aed5-5916-80bb-e5a1ac156184
2026-03-26 22:45:56 [ayvens.be] INFO: Found listing with ID: 1986046
2026-03-26 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986046%27 HTTP/1.1" 200 None
2026-03-26 22:45:56 [ayvens.be] INFO: Scrape type for 1986046: 1
2026-03-26 22:45:56 [ayvens.be] INFO: Extracting data for car ID: 1986046
2026-03-26 22:45:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c32ddf75-f711-5d8e-88f4-e2a8637663cd with identifier: 1986046
2026-03-26 22:45:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c32ddf75-f711-5d8e-88f4-e2a8637663cd with scrape type 1
2026-03-26 22:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c32ddf75-f711-5d8e-88f4-e2a8637663cd
2026-03-26 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cw%252F700b49f150f24f55886f58a0d9457393%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cw/700b49f150f24f55886f58a0d9457393/images/large/1.jpg not downloaded yet
2026-03-26 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cw%252F700b49f150f24f55886f58a0d9457393%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cw/700b49f150f24f55886f58a0d9457393/images/large/2.jpg not downloaded yet
2026-03-26 22:45:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/786a70f29ae14639811fe53e5df11d5e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/786a70f29ae14639811fe53e5df11d5e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/786a70f29ae14639811fe53e5df11d5e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cw%252F700b49f150f24f55886f58a0d9457393%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cw/700b49f150f24f55886f58a0d9457393/images/large/3.jpg not downloaded yet
2026-03-26 22:45:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cc8790>
2026-03-26 22:45:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d16ce74-aed5-5916-80bb-e5a1ac156184/7d16ce74-aed5-5916-80bb-e5a1ac156184_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F76531d0ed07a41629163a03ceb057d96%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/76531d0ed07a41629163a03ceb057d96/images/large/9.jpg saved to cache
2026-03-26 22:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7d16ce74-aed5-5916-80bb-e5a1ac156184
2026-03-26 22:45:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e45b90>
2026-03-26 22:45:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d16ce74-aed5-5916-80bb-e5a1ac156184/7d16ce74-aed5-5916-80bb-e5a1ac156184_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F76531d0ed07a41629163a03ceb057d96%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/76531d0ed07a41629163a03ceb057d96/images/large/6.jpg saved to cache
2026-03-26 22:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7d16ce74-aed5-5916-80bb-e5a1ac156184
2026-03-26 22:45:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74e7ed0>
2026-03-26 22:45:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d16ce74-aed5-5916-80bb-e5a1ac156184/7d16ce74-aed5-5916-80bb-e5a1ac156184_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F76531d0ed07a41629163a03ceb057d96%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/76531d0ed07a41629163a03ceb057d96/images/large/10.jpg saved to cache
2026-03-26 22:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7d16ce74-aed5-5916-80bb-e5a1ac156184
2026-03-26 22:45:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7d16ce74-aed5-5916-80bb-e5a1ac156184, skipping ID generation
2026-03-26 22:45:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d16ce74-aed5-5916-80bb-e5a1ac156184 with scrape type 1
2026-03-26 22:45:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7d16ce74-aed5-5916-80bb-e5a1ac156184 sending to next pipeline
2026-03-26 22:45:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 7d16ce74-aed5-5916-80bb-e5a1ac156184, identifier: 1986044
2026-03-26 22:45:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/786a70f29ae14639811fe53e5df11d5e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 7d16ce74-aed5-5916-80bb-e5a1ac156184 with identifier: 1986044
2026-03-26 22:45:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 7d16ce74-aed5-5916-80bb-e5a1ac156184 with identifier: 1986044
2026-03-26 22:45:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 7d16ce74-aed5-5916-80bb-e5a1ac156184 with identifier: 1986044 to the API
2026-03-26 22:45:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:45:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:45:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ar/76531d0ed07a41629163a03ceb057d96/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '7d16ce74-aed5-5916-80bb-e5a1ac156184',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'OCTAVIA COMBI',
 'odometer': 164594,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d16ce74-aed5-5916-80bb-e5a1ac156184/7d16ce74-aed5-5916-80bb-e5a1ac156184_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 741405,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/76531d0ed07a41629163a03ceb057d96/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d16ce74-aed5-5916-80bb-e5a1ac156184/7d16ce74-aed5-5916-80bb-e5a1ac156184_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 743268,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/76531d0ed07a41629163a03ceb057d96/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d16ce74-aed5-5916-80bb-e5a1ac156184/7d16ce74-aed5-5916-80bb-e5a1ac156184_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 734844,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/76531d0ed07a41629163a03ceb057d96/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d16ce74-aed5-5916-80bb-e5a1ac156184/7d16ce74-aed5-5916-80bb-e5a1ac156184_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 806321,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/76531d0ed07a41629163a03ceb057d96/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d16ce74-aed5-5916-80bb-e5a1ac156184/7d16ce74-aed5-5916-80bb-e5a1ac156184_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 789861,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/76531d0ed07a41629163a03ceb057d96/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d16ce74-aed5-5916-80bb-e5a1ac156184/7d16ce74-aed5-5916-80bb-e5a1ac156184_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 762845,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/76531d0ed07a41629163a03ceb057d96/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d16ce74-aed5-5916-80bb-e5a1ac156184/7d16ce74-aed5-5916-80bb-e5a1ac156184_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 717324,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/76531d0ed07a41629163a03ceb057d96/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d16ce74-aed5-5916-80bb-e5a1ac156184/7d16ce74-aed5-5916-80bb-e5a1ac156184_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 827582,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/76531d0ed07a41629163a03ceb057d96/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d16ce74-aed5-5916-80bb-e5a1ac156184/7d16ce74-aed5-5916-80bb-e5a1ac156184_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 734321,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/76531d0ed07a41629163a03ceb057d96/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d16ce74-aed5-5916-80bb-e5a1ac156184/7d16ce74-aed5-5916-80bb-e5a1ac156184_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 845683,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/76531d0ed07a41629163a03ceb057d96/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA OCTAVIA COMBI 1.4 TSI PHEV 150KW DSG CLEVER',
 'transmission': 'automatic',
 'trim': '1.4 TSI PHEV 150KW DSG CLEVER',
 'vin': None,
 'year': 2021}
2026-03-26 22:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986044%27 HTTP/1.1" 200 None
2026-03-26 22:45:57 [ayvens.be] INFO: Saving data for 1986044: {'created_time': 1774565157.404658, 'last_price_update_time': 1774565157.40467, 'auction_closing_time': 1775028600.0}
2026-03-26 22:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986044') HTTP/1.1" 204 0
2026-03-26 22:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cw%252F700b49f150f24f55886f58a0d9457393%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cw/700b49f150f24f55886f58a0d9457393/images/large/4.jpg not downloaded yet
2026-03-26 22:45:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/786a70f29ae14639811fe53e5df11d5e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cw%252F700b49f150f24f55886f58a0d9457393%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cw/700b49f150f24f55886f58a0d9457393/images/large/5.jpg not downloaded yet
2026-03-26 22:45:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c76e90>
2026-03-26 22:45:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d010e538-ecc5-5d8b-87d0-d392c7fd8842/d010e538-ecc5-5d8b-87d0-d392c7fd8842_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F786a70f29ae14639811fe53e5df11d5e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/786a70f29ae14639811fe53e5df11d5e/images/large/1.jpg saved to cache
2026-03-26 22:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d010e538-ecc5-5d8b-87d0-d392c7fd8842
2026-03-26 22:45:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b748b590>
2026-03-26 22:45:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d010e538-ecc5-5d8b-87d0-d392c7fd8842/d010e538-ecc5-5d8b-87d0-d392c7fd8842_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F786a70f29ae14639811fe53e5df11d5e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/786a70f29ae14639811fe53e5df11d5e/images/large/4.jpg saved to cache
2026-03-26 22:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d010e538-ecc5-5d8b-87d0-d392c7fd8842
2026-03-26 22:45:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74bead0>
2026-03-26 22:45:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d010e538-ecc5-5d8b-87d0-d392c7fd8842/d010e538-ecc5-5d8b-87d0-d392c7fd8842_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F786a70f29ae14639811fe53e5df11d5e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/786a70f29ae14639811fe53e5df11d5e/images/large/2.jpg saved to cache
2026-03-26 22:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d010e538-ecc5-5d8b-87d0-d392c7fd8842
2026-03-26 22:45:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7592250>
2026-03-26 22:45:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d010e538-ecc5-5d8b-87d0-d392c7fd8842/d010e538-ecc5-5d8b-87d0-d392c7fd8842_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F786a70f29ae14639811fe53e5df11d5e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/786a70f29ae14639811fe53e5df11d5e/images/large/3.jpg saved to cache
2026-03-26 22:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d010e538-ecc5-5d8b-87d0-d392c7fd8842
2026-03-26 22:45:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/786a70f29ae14639811fe53e5df11d5e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cw%252F700b49f150f24f55886f58a0d9457393%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cw/700b49f150f24f55886f58a0d9457393/images/large/6.jpg not downloaded yet
2026-03-26 22:45:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/786a70f29ae14639811fe53e5df11d5e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/786a70f29ae14639811fe53e5df11d5e/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cw%252F700b49f150f24f55886f58a0d9457393%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cw/700b49f150f24f55886f58a0d9457393/images/large/7.jpg not downloaded yet
2026-03-26 22:45:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74e6a90>
2026-03-26 22:45:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d010e538-ecc5-5d8b-87d0-d392c7fd8842/d010e538-ecc5-5d8b-87d0-d392c7fd8842_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F786a70f29ae14639811fe53e5df11d5e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/786a70f29ae14639811fe53e5df11d5e/images/large/5.jpg saved to cache
2026-03-26 22:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d010e538-ecc5-5d8b-87d0-d392c7fd8842
2026-03-26 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cw%252F700b49f150f24f55886f58a0d9457393%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cw/700b49f150f24f55886f58a0d9457393/images/large/8.jpg not downloaded yet
2026-03-26 22:45:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/786a70f29ae14639811fe53e5df11d5e/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76a5550>
2026-03-26 22:45:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d010e538-ecc5-5d8b-87d0-d392c7fd8842/d010e538-ecc5-5d8b-87d0-d392c7fd8842_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F786a70f29ae14639811fe53e5df11d5e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/786a70f29ae14639811fe53e5df11d5e/images/large/6.jpg saved to cache
2026-03-26 22:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d010e538-ecc5-5d8b-87d0-d392c7fd8842
2026-03-26 22:45:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7483990>
2026-03-26 22:45:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d010e538-ecc5-5d8b-87d0-d392c7fd8842/d010e538-ecc5-5d8b-87d0-d392c7fd8842_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F786a70f29ae14639811fe53e5df11d5e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/786a70f29ae14639811fe53e5df11d5e/images/large/7.jpg saved to cache
2026-03-26 22:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d010e538-ecc5-5d8b-87d0-d392c7fd8842
2026-03-26 22:45:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7cce0d0>
2026-03-26 22:45:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d010e538-ecc5-5d8b-87d0-d392c7fd8842/d010e538-ecc5-5d8b-87d0-d392c7fd8842_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F786a70f29ae14639811fe53e5df11d5e%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/786a70f29ae14639811fe53e5df11d5e/images/large/9.jpg saved to cache
2026-03-26 22:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d010e538-ecc5-5d8b-87d0-d392c7fd8842
2026-03-26 22:45:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/786a70f29ae14639811fe53e5df11d5e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cw%252F700b49f150f24f55886f58a0d9457393%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cw/700b49f150f24f55886f58a0d9457393/images/large/9.jpg not downloaded yet
2026-03-26 22:45:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cw/700b49f150f24f55886f58a0d9457393/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cw%252F700b49f150f24f55886f58a0d9457393%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cw/700b49f150f24f55886f58a0d9457393/images/large/10.jpg not downloaded yet
2026-03-26 22:45:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74a6e90>
2026-03-26 22:45:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d010e538-ecc5-5d8b-87d0-d392c7fd8842/d010e538-ecc5-5d8b-87d0-d392c7fd8842_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F786a70f29ae14639811fe53e5df11d5e%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/786a70f29ae14639811fe53e5df11d5e/images/large/10.jpg saved to cache
2026-03-26 22:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d010e538-ecc5-5d8b-87d0-d392c7fd8842
2026-03-26 22:45:58 [ayvens.be] INFO: Found listing with ID: 1986047
2026-03-26 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986047%27 HTTP/1.1" 200 None
2026-03-26 22:45:58 [ayvens.be] INFO: Scrape type for 1986047: 1
2026-03-26 22:45:58 [ayvens.be] INFO: Extracting data for car ID: 1986047
2026-03-26 22:45:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c35c4e19-ff8a-52ec-beab-c502dd7d84cf with identifier: 1986047
2026-03-26 22:45:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c35c4e19-ff8a-52ec-beab-c502dd7d84cf with scrape type 1
2026-03-26 22:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c35c4e19-ff8a-52ec-beab-c502dd7d84cf
2026-03-26 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252F18839000aa524dfe8eb0b5a1b507a265%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/18839000aa524dfe8eb0b5a1b507a265/images/large/1.jpg not downloaded yet
2026-03-26 22:45:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cw/700b49f150f24f55886f58a0d9457393/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252F18839000aa524dfe8eb0b5a1b507a265%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/18839000aa524dfe8eb0b5a1b507a265/images/large/2.jpg not downloaded yet
2026-03-26 22:45:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e11910>
2026-03-26 22:45:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d010e538-ecc5-5d8b-87d0-d392c7fd8842/d010e538-ecc5-5d8b-87d0-d392c7fd8842_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F786a70f29ae14639811fe53e5df11d5e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/786a70f29ae14639811fe53e5df11d5e/images/large/8.jpg saved to cache
2026-03-26 22:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d010e538-ecc5-5d8b-87d0-d392c7fd8842
2026-03-26 22:45:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d010e538-ecc5-5d8b-87d0-d392c7fd8842, skipping ID generation
2026-03-26 22:45:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d010e538-ecc5-5d8b-87d0-d392c7fd8842 with scrape type 1
2026-03-26 22:45:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d010e538-ecc5-5d8b-87d0-d392c7fd8842 sending to next pipeline
2026-03-26 22:45:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d010e538-ecc5-5d8b-87d0-d392c7fd8842, identifier: 1986045
2026-03-26 22:45:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76a57d0>
2026-03-26 22:45:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c32ddf75-f711-5d8e-88f4-e2a8637663cd/c32ddf75-f711-5d8e-88f4-e2a8637663cd_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cw%252F700b49f150f24f55886f58a0d9457393%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cw/700b49f150f24f55886f58a0d9457393/images/large/1.jpg saved to cache
2026-03-26 22:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c32ddf75-f711-5d8e-88f4-e2a8637663cd
2026-03-26 22:45:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d010e538-ecc5-5d8b-87d0-d392c7fd8842 with identifier: 1986045
2026-03-26 22:45:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d010e538-ecc5-5d8b-87d0-d392c7fd8842 with identifier: 1986045
2026-03-26 22:45:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d010e538-ecc5-5d8b-87d0-d392c7fd8842 with identifier: 1986045 to the API
2026-03-26 22:45:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:45:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:45:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yp/786a70f29ae14639811fe53e5df11d5e/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'd010e538-ecc5-5d8b-87d0-d392c7fd8842',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'CRAFTER 35 FOURGON MWB HR DSL',
 'odometer': 114878,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d010e538-ecc5-5d8b-87d0-d392c7fd8842/d010e538-ecc5-5d8b-87d0-d392c7fd8842_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 589760,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/786a70f29ae14639811fe53e5df11d5e/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d010e538-ecc5-5d8b-87d0-d392c7fd8842/d010e538-ecc5-5d8b-87d0-d392c7fd8842_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 522286,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/786a70f29ae14639811fe53e5df11d5e/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d010e538-ecc5-5d8b-87d0-d392c7fd8842/d010e538-ecc5-5d8b-87d0-d392c7fd8842_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 538667,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/786a70f29ae14639811fe53e5df11d5e/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d010e538-ecc5-5d8b-87d0-d392c7fd8842/d010e538-ecc5-5d8b-87d0-d392c7fd8842_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 512302,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/786a70f29ae14639811fe53e5df11d5e/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d010e538-ecc5-5d8b-87d0-d392c7fd8842/d010e538-ecc5-5d8b-87d0-d392c7fd8842_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 469489,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/786a70f29ae14639811fe53e5df11d5e/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d010e538-ecc5-5d8b-87d0-d392c7fd8842/d010e538-ecc5-5d8b-87d0-d392c7fd8842_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 636870,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/786a70f29ae14639811fe53e5df11d5e/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d010e538-ecc5-5d8b-87d0-d392c7fd8842/d010e538-ecc5-5d8b-87d0-d392c7fd8842_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 653900,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/786a70f29ae14639811fe53e5df11d5e/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d010e538-ecc5-5d8b-87d0-d392c7fd8842/d010e538-ecc5-5d8b-87d0-d392c7fd8842_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 588098,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/786a70f29ae14639811fe53e5df11d5e/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d010e538-ecc5-5d8b-87d0-d392c7fd8842/d010e538-ecc5-5d8b-87d0-d392c7fd8842_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 483836,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/786a70f29ae14639811fe53e5df11d5e/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d010e538-ecc5-5d8b-87d0-d392c7fd8842/d010e538-ecc5-5d8b-87d0-d392c7fd8842_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 555733,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/786a70f29ae14639811fe53e5df11d5e/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-19',
 'seats_number': 3,
 'seller_name': None,
 'title': 'VOLKSWAGEN CRAFTER 35 FOURGON MWB HR DSL 2.0 CR TDi L3H3 '
          'Automatic-8 STOCK',
 'transmission': 'automatic',
 'trim': '2.0 CR TDi L3H3 Automatic-8 STOCK',
 'vin': None,
 'year': 2020}
2026-03-26 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986045%27 HTTP/1.1" 200 None
2026-03-26 22:45:59 [ayvens.be] INFO: Saving data for 1986045: {'created_time': 1774565159.237657, 'last_price_update_time': 1774565159.237667, 'auction_closing_time': 1775028600.0}
2026-03-26 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986045') HTTP/1.1" 204 0
2026-03-26 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252F18839000aa524dfe8eb0b5a1b507a265%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/18839000aa524dfe8eb0b5a1b507a265/images/large/3.jpg not downloaded yet
2026-03-26 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252F18839000aa524dfe8eb0b5a1b507a265%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/18839000aa524dfe8eb0b5a1b507a265/images/large/4.jpg not downloaded yet
2026-03-26 22:45:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cw/700b49f150f24f55886f58a0d9457393/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cw/700b49f150f24f55886f58a0d9457393/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5ccb550>
2026-03-26 22:45:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c32ddf75-f711-5d8e-88f4-e2a8637663cd/c32ddf75-f711-5d8e-88f4-e2a8637663cd_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cw%252F700b49f150f24f55886f58a0d9457393%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cw/700b49f150f24f55886f58a0d9457393/images/large/2.jpg saved to cache
2026-03-26 22:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c32ddf75-f711-5d8e-88f4-e2a8637663cd
2026-03-26 22:45:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cw/700b49f150f24f55886f58a0d9457393/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cw/700b49f150f24f55886f58a0d9457393/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252F18839000aa524dfe8eb0b5a1b507a265%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/18839000aa524dfe8eb0b5a1b507a265/images/large/5.jpg not downloaded yet
2026-03-26 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252F18839000aa524dfe8eb0b5a1b507a265%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/18839000aa524dfe8eb0b5a1b507a265/images/large/6.jpg not downloaded yet
2026-03-26 22:45:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cw/700b49f150f24f55886f58a0d9457393/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252F18839000aa524dfe8eb0b5a1b507a265%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/18839000aa524dfe8eb0b5a1b507a265/images/large/7.jpg not downloaded yet
2026-03-26 22:45:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7570a90>
2026-03-26 22:45:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c32ddf75-f711-5d8e-88f4-e2a8637663cd/c32ddf75-f711-5d8e-88f4-e2a8637663cd_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cw%252F700b49f150f24f55886f58a0d9457393%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cw/700b49f150f24f55886f58a0d9457393/images/large/3.jpg saved to cache
2026-03-26 22:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c32ddf75-f711-5d8e-88f4-e2a8637663cd
2026-03-26 22:45:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74dde10>
2026-03-26 22:45:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c32ddf75-f711-5d8e-88f4-e2a8637663cd/c32ddf75-f711-5d8e-88f4-e2a8637663cd_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cw%252F700b49f150f24f55886f58a0d9457393%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cw/700b49f150f24f55886f58a0d9457393/images/large/6.jpg saved to cache
2026-03-26 22:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c32ddf75-f711-5d8e-88f4-e2a8637663cd
2026-03-26 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252F18839000aa524dfe8eb0b5a1b507a265%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/18839000aa524dfe8eb0b5a1b507a265/images/large/8.jpg not downloaded yet
2026-03-26 22:45:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cw/700b49f150f24f55886f58a0d9457393/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cw/700b49f150f24f55886f58a0d9457393/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252F18839000aa524dfe8eb0b5a1b507a265%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/18839000aa524dfe8eb0b5a1b507a265/images/large/9.jpg not downloaded yet
2026-03-26 22:45:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cw/700b49f150f24f55886f58a0d9457393/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ye/18839000aa524dfe8eb0b5a1b507a265/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ye/18839000aa524dfe8eb0b5a1b507a265/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ye/18839000aa524dfe8eb0b5a1b507a265/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ye/18839000aa524dfe8eb0b5a1b507a265/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:45:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76e1690>
2026-03-26 22:45:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c32ddf75-f711-5d8e-88f4-e2a8637663cd/c32ddf75-f711-5d8e-88f4-e2a8637663cd_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cw%252F700b49f150f24f55886f58a0d9457393%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cw/700b49f150f24f55886f58a0d9457393/images/large/4.jpg saved to cache
2026-03-26 22:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c32ddf75-f711-5d8e-88f4-e2a8637663cd
2026-03-26 22:45:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c7e110>
2026-03-26 22:45:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c32ddf75-f711-5d8e-88f4-e2a8637663cd/c32ddf75-f711-5d8e-88f4-e2a8637663cd_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cw%252F700b49f150f24f55886f58a0d9457393%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cw/700b49f150f24f55886f58a0d9457393/images/large/5.jpg saved to cache
2026-03-26 22:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c32ddf75-f711-5d8e-88f4-e2a8637663cd
2026-03-26 22:45:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:45:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7451650>
2026-03-26 22:45:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:45:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c32ddf75-f711-5d8e-88f4-e2a8637663cd/c32ddf75-f711-5d8e-88f4-e2a8637663cd_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cw%252F700b49f150f24f55886f58a0d9457393%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cw/700b49f150f24f55886f58a0d9457393/images/large/7.jpg saved to cache
2026-03-26 22:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c32ddf75-f711-5d8e-88f4-e2a8637663cd
2026-03-26 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252F18839000aa524dfe8eb0b5a1b507a265%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/18839000aa524dfe8eb0b5a1b507a265/images/large/10.jpg not downloaded yet
2026-03-26 22:46:00 [ayvens.be] INFO: Found listing with ID: 1986048
2026-03-26 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986048%27 HTTP/1.1" 200 None
2026-03-26 22:46:00 [ayvens.be] INFO: Scrape type for 1986048: 1
2026-03-26 22:46:00 [ayvens.be] INFO: Extracting data for car ID: 1986048
2026-03-26 22:46:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1077883c-b0c1-5767-992f-d0213ab4e1c7 with identifier: 1986048
2026-03-26 22:46:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1077883c-b0c1-5767-992f-d0213ab4e1c7 with scrape type 1
2026-03-26 22:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1077883c-b0c1-5767-992f-d0213ab4e1c7
2026-03-26 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fc4ac88bc63c4498e9352cf19705fbdd1%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/c4ac88bc63c4498e9352cf19705fbdd1/images/large/1.jpg not downloaded yet
2026-03-26 22:46:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c69dd0>
2026-03-26 22:46:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c32ddf75-f711-5d8e-88f4-e2a8637663cd/c32ddf75-f711-5d8e-88f4-e2a8637663cd_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cw%252F700b49f150f24f55886f58a0d9457393%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cw/700b49f150f24f55886f58a0d9457393/images/large/8.jpg saved to cache
2026-03-26 22:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c32ddf75-f711-5d8e-88f4-e2a8637663cd
2026-03-26 22:46:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b764afd0>
2026-03-26 22:46:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c32ddf75-f711-5d8e-88f4-e2a8637663cd/c32ddf75-f711-5d8e-88f4-e2a8637663cd_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cw%252F700b49f150f24f55886f58a0d9457393%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cw/700b49f150f24f55886f58a0d9457393/images/large/10.jpg saved to cache
2026-03-26 22:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c32ddf75-f711-5d8e-88f4-e2a8637663cd
2026-03-26 22:46:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77e80d0>
2026-03-26 22:46:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c32ddf75-f711-5d8e-88f4-e2a8637663cd/c32ddf75-f711-5d8e-88f4-e2a8637663cd_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cw%252F700b49f150f24f55886f58a0d9457393%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cw/700b49f150f24f55886f58a0d9457393/images/large/9.jpg saved to cache
2026-03-26 22:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c32ddf75-f711-5d8e-88f4-e2a8637663cd
2026-03-26 22:46:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c32ddf75-f711-5d8e-88f4-e2a8637663cd, skipping ID generation
2026-03-26 22:46:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c32ddf75-f711-5d8e-88f4-e2a8637663cd with scrape type 1
2026-03-26 22:46:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c32ddf75-f711-5d8e-88f4-e2a8637663cd sending to next pipeline
2026-03-26 22:46:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c32ddf75-f711-5d8e-88f4-e2a8637663cd, identifier: 1986046
2026-03-26 22:46:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b35b50>
2026-03-26 22:46:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c35c4e19-ff8a-52ec-beab-c502dd7d84cf/c35c4e19-ff8a-52ec-beab-c502dd7d84cf_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252F18839000aa524dfe8eb0b5a1b507a265%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/18839000aa524dfe8eb0b5a1b507a265/images/large/2.jpg saved to cache
2026-03-26 22:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c35c4e19-ff8a-52ec-beab-c502dd7d84cf
2026-03-26 22:46:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7453250>
2026-03-26 22:46:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c35c4e19-ff8a-52ec-beab-c502dd7d84cf/c35c4e19-ff8a-52ec-beab-c502dd7d84cf_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252F18839000aa524dfe8eb0b5a1b507a265%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/18839000aa524dfe8eb0b5a1b507a265/images/large/3.jpg saved to cache
2026-03-26 22:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c35c4e19-ff8a-52ec-beab-c502dd7d84cf
2026-03-26 22:46:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b727bc10>
2026-03-26 22:46:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c35c4e19-ff8a-52ec-beab-c502dd7d84cf/c35c4e19-ff8a-52ec-beab-c502dd7d84cf_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252F18839000aa524dfe8eb0b5a1b507a265%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/18839000aa524dfe8eb0b5a1b507a265/images/large/1.jpg saved to cache
2026-03-26 22:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c35c4e19-ff8a-52ec-beab-c502dd7d84cf
2026-03-26 22:46:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7452310>
2026-03-26 22:46:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c35c4e19-ff8a-52ec-beab-c502dd7d84cf/c35c4e19-ff8a-52ec-beab-c502dd7d84cf_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252F18839000aa524dfe8eb0b5a1b507a265%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/18839000aa524dfe8eb0b5a1b507a265/images/large/4.jpg saved to cache
2026-03-26 22:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c35c4e19-ff8a-52ec-beab-c502dd7d84cf
2026-03-26 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fc4ac88bc63c4498e9352cf19705fbdd1%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/c4ac88bc63c4498e9352cf19705fbdd1/images/large/2.jpg not downloaded yet
2026-03-26 22:46:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c32ddf75-f711-5d8e-88f4-e2a8637663cd with identifier: 1986046
2026-03-26 22:46:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c32ddf75-f711-5d8e-88f4-e2a8637663cd with identifier: 1986046
2026-03-26 22:46:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c32ddf75-f711-5d8e-88f4-e2a8637663cd with identifier: 1986046 to the API
2026-03-26 22:46:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:46:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:46:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cw/700b49f150f24f55886f58a0d9457393/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'c32ddf75-f711-5d8e-88f4-e2a8637663cd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '5 SERIES TOURING',
 'odometer': 144843,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c32ddf75-f711-5d8e-88f4-e2a8637663cd/c32ddf75-f711-5d8e-88f4-e2a8637663cd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 706501,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cw/700b49f150f24f55886f58a0d9457393/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c32ddf75-f711-5d8e-88f4-e2a8637663cd/c32ddf75-f711-5d8e-88f4-e2a8637663cd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 687862,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cw/700b49f150f24f55886f58a0d9457393/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c32ddf75-f711-5d8e-88f4-e2a8637663cd/c32ddf75-f711-5d8e-88f4-e2a8637663cd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 707749,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cw/700b49f150f24f55886f58a0d9457393/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c32ddf75-f711-5d8e-88f4-e2a8637663cd/c32ddf75-f711-5d8e-88f4-e2a8637663cd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 734115,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cw/700b49f150f24f55886f58a0d9457393/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c32ddf75-f711-5d8e-88f4-e2a8637663cd/c32ddf75-f711-5d8e-88f4-e2a8637663cd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 725988,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cw/700b49f150f24f55886f58a0d9457393/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c32ddf75-f711-5d8e-88f4-e2a8637663cd/c32ddf75-f711-5d8e-88f4-e2a8637663cd_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 687139,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cw/700b49f150f24f55886f58a0d9457393/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c32ddf75-f711-5d8e-88f4-e2a8637663cd/c32ddf75-f711-5d8e-88f4-e2a8637663cd_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 660936,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cw/700b49f150f24f55886f58a0d9457393/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c32ddf75-f711-5d8e-88f4-e2a8637663cd/c32ddf75-f711-5d8e-88f4-e2a8637663cd_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 840521,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cw/700b49f150f24f55886f58a0d9457393/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c32ddf75-f711-5d8e-88f4-e2a8637663cd/c32ddf75-f711-5d8e-88f4-e2a8637663cd_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 910539,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cw/700b49f150f24f55886f58a0d9457393/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c32ddf75-f711-5d8e-88f4-e2a8637663cd/c32ddf75-f711-5d8e-88f4-e2a8637663cd_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 720789,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cw/700b49f150f24f55886f58a0d9457393/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 5 SERIES TOURING 2.0 530E 170KW XDRIVE AUTO TOURING',
 'transmission': 'automatic',
 'trim': '2.0 530E 170KW XDRIVE AUTO TOURING',
 'vin': None,
 'year': 2022}
2026-03-26 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986046%27 HTTP/1.1" 200 None
2026-03-26 22:46:01 [ayvens.be] INFO: Saving data for 1986046: {'created_time': 1774565161.143158, 'last_price_update_time': 1774565161.143169, 'auction_closing_time': 1775028600.0}
2026-03-26 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986046') HTTP/1.1" 204 0
2026-03-26 22:46:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ye/18839000aa524dfe8eb0b5a1b507a265/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fc4ac88bc63c4498e9352cf19705fbdd1%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/c4ac88bc63c4498e9352cf19705fbdd1/images/large/3.jpg not downloaded yet
2026-03-26 22:46:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ye/18839000aa524dfe8eb0b5a1b507a265/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ye/18839000aa524dfe8eb0b5a1b507a265/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fc4ac88bc63c4498e9352cf19705fbdd1%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/c4ac88bc63c4498e9352cf19705fbdd1/images/large/4.jpg not downloaded yet
2026-03-26 22:46:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ye/18839000aa524dfe8eb0b5a1b507a265/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fc4ac88bc63c4498e9352cf19705fbdd1%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/c4ac88bc63c4498e9352cf19705fbdd1/images/large/5.jpg not downloaded yet
2026-03-26 22:46:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ye/18839000aa524dfe8eb0b5a1b507a265/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ye/18839000aa524dfe8eb0b5a1b507a265/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fc4ac88bc63c4498e9352cf19705fbdd1%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/c4ac88bc63c4498e9352cf19705fbdd1/images/large/6.jpg not downloaded yet
2026-03-26 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fc4ac88bc63c4498e9352cf19705fbdd1%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/c4ac88bc63c4498e9352cf19705fbdd1/images/large/7.jpg not downloaded yet
2026-03-26 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fc4ac88bc63c4498e9352cf19705fbdd1%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/c4ac88bc63c4498e9352cf19705fbdd1/images/large/8.jpg not downloaded yet
2026-03-26 22:46:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6ded610>
2026-03-26 22:46:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c35c4e19-ff8a-52ec-beab-c502dd7d84cf/c35c4e19-ff8a-52ec-beab-c502dd7d84cf_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252F18839000aa524dfe8eb0b5a1b507a265%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/18839000aa524dfe8eb0b5a1b507a265/images/large/5.jpg saved to cache
2026-03-26 22:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c35c4e19-ff8a-52ec-beab-c502dd7d84cf
2026-03-26 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fc4ac88bc63c4498e9352cf19705fbdd1%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/c4ac88bc63c4498e9352cf19705fbdd1/images/large/9.jpg not downloaded yet
2026-03-26 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fc4ac88bc63c4498e9352cf19705fbdd1%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/c4ac88bc63c4498e9352cf19705fbdd1/images/large/10.jpg not downloaded yet
2026-03-26 22:46:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cbed90>
2026-03-26 22:46:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c35c4e19-ff8a-52ec-beab-c502dd7d84cf/c35c4e19-ff8a-52ec-beab-c502dd7d84cf_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252F18839000aa524dfe8eb0b5a1b507a265%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/18839000aa524dfe8eb0b5a1b507a265/images/large/6.jpg saved to cache
2026-03-26 22:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c35c4e19-ff8a-52ec-beab-c502dd7d84cf
2026-03-26 22:46:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7497550>
2026-03-26 22:46:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c35c4e19-ff8a-52ec-beab-c502dd7d84cf/c35c4e19-ff8a-52ec-beab-c502dd7d84cf_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252F18839000aa524dfe8eb0b5a1b507a265%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/18839000aa524dfe8eb0b5a1b507a265/images/large/7.jpg saved to cache
2026-03-26 22:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c35c4e19-ff8a-52ec-beab-c502dd7d84cf
2026-03-26 22:46:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b98690>
2026-03-26 22:46:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c35c4e19-ff8a-52ec-beab-c502dd7d84cf/c35c4e19-ff8a-52ec-beab-c502dd7d84cf_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252F18839000aa524dfe8eb0b5a1b507a265%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/18839000aa524dfe8eb0b5a1b507a265/images/large/10.jpg saved to cache
2026-03-26 22:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c35c4e19-ff8a-52ec-beab-c502dd7d84cf
2026-03-26 22:46:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e44350>
2026-03-26 22:46:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c35c4e19-ff8a-52ec-beab-c502dd7d84cf/c35c4e19-ff8a-52ec-beab-c502dd7d84cf_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252F18839000aa524dfe8eb0b5a1b507a265%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/18839000aa524dfe8eb0b5a1b507a265/images/large/8.jpg saved to cache
2026-03-26 22:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c35c4e19-ff8a-52ec-beab-c502dd7d84cf
2026-03-26 22:46:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c5edd0>
2026-03-26 22:46:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c35c4e19-ff8a-52ec-beab-c502dd7d84cf/c35c4e19-ff8a-52ec-beab-c502dd7d84cf_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252F18839000aa524dfe8eb0b5a1b507a265%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/18839000aa524dfe8eb0b5a1b507a265/images/large/9.jpg saved to cache
2026-03-26 22:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c35c4e19-ff8a-52ec-beab-c502dd7d84cf
2026-03-26 22:46:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c35c4e19-ff8a-52ec-beab-c502dd7d84cf, skipping ID generation
2026-03-26 22:46:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c35c4e19-ff8a-52ec-beab-c502dd7d84cf with scrape type 1
2026-03-26 22:46:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c35c4e19-ff8a-52ec-beab-c502dd7d84cf sending to next pipeline
2026-03-26 22:46:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c35c4e19-ff8a-52ec-beab-c502dd7d84cf, identifier: 1986047
2026-03-26 22:46:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c35c4e19-ff8a-52ec-beab-c502dd7d84cf with identifier: 1986047
2026-03-26 22:46:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c35c4e19-ff8a-52ec-beab-c502dd7d84cf with identifier: 1986047
2026-03-26 22:46:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c35c4e19-ff8a-52ec-beab-c502dd7d84cf with identifier: 1986047 to the API
2026-03-26 22:46:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:46:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:46:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1ye/18839000aa524dfe8eb0b5a1b507a265/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'c35c4e19-ff8a-52ec-beab-c502dd7d84cf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Puma',
 'odometer': 95935,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c35c4e19-ff8a-52ec-beab-c502dd7d84cf/c35c4e19-ff8a-52ec-beab-c502dd7d84cf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 229582,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ye/18839000aa524dfe8eb0b5a1b507a265/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c35c4e19-ff8a-52ec-beab-c502dd7d84cf/c35c4e19-ff8a-52ec-beab-c502dd7d84cf_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 216167,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ye/18839000aa524dfe8eb0b5a1b507a265/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c35c4e19-ff8a-52ec-beab-c502dd7d84cf/c35c4e19-ff8a-52ec-beab-c502dd7d84cf_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 222810,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ye/18839000aa524dfe8eb0b5a1b507a265/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c35c4e19-ff8a-52ec-beab-c502dd7d84cf/c35c4e19-ff8a-52ec-beab-c502dd7d84cf_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 215339,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ye/18839000aa524dfe8eb0b5a1b507a265/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c35c4e19-ff8a-52ec-beab-c502dd7d84cf/c35c4e19-ff8a-52ec-beab-c502dd7d84cf_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 286107,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ye/18839000aa524dfe8eb0b5a1b507a265/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c35c4e19-ff8a-52ec-beab-c502dd7d84cf/c35c4e19-ff8a-52ec-beab-c502dd7d84cf_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 260053,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ye/18839000aa524dfe8eb0b5a1b507a265/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c35c4e19-ff8a-52ec-beab-c502dd7d84cf/c35c4e19-ff8a-52ec-beab-c502dd7d84cf_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 268184,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ye/18839000aa524dfe8eb0b5a1b507a265/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c35c4e19-ff8a-52ec-beab-c502dd7d84cf/c35c4e19-ff8a-52ec-beab-c502dd7d84cf_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 349266,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ye/18839000aa524dfe8eb0b5a1b507a265/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c35c4e19-ff8a-52ec-beab-c502dd7d84cf/c35c4e19-ff8a-52ec-beab-c502dd7d84cf_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 434191,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ye/18839000aa524dfe8eb0b5a1b507a265/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c35c4e19-ff8a-52ec-beab-c502dd7d84cf/c35c4e19-ff8a-52ec-beab-c502dd7d84cf_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 267241,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ye/18839000aa524dfe8eb0b5a1b507a265/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD Puma 1.0 ECOBOOST MHEV 92KW TITANIUM X',
 'transmission': 'manual',
 'trim': '1.0 ECOBOOST MHEV 92KW TITANIUM X',
 'vin': None,
 'year': 2020}
2026-03-26 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986047%27 HTTP/1.1" 200 None
2026-03-26 22:46:02 [ayvens.be] INFO: Saving data for 1986047: {'created_time': 1774565162.216637, 'last_price_update_time': 1774565162.216647, 'auction_closing_time': 1775028600.0}
2026-03-26 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986047') HTTP/1.1" 204 0
2026-03-26 22:46:02 [ayvens.be] INFO: Found listing with ID: 1986049
2026-03-26 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986049%27 HTTP/1.1" 200 None
2026-03-26 22:46:02 [ayvens.be] INFO: Scrape type for 1986049: 1
2026-03-26 22:46:02 [ayvens.be] INFO: Extracting data for car ID: 1986049
2026-03-26 22:46:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 55de8cbe-2247-5b6f-b8d2-39ad91e6d17c with identifier: 1986049
2026-03-26 22:46:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55de8cbe-2247-5b6f-b8d2-39ad91e6d17c with scrape type 1
2026-03-26 22:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 55de8cbe-2247-5b6f-b8d2-39ad91e6d17c
2026-03-26 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252Ff3d90b861fbb45ef93349ea33fc198fa%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/f3d90b861fbb45ef93349ea33fc198fa/images/large/1.jpg not downloaded yet
2026-03-26 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252Ff3d90b861fbb45ef93349ea33fc198fa%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/f3d90b861fbb45ef93349ea33fc198fa/images/large/2.jpg not downloaded yet
2026-03-26 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252Ff3d90b861fbb45ef93349ea33fc198fa%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/f3d90b861fbb45ef93349ea33fc198fa/images/large/3.jpg not downloaded yet
2026-03-26 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252Ff3d90b861fbb45ef93349ea33fc198fa%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/f3d90b861fbb45ef93349ea33fc198fa/images/large/4.jpg not downloaded yet
2026-03-26 22:46:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/c4ac88bc63c4498e9352cf19705fbdd1/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252Ff3d90b861fbb45ef93349ea33fc198fa%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/f3d90b861fbb45ef93349ea33fc198fa/images/large/5.jpg not downloaded yet
2026-03-26 22:46:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/c4ac88bc63c4498e9352cf19705fbdd1/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/c4ac88bc63c4498e9352cf19705fbdd1/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/c4ac88bc63c4498e9352cf19705fbdd1/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/c4ac88bc63c4498e9352cf19705fbdd1/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/c4ac88bc63c4498e9352cf19705fbdd1/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252Ff3d90b861fbb45ef93349ea33fc198fa%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/f3d90b861fbb45ef93349ea33fc198fa/images/large/6.jpg not downloaded yet
2026-03-26 22:46:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/c4ac88bc63c4498e9352cf19705fbdd1/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/c4ac88bc63c4498e9352cf19705fbdd1/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252Ff3d90b861fbb45ef93349ea33fc198fa%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/f3d90b861fbb45ef93349ea33fc198fa/images/large/7.jpg not downloaded yet
2026-03-26 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252Ff3d90b861fbb45ef93349ea33fc198fa%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/f3d90b861fbb45ef93349ea33fc198fa/images/large/8.jpg not downloaded yet
2026-03-26 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252Ff3d90b861fbb45ef93349ea33fc198fa%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/f3d90b861fbb45ef93349ea33fc198fa/images/large/9.jpg not downloaded yet
2026-03-26 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252Ff3d90b861fbb45ef93349ea33fc198fa%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/f3d90b861fbb45ef93349ea33fc198fa/images/large/10.jpg not downloaded yet
2026-03-26 22:46:02 [ayvens.be] INFO: Found listing with ID: 1986050
2026-03-26 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986050%27 HTTP/1.1" 200 None
2026-03-26 22:46:02 [ayvens.be] INFO: Scrape type for 1986050: 1
2026-03-26 22:46:02 [ayvens.be] INFO: Extracting data for car ID: 1986050
2026-03-26 22:46:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00349aad-9198-5bb8-b310-8af076348f0e with identifier: 1986050
2026-03-26 22:46:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00349aad-9198-5bb8-b310-8af076348f0e with scrape type 1
2026-03-26 22:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 00349aad-9198-5bb8-b310-8af076348f0e
2026-03-26 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F2f36f274ea884c48aed0d5e185ac3c83%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/2f36f274ea884c48aed0d5e185ac3c83/images/large/1.jpg not downloaded yet
2026-03-26 22:46:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/f3d90b861fbb45ef93349ea33fc198fa/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7565210>
2026-03-26 22:46:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1077883c-b0c1-5767-992f-d0213ab4e1c7/1077883c-b0c1-5767-992f-d0213ab4e1c7_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fc4ac88bc63c4498e9352cf19705fbdd1%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/c4ac88bc63c4498e9352cf19705fbdd1/images/large/7.jpg saved to cache
2026-03-26 22:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1077883c-b0c1-5767-992f-d0213ab4e1c7
2026-03-26 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F2f36f274ea884c48aed0d5e185ac3c83%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/2f36f274ea884c48aed0d5e185ac3c83/images/large/2.jpg not downloaded yet
2026-03-26 22:46:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74a7690>
2026-03-26 22:46:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1077883c-b0c1-5767-992f-d0213ab4e1c7/1077883c-b0c1-5767-992f-d0213ab4e1c7_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fc4ac88bc63c4498e9352cf19705fbdd1%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/c4ac88bc63c4498e9352cf19705fbdd1/images/large/5.jpg saved to cache
2026-03-26 22:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1077883c-b0c1-5767-992f-d0213ab4e1c7
2026-03-26 22:46:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b728f110>
2026-03-26 22:46:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1077883c-b0c1-5767-992f-d0213ab4e1c7/1077883c-b0c1-5767-992f-d0213ab4e1c7_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fc4ac88bc63c4498e9352cf19705fbdd1%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/c4ac88bc63c4498e9352cf19705fbdd1/images/large/4.jpg saved to cache
2026-03-26 22:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1077883c-b0c1-5767-992f-d0213ab4e1c7
2026-03-26 22:46:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cc3490>
2026-03-26 22:46:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1077883c-b0c1-5767-992f-d0213ab4e1c7/1077883c-b0c1-5767-992f-d0213ab4e1c7_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fc4ac88bc63c4498e9352cf19705fbdd1%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/c4ac88bc63c4498e9352cf19705fbdd1/images/large/1.jpg saved to cache
2026-03-26 22:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1077883c-b0c1-5767-992f-d0213ab4e1c7
2026-03-26 22:46:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b787db50>
2026-03-26 22:46:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1077883c-b0c1-5767-992f-d0213ab4e1c7/1077883c-b0c1-5767-992f-d0213ab4e1c7_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fc4ac88bc63c4498e9352cf19705fbdd1%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/c4ac88bc63c4498e9352cf19705fbdd1/images/large/3.jpg saved to cache
2026-03-26 22:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1077883c-b0c1-5767-992f-d0213ab4e1c7
2026-03-26 22:46:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cc9390>
2026-03-26 22:46:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1077883c-b0c1-5767-992f-d0213ab4e1c7/1077883c-b0c1-5767-992f-d0213ab4e1c7_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fc4ac88bc63c4498e9352cf19705fbdd1%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/c4ac88bc63c4498e9352cf19705fbdd1/images/large/8.jpg saved to cache
2026-03-26 22:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1077883c-b0c1-5767-992f-d0213ab4e1c7
2026-03-26 22:46:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7565a90>
2026-03-26 22:46:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1077883c-b0c1-5767-992f-d0213ab4e1c7/1077883c-b0c1-5767-992f-d0213ab4e1c7_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fc4ac88bc63c4498e9352cf19705fbdd1%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/c4ac88bc63c4498e9352cf19705fbdd1/images/large/2.jpg saved to cache
2026-03-26 22:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1077883c-b0c1-5767-992f-d0213ab4e1c7
2026-03-26 22:46:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cc2550>
2026-03-26 22:46:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1077883c-b0c1-5767-992f-d0213ab4e1c7/1077883c-b0c1-5767-992f-d0213ab4e1c7_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fc4ac88bc63c4498e9352cf19705fbdd1%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/c4ac88bc63c4498e9352cf19705fbdd1/images/large/6.jpg saved to cache
2026-03-26 22:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1077883c-b0c1-5767-992f-d0213ab4e1c7
2026-03-26 22:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F2f36f274ea884c48aed0d5e185ac3c83%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/2f36f274ea884c48aed0d5e185ac3c83/images/large/3.jpg not downloaded yet
2026-03-26 22:46:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/f3d90b861fbb45ef93349ea33fc198fa/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/f3d90b861fbb45ef93349ea33fc198fa/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/f3d90b861fbb45ef93349ea33fc198fa/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F2f36f274ea884c48aed0d5e185ac3c83%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/2f36f274ea884c48aed0d5e185ac3c83/images/large/4.jpg not downloaded yet
2026-03-26 22:46:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76a5b90>
2026-03-26 22:46:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55de8cbe-2247-5b6f-b8d2-39ad91e6d17c/55de8cbe-2247-5b6f-b8d2-39ad91e6d17c_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252Ff3d90b861fbb45ef93349ea33fc198fa%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/f3d90b861fbb45ef93349ea33fc198fa/images/large/1.jpg saved to cache
2026-03-26 22:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 55de8cbe-2247-5b6f-b8d2-39ad91e6d17c
2026-03-26 22:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F2f36f274ea884c48aed0d5e185ac3c83%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/2f36f274ea884c48aed0d5e185ac3c83/images/large/5.jpg not downloaded yet
2026-03-26 22:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F2f36f274ea884c48aed0d5e185ac3c83%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/2f36f274ea884c48aed0d5e185ac3c83/images/large/6.jpg not downloaded yet
2026-03-26 22:46:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/c4ac88bc63c4498e9352cf19705fbdd1/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F2f36f274ea884c48aed0d5e185ac3c83%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/2f36f274ea884c48aed0d5e185ac3c83/images/large/7.jpg not downloaded yet
2026-03-26 22:46:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/c4ac88bc63c4498e9352cf19705fbdd1/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F2f36f274ea884c48aed0d5e185ac3c83%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/2f36f274ea884c48aed0d5e185ac3c83/images/large/8.jpg not downloaded yet
2026-03-26 22:46:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b777b290>
2026-03-26 22:46:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55de8cbe-2247-5b6f-b8d2-39ad91e6d17c/55de8cbe-2247-5b6f-b8d2-39ad91e6d17c_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252Ff3d90b861fbb45ef93349ea33fc198fa%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/f3d90b861fbb45ef93349ea33fc198fa/images/large/4.jpg saved to cache
2026-03-26 22:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 55de8cbe-2247-5b6f-b8d2-39ad91e6d17c
2026-03-26 22:46:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74afb10>
2026-03-26 22:46:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55de8cbe-2247-5b6f-b8d2-39ad91e6d17c/55de8cbe-2247-5b6f-b8d2-39ad91e6d17c_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252Ff3d90b861fbb45ef93349ea33fc198fa%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/f3d90b861fbb45ef93349ea33fc198fa/images/large/3.jpg saved to cache
2026-03-26 22:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 55de8cbe-2247-5b6f-b8d2-39ad91e6d17c
2026-03-26 22:46:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c61650>
2026-03-26 22:46:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55de8cbe-2247-5b6f-b8d2-39ad91e6d17c/55de8cbe-2247-5b6f-b8d2-39ad91e6d17c_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252Ff3d90b861fbb45ef93349ea33fc198fa%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/f3d90b861fbb45ef93349ea33fc198fa/images/large/2.jpg saved to cache
2026-03-26 22:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 55de8cbe-2247-5b6f-b8d2-39ad91e6d17c
2026-03-26 22:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F2f36f274ea884c48aed0d5e185ac3c83%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/2f36f274ea884c48aed0d5e185ac3c83/images/large/9.jpg not downloaded yet
2026-03-26 22:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F2f36f274ea884c48aed0d5e185ac3c83%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/2f36f274ea884c48aed0d5e185ac3c83/images/large/10.jpg not downloaded yet
2026-03-26 22:46:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/f3d90b861fbb45ef93349ea33fc198fa/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:04 [ayvens.be] INFO: Found listing with ID: 1986051
2026-03-26 22:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986051%27 HTTP/1.1" 200 None
2026-03-26 22:46:04 [ayvens.be] INFO: Scrape type for 1986051: 1
2026-03-26 22:46:04 [ayvens.be] INFO: Extracting data for car ID: 1986051
2026-03-26 22:46:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 735aded9-be81-558c-a6a9-efc2b66de218 with identifier: 1986051
2026-03-26 22:46:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 735aded9-be81-558c-a6a9-efc2b66de218 with scrape type 1
2026-03-26 22:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 735aded9-be81-558c-a6a9-efc2b66de218
2026-03-26 22:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F9c6ccb22ca754cacb4a023404dc45dcb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/9c6ccb22ca754cacb4a023404dc45dcb/images/large/1.jpg not downloaded yet
2026-03-26 22:46:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd0c47d0>
2026-03-26 22:46:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1077883c-b0c1-5767-992f-d0213ab4e1c7/1077883c-b0c1-5767-992f-d0213ab4e1c7_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fc4ac88bc63c4498e9352cf19705fbdd1%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/c4ac88bc63c4498e9352cf19705fbdd1/images/large/10.jpg saved to cache
2026-03-26 22:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1077883c-b0c1-5767-992f-d0213ab4e1c7
2026-03-26 22:46:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6dec410>
2026-03-26 22:46:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1077883c-b0c1-5767-992f-d0213ab4e1c7/1077883c-b0c1-5767-992f-d0213ab4e1c7_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fc4ac88bc63c4498e9352cf19705fbdd1%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/c4ac88bc63c4498e9352cf19705fbdd1/images/large/9.jpg saved to cache
2026-03-26 22:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1077883c-b0c1-5767-992f-d0213ab4e1c7
2026-03-26 22:46:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1077883c-b0c1-5767-992f-d0213ab4e1c7, skipping ID generation
2026-03-26 22:46:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1077883c-b0c1-5767-992f-d0213ab4e1c7 with scrape type 1
2026-03-26 22:46:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1077883c-b0c1-5767-992f-d0213ab4e1c7 sending to next pipeline
2026-03-26 22:46:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 1077883c-b0c1-5767-992f-d0213ab4e1c7, identifier: 1986048
2026-03-26 22:46:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/f3d90b861fbb45ef93349ea33fc198fa/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/f3d90b861fbb45ef93349ea33fc198fa/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 1077883c-b0c1-5767-992f-d0213ab4e1c7 with identifier: 1986048
2026-03-26 22:46:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 1077883c-b0c1-5767-992f-d0213ab4e1c7 with identifier: 1986048
2026-03-26 22:46:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 1077883c-b0c1-5767-992f-d0213ab4e1c7 with identifier: 1986048 to the API
2026-03-26 22:46:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:46:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:46:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bq/c4ac88bc63c4498e9352cf19705fbdd1/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '1077883c-b0c1-5767-992f-d0213ab4e1c7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A3',
 'odometer': 64116,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1077883c-b0c1-5767-992f-d0213ab4e1c7/1077883c-b0c1-5767-992f-d0213ab4e1c7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 763475,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/c4ac88bc63c4498e9352cf19705fbdd1/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1077883c-b0c1-5767-992f-d0213ab4e1c7/1077883c-b0c1-5767-992f-d0213ab4e1c7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 738317,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/c4ac88bc63c4498e9352cf19705fbdd1/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1077883c-b0c1-5767-992f-d0213ab4e1c7/1077883c-b0c1-5767-992f-d0213ab4e1c7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 718615,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/c4ac88bc63c4498e9352cf19705fbdd1/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1077883c-b0c1-5767-992f-d0213ab4e1c7/1077883c-b0c1-5767-992f-d0213ab4e1c7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 759629,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/c4ac88bc63c4498e9352cf19705fbdd1/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1077883c-b0c1-5767-992f-d0213ab4e1c7/1077883c-b0c1-5767-992f-d0213ab4e1c7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 746861,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/c4ac88bc63c4498e9352cf19705fbdd1/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1077883c-b0c1-5767-992f-d0213ab4e1c7/1077883c-b0c1-5767-992f-d0213ab4e1c7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 733623,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/c4ac88bc63c4498e9352cf19705fbdd1/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1077883c-b0c1-5767-992f-d0213ab4e1c7/1077883c-b0c1-5767-992f-d0213ab4e1c7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 538354,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/c4ac88bc63c4498e9352cf19705fbdd1/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1077883c-b0c1-5767-992f-d0213ab4e1c7/1077883c-b0c1-5767-992f-d0213ab4e1c7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 674792,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/c4ac88bc63c4498e9352cf19705fbdd1/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1077883c-b0c1-5767-992f-d0213ab4e1c7/1077883c-b0c1-5767-992f-d0213ab4e1c7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 778003,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/c4ac88bc63c4498e9352cf19705fbdd1/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1077883c-b0c1-5767-992f-d0213ab4e1c7/1077883c-b0c1-5767-992f-d0213ab4e1c7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 722243,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/c4ac88bc63c4498e9352cf19705fbdd1/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A3 1.4 40 TFSI E S TRON. ADVANCED SPORTBACK',
 'transmission': 'automatic',
 'trim': '1.4 40 TFSI E S TRON. ADVANCED SPORTBACK',
 'vin': None,
 'year': 2022}
2026-03-26 22:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986048%27 HTTP/1.1" 200 None
2026-03-26 22:46:04 [ayvens.be] INFO: Saving data for 1986048: {'created_time': 1774565164.968467, 'last_price_update_time': 1774565164.968476, 'auction_closing_time': 1775028600.0}
2026-03-26 22:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986048') HTTP/1.1" 204 0
2026-03-26 22:46:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/f3d90b861fbb45ef93349ea33fc198fa/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F9c6ccb22ca754cacb4a023404dc45dcb%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/9c6ccb22ca754cacb4a023404dc45dcb/images/large/2.jpg not downloaded yet
2026-03-26 22:46:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/2f36f274ea884c48aed0d5e185ac3c83/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/2f36f274ea884c48aed0d5e185ac3c83/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/f3d90b861fbb45ef93349ea33fc198fa/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F9c6ccb22ca754cacb4a023404dc45dcb%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/9c6ccb22ca754cacb4a023404dc45dcb/images/large/3.jpg not downloaded yet
2026-03-26 22:46:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b78aa810>
2026-03-26 22:46:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55de8cbe-2247-5b6f-b8d2-39ad91e6d17c/55de8cbe-2247-5b6f-b8d2-39ad91e6d17c_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252Ff3d90b861fbb45ef93349ea33fc198fa%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/f3d90b861fbb45ef93349ea33fc198fa/images/large/7.jpg saved to cache
2026-03-26 22:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 55de8cbe-2247-5b6f-b8d2-39ad91e6d17c
2026-03-26 22:46:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b768b490>
2026-03-26 22:46:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55de8cbe-2247-5b6f-b8d2-39ad91e6d17c/55de8cbe-2247-5b6f-b8d2-39ad91e6d17c_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252Ff3d90b861fbb45ef93349ea33fc198fa%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/f3d90b861fbb45ef93349ea33fc198fa/images/large/8.jpg saved to cache
2026-03-26 22:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 55de8cbe-2247-5b6f-b8d2-39ad91e6d17c
2026-03-26 22:46:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74cd4d0>
2026-03-26 22:46:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55de8cbe-2247-5b6f-b8d2-39ad91e6d17c/55de8cbe-2247-5b6f-b8d2-39ad91e6d17c_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252Ff3d90b861fbb45ef93349ea33fc198fa%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/f3d90b861fbb45ef93349ea33fc198fa/images/large/9.jpg saved to cache
2026-03-26 22:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 55de8cbe-2247-5b6f-b8d2-39ad91e6d17c
2026-03-26 22:46:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/f3d90b861fbb45ef93349ea33fc198fa/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F9c6ccb22ca754cacb4a023404dc45dcb%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/9c6ccb22ca754cacb4a023404dc45dcb/images/large/4.jpg not downloaded yet
2026-03-26 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F9c6ccb22ca754cacb4a023404dc45dcb%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/9c6ccb22ca754cacb4a023404dc45dcb/images/large/5.jpg not downloaded yet
2026-03-26 22:46:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7593d90>
2026-03-26 22:46:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55de8cbe-2247-5b6f-b8d2-39ad91e6d17c/55de8cbe-2247-5b6f-b8d2-39ad91e6d17c_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252Ff3d90b861fbb45ef93349ea33fc198fa%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/f3d90b861fbb45ef93349ea33fc198fa/images/large/10.jpg saved to cache
2026-03-26 22:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 55de8cbe-2247-5b6f-b8d2-39ad91e6d17c
2026-03-26 22:46:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77d6650>
2026-03-26 22:46:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00349aad-9198-5bb8-b310-8af076348f0e/00349aad-9198-5bb8-b310-8af076348f0e_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F2f36f274ea884c48aed0d5e185ac3c83%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/2f36f274ea884c48aed0d5e185ac3c83/images/large/3.jpg saved to cache
2026-03-26 22:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 00349aad-9198-5bb8-b310-8af076348f0e
2026-03-26 22:46:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79f3510>
2026-03-26 22:46:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00349aad-9198-5bb8-b310-8af076348f0e/00349aad-9198-5bb8-b310-8af076348f0e_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F2f36f274ea884c48aed0d5e185ac3c83%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/2f36f274ea884c48aed0d5e185ac3c83/images/large/2.jpg saved to cache
2026-03-26 22:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 00349aad-9198-5bb8-b310-8af076348f0e
2026-03-26 22:46:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c81f50>
2026-03-26 22:46:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55de8cbe-2247-5b6f-b8d2-39ad91e6d17c/55de8cbe-2247-5b6f-b8d2-39ad91e6d17c_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252Ff3d90b861fbb45ef93349ea33fc198fa%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/f3d90b861fbb45ef93349ea33fc198fa/images/large/6.jpg saved to cache
2026-03-26 22:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 55de8cbe-2247-5b6f-b8d2-39ad91e6d17c
2026-03-26 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F9c6ccb22ca754cacb4a023404dc45dcb%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/9c6ccb22ca754cacb4a023404dc45dcb/images/large/6.jpg not downloaded yet
2026-03-26 22:46:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/2f36f274ea884c48aed0d5e185ac3c83/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/2f36f274ea884c48aed0d5e185ac3c83/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/2f36f274ea884c48aed0d5e185ac3c83/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F9c6ccb22ca754cacb4a023404dc45dcb%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/9c6ccb22ca754cacb4a023404dc45dcb/images/large/7.jpg not downloaded yet
2026-03-26 22:46:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/2f36f274ea884c48aed0d5e185ac3c83/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b75a5310>
2026-03-26 22:46:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55de8cbe-2247-5b6f-b8d2-39ad91e6d17c/55de8cbe-2247-5b6f-b8d2-39ad91e6d17c_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252Ff3d90b861fbb45ef93349ea33fc198fa%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/f3d90b861fbb45ef93349ea33fc198fa/images/large/5.jpg saved to cache
2026-03-26 22:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 55de8cbe-2247-5b6f-b8d2-39ad91e6d17c
2026-03-26 22:46:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 55de8cbe-2247-5b6f-b8d2-39ad91e6d17c, skipping ID generation
2026-03-26 22:46:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55de8cbe-2247-5b6f-b8d2-39ad91e6d17c with scrape type 1
2026-03-26 22:46:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 55de8cbe-2247-5b6f-b8d2-39ad91e6d17c sending to next pipeline
2026-03-26 22:46:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 55de8cbe-2247-5b6f-b8d2-39ad91e6d17c, identifier: 1986049
2026-03-26 22:46:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/2f36f274ea884c48aed0d5e185ac3c83/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F9c6ccb22ca754cacb4a023404dc45dcb%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/9c6ccb22ca754cacb4a023404dc45dcb/images/large/8.jpg not downloaded yet
2026-03-26 22:46:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 55de8cbe-2247-5b6f-b8d2-39ad91e6d17c with identifier: 1986049
2026-03-26 22:46:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 55de8cbe-2247-5b6f-b8d2-39ad91e6d17c with identifier: 1986049
2026-03-26 22:46:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 55de8cbe-2247-5b6f-b8d2-39ad91e6d17c with identifier: 1986049 to the API
2026-03-26 22:46:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:46:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:46:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ct/f3d90b861fbb45ef93349ea33fc198fa/images/large/5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '55de8cbe-2247-5b6f-b8d2-39ad91e6d17c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'CAPTUR',
 'odometer': 40253,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55de8cbe-2247-5b6f-b8d2-39ad91e6d17c/55de8cbe-2247-5b6f-b8d2-39ad91e6d17c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 245422,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/f3d90b861fbb45ef93349ea33fc198fa/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55de8cbe-2247-5b6f-b8d2-39ad91e6d17c/55de8cbe-2247-5b6f-b8d2-39ad91e6d17c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 249401,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/f3d90b861fbb45ef93349ea33fc198fa/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55de8cbe-2247-5b6f-b8d2-39ad91e6d17c/55de8cbe-2247-5b6f-b8d2-39ad91e6d17c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 262793,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/f3d90b861fbb45ef93349ea33fc198fa/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55de8cbe-2247-5b6f-b8d2-39ad91e6d17c/55de8cbe-2247-5b6f-b8d2-39ad91e6d17c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 255728,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/f3d90b861fbb45ef93349ea33fc198fa/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55de8cbe-2247-5b6f-b8d2-39ad91e6d17c/55de8cbe-2247-5b6f-b8d2-39ad91e6d17c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 246842,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/f3d90b861fbb45ef93349ea33fc198fa/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55de8cbe-2247-5b6f-b8d2-39ad91e6d17c/55de8cbe-2247-5b6f-b8d2-39ad91e6d17c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 234853,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/f3d90b861fbb45ef93349ea33fc198fa/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55de8cbe-2247-5b6f-b8d2-39ad91e6d17c/55de8cbe-2247-5b6f-b8d2-39ad91e6d17c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 256403,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/f3d90b861fbb45ef93349ea33fc198fa/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55de8cbe-2247-5b6f-b8d2-39ad91e6d17c/55de8cbe-2247-5b6f-b8d2-39ad91e6d17c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 369029,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/f3d90b861fbb45ef93349ea33fc198fa/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55de8cbe-2247-5b6f-b8d2-39ad91e6d17c/55de8cbe-2247-5b6f-b8d2-39ad91e6d17c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 311925,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/f3d90b861fbb45ef93349ea33fc198fa/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55de8cbe-2247-5b6f-b8d2-39ad91e6d17c/55de8cbe-2247-5b6f-b8d2-39ad91e6d17c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 345129,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/f3d90b861fbb45ef93349ea33fc198fa/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT CAPTUR 1.0 TCE 90 EQUILIBRE',
 'transmission': 'manual',
 'trim': '1.0 TCE 90 EQUILIBRE',
 'vin': None,
 'year': 2022}
2026-03-26 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986049%27 HTTP/1.1" 200 None
2026-03-26 22:46:06 [ayvens.be] INFO: Saving data for 1986049: {'created_time': 1774565166.295278, 'last_price_update_time': 1774565166.295287, 'auction_closing_time': 1775028600.0}
2026-03-26 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986049') HTTP/1.1" 204 0
2026-03-26 22:46:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/2f36f274ea884c48aed0d5e185ac3c83/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/2f36f274ea884c48aed0d5e185ac3c83/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F9c6ccb22ca754cacb4a023404dc45dcb%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/9c6ccb22ca754cacb4a023404dc45dcb/images/large/9.jpg not downloaded yet
2026-03-26 22:46:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c96d90>
2026-03-26 22:46:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00349aad-9198-5bb8-b310-8af076348f0e/00349aad-9198-5bb8-b310-8af076348f0e_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F2f36f274ea884c48aed0d5e185ac3c83%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/2f36f274ea884c48aed0d5e185ac3c83/images/large/6.jpg saved to cache
2026-03-26 22:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 00349aad-9198-5bb8-b310-8af076348f0e
2026-03-26 22:46:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7688890>
2026-03-26 22:46:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00349aad-9198-5bb8-b310-8af076348f0e/00349aad-9198-5bb8-b310-8af076348f0e_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F2f36f274ea884c48aed0d5e185ac3c83%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/2f36f274ea884c48aed0d5e185ac3c83/images/large/5.jpg saved to cache
2026-03-26 22:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 00349aad-9198-5bb8-b310-8af076348f0e
2026-03-26 22:46:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7586c90>
2026-03-26 22:46:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00349aad-9198-5bb8-b310-8af076348f0e/00349aad-9198-5bb8-b310-8af076348f0e_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F2f36f274ea884c48aed0d5e185ac3c83%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/2f36f274ea884c48aed0d5e185ac3c83/images/large/7.jpg saved to cache
2026-03-26 22:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 00349aad-9198-5bb8-b310-8af076348f0e
2026-03-26 22:46:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c96d90>
2026-03-26 22:46:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00349aad-9198-5bb8-b310-8af076348f0e/00349aad-9198-5bb8-b310-8af076348f0e_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F2f36f274ea884c48aed0d5e185ac3c83%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/2f36f274ea884c48aed0d5e185ac3c83/images/large/4.jpg saved to cache
2026-03-26 22:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 00349aad-9198-5bb8-b310-8af076348f0e
2026-03-26 22:46:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b15e50>
2026-03-26 22:46:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00349aad-9198-5bb8-b310-8af076348f0e/00349aad-9198-5bb8-b310-8af076348f0e_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F2f36f274ea884c48aed0d5e185ac3c83%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/2f36f274ea884c48aed0d5e185ac3c83/images/large/9.jpg saved to cache
2026-03-26 22:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 00349aad-9198-5bb8-b310-8af076348f0e
2026-03-26 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F9c6ccb22ca754cacb4a023404dc45dcb%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/9c6ccb22ca754cacb4a023404dc45dcb/images/large/10.jpg not downloaded yet
2026-03-26 22:46:06 [ayvens.be] INFO: Found listing with ID: 1986052
2026-03-26 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986052%27 HTTP/1.1" 200 None
2026-03-26 22:46:06 [ayvens.be] INFO: Scrape type for 1986052: 1
2026-03-26 22:46:06 [ayvens.be] INFO: Extracting data for car ID: 1986052
2026-03-26 22:46:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 25d49266-b07d-5698-9e45-925e342cd487 with identifier: 1986052
2026-03-26 22:46:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25d49266-b07d-5698-9e45-925e342cd487 with scrape type 1
2026-03-26 22:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 25d49266-b07d-5698-9e45-925e342cd487
2026-03-26 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F4c45a29c8ecf4c018d8df256553a1faf%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/4c45a29c8ecf4c018d8df256553a1faf/images/large/1.jpg not downloaded yet
2026-03-26 22:46:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76e1f90>
2026-03-26 22:46:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00349aad-9198-5bb8-b310-8af076348f0e/00349aad-9198-5bb8-b310-8af076348f0e_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F2f36f274ea884c48aed0d5e185ac3c83%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/2f36f274ea884c48aed0d5e185ac3c83/images/large/10.jpg saved to cache
2026-03-26 22:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 00349aad-9198-5bb8-b310-8af076348f0e
2026-03-26 22:46:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7570bd0>
2026-03-26 22:46:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00349aad-9198-5bb8-b310-8af076348f0e/00349aad-9198-5bb8-b310-8af076348f0e_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F2f36f274ea884c48aed0d5e185ac3c83%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/2f36f274ea884c48aed0d5e185ac3c83/images/large/8.jpg saved to cache
2026-03-26 22:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 00349aad-9198-5bb8-b310-8af076348f0e
2026-03-26 22:46:06 [scrapy.extensions.logstats] INFO: Crawled 2 pages (at 2 pages/min), scraped 21 items (at 21 items/min)
2026-03-26 22:46:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 179MiB
2026-03-26 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F4c45a29c8ecf4c018d8df256553a1faf%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/4c45a29c8ecf4c018d8df256553a1faf/images/large/2.jpg not downloaded yet
2026-03-26 22:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F4c45a29c8ecf4c018d8df256553a1faf%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/4c45a29c8ecf4c018d8df256553a1faf/images/large/3.jpg not downloaded yet
2026-03-26 22:46:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/9c6ccb22ca754cacb4a023404dc45dcb/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/9c6ccb22ca754cacb4a023404dc45dcb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/2f36f274ea884c48aed0d5e185ac3c83/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F4c45a29c8ecf4c018d8df256553a1faf%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/4c45a29c8ecf4c018d8df256553a1faf/images/large/4.jpg not downloaded yet
2026-03-26 22:46:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/9c6ccb22ca754cacb4a023404dc45dcb/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/9c6ccb22ca754cacb4a023404dc45dcb/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F4c45a29c8ecf4c018d8df256553a1faf%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/4c45a29c8ecf4c018d8df256553a1faf/images/large/5.jpg not downloaded yet
2026-03-26 22:46:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/9c6ccb22ca754cacb4a023404dc45dcb/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F4c45a29c8ecf4c018d8df256553a1faf%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/4c45a29c8ecf4c018d8df256553a1faf/images/large/6.jpg not downloaded yet
2026-03-26 22:46:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/9c6ccb22ca754cacb4a023404dc45dcb/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/9c6ccb22ca754cacb4a023404dc45dcb/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F4c45a29c8ecf4c018d8df256553a1faf%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/4c45a29c8ecf4c018d8df256553a1faf/images/large/7.jpg not downloaded yet
2026-03-26 22:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F4c45a29c8ecf4c018d8df256553a1faf%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/4c45a29c8ecf4c018d8df256553a1faf/images/large/8.jpg not downloaded yet
2026-03-26 22:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F4c45a29c8ecf4c018d8df256553a1faf%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/4c45a29c8ecf4c018d8df256553a1faf/images/large/9.jpg not downloaded yet
2026-03-26 22:46:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79f3d90>
2026-03-26 22:46:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_735aded9-be81-558c-a6a9-efc2b66de218/735aded9-be81-558c-a6a9-efc2b66de218_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F9c6ccb22ca754cacb4a023404dc45dcb%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/9c6ccb22ca754cacb4a023404dc45dcb/images/large/2.jpg saved to cache
2026-03-26 22:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 735aded9-be81-558c-a6a9-efc2b66de218
2026-03-26 22:46:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76a4c10>
2026-03-26 22:46:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_735aded9-be81-558c-a6a9-efc2b66de218/735aded9-be81-558c-a6a9-efc2b66de218_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F9c6ccb22ca754cacb4a023404dc45dcb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/9c6ccb22ca754cacb4a023404dc45dcb/images/large/1.jpg saved to cache
2026-03-26 22:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 735aded9-be81-558c-a6a9-efc2b66de218
2026-03-26 22:46:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c75490>
2026-03-26 22:46:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00349aad-9198-5bb8-b310-8af076348f0e/00349aad-9198-5bb8-b310-8af076348f0e_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F2f36f274ea884c48aed0d5e185ac3c83%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/2f36f274ea884c48aed0d5e185ac3c83/images/large/1.jpg saved to cache
2026-03-26 22:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 00349aad-9198-5bb8-b310-8af076348f0e
2026-03-26 22:46:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 00349aad-9198-5bb8-b310-8af076348f0e, skipping ID generation
2026-03-26 22:46:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00349aad-9198-5bb8-b310-8af076348f0e with scrape type 1
2026-03-26 22:46:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 00349aad-9198-5bb8-b310-8af076348f0e sending to next pipeline
2026-03-26 22:46:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 00349aad-9198-5bb8-b310-8af076348f0e, identifier: 1986050
2026-03-26 22:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F4c45a29c8ecf4c018d8df256553a1faf%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/4c45a29c8ecf4c018d8df256553a1faf/images/large/10.jpg not downloaded yet
2026-03-26 22:46:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 00349aad-9198-5bb8-b310-8af076348f0e with identifier: 1986050
2026-03-26 22:46:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 00349aad-9198-5bb8-b310-8af076348f0e with identifier: 1986050
2026-03-26 22:46:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 00349aad-9198-5bb8-b310-8af076348f0e with identifier: 1986050 to the API
2026-03-26 22:46:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:46:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:46:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bk/2f36f274ea884c48aed0d5e185ac3c83/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '00349aad-9198-5bb8-b310-8af076348f0e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A-CLASS',
 'odometer': 85166,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00349aad-9198-5bb8-b310-8af076348f0e/00349aad-9198-5bb8-b310-8af076348f0e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 484050,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/2f36f274ea884c48aed0d5e185ac3c83/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00349aad-9198-5bb8-b310-8af076348f0e/00349aad-9198-5bb8-b310-8af076348f0e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 476564,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/2f36f274ea884c48aed0d5e185ac3c83/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00349aad-9198-5bb8-b310-8af076348f0e/00349aad-9198-5bb8-b310-8af076348f0e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 433290,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/2f36f274ea884c48aed0d5e185ac3c83/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00349aad-9198-5bb8-b310-8af076348f0e/00349aad-9198-5bb8-b310-8af076348f0e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 447585,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/2f36f274ea884c48aed0d5e185ac3c83/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00349aad-9198-5bb8-b310-8af076348f0e/00349aad-9198-5bb8-b310-8af076348f0e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 300099,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/2f36f274ea884c48aed0d5e185ac3c83/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00349aad-9198-5bb8-b310-8af076348f0e/00349aad-9198-5bb8-b310-8af076348f0e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 267857,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/2f36f274ea884c48aed0d5e185ac3c83/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00349aad-9198-5bb8-b310-8af076348f0e/00349aad-9198-5bb8-b310-8af076348f0e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 379019,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/2f36f274ea884c48aed0d5e185ac3c83/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00349aad-9198-5bb8-b310-8af076348f0e/00349aad-9198-5bb8-b310-8af076348f0e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 431305,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/2f36f274ea884c48aed0d5e185ac3c83/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00349aad-9198-5bb8-b310-8af076348f0e/00349aad-9198-5bb8-b310-8af076348f0e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 319187,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/2f36f274ea884c48aed0d5e185ac3c83/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00349aad-9198-5bb8-b310-8af076348f0e/00349aad-9198-5bb8-b310-8af076348f0e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 334303,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/2f36f274ea884c48aed0d5e185ac3c83/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ A-CLASS 1.3 A 250 E DCT BUSINESS SOLUTION',
 'transmission': 'automatic',
 'trim': '1.3 A 250 E DCT BUSINESS SOLUTION',
 'vin': None,
 'year': 2021}
2026-03-26 22:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986050%27 HTTP/1.1" 200 None
2026-03-26 22:46:07 [ayvens.be] INFO: Saving data for 1986050: {'created_time': 1774565167.89063, 'last_price_update_time': 1774565167.890642, 'auction_closing_time': 1775028600.0}
2026-03-26 22:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986050') HTTP/1.1" 204 0
2026-03-26 22:46:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76cea10>
2026-03-26 22:46:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_735aded9-be81-558c-a6a9-efc2b66de218/735aded9-be81-558c-a6a9-efc2b66de218_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F9c6ccb22ca754cacb4a023404dc45dcb%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/9c6ccb22ca754cacb4a023404dc45dcb/images/large/4.jpg saved to cache
2026-03-26 22:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 735aded9-be81-558c-a6a9-efc2b66de218
2026-03-26 22:46:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e137d0>
2026-03-26 22:46:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_735aded9-be81-558c-a6a9-efc2b66de218/735aded9-be81-558c-a6a9-efc2b66de218_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F9c6ccb22ca754cacb4a023404dc45dcb%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/9c6ccb22ca754cacb4a023404dc45dcb/images/large/3.jpg saved to cache
2026-03-26 22:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 735aded9-be81-558c-a6a9-efc2b66de218
2026-03-26 22:46:08 [ayvens.be] INFO: Found listing with ID: 1986053
2026-03-26 22:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986053%27 HTTP/1.1" 200 None
2026-03-26 22:46:08 [ayvens.be] INFO: Scrape type for 1986053: 1
2026-03-26 22:46:08 [ayvens.be] INFO: Extracting data for car ID: 1986053
2026-03-26 22:46:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 903e1390-8721-55ae-9697-cc1db8002744 with identifier: 1986053
2026-03-26 22:46:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 903e1390-8721-55ae-9697-cc1db8002744 with scrape type 1
2026-03-26 22:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 903e1390-8721-55ae-9697-cc1db8002744
2026-03-26 22:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252Fa4a23ad46bb447e385e4dcbc9b21006e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/a4a23ad46bb447e385e4dcbc9b21006e/images/large/1.jpg not downloaded yet
2026-03-26 22:46:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7417090>
2026-03-26 22:46:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_735aded9-be81-558c-a6a9-efc2b66de218/735aded9-be81-558c-a6a9-efc2b66de218_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F9c6ccb22ca754cacb4a023404dc45dcb%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/9c6ccb22ca754cacb4a023404dc45dcb/images/large/5.jpg saved to cache
2026-03-26 22:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 735aded9-be81-558c-a6a9-efc2b66de218
2026-03-26 22:46:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7689f50>
2026-03-26 22:46:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_735aded9-be81-558c-a6a9-efc2b66de218/735aded9-be81-558c-a6a9-efc2b66de218_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F9c6ccb22ca754cacb4a023404dc45dcb%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/9c6ccb22ca754cacb4a023404dc45dcb/images/large/6.jpg saved to cache
2026-03-26 22:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 735aded9-be81-558c-a6a9-efc2b66de218
2026-03-26 22:46:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7400b50>
2026-03-26 22:46:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_735aded9-be81-558c-a6a9-efc2b66de218/735aded9-be81-558c-a6a9-efc2b66de218_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F9c6ccb22ca754cacb4a023404dc45dcb%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/9c6ccb22ca754cacb4a023404dc45dcb/images/large/7.jpg saved to cache
2026-03-26 22:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 735aded9-be81-558c-a6a9-efc2b66de218
2026-03-26 22:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252Fa4a23ad46bb447e385e4dcbc9b21006e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/a4a23ad46bb447e385e4dcbc9b21006e/images/large/2.jpg not downloaded yet
2026-03-26 22:46:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/4c45a29c8ecf4c018d8df256553a1faf/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/4c45a29c8ecf4c018d8df256553a1faf/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/4c45a29c8ecf4c018d8df256553a1faf/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/4c45a29c8ecf4c018d8df256553a1faf/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252Fa4a23ad46bb447e385e4dcbc9b21006e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/a4a23ad46bb447e385e4dcbc9b21006e/images/large/3.jpg not downloaded yet
2026-03-26 22:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252Fa4a23ad46bb447e385e4dcbc9b21006e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/a4a23ad46bb447e385e4dcbc9b21006e/images/large/4.jpg not downloaded yet
2026-03-26 22:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252Fa4a23ad46bb447e385e4dcbc9b21006e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/a4a23ad46bb447e385e4dcbc9b21006e/images/large/5.jpg not downloaded yet
2026-03-26 22:46:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/9c6ccb22ca754cacb4a023404dc45dcb/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/9c6ccb22ca754cacb4a023404dc45dcb/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/9c6ccb22ca754cacb4a023404dc45dcb/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252Fa4a23ad46bb447e385e4dcbc9b21006e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/a4a23ad46bb447e385e4dcbc9b21006e/images/large/6.jpg not downloaded yet
2026-03-26 22:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252Fa4a23ad46bb447e385e4dcbc9b21006e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/a4a23ad46bb447e385e4dcbc9b21006e/images/large/7.jpg not downloaded yet
2026-03-26 22:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252Fa4a23ad46bb447e385e4dcbc9b21006e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/a4a23ad46bb447e385e4dcbc9b21006e/images/large/8.jpg not downloaded yet
2026-03-26 22:46:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6dedf90>
2026-03-26 22:46:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25d49266-b07d-5698-9e45-925e342cd487/25d49266-b07d-5698-9e45-925e342cd487_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F4c45a29c8ecf4c018d8df256553a1faf%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/4c45a29c8ecf4c018d8df256553a1faf/images/large/4.jpg saved to cache
2026-03-26 22:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 25d49266-b07d-5698-9e45-925e342cd487
2026-03-26 22:46:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7450110>
2026-03-26 22:46:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25d49266-b07d-5698-9e45-925e342cd487/25d49266-b07d-5698-9e45-925e342cd487_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F4c45a29c8ecf4c018d8df256553a1faf%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/4c45a29c8ecf4c018d8df256553a1faf/images/large/2.jpg saved to cache
2026-03-26 22:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 25d49266-b07d-5698-9e45-925e342cd487
2026-03-26 22:46:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7587410>
2026-03-26 22:46:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25d49266-b07d-5698-9e45-925e342cd487/25d49266-b07d-5698-9e45-925e342cd487_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F4c45a29c8ecf4c018d8df256553a1faf%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/4c45a29c8ecf4c018d8df256553a1faf/images/large/3.jpg saved to cache
2026-03-26 22:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 25d49266-b07d-5698-9e45-925e342cd487
2026-03-26 22:46:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e4de90>
2026-03-26 22:46:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25d49266-b07d-5698-9e45-925e342cd487/25d49266-b07d-5698-9e45-925e342cd487_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F4c45a29c8ecf4c018d8df256553a1faf%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/4c45a29c8ecf4c018d8df256553a1faf/images/large/1.jpg saved to cache
2026-03-26 22:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 25d49266-b07d-5698-9e45-925e342cd487
2026-03-26 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252Fa4a23ad46bb447e385e4dcbc9b21006e%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/a4a23ad46bb447e385e4dcbc9b21006e/images/large/9.jpg not downloaded yet
2026-03-26 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252Fa4a23ad46bb447e385e4dcbc9b21006e%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/a4a23ad46bb447e385e4dcbc9b21006e/images/large/10.jpg not downloaded yet
2026-03-26 22:46:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/4c45a29c8ecf4c018d8df256553a1faf/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:09 [ayvens.be] INFO: Found listing with ID: 1986054
2026-03-26 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986054%27 HTTP/1.1" 200 None
2026-03-26 22:46:09 [ayvens.be] INFO: Scrape type for 1986054: 1
2026-03-26 22:46:09 [ayvens.be] INFO: Extracting data for car ID: 1986054
2026-03-26 22:46:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f30e219f-3220-5b64-b86f-01bce4968bbe with identifier: 1986054
2026-03-26 22:46:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f30e219f-3220-5b64-b86f-01bce4968bbe with scrape type 1
2026-03-26 22:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f30e219f-3220-5b64-b86f-01bce4968bbe
2026-03-26 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252Fcec88b0186f64c71bb25d7be8bc0b14f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/cec88b0186f64c71bb25d7be8bc0b14f/images/large/1.jpg not downloaded yet
2026-03-26 22:46:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7661790>
2026-03-26 22:46:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_735aded9-be81-558c-a6a9-efc2b66de218/735aded9-be81-558c-a6a9-efc2b66de218_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F9c6ccb22ca754cacb4a023404dc45dcb%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/9c6ccb22ca754cacb4a023404dc45dcb/images/large/9.jpg saved to cache
2026-03-26 22:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 735aded9-be81-558c-a6a9-efc2b66de218
2026-03-26 22:46:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b784dbd0>
2026-03-26 22:46:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_735aded9-be81-558c-a6a9-efc2b66de218/735aded9-be81-558c-a6a9-efc2b66de218_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F9c6ccb22ca754cacb4a023404dc45dcb%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/9c6ccb22ca754cacb4a023404dc45dcb/images/large/10.jpg saved to cache
2026-03-26 22:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 735aded9-be81-558c-a6a9-efc2b66de218
2026-03-26 22:46:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b787e090>
2026-03-26 22:46:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_735aded9-be81-558c-a6a9-efc2b66de218/735aded9-be81-558c-a6a9-efc2b66de218_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F9c6ccb22ca754cacb4a023404dc45dcb%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/9c6ccb22ca754cacb4a023404dc45dcb/images/large/8.jpg saved to cache
2026-03-26 22:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 735aded9-be81-558c-a6a9-efc2b66de218
2026-03-26 22:46:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 735aded9-be81-558c-a6a9-efc2b66de218, skipping ID generation
2026-03-26 22:46:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 735aded9-be81-558c-a6a9-efc2b66de218 with scrape type 1
2026-03-26 22:46:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 735aded9-be81-558c-a6a9-efc2b66de218 sending to next pipeline
2026-03-26 22:46:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 735aded9-be81-558c-a6a9-efc2b66de218, identifier: 1986051
2026-03-26 22:46:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/4c45a29c8ecf4c018d8df256553a1faf/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/4c45a29c8ecf4c018d8df256553a1faf/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 735aded9-be81-558c-a6a9-efc2b66de218 with identifier: 1986051
2026-03-26 22:46:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 735aded9-be81-558c-a6a9-efc2b66de218 with identifier: 1986051
2026-03-26 22:46:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 735aded9-be81-558c-a6a9-efc2b66de218 with identifier: 1986051 to the API
2026-03-26 22:46:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:46:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:46:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bq/9c6ccb22ca754cacb4a023404dc45dcb/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '735aded9-be81-558c-a6a9-efc2b66de218',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'B-CLASS',
 'odometer': 128479,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_735aded9-be81-558c-a6a9-efc2b66de218/735aded9-be81-558c-a6a9-efc2b66de218_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 729993,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/9c6ccb22ca754cacb4a023404dc45dcb/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_735aded9-be81-558c-a6a9-efc2b66de218/735aded9-be81-558c-a6a9-efc2b66de218_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 735392,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/9c6ccb22ca754cacb4a023404dc45dcb/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_735aded9-be81-558c-a6a9-efc2b66de218/735aded9-be81-558c-a6a9-efc2b66de218_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 747302,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/9c6ccb22ca754cacb4a023404dc45dcb/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_735aded9-be81-558c-a6a9-efc2b66de218/735aded9-be81-558c-a6a9-efc2b66de218_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 764947,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/9c6ccb22ca754cacb4a023404dc45dcb/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_735aded9-be81-558c-a6a9-efc2b66de218/735aded9-be81-558c-a6a9-efc2b66de218_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 766453,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/9c6ccb22ca754cacb4a023404dc45dcb/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_735aded9-be81-558c-a6a9-efc2b66de218/735aded9-be81-558c-a6a9-efc2b66de218_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 797378,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/9c6ccb22ca754cacb4a023404dc45dcb/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_735aded9-be81-558c-a6a9-efc2b66de218/735aded9-be81-558c-a6a9-efc2b66de218_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 612898,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/9c6ccb22ca754cacb4a023404dc45dcb/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_735aded9-be81-558c-a6a9-efc2b66de218/735aded9-be81-558c-a6a9-efc2b66de218_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 754615,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/9c6ccb22ca754cacb4a023404dc45dcb/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_735aded9-be81-558c-a6a9-efc2b66de218/735aded9-be81-558c-a6a9-efc2b66de218_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 743910,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/9c6ccb22ca754cacb4a023404dc45dcb/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_735aded9-be81-558c-a6a9-efc2b66de218/735aded9-be81-558c-a6a9-efc2b66de218_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 752690,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/9c6ccb22ca754cacb4a023404dc45dcb/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ B-CLASS 1.3 B 250 E BUSINESS SOLUTION',
 'transmission': 'automatic',
 'trim': '1.3 B 250 E BUSINESS SOLUTION',
 'vin': None,
 'year': 2022}
2026-03-26 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986051%27 HTTP/1.1" 200 None
2026-03-26 22:46:09 [ayvens.be] INFO: Saving data for 1986051: {'created_time': 1774565169.953661, 'last_price_update_time': 1774565169.95367, 'auction_closing_time': 1775028600.0}
2026-03-26 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986051') HTTP/1.1" 204 0
2026-03-26 22:46:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/4c45a29c8ecf4c018d8df256553a1faf/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/4c45a29c8ecf4c018d8df256553a1faf/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/a4a23ad46bb447e385e4dcbc9b21006e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/4c45a29c8ecf4c018d8df256553a1faf/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252Fcec88b0186f64c71bb25d7be8bc0b14f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/cec88b0186f64c71bb25d7be8bc0b14f/images/large/2.jpg not downloaded yet
2026-03-26 22:46:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/a4a23ad46bb447e385e4dcbc9b21006e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252Fcec88b0186f64c71bb25d7be8bc0b14f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/cec88b0186f64c71bb25d7be8bc0b14f/images/large/3.jpg not downloaded yet
2026-03-26 22:46:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c76190>
2026-03-26 22:46:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25d49266-b07d-5698-9e45-925e342cd487/25d49266-b07d-5698-9e45-925e342cd487_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F4c45a29c8ecf4c018d8df256553a1faf%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/4c45a29c8ecf4c018d8df256553a1faf/images/large/6.jpg saved to cache
2026-03-26 22:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 25d49266-b07d-5698-9e45-925e342cd487
2026-03-26 22:46:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cbcf10>
2026-03-26 22:46:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25d49266-b07d-5698-9e45-925e342cd487/25d49266-b07d-5698-9e45-925e342cd487_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F4c45a29c8ecf4c018d8df256553a1faf%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/4c45a29c8ecf4c018d8df256553a1faf/images/large/8.jpg saved to cache
2026-03-26 22:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 25d49266-b07d-5698-9e45-925e342cd487
2026-03-26 22:46:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76a7c90>
2026-03-26 22:46:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25d49266-b07d-5698-9e45-925e342cd487/25d49266-b07d-5698-9e45-925e342cd487_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F4c45a29c8ecf4c018d8df256553a1faf%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/4c45a29c8ecf4c018d8df256553a1faf/images/large/7.jpg saved to cache
2026-03-26 22:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 25d49266-b07d-5698-9e45-925e342cd487
2026-03-26 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252Fcec88b0186f64c71bb25d7be8bc0b14f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/cec88b0186f64c71bb25d7be8bc0b14f/images/large/4.jpg not downloaded yet
2026-03-26 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252Fcec88b0186f64c71bb25d7be8bc0b14f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/cec88b0186f64c71bb25d7be8bc0b14f/images/large/5.jpg not downloaded yet
2026-03-26 22:46:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b748af50>
2026-03-26 22:46:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25d49266-b07d-5698-9e45-925e342cd487/25d49266-b07d-5698-9e45-925e342cd487_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F4c45a29c8ecf4c018d8df256553a1faf%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/4c45a29c8ecf4c018d8df256553a1faf/images/large/10.jpg saved to cache
2026-03-26 22:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 25d49266-b07d-5698-9e45-925e342cd487
2026-03-26 22:46:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6d80290>
2026-03-26 22:46:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25d49266-b07d-5698-9e45-925e342cd487/25d49266-b07d-5698-9e45-925e342cd487_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F4c45a29c8ecf4c018d8df256553a1faf%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/4c45a29c8ecf4c018d8df256553a1faf/images/large/9.jpg saved to cache
2026-03-26 22:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 25d49266-b07d-5698-9e45-925e342cd487
2026-03-26 22:46:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b726a750>
2026-03-26 22:46:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_903e1390-8721-55ae-9697-cc1db8002744/903e1390-8721-55ae-9697-cc1db8002744_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252Fa4a23ad46bb447e385e4dcbc9b21006e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/a4a23ad46bb447e385e4dcbc9b21006e/images/large/1.jpg saved to cache
2026-03-26 22:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 903e1390-8721-55ae-9697-cc1db8002744
2026-03-26 22:46:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c94f50>
2026-03-26 22:46:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25d49266-b07d-5698-9e45-925e342cd487/25d49266-b07d-5698-9e45-925e342cd487_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F4c45a29c8ecf4c018d8df256553a1faf%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/4c45a29c8ecf4c018d8df256553a1faf/images/large/5.jpg saved to cache
2026-03-26 22:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 25d49266-b07d-5698-9e45-925e342cd487
2026-03-26 22:46:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 25d49266-b07d-5698-9e45-925e342cd487, skipping ID generation
2026-03-26 22:46:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25d49266-b07d-5698-9e45-925e342cd487 with scrape type 1
2026-03-26 22:46:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 25d49266-b07d-5698-9e45-925e342cd487 sending to next pipeline
2026-03-26 22:46:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 25d49266-b07d-5698-9e45-925e342cd487, identifier: 1986052
2026-03-26 22:46:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e11bd0>
2026-03-26 22:46:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_903e1390-8721-55ae-9697-cc1db8002744/903e1390-8721-55ae-9697-cc1db8002744_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252Fa4a23ad46bb447e385e4dcbc9b21006e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/a4a23ad46bb447e385e4dcbc9b21006e/images/large/2.jpg saved to cache
2026-03-26 22:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 903e1390-8721-55ae-9697-cc1db8002744
2026-03-26 22:46:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 25d49266-b07d-5698-9e45-925e342cd487 with identifier: 1986052
2026-03-26 22:46:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 25d49266-b07d-5698-9e45-925e342cd487 with identifier: 1986052
2026-03-26 22:46:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 25d49266-b07d-5698-9e45-925e342cd487 with identifier: 1986052 to the API
2026-03-26 22:46:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:46:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:46:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yr/4c45a29c8ecf4c018d8df256553a1faf/images/large/5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '25d49266-b07d-5698-9e45-925e342cd487',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 152141,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25d49266-b07d-5698-9e45-925e342cd487/25d49266-b07d-5698-9e45-925e342cd487_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 359672,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/4c45a29c8ecf4c018d8df256553a1faf/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25d49266-b07d-5698-9e45-925e342cd487/25d49266-b07d-5698-9e45-925e342cd487_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 363876,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/4c45a29c8ecf4c018d8df256553a1faf/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25d49266-b07d-5698-9e45-925e342cd487/25d49266-b07d-5698-9e45-925e342cd487_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 377452,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/4c45a29c8ecf4c018d8df256553a1faf/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25d49266-b07d-5698-9e45-925e342cd487/25d49266-b07d-5698-9e45-925e342cd487_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 364250,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/4c45a29c8ecf4c018d8df256553a1faf/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25d49266-b07d-5698-9e45-925e342cd487/25d49266-b07d-5698-9e45-925e342cd487_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 342829,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/4c45a29c8ecf4c018d8df256553a1faf/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25d49266-b07d-5698-9e45-925e342cd487/25d49266-b07d-5698-9e45-925e342cd487_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 256964,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/4c45a29c8ecf4c018d8df256553a1faf/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25d49266-b07d-5698-9e45-925e342cd487/25d49266-b07d-5698-9e45-925e342cd487_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 316368,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/4c45a29c8ecf4c018d8df256553a1faf/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25d49266-b07d-5698-9e45-925e342cd487/25d49266-b07d-5698-9e45-925e342cd487_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 347508,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/4c45a29c8ecf4c018d8df256553a1faf/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25d49266-b07d-5698-9e45-925e342cd487/25d49266-b07d-5698-9e45-925e342cd487_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 377332,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/4c45a29c8ecf4c018d8df256553a1faf/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25d49266-b07d-5698-9e45-925e342cd487/25d49266-b07d-5698-9e45-925e342cd487_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 332391,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/4c45a29c8ecf4c018d8df256553a1faf/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 1.5 XDRIVE25E PHEV 162KW)',
 'transmission': 'automatic',
 'trim': '1.5 XDRIVE25E PHEV 162KW)',
 'vin': None,
 'year': 2020}
2026-03-26 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986052%27 HTTP/1.1" 200 None
2026-03-26 22:46:11 [ayvens.be] INFO: Saving data for 1986052: {'created_time': 1774565171.17679, 'last_price_update_time': 1774565171.176801, 'auction_closing_time': 1775028600.0}
2026-03-26 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986052') HTTP/1.1" 204 0
2026-03-26 22:46:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/a4a23ad46bb447e385e4dcbc9b21006e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/a4a23ad46bb447e385e4dcbc9b21006e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252Fcec88b0186f64c71bb25d7be8bc0b14f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/cec88b0186f64c71bb25d7be8bc0b14f/images/large/6.jpg not downloaded yet
2026-03-26 22:46:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/a4a23ad46bb447e385e4dcbc9b21006e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/a4a23ad46bb447e385e4dcbc9b21006e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/a4a23ad46bb447e385e4dcbc9b21006e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/a4a23ad46bb447e385e4dcbc9b21006e/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252Fcec88b0186f64c71bb25d7be8bc0b14f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/cec88b0186f64c71bb25d7be8bc0b14f/images/large/7.jpg not downloaded yet
2026-03-26 22:46:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/a4a23ad46bb447e385e4dcbc9b21006e/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252Fcec88b0186f64c71bb25d7be8bc0b14f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/cec88b0186f64c71bb25d7be8bc0b14f/images/large/8.jpg not downloaded yet
2026-03-26 22:46:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/a4a23ad46bb447e385e4dcbc9b21006e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252Fcec88b0186f64c71bb25d7be8bc0b14f%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/cec88b0186f64c71bb25d7be8bc0b14f/images/large/9.jpg not downloaded yet
2026-03-26 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252Fcec88b0186f64c71bb25d7be8bc0b14f%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/cec88b0186f64c71bb25d7be8bc0b14f/images/large/10.jpg not downloaded yet
2026-03-26 22:46:11 [ayvens.be] INFO: Found listing with ID: 1986055
2026-03-26 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986055%27 HTTP/1.1" 200 None
2026-03-26 22:46:11 [ayvens.be] INFO: Scrape type for 1986055: 1
2026-03-26 22:46:11 [ayvens.be] INFO: Extracting data for car ID: 1986055
2026-03-26 22:46:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9141ae3d-f426-5d7e-8314-c2bb045d46a8 with identifier: 1986055
2026-03-26 22:46:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9141ae3d-f426-5d7e-8314-c2bb045d46a8 with scrape type 1
2026-03-26 22:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9141ae3d-f426-5d7e-8314-c2bb045d46a8
2026-03-26 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F7e1c1fdd1cdc4245bf4c8c885358db52%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/7e1c1fdd1cdc4245bf4c8c885358db52/images/large/1.jpg not downloaded yet
2026-03-26 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F7e1c1fdd1cdc4245bf4c8c885358db52%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/7e1c1fdd1cdc4245bf4c8c885358db52/images/large/2.jpg not downloaded yet
2026-03-26 22:46:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7ceb110>
2026-03-26 22:46:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_903e1390-8721-55ae-9697-cc1db8002744/903e1390-8721-55ae-9697-cc1db8002744_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252Fa4a23ad46bb447e385e4dcbc9b21006e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/a4a23ad46bb447e385e4dcbc9b21006e/images/large/7.jpg saved to cache
2026-03-26 22:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 903e1390-8721-55ae-9697-cc1db8002744
2026-03-26 22:46:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b788e190>
2026-03-26 22:46:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_903e1390-8721-55ae-9697-cc1db8002744/903e1390-8721-55ae-9697-cc1db8002744_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252Fa4a23ad46bb447e385e4dcbc9b21006e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/a4a23ad46bb447e385e4dcbc9b21006e/images/large/5.jpg saved to cache
2026-03-26 22:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 903e1390-8721-55ae-9697-cc1db8002744
2026-03-26 22:46:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76cc1d0>
2026-03-26 22:46:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_903e1390-8721-55ae-9697-cc1db8002744/903e1390-8721-55ae-9697-cc1db8002744_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252Fa4a23ad46bb447e385e4dcbc9b21006e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/a4a23ad46bb447e385e4dcbc9b21006e/images/large/3.jpg saved to cache
2026-03-26 22:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 903e1390-8721-55ae-9697-cc1db8002744
2026-03-26 22:46:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74df210>
2026-03-26 22:46:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_903e1390-8721-55ae-9697-cc1db8002744/903e1390-8721-55ae-9697-cc1db8002744_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252Fa4a23ad46bb447e385e4dcbc9b21006e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/a4a23ad46bb447e385e4dcbc9b21006e/images/large/6.jpg saved to cache
2026-03-26 22:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 903e1390-8721-55ae-9697-cc1db8002744
2026-03-26 22:46:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77c93d0>
2026-03-26 22:46:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_903e1390-8721-55ae-9697-cc1db8002744/903e1390-8721-55ae-9697-cc1db8002744_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252Fa4a23ad46bb447e385e4dcbc9b21006e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/a4a23ad46bb447e385e4dcbc9b21006e/images/large/8.jpg saved to cache
2026-03-26 22:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 903e1390-8721-55ae-9697-cc1db8002744
2026-03-26 22:46:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b72efe90>
2026-03-26 22:46:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_903e1390-8721-55ae-9697-cc1db8002744/903e1390-8721-55ae-9697-cc1db8002744_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252Fa4a23ad46bb447e385e4dcbc9b21006e%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/a4a23ad46bb447e385e4dcbc9b21006e/images/large/10.jpg saved to cache
2026-03-26 22:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 903e1390-8721-55ae-9697-cc1db8002744
2026-03-26 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F7e1c1fdd1cdc4245bf4c8c885358db52%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/7e1c1fdd1cdc4245bf4c8c885358db52/images/large/3.jpg not downloaded yet
2026-03-26 22:46:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd3c4710>
2026-03-26 22:46:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_903e1390-8721-55ae-9697-cc1db8002744/903e1390-8721-55ae-9697-cc1db8002744_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252Fa4a23ad46bb447e385e4dcbc9b21006e%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/a4a23ad46bb447e385e4dcbc9b21006e/images/large/9.jpg saved to cache
2026-03-26 22:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 903e1390-8721-55ae-9697-cc1db8002744
2026-03-26 22:46:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b748a350>
2026-03-26 22:46:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_903e1390-8721-55ae-9697-cc1db8002744/903e1390-8721-55ae-9697-cc1db8002744_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252Fa4a23ad46bb447e385e4dcbc9b21006e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/a4a23ad46bb447e385e4dcbc9b21006e/images/large/4.jpg saved to cache
2026-03-26 22:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 903e1390-8721-55ae-9697-cc1db8002744
2026-03-26 22:46:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 903e1390-8721-55ae-9697-cc1db8002744, skipping ID generation
2026-03-26 22:46:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 903e1390-8721-55ae-9697-cc1db8002744 with scrape type 1
2026-03-26 22:46:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 903e1390-8721-55ae-9697-cc1db8002744 sending to next pipeline
2026-03-26 22:46:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 903e1390-8721-55ae-9697-cc1db8002744, identifier: 1986053
2026-03-26 22:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F7e1c1fdd1cdc4245bf4c8c885358db52%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/7e1c1fdd1cdc4245bf4c8c885358db52/images/large/4.jpg not downloaded yet
2026-03-26 22:46:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 903e1390-8721-55ae-9697-cc1db8002744 with identifier: 1986053
2026-03-26 22:46:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 903e1390-8721-55ae-9697-cc1db8002744 with identifier: 1986053
2026-03-26 22:46:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 903e1390-8721-55ae-9697-cc1db8002744 with identifier: 1986053 to the API
2026-03-26 22:46:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:46:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:46:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2an/a4a23ad46bb447e385e4dcbc9b21006e/images/large/4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '903e1390-8721-55ae-9697-cc1db8002744',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 86016,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_903e1390-8721-55ae-9697-cc1db8002744/903e1390-8721-55ae-9697-cc1db8002744_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 342583,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/a4a23ad46bb447e385e4dcbc9b21006e/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_903e1390-8721-55ae-9697-cc1db8002744/903e1390-8721-55ae-9697-cc1db8002744_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 453825,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/a4a23ad46bb447e385e4dcbc9b21006e/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_903e1390-8721-55ae-9697-cc1db8002744/903e1390-8721-55ae-9697-cc1db8002744_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 529881,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/a4a23ad46bb447e385e4dcbc9b21006e/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_903e1390-8721-55ae-9697-cc1db8002744/903e1390-8721-55ae-9697-cc1db8002744_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 536542,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/a4a23ad46bb447e385e4dcbc9b21006e/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_903e1390-8721-55ae-9697-cc1db8002744/903e1390-8721-55ae-9697-cc1db8002744_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 258993,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/a4a23ad46bb447e385e4dcbc9b21006e/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_903e1390-8721-55ae-9697-cc1db8002744/903e1390-8721-55ae-9697-cc1db8002744_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 325999,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/a4a23ad46bb447e385e4dcbc9b21006e/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_903e1390-8721-55ae-9697-cc1db8002744/903e1390-8721-55ae-9697-cc1db8002744_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 231471,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/a4a23ad46bb447e385e4dcbc9b21006e/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_903e1390-8721-55ae-9697-cc1db8002744/903e1390-8721-55ae-9697-cc1db8002744_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 377715,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/a4a23ad46bb447e385e4dcbc9b21006e/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_903e1390-8721-55ae-9697-cc1db8002744/903e1390-8721-55ae-9697-cc1db8002744_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 420944,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/a4a23ad46bb447e385e4dcbc9b21006e/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_903e1390-8721-55ae-9697-cc1db8002744/903e1390-8721-55ae-9697-cc1db8002744_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 389608,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/a4a23ad46bb447e385e4dcbc9b21006e/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 1.6 HYBRID 225 E-AUTO8 GT PACK',
 'transmission': 'automatic',
 'trim': '1.6 HYBRID 225 E-AUTO8 GT PACK',
 'vin': None,
 'year': 2021}
2026-03-26 22:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986053%27 HTTP/1.1" 200 None
2026-03-26 22:46:12 [ayvens.be] INFO: Saving data for 1986053: {'created_time': 1774565172.41042, 'last_price_update_time': 1774565172.41043, 'auction_closing_time': 1775028600.0}
2026-03-26 22:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986053') HTTP/1.1" 204 0
2026-03-26 22:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F7e1c1fdd1cdc4245bf4c8c885358db52%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/7e1c1fdd1cdc4245bf4c8c885358db52/images/large/5.jpg not downloaded yet
2026-03-26 22:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F7e1c1fdd1cdc4245bf4c8c885358db52%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/7e1c1fdd1cdc4245bf4c8c885358db52/images/large/6.jpg not downloaded yet
2026-03-26 22:46:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ag/cec88b0186f64c71bb25d7be8bc0b14f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ag/cec88b0186f64c71bb25d7be8bc0b14f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ag/cec88b0186f64c71bb25d7be8bc0b14f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F7e1c1fdd1cdc4245bf4c8c885358db52%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/7e1c1fdd1cdc4245bf4c8c885358db52/images/large/7.jpg not downloaded yet
2026-03-26 22:46:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ag/cec88b0186f64c71bb25d7be8bc0b14f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ag/cec88b0186f64c71bb25d7be8bc0b14f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ag/cec88b0186f64c71bb25d7be8bc0b14f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F7e1c1fdd1cdc4245bf4c8c885358db52%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/7e1c1fdd1cdc4245bf4c8c885358db52/images/large/8.jpg not downloaded yet
2026-03-26 22:46:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ag/cec88b0186f64c71bb25d7be8bc0b14f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F7e1c1fdd1cdc4245bf4c8c885358db52%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/7e1c1fdd1cdc4245bf4c8c885358db52/images/large/9.jpg not downloaded yet
2026-03-26 22:46:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ag/cec88b0186f64c71bb25d7be8bc0b14f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F7e1c1fdd1cdc4245bf4c8c885358db52%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/7e1c1fdd1cdc4245bf4c8c885358db52/images/large/10.jpg not downloaded yet
2026-03-26 22:46:12 [ayvens.be] INFO: Found listing with ID: 1986056
2026-03-26 22:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986056%27 HTTP/1.1" 200 None
2026-03-26 22:46:12 [ayvens.be] INFO: Scrape type for 1986056: 1
2026-03-26 22:46:12 [ayvens.be] INFO: Extracting data for car ID: 1986056
2026-03-26 22:46:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 95f3edeb-a72e-5665-83c2-ec33099e72e1 with identifier: 1986056
2026-03-26 22:46:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95f3edeb-a72e-5665-83c2-ec33099e72e1 with scrape type 1
2026-03-26 22:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 95f3edeb-a72e-5665-83c2-ec33099e72e1
2026-03-26 22:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F8cc412c93e784a89b9a7edf7ecf94290%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/8cc412c93e784a89b9a7edf7ecf94290/images/large/1.jpg not downloaded yet
2026-03-26 22:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F8cc412c93e784a89b9a7edf7ecf94290%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/8cc412c93e784a89b9a7edf7ecf94290/images/large/2.jpg not downloaded yet
2026-03-26 22:46:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6d83490>
2026-03-26 22:46:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f30e219f-3220-5b64-b86f-01bce4968bbe/f30e219f-3220-5b64-b86f-01bce4968bbe_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252Fcec88b0186f64c71bb25d7be8bc0b14f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/cec88b0186f64c71bb25d7be8bc0b14f/images/large/4.jpg saved to cache
2026-03-26 22:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f30e219f-3220-5b64-b86f-01bce4968bbe
2026-03-26 22:46:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cbd010>
2026-03-26 22:46:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f30e219f-3220-5b64-b86f-01bce4968bbe/f30e219f-3220-5b64-b86f-01bce4968bbe_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252Fcec88b0186f64c71bb25d7be8bc0b14f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/cec88b0186f64c71bb25d7be8bc0b14f/images/large/1.jpg saved to cache
2026-03-26 22:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f30e219f-3220-5b64-b86f-01bce4968bbe
2026-03-26 22:46:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e1efd0>
2026-03-26 22:46:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f30e219f-3220-5b64-b86f-01bce4968bbe/f30e219f-3220-5b64-b86f-01bce4968bbe_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252Fcec88b0186f64c71bb25d7be8bc0b14f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/cec88b0186f64c71bb25d7be8bc0b14f/images/large/2.jpg saved to cache
2026-03-26 22:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f30e219f-3220-5b64-b86f-01bce4968bbe
2026-03-26 22:46:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6df0990>
2026-03-26 22:46:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f30e219f-3220-5b64-b86f-01bce4968bbe/f30e219f-3220-5b64-b86f-01bce4968bbe_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252Fcec88b0186f64c71bb25d7be8bc0b14f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/cec88b0186f64c71bb25d7be8bc0b14f/images/large/3.jpg saved to cache
2026-03-26 22:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f30e219f-3220-5b64-b86f-01bce4968bbe
2026-03-26 22:46:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e3d2d0>
2026-03-26 22:46:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f30e219f-3220-5b64-b86f-01bce4968bbe/f30e219f-3220-5b64-b86f-01bce4968bbe_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252Fcec88b0186f64c71bb25d7be8bc0b14f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/cec88b0186f64c71bb25d7be8bc0b14f/images/large/5.jpg saved to cache
2026-03-26 22:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f30e219f-3220-5b64-b86f-01bce4968bbe
2026-03-26 22:46:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5ca1d10>
2026-03-26 22:46:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f30e219f-3220-5b64-b86f-01bce4968bbe/f30e219f-3220-5b64-b86f-01bce4968bbe_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252Fcec88b0186f64c71bb25d7be8bc0b14f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/cec88b0186f64c71bb25d7be8bc0b14f/images/large/7.jpg saved to cache
2026-03-26 22:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f30e219f-3220-5b64-b86f-01bce4968bbe
2026-03-26 22:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F8cc412c93e784a89b9a7edf7ecf94290%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/8cc412c93e784a89b9a7edf7ecf94290/images/large/3.jpg not downloaded yet
2026-03-26 22:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F8cc412c93e784a89b9a7edf7ecf94290%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/8cc412c93e784a89b9a7edf7ecf94290/images/large/4.jpg not downloaded yet
2026-03-26 22:46:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e4c490>
2026-03-26 22:46:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f30e219f-3220-5b64-b86f-01bce4968bbe/f30e219f-3220-5b64-b86f-01bce4968bbe_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252Fcec88b0186f64c71bb25d7be8bc0b14f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/cec88b0186f64c71bb25d7be8bc0b14f/images/large/6.jpg saved to cache
2026-03-26 22:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f30e219f-3220-5b64-b86f-01bce4968bbe
2026-03-26 22:46:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e4e1d0>
2026-03-26 22:46:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f30e219f-3220-5b64-b86f-01bce4968bbe/f30e219f-3220-5b64-b86f-01bce4968bbe_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252Fcec88b0186f64c71bb25d7be8bc0b14f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/cec88b0186f64c71bb25d7be8bc0b14f/images/large/8.jpg saved to cache
2026-03-26 22:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f30e219f-3220-5b64-b86f-01bce4968bbe
2026-03-26 22:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F8cc412c93e784a89b9a7edf7ecf94290%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/8cc412c93e784a89b9a7edf7ecf94290/images/large/5.jpg not downloaded yet
2026-03-26 22:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F8cc412c93e784a89b9a7edf7ecf94290%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/8cc412c93e784a89b9a7edf7ecf94290/images/large/6.jpg not downloaded yet
2026-03-26 22:46:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/7e1c1fdd1cdc4245bf4c8c885358db52/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/7e1c1fdd1cdc4245bf4c8c885358db52/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/7e1c1fdd1cdc4245bf4c8c885358db52/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/7e1c1fdd1cdc4245bf4c8c885358db52/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F8cc412c93e784a89b9a7edf7ecf94290%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/8cc412c93e784a89b9a7edf7ecf94290/images/large/7.jpg not downloaded yet
2026-03-26 22:46:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/7e1c1fdd1cdc4245bf4c8c885358db52/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/7e1c1fdd1cdc4245bf4c8c885358db52/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F8cc412c93e784a89b9a7edf7ecf94290%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/8cc412c93e784a89b9a7edf7ecf94290/images/large/8.jpg not downloaded yet
2026-03-26 22:46:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ag/cec88b0186f64c71bb25d7be8bc0b14f/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F8cc412c93e784a89b9a7edf7ecf94290%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/8cc412c93e784a89b9a7edf7ecf94290/images/large/9.jpg not downloaded yet
2026-03-26 22:46:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ag/cec88b0186f64c71bb25d7be8bc0b14f/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F8cc412c93e784a89b9a7edf7ecf94290%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/8cc412c93e784a89b9a7edf7ecf94290/images/large/10.jpg not downloaded yet
2026-03-26 22:46:13 [ayvens.be] INFO: Found listing with ID: 1986057
2026-03-26 22:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986057%27 HTTP/1.1" 200 None
2026-03-26 22:46:13 [ayvens.be] INFO: Scrape type for 1986057: 1
2026-03-26 22:46:13 [ayvens.be] INFO: Extracting data for car ID: 1986057
2026-03-26 22:46:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b349ff55-7466-590b-bffd-73237a1ae400 with identifier: 1986057
2026-03-26 22:46:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b349ff55-7466-590b-bffd-73237a1ae400 with scrape type 1
2026-03-26 22:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b349ff55-7466-590b-bffd-73237a1ae400
2026-03-26 22:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F33bb4cf5d1084472a2bc6e8d869f8614%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/33bb4cf5d1084472a2bc6e8d869f8614/images/large/1.jpg not downloaded yet
2026-03-26 22:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F33bb4cf5d1084472a2bc6e8d869f8614%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/33bb4cf5d1084472a2bc6e8d869f8614/images/large/2.jpg not downloaded yet
2026-03-26 22:46:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7572650>
2026-03-26 22:46:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9141ae3d-f426-5d7e-8314-c2bb045d46a8/9141ae3d-f426-5d7e-8314-c2bb045d46a8_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F7e1c1fdd1cdc4245bf4c8c885358db52%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/7e1c1fdd1cdc4245bf4c8c885358db52/images/large/3.jpg saved to cache
2026-03-26 22:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9141ae3d-f426-5d7e-8314-c2bb045d46a8
2026-03-26 22:46:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd0af890>
2026-03-26 22:46:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9141ae3d-f426-5d7e-8314-c2bb045d46a8/9141ae3d-f426-5d7e-8314-c2bb045d46a8_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F7e1c1fdd1cdc4245bf4c8c885358db52%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/7e1c1fdd1cdc4245bf4c8c885358db52/images/large/5.jpg saved to cache
2026-03-26 22:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9141ae3d-f426-5d7e-8314-c2bb045d46a8
2026-03-26 22:46:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74bf250>
2026-03-26 22:46:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9141ae3d-f426-5d7e-8314-c2bb045d46a8/9141ae3d-f426-5d7e-8314-c2bb045d46a8_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F7e1c1fdd1cdc4245bf4c8c885358db52%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/7e1c1fdd1cdc4245bf4c8c885358db52/images/large/6.jpg saved to cache
2026-03-26 22:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9141ae3d-f426-5d7e-8314-c2bb045d46a8
2026-03-26 22:46:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c6bd10>
2026-03-26 22:46:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9141ae3d-f426-5d7e-8314-c2bb045d46a8/9141ae3d-f426-5d7e-8314-c2bb045d46a8_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F7e1c1fdd1cdc4245bf4c8c885358db52%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/7e1c1fdd1cdc4245bf4c8c885358db52/images/large/4.jpg saved to cache
2026-03-26 22:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9141ae3d-f426-5d7e-8314-c2bb045d46a8
2026-03-26 22:46:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76cf750>
2026-03-26 22:46:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9141ae3d-f426-5d7e-8314-c2bb045d46a8/9141ae3d-f426-5d7e-8314-c2bb045d46a8_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F7e1c1fdd1cdc4245bf4c8c885358db52%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/7e1c1fdd1cdc4245bf4c8c885358db52/images/large/1.jpg saved to cache
2026-03-26 22:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9141ae3d-f426-5d7e-8314-c2bb045d46a8
2026-03-26 22:46:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c63090>
2026-03-26 22:46:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9141ae3d-f426-5d7e-8314-c2bb045d46a8/9141ae3d-f426-5d7e-8314-c2bb045d46a8_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F7e1c1fdd1cdc4245bf4c8c885358db52%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/7e1c1fdd1cdc4245bf4c8c885358db52/images/large/2.jpg saved to cache
2026-03-26 22:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9141ae3d-f426-5d7e-8314-c2bb045d46a8
2026-03-26 22:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F33bb4cf5d1084472a2bc6e8d869f8614%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/33bb4cf5d1084472a2bc6e8d869f8614/images/large/3.jpg not downloaded yet
2026-03-26 22:46:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c7c650>
2026-03-26 22:46:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f30e219f-3220-5b64-b86f-01bce4968bbe/f30e219f-3220-5b64-b86f-01bce4968bbe_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252Fcec88b0186f64c71bb25d7be8bc0b14f%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/cec88b0186f64c71bb25d7be8bc0b14f/images/large/9.jpg saved to cache
2026-03-26 22:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f30e219f-3220-5b64-b86f-01bce4968bbe
2026-03-26 22:46:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76c6790>
2026-03-26 22:46:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f30e219f-3220-5b64-b86f-01bce4968bbe/f30e219f-3220-5b64-b86f-01bce4968bbe_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252Fcec88b0186f64c71bb25d7be8bc0b14f%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/cec88b0186f64c71bb25d7be8bc0b14f/images/large/10.jpg saved to cache
2026-03-26 22:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f30e219f-3220-5b64-b86f-01bce4968bbe
2026-03-26 22:46:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f30e219f-3220-5b64-b86f-01bce4968bbe, skipping ID generation
2026-03-26 22:46:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f30e219f-3220-5b64-b86f-01bce4968bbe with scrape type 1
2026-03-26 22:46:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f30e219f-3220-5b64-b86f-01bce4968bbe sending to next pipeline
2026-03-26 22:46:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f30e219f-3220-5b64-b86f-01bce4968bbe, identifier: 1986054
2026-03-26 22:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F33bb4cf5d1084472a2bc6e8d869f8614%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/33bb4cf5d1084472a2bc6e8d869f8614/images/large/4.jpg not downloaded yet
2026-03-26 22:46:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f30e219f-3220-5b64-b86f-01bce4968bbe with identifier: 1986054
2026-03-26 22:46:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f30e219f-3220-5b64-b86f-01bce4968bbe with identifier: 1986054
2026-03-26 22:46:14 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f30e219f-3220-5b64-b86f-01bce4968bbe with identifier: 1986054 to the API
2026-03-26 22:46:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:46:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:46:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ag/cec88b0186f64c71bb25d7be8bc0b14f/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'f30e219f-3220-5b64-b86f-01bce4968bbe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 130758,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f30e219f-3220-5b64-b86f-01bce4968bbe/f30e219f-3220-5b64-b86f-01bce4968bbe_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 655997,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ag/cec88b0186f64c71bb25d7be8bc0b14f/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f30e219f-3220-5b64-b86f-01bce4968bbe/f30e219f-3220-5b64-b86f-01bce4968bbe_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 675588,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ag/cec88b0186f64c71bb25d7be8bc0b14f/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f30e219f-3220-5b64-b86f-01bce4968bbe/f30e219f-3220-5b64-b86f-01bce4968bbe_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 639155,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ag/cec88b0186f64c71bb25d7be8bc0b14f/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f30e219f-3220-5b64-b86f-01bce4968bbe/f30e219f-3220-5b64-b86f-01bce4968bbe_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 672309,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ag/cec88b0186f64c71bb25d7be8bc0b14f/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f30e219f-3220-5b64-b86f-01bce4968bbe/f30e219f-3220-5b64-b86f-01bce4968bbe_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 638249,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ag/cec88b0186f64c71bb25d7be8bc0b14f/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f30e219f-3220-5b64-b86f-01bce4968bbe/f30e219f-3220-5b64-b86f-01bce4968bbe_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 688721,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ag/cec88b0186f64c71bb25d7be8bc0b14f/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f30e219f-3220-5b64-b86f-01bce4968bbe/f30e219f-3220-5b64-b86f-01bce4968bbe_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 619400,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ag/cec88b0186f64c71bb25d7be8bc0b14f/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f30e219f-3220-5b64-b86f-01bce4968bbe/f30e219f-3220-5b64-b86f-01bce4968bbe_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 835652,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ag/cec88b0186f64c71bb25d7be8bc0b14f/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f30e219f-3220-5b64-b86f-01bce4968bbe/f30e219f-3220-5b64-b86f-01bce4968bbe_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 777770,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ag/cec88b0186f64c71bb25d7be8bc0b14f/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f30e219f-3220-5b64-b86f-01bce4968bbe/f30e219f-3220-5b64-b86f-01bce4968bbe_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 847929,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ag/cec88b0186f64c71bb25d7be8bc0b14f/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 1.5 BLUEHDI S&S EAT8 GT PACK',
 'transmission': 'automatic',
 'trim': '1.5 BLUEHDI S&S EAT8 GT PACK',
 'vin': None,
 'year': 2021}
2026-03-26 22:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986054%27 HTTP/1.1" 200 None
2026-03-26 22:46:14 [ayvens.be] INFO: Saving data for 1986054: {'created_time': 1774565174.981118, 'last_price_update_time': 1774565174.981127, 'auction_closing_time': 1775028600.0}
2026-03-26 22:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986054') HTTP/1.1" 204 0
2026-03-26 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F33bb4cf5d1084472a2bc6e8d869f8614%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/33bb4cf5d1084472a2bc6e8d869f8614/images/large/5.jpg not downloaded yet
2026-03-26 22:46:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/8cc412c93e784a89b9a7edf7ecf94290/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F33bb4cf5d1084472a2bc6e8d869f8614%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/33bb4cf5d1084472a2bc6e8d869f8614/images/large/6.jpg not downloaded yet
2026-03-26 22:46:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/7e1c1fdd1cdc4245bf4c8c885358db52/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/8cc412c93e784a89b9a7edf7ecf94290/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/8cc412c93e784a89b9a7edf7ecf94290/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/7e1c1fdd1cdc4245bf4c8c885358db52/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F33bb4cf5d1084472a2bc6e8d869f8614%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/33bb4cf5d1084472a2bc6e8d869f8614/images/large/7.jpg not downloaded yet
2026-03-26 22:46:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/8cc412c93e784a89b9a7edf7ecf94290/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/7e1c1fdd1cdc4245bf4c8c885358db52/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F33bb4cf5d1084472a2bc6e8d869f8614%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/33bb4cf5d1084472a2bc6e8d869f8614/images/large/8.jpg not downloaded yet
2026-03-26 22:46:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/7e1c1fdd1cdc4245bf4c8c885358db52/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F33bb4cf5d1084472a2bc6e8d869f8614%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/33bb4cf5d1084472a2bc6e8d869f8614/images/large/9.jpg not downloaded yet
2026-03-26 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F33bb4cf5d1084472a2bc6e8d869f8614%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/33bb4cf5d1084472a2bc6e8d869f8614/images/large/10.jpg not downloaded yet
2026-03-26 22:46:15 [ayvens.be] INFO: Found listing with ID: 1986058
2026-03-26 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986058%27 HTTP/1.1" 200 None
2026-03-26 22:46:15 [ayvens.be] INFO: Scrape type for 1986058: 1
2026-03-26 22:46:15 [ayvens.be] INFO: Extracting data for car ID: 1986058
2026-03-26 22:46:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a03492f-3c74-5a66-9455-28bf6cc089f5 with identifier: 1986058
2026-03-26 22:46:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a03492f-3c74-5a66-9455-28bf6cc089f5 with scrape type 1
2026-03-26 22:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9a03492f-3c74-5a66-9455-28bf6cc089f5
2026-03-26 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F229355a0a9ec49768d725df8f1bf134d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/229355a0a9ec49768d725df8f1bf134d/images/large/1.jpg not downloaded yet
2026-03-26 22:46:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7585350>
2026-03-26 22:46:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95f3edeb-a72e-5665-83c2-ec33099e72e1/95f3edeb-a72e-5665-83c2-ec33099e72e1_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F8cc412c93e784a89b9a7edf7ecf94290%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/8cc412c93e784a89b9a7edf7ecf94290/images/large/3.jpg saved to cache
2026-03-26 22:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 95f3edeb-a72e-5665-83c2-ec33099e72e1
2026-03-26 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F229355a0a9ec49768d725df8f1bf134d%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/229355a0a9ec49768d725df8f1bf134d/images/large/2.jpg not downloaded yet
2026-03-26 22:46:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76ccc10>
2026-03-26 22:46:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9141ae3d-f426-5d7e-8314-c2bb045d46a8/9141ae3d-f426-5d7e-8314-c2bb045d46a8_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F7e1c1fdd1cdc4245bf4c8c885358db52%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/7e1c1fdd1cdc4245bf4c8c885358db52/images/large/10.jpg saved to cache
2026-03-26 22:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9141ae3d-f426-5d7e-8314-c2bb045d46a8
2026-03-26 22:46:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b75671d0>
2026-03-26 22:46:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95f3edeb-a72e-5665-83c2-ec33099e72e1/95f3edeb-a72e-5665-83c2-ec33099e72e1_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F8cc412c93e784a89b9a7edf7ecf94290%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/8cc412c93e784a89b9a7edf7ecf94290/images/large/4.jpg saved to cache
2026-03-26 22:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 95f3edeb-a72e-5665-83c2-ec33099e72e1
2026-03-26 22:46:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7439710>
2026-03-26 22:46:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95f3edeb-a72e-5665-83c2-ec33099e72e1/95f3edeb-a72e-5665-83c2-ec33099e72e1_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F8cc412c93e784a89b9a7edf7ecf94290%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/8cc412c93e784a89b9a7edf7ecf94290/images/large/2.jpg saved to cache
2026-03-26 22:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 95f3edeb-a72e-5665-83c2-ec33099e72e1
2026-03-26 22:46:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76e2c10>
2026-03-26 22:46:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9141ae3d-f426-5d7e-8314-c2bb045d46a8/9141ae3d-f426-5d7e-8314-c2bb045d46a8_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F7e1c1fdd1cdc4245bf4c8c885358db52%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/7e1c1fdd1cdc4245bf4c8c885358db52/images/large/7.jpg saved to cache
2026-03-26 22:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9141ae3d-f426-5d7e-8314-c2bb045d46a8
2026-03-26 22:46:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7495cd0>
2026-03-26 22:46:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95f3edeb-a72e-5665-83c2-ec33099e72e1/95f3edeb-a72e-5665-83c2-ec33099e72e1_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F8cc412c93e784a89b9a7edf7ecf94290%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/8cc412c93e784a89b9a7edf7ecf94290/images/large/1.jpg saved to cache
2026-03-26 22:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 95f3edeb-a72e-5665-83c2-ec33099e72e1
2026-03-26 22:46:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e35e10>
2026-03-26 22:46:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9141ae3d-f426-5d7e-8314-c2bb045d46a8/9141ae3d-f426-5d7e-8314-c2bb045d46a8_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F7e1c1fdd1cdc4245bf4c8c885358db52%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/7e1c1fdd1cdc4245bf4c8c885358db52/images/large/9.jpg saved to cache
2026-03-26 22:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9141ae3d-f426-5d7e-8314-c2bb045d46a8
2026-03-26 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F229355a0a9ec49768d725df8f1bf134d%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/229355a0a9ec49768d725df8f1bf134d/images/large/3.jpg not downloaded yet
2026-03-26 22:46:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/8cc412c93e784a89b9a7edf7ecf94290/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/8cc412c93e784a89b9a7edf7ecf94290/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F229355a0a9ec49768d725df8f1bf134d%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/229355a0a9ec49768d725df8f1bf134d/images/large/4.jpg not downloaded yet
2026-03-26 22:46:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b787cd50>
2026-03-26 22:46:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9141ae3d-f426-5d7e-8314-c2bb045d46a8/9141ae3d-f426-5d7e-8314-c2bb045d46a8_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F7e1c1fdd1cdc4245bf4c8c885358db52%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/7e1c1fdd1cdc4245bf4c8c885358db52/images/large/8.jpg saved to cache
2026-03-26 22:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9141ae3d-f426-5d7e-8314-c2bb045d46a8
2026-03-26 22:46:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9141ae3d-f426-5d7e-8314-c2bb045d46a8, skipping ID generation
2026-03-26 22:46:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9141ae3d-f426-5d7e-8314-c2bb045d46a8 with scrape type 1
2026-03-26 22:46:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9141ae3d-f426-5d7e-8314-c2bb045d46a8 sending to next pipeline
2026-03-26 22:46:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 9141ae3d-f426-5d7e-8314-c2bb045d46a8, identifier: 1986055
2026-03-26 22:46:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/8cc412c93e784a89b9a7edf7ecf94290/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 9141ae3d-f426-5d7e-8314-c2bb045d46a8 with identifier: 1986055
2026-03-26 22:46:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 9141ae3d-f426-5d7e-8314-c2bb045d46a8 with identifier: 1986055
2026-03-26 22:46:16 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 9141ae3d-f426-5d7e-8314-c2bb045d46a8 with identifier: 1986055 to the API
2026-03-26 22:46:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:46:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:46:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ae/7e1c1fdd1cdc4245bf4c8c885358db52/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '9141ae3d-f426-5d7e-8314-c2bb045d46a8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'QASHQAI',
 'odometer': 49990,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9141ae3d-f426-5d7e-8314-c2bb045d46a8/9141ae3d-f426-5d7e-8314-c2bb045d46a8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 617282,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/7e1c1fdd1cdc4245bf4c8c885358db52/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9141ae3d-f426-5d7e-8314-c2bb045d46a8/9141ae3d-f426-5d7e-8314-c2bb045d46a8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 645248,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/7e1c1fdd1cdc4245bf4c8c885358db52/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9141ae3d-f426-5d7e-8314-c2bb045d46a8/9141ae3d-f426-5d7e-8314-c2bb045d46a8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 611061,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/7e1c1fdd1cdc4245bf4c8c885358db52/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9141ae3d-f426-5d7e-8314-c2bb045d46a8/9141ae3d-f426-5d7e-8314-c2bb045d46a8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 685730,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/7e1c1fdd1cdc4245bf4c8c885358db52/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9141ae3d-f426-5d7e-8314-c2bb045d46a8/9141ae3d-f426-5d7e-8314-c2bb045d46a8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 596462,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/7e1c1fdd1cdc4245bf4c8c885358db52/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9141ae3d-f426-5d7e-8314-c2bb045d46a8/9141ae3d-f426-5d7e-8314-c2bb045d46a8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 500205,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/7e1c1fdd1cdc4245bf4c8c885358db52/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9141ae3d-f426-5d7e-8314-c2bb045d46a8/9141ae3d-f426-5d7e-8314-c2bb045d46a8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 661223,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/7e1c1fdd1cdc4245bf4c8c885358db52/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9141ae3d-f426-5d7e-8314-c2bb045d46a8/9141ae3d-f426-5d7e-8314-c2bb045d46a8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 691599,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/7e1c1fdd1cdc4245bf4c8c885358db52/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9141ae3d-f426-5d7e-8314-c2bb045d46a8/9141ae3d-f426-5d7e-8314-c2bb045d46a8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 603072,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/7e1c1fdd1cdc4245bf4c8c885358db52/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9141ae3d-f426-5d7e-8314-c2bb045d46a8/9141ae3d-f426-5d7e-8314-c2bb045d46a8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 652602,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/7e1c1fdd1cdc4245bf4c8c885358db52/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN QASHQAI 1.3 DIG-T 140 EVAPO N-CONNECTA',
 'transmission': 'manual',
 'trim': '1.3 DIG-T 140 EVAPO N-CONNECTA',
 'vin': None,
 'year': 2021}
2026-03-26 22:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986055%27 HTTP/1.1" 200 None
2026-03-26 22:46:16 [ayvens.be] INFO: Saving data for 1986055: {'created_time': 1774565176.630935, 'last_price_update_time': 1774565176.630945, 'auction_closing_time': 1775028600.0}
2026-03-26 22:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986055') HTTP/1.1" 204 0
2026-03-26 22:46:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/8cc412c93e784a89b9a7edf7ecf94290/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F229355a0a9ec49768d725df8f1bf134d%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/229355a0a9ec49768d725df8f1bf134d/images/large/5.jpg not downloaded yet
2026-03-26 22:46:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/8cc412c93e784a89b9a7edf7ecf94290/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F229355a0a9ec49768d725df8f1bf134d%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/229355a0a9ec49768d725df8f1bf134d/images/large/6.jpg not downloaded yet
2026-03-26 22:46:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b741d090>
2026-03-26 22:46:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95f3edeb-a72e-5665-83c2-ec33099e72e1/95f3edeb-a72e-5665-83c2-ec33099e72e1_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F8cc412c93e784a89b9a7edf7ecf94290%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/8cc412c93e784a89b9a7edf7ecf94290/images/large/8.jpg saved to cache
2026-03-26 22:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 95f3edeb-a72e-5665-83c2-ec33099e72e1
2026-03-26 22:46:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74de0d0>
2026-03-26 22:46:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95f3edeb-a72e-5665-83c2-ec33099e72e1/95f3edeb-a72e-5665-83c2-ec33099e72e1_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F8cc412c93e784a89b9a7edf7ecf94290%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/8cc412c93e784a89b9a7edf7ecf94290/images/large/6.jpg saved to cache
2026-03-26 22:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 95f3edeb-a72e-5665-83c2-ec33099e72e1
2026-03-26 22:46:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e17510>
2026-03-26 22:46:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95f3edeb-a72e-5665-83c2-ec33099e72e1/95f3edeb-a72e-5665-83c2-ec33099e72e1_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F8cc412c93e784a89b9a7edf7ecf94290%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/8cc412c93e784a89b9a7edf7ecf94290/images/large/10.jpg saved to cache
2026-03-26 22:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 95f3edeb-a72e-5665-83c2-ec33099e72e1
2026-03-26 22:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F229355a0a9ec49768d725df8f1bf134d%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/229355a0a9ec49768d725df8f1bf134d/images/large/7.jpg not downloaded yet
2026-03-26 22:46:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/33bb4cf5d1084472a2bc6e8d869f8614/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b787ea50>
2026-03-26 22:46:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95f3edeb-a72e-5665-83c2-ec33099e72e1/95f3edeb-a72e-5665-83c2-ec33099e72e1_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F8cc412c93e784a89b9a7edf7ecf94290%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/8cc412c93e784a89b9a7edf7ecf94290/images/large/5.jpg saved to cache
2026-03-26 22:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 95f3edeb-a72e-5665-83c2-ec33099e72e1
2026-03-26 22:46:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7491810>
2026-03-26 22:46:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95f3edeb-a72e-5665-83c2-ec33099e72e1/95f3edeb-a72e-5665-83c2-ec33099e72e1_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F8cc412c93e784a89b9a7edf7ecf94290%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/8cc412c93e784a89b9a7edf7ecf94290/images/large/7.jpg saved to cache
2026-03-26 22:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 95f3edeb-a72e-5665-83c2-ec33099e72e1
2026-03-26 22:46:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/33bb4cf5d1084472a2bc6e8d869f8614/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F229355a0a9ec49768d725df8f1bf134d%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/229355a0a9ec49768d725df8f1bf134d/images/large/8.jpg not downloaded yet
2026-03-26 22:46:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/33bb4cf5d1084472a2bc6e8d869f8614/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/8cc412c93e784a89b9a7edf7ecf94290/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F229355a0a9ec49768d725df8f1bf134d%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/229355a0a9ec49768d725df8f1bf134d/images/large/9.jpg not downloaded yet
2026-03-26 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F229355a0a9ec49768d725df8f1bf134d%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/229355a0a9ec49768d725df8f1bf134d/images/large/10.jpg not downloaded yet
2026-03-26 22:46:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cbd290>
2026-03-26 22:46:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b349ff55-7466-590b-bffd-73237a1ae400/b349ff55-7466-590b-bffd-73237a1ae400_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F33bb4cf5d1084472a2bc6e8d869f8614%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/33bb4cf5d1084472a2bc6e8d869f8614/images/large/3.jpg saved to cache
2026-03-26 22:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b349ff55-7466-590b-bffd-73237a1ae400
2026-03-26 22:46:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/33bb4cf5d1084472a2bc6e8d869f8614/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/33bb4cf5d1084472a2bc6e8d869f8614/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:17 [ayvens.be] INFO: Found listing with ID: 1986059
2026-03-26 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986059%27 HTTP/1.1" 200 None
2026-03-26 22:46:17 [ayvens.be] INFO: Scrape type for 1986059: 1
2026-03-26 22:46:17 [ayvens.be] INFO: Extracting data for car ID: 1986059
2026-03-26 22:46:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a197201-09a4-5914-9db7-b1acd397848f with identifier: 1986059
2026-03-26 22:46:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a197201-09a4-5914-9db7-b1acd397848f with scrape type 1
2026-03-26 22:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6a197201-09a4-5914-9db7-b1acd397848f
2026-03-26 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F38f37bdafc5046809f180038daac16aa%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/38f37bdafc5046809f180038daac16aa/images/large/1.jpg not downloaded yet
2026-03-26 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F38f37bdafc5046809f180038daac16aa%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/38f37bdafc5046809f180038daac16aa/images/large/2.jpg not downloaded yet
2026-03-26 22:46:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/33bb4cf5d1084472a2bc6e8d869f8614/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b782da90>
2026-03-26 22:46:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b349ff55-7466-590b-bffd-73237a1ae400/b349ff55-7466-590b-bffd-73237a1ae400_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F33bb4cf5d1084472a2bc6e8d869f8614%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/33bb4cf5d1084472a2bc6e8d869f8614/images/large/2.jpg saved to cache
2026-03-26 22:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b349ff55-7466-590b-bffd-73237a1ae400
2026-03-26 22:46:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b741c510>
2026-03-26 22:46:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b349ff55-7466-590b-bffd-73237a1ae400/b349ff55-7466-590b-bffd-73237a1ae400_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F33bb4cf5d1084472a2bc6e8d869f8614%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/33bb4cf5d1084472a2bc6e8d869f8614/images/large/1.jpg saved to cache
2026-03-26 22:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b349ff55-7466-590b-bffd-73237a1ae400
2026-03-26 22:46:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6dedb10>
2026-03-26 22:46:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95f3edeb-a72e-5665-83c2-ec33099e72e1/95f3edeb-a72e-5665-83c2-ec33099e72e1_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F8cc412c93e784a89b9a7edf7ecf94290%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/8cc412c93e784a89b9a7edf7ecf94290/images/large/9.jpg saved to cache
2026-03-26 22:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 95f3edeb-a72e-5665-83c2-ec33099e72e1
2026-03-26 22:46:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 95f3edeb-a72e-5665-83c2-ec33099e72e1, skipping ID generation
2026-03-26 22:46:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95f3edeb-a72e-5665-83c2-ec33099e72e1 with scrape type 1
2026-03-26 22:46:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 95f3edeb-a72e-5665-83c2-ec33099e72e1 sending to next pipeline
2026-03-26 22:46:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 95f3edeb-a72e-5665-83c2-ec33099e72e1, identifier: 1986056
2026-03-26 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F38f37bdafc5046809f180038daac16aa%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/38f37bdafc5046809f180038daac16aa/images/large/3.jpg not downloaded yet
2026-03-26 22:46:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 95f3edeb-a72e-5665-83c2-ec33099e72e1 with identifier: 1986056
2026-03-26 22:46:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 95f3edeb-a72e-5665-83c2-ec33099e72e1 with identifier: 1986056
2026-03-26 22:46:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 95f3edeb-a72e-5665-83c2-ec33099e72e1 with identifier: 1986056 to the API
2026-03-26 22:46:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:46:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:46:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bj/8cc412c93e784a89b9a7edf7ecf94290/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'electric',
 'id': '95f3edeb-a72e-5665-83c2-ec33099e72e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'EQA',
 'odometer': 79699,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95f3edeb-a72e-5665-83c2-ec33099e72e1/95f3edeb-a72e-5665-83c2-ec33099e72e1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 754804,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/8cc412c93e784a89b9a7edf7ecf94290/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95f3edeb-a72e-5665-83c2-ec33099e72e1/95f3edeb-a72e-5665-83c2-ec33099e72e1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 776277,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/8cc412c93e784a89b9a7edf7ecf94290/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95f3edeb-a72e-5665-83c2-ec33099e72e1/95f3edeb-a72e-5665-83c2-ec33099e72e1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 535427,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/8cc412c93e784a89b9a7edf7ecf94290/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95f3edeb-a72e-5665-83c2-ec33099e72e1/95f3edeb-a72e-5665-83c2-ec33099e72e1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 460231,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/8cc412c93e784a89b9a7edf7ecf94290/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95f3edeb-a72e-5665-83c2-ec33099e72e1/95f3edeb-a72e-5665-83c2-ec33099e72e1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 419840,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/8cc412c93e784a89b9a7edf7ecf94290/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95f3edeb-a72e-5665-83c2-ec33099e72e1/95f3edeb-a72e-5665-83c2-ec33099e72e1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 351238,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/8cc412c93e784a89b9a7edf7ecf94290/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95f3edeb-a72e-5665-83c2-ec33099e72e1/95f3edeb-a72e-5665-83c2-ec33099e72e1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 445958,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/8cc412c93e784a89b9a7edf7ecf94290/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95f3edeb-a72e-5665-83c2-ec33099e72e1/95f3edeb-a72e-5665-83c2-ec33099e72e1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 250401,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/8cc412c93e784a89b9a7edf7ecf94290/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95f3edeb-a72e-5665-83c2-ec33099e72e1/95f3edeb-a72e-5665-83c2-ec33099e72e1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 249000,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/8cc412c93e784a89b9a7edf7ecf94290/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95f3edeb-a72e-5665-83c2-ec33099e72e1/95f3edeb-a72e-5665-83c2-ec33099e72e1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 304855,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/8cc412c93e784a89b9a7edf7ecf94290/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ EQA BEV 67KWH EQA 250 BUSINESS SOLUTION LUX',
 'transmission': 'automatic',
 'trim': 'BEV 67KWH EQA 250 BUSINESS SOLUTION LUX',
 'vin': None,
 'year': 2021}
2026-03-26 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986056%27 HTTP/1.1" 200 None
2026-03-26 22:46:18 [ayvens.be] INFO: Saving data for 1986056: {'created_time': 1774565178.080415, 'last_price_update_time': 1774565178.080425, 'auction_closing_time': 1775028600.0}
2026-03-26 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986056') HTTP/1.1" 204 0
2026-03-26 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F38f37bdafc5046809f180038daac16aa%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/38f37bdafc5046809f180038daac16aa/images/large/4.jpg not downloaded yet
2026-03-26 22:46:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/33bb4cf5d1084472a2bc6e8d869f8614/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F38f37bdafc5046809f180038daac16aa%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/38f37bdafc5046809f180038daac16aa/images/large/5.jpg not downloaded yet
2026-03-26 22:46:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b787f690>
2026-03-26 22:46:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b349ff55-7466-590b-bffd-73237a1ae400/b349ff55-7466-590b-bffd-73237a1ae400_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F33bb4cf5d1084472a2bc6e8d869f8614%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/33bb4cf5d1084472a2bc6e8d869f8614/images/large/5.jpg saved to cache
2026-03-26 22:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b349ff55-7466-590b-bffd-73237a1ae400
2026-03-26 22:46:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77d5490>
2026-03-26 22:46:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b349ff55-7466-590b-bffd-73237a1ae400/b349ff55-7466-590b-bffd-73237a1ae400_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F33bb4cf5d1084472a2bc6e8d869f8614%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/33bb4cf5d1084472a2bc6e8d869f8614/images/large/6.jpg saved to cache
2026-03-26 22:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b349ff55-7466-590b-bffd-73237a1ae400
2026-03-26 22:46:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74f8ed0>
2026-03-26 22:46:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b349ff55-7466-590b-bffd-73237a1ae400/b349ff55-7466-590b-bffd-73237a1ae400_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F33bb4cf5d1084472a2bc6e8d869f8614%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/33bb4cf5d1084472a2bc6e8d869f8614/images/large/4.jpg saved to cache
2026-03-26 22:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b349ff55-7466-590b-bffd-73237a1ae400
2026-03-26 22:46:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/229355a0a9ec49768d725df8f1bf134d/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F38f37bdafc5046809f180038daac16aa%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/38f37bdafc5046809f180038daac16aa/images/large/6.jpg not downloaded yet
2026-03-26 22:46:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/229355a0a9ec49768d725df8f1bf134d/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F38f37bdafc5046809f180038daac16aa%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/38f37bdafc5046809f180038daac16aa/images/large/7.jpg not downloaded yet
2026-03-26 22:46:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/229355a0a9ec49768d725df8f1bf134d/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/229355a0a9ec49768d725df8f1bf134d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cb10d0>
2026-03-26 22:46:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b349ff55-7466-590b-bffd-73237a1ae400/b349ff55-7466-590b-bffd-73237a1ae400_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F33bb4cf5d1084472a2bc6e8d869f8614%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/33bb4cf5d1084472a2bc6e8d869f8614/images/large/7.jpg saved to cache
2026-03-26 22:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b349ff55-7466-590b-bffd-73237a1ae400
2026-03-26 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F38f37bdafc5046809f180038daac16aa%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/38f37bdafc5046809f180038daac16aa/images/large/8.jpg not downloaded yet
2026-03-26 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F38f37bdafc5046809f180038daac16aa%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/38f37bdafc5046809f180038daac16aa/images/large/9.jpg not downloaded yet
2026-03-26 22:46:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/33bb4cf5d1084472a2bc6e8d869f8614/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/33bb4cf5d1084472a2bc6e8d869f8614/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F38f37bdafc5046809f180038daac16aa%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/38f37bdafc5046809f180038daac16aa/images/large/10.jpg not downloaded yet
2026-03-26 22:46:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7427cd0>
2026-03-26 22:46:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a03492f-3c74-5a66-9455-28bf6cc089f5/9a03492f-3c74-5a66-9455-28bf6cc089f5_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F229355a0a9ec49768d725df8f1bf134d%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/229355a0a9ec49768d725df8f1bf134d/images/large/3.jpg saved to cache
2026-03-26 22:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9a03492f-3c74-5a66-9455-28bf6cc089f5
2026-03-26 22:46:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e113d0>
2026-03-26 22:46:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a03492f-3c74-5a66-9455-28bf6cc089f5/9a03492f-3c74-5a66-9455-28bf6cc089f5_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F229355a0a9ec49768d725df8f1bf134d%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/229355a0a9ec49768d725df8f1bf134d/images/large/4.jpg saved to cache
2026-03-26 22:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9a03492f-3c74-5a66-9455-28bf6cc089f5
2026-03-26 22:46:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/33bb4cf5d1084472a2bc6e8d869f8614/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:18 [ayvens.be] INFO: Found listing with ID: 1986060
2026-03-26 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986060%27 HTTP/1.1" 200 None
2026-03-26 22:46:18 [ayvens.be] INFO: Scrape type for 1986060: 1
2026-03-26 22:46:18 [ayvens.be] INFO: Extracting data for car ID: 1986060
2026-03-26 22:46:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a3e5ac1e-7a7e-554b-b75c-63b3f5a59935 with identifier: 1986060
2026-03-26 22:46:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3e5ac1e-7a7e-554b-b75c-63b3f5a59935 with scrape type 1
2026-03-26 22:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a3e5ac1e-7a7e-554b-b75c-63b3f5a59935
2026-03-26 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F6a069b24116e4224a8830ae208926fb6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/6a069b24116e4224a8830ae208926fb6/images/large/1.jpg not downloaded yet
2026-03-26 22:46:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c779d0>
2026-03-26 22:46:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a03492f-3c74-5a66-9455-28bf6cc089f5/9a03492f-3c74-5a66-9455-28bf6cc089f5_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F229355a0a9ec49768d725df8f1bf134d%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/229355a0a9ec49768d725df8f1bf134d/images/large/2.jpg saved to cache
2026-03-26 22:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9a03492f-3c74-5a66-9455-28bf6cc089f5
2026-03-26 22:46:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b782e5d0>
2026-03-26 22:46:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a03492f-3c74-5a66-9455-28bf6cc089f5/9a03492f-3c74-5a66-9455-28bf6cc089f5_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F229355a0a9ec49768d725df8f1bf134d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/229355a0a9ec49768d725df8f1bf134d/images/large/1.jpg saved to cache
2026-03-26 22:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9a03492f-3c74-5a66-9455-28bf6cc089f5
2026-03-26 22:46:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/229355a0a9ec49768d725df8f1bf134d/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/229355a0a9ec49768d725df8f1bf134d/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F6a069b24116e4224a8830ae208926fb6%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/6a069b24116e4224a8830ae208926fb6/images/large/2.jpg not downloaded yet
2026-03-26 22:46:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7ccf010>
2026-03-26 22:46:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b349ff55-7466-590b-bffd-73237a1ae400/b349ff55-7466-590b-bffd-73237a1ae400_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F33bb4cf5d1084472a2bc6e8d869f8614%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/33bb4cf5d1084472a2bc6e8d869f8614/images/large/9.jpg saved to cache
2026-03-26 22:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b349ff55-7466-590b-bffd-73237a1ae400
2026-03-26 22:46:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b777a090>
2026-03-26 22:46:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b349ff55-7466-590b-bffd-73237a1ae400/b349ff55-7466-590b-bffd-73237a1ae400_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F33bb4cf5d1084472a2bc6e8d869f8614%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/33bb4cf5d1084472a2bc6e8d869f8614/images/large/10.jpg saved to cache
2026-03-26 22:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b349ff55-7466-590b-bffd-73237a1ae400
2026-03-26 22:46:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79f0350>
2026-03-26 22:46:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b349ff55-7466-590b-bffd-73237a1ae400/b349ff55-7466-590b-bffd-73237a1ae400_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F33bb4cf5d1084472a2bc6e8d869f8614%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/33bb4cf5d1084472a2bc6e8d869f8614/images/large/8.jpg saved to cache
2026-03-26 22:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b349ff55-7466-590b-bffd-73237a1ae400
2026-03-26 22:46:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b349ff55-7466-590b-bffd-73237a1ae400, skipping ID generation
2026-03-26 22:46:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b349ff55-7466-590b-bffd-73237a1ae400 with scrape type 1
2026-03-26 22:46:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b349ff55-7466-590b-bffd-73237a1ae400 sending to next pipeline
2026-03-26 22:46:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b349ff55-7466-590b-bffd-73237a1ae400, identifier: 1986057
2026-03-26 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F6a069b24116e4224a8830ae208926fb6%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/6a069b24116e4224a8830ae208926fb6/images/large/3.jpg not downloaded yet
2026-03-26 22:46:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b349ff55-7466-590b-bffd-73237a1ae400 with identifier: 1986057
2026-03-26 22:46:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b349ff55-7466-590b-bffd-73237a1ae400 with identifier: 1986057
2026-03-26 22:46:19 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b349ff55-7466-590b-bffd-73237a1ae400 with identifier: 1986057 to the API
2026-03-26 22:46:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:46:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:46:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bl/33bb4cf5d1084472a2bc6e8d869f8614/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'b349ff55-7466-590b-bffd-73237a1ae400',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '1 SERIES HATCH',
 'odometer': 108100,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b349ff55-7466-590b-bffd-73237a1ae400/b349ff55-7466-590b-bffd-73237a1ae400_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 698510,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/33bb4cf5d1084472a2bc6e8d869f8614/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b349ff55-7466-590b-bffd-73237a1ae400/b349ff55-7466-590b-bffd-73237a1ae400_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 727218,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/33bb4cf5d1084472a2bc6e8d869f8614/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b349ff55-7466-590b-bffd-73237a1ae400/b349ff55-7466-590b-bffd-73237a1ae400_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 707100,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/33bb4cf5d1084472a2bc6e8d869f8614/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b349ff55-7466-590b-bffd-73237a1ae400/b349ff55-7466-590b-bffd-73237a1ae400_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 720354,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/33bb4cf5d1084472a2bc6e8d869f8614/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b349ff55-7466-590b-bffd-73237a1ae400/b349ff55-7466-590b-bffd-73237a1ae400_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 692289,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/33bb4cf5d1084472a2bc6e8d869f8614/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b349ff55-7466-590b-bffd-73237a1ae400/b349ff55-7466-590b-bffd-73237a1ae400_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 752409,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/33bb4cf5d1084472a2bc6e8d869f8614/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b349ff55-7466-590b-bffd-73237a1ae400/b349ff55-7466-590b-bffd-73237a1ae400_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 626303,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/33bb4cf5d1084472a2bc6e8d869f8614/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b349ff55-7466-590b-bffd-73237a1ae400/b349ff55-7466-590b-bffd-73237a1ae400_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 858959,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/33bb4cf5d1084472a2bc6e8d869f8614/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b349ff55-7466-590b-bffd-73237a1ae400/b349ff55-7466-590b-bffd-73237a1ae400_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 883598,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/33bb4cf5d1084472a2bc6e8d869f8614/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b349ff55-7466-590b-bffd-73237a1ae400/b349ff55-7466-590b-bffd-73237a1ae400_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 883598,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/33bb4cf5d1084472a2bc6e8d869f8614/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1 SERIES HATCH 1.5 116D (85KW)',
 'transmission': 'manual',
 'trim': '1.5 116D (85KW)',
 'vin': None,
 'year': 2022}
2026-03-26 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986057%27 HTTP/1.1" 200 None
2026-03-26 22:46:19 [ayvens.be] INFO: Saving data for 1986057: {'created_time': 1774565179.857056, 'last_price_update_time': 1774565179.857065, 'auction_closing_time': 1775028600.0}
2026-03-26 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986057') HTTP/1.1" 204 0
2026-03-26 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F6a069b24116e4224a8830ae208926fb6%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/6a069b24116e4224a8830ae208926fb6/images/large/4.jpg not downloaded yet
2026-03-26 22:46:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6defa50>
2026-03-26 22:46:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a03492f-3c74-5a66-9455-28bf6cc089f5/9a03492f-3c74-5a66-9455-28bf6cc089f5_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F229355a0a9ec49768d725df8f1bf134d%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/229355a0a9ec49768d725df8f1bf134d/images/large/6.jpg saved to cache
2026-03-26 22:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9a03492f-3c74-5a66-9455-28bf6cc089f5
2026-03-26 22:46:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7453990>
2026-03-26 22:46:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a03492f-3c74-5a66-9455-28bf6cc089f5/9a03492f-3c74-5a66-9455-28bf6cc089f5_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F229355a0a9ec49768d725df8f1bf134d%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/229355a0a9ec49768d725df8f1bf134d/images/large/5.jpg saved to cache
2026-03-26 22:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9a03492f-3c74-5a66-9455-28bf6cc089f5
2026-03-26 22:46:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/229355a0a9ec49768d725df8f1bf134d/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/229355a0a9ec49768d725df8f1bf134d/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aa/38f37bdafc5046809f180038daac16aa/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F6a069b24116e4224a8830ae208926fb6%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/6a069b24116e4224a8830ae208926fb6/images/large/5.jpg not downloaded yet
2026-03-26 22:46:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/229355a0a9ec49768d725df8f1bf134d/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/229355a0a9ec49768d725df8f1bf134d/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aa/38f37bdafc5046809f180038daac16aa/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F6a069b24116e4224a8830ae208926fb6%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/6a069b24116e4224a8830ae208926fb6/images/large/6.jpg not downloaded yet
2026-03-26 22:46:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aa/38f37bdafc5046809f180038daac16aa/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aa/38f37bdafc5046809f180038daac16aa/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F6a069b24116e4224a8830ae208926fb6%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/6a069b24116e4224a8830ae208926fb6/images/large/7.jpg not downloaded yet
2026-03-26 22:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F6a069b24116e4224a8830ae208926fb6%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/6a069b24116e4224a8830ae208926fb6/images/large/8.jpg not downloaded yet
2026-03-26 22:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F6a069b24116e4224a8830ae208926fb6%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/6a069b24116e4224a8830ae208926fb6/images/large/9.jpg not downloaded yet
2026-03-26 22:46:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74dfcd0>
2026-03-26 22:46:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a03492f-3c74-5a66-9455-28bf6cc089f5/9a03492f-3c74-5a66-9455-28bf6cc089f5_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F229355a0a9ec49768d725df8f1bf134d%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/229355a0a9ec49768d725df8f1bf134d/images/large/7.jpg saved to cache
2026-03-26 22:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9a03492f-3c74-5a66-9455-28bf6cc089f5
2026-03-26 22:46:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77ea110>
2026-03-26 22:46:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a03492f-3c74-5a66-9455-28bf6cc089f5/9a03492f-3c74-5a66-9455-28bf6cc089f5_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F229355a0a9ec49768d725df8f1bf134d%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/229355a0a9ec49768d725df8f1bf134d/images/large/9.jpg saved to cache
2026-03-26 22:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9a03492f-3c74-5a66-9455-28bf6cc089f5
2026-03-26 22:46:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7768090>
2026-03-26 22:46:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a197201-09a4-5914-9db7-b1acd397848f/6a197201-09a4-5914-9db7-b1acd397848f_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F38f37bdafc5046809f180038daac16aa%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/38f37bdafc5046809f180038daac16aa/images/large/1.jpg saved to cache
2026-03-26 22:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6a197201-09a4-5914-9db7-b1acd397848f
2026-03-26 22:46:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7725410>
2026-03-26 22:46:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a03492f-3c74-5a66-9455-28bf6cc089f5/9a03492f-3c74-5a66-9455-28bf6cc089f5_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F229355a0a9ec49768d725df8f1bf134d%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/229355a0a9ec49768d725df8f1bf134d/images/large/8.jpg saved to cache
2026-03-26 22:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9a03492f-3c74-5a66-9455-28bf6cc089f5
2026-03-26 22:46:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77cbf50>
2026-03-26 22:46:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a03492f-3c74-5a66-9455-28bf6cc089f5/9a03492f-3c74-5a66-9455-28bf6cc089f5_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F229355a0a9ec49768d725df8f1bf134d%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/229355a0a9ec49768d725df8f1bf134d/images/large/10.jpg saved to cache
2026-03-26 22:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9a03492f-3c74-5a66-9455-28bf6cc089f5
2026-03-26 22:46:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9a03492f-3c74-5a66-9455-28bf6cc089f5, skipping ID generation
2026-03-26 22:46:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a03492f-3c74-5a66-9455-28bf6cc089f5 with scrape type 1
2026-03-26 22:46:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9a03492f-3c74-5a66-9455-28bf6cc089f5 sending to next pipeline
2026-03-26 22:46:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 9a03492f-3c74-5a66-9455-28bf6cc089f5, identifier: 1986058
2026-03-26 22:46:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77c9550>
2026-03-26 22:46:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a197201-09a4-5914-9db7-b1acd397848f/6a197201-09a4-5914-9db7-b1acd397848f_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F38f37bdafc5046809f180038daac16aa%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/38f37bdafc5046809f180038daac16aa/images/large/5.jpg saved to cache
2026-03-26 22:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6a197201-09a4-5914-9db7-b1acd397848f
2026-03-26 22:46:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7410090>
2026-03-26 22:46:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a197201-09a4-5914-9db7-b1acd397848f/6a197201-09a4-5914-9db7-b1acd397848f_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F38f37bdafc5046809f180038daac16aa%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/38f37bdafc5046809f180038daac16aa/images/large/4.jpg saved to cache
2026-03-26 22:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6a197201-09a4-5914-9db7-b1acd397848f
2026-03-26 22:46:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7727110>
2026-03-26 22:46:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a197201-09a4-5914-9db7-b1acd397848f/6a197201-09a4-5914-9db7-b1acd397848f_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F38f37bdafc5046809f180038daac16aa%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/38f37bdafc5046809f180038daac16aa/images/large/2.jpg saved to cache
2026-03-26 22:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6a197201-09a4-5914-9db7-b1acd397848f
2026-03-26 22:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F6a069b24116e4224a8830ae208926fb6%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/6a069b24116e4224a8830ae208926fb6/images/large/10.jpg not downloaded yet
2026-03-26 22:46:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 9a03492f-3c74-5a66-9455-28bf6cc089f5 with identifier: 1986058
2026-03-26 22:46:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 9a03492f-3c74-5a66-9455-28bf6cc089f5 with identifier: 1986058
2026-03-26 22:46:21 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 9a03492f-3c74-5a66-9455-28bf6cc089f5 with identifier: 1986058 to the API
2026-03-26 22:46:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:46:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:46:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ab/229355a0a9ec49768d725df8f1bf134d/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'electric',
 'id': '9a03492f-3c74-5a66-9455-28bf6cc089f5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'TESLA',
 'model': 'MODEL 3',
 'odometer': 53759,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 18,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a03492f-3c74-5a66-9455-28bf6cc089f5/9a03492f-3c74-5a66-9455-28bf6cc089f5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 622163,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/229355a0a9ec49768d725df8f1bf134d/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a03492f-3c74-5a66-9455-28bf6cc089f5/9a03492f-3c74-5a66-9455-28bf6cc089f5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 600834,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/229355a0a9ec49768d725df8f1bf134d/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a03492f-3c74-5a66-9455-28bf6cc089f5/9a03492f-3c74-5a66-9455-28bf6cc089f5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 595427,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/229355a0a9ec49768d725df8f1bf134d/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a03492f-3c74-5a66-9455-28bf6cc089f5/9a03492f-3c74-5a66-9455-28bf6cc089f5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 519306,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/229355a0a9ec49768d725df8f1bf134d/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a03492f-3c74-5a66-9455-28bf6cc089f5/9a03492f-3c74-5a66-9455-28bf6cc089f5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 467084,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/229355a0a9ec49768d725df8f1bf134d/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a03492f-3c74-5a66-9455-28bf6cc089f5/9a03492f-3c74-5a66-9455-28bf6cc089f5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 495678,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/229355a0a9ec49768d725df8f1bf134d/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a03492f-3c74-5a66-9455-28bf6cc089f5/9a03492f-3c74-5a66-9455-28bf6cc089f5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 473110,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/229355a0a9ec49768d725df8f1bf134d/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a03492f-3c74-5a66-9455-28bf6cc089f5/9a03492f-3c74-5a66-9455-28bf6cc089f5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 632658,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/229355a0a9ec49768d725df8f1bf134d/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a03492f-3c74-5a66-9455-28bf6cc089f5/9a03492f-3c74-5a66-9455-28bf6cc089f5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 473092,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/229355a0a9ec49768d725df8f1bf134d/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a03492f-3c74-5a66-9455-28bf6cc089f5/9a03492f-3c74-5a66-9455-28bf6cc089f5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 560257,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/229355a0a9ec49768d725df8f1bf134d/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TESLA MODEL 3 BEV 50KWH STANDARD RWD PLUS AUTO',
 'transmission': 'automatic',
 'trim': 'BEV 50KWH STANDARD RWD PLUS AUTO',
 'vin': None,
 'year': 2021}
2026-03-26 22:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986058%27 HTTP/1.1" 200 None
2026-03-26 22:46:21 [ayvens.be] INFO: Saving data for 1986058: {'created_time': 1774565181.371903, 'last_price_update_time': 1774565181.371914, 'auction_closing_time': 1775028600.0}
2026-03-26 22:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986058') HTTP/1.1" 204 0
2026-03-26 22:46:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aa/38f37bdafc5046809f180038daac16aa/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:21 [ayvens.be] INFO: Found listing with ID: 1986061
2026-03-26 22:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986061%27 HTTP/1.1" 200 None
2026-03-26 22:46:21 [ayvens.be] INFO: Scrape type for 1986061: 1
2026-03-26 22:46:21 [ayvens.be] INFO: Extracting data for car ID: 1986061
2026-03-26 22:46:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee42f577-0ba2-553b-8bfb-a6c2fba8c938 with identifier: 1986061
2026-03-26 22:46:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee42f577-0ba2-553b-8bfb-a6c2fba8c938 with scrape type 1
2026-03-26 22:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ee42f577-0ba2-553b-8bfb-a6c2fba8c938
2026-03-26 22:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F3cbf7e66f1f44d54b014615130fd43e9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/3cbf7e66f1f44d54b014615130fd43e9/images/large/1.jpg not downloaded yet
2026-03-26 22:46:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aa/38f37bdafc5046809f180038daac16aa/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F3cbf7e66f1f44d54b014615130fd43e9%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/3cbf7e66f1f44d54b014615130fd43e9/images/large/2.jpg not downloaded yet
2026-03-26 22:46:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aa/38f37bdafc5046809f180038daac16aa/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aa/38f37bdafc5046809f180038daac16aa/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/6a069b24116e4224a8830ae208926fb6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F3cbf7e66f1f44d54b014615130fd43e9%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/3cbf7e66f1f44d54b014615130fd43e9/images/large/3.jpg not downloaded yet
2026-03-26 22:46:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aa/38f37bdafc5046809f180038daac16aa/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/6a069b24116e4224a8830ae208926fb6/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F3cbf7e66f1f44d54b014615130fd43e9%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/3cbf7e66f1f44d54b014615130fd43e9/images/large/4.jpg not downloaded yet
2026-03-26 22:46:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7925d90>
2026-03-26 22:46:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a197201-09a4-5914-9db7-b1acd397848f/6a197201-09a4-5914-9db7-b1acd397848f_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F38f37bdafc5046809f180038daac16aa%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/38f37bdafc5046809f180038daac16aa/images/large/10.jpg saved to cache
2026-03-26 22:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6a197201-09a4-5914-9db7-b1acd397848f
2026-03-26 22:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F3cbf7e66f1f44d54b014615130fd43e9%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/3cbf7e66f1f44d54b014615130fd43e9/images/large/5.jpg not downloaded yet
2026-03-26 22:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F3cbf7e66f1f44d54b014615130fd43e9%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/3cbf7e66f1f44d54b014615130fd43e9/images/large/6.jpg not downloaded yet
2026-03-26 22:46:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7571fd0>
2026-03-26 22:46:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a197201-09a4-5914-9db7-b1acd397848f/6a197201-09a4-5914-9db7-b1acd397848f_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F38f37bdafc5046809f180038daac16aa%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/38f37bdafc5046809f180038daac16aa/images/large/7.jpg saved to cache
2026-03-26 22:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6a197201-09a4-5914-9db7-b1acd397848f
2026-03-26 22:46:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cc8a10>
2026-03-26 22:46:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a197201-09a4-5914-9db7-b1acd397848f/6a197201-09a4-5914-9db7-b1acd397848f_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F38f37bdafc5046809f180038daac16aa%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/38f37bdafc5046809f180038daac16aa/images/large/9.jpg saved to cache
2026-03-26 22:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6a197201-09a4-5914-9db7-b1acd397848f
2026-03-26 22:46:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b725cb90>
2026-03-26 22:46:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a197201-09a4-5914-9db7-b1acd397848f/6a197201-09a4-5914-9db7-b1acd397848f_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F38f37bdafc5046809f180038daac16aa%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/38f37bdafc5046809f180038daac16aa/images/large/6.jpg saved to cache
2026-03-26 22:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6a197201-09a4-5914-9db7-b1acd397848f
2026-03-26 22:46:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b782f650>
2026-03-26 22:46:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3e5ac1e-7a7e-554b-b75c-63b3f5a59935/a3e5ac1e-7a7e-554b-b75c-63b3f5a59935_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F6a069b24116e4224a8830ae208926fb6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/6a069b24116e4224a8830ae208926fb6/images/large/1.jpg saved to cache
2026-03-26 22:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a3e5ac1e-7a7e-554b-b75c-63b3f5a59935
2026-03-26 22:46:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7648410>
2026-03-26 22:46:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a197201-09a4-5914-9db7-b1acd397848f/6a197201-09a4-5914-9db7-b1acd397848f_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F38f37bdafc5046809f180038daac16aa%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/38f37bdafc5046809f180038daac16aa/images/large/3.jpg saved to cache
2026-03-26 22:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6a197201-09a4-5914-9db7-b1acd397848f
2026-03-26 22:46:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b75722d0>
2026-03-26 22:46:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3e5ac1e-7a7e-554b-b75c-63b3f5a59935/a3e5ac1e-7a7e-554b-b75c-63b3f5a59935_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F6a069b24116e4224a8830ae208926fb6%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/6a069b24116e4224a8830ae208926fb6/images/large/2.jpg saved to cache
2026-03-26 22:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a3e5ac1e-7a7e-554b-b75c-63b3f5a59935
2026-03-26 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F3cbf7e66f1f44d54b014615130fd43e9%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/3cbf7e66f1f44d54b014615130fd43e9/images/large/7.jpg not downloaded yet
2026-03-26 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F3cbf7e66f1f44d54b014615130fd43e9%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/3cbf7e66f1f44d54b014615130fd43e9/images/large/8.jpg not downloaded yet
2026-03-26 22:46:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/6a069b24116e4224a8830ae208926fb6/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F3cbf7e66f1f44d54b014615130fd43e9%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/3cbf7e66f1f44d54b014615130fd43e9/images/large/9.jpg not downloaded yet
2026-03-26 22:46:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/6a069b24116e4224a8830ae208926fb6/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/6a069b24116e4224a8830ae208926fb6/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/6a069b24116e4224a8830ae208926fb6/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/6a069b24116e4224a8830ae208926fb6/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F3cbf7e66f1f44d54b014615130fd43e9%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/3cbf7e66f1f44d54b014615130fd43e9/images/large/10.jpg not downloaded yet
2026-03-26 22:46:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/6a069b24116e4224a8830ae208926fb6/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/6a069b24116e4224a8830ae208926fb6/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:22 [ayvens.be] INFO: Found listing with ID: 1986062
2026-03-26 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986062%27 HTTP/1.1" 200 None
2026-03-26 22:46:22 [ayvens.be] INFO: Scrape type for 1986062: 1
2026-03-26 22:46:22 [ayvens.be] INFO: Extracting data for car ID: 1986062
2026-03-26 22:46:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a8bce15d-0997-5ef0-a16b-be412ce756f4 with identifier: 1986062
2026-03-26 22:46:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8bce15d-0997-5ef0-a16b-be412ce756f4 with scrape type 1
2026-03-26 22:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a8bce15d-0997-5ef0-a16b-be412ce756f4
2026-03-26 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wr%252Faa13ca66598b4635810c47ecb6c0fcf3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wr/aa13ca66598b4635810c47ecb6c0fcf3/images/large/1.jpg not downloaded yet
2026-03-26 22:46:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aa/38f37bdafc5046809f180038daac16aa/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wr%252Faa13ca66598b4635810c47ecb6c0fcf3%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wr/aa13ca66598b4635810c47ecb6c0fcf3/images/large/2.jpg not downloaded yet
2026-03-26 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wr%252Faa13ca66598b4635810c47ecb6c0fcf3%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wr/aa13ca66598b4635810c47ecb6c0fcf3/images/large/3.jpg not downloaded yet
2026-03-26 22:46:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e1e790>
2026-03-26 22:46:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3e5ac1e-7a7e-554b-b75c-63b3f5a59935/a3e5ac1e-7a7e-554b-b75c-63b3f5a59935_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F6a069b24116e4224a8830ae208926fb6%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/6a069b24116e4224a8830ae208926fb6/images/large/7.jpg saved to cache
2026-03-26 22:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a3e5ac1e-7a7e-554b-b75c-63b3f5a59935
2026-03-26 22:46:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76886d0>
2026-03-26 22:46:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3e5ac1e-7a7e-554b-b75c-63b3f5a59935/a3e5ac1e-7a7e-554b-b75c-63b3f5a59935_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F6a069b24116e4224a8830ae208926fb6%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/6a069b24116e4224a8830ae208926fb6/images/large/4.jpg saved to cache
2026-03-26 22:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a3e5ac1e-7a7e-554b-b75c-63b3f5a59935
2026-03-26 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wr%252Faa13ca66598b4635810c47ecb6c0fcf3%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wr/aa13ca66598b4635810c47ecb6c0fcf3/images/large/4.jpg not downloaded yet
2026-03-26 22:46:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/6a069b24116e4224a8830ae208926fb6/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79dcbd0>
2026-03-26 22:46:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3e5ac1e-7a7e-554b-b75c-63b3f5a59935/a3e5ac1e-7a7e-554b-b75c-63b3f5a59935_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F6a069b24116e4224a8830ae208926fb6%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/6a069b24116e4224a8830ae208926fb6/images/large/5.jpg saved to cache
2026-03-26 22:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a3e5ac1e-7a7e-554b-b75c-63b3f5a59935
2026-03-26 22:46:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd0d3c10>
2026-03-26 22:46:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3e5ac1e-7a7e-554b-b75c-63b3f5a59935/a3e5ac1e-7a7e-554b-b75c-63b3f5a59935_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F6a069b24116e4224a8830ae208926fb6%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/6a069b24116e4224a8830ae208926fb6/images/large/9.jpg saved to cache
2026-03-26 22:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a3e5ac1e-7a7e-554b-b75c-63b3f5a59935
2026-03-26 22:46:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e35410>
2026-03-26 22:46:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3e5ac1e-7a7e-554b-b75c-63b3f5a59935/a3e5ac1e-7a7e-554b-b75c-63b3f5a59935_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F6a069b24116e4224a8830ae208926fb6%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/6a069b24116e4224a8830ae208926fb6/images/large/8.jpg saved to cache
2026-03-26 22:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a3e5ac1e-7a7e-554b-b75c-63b3f5a59935
2026-03-26 22:46:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7405850>
2026-03-26 22:46:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3e5ac1e-7a7e-554b-b75c-63b3f5a59935/a3e5ac1e-7a7e-554b-b75c-63b3f5a59935_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F6a069b24116e4224a8830ae208926fb6%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/6a069b24116e4224a8830ae208926fb6/images/large/3.jpg saved to cache
2026-03-26 22:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a3e5ac1e-7a7e-554b-b75c-63b3f5a59935
2026-03-26 22:46:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7ccc690>
2026-03-26 22:46:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3e5ac1e-7a7e-554b-b75c-63b3f5a59935/a3e5ac1e-7a7e-554b-b75c-63b3f5a59935_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F6a069b24116e4224a8830ae208926fb6%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/6a069b24116e4224a8830ae208926fb6/images/large/6.jpg saved to cache
2026-03-26 22:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a3e5ac1e-7a7e-554b-b75c-63b3f5a59935
2026-03-26 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wr%252Faa13ca66598b4635810c47ecb6c0fcf3%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wr/aa13ca66598b4635810c47ecb6c0fcf3/images/large/5.jpg not downloaded yet
2026-03-26 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wr%252Faa13ca66598b4635810c47ecb6c0fcf3%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wr/aa13ca66598b4635810c47ecb6c0fcf3/images/large/6.jpg not downloaded yet
2026-03-26 22:46:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7458810>
2026-03-26 22:46:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a197201-09a4-5914-9db7-b1acd397848f/6a197201-09a4-5914-9db7-b1acd397848f_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F38f37bdafc5046809f180038daac16aa%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/38f37bdafc5046809f180038daac16aa/images/large/8.jpg saved to cache
2026-03-26 22:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6a197201-09a4-5914-9db7-b1acd397848f
2026-03-26 22:46:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6a197201-09a4-5914-9db7-b1acd397848f, skipping ID generation
2026-03-26 22:46:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a197201-09a4-5914-9db7-b1acd397848f with scrape type 1
2026-03-26 22:46:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6a197201-09a4-5914-9db7-b1acd397848f sending to next pipeline
2026-03-26 22:46:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 6a197201-09a4-5914-9db7-b1acd397848f, identifier: 1986059
2026-03-26 22:46:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6df2550>
2026-03-26 22:46:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3e5ac1e-7a7e-554b-b75c-63b3f5a59935/a3e5ac1e-7a7e-554b-b75c-63b3f5a59935_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F6a069b24116e4224a8830ae208926fb6%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/6a069b24116e4224a8830ae208926fb6/images/large/10.jpg saved to cache
2026-03-26 22:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a3e5ac1e-7a7e-554b-b75c-63b3f5a59935
2026-03-26 22:46:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a3e5ac1e-7a7e-554b-b75c-63b3f5a59935, skipping ID generation
2026-03-26 22:46:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3e5ac1e-7a7e-554b-b75c-63b3f5a59935 with scrape type 1
2026-03-26 22:46:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a3e5ac1e-7a7e-554b-b75c-63b3f5a59935 sending to next pipeline
2026-03-26 22:46:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a3e5ac1e-7a7e-554b-b75c-63b3f5a59935, identifier: 1986060
2026-03-26 22:46:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/3cbf7e66f1f44d54b014615130fd43e9/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/3cbf7e66f1f44d54b014615130fd43e9/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 6a197201-09a4-5914-9db7-b1acd397848f with identifier: 1986059
2026-03-26 22:46:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 6a197201-09a4-5914-9db7-b1acd397848f with identifier: 1986059
2026-03-26 22:46:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 6a197201-09a4-5914-9db7-b1acd397848f with identifier: 1986059 to the API
2026-03-26 22:46:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:46:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:46:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2aa/38f37bdafc5046809f180038daac16aa/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '6a197201-09a4-5914-9db7-b1acd397848f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 107928,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a197201-09a4-5914-9db7-b1acd397848f/6a197201-09a4-5914-9db7-b1acd397848f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 421340,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aa/38f37bdafc5046809f180038daac16aa/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a197201-09a4-5914-9db7-b1acd397848f/6a197201-09a4-5914-9db7-b1acd397848f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 500283,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aa/38f37bdafc5046809f180038daac16aa/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a197201-09a4-5914-9db7-b1acd397848f/6a197201-09a4-5914-9db7-b1acd397848f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 476817,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aa/38f37bdafc5046809f180038daac16aa/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a197201-09a4-5914-9db7-b1acd397848f/6a197201-09a4-5914-9db7-b1acd397848f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 496482,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aa/38f37bdafc5046809f180038daac16aa/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a197201-09a4-5914-9db7-b1acd397848f/6a197201-09a4-5914-9db7-b1acd397848f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 347735,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aa/38f37bdafc5046809f180038daac16aa/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a197201-09a4-5914-9db7-b1acd397848f/6a197201-09a4-5914-9db7-b1acd397848f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 365683,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aa/38f37bdafc5046809f180038daac16aa/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a197201-09a4-5914-9db7-b1acd397848f/6a197201-09a4-5914-9db7-b1acd397848f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 430440,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aa/38f37bdafc5046809f180038daac16aa/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a197201-09a4-5914-9db7-b1acd397848f/6a197201-09a4-5914-9db7-b1acd397848f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 427192,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aa/38f37bdafc5046809f180038daac16aa/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a197201-09a4-5914-9db7-b1acd397848f/6a197201-09a4-5914-9db7-b1acd397848f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 331027,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aa/38f37bdafc5046809f180038daac16aa/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a197201-09a4-5914-9db7-b1acd397848f/6a197201-09a4-5914-9db7-b1acd397848f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 323500,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aa/38f37bdafc5046809f180038daac16aa/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 2.0 SDRIVE18D (100KW)',
 'transmission': 'manual',
 'trim': '2.0 SDRIVE18D (100KW)',
 'vin': None,
 'year': 2021}
2026-03-26 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986059%27 HTTP/1.1" 200 None
2026-03-26 22:46:23 [ayvens.be] INFO: Saving data for 1986059: {'created_time': 1774565183.88021, 'last_price_update_time': 1774565183.88022, 'auction_closing_time': 1775028600.0}
2026-03-26 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986059') HTTP/1.1" 204 0
2026-03-26 22:46:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a3e5ac1e-7a7e-554b-b75c-63b3f5a59935 with identifier: 1986060
2026-03-26 22:46:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a3e5ac1e-7a7e-554b-b75c-63b3f5a59935 with identifier: 1986060
2026-03-26 22:46:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a3e5ac1e-7a7e-554b-b75c-63b3f5a59935 with identifier: 1986060 to the API
2026-03-26 22:46:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:46:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:46:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ac/6a069b24116e4224a8830ae208926fb6/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'a3e5ac1e-7a7e-554b-b75c-63b3f5a59935',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '1 SERIES HATCH',
 'odometer': 57131,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3e5ac1e-7a7e-554b-b75c-63b3f5a59935/a3e5ac1e-7a7e-554b-b75c-63b3f5a59935_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 537799,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/6a069b24116e4224a8830ae208926fb6/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3e5ac1e-7a7e-554b-b75c-63b3f5a59935/a3e5ac1e-7a7e-554b-b75c-63b3f5a59935_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 450409,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/6a069b24116e4224a8830ae208926fb6/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3e5ac1e-7a7e-554b-b75c-63b3f5a59935/a3e5ac1e-7a7e-554b-b75c-63b3f5a59935_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 509583,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/6a069b24116e4224a8830ae208926fb6/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3e5ac1e-7a7e-554b-b75c-63b3f5a59935/a3e5ac1e-7a7e-554b-b75c-63b3f5a59935_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 593667,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/6a069b24116e4224a8830ae208926fb6/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3e5ac1e-7a7e-554b-b75c-63b3f5a59935/a3e5ac1e-7a7e-554b-b75c-63b3f5a59935_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 415371,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/6a069b24116e4224a8830ae208926fb6/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3e5ac1e-7a7e-554b-b75c-63b3f5a59935/a3e5ac1e-7a7e-554b-b75c-63b3f5a59935_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 412840,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/6a069b24116e4224a8830ae208926fb6/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3e5ac1e-7a7e-554b-b75c-63b3f5a59935/a3e5ac1e-7a7e-554b-b75c-63b3f5a59935_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 561074,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/6a069b24116e4224a8830ae208926fb6/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3e5ac1e-7a7e-554b-b75c-63b3f5a59935/a3e5ac1e-7a7e-554b-b75c-63b3f5a59935_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 377055,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/6a069b24116e4224a8830ae208926fb6/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3e5ac1e-7a7e-554b-b75c-63b3f5a59935/a3e5ac1e-7a7e-554b-b75c-63b3f5a59935_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 357821,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/6a069b24116e4224a8830ae208926fb6/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3e5ac1e-7a7e-554b-b75c-63b3f5a59935/a3e5ac1e-7a7e-554b-b75c-63b3f5a59935_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 260766,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/6a069b24116e4224a8830ae208926fb6/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1 SERIES HATCH 1.5 118I (100KW)',
 'transmission': 'manual',
 'trim': '1.5 118I (100KW)',
 'vin': None,
 'year': 2021}
2026-03-26 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986060%27 HTTP/1.1" 200 None
2026-03-26 22:46:24 [ayvens.be] INFO: Saving data for 1986060: {'created_time': 1774565184.276873, 'last_price_update_time': 1774565184.276883, 'auction_closing_time': 1775028600.0}
2026-03-26 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986060') HTTP/1.1" 204 0
2026-03-26 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wr%252Faa13ca66598b4635810c47ecb6c0fcf3%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wr/aa13ca66598b4635810c47ecb6c0fcf3/images/large/7.jpg not downloaded yet
2026-03-26 22:46:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/3cbf7e66f1f44d54b014615130fd43e9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/3cbf7e66f1f44d54b014615130fd43e9/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wr%252Faa13ca66598b4635810c47ecb6c0fcf3%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wr/aa13ca66598b4635810c47ecb6c0fcf3/images/large/8.jpg not downloaded yet
2026-03-26 22:46:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b72fd510>
2026-03-26 22:46:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee42f577-0ba2-553b-8bfb-a6c2fba8c938/ee42f577-0ba2-553b-8bfb-a6c2fba8c938_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F3cbf7e66f1f44d54b014615130fd43e9%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/3cbf7e66f1f44d54b014615130fd43e9/images/large/3.jpg saved to cache
2026-03-26 22:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ee42f577-0ba2-553b-8bfb-a6c2fba8c938
2026-03-26 22:46:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7564650>
2026-03-26 22:46:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee42f577-0ba2-553b-8bfb-a6c2fba8c938/ee42f577-0ba2-553b-8bfb-a6c2fba8c938_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F3cbf7e66f1f44d54b014615130fd43e9%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/3cbf7e66f1f44d54b014615130fd43e9/images/large/4.jpg saved to cache
2026-03-26 22:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ee42f577-0ba2-553b-8bfb-a6c2fba8c938
2026-03-26 22:46:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/3cbf7e66f1f44d54b014615130fd43e9/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/3cbf7e66f1f44d54b014615130fd43e9/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/3cbf7e66f1f44d54b014615130fd43e9/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wr%252Faa13ca66598b4635810c47ecb6c0fcf3%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wr/aa13ca66598b4635810c47ecb6c0fcf3/images/large/9.jpg not downloaded yet
2026-03-26 22:46:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c68110>
2026-03-26 22:46:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee42f577-0ba2-553b-8bfb-a6c2fba8c938/ee42f577-0ba2-553b-8bfb-a6c2fba8c938_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F3cbf7e66f1f44d54b014615130fd43e9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/3cbf7e66f1f44d54b014615130fd43e9/images/large/1.jpg saved to cache
2026-03-26 22:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ee42f577-0ba2-553b-8bfb-a6c2fba8c938
2026-03-26 22:46:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76e1210>
2026-03-26 22:46:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee42f577-0ba2-553b-8bfb-a6c2fba8c938/ee42f577-0ba2-553b-8bfb-a6c2fba8c938_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F3cbf7e66f1f44d54b014615130fd43e9%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/3cbf7e66f1f44d54b014615130fd43e9/images/large/6.jpg saved to cache
2026-03-26 22:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ee42f577-0ba2-553b-8bfb-a6c2fba8c938
2026-03-26 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wr%252Faa13ca66598b4635810c47ecb6c0fcf3%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wr/aa13ca66598b4635810c47ecb6c0fcf3/images/large/10.jpg not downloaded yet
2026-03-26 22:46:24 [ayvens.be] INFO: Found listing with ID: 1986063
2026-03-26 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986063%27 HTTP/1.1" 200 None
2026-03-26 22:46:24 [ayvens.be] INFO: Scrape type for 1986063: 1
2026-03-26 22:46:24 [ayvens.be] INFO: Extracting data for car ID: 1986063
2026-03-26 22:46:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54368680-60a6-5d28-a06b-cee42607ebff with identifier: 1986063
2026-03-26 22:46:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54368680-60a6-5d28-a06b-cee42607ebff with scrape type 1
2026-03-26 22:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 54368680-60a6-5d28-a06b-cee42607ebff
2026-03-26 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Ffc8446bbc2a54b868ff39327af630dab%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/fc8446bbc2a54b868ff39327af630dab/images/large/1.jpg not downloaded yet
2026-03-26 22:46:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7648c90>
2026-03-26 22:46:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee42f577-0ba2-553b-8bfb-a6c2fba8c938/ee42f577-0ba2-553b-8bfb-a6c2fba8c938_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F3cbf7e66f1f44d54b014615130fd43e9%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/3cbf7e66f1f44d54b014615130fd43e9/images/large/7.jpg saved to cache
2026-03-26 22:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ee42f577-0ba2-553b-8bfb-a6c2fba8c938
2026-03-26 22:46:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e29050>
2026-03-26 22:46:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee42f577-0ba2-553b-8bfb-a6c2fba8c938/ee42f577-0ba2-553b-8bfb-a6c2fba8c938_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F3cbf7e66f1f44d54b014615130fd43e9%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/3cbf7e66f1f44d54b014615130fd43e9/images/large/2.jpg saved to cache
2026-03-26 22:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ee42f577-0ba2-553b-8bfb-a6c2fba8c938
2026-03-26 22:46:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b726b610>
2026-03-26 22:46:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee42f577-0ba2-553b-8bfb-a6c2fba8c938/ee42f577-0ba2-553b-8bfb-a6c2fba8c938_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F3cbf7e66f1f44d54b014615130fd43e9%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/3cbf7e66f1f44d54b014615130fd43e9/images/large/5.jpg saved to cache
2026-03-26 22:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ee42f577-0ba2-553b-8bfb-a6c2fba8c938
2026-03-26 22:46:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/3cbf7e66f1f44d54b014615130fd43e9/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Ffc8446bbc2a54b868ff39327af630dab%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/fc8446bbc2a54b868ff39327af630dab/images/large/2.jpg not downloaded yet
2026-03-26 22:46:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/3cbf7e66f1f44d54b014615130fd43e9/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Ffc8446bbc2a54b868ff39327af630dab%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/fc8446bbc2a54b868ff39327af630dab/images/large/3.jpg not downloaded yet
2026-03-26 22:46:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/3cbf7e66f1f44d54b014615130fd43e9/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Ffc8446bbc2a54b868ff39327af630dab%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/fc8446bbc2a54b868ff39327af630dab/images/large/4.jpg not downloaded yet
2026-03-26 22:46:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wr/aa13ca66598b4635810c47ecb6c0fcf3/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Ffc8446bbc2a54b868ff39327af630dab%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/fc8446bbc2a54b868ff39327af630dab/images/large/5.jpg not downloaded yet
2026-03-26 22:46:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wr/aa13ca66598b4635810c47ecb6c0fcf3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Ffc8446bbc2a54b868ff39327af630dab%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/fc8446bbc2a54b868ff39327af630dab/images/large/6.jpg not downloaded yet
2026-03-26 22:46:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wr/aa13ca66598b4635810c47ecb6c0fcf3/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wr/aa13ca66598b4635810c47ecb6c0fcf3/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e01750>
2026-03-26 22:46:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee42f577-0ba2-553b-8bfb-a6c2fba8c938/ee42f577-0ba2-553b-8bfb-a6c2fba8c938_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F3cbf7e66f1f44d54b014615130fd43e9%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/3cbf7e66f1f44d54b014615130fd43e9/images/large/8.jpg saved to cache
2026-03-26 22:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ee42f577-0ba2-553b-8bfb-a6c2fba8c938
2026-03-26 22:46:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wr/aa13ca66598b4635810c47ecb6c0fcf3/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Ffc8446bbc2a54b868ff39327af630dab%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/fc8446bbc2a54b868ff39327af630dab/images/large/7.jpg not downloaded yet
2026-03-26 22:46:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b75a7dd0>
2026-03-26 22:46:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee42f577-0ba2-553b-8bfb-a6c2fba8c938/ee42f577-0ba2-553b-8bfb-a6c2fba8c938_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F3cbf7e66f1f44d54b014615130fd43e9%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/3cbf7e66f1f44d54b014615130fd43e9/images/large/10.jpg saved to cache
2026-03-26 22:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ee42f577-0ba2-553b-8bfb-a6c2fba8c938
2026-03-26 22:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Ffc8446bbc2a54b868ff39327af630dab%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/fc8446bbc2a54b868ff39327af630dab/images/large/8.jpg not downloaded yet
2026-03-26 22:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Ffc8446bbc2a54b868ff39327af630dab%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/fc8446bbc2a54b868ff39327af630dab/images/large/9.jpg not downloaded yet
2026-03-26 22:46:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7452810>
2026-03-26 22:46:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee42f577-0ba2-553b-8bfb-a6c2fba8c938/ee42f577-0ba2-553b-8bfb-a6c2fba8c938_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F3cbf7e66f1f44d54b014615130fd43e9%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/3cbf7e66f1f44d54b014615130fd43e9/images/large/9.jpg saved to cache
2026-03-26 22:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ee42f577-0ba2-553b-8bfb-a6c2fba8c938
2026-03-26 22:46:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ee42f577-0ba2-553b-8bfb-a6c2fba8c938, skipping ID generation
2026-03-26 22:46:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee42f577-0ba2-553b-8bfb-a6c2fba8c938 with scrape type 1
2026-03-26 22:46:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ee42f577-0ba2-553b-8bfb-a6c2fba8c938 sending to next pipeline
2026-03-26 22:46:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: ee42f577-0ba2-553b-8bfb-a6c2fba8c938, identifier: 1986061
2026-03-26 22:46:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7290dd0>
2026-03-26 22:46:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8bce15d-0997-5ef0-a16b-be412ce756f4/a8bce15d-0997-5ef0-a16b-be412ce756f4_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wr%252Faa13ca66598b4635810c47ecb6c0fcf3%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wr/aa13ca66598b4635810c47ecb6c0fcf3/images/large/2.jpg saved to cache
2026-03-26 22:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a8bce15d-0997-5ef0-a16b-be412ce756f4
2026-03-26 22:46:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd9ce550>
2026-03-26 22:46:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8bce15d-0997-5ef0-a16b-be412ce756f4/a8bce15d-0997-5ef0-a16b-be412ce756f4_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wr%252Faa13ca66598b4635810c47ecb6c0fcf3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wr/aa13ca66598b4635810c47ecb6c0fcf3/images/large/1.jpg saved to cache
2026-03-26 22:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a8bce15d-0997-5ef0-a16b-be412ce756f4
2026-03-26 22:46:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b17c90>
2026-03-26 22:46:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8bce15d-0997-5ef0-a16b-be412ce756f4/a8bce15d-0997-5ef0-a16b-be412ce756f4_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wr%252Faa13ca66598b4635810c47ecb6c0fcf3%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wr/aa13ca66598b4635810c47ecb6c0fcf3/images/large/5.jpg saved to cache
2026-03-26 22:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a8bce15d-0997-5ef0-a16b-be412ce756f4
2026-03-26 22:46:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74bf190>
2026-03-26 22:46:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8bce15d-0997-5ef0-a16b-be412ce756f4/a8bce15d-0997-5ef0-a16b-be412ce756f4_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wr%252Faa13ca66598b4635810c47ecb6c0fcf3%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wr/aa13ca66598b4635810c47ecb6c0fcf3/images/large/3.jpg saved to cache
2026-03-26 22:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a8bce15d-0997-5ef0-a16b-be412ce756f4
2026-03-26 22:46:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b764a210>
2026-03-26 22:46:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8bce15d-0997-5ef0-a16b-be412ce756f4/a8bce15d-0997-5ef0-a16b-be412ce756f4_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wr%252Faa13ca66598b4635810c47ecb6c0fcf3%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wr/aa13ca66598b4635810c47ecb6c0fcf3/images/large/4.jpg saved to cache
2026-03-26 22:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a8bce15d-0997-5ef0-a16b-be412ce756f4
2026-03-26 22:46:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: ee42f577-0ba2-553b-8bfb-a6c2fba8c938 with identifier: 1986061
2026-03-26 22:46:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: ee42f577-0ba2-553b-8bfb-a6c2fba8c938 with identifier: 1986061
2026-03-26 22:46:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: ee42f577-0ba2-553b-8bfb-a6c2fba8c938 with identifier: 1986061 to the API
2026-03-26 22:46:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:46:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:46:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2an/3cbf7e66f1f44d54b014615130fd43e9/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'ee42f577-0ba2-553b-8bfb-a6c2fba8c938',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF VIII',
 'odometer': 79298,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee42f577-0ba2-553b-8bfb-a6c2fba8c938/ee42f577-0ba2-553b-8bfb-a6c2fba8c938_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 622822,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/3cbf7e66f1f44d54b014615130fd43e9/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee42f577-0ba2-553b-8bfb-a6c2fba8c938/ee42f577-0ba2-553b-8bfb-a6c2fba8c938_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 589591,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/3cbf7e66f1f44d54b014615130fd43e9/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee42f577-0ba2-553b-8bfb-a6c2fba8c938/ee42f577-0ba2-553b-8bfb-a6c2fba8c938_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 616917,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/3cbf7e66f1f44d54b014615130fd43e9/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee42f577-0ba2-553b-8bfb-a6c2fba8c938/ee42f577-0ba2-553b-8bfb-a6c2fba8c938_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 633356,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/3cbf7e66f1f44d54b014615130fd43e9/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee42f577-0ba2-553b-8bfb-a6c2fba8c938/ee42f577-0ba2-553b-8bfb-a6c2fba8c938_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 598230,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/3cbf7e66f1f44d54b014615130fd43e9/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee42f577-0ba2-553b-8bfb-a6c2fba8c938/ee42f577-0ba2-553b-8bfb-a6c2fba8c938_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 500098,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/3cbf7e66f1f44d54b014615130fd43e9/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee42f577-0ba2-553b-8bfb-a6c2fba8c938/ee42f577-0ba2-553b-8bfb-a6c2fba8c938_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 631750,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/3cbf7e66f1f44d54b014615130fd43e9/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee42f577-0ba2-553b-8bfb-a6c2fba8c938/ee42f577-0ba2-553b-8bfb-a6c2fba8c938_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 654605,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/3cbf7e66f1f44d54b014615130fd43e9/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee42f577-0ba2-553b-8bfb-a6c2fba8c938/ee42f577-0ba2-553b-8bfb-a6c2fba8c938_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 536852,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/3cbf7e66f1f44d54b014615130fd43e9/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee42f577-0ba2-553b-8bfb-a6c2fba8c938/ee42f577-0ba2-553b-8bfb-a6c2fba8c938_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 580933,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/3cbf7e66f1f44d54b014615130fd43e9/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF VIII 1.0 E-TSI 81KW LIFE DSG',
 'transmission': 'automatic',
 'trim': '1.0 E-TSI 81KW LIFE DSG',
 'vin': None,
 'year': 2021}
2026-03-26 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986061%27 HTTP/1.1" 200 None
2026-03-26 22:46:26 [ayvens.be] INFO: Saving data for 1986061: {'created_time': 1774565186.736512, 'last_price_update_time': 1774565186.736521, 'auction_closing_time': 1775028600.0}
2026-03-26 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986061') HTTP/1.1" 204 0
2026-03-26 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Ffc8446bbc2a54b868ff39327af630dab%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/fc8446bbc2a54b868ff39327af630dab/images/large/10.jpg not downloaded yet
2026-03-26 22:46:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wr/aa13ca66598b4635810c47ecb6c0fcf3/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:26 [ayvens.be] INFO: Found listing with ID: 1986064
2026-03-26 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986064%27 HTTP/1.1" 200 None
2026-03-26 22:46:26 [ayvens.be] INFO: Scrape type for 1986064: 1
2026-03-26 22:46:26 [ayvens.be] INFO: Extracting data for car ID: 1986064
2026-03-26 22:46:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9e70a0a4-0868-5521-9cb0-c4cc8d73a330 with identifier: 1986064
2026-03-26 22:46:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e70a0a4-0868-5521-9cb0-c4cc8d73a330 with scrape type 1
2026-03-26 22:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9e70a0a4-0868-5521-9cb0-c4cc8d73a330
2026-03-26 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F0d1ccc92bf1b421792d8e717c46b8553%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/0d1ccc92bf1b421792d8e717c46b8553/images/large/1.jpg not downloaded yet
2026-03-26 22:46:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wr/aa13ca66598b4635810c47ecb6c0fcf3/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F0d1ccc92bf1b421792d8e717c46b8553%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/0d1ccc92bf1b421792d8e717c46b8553/images/large/2.jpg not downloaded yet
2026-03-26 22:46:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wr/aa13ca66598b4635810c47ecb6c0fcf3/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wr/aa13ca66598b4635810c47ecb6c0fcf3/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/fc8446bbc2a54b868ff39327af630dab/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F0d1ccc92bf1b421792d8e717c46b8553%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/0d1ccc92bf1b421792d8e717c46b8553/images/large/3.jpg not downloaded yet
2026-03-26 22:46:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wr/aa13ca66598b4635810c47ecb6c0fcf3/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/fc8446bbc2a54b868ff39327af630dab/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F0d1ccc92bf1b421792d8e717c46b8553%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/0d1ccc92bf1b421792d8e717c46b8553/images/large/4.jpg not downloaded yet
2026-03-26 22:46:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/fc8446bbc2a54b868ff39327af630dab/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F0d1ccc92bf1b421792d8e717c46b8553%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/0d1ccc92bf1b421792d8e717c46b8553/images/large/5.jpg not downloaded yet
2026-03-26 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F0d1ccc92bf1b421792d8e717c46b8553%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/0d1ccc92bf1b421792d8e717c46b8553/images/large/6.jpg not downloaded yet
2026-03-26 22:46:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7725b10>
2026-03-26 22:46:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8bce15d-0997-5ef0-a16b-be412ce756f4/a8bce15d-0997-5ef0-a16b-be412ce756f4_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wr%252Faa13ca66598b4635810c47ecb6c0fcf3%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wr/aa13ca66598b4635810c47ecb6c0fcf3/images/large/7.jpg saved to cache
2026-03-26 22:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a8bce15d-0997-5ef0-a16b-be412ce756f4
2026-03-26 22:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F0d1ccc92bf1b421792d8e717c46b8553%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/0d1ccc92bf1b421792d8e717c46b8553/images/large/7.jpg not downloaded yet
2026-03-26 22:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F0d1ccc92bf1b421792d8e717c46b8553%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/0d1ccc92bf1b421792d8e717c46b8553/images/large/8.jpg not downloaded yet
2026-03-26 22:46:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/fc8446bbc2a54b868ff39327af630dab/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F0d1ccc92bf1b421792d8e717c46b8553%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/0d1ccc92bf1b421792d8e717c46b8553/images/large/9.jpg not downloaded yet
2026-03-26 22:46:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77e9750>
2026-03-26 22:46:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8bce15d-0997-5ef0-a16b-be412ce756f4/a8bce15d-0997-5ef0-a16b-be412ce756f4_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wr%252Faa13ca66598b4635810c47ecb6c0fcf3%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wr/aa13ca66598b4635810c47ecb6c0fcf3/images/large/6.jpg saved to cache
2026-03-26 22:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a8bce15d-0997-5ef0-a16b-be412ce756f4
2026-03-26 22:46:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c97110>
2026-03-26 22:46:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8bce15d-0997-5ef0-a16b-be412ce756f4/a8bce15d-0997-5ef0-a16b-be412ce756f4_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wr%252Faa13ca66598b4635810c47ecb6c0fcf3%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wr/aa13ca66598b4635810c47ecb6c0fcf3/images/large/8.jpg saved to cache
2026-03-26 22:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a8bce15d-0997-5ef0-a16b-be412ce756f4
2026-03-26 22:46:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7409990>
2026-03-26 22:46:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8bce15d-0997-5ef0-a16b-be412ce756f4/a8bce15d-0997-5ef0-a16b-be412ce756f4_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wr%252Faa13ca66598b4635810c47ecb6c0fcf3%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wr/aa13ca66598b4635810c47ecb6c0fcf3/images/large/9.jpg saved to cache
2026-03-26 22:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a8bce15d-0997-5ef0-a16b-be412ce756f4
2026-03-26 22:46:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b741f8d0>
2026-03-26 22:46:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54368680-60a6-5d28-a06b-cee42607ebff/54368680-60a6-5d28-a06b-cee42607ebff_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Ffc8446bbc2a54b868ff39327af630dab%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/fc8446bbc2a54b868ff39327af630dab/images/large/1.jpg saved to cache
2026-03-26 22:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 54368680-60a6-5d28-a06b-cee42607ebff
2026-03-26 22:46:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b98310>
2026-03-26 22:46:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8bce15d-0997-5ef0-a16b-be412ce756f4/a8bce15d-0997-5ef0-a16b-be412ce756f4_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wr%252Faa13ca66598b4635810c47ecb6c0fcf3%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wr/aa13ca66598b4635810c47ecb6c0fcf3/images/large/10.jpg saved to cache
2026-03-26 22:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a8bce15d-0997-5ef0-a16b-be412ce756f4
2026-03-26 22:46:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a8bce15d-0997-5ef0-a16b-be412ce756f4, skipping ID generation
2026-03-26 22:46:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8bce15d-0997-5ef0-a16b-be412ce756f4 with scrape type 1
2026-03-26 22:46:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a8bce15d-0997-5ef0-a16b-be412ce756f4 sending to next pipeline
2026-03-26 22:46:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a8bce15d-0997-5ef0-a16b-be412ce756f4, identifier: 1986062
2026-03-26 22:46:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b72ef5d0>
2026-03-26 22:46:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54368680-60a6-5d28-a06b-cee42607ebff/54368680-60a6-5d28-a06b-cee42607ebff_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Ffc8446bbc2a54b868ff39327af630dab%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/fc8446bbc2a54b868ff39327af630dab/images/large/2.jpg saved to cache
2026-03-26 22:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 54368680-60a6-5d28-a06b-cee42607ebff
2026-03-26 22:46:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7410dd0>
2026-03-26 22:46:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54368680-60a6-5d28-a06b-cee42607ebff/54368680-60a6-5d28-a06b-cee42607ebff_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Ffc8446bbc2a54b868ff39327af630dab%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/fc8446bbc2a54b868ff39327af630dab/images/large/3.jpg saved to cache
2026-03-26 22:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 54368680-60a6-5d28-a06b-cee42607ebff
2026-03-26 22:46:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a8bce15d-0997-5ef0-a16b-be412ce756f4 with identifier: 1986062
2026-03-26 22:46:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a8bce15d-0997-5ef0-a16b-be412ce756f4 with identifier: 1986062
2026-03-26 22:46:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a8bce15d-0997-5ef0-a16b-be412ce756f4 with identifier: 1986062 to the API
2026-03-26 22:46:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:46:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:46:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1wr/aa13ca66598b4635810c47ecb6c0fcf3/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.8L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'a8bce15d-0997-5ef0-a16b-be412ce756f4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'LAND CRUISER LWB DIESEL - 2017',
 'odometer': 110608,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8bce15d-0997-5ef0-a16b-be412ce756f4/a8bce15d-0997-5ef0-a16b-be412ce756f4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 664027,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wr/aa13ca66598b4635810c47ecb6c0fcf3/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8bce15d-0997-5ef0-a16b-be412ce756f4/a8bce15d-0997-5ef0-a16b-be412ce756f4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 652196,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wr/aa13ca66598b4635810c47ecb6c0fcf3/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8bce15d-0997-5ef0-a16b-be412ce756f4/a8bce15d-0997-5ef0-a16b-be412ce756f4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 627868,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wr/aa13ca66598b4635810c47ecb6c0fcf3/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8bce15d-0997-5ef0-a16b-be412ce756f4/a8bce15d-0997-5ef0-a16b-be412ce756f4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 663105,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wr/aa13ca66598b4635810c47ecb6c0fcf3/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8bce15d-0997-5ef0-a16b-be412ce756f4/a8bce15d-0997-5ef0-a16b-be412ce756f4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 637156,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wr/aa13ca66598b4635810c47ecb6c0fcf3/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8bce15d-0997-5ef0-a16b-be412ce756f4/a8bce15d-0997-5ef0-a16b-be412ce756f4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 733479,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wr/aa13ca66598b4635810c47ecb6c0fcf3/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8bce15d-0997-5ef0-a16b-be412ce756f4/a8bce15d-0997-5ef0-a16b-be412ce756f4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 574015,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wr/aa13ca66598b4635810c47ecb6c0fcf3/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8bce15d-0997-5ef0-a16b-be412ce756f4/a8bce15d-0997-5ef0-a16b-be412ce756f4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 692340,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wr/aa13ca66598b4635810c47ecb6c0fcf3/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8bce15d-0997-5ef0-a16b-be412ce756f4/a8bce15d-0997-5ef0-a16b-be412ce756f4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 727596,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wr/aa13ca66598b4635810c47ecb6c0fcf3/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8bce15d-0997-5ef0-a16b-be412ce756f4/a8bce15d-0997-5ef0-a16b-be412ce756f4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 788849,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wr/aa13ca66598b4635810c47ecb6c0fcf3/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA LAND CRUISER LWB DIESEL - 2017 2.8 D-4D BM Transfo Van '
          'Fluxys',
 'transmission': 'manual',
 'trim': '2.8 D-4D BM Transfo Van Fluxys',
 'vin': None,
 'year': 2019}
2026-03-26 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986062%27 HTTP/1.1" 200 None
2026-03-26 22:46:28 [ayvens.be] INFO: Saving data for 1986062: {'created_time': 1774565188.143502, 'last_price_update_time': 1774565188.143513, 'auction_closing_time': 1775028600.0}
2026-03-26 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986062') HTTP/1.1" 204 0
2026-03-26 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F0d1ccc92bf1b421792d8e717c46b8553%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/0d1ccc92bf1b421792d8e717c46b8553/images/large/10.jpg not downloaded yet
2026-03-26 22:46:28 [ayvens.be] INFO: Found listing with ID: 1986065
2026-03-26 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986065%27 HTTP/1.1" 200 None
2026-03-26 22:46:28 [ayvens.be] INFO: Scrape type for 1986065: 1
2026-03-26 22:46:28 [ayvens.be] INFO: Extracting data for car ID: 1986065
2026-03-26 22:46:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97ab8ef2-8f9c-5049-a47a-20d0d7b4ea94 with identifier: 1986065
2026-03-26 22:46:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97ab8ef2-8f9c-5049-a47a-20d0d7b4ea94 with scrape type 1
2026-03-26 22:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 97ab8ef2-8f9c-5049-a47a-20d0d7b4ea94
2026-03-26 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cf%252F4f9616451b3c44c59e92eb0f752ea8ba%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cf/4f9616451b3c44c59e92eb0f752ea8ba/images/large/1.jpg not downloaded yet
2026-03-26 22:46:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b726af10>
2026-03-26 22:46:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54368680-60a6-5d28-a06b-cee42607ebff/54368680-60a6-5d28-a06b-cee42607ebff_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Ffc8446bbc2a54b868ff39327af630dab%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/fc8446bbc2a54b868ff39327af630dab/images/large/4.jpg saved to cache
2026-03-26 22:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 54368680-60a6-5d28-a06b-cee42607ebff
2026-03-26 22:46:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/fc8446bbc2a54b868ff39327af630dab/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/fc8446bbc2a54b868ff39327af630dab/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cl/0d1ccc92bf1b421792d8e717c46b8553/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cf%252F4f9616451b3c44c59e92eb0f752ea8ba%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cf/4f9616451b3c44c59e92eb0f752ea8ba/images/large/2.jpg not downloaded yet
2026-03-26 22:46:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/fc8446bbc2a54b868ff39327af630dab/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/fc8446bbc2a54b868ff39327af630dab/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cf%252F4f9616451b3c44c59e92eb0f752ea8ba%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cf/4f9616451b3c44c59e92eb0f752ea8ba/images/large/3.jpg not downloaded yet
2026-03-26 22:46:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/fc8446bbc2a54b868ff39327af630dab/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cf%252F4f9616451b3c44c59e92eb0f752ea8ba%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cf/4f9616451b3c44c59e92eb0f752ea8ba/images/large/4.jpg not downloaded yet
2026-03-26 22:46:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/fc8446bbc2a54b868ff39327af630dab/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cf%252F4f9616451b3c44c59e92eb0f752ea8ba%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cf/4f9616451b3c44c59e92eb0f752ea8ba/images/large/5.jpg not downloaded yet
2026-03-26 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cf%252F4f9616451b3c44c59e92eb0f752ea8ba%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cf/4f9616451b3c44c59e92eb0f752ea8ba/images/large/6.jpg not downloaded yet
2026-03-26 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cf%252F4f9616451b3c44c59e92eb0f752ea8ba%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cf/4f9616451b3c44c59e92eb0f752ea8ba/images/large/7.jpg not downloaded yet
2026-03-26 22:46:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cl/0d1ccc92bf1b421792d8e717c46b8553/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76ee3d0>
2026-03-26 22:46:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54368680-60a6-5d28-a06b-cee42607ebff/54368680-60a6-5d28-a06b-cee42607ebff_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Ffc8446bbc2a54b868ff39327af630dab%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/fc8446bbc2a54b868ff39327af630dab/images/large/9.jpg saved to cache
2026-03-26 22:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 54368680-60a6-5d28-a06b-cee42607ebff
2026-03-26 22:46:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c75b90>
2026-03-26 22:46:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54368680-60a6-5d28-a06b-cee42607ebff/54368680-60a6-5d28-a06b-cee42607ebff_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Ffc8446bbc2a54b868ff39327af630dab%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/fc8446bbc2a54b868ff39327af630dab/images/large/10.jpg saved to cache
2026-03-26 22:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 54368680-60a6-5d28-a06b-cee42607ebff
2026-03-26 22:46:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74f8e50>
2026-03-26 22:46:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e70a0a4-0868-5521-9cb0-c4cc8d73a330/9e70a0a4-0868-5521-9cb0-c4cc8d73a330_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F0d1ccc92bf1b421792d8e717c46b8553%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/0d1ccc92bf1b421792d8e717c46b8553/images/large/1.jpg saved to cache
2026-03-26 22:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9e70a0a4-0868-5521-9cb0-c4cc8d73a330
2026-03-26 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cf%252F4f9616451b3c44c59e92eb0f752ea8ba%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cf/4f9616451b3c44c59e92eb0f752ea8ba/images/large/8.jpg not downloaded yet
2026-03-26 22:46:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cl/0d1ccc92bf1b421792d8e717c46b8553/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e16ad0>
2026-03-26 22:46:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54368680-60a6-5d28-a06b-cee42607ebff/54368680-60a6-5d28-a06b-cee42607ebff_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Ffc8446bbc2a54b868ff39327af630dab%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/fc8446bbc2a54b868ff39327af630dab/images/large/5.jpg saved to cache
2026-03-26 22:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 54368680-60a6-5d28-a06b-cee42607ebff
2026-03-26 22:46:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e2aed0>
2026-03-26 22:46:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54368680-60a6-5d28-a06b-cee42607ebff/54368680-60a6-5d28-a06b-cee42607ebff_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Ffc8446bbc2a54b868ff39327af630dab%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/fc8446bbc2a54b868ff39327af630dab/images/large/6.jpg saved to cache
2026-03-26 22:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 54368680-60a6-5d28-a06b-cee42607ebff
2026-03-26 22:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cf%252F4f9616451b3c44c59e92eb0f752ea8ba%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cf/4f9616451b3c44c59e92eb0f752ea8ba/images/large/9.jpg not downloaded yet
2026-03-26 22:46:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cl/0d1ccc92bf1b421792d8e717c46b8553/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cl/0d1ccc92bf1b421792d8e717c46b8553/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cf%252F4f9616451b3c44c59e92eb0f752ea8ba%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cf/4f9616451b3c44c59e92eb0f752ea8ba/images/large/10.jpg not downloaded yet
2026-03-26 22:46:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5ccb9d0>
2026-03-26 22:46:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54368680-60a6-5d28-a06b-cee42607ebff/54368680-60a6-5d28-a06b-cee42607ebff_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Ffc8446bbc2a54b868ff39327af630dab%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/fc8446bbc2a54b868ff39327af630dab/images/large/7.jpg saved to cache
2026-03-26 22:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 54368680-60a6-5d28-a06b-cee42607ebff
2026-03-26 22:46:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c62dd0>
2026-03-26 22:46:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54368680-60a6-5d28-a06b-cee42607ebff/54368680-60a6-5d28-a06b-cee42607ebff_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Ffc8446bbc2a54b868ff39327af630dab%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/fc8446bbc2a54b868ff39327af630dab/images/large/8.jpg saved to cache
2026-03-26 22:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 54368680-60a6-5d28-a06b-cee42607ebff
2026-03-26 22:46:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 54368680-60a6-5d28-a06b-cee42607ebff, skipping ID generation
2026-03-26 22:46:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54368680-60a6-5d28-a06b-cee42607ebff with scrape type 1
2026-03-26 22:46:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 54368680-60a6-5d28-a06b-cee42607ebff sending to next pipeline
2026-03-26 22:46:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 54368680-60a6-5d28-a06b-cee42607ebff, identifier: 1986063
2026-03-26 22:46:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd5b2890>
2026-03-26 22:46:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e70a0a4-0868-5521-9cb0-c4cc8d73a330/9e70a0a4-0868-5521-9cb0-c4cc8d73a330_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F0d1ccc92bf1b421792d8e717c46b8553%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/0d1ccc92bf1b421792d8e717c46b8553/images/large/6.jpg saved to cache
2026-03-26 22:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9e70a0a4-0868-5521-9cb0-c4cc8d73a330
2026-03-26 22:46:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b78a8110>
2026-03-26 22:46:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e70a0a4-0868-5521-9cb0-c4cc8d73a330/9e70a0a4-0868-5521-9cb0-c4cc8d73a330_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F0d1ccc92bf1b421792d8e717c46b8553%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/0d1ccc92bf1b421792d8e717c46b8553/images/large/9.jpg saved to cache
2026-03-26 22:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9e70a0a4-0868-5521-9cb0-c4cc8d73a330
2026-03-26 22:46:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 54368680-60a6-5d28-a06b-cee42607ebff with identifier: 1986063
2026-03-26 22:46:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 54368680-60a6-5d28-a06b-cee42607ebff with identifier: 1986063
2026-03-26 22:46:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 54368680-60a6-5d28-a06b-cee42607ebff with identifier: 1986063 to the API
2026-03-26 22:46:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:46:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:46:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bq/fc8446bbc2a54b868ff39327af630dab/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '54368680-60a6-5d28-a06b-cee42607ebff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 122169,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54368680-60a6-5d28-a06b-cee42607ebff/54368680-60a6-5d28-a06b-cee42607ebff_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 636581,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/fc8446bbc2a54b868ff39327af630dab/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54368680-60a6-5d28-a06b-cee42607ebff/54368680-60a6-5d28-a06b-cee42607ebff_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 662221,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/fc8446bbc2a54b868ff39327af630dab/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54368680-60a6-5d28-a06b-cee42607ebff/54368680-60a6-5d28-a06b-cee42607ebff_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 653914,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/fc8446bbc2a54b868ff39327af630dab/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54368680-60a6-5d28-a06b-cee42607ebff/54368680-60a6-5d28-a06b-cee42607ebff_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 697648,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/fc8446bbc2a54b868ff39327af630dab/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54368680-60a6-5d28-a06b-cee42607ebff/54368680-60a6-5d28-a06b-cee42607ebff_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 676361,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/fc8446bbc2a54b868ff39327af630dab/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54368680-60a6-5d28-a06b-cee42607ebff/54368680-60a6-5d28-a06b-cee42607ebff_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 608639,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/fc8446bbc2a54b868ff39327af630dab/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54368680-60a6-5d28-a06b-cee42607ebff/54368680-60a6-5d28-a06b-cee42607ebff_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 696350,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/fc8446bbc2a54b868ff39327af630dab/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54368680-60a6-5d28-a06b-cee42607ebff/54368680-60a6-5d28-a06b-cee42607ebff_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 695750,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/fc8446bbc2a54b868ff39327af630dab/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54368680-60a6-5d28-a06b-cee42607ebff/54368680-60a6-5d28-a06b-cee42607ebff_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 619895,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/fc8446bbc2a54b868ff39327af630dab/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54368680-60a6-5d28-a06b-cee42607ebff/54368680-60a6-5d28-a06b-cee42607ebff_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 580105,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/fc8446bbc2a54b868ff39327af630dab/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 1.5 SDRIVE16DA',
 'transmission': 'automatic',
 'trim': '1.5 SDRIVE16DA',
 'vin': None,
 'year': 2022}
2026-03-26 22:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986063%27 HTTP/1.1" 200 None
2026-03-26 22:46:29 [ayvens.be] INFO: Saving data for 1986063: {'created_time': 1774565189.893553, 'last_price_update_time': 1774565189.893563, 'auction_closing_time': 1775028600.0}
2026-03-26 22:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986063') HTTP/1.1" 204 0
2026-03-26 22:46:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cl/0d1ccc92bf1b421792d8e717c46b8553/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cl/0d1ccc92bf1b421792d8e717c46b8553/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:29 [ayvens.be] INFO: Found listing with ID: 1986066
2026-03-26 22:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986066%27 HTTP/1.1" 200 None
2026-03-26 22:46:29 [ayvens.be] INFO: Scrape type for 1986066: 1
2026-03-26 22:46:29 [ayvens.be] INFO: Extracting data for car ID: 1986066
2026-03-26 22:46:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d62b895f-d287-5f27-989b-d256b02cf905 with identifier: 1986066
2026-03-26 22:46:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d62b895f-d287-5f27-989b-d256b02cf905 with scrape type 1
2026-03-26 22:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d62b895f-d287-5f27-989b-d256b02cf905
2026-03-26 22:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F59f9115034174243b2063d81dcf3beab%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/59f9115034174243b2063d81dcf3beab/images/large/1.jpg not downloaded yet
2026-03-26 22:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F59f9115034174243b2063d81dcf3beab%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/59f9115034174243b2063d81dcf3beab/images/large/2.jpg not downloaded yet
2026-03-26 22:46:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cl/0d1ccc92bf1b421792d8e717c46b8553/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cl/0d1ccc92bf1b421792d8e717c46b8553/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cf/4f9616451b3c44c59e92eb0f752ea8ba/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7400d10>
2026-03-26 22:46:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e70a0a4-0868-5521-9cb0-c4cc8d73a330/9e70a0a4-0868-5521-9cb0-c4cc8d73a330_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F0d1ccc92bf1b421792d8e717c46b8553%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/0d1ccc92bf1b421792d8e717c46b8553/images/large/7.jpg saved to cache
2026-03-26 22:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9e70a0a4-0868-5521-9cb0-c4cc8d73a330
2026-03-26 22:46:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7436f10>
2026-03-26 22:46:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e70a0a4-0868-5521-9cb0-c4cc8d73a330/9e70a0a4-0868-5521-9cb0-c4cc8d73a330_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F0d1ccc92bf1b421792d8e717c46b8553%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/0d1ccc92bf1b421792d8e717c46b8553/images/large/5.jpg saved to cache
2026-03-26 22:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9e70a0a4-0868-5521-9cb0-c4cc8d73a330
2026-03-26 22:46:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cl/0d1ccc92bf1b421792d8e717c46b8553/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cf/4f9616451b3c44c59e92eb0f752ea8ba/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cf/4f9616451b3c44c59e92eb0f752ea8ba/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F59f9115034174243b2063d81dcf3beab%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/59f9115034174243b2063d81dcf3beab/images/large/3.jpg not downloaded yet
2026-03-26 22:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F59f9115034174243b2063d81dcf3beab%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/59f9115034174243b2063d81dcf3beab/images/large/4.jpg not downloaded yet
2026-03-26 22:46:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e11910>
2026-03-26 22:46:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e70a0a4-0868-5521-9cb0-c4cc8d73a330/9e70a0a4-0868-5521-9cb0-c4cc8d73a330_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F0d1ccc92bf1b421792d8e717c46b8553%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/0d1ccc92bf1b421792d8e717c46b8553/images/large/8.jpg saved to cache
2026-03-26 22:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9e70a0a4-0868-5521-9cb0-c4cc8d73a330
2026-03-26 22:46:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cb0590>
2026-03-26 22:46:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e70a0a4-0868-5521-9cb0-c4cc8d73a330/9e70a0a4-0868-5521-9cb0-c4cc8d73a330_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F0d1ccc92bf1b421792d8e717c46b8553%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/0d1ccc92bf1b421792d8e717c46b8553/images/large/10.jpg saved to cache
2026-03-26 22:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9e70a0a4-0868-5521-9cb0-c4cc8d73a330
2026-03-26 22:46:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b727ff10>
2026-03-26 22:46:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e70a0a4-0868-5521-9cb0-c4cc8d73a330/9e70a0a4-0868-5521-9cb0-c4cc8d73a330_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F0d1ccc92bf1b421792d8e717c46b8553%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/0d1ccc92bf1b421792d8e717c46b8553/images/large/3.jpg saved to cache
2026-03-26 22:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9e70a0a4-0868-5521-9cb0-c4cc8d73a330
2026-03-26 22:46:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cb0410>
2026-03-26 22:46:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e70a0a4-0868-5521-9cb0-c4cc8d73a330/9e70a0a4-0868-5521-9cb0-c4cc8d73a330_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F0d1ccc92bf1b421792d8e717c46b8553%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/0d1ccc92bf1b421792d8e717c46b8553/images/large/4.jpg saved to cache
2026-03-26 22:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9e70a0a4-0868-5521-9cb0-c4cc8d73a330
2026-03-26 22:46:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7875850>
2026-03-26 22:46:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97ab8ef2-8f9c-5049-a47a-20d0d7b4ea94/97ab8ef2-8f9c-5049-a47a-20d0d7b4ea94_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cf%252F4f9616451b3c44c59e92eb0f752ea8ba%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cf/4f9616451b3c44c59e92eb0f752ea8ba/images/large/1.jpg saved to cache
2026-03-26 22:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 97ab8ef2-8f9c-5049-a47a-20d0d7b4ea94
2026-03-26 22:46:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cf/4f9616451b3c44c59e92eb0f752ea8ba/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F59f9115034174243b2063d81dcf3beab%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/59f9115034174243b2063d81dcf3beab/images/large/5.jpg not downloaded yet
2026-03-26 22:46:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cf/4f9616451b3c44c59e92eb0f752ea8ba/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F59f9115034174243b2063d81dcf3beab%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/59f9115034174243b2063d81dcf3beab/images/large/6.jpg not downloaded yet
2026-03-26 22:46:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cf/4f9616451b3c44c59e92eb0f752ea8ba/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c74a90>
2026-03-26 22:46:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e70a0a4-0868-5521-9cb0-c4cc8d73a330/9e70a0a4-0868-5521-9cb0-c4cc8d73a330_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F0d1ccc92bf1b421792d8e717c46b8553%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/0d1ccc92bf1b421792d8e717c46b8553/images/large/2.jpg saved to cache
2026-03-26 22:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9e70a0a4-0868-5521-9cb0-c4cc8d73a330
2026-03-26 22:46:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9e70a0a4-0868-5521-9cb0-c4cc8d73a330, skipping ID generation
2026-03-26 22:46:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e70a0a4-0868-5521-9cb0-c4cc8d73a330 with scrape type 1
2026-03-26 22:46:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9e70a0a4-0868-5521-9cb0-c4cc8d73a330 sending to next pipeline
2026-03-26 22:46:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 9e70a0a4-0868-5521-9cb0-c4cc8d73a330, identifier: 1986064
2026-03-26 22:46:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd5b2910>
2026-03-26 22:46:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97ab8ef2-8f9c-5049-a47a-20d0d7b4ea94/97ab8ef2-8f9c-5049-a47a-20d0d7b4ea94_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cf%252F4f9616451b3c44c59e92eb0f752ea8ba%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cf/4f9616451b3c44c59e92eb0f752ea8ba/images/large/3.jpg saved to cache
2026-03-26 22:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 97ab8ef2-8f9c-5049-a47a-20d0d7b4ea94
2026-03-26 22:46:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cb1650>
2026-03-26 22:46:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97ab8ef2-8f9c-5049-a47a-20d0d7b4ea94/97ab8ef2-8f9c-5049-a47a-20d0d7b4ea94_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cf%252F4f9616451b3c44c59e92eb0f752ea8ba%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cf/4f9616451b3c44c59e92eb0f752ea8ba/images/large/2.jpg saved to cache
2026-03-26 22:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 97ab8ef2-8f9c-5049-a47a-20d0d7b4ea94
2026-03-26 22:46:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cf/4f9616451b3c44c59e92eb0f752ea8ba/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cf/4f9616451b3c44c59e92eb0f752ea8ba/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F59f9115034174243b2063d81dcf3beab%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/59f9115034174243b2063d81dcf3beab/images/large/7.jpg not downloaded yet
2026-03-26 22:46:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 9e70a0a4-0868-5521-9cb0-c4cc8d73a330 with identifier: 1986064
2026-03-26 22:46:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 9e70a0a4-0868-5521-9cb0-c4cc8d73a330 with identifier: 1986064
2026-03-26 22:46:31 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 9e70a0a4-0868-5521-9cb0-c4cc8d73a330 with identifier: 1986064 to the API
2026-03-26 22:46:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:46:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:46:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cl/0d1ccc92bf1b421792d8e717c46b8553/images/large/2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '9e70a0a4-0868-5521-9cb0-c4cc8d73a330',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'QASHQAI',
 'odometer': 174588,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e70a0a4-0868-5521-9cb0-c4cc8d73a330/9e70a0a4-0868-5521-9cb0-c4cc8d73a330_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 564982,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cl/0d1ccc92bf1b421792d8e717c46b8553/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e70a0a4-0868-5521-9cb0-c4cc8d73a330/9e70a0a4-0868-5521-9cb0-c4cc8d73a330_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 652648,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cl/0d1ccc92bf1b421792d8e717c46b8553/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e70a0a4-0868-5521-9cb0-c4cc8d73a330/9e70a0a4-0868-5521-9cb0-c4cc8d73a330_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 551668,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cl/0d1ccc92bf1b421792d8e717c46b8553/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e70a0a4-0868-5521-9cb0-c4cc8d73a330/9e70a0a4-0868-5521-9cb0-c4cc8d73a330_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 582159,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cl/0d1ccc92bf1b421792d8e717c46b8553/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e70a0a4-0868-5521-9cb0-c4cc8d73a330/9e70a0a4-0868-5521-9cb0-c4cc8d73a330_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 413916,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cl/0d1ccc92bf1b421792d8e717c46b8553/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e70a0a4-0868-5521-9cb0-c4cc8d73a330/9e70a0a4-0868-5521-9cb0-c4cc8d73a330_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 214045,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cl/0d1ccc92bf1b421792d8e717c46b8553/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e70a0a4-0868-5521-9cb0-c4cc8d73a330/9e70a0a4-0868-5521-9cb0-c4cc8d73a330_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 389875,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cl/0d1ccc92bf1b421792d8e717c46b8553/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e70a0a4-0868-5521-9cb0-c4cc8d73a330/9e70a0a4-0868-5521-9cb0-c4cc8d73a330_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 357640,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cl/0d1ccc92bf1b421792d8e717c46b8553/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e70a0a4-0868-5521-9cb0-c4cc8d73a330/9e70a0a4-0868-5521-9cb0-c4cc8d73a330_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 360726,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cl/0d1ccc92bf1b421792d8e717c46b8553/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e70a0a4-0868-5521-9cb0-c4cc8d73a330/9e70a0a4-0868-5521-9cb0-c4cc8d73a330_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 229370,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cl/0d1ccc92bf1b421792d8e717c46b8553/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN QASHQAI 1.3 MHEV 116KW N-CONNECTA XTRONIC',
 'transmission': 'automatic',
 'trim': '1.3 MHEV 116KW N-CONNECTA XTRONIC',
 'vin': None,
 'year': 2022}
2026-03-26 22:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986064%27 HTTP/1.1" 200 None
2026-03-26 22:46:31 [ayvens.be] INFO: Saving data for 1986064: {'created_time': 1774565191.567381, 'last_price_update_time': 1774565191.567391, 'auction_closing_time': 1775028600.0}
2026-03-26 22:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986064') HTTP/1.1" 204 0
2026-03-26 22:46:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cf/4f9616451b3c44c59e92eb0f752ea8ba/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cf/4f9616451b3c44c59e92eb0f752ea8ba/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F59f9115034174243b2063d81dcf3beab%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/59f9115034174243b2063d81dcf3beab/images/large/8.jpg not downloaded yet
2026-03-26 22:46:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7744050>
2026-03-26 22:46:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97ab8ef2-8f9c-5049-a47a-20d0d7b4ea94/97ab8ef2-8f9c-5049-a47a-20d0d7b4ea94_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cf%252F4f9616451b3c44c59e92eb0f752ea8ba%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cf/4f9616451b3c44c59e92eb0f752ea8ba/images/large/4.jpg saved to cache
2026-03-26 22:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 97ab8ef2-8f9c-5049-a47a-20d0d7b4ea94
2026-03-26 22:46:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e15e10>
2026-03-26 22:46:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97ab8ef2-8f9c-5049-a47a-20d0d7b4ea94/97ab8ef2-8f9c-5049-a47a-20d0d7b4ea94_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cf%252F4f9616451b3c44c59e92eb0f752ea8ba%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cf/4f9616451b3c44c59e92eb0f752ea8ba/images/large/5.jpg saved to cache
2026-03-26 22:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 97ab8ef2-8f9c-5049-a47a-20d0d7b4ea94
2026-03-26 22:46:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e2bf10>
2026-03-26 22:46:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97ab8ef2-8f9c-5049-a47a-20d0d7b4ea94/97ab8ef2-8f9c-5049-a47a-20d0d7b4ea94_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cf%252F4f9616451b3c44c59e92eb0f752ea8ba%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cf/4f9616451b3c44c59e92eb0f752ea8ba/images/large/10.jpg saved to cache
2026-03-26 22:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 97ab8ef2-8f9c-5049-a47a-20d0d7b4ea94
2026-03-26 22:46:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77c9750>
2026-03-26 22:46:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97ab8ef2-8f9c-5049-a47a-20d0d7b4ea94/97ab8ef2-8f9c-5049-a47a-20d0d7b4ea94_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cf%252F4f9616451b3c44c59e92eb0f752ea8ba%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cf/4f9616451b3c44c59e92eb0f752ea8ba/images/large/7.jpg saved to cache
2026-03-26 22:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 97ab8ef2-8f9c-5049-a47a-20d0d7b4ea94
2026-03-26 22:46:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7290990>
2026-03-26 22:46:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97ab8ef2-8f9c-5049-a47a-20d0d7b4ea94/97ab8ef2-8f9c-5049-a47a-20d0d7b4ea94_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cf%252F4f9616451b3c44c59e92eb0f752ea8ba%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cf/4f9616451b3c44c59e92eb0f752ea8ba/images/large/6.jpg saved to cache
2026-03-26 22:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 97ab8ef2-8f9c-5049-a47a-20d0d7b4ea94
2026-03-26 22:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F59f9115034174243b2063d81dcf3beab%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/59f9115034174243b2063d81dcf3beab/images/large/9.jpg not downloaded yet
2026-03-26 22:46:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/59f9115034174243b2063d81dcf3beab/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F59f9115034174243b2063d81dcf3beab%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/59f9115034174243b2063d81dcf3beab/images/large/10.jpg not downloaded yet
2026-03-26 22:46:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74ad290>
2026-03-26 22:46:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97ab8ef2-8f9c-5049-a47a-20d0d7b4ea94/97ab8ef2-8f9c-5049-a47a-20d0d7b4ea94_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cf%252F4f9616451b3c44c59e92eb0f752ea8ba%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cf/4f9616451b3c44c59e92eb0f752ea8ba/images/large/8.jpg saved to cache
2026-03-26 22:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 97ab8ef2-8f9c-5049-a47a-20d0d7b4ea94
2026-03-26 22:46:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e16110>
2026-03-26 22:46:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97ab8ef2-8f9c-5049-a47a-20d0d7b4ea94/97ab8ef2-8f9c-5049-a47a-20d0d7b4ea94_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cf%252F4f9616451b3c44c59e92eb0f752ea8ba%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cf/4f9616451b3c44c59e92eb0f752ea8ba/images/large/9.jpg saved to cache
2026-03-26 22:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 97ab8ef2-8f9c-5049-a47a-20d0d7b4ea94
2026-03-26 22:46:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 97ab8ef2-8f9c-5049-a47a-20d0d7b4ea94, skipping ID generation
2026-03-26 22:46:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97ab8ef2-8f9c-5049-a47a-20d0d7b4ea94 with scrape type 1
2026-03-26 22:46:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 97ab8ef2-8f9c-5049-a47a-20d0d7b4ea94 sending to next pipeline
2026-03-26 22:46:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 97ab8ef2-8f9c-5049-a47a-20d0d7b4ea94, identifier: 1986065
2026-03-26 22:46:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 97ab8ef2-8f9c-5049-a47a-20d0d7b4ea94 with identifier: 1986065
2026-03-26 22:46:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 97ab8ef2-8f9c-5049-a47a-20d0d7b4ea94 with identifier: 1986065
2026-03-26 22:46:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 97ab8ef2-8f9c-5049-a47a-20d0d7b4ea94 with identifier: 1986065 to the API
2026-03-26 22:46:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:46:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:46:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cf/4f9616451b3c44c59e92eb0f752ea8ba/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '97ab8ef2-8f9c-5049-a47a-20d0d7b4ea94',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'CITROAu2039N',
 'model': 'C5 X',
 'odometer': 50757,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97ab8ef2-8f9c-5049-a47a-20d0d7b4ea94/97ab8ef2-8f9c-5049-a47a-20d0d7b4ea94_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 232465,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cf/4f9616451b3c44c59e92eb0f752ea8ba/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97ab8ef2-8f9c-5049-a47a-20d0d7b4ea94/97ab8ef2-8f9c-5049-a47a-20d0d7b4ea94_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 225967,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cf/4f9616451b3c44c59e92eb0f752ea8ba/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97ab8ef2-8f9c-5049-a47a-20d0d7b4ea94/97ab8ef2-8f9c-5049-a47a-20d0d7b4ea94_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 247676,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cf/4f9616451b3c44c59e92eb0f752ea8ba/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97ab8ef2-8f9c-5049-a47a-20d0d7b4ea94/97ab8ef2-8f9c-5049-a47a-20d0d7b4ea94_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 248541,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cf/4f9616451b3c44c59e92eb0f752ea8ba/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97ab8ef2-8f9c-5049-a47a-20d0d7b4ea94/97ab8ef2-8f9c-5049-a47a-20d0d7b4ea94_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 307129,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cf/4f9616451b3c44c59e92eb0f752ea8ba/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97ab8ef2-8f9c-5049-a47a-20d0d7b4ea94/97ab8ef2-8f9c-5049-a47a-20d0d7b4ea94_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 274853,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cf/4f9616451b3c44c59e92eb0f752ea8ba/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97ab8ef2-8f9c-5049-a47a-20d0d7b4ea94/97ab8ef2-8f9c-5049-a47a-20d0d7b4ea94_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 290222,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cf/4f9616451b3c44c59e92eb0f752ea8ba/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97ab8ef2-8f9c-5049-a47a-20d0d7b4ea94/97ab8ef2-8f9c-5049-a47a-20d0d7b4ea94_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 328365,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cf/4f9616451b3c44c59e92eb0f752ea8ba/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97ab8ef2-8f9c-5049-a47a-20d0d7b4ea94/97ab8ef2-8f9c-5049-a47a-20d0d7b4ea94_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 369598,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cf/4f9616451b3c44c59e92eb0f752ea8ba/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97ab8ef2-8f9c-5049-a47a-20d0d7b4ea94/97ab8ef2-8f9c-5049-a47a-20d0d7b4ea94_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 205119,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cf/4f9616451b3c44c59e92eb0f752ea8ba/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROAu2039N C5 X 1.2 PURETECH 130 S&S EAT8 FEEL AT',
 'transmission': 'automatic',
 'trim': '1.2 PURETECH 130 S&S EAT8 FEEL AT',
 'vin': None,
 'year': 2022}
2026-03-26 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986065%27 HTTP/1.1" 200 None
2026-03-26 22:46:33 [ayvens.be] INFO: Saving data for 1986065: {'created_time': 1774565193.142312, 'last_price_update_time': 1774565193.142321, 'auction_closing_time': 1775028600.0}
2026-03-26 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986065') HTTP/1.1" 204 0
2026-03-26 22:46:33 [ayvens.be] INFO: Found listing with ID: 1986067
2026-03-26 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986067%27 HTTP/1.1" 200 None
2026-03-26 22:46:33 [ayvens.be] INFO: Scrape type for 1986067: 1
2026-03-26 22:46:33 [ayvens.be] INFO: Extracting data for car ID: 1986067
2026-03-26 22:46:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8fdd8846-38da-5d0c-b5c0-4240e4bdb3a8 with identifier: 1986067
2026-03-26 22:46:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8fdd8846-38da-5d0c-b5c0-4240e4bdb3a8 with scrape type 1
2026-03-26 22:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8fdd8846-38da-5d0c-b5c0-4240e4bdb3a8
2026-03-26 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F74b02b4724104efe880a23715338f4de%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/74b02b4724104efe880a23715338f4de/images/large/1.jpg not downloaded yet
2026-03-26 22:46:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b75a42d0>
2026-03-26 22:46:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d62b895f-d287-5f27-989b-d256b02cf905/d62b895f-d287-5f27-989b-d256b02cf905_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F59f9115034174243b2063d81dcf3beab%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/59f9115034174243b2063d81dcf3beab/images/large/1.jpg saved to cache
2026-03-26 22:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d62b895f-d287-5f27-989b-d256b02cf905
2026-03-26 22:46:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/59f9115034174243b2063d81dcf3beab/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F74b02b4724104efe880a23715338f4de%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/74b02b4724104efe880a23715338f4de/images/large/2.jpg not downloaded yet
2026-03-26 22:46:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/59f9115034174243b2063d81dcf3beab/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F74b02b4724104efe880a23715338f4de%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/74b02b4724104efe880a23715338f4de/images/large/3.jpg not downloaded yet
2026-03-26 22:46:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/59f9115034174243b2063d81dcf3beab/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/59f9115034174243b2063d81dcf3beab/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/59f9115034174243b2063d81dcf3beab/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F74b02b4724104efe880a23715338f4de%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/74b02b4724104efe880a23715338f4de/images/large/4.jpg not downloaded yet
2026-03-26 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F74b02b4724104efe880a23715338f4de%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/74b02b4724104efe880a23715338f4de/images/large/5.jpg not downloaded yet
2026-03-26 22:46:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/59f9115034174243b2063d81dcf3beab/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F74b02b4724104efe880a23715338f4de%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/74b02b4724104efe880a23715338f4de/images/large/6.jpg not downloaded yet
2026-03-26 22:46:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/59f9115034174243b2063d81dcf3beab/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F74b02b4724104efe880a23715338f4de%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/74b02b4724104efe880a23715338f4de/images/large/7.jpg not downloaded yet
2026-03-26 22:46:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/59f9115034174243b2063d81dcf3beab/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7ccd910>
2026-03-26 22:46:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d62b895f-d287-5f27-989b-d256b02cf905/d62b895f-d287-5f27-989b-d256b02cf905_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F59f9115034174243b2063d81dcf3beab%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/59f9115034174243b2063d81dcf3beab/images/large/3.jpg saved to cache
2026-03-26 22:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d62b895f-d287-5f27-989b-d256b02cf905
2026-03-26 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F74b02b4724104efe880a23715338f4de%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/74b02b4724104efe880a23715338f4de/images/large/8.jpg not downloaded yet
2026-03-26 22:46:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7875210>
2026-03-26 22:46:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d62b895f-d287-5f27-989b-d256b02cf905/d62b895f-d287-5f27-989b-d256b02cf905_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F59f9115034174243b2063d81dcf3beab%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/59f9115034174243b2063d81dcf3beab/images/large/2.jpg saved to cache
2026-03-26 22:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d62b895f-d287-5f27-989b-d256b02cf905
2026-03-26 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F74b02b4724104efe880a23715338f4de%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/74b02b4724104efe880a23715338f4de/images/large/9.jpg not downloaded yet
2026-03-26 22:46:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c7e3d0>
2026-03-26 22:46:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d62b895f-d287-5f27-989b-d256b02cf905/d62b895f-d287-5f27-989b-d256b02cf905_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F59f9115034174243b2063d81dcf3beab%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/59f9115034174243b2063d81dcf3beab/images/large/4.jpg saved to cache
2026-03-26 22:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d62b895f-d287-5f27-989b-d256b02cf905
2026-03-26 22:46:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c7cb50>
2026-03-26 22:46:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d62b895f-d287-5f27-989b-d256b02cf905/d62b895f-d287-5f27-989b-d256b02cf905_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F59f9115034174243b2063d81dcf3beab%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/59f9115034174243b2063d81dcf3beab/images/large/6.jpg saved to cache
2026-03-26 22:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d62b895f-d287-5f27-989b-d256b02cf905
2026-03-26 22:46:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7293410>
2026-03-26 22:46:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d62b895f-d287-5f27-989b-d256b02cf905/d62b895f-d287-5f27-989b-d256b02cf905_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F59f9115034174243b2063d81dcf3beab%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/59f9115034174243b2063d81dcf3beab/images/large/5.jpg saved to cache
2026-03-26 22:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d62b895f-d287-5f27-989b-d256b02cf905
2026-03-26 22:46:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7401150>
2026-03-26 22:46:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d62b895f-d287-5f27-989b-d256b02cf905/d62b895f-d287-5f27-989b-d256b02cf905_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F59f9115034174243b2063d81dcf3beab%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/59f9115034174243b2063d81dcf3beab/images/large/7.jpg saved to cache
2026-03-26 22:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d62b895f-d287-5f27-989b-d256b02cf905
2026-03-26 22:46:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b782e610>
2026-03-26 22:46:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d62b895f-d287-5f27-989b-d256b02cf905/d62b895f-d287-5f27-989b-d256b02cf905_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F59f9115034174243b2063d81dcf3beab%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/59f9115034174243b2063d81dcf3beab/images/large/8.jpg saved to cache
2026-03-26 22:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d62b895f-d287-5f27-989b-d256b02cf905
2026-03-26 22:46:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7877690>
2026-03-26 22:46:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d62b895f-d287-5f27-989b-d256b02cf905/d62b895f-d287-5f27-989b-d256b02cf905_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F59f9115034174243b2063d81dcf3beab%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/59f9115034174243b2063d81dcf3beab/images/large/9.jpg saved to cache
2026-03-26 22:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d62b895f-d287-5f27-989b-d256b02cf905
2026-03-26 22:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F74b02b4724104efe880a23715338f4de%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/74b02b4724104efe880a23715338f4de/images/large/10.jpg not downloaded yet
2026-03-26 22:46:34 [ayvens.be] INFO: Found listing with ID: 1986068
2026-03-26 22:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986068%27 HTTP/1.1" 200 None
2026-03-26 22:46:34 [ayvens.be] INFO: Scrape type for 1986068: 1
2026-03-26 22:46:34 [ayvens.be] INFO: Extracting data for car ID: 1986068
2026-03-26 22:46:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f6b9527f-99d2-56a6-90da-0ff54160ff73 with identifier: 1986068
2026-03-26 22:46:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6b9527f-99d2-56a6-90da-0ff54160ff73 with scrape type 1
2026-03-26 22:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f6b9527f-99d2-56a6-90da-0ff54160ff73
2026-03-26 22:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F0a4033d942754926968dc7938ff8fc44%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/0a4033d942754926968dc7938ff8fc44/images/large/1.jpg not downloaded yet
2026-03-26 22:46:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/59f9115034174243b2063d81dcf3beab/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F0a4033d942754926968dc7938ff8fc44%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/0a4033d942754926968dc7938ff8fc44/images/large/2.jpg not downloaded yet
2026-03-26 22:46:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/74b02b4724104efe880a23715338f4de/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/74b02b4724104efe880a23715338f4de/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/74b02b4724104efe880a23715338f4de/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/74b02b4724104efe880a23715338f4de/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/74b02b4724104efe880a23715338f4de/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F0a4033d942754926968dc7938ff8fc44%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/0a4033d942754926968dc7938ff8fc44/images/large/3.jpg not downloaded yet
2026-03-26 22:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F0a4033d942754926968dc7938ff8fc44%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/0a4033d942754926968dc7938ff8fc44/images/large/4.jpg not downloaded yet
2026-03-26 22:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F0a4033d942754926968dc7938ff8fc44%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/0a4033d942754926968dc7938ff8fc44/images/large/5.jpg not downloaded yet
2026-03-26 22:46:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/74b02b4724104efe880a23715338f4de/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F0a4033d942754926968dc7938ff8fc44%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/0a4033d942754926968dc7938ff8fc44/images/large/6.jpg not downloaded yet
2026-03-26 22:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F0a4033d942754926968dc7938ff8fc44%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/0a4033d942754926968dc7938ff8fc44/images/large/7.jpg not downloaded yet
2026-03-26 22:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F0a4033d942754926968dc7938ff8fc44%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/0a4033d942754926968dc7938ff8fc44/images/large/8.jpg not downloaded yet
2026-03-26 22:46:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b78a94d0>
2026-03-26 22:46:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d62b895f-d287-5f27-989b-d256b02cf905/d62b895f-d287-5f27-989b-d256b02cf905_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F59f9115034174243b2063d81dcf3beab%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/59f9115034174243b2063d81dcf3beab/images/large/10.jpg saved to cache
2026-03-26 22:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d62b895f-d287-5f27-989b-d256b02cf905
2026-03-26 22:46:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d62b895f-d287-5f27-989b-d256b02cf905, skipping ID generation
2026-03-26 22:46:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d62b895f-d287-5f27-989b-d256b02cf905 with scrape type 1
2026-03-26 22:46:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d62b895f-d287-5f27-989b-d256b02cf905 sending to next pipeline
2026-03-26 22:46:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d62b895f-d287-5f27-989b-d256b02cf905, identifier: 1986066
2026-03-26 22:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F0a4033d942754926968dc7938ff8fc44%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/0a4033d942754926968dc7938ff8fc44/images/large/9.jpg not downloaded yet
2026-03-26 22:46:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d62b895f-d287-5f27-989b-d256b02cf905 with identifier: 1986066
2026-03-26 22:46:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d62b895f-d287-5f27-989b-d256b02cf905 with identifier: 1986066
2026-03-26 22:46:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d62b895f-d287-5f27-989b-d256b02cf905 with identifier: 1986066 to the API
2026-03-26 22:46:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:46:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:46:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cc/59f9115034174243b2063d81dcf3beab/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'electric',
 'id': 'd62b895f-d287-5f27-989b-d256b02cf905',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'ENYAQ',
 'odometer': 68699,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d62b895f-d287-5f27-989b-d256b02cf905/d62b895f-d287-5f27-989b-d256b02cf905_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 675046,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/59f9115034174243b2063d81dcf3beab/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d62b895f-d287-5f27-989b-d256b02cf905/d62b895f-d287-5f27-989b-d256b02cf905_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 689617,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/59f9115034174243b2063d81dcf3beab/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d62b895f-d287-5f27-989b-d256b02cf905/d62b895f-d287-5f27-989b-d256b02cf905_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 608083,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/59f9115034174243b2063d81dcf3beab/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d62b895f-d287-5f27-989b-d256b02cf905/d62b895f-d287-5f27-989b-d256b02cf905_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 725037,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/59f9115034174243b2063d81dcf3beab/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d62b895f-d287-5f27-989b-d256b02cf905/d62b895f-d287-5f27-989b-d256b02cf905_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 617768,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/59f9115034174243b2063d81dcf3beab/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d62b895f-d287-5f27-989b-d256b02cf905/d62b895f-d287-5f27-989b-d256b02cf905_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 562978,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/59f9115034174243b2063d81dcf3beab/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d62b895f-d287-5f27-989b-d256b02cf905/d62b895f-d287-5f27-989b-d256b02cf905_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 654536,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/59f9115034174243b2063d81dcf3beab/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d62b895f-d287-5f27-989b-d256b02cf905/d62b895f-d287-5f27-989b-d256b02cf905_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 718972,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/59f9115034174243b2063d81dcf3beab/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d62b895f-d287-5f27-989b-d256b02cf905/d62b895f-d287-5f27-989b-d256b02cf905_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 568645,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/59f9115034174243b2063d81dcf3beab/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d62b895f-d287-5f27-989b-d256b02cf905/d62b895f-d287-5f27-989b-d256b02cf905_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 627260,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/59f9115034174243b2063d81dcf3beab/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA ENYAQ 82KWH IV 80',
 'transmission': 'automatic',
 'trim': '82KWH IV 80',
 'vin': None,
 'year': 2022}
2026-03-26 22:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986066%27 HTTP/1.1" 200 None
2026-03-26 22:46:35 [ayvens.be] INFO: Saving data for 1986066: {'created_time': 1774565195.005, 'last_price_update_time': 1774565195.005009, 'auction_closing_time': 1775028600.0}
2026-03-26 22:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986066') HTTP/1.1" 204 0
2026-03-26 22:46:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5ca55d0>
2026-03-26 22:46:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fdd8846-38da-5d0c-b5c0-4240e4bdb3a8/8fdd8846-38da-5d0c-b5c0-4240e4bdb3a8_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F74b02b4724104efe880a23715338f4de%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/74b02b4724104efe880a23715338f4de/images/large/2.jpg saved to cache
2026-03-26 22:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8fdd8846-38da-5d0c-b5c0-4240e4bdb3a8
2026-03-26 22:46:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7435a10>
2026-03-26 22:46:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fdd8846-38da-5d0c-b5c0-4240e4bdb3a8/8fdd8846-38da-5d0c-b5c0-4240e4bdb3a8_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F74b02b4724104efe880a23715338f4de%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/74b02b4724104efe880a23715338f4de/images/large/3.jpg saved to cache
2026-03-26 22:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8fdd8846-38da-5d0c-b5c0-4240e4bdb3a8
2026-03-26 22:46:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7912810>
2026-03-26 22:46:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fdd8846-38da-5d0c-b5c0-4240e4bdb3a8/8fdd8846-38da-5d0c-b5c0-4240e4bdb3a8_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F74b02b4724104efe880a23715338f4de%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/74b02b4724104efe880a23715338f4de/images/large/4.jpg saved to cache
2026-03-26 22:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8fdd8846-38da-5d0c-b5c0-4240e4bdb3a8
2026-03-26 22:46:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79ddf50>
2026-03-26 22:46:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fdd8846-38da-5d0c-b5c0-4240e4bdb3a8/8fdd8846-38da-5d0c-b5c0-4240e4bdb3a8_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F74b02b4724104efe880a23715338f4de%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/74b02b4724104efe880a23715338f4de/images/large/5.jpg saved to cache
2026-03-26 22:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8fdd8846-38da-5d0c-b5c0-4240e4bdb3a8
2026-03-26 22:46:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5ca5950>
2026-03-26 22:46:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fdd8846-38da-5d0c-b5c0-4240e4bdb3a8/8fdd8846-38da-5d0c-b5c0-4240e4bdb3a8_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F74b02b4724104efe880a23715338f4de%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/74b02b4724104efe880a23715338f4de/images/large/1.jpg saved to cache
2026-03-26 22:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8fdd8846-38da-5d0c-b5c0-4240e4bdb3a8
2026-03-26 22:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F0a4033d942754926968dc7938ff8fc44%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/0a4033d942754926968dc7938ff8fc44/images/large/10.jpg not downloaded yet
2026-03-26 22:46:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/0a4033d942754926968dc7938ff8fc44/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b746ff50>
2026-03-26 22:46:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fdd8846-38da-5d0c-b5c0-4240e4bdb3a8/8fdd8846-38da-5d0c-b5c0-4240e4bdb3a8_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F74b02b4724104efe880a23715338f4de%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/74b02b4724104efe880a23715338f4de/images/large/7.jpg saved to cache
2026-03-26 22:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8fdd8846-38da-5d0c-b5c0-4240e4bdb3a8
2026-03-26 22:46:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/0a4033d942754926968dc7938ff8fc44/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:35 [ayvens.be] INFO: Found listing with ID: 1986069
2026-03-26 22:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986069%27 HTTP/1.1" 200 None
2026-03-26 22:46:35 [ayvens.be] INFO: Scrape type for 1986069: 1
2026-03-26 22:46:35 [ayvens.be] INFO: Extracting data for car ID: 1986069
2026-03-26 22:46:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13f3b5cb-b2b3-534a-be68-e343ad7b86e7 with identifier: 1986069
2026-03-26 22:46:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13f3b5cb-b2b3-534a-be68-e343ad7b86e7 with scrape type 1
2026-03-26 22:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 13f3b5cb-b2b3-534a-be68-e343ad7b86e7
2026-03-26 22:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F12c905d517de4e959bb4fc6dcd84d266%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/12c905d517de4e959bb4fc6dcd84d266/images/large/1.jpg not downloaded yet
2026-03-26 22:46:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/0a4033d942754926968dc7938ff8fc44/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/0a4033d942754926968dc7938ff8fc44/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/74b02b4724104efe880a23715338f4de/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F12c905d517de4e959bb4fc6dcd84d266%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/12c905d517de4e959bb4fc6dcd84d266/images/large/2.jpg not downloaded yet
2026-03-26 22:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F12c905d517de4e959bb4fc6dcd84d266%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/12c905d517de4e959bb4fc6dcd84d266/images/large/3.jpg not downloaded yet
2026-03-26 22:46:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b746c550>
2026-03-26 22:46:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6b9527f-99d2-56a6-90da-0ff54160ff73/f6b9527f-99d2-56a6-90da-0ff54160ff73_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F0a4033d942754926968dc7938ff8fc44%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/0a4033d942754926968dc7938ff8fc44/images/large/1.jpg saved to cache
2026-03-26 22:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f6b9527f-99d2-56a6-90da-0ff54160ff73
2026-03-26 22:46:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/74b02b4724104efe880a23715338f4de/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F12c905d517de4e959bb4fc6dcd84d266%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/12c905d517de4e959bb4fc6dcd84d266/images/large/4.jpg not downloaded yet
2026-03-26 22:46:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/74b02b4724104efe880a23715338f4de/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/74b02b4724104efe880a23715338f4de/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F12c905d517de4e959bb4fc6dcd84d266%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/12c905d517de4e959bb4fc6dcd84d266/images/large/5.jpg not downloaded yet
2026-03-26 22:46:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/0a4033d942754926968dc7938ff8fc44/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F12c905d517de4e959bb4fc6dcd84d266%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/12c905d517de4e959bb4fc6dcd84d266/images/large/6.jpg not downloaded yet
2026-03-26 22:46:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74bec90>
2026-03-26 22:46:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6b9527f-99d2-56a6-90da-0ff54160ff73/f6b9527f-99d2-56a6-90da-0ff54160ff73_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F0a4033d942754926968dc7938ff8fc44%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/0a4033d942754926968dc7938ff8fc44/images/large/2.jpg saved to cache
2026-03-26 22:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f6b9527f-99d2-56a6-90da-0ff54160ff73
2026-03-26 22:46:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7410190>
2026-03-26 22:46:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6b9527f-99d2-56a6-90da-0ff54160ff73/f6b9527f-99d2-56a6-90da-0ff54160ff73_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F0a4033d942754926968dc7938ff8fc44%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/0a4033d942754926968dc7938ff8fc44/images/large/4.jpg saved to cache
2026-03-26 22:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f6b9527f-99d2-56a6-90da-0ff54160ff73
2026-03-26 22:46:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c688d0>
2026-03-26 22:46:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6b9527f-99d2-56a6-90da-0ff54160ff73/f6b9527f-99d2-56a6-90da-0ff54160ff73_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F0a4033d942754926968dc7938ff8fc44%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/0a4033d942754926968dc7938ff8fc44/images/large/3.jpg saved to cache
2026-03-26 22:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f6b9527f-99d2-56a6-90da-0ff54160ff73
2026-03-26 22:46:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5ca27d0>
2026-03-26 22:46:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fdd8846-38da-5d0c-b5c0-4240e4bdb3a8/8fdd8846-38da-5d0c-b5c0-4240e4bdb3a8_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F74b02b4724104efe880a23715338f4de%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/74b02b4724104efe880a23715338f4de/images/large/9.jpg saved to cache
2026-03-26 22:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8fdd8846-38da-5d0c-b5c0-4240e4bdb3a8
2026-03-26 22:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F12c905d517de4e959bb4fc6dcd84d266%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/12c905d517de4e959bb4fc6dcd84d266/images/large/7.jpg not downloaded yet
2026-03-26 22:46:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/0a4033d942754926968dc7938ff8fc44/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/0a4033d942754926968dc7938ff8fc44/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F12c905d517de4e959bb4fc6dcd84d266%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/12c905d517de4e959bb4fc6dcd84d266/images/large/8.jpg not downloaded yet
2026-03-26 22:46:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/12c905d517de4e959bb4fc6dcd84d266/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/12c905d517de4e959bb4fc6dcd84d266/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7648450>
2026-03-26 22:46:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fdd8846-38da-5d0c-b5c0-4240e4bdb3a8/8fdd8846-38da-5d0c-b5c0-4240e4bdb3a8_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F74b02b4724104efe880a23715338f4de%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/74b02b4724104efe880a23715338f4de/images/large/8.jpg saved to cache
2026-03-26 22:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8fdd8846-38da-5d0c-b5c0-4240e4bdb3a8
2026-03-26 22:46:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74fba10>
2026-03-26 22:46:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fdd8846-38da-5d0c-b5c0-4240e4bdb3a8/8fdd8846-38da-5d0c-b5c0-4240e4bdb3a8_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F74b02b4724104efe880a23715338f4de%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/74b02b4724104efe880a23715338f4de/images/large/10.jpg saved to cache
2026-03-26 22:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8fdd8846-38da-5d0c-b5c0-4240e4bdb3a8
2026-03-26 22:46:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7688cd0>
2026-03-26 22:46:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fdd8846-38da-5d0c-b5c0-4240e4bdb3a8/8fdd8846-38da-5d0c-b5c0-4240e4bdb3a8_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F74b02b4724104efe880a23715338f4de%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/74b02b4724104efe880a23715338f4de/images/large/6.jpg saved to cache
2026-03-26 22:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8fdd8846-38da-5d0c-b5c0-4240e4bdb3a8
2026-03-26 22:46:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8fdd8846-38da-5d0c-b5c0-4240e4bdb3a8, skipping ID generation
2026-03-26 22:46:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8fdd8846-38da-5d0c-b5c0-4240e4bdb3a8 with scrape type 1
2026-03-26 22:46:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8fdd8846-38da-5d0c-b5c0-4240e4bdb3a8 sending to next pipeline
2026-03-26 22:46:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 8fdd8846-38da-5d0c-b5c0-4240e4bdb3a8, identifier: 1986067
2026-03-26 22:46:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cc9f50>
2026-03-26 22:46:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6b9527f-99d2-56a6-90da-0ff54160ff73/f6b9527f-99d2-56a6-90da-0ff54160ff73_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F0a4033d942754926968dc7938ff8fc44%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/0a4033d942754926968dc7938ff8fc44/images/large/5.jpg saved to cache
2026-03-26 22:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f6b9527f-99d2-56a6-90da-0ff54160ff73
2026-03-26 22:46:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/0a4033d942754926968dc7938ff8fc44/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/0a4033d942754926968dc7938ff8fc44/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F12c905d517de4e959bb4fc6dcd84d266%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/12c905d517de4e959bb4fc6dcd84d266/images/large/9.jpg not downloaded yet
2026-03-26 22:46:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 8fdd8846-38da-5d0c-b5c0-4240e4bdb3a8 with identifier: 1986067
2026-03-26 22:46:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 8fdd8846-38da-5d0c-b5c0-4240e4bdb3a8 with identifier: 1986067
2026-03-26 22:46:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 8fdd8846-38da-5d0c-b5c0-4240e4bdb3a8 with identifier: 1986067 to the API
2026-03-26 22:46:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:46:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:46:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cq/74b02b4724104efe880a23715338f4de/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'electric',
 'id': '8fdd8846-38da-5d0c-b5c0-4240e4bdb3a8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'POLESTAR',
 'model': '2',
 'odometer': 28964,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fdd8846-38da-5d0c-b5c0-4240e4bdb3a8/8fdd8846-38da-5d0c-b5c0-4240e4bdb3a8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 637608,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/74b02b4724104efe880a23715338f4de/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fdd8846-38da-5d0c-b5c0-4240e4bdb3a8/8fdd8846-38da-5d0c-b5c0-4240e4bdb3a8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 641722,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/74b02b4724104efe880a23715338f4de/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fdd8846-38da-5d0c-b5c0-4240e4bdb3a8/8fdd8846-38da-5d0c-b5c0-4240e4bdb3a8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 636090,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/74b02b4724104efe880a23715338f4de/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fdd8846-38da-5d0c-b5c0-4240e4bdb3a8/8fdd8846-38da-5d0c-b5c0-4240e4bdb3a8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 650728,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/74b02b4724104efe880a23715338f4de/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fdd8846-38da-5d0c-b5c0-4240e4bdb3a8/8fdd8846-38da-5d0c-b5c0-4240e4bdb3a8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 598455,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/74b02b4724104efe880a23715338f4de/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fdd8846-38da-5d0c-b5c0-4240e4bdb3a8/8fdd8846-38da-5d0c-b5c0-4240e4bdb3a8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 658776,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/74b02b4724104efe880a23715338f4de/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fdd8846-38da-5d0c-b5c0-4240e4bdb3a8/8fdd8846-38da-5d0c-b5c0-4240e4bdb3a8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 577949,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/74b02b4724104efe880a23715338f4de/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fdd8846-38da-5d0c-b5c0-4240e4bdb3a8/8fdd8846-38da-5d0c-b5c0-4240e4bdb3a8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 783573,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/74b02b4724104efe880a23715338f4de/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fdd8846-38da-5d0c-b5c0-4240e4bdb3a8/8fdd8846-38da-5d0c-b5c0-4240e4bdb3a8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 819507,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/74b02b4724104efe880a23715338f4de/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fdd8846-38da-5d0c-b5c0-4240e4bdb3a8/8fdd8846-38da-5d0c-b5c0-4240e4bdb3a8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 716202,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/74b02b4724104efe880a23715338f4de/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'POLESTAR 2 BEV 78KWH DUAL MOTOR AUTO 4WD LONG RANGE',
 'transmission': 'automatic',
 'trim': 'BEV 78KWH DUAL MOTOR AUTO 4WD LONG RANGE',
 'vin': None,
 'year': 2022}
2026-03-26 22:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986067%27 HTTP/1.1" 200 None
2026-03-26 22:46:37 [ayvens.be] INFO: Saving data for 1986067: {'created_time': 1774565197.022482, 'last_price_update_time': 1774565197.022493, 'auction_closing_time': 1775028600.0}
2026-03-26 22:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986067') HTTP/1.1" 204 0
2026-03-26 22:46:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/0a4033d942754926968dc7938ff8fc44/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F12c905d517de4e959bb4fc6dcd84d266%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/12c905d517de4e959bb4fc6dcd84d266/images/large/10.jpg not downloaded yet
2026-03-26 22:46:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b746ded0>
2026-03-26 22:46:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6b9527f-99d2-56a6-90da-0ff54160ff73/f6b9527f-99d2-56a6-90da-0ff54160ff73_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F0a4033d942754926968dc7938ff8fc44%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/0a4033d942754926968dc7938ff8fc44/images/large/7.jpg saved to cache
2026-03-26 22:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f6b9527f-99d2-56a6-90da-0ff54160ff73
2026-03-26 22:46:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7770910>
2026-03-26 22:46:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6b9527f-99d2-56a6-90da-0ff54160ff73/f6b9527f-99d2-56a6-90da-0ff54160ff73_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F0a4033d942754926968dc7938ff8fc44%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/0a4033d942754926968dc7938ff8fc44/images/large/8.jpg saved to cache
2026-03-26 22:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f6b9527f-99d2-56a6-90da-0ff54160ff73
2026-03-26 22:46:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7ccd850>
2026-03-26 22:46:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13f3b5cb-b2b3-534a-be68-e343ad7b86e7/13f3b5cb-b2b3-534a-be68-e343ad7b86e7_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F12c905d517de4e959bb4fc6dcd84d266%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/12c905d517de4e959bb4fc6dcd84d266/images/large/2.jpg saved to cache
2026-03-26 22:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 13f3b5cb-b2b3-534a-be68-e343ad7b86e7
2026-03-26 22:46:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c60510>
2026-03-26 22:46:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13f3b5cb-b2b3-534a-be68-e343ad7b86e7/13f3b5cb-b2b3-534a-be68-e343ad7b86e7_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F12c905d517de4e959bb4fc6dcd84d266%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/12c905d517de4e959bb4fc6dcd84d266/images/large/1.jpg saved to cache
2026-03-26 22:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 13f3b5cb-b2b3-534a-be68-e343ad7b86e7
2026-03-26 22:46:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c6b550>
2026-03-26 22:46:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6b9527f-99d2-56a6-90da-0ff54160ff73/f6b9527f-99d2-56a6-90da-0ff54160ff73_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F0a4033d942754926968dc7938ff8fc44%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/0a4033d942754926968dc7938ff8fc44/images/large/6.jpg saved to cache
2026-03-26 22:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f6b9527f-99d2-56a6-90da-0ff54160ff73
2026-03-26 22:46:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7410d50>
2026-03-26 22:46:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6b9527f-99d2-56a6-90da-0ff54160ff73/f6b9527f-99d2-56a6-90da-0ff54160ff73_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F0a4033d942754926968dc7938ff8fc44%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/0a4033d942754926968dc7938ff8fc44/images/large/10.jpg saved to cache
2026-03-26 22:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f6b9527f-99d2-56a6-90da-0ff54160ff73
2026-03-26 22:46:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/12c905d517de4e959bb4fc6dcd84d266/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/12c905d517de4e959bb4fc6dcd84d266/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:37 [ayvens.be] INFO: Found listing with ID: 1986070
2026-03-26 22:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986070%27 HTTP/1.1" 200 None
2026-03-26 22:46:37 [ayvens.be] INFO: Scrape type for 1986070: 1
2026-03-26 22:46:37 [ayvens.be] INFO: Extracting data for car ID: 1986070
2026-03-26 22:46:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc6db33d-5eeb-55e6-897a-3a94a462f6ee with identifier: 1986070
2026-03-26 22:46:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc6db33d-5eeb-55e6-897a-3a94a462f6ee with scrape type 1
2026-03-26 22:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dc6db33d-5eeb-55e6-897a-3a94a462f6ee
2026-03-26 22:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fd902a99f2fa04a149a1d5ab5c8526864%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/d902a99f2fa04a149a1d5ab5c8526864/images/large/1.jpg not downloaded yet
2026-03-26 22:46:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/12c905d517de4e959bb4fc6dcd84d266/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/12c905d517de4e959bb4fc6dcd84d266/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fd902a99f2fa04a149a1d5ab5c8526864%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/d902a99f2fa04a149a1d5ab5c8526864/images/large/2.jpg not downloaded yet
2026-03-26 22:46:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e348d0>
2026-03-26 22:46:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6b9527f-99d2-56a6-90da-0ff54160ff73/f6b9527f-99d2-56a6-90da-0ff54160ff73_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F0a4033d942754926968dc7938ff8fc44%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/0a4033d942754926968dc7938ff8fc44/images/large/9.jpg saved to cache
2026-03-26 22:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f6b9527f-99d2-56a6-90da-0ff54160ff73
2026-03-26 22:46:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f6b9527f-99d2-56a6-90da-0ff54160ff73, skipping ID generation
2026-03-26 22:46:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6b9527f-99d2-56a6-90da-0ff54160ff73 with scrape type 1
2026-03-26 22:46:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f6b9527f-99d2-56a6-90da-0ff54160ff73 sending to next pipeline
2026-03-26 22:46:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f6b9527f-99d2-56a6-90da-0ff54160ff73, identifier: 1986068
2026-03-26 22:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fd902a99f2fa04a149a1d5ab5c8526864%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/d902a99f2fa04a149a1d5ab5c8526864/images/large/3.jpg not downloaded yet
2026-03-26 22:46:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f6b9527f-99d2-56a6-90da-0ff54160ff73 with identifier: 1986068
2026-03-26 22:46:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f6b9527f-99d2-56a6-90da-0ff54160ff73 with identifier: 1986068
2026-03-26 22:46:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f6b9527f-99d2-56a6-90da-0ff54160ff73 with identifier: 1986068 to the API
2026-03-26 22:46:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:46:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:46:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bm/0a4033d942754926968dc7938ff8fc44/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'f6b9527f-99d2-56a6-90da-0ff54160ff73',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 80233,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6b9527f-99d2-56a6-90da-0ff54160ff73/f6b9527f-99d2-56a6-90da-0ff54160ff73_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 238892,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/0a4033d942754926968dc7938ff8fc44/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6b9527f-99d2-56a6-90da-0ff54160ff73/f6b9527f-99d2-56a6-90da-0ff54160ff73_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 222213,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/0a4033d942754926968dc7938ff8fc44/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6b9527f-99d2-56a6-90da-0ff54160ff73/f6b9527f-99d2-56a6-90da-0ff54160ff73_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 266215,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/0a4033d942754926968dc7938ff8fc44/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6b9527f-99d2-56a6-90da-0ff54160ff73/f6b9527f-99d2-56a6-90da-0ff54160ff73_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 262431,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/0a4033d942754926968dc7938ff8fc44/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6b9527f-99d2-56a6-90da-0ff54160ff73/f6b9527f-99d2-56a6-90da-0ff54160ff73_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 319211,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/0a4033d942754926968dc7938ff8fc44/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6b9527f-99d2-56a6-90da-0ff54160ff73/f6b9527f-99d2-56a6-90da-0ff54160ff73_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 314061,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/0a4033d942754926968dc7938ff8fc44/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6b9527f-99d2-56a6-90da-0ff54160ff73/f6b9527f-99d2-56a6-90da-0ff54160ff73_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 299493,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/0a4033d942754926968dc7938ff8fc44/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6b9527f-99d2-56a6-90da-0ff54160ff73/f6b9527f-99d2-56a6-90da-0ff54160ff73_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 339128,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/0a4033d942754926968dc7938ff8fc44/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6b9527f-99d2-56a6-90da-0ff54160ff73/f6b9527f-99d2-56a6-90da-0ff54160ff73_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 372823,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/0a4033d942754926968dc7938ff8fc44/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6b9527f-99d2-56a6-90da-0ff54160ff73/f6b9527f-99d2-56a6-90da-0ff54160ff73_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 314491,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/0a4033d942754926968dc7938ff8fc44/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 1.5 SDRIVE16D',
 'transmission': 'manual',
 'trim': '1.5 SDRIVE16D',
 'vin': None,
 'year': 2022}
2026-03-26 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986068%27 HTTP/1.1" 200 None
2026-03-26 22:46:38 [ayvens.be] INFO: Saving data for 1986068: {'created_time': 1774565198.199446, 'last_price_update_time': 1774565198.199455, 'auction_closing_time': 1775028600.0}
2026-03-26 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986068') HTTP/1.1" 204 0
2026-03-26 22:46:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/12c905d517de4e959bb4fc6dcd84d266/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/12c905d517de4e959bb4fc6dcd84d266/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fd902a99f2fa04a149a1d5ab5c8526864%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/d902a99f2fa04a149a1d5ab5c8526864/images/large/4.jpg not downloaded yet
2026-03-26 22:46:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b729c810>
2026-03-26 22:46:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13f3b5cb-b2b3-534a-be68-e343ad7b86e7/13f3b5cb-b2b3-534a-be68-e343ad7b86e7_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F12c905d517de4e959bb4fc6dcd84d266%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/12c905d517de4e959bb4fc6dcd84d266/images/large/4.jpg saved to cache
2026-03-26 22:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 13f3b5cb-b2b3-534a-be68-e343ad7b86e7
2026-03-26 22:46:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76cdfd0>
2026-03-26 22:46:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13f3b5cb-b2b3-534a-be68-e343ad7b86e7/13f3b5cb-b2b3-534a-be68-e343ad7b86e7_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F12c905d517de4e959bb4fc6dcd84d266%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/12c905d517de4e959bb4fc6dcd84d266/images/large/3.jpg saved to cache
2026-03-26 22:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 13f3b5cb-b2b3-534a-be68-e343ad7b86e7
2026-03-26 22:46:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80be057b10>
2026-03-26 22:46:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13f3b5cb-b2b3-534a-be68-e343ad7b86e7/13f3b5cb-b2b3-534a-be68-e343ad7b86e7_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F12c905d517de4e959bb4fc6dcd84d266%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/12c905d517de4e959bb4fc6dcd84d266/images/large/5.jpg saved to cache
2026-03-26 22:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 13f3b5cb-b2b3-534a-be68-e343ad7b86e7
2026-03-26 22:46:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77252d0>
2026-03-26 22:46:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13f3b5cb-b2b3-534a-be68-e343ad7b86e7/13f3b5cb-b2b3-534a-be68-e343ad7b86e7_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F12c905d517de4e959bb4fc6dcd84d266%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/12c905d517de4e959bb4fc6dcd84d266/images/large/6.jpg saved to cache
2026-03-26 22:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 13f3b5cb-b2b3-534a-be68-e343ad7b86e7
2026-03-26 22:46:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/12c905d517de4e959bb4fc6dcd84d266/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fd902a99f2fa04a149a1d5ab5c8526864%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/d902a99f2fa04a149a1d5ab5c8526864/images/large/5.jpg not downloaded yet
2026-03-26 22:46:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/12c905d517de4e959bb4fc6dcd84d266/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fd902a99f2fa04a149a1d5ab5c8526864%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/d902a99f2fa04a149a1d5ab5c8526864/images/large/6.jpg not downloaded yet
2026-03-26 22:46:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6def6d0>
2026-03-26 22:46:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13f3b5cb-b2b3-534a-be68-e343ad7b86e7/13f3b5cb-b2b3-534a-be68-e343ad7b86e7_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F12c905d517de4e959bb4fc6dcd84d266%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/12c905d517de4e959bb4fc6dcd84d266/images/large/7.jpg saved to cache
2026-03-26 22:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 13f3b5cb-b2b3-534a-be68-e343ad7b86e7
2026-03-26 22:46:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b788ead0>
2026-03-26 22:46:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13f3b5cb-b2b3-534a-be68-e343ad7b86e7/13f3b5cb-b2b3-534a-be68-e343ad7b86e7_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F12c905d517de4e959bb4fc6dcd84d266%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/12c905d517de4e959bb4fc6dcd84d266/images/large/8.jpg saved to cache
2026-03-26 22:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 13f3b5cb-b2b3-534a-be68-e343ad7b86e7
2026-03-26 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fd902a99f2fa04a149a1d5ab5c8526864%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/d902a99f2fa04a149a1d5ab5c8526864/images/large/7.jpg not downloaded yet
2026-03-26 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fd902a99f2fa04a149a1d5ab5c8526864%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/d902a99f2fa04a149a1d5ab5c8526864/images/large/8.jpg not downloaded yet
2026-03-26 22:46:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b782dd50>
2026-03-26 22:46:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13f3b5cb-b2b3-534a-be68-e343ad7b86e7/13f3b5cb-b2b3-534a-be68-e343ad7b86e7_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F12c905d517de4e959bb4fc6dcd84d266%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/12c905d517de4e959bb4fc6dcd84d266/images/large/9.jpg saved to cache
2026-03-26 22:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 13f3b5cb-b2b3-534a-be68-e343ad7b86e7
2026-03-26 22:46:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b764a110>
2026-03-26 22:46:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13f3b5cb-b2b3-534a-be68-e343ad7b86e7/13f3b5cb-b2b3-534a-be68-e343ad7b86e7_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F12c905d517de4e959bb4fc6dcd84d266%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/12c905d517de4e959bb4fc6dcd84d266/images/large/10.jpg saved to cache
2026-03-26 22:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 13f3b5cb-b2b3-534a-be68-e343ad7b86e7
2026-03-26 22:46:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 13f3b5cb-b2b3-534a-be68-e343ad7b86e7, skipping ID generation
2026-03-26 22:46:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13f3b5cb-b2b3-534a-be68-e343ad7b86e7 with scrape type 1
2026-03-26 22:46:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 13f3b5cb-b2b3-534a-be68-e343ad7b86e7 sending to next pipeline
2026-03-26 22:46:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 13f3b5cb-b2b3-534a-be68-e343ad7b86e7, identifier: 1986069
2026-03-26 22:46:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/d902a99f2fa04a149a1d5ab5c8526864/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 13f3b5cb-b2b3-534a-be68-e343ad7b86e7 with identifier: 1986069
2026-03-26 22:46:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 13f3b5cb-b2b3-534a-be68-e343ad7b86e7 with identifier: 1986069
2026-03-26 22:46:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 13f3b5cb-b2b3-534a-be68-e343ad7b86e7 with identifier: 1986069 to the API
2026-03-26 22:46:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:46:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:46:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bm/12c905d517de4e959bb4fc6dcd84d266/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '13f3b5cb-b2b3-534a-be68-e343ad7b86e7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'OCTAVIA COMBI',
 'odometer': 99196,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13f3b5cb-b2b3-534a-be68-e343ad7b86e7/13f3b5cb-b2b3-534a-be68-e343ad7b86e7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 238570,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/12c905d517de4e959bb4fc6dcd84d266/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13f3b5cb-b2b3-534a-be68-e343ad7b86e7/13f3b5cb-b2b3-534a-be68-e343ad7b86e7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 231705,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/12c905d517de4e959bb4fc6dcd84d266/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13f3b5cb-b2b3-534a-be68-e343ad7b86e7/13f3b5cb-b2b3-534a-be68-e343ad7b86e7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 250711,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/12c905d517de4e959bb4fc6dcd84d266/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13f3b5cb-b2b3-534a-be68-e343ad7b86e7/13f3b5cb-b2b3-534a-be68-e343ad7b86e7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 244131,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/12c905d517de4e959bb4fc6dcd84d266/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13f3b5cb-b2b3-534a-be68-e343ad7b86e7/13f3b5cb-b2b3-534a-be68-e343ad7b86e7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 303847,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/12c905d517de4e959bb4fc6dcd84d266/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13f3b5cb-b2b3-534a-be68-e343ad7b86e7/13f3b5cb-b2b3-534a-be68-e343ad7b86e7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 299198,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/12c905d517de4e959bb4fc6dcd84d266/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13f3b5cb-b2b3-534a-be68-e343ad7b86e7/13f3b5cb-b2b3-534a-be68-e343ad7b86e7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 291541,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/12c905d517de4e959bb4fc6dcd84d266/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13f3b5cb-b2b3-534a-be68-e343ad7b86e7/13f3b5cb-b2b3-534a-be68-e343ad7b86e7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 301434,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/12c905d517de4e959bb4fc6dcd84d266/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13f3b5cb-b2b3-534a-be68-e343ad7b86e7/13f3b5cb-b2b3-534a-be68-e343ad7b86e7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 230815,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/12c905d517de4e959bb4fc6dcd84d266/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13f3b5cb-b2b3-534a-be68-e343ad7b86e7/13f3b5cb-b2b3-534a-be68-e343ad7b86e7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 303210,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/12c905d517de4e959bb4fc6dcd84d266/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA OCTAVIA COMBI 1.0 TSI MHEV 81KW DSG CLEVER',
 'transmission': 'automatic',
 'trim': '1.0 TSI MHEV 81KW DSG CLEVER',
 'vin': None,
 'year': 2022}
2026-03-26 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986069%27 HTTP/1.1" 200 None
2026-03-26 22:46:39 [ayvens.be] INFO: Saving data for 1986069: {'created_time': 1774565199.314804, 'last_price_update_time': 1774565199.314815, 'auction_closing_time': 1775028600.0}
2026-03-26 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986069') HTTP/1.1" 204 0
2026-03-26 22:46:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/d902a99f2fa04a149a1d5ab5c8526864/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fd902a99f2fa04a149a1d5ab5c8526864%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/d902a99f2fa04a149a1d5ab5c8526864/images/large/9.jpg not downloaded yet
2026-03-26 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fd902a99f2fa04a149a1d5ab5c8526864%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/d902a99f2fa04a149a1d5ab5c8526864/images/large/10.jpg not downloaded yet
2026-03-26 22:46:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/d902a99f2fa04a149a1d5ab5c8526864/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/d902a99f2fa04a149a1d5ab5c8526864/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79f0510>
2026-03-26 22:46:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc6db33d-5eeb-55e6-897a-3a94a462f6ee/dc6db33d-5eeb-55e6-897a-3a94a462f6ee_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fd902a99f2fa04a149a1d5ab5c8526864%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/d902a99f2fa04a149a1d5ab5c8526864/images/large/2.jpg saved to cache
2026-03-26 22:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dc6db33d-5eeb-55e6-897a-3a94a462f6ee
2026-03-26 22:46:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/d902a99f2fa04a149a1d5ab5c8526864/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:39 [ayvens.be] INFO: Found listing with ID: 1986071
2026-03-26 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986071%27 HTTP/1.1" 200 None
2026-03-26 22:46:39 [ayvens.be] INFO: Scrape type for 1986071: 1
2026-03-26 22:46:39 [ayvens.be] INFO: Extracting data for car ID: 1986071
2026-03-26 22:46:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ea2c17f-ff52-5e76-8d4c-a1beb3c4499a with identifier: 1986071
2026-03-26 22:46:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ea2c17f-ff52-5e76-8d4c-a1beb3c4499a with scrape type 1
2026-03-26 22:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9ea2c17f-ff52-5e76-8d4c-a1beb3c4499a
2026-03-26 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252F305f292465624b5ea8f7d3ef28557b18%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/305f292465624b5ea8f7d3ef28557b18/images/large/1.jpg not downloaded yet
2026-03-26 22:46:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/d902a99f2fa04a149a1d5ab5c8526864/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252F305f292465624b5ea8f7d3ef28557b18%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/305f292465624b5ea8f7d3ef28557b18/images/large/2.jpg not downloaded yet
2026-03-26 22:46:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cc0f90>
2026-03-26 22:46:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc6db33d-5eeb-55e6-897a-3a94a462f6ee/dc6db33d-5eeb-55e6-897a-3a94a462f6ee_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fd902a99f2fa04a149a1d5ab5c8526864%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/d902a99f2fa04a149a1d5ab5c8526864/images/large/1.jpg saved to cache
2026-03-26 22:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dc6db33d-5eeb-55e6-897a-3a94a462f6ee
2026-03-26 22:46:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7660410>
2026-03-26 22:46:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc6db33d-5eeb-55e6-897a-3a94a462f6ee/dc6db33d-5eeb-55e6-897a-3a94a462f6ee_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fd902a99f2fa04a149a1d5ab5c8526864%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/d902a99f2fa04a149a1d5ab5c8526864/images/large/4.jpg saved to cache
2026-03-26 22:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dc6db33d-5eeb-55e6-897a-3a94a462f6ee
2026-03-26 22:46:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76c6250>
2026-03-26 22:46:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc6db33d-5eeb-55e6-897a-3a94a462f6ee/dc6db33d-5eeb-55e6-897a-3a94a462f6ee_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fd902a99f2fa04a149a1d5ab5c8526864%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/d902a99f2fa04a149a1d5ab5c8526864/images/large/3.jpg saved to cache
2026-03-26 22:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dc6db33d-5eeb-55e6-897a-3a94a462f6ee
2026-03-26 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252F305f292465624b5ea8f7d3ef28557b18%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/305f292465624b5ea8f7d3ef28557b18/images/large/3.jpg not downloaded yet
2026-03-26 22:46:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/d902a99f2fa04a149a1d5ab5c8526864/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7401050>
2026-03-26 22:46:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc6db33d-5eeb-55e6-897a-3a94a462f6ee/dc6db33d-5eeb-55e6-897a-3a94a462f6ee_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fd902a99f2fa04a149a1d5ab5c8526864%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/d902a99f2fa04a149a1d5ab5c8526864/images/large/6.jpg saved to cache
2026-03-26 22:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dc6db33d-5eeb-55e6-897a-3a94a462f6ee
2026-03-26 22:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252F305f292465624b5ea8f7d3ef28557b18%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/305f292465624b5ea8f7d3ef28557b18/images/large/4.jpg not downloaded yet
2026-03-26 22:46:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5ca3790>
2026-03-26 22:46:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc6db33d-5eeb-55e6-897a-3a94a462f6ee/dc6db33d-5eeb-55e6-897a-3a94a462f6ee_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fd902a99f2fa04a149a1d5ab5c8526864%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/d902a99f2fa04a149a1d5ab5c8526864/images/large/5.jpg saved to cache
2026-03-26 22:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dc6db33d-5eeb-55e6-897a-3a94a462f6ee
2026-03-26 22:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252F305f292465624b5ea8f7d3ef28557b18%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/305f292465624b5ea8f7d3ef28557b18/images/large/5.jpg not downloaded yet
2026-03-26 22:46:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cc3290>
2026-03-26 22:46:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc6db33d-5eeb-55e6-897a-3a94a462f6ee/dc6db33d-5eeb-55e6-897a-3a94a462f6ee_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fd902a99f2fa04a149a1d5ab5c8526864%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/d902a99f2fa04a149a1d5ab5c8526864/images/large/8.jpg saved to cache
2026-03-26 22:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item dc6db33d-5eeb-55e6-897a-3a94a462f6ee
2026-03-26 22:46:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/d902a99f2fa04a149a1d5ab5c8526864/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/d902a99f2fa04a149a1d5ab5c8526864/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252F305f292465624b5ea8f7d3ef28557b18%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/305f292465624b5ea8f7d3ef28557b18/images/large/6.jpg not downloaded yet
2026-03-26 22:46:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/d902a99f2fa04a149a1d5ab5c8526864/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252F305f292465624b5ea8f7d3ef28557b18%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/305f292465624b5ea8f7d3ef28557b18/images/large/7.jpg not downloaded yet
2026-03-26 22:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252F305f292465624b5ea8f7d3ef28557b18%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/305f292465624b5ea8f7d3ef28557b18/images/large/8.jpg not downloaded yet
2026-03-26 22:46:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cg/305f292465624b5ea8f7d3ef28557b18/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252F305f292465624b5ea8f7d3ef28557b18%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/305f292465624b5ea8f7d3ef28557b18/images/large/9.jpg not downloaded yet
2026-03-26 22:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252F305f292465624b5ea8f7d3ef28557b18%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/305f292465624b5ea8f7d3ef28557b18/images/large/10.jpg not downloaded yet
2026-03-26 22:46:40 [ayvens.be] INFO: Found listing with ID: 1986072
2026-03-26 22:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986072%27 HTTP/1.1" 200 None
2026-03-26 22:46:40 [ayvens.be] INFO: Scrape type for 1986072: 1
2026-03-26 22:46:40 [ayvens.be] INFO: Extracting data for car ID: 1986072
2026-03-26 22:46:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a3eddde3-6de0-5a86-94ca-bf01d083fe0f with identifier: 1986072
2026-03-26 22:46:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3eddde3-6de0-5a86-94ca-bf01d083fe0f with scrape type 1
2026-03-26 22:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a3eddde3-6de0-5a86-94ca-bf01d083fe0f
2026-03-26 22:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F555a30ad031b4229a85dd8e5949424cc%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/555a30ad031b4229a85dd8e5949424cc/images/large/1.jpg not downloaded yet
2026-03-26 22:46:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cg/305f292465624b5ea8f7d3ef28557b18/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F555a30ad031b4229a85dd8e5949424cc%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/555a30ad031b4229a85dd8e5949424cc/images/large/2.jpg not downloaded yet
2026-03-26 22:46:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76a4b50>
2026-03-26 22:46:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc6db33d-5eeb-55e6-897a-3a94a462f6ee/dc6db33d-5eeb-55e6-897a-3a94a462f6ee_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fd902a99f2fa04a149a1d5ab5c8526864%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/d902a99f2fa04a149a1d5ab5c8526864/images/large/9.jpg saved to cache
2026-03-26 22:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item dc6db33d-5eeb-55e6-897a-3a94a462f6ee
2026-03-26 22:46:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd3bad90>
2026-03-26 22:46:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc6db33d-5eeb-55e6-897a-3a94a462f6ee/dc6db33d-5eeb-55e6-897a-3a94a462f6ee_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fd902a99f2fa04a149a1d5ab5c8526864%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/d902a99f2fa04a149a1d5ab5c8526864/images/large/7.jpg saved to cache
2026-03-26 22:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item dc6db33d-5eeb-55e6-897a-3a94a462f6ee
2026-03-26 22:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F555a30ad031b4229a85dd8e5949424cc%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/555a30ad031b4229a85dd8e5949424cc/images/large/3.jpg not downloaded yet
2026-03-26 22:46:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79f2750>
2026-03-26 22:46:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc6db33d-5eeb-55e6-897a-3a94a462f6ee/dc6db33d-5eeb-55e6-897a-3a94a462f6ee_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fd902a99f2fa04a149a1d5ab5c8526864%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/d902a99f2fa04a149a1d5ab5c8526864/images/large/10.jpg saved to cache
2026-03-26 22:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item dc6db33d-5eeb-55e6-897a-3a94a462f6ee
2026-03-26 22:46:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dc6db33d-5eeb-55e6-897a-3a94a462f6ee, skipping ID generation
2026-03-26 22:46:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc6db33d-5eeb-55e6-897a-3a94a462f6ee with scrape type 1
2026-03-26 22:46:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dc6db33d-5eeb-55e6-897a-3a94a462f6ee sending to next pipeline
2026-03-26 22:46:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: dc6db33d-5eeb-55e6-897a-3a94a462f6ee, identifier: 1986070
2026-03-26 22:46:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7476190>
2026-03-26 22:46:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ea2c17f-ff52-5e76-8d4c-a1beb3c4499a/9ea2c17f-ff52-5e76-8d4c-a1beb3c4499a_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252F305f292465624b5ea8f7d3ef28557b18%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/305f292465624b5ea8f7d3ef28557b18/images/large/1.jpg saved to cache
2026-03-26 22:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9ea2c17f-ff52-5e76-8d4c-a1beb3c4499a
2026-03-26 22:46:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cg/305f292465624b5ea8f7d3ef28557b18/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: dc6db33d-5eeb-55e6-897a-3a94a462f6ee with identifier: 1986070
2026-03-26 22:46:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: dc6db33d-5eeb-55e6-897a-3a94a462f6ee with identifier: 1986070
2026-03-26 22:46:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: dc6db33d-5eeb-55e6-897a-3a94a462f6ee with identifier: 1986070 to the API
2026-03-26 22:46:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:46:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:46:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bs/d902a99f2fa04a149a1d5ab5c8526864/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'dc6db33d-5eeb-55e6-897a-3a94a462f6ee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'MINI',
 'model': 'MINI 5 DOOR',
 'odometer': 57492,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc6db33d-5eeb-55e6-897a-3a94a462f6ee/dc6db33d-5eeb-55e6-897a-3a94a462f6ee_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 498321,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/d902a99f2fa04a149a1d5ab5c8526864/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc6db33d-5eeb-55e6-897a-3a94a462f6ee/dc6db33d-5eeb-55e6-897a-3a94a462f6ee_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 433025,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/d902a99f2fa04a149a1d5ab5c8526864/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc6db33d-5eeb-55e6-897a-3a94a462f6ee/dc6db33d-5eeb-55e6-897a-3a94a462f6ee_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 431769,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/d902a99f2fa04a149a1d5ab5c8526864/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc6db33d-5eeb-55e6-897a-3a94a462f6ee/dc6db33d-5eeb-55e6-897a-3a94a462f6ee_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 393205,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/d902a99f2fa04a149a1d5ab5c8526864/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc6db33d-5eeb-55e6-897a-3a94a462f6ee/dc6db33d-5eeb-55e6-897a-3a94a462f6ee_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 425128,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/d902a99f2fa04a149a1d5ab5c8526864/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc6db33d-5eeb-55e6-897a-3a94a462f6ee/dc6db33d-5eeb-55e6-897a-3a94a462f6ee_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 305629,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/d902a99f2fa04a149a1d5ab5c8526864/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc6db33d-5eeb-55e6-897a-3a94a462f6ee/dc6db33d-5eeb-55e6-897a-3a94a462f6ee_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 344471,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/d902a99f2fa04a149a1d5ab5c8526864/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc6db33d-5eeb-55e6-897a-3a94a462f6ee/dc6db33d-5eeb-55e6-897a-3a94a462f6ee_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 315465,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/d902a99f2fa04a149a1d5ab5c8526864/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc6db33d-5eeb-55e6-897a-3a94a462f6ee/dc6db33d-5eeb-55e6-897a-3a94a462f6ee_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 381423,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/d902a99f2fa04a149a1d5ab5c8526864/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc6db33d-5eeb-55e6-897a-3a94a462f6ee/dc6db33d-5eeb-55e6-897a-3a94a462f6ee_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 398873,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/d902a99f2fa04a149a1d5ab5c8526864/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI MINI 5 DOOR 1.5 COOPER',
 'transmission': 'manual',
 'trim': '1.5 COOPER',
 'vin': None,
 'year': 2022}
2026-03-26 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986070%27 HTTP/1.1" 200 None
2026-03-26 22:46:41 [ayvens.be] INFO: Saving data for 1986070: {'created_time': 1774565201.982027, 'last_price_update_time': 1774565201.982037, 'auction_closing_time': 1775028600.0}
2026-03-26 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986070') HTTP/1.1" 204 0
2026-03-26 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F555a30ad031b4229a85dd8e5949424cc%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/555a30ad031b4229a85dd8e5949424cc/images/large/4.jpg not downloaded yet
2026-03-26 22:46:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5ca2810>
2026-03-26 22:46:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ea2c17f-ff52-5e76-8d4c-a1beb3c4499a/9ea2c17f-ff52-5e76-8d4c-a1beb3c4499a_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252F305f292465624b5ea8f7d3ef28557b18%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/305f292465624b5ea8f7d3ef28557b18/images/large/3.jpg saved to cache
2026-03-26 22:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9ea2c17f-ff52-5e76-8d4c-a1beb3c4499a
2026-03-26 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F555a30ad031b4229a85dd8e5949424cc%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/555a30ad031b4229a85dd8e5949424cc/images/large/5.jpg not downloaded yet
2026-03-26 22:46:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7587690>
2026-03-26 22:46:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ea2c17f-ff52-5e76-8d4c-a1beb3c4499a/9ea2c17f-ff52-5e76-8d4c-a1beb3c4499a_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252F305f292465624b5ea8f7d3ef28557b18%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/305f292465624b5ea8f7d3ef28557b18/images/large/2.jpg saved to cache
2026-03-26 22:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9ea2c17f-ff52-5e76-8d4c-a1beb3c4499a
2026-03-26 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F555a30ad031b4229a85dd8e5949424cc%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/555a30ad031b4229a85dd8e5949424cc/images/large/6.jpg not downloaded yet
2026-03-26 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F555a30ad031b4229a85dd8e5949424cc%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/555a30ad031b4229a85dd8e5949424cc/images/large/7.jpg not downloaded yet
2026-03-26 22:46:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cg/305f292465624b5ea8f7d3ef28557b18/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cg/305f292465624b5ea8f7d3ef28557b18/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cg/305f292465624b5ea8f7d3ef28557b18/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cg/305f292465624b5ea8f7d3ef28557b18/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F555a30ad031b4229a85dd8e5949424cc%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/555a30ad031b4229a85dd8e5949424cc/images/large/8.jpg not downloaded yet
2026-03-26 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F555a30ad031b4229a85dd8e5949424cc%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/555a30ad031b4229a85dd8e5949424cc/images/large/9.jpg not downloaded yet
2026-03-26 22:46:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cg/305f292465624b5ea8f7d3ef28557b18/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/555a30ad031b4229a85dd8e5949424cc/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cg/305f292465624b5ea8f7d3ef28557b18/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cg/305f292465624b5ea8f7d3ef28557b18/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F555a30ad031b4229a85dd8e5949424cc%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/555a30ad031b4229a85dd8e5949424cc/images/large/10.jpg not downloaded yet
2026-03-26 22:46:42 [ayvens.be] INFO: Found listing with ID: 1986073
2026-03-26 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986073%27 HTTP/1.1" 200 None
2026-03-26 22:46:42 [ayvens.be] INFO: Scrape type for 1986073: 1
2026-03-26 22:46:42 [ayvens.be] INFO: Extracting data for car ID: 1986073
2026-03-26 22:46:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9fa71a98-41e8-5bbe-99a8-dff2a6c43ead with identifier: 1986073
2026-03-26 22:46:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9fa71a98-41e8-5bbe-99a8-dff2a6c43ead with scrape type 1
2026-03-26 22:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9fa71a98-41e8-5bbe-99a8-dff2a6c43ead
2026-03-26 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F367598e3b77a4ac4a0821e6fd67c04d0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/367598e3b77a4ac4a0821e6fd67c04d0/images/large/1.jpg not downloaded yet
2026-03-26 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F367598e3b77a4ac4a0821e6fd67c04d0%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/367598e3b77a4ac4a0821e6fd67c04d0/images/large/2.jpg not downloaded yet
2026-03-26 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F367598e3b77a4ac4a0821e6fd67c04d0%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/367598e3b77a4ac4a0821e6fd67c04d0/images/large/3.jpg not downloaded yet
2026-03-26 22:46:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b743b690>
2026-03-26 22:46:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ea2c17f-ff52-5e76-8d4c-a1beb3c4499a/9ea2c17f-ff52-5e76-8d4c-a1beb3c4499a_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252F305f292465624b5ea8f7d3ef28557b18%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/305f292465624b5ea8f7d3ef28557b18/images/large/6.jpg saved to cache
2026-03-26 22:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9ea2c17f-ff52-5e76-8d4c-a1beb3c4499a
2026-03-26 22:46:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b727c210>
2026-03-26 22:46:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ea2c17f-ff52-5e76-8d4c-a1beb3c4499a/9ea2c17f-ff52-5e76-8d4c-a1beb3c4499a_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252F305f292465624b5ea8f7d3ef28557b18%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/305f292465624b5ea8f7d3ef28557b18/images/large/4.jpg saved to cache
2026-03-26 22:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9ea2c17f-ff52-5e76-8d4c-a1beb3c4499a
2026-03-26 22:46:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c69350>
2026-03-26 22:46:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ea2c17f-ff52-5e76-8d4c-a1beb3c4499a/9ea2c17f-ff52-5e76-8d4c-a1beb3c4499a_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252F305f292465624b5ea8f7d3ef28557b18%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/305f292465624b5ea8f7d3ef28557b18/images/large/7.jpg saved to cache
2026-03-26 22:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9ea2c17f-ff52-5e76-8d4c-a1beb3c4499a
2026-03-26 22:46:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74e7a90>
2026-03-26 22:46:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ea2c17f-ff52-5e76-8d4c-a1beb3c4499a/9ea2c17f-ff52-5e76-8d4c-a1beb3c4499a_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252F305f292465624b5ea8f7d3ef28557b18%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/305f292465624b5ea8f7d3ef28557b18/images/large/5.jpg saved to cache
2026-03-26 22:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9ea2c17f-ff52-5e76-8d4c-a1beb3c4499a
2026-03-26 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F367598e3b77a4ac4a0821e6fd67c04d0%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/367598e3b77a4ac4a0821e6fd67c04d0/images/large/4.jpg not downloaded yet
2026-03-26 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F367598e3b77a4ac4a0821e6fd67c04d0%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/367598e3b77a4ac4a0821e6fd67c04d0/images/large/5.jpg not downloaded yet
2026-03-26 22:46:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd3b5e50>
2026-03-26 22:46:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ea2c17f-ff52-5e76-8d4c-a1beb3c4499a/9ea2c17f-ff52-5e76-8d4c-a1beb3c4499a_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252F305f292465624b5ea8f7d3ef28557b18%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/305f292465624b5ea8f7d3ef28557b18/images/large/9.jpg saved to cache
2026-03-26 22:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9ea2c17f-ff52-5e76-8d4c-a1beb3c4499a
2026-03-26 22:46:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e297d0>
2026-03-26 22:46:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3eddde3-6de0-5a86-94ca-bf01d083fe0f/a3eddde3-6de0-5a86-94ca-bf01d083fe0f_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F555a30ad031b4229a85dd8e5949424cc%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/555a30ad031b4229a85dd8e5949424cc/images/large/1.jpg saved to cache
2026-03-26 22:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a3eddde3-6de0-5a86-94ca-bf01d083fe0f
2026-03-26 22:46:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74e4290>
2026-03-26 22:46:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ea2c17f-ff52-5e76-8d4c-a1beb3c4499a/9ea2c17f-ff52-5e76-8d4c-a1beb3c4499a_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252F305f292465624b5ea8f7d3ef28557b18%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/305f292465624b5ea8f7d3ef28557b18/images/large/8.jpg saved to cache
2026-03-26 22:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9ea2c17f-ff52-5e76-8d4c-a1beb3c4499a
2026-03-26 22:46:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7cea110>
2026-03-26 22:46:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ea2c17f-ff52-5e76-8d4c-a1beb3c4499a/9ea2c17f-ff52-5e76-8d4c-a1beb3c4499a_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252F305f292465624b5ea8f7d3ef28557b18%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/305f292465624b5ea8f7d3ef28557b18/images/large/10.jpg saved to cache
2026-03-26 22:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9ea2c17f-ff52-5e76-8d4c-a1beb3c4499a
2026-03-26 22:46:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9ea2c17f-ff52-5e76-8d4c-a1beb3c4499a, skipping ID generation
2026-03-26 22:46:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ea2c17f-ff52-5e76-8d4c-a1beb3c4499a with scrape type 1
2026-03-26 22:46:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9ea2c17f-ff52-5e76-8d4c-a1beb3c4499a sending to next pipeline
2026-03-26 22:46:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 9ea2c17f-ff52-5e76-8d4c-a1beb3c4499a, identifier: 1986071
2026-03-26 22:46:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 9ea2c17f-ff52-5e76-8d4c-a1beb3c4499a with identifier: 1986071
2026-03-26 22:46:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 9ea2c17f-ff52-5e76-8d4c-a1beb3c4499a with identifier: 1986071
2026-03-26 22:46:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 9ea2c17f-ff52-5e76-8d4c-a1beb3c4499a with identifier: 1986071 to the API
2026-03-26 22:46:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:46:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:46:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cg/305f292465624b5ea8f7d3ef28557b18/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '9ea2c17f-ff52-5e76-8d4c-a1beb3c4499a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'B-CLASS',
 'odometer': 37940,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ea2c17f-ff52-5e76-8d4c-a1beb3c4499a/9ea2c17f-ff52-5e76-8d4c-a1beb3c4499a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 644571,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cg/305f292465624b5ea8f7d3ef28557b18/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ea2c17f-ff52-5e76-8d4c-a1beb3c4499a/9ea2c17f-ff52-5e76-8d4c-a1beb3c4499a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 628550,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cg/305f292465624b5ea8f7d3ef28557b18/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ea2c17f-ff52-5e76-8d4c-a1beb3c4499a/9ea2c17f-ff52-5e76-8d4c-a1beb3c4499a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 615570,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cg/305f292465624b5ea8f7d3ef28557b18/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ea2c17f-ff52-5e76-8d4c-a1beb3c4499a/9ea2c17f-ff52-5e76-8d4c-a1beb3c4499a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 660859,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cg/305f292465624b5ea8f7d3ef28557b18/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ea2c17f-ff52-5e76-8d4c-a1beb3c4499a/9ea2c17f-ff52-5e76-8d4c-a1beb3c4499a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 662117,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cg/305f292465624b5ea8f7d3ef28557b18/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ea2c17f-ff52-5e76-8d4c-a1beb3c4499a/9ea2c17f-ff52-5e76-8d4c-a1beb3c4499a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 717015,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cg/305f292465624b5ea8f7d3ef28557b18/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ea2c17f-ff52-5e76-8d4c-a1beb3c4499a/9ea2c17f-ff52-5e76-8d4c-a1beb3c4499a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 688315,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cg/305f292465624b5ea8f7d3ef28557b18/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ea2c17f-ff52-5e76-8d4c-a1beb3c4499a/9ea2c17f-ff52-5e76-8d4c-a1beb3c4499a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 924621,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cg/305f292465624b5ea8f7d3ef28557b18/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ea2c17f-ff52-5e76-8d4c-a1beb3c4499a/9ea2c17f-ff52-5e76-8d4c-a1beb3c4499a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 862322,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cg/305f292465624b5ea8f7d3ef28557b18/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ea2c17f-ff52-5e76-8d4c-a1beb3c4499a/9ea2c17f-ff52-5e76-8d4c-a1beb3c4499a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 796608,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cg/305f292465624b5ea8f7d3ef28557b18/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ B-CLASS 2.0 B 180 D BUSINESS SOLUTION',
 'transmission': 'manual',
 'trim': '2.0 B 180 D BUSINESS SOLUTION',
 'vin': None,
 'year': 2022}
2026-03-26 22:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986071%27 HTTP/1.1" 200 None
2026-03-26 22:46:43 [ayvens.be] INFO: Saving data for 1986071: {'created_time': 1774565203.656065, 'last_price_update_time': 1774565203.656075, 'auction_closing_time': 1775028600.0}
2026-03-26 22:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986071') HTTP/1.1" 204 0
2026-03-26 22:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F367598e3b77a4ac4a0821e6fd67c04d0%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/367598e3b77a4ac4a0821e6fd67c04d0/images/large/6.jpg not downloaded yet
2026-03-26 22:46:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/555a30ad031b4229a85dd8e5949424cc/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/555a30ad031b4229a85dd8e5949424cc/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F367598e3b77a4ac4a0821e6fd67c04d0%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/367598e3b77a4ac4a0821e6fd67c04d0/images/large/7.jpg not downloaded yet
2026-03-26 22:46:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/555a30ad031b4229a85dd8e5949424cc/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/555a30ad031b4229a85dd8e5949424cc/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/555a30ad031b4229a85dd8e5949424cc/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F367598e3b77a4ac4a0821e6fd67c04d0%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/367598e3b77a4ac4a0821e6fd67c04d0/images/large/8.jpg not downloaded yet
2026-03-26 22:46:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/555a30ad031b4229a85dd8e5949424cc/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F367598e3b77a4ac4a0821e6fd67c04d0%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/367598e3b77a4ac4a0821e6fd67c04d0/images/large/9.jpg not downloaded yet
2026-03-26 22:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F367598e3b77a4ac4a0821e6fd67c04d0%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/367598e3b77a4ac4a0821e6fd67c04d0/images/large/10.jpg not downloaded yet
2026-03-26 22:46:43 [ayvens.be] INFO: Found listing with ID: 1986074
2026-03-26 22:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986074%27 HTTP/1.1" 200 None
2026-03-26 22:46:43 [ayvens.be] INFO: Scrape type for 1986074: 1
2026-03-26 22:46:43 [ayvens.be] INFO: Extracting data for car ID: 1986074
2026-03-26 22:46:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e1c363ea-e892-5a47-b252-9beca2f973a5 with identifier: 1986074
2026-03-26 22:46:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e1c363ea-e892-5a47-b252-9beca2f973a5 with scrape type 1
2026-03-26 22:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e1c363ea-e892-5a47-b252-9beca2f973a5
2026-03-26 22:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F65d65de752da4f1790e058409738cdcd%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/65d65de752da4f1790e058409738cdcd/images/large/1.jpg not downloaded yet
2026-03-26 22:46:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/367598e3b77a4ac4a0821e6fd67c04d0/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F65d65de752da4f1790e058409738cdcd%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/65d65de752da4f1790e058409738cdcd/images/large/2.jpg not downloaded yet
2026-03-26 22:46:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7477c90>
2026-03-26 22:46:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3eddde3-6de0-5a86-94ca-bf01d083fe0f/a3eddde3-6de0-5a86-94ca-bf01d083fe0f_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F555a30ad031b4229a85dd8e5949424cc%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/555a30ad031b4229a85dd8e5949424cc/images/large/6.jpg saved to cache
2026-03-26 22:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a3eddde3-6de0-5a86-94ca-bf01d083fe0f
2026-03-26 22:46:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76ec150>
2026-03-26 22:46:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3eddde3-6de0-5a86-94ca-bf01d083fe0f/a3eddde3-6de0-5a86-94ca-bf01d083fe0f_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F555a30ad031b4229a85dd8e5949424cc%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/555a30ad031b4229a85dd8e5949424cc/images/large/3.jpg saved to cache
2026-03-26 22:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a3eddde3-6de0-5a86-94ca-bf01d083fe0f
2026-03-26 22:46:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7877510>
2026-03-26 22:46:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3eddde3-6de0-5a86-94ca-bf01d083fe0f/a3eddde3-6de0-5a86-94ca-bf01d083fe0f_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F555a30ad031b4229a85dd8e5949424cc%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/555a30ad031b4229a85dd8e5949424cc/images/large/5.jpg saved to cache
2026-03-26 22:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a3eddde3-6de0-5a86-94ca-bf01d083fe0f
2026-03-26 22:46:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76ed190>
2026-03-26 22:46:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3eddde3-6de0-5a86-94ca-bf01d083fe0f/a3eddde3-6de0-5a86-94ca-bf01d083fe0f_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F555a30ad031b4229a85dd8e5949424cc%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/555a30ad031b4229a85dd8e5949424cc/images/large/4.jpg saved to cache
2026-03-26 22:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a3eddde3-6de0-5a86-94ca-bf01d083fe0f
2026-03-26 22:46:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74e6190>
2026-03-26 22:46:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3eddde3-6de0-5a86-94ca-bf01d083fe0f/a3eddde3-6de0-5a86-94ca-bf01d083fe0f_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F555a30ad031b4229a85dd8e5949424cc%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/555a30ad031b4229a85dd8e5949424cc/images/large/7.jpg saved to cache
2026-03-26 22:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a3eddde3-6de0-5a86-94ca-bf01d083fe0f
2026-03-26 22:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F65d65de752da4f1790e058409738cdcd%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/65d65de752da4f1790e058409738cdcd/images/large/3.jpg not downloaded yet
2026-03-26 22:46:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cc9bd0>
2026-03-26 22:46:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3eddde3-6de0-5a86-94ca-bf01d083fe0f/a3eddde3-6de0-5a86-94ca-bf01d083fe0f_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F555a30ad031b4229a85dd8e5949424cc%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/555a30ad031b4229a85dd8e5949424cc/images/large/8.jpg saved to cache
2026-03-26 22:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a3eddde3-6de0-5a86-94ca-bf01d083fe0f
2026-03-26 22:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F65d65de752da4f1790e058409738cdcd%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/65d65de752da4f1790e058409738cdcd/images/large/4.jpg not downloaded yet
2026-03-26 22:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F65d65de752da4f1790e058409738cdcd%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/65d65de752da4f1790e058409738cdcd/images/large/5.jpg not downloaded yet
2026-03-26 22:46:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7876c10>
2026-03-26 22:46:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9fa71a98-41e8-5bbe-99a8-dff2a6c43ead/9fa71a98-41e8-5bbe-99a8-dff2a6c43ead_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F367598e3b77a4ac4a0821e6fd67c04d0%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/367598e3b77a4ac4a0821e6fd67c04d0/images/large/3.jpg saved to cache
2026-03-26 22:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9fa71a98-41e8-5bbe-99a8-dff2a6c43ead
2026-03-26 22:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F65d65de752da4f1790e058409738cdcd%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/65d65de752da4f1790e058409738cdcd/images/large/6.jpg not downloaded yet
2026-03-26 22:46:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/555a30ad031b4229a85dd8e5949424cc/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/555a30ad031b4229a85dd8e5949424cc/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F65d65de752da4f1790e058409738cdcd%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/65d65de752da4f1790e058409738cdcd/images/large/7.jpg not downloaded yet
2026-03-26 22:46:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/367598e3b77a4ac4a0821e6fd67c04d0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/367598e3b77a4ac4a0821e6fd67c04d0/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F65d65de752da4f1790e058409738cdcd%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/65d65de752da4f1790e058409738cdcd/images/large/8.jpg not downloaded yet
2026-03-26 22:46:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/367598e3b77a4ac4a0821e6fd67c04d0/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/367598e3b77a4ac4a0821e6fd67c04d0/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/367598e3b77a4ac4a0821e6fd67c04d0/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F65d65de752da4f1790e058409738cdcd%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/65d65de752da4f1790e058409738cdcd/images/large/9.jpg not downloaded yet
2026-03-26 22:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F65d65de752da4f1790e058409738cdcd%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/65d65de752da4f1790e058409738cdcd/images/large/10.jpg not downloaded yet
2026-03-26 22:46:44 [ayvens.be] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 100
2026-03-26 22:46:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/555a30ad031b4229a85dd8e5949424cc/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-26 22:46:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7cce7d0>
2026-03-26 22:46:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3eddde3-6de0-5a86-94ca-bf01d083fe0f/a3eddde3-6de0-5a86-94ca-bf01d083fe0f_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F555a30ad031b4229a85dd8e5949424cc%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/555a30ad031b4229a85dd8e5949424cc/images/large/10.jpg saved to cache
2026-03-26 22:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a3eddde3-6de0-5a86-94ca-bf01d083fe0f
2026-03-26 22:46:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b745bc90>
2026-03-26 22:46:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3eddde3-6de0-5a86-94ca-bf01d083fe0f/a3eddde3-6de0-5a86-94ca-bf01d083fe0f_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F555a30ad031b4229a85dd8e5949424cc%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/555a30ad031b4229a85dd8e5949424cc/images/large/9.jpg saved to cache
2026-03-26 22:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a3eddde3-6de0-5a86-94ca-bf01d083fe0f
2026-03-26 22:46:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74b7350>
2026-03-26 22:46:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9fa71a98-41e8-5bbe-99a8-dff2a6c43ead/9fa71a98-41e8-5bbe-99a8-dff2a6c43ead_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F367598e3b77a4ac4a0821e6fd67c04d0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/367598e3b77a4ac4a0821e6fd67c04d0/images/large/1.jpg saved to cache
2026-03-26 22:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9fa71a98-41e8-5bbe-99a8-dff2a6c43ead
2026-03-26 22:46:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b740b350>
2026-03-26 22:46:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9fa71a98-41e8-5bbe-99a8-dff2a6c43ead/9fa71a98-41e8-5bbe-99a8-dff2a6c43ead_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F367598e3b77a4ac4a0821e6fd67c04d0%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/367598e3b77a4ac4a0821e6fd67c04d0/images/large/4.jpg saved to cache
2026-03-26 22:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9fa71a98-41e8-5bbe-99a8-dff2a6c43ead
2026-03-26 22:46:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7408c90>
2026-03-26 22:46:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9fa71a98-41e8-5bbe-99a8-dff2a6c43ead/9fa71a98-41e8-5bbe-99a8-dff2a6c43ead_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F367598e3b77a4ac4a0821e6fd67c04d0%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/367598e3b77a4ac4a0821e6fd67c04d0/images/large/5.jpg saved to cache
2026-03-26 22:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9fa71a98-41e8-5bbe-99a8-dff2a6c43ead
2026-03-26 22:46:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77ac150>
2026-03-26 22:46:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9fa71a98-41e8-5bbe-99a8-dff2a6c43ead/9fa71a98-41e8-5bbe-99a8-dff2a6c43ead_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F367598e3b77a4ac4a0821e6fd67c04d0%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/367598e3b77a4ac4a0821e6fd67c04d0/images/large/6.jpg saved to cache
2026-03-26 22:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9fa71a98-41e8-5bbe-99a8-dff2a6c43ead
2026-03-26 22:46:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77ae490>
2026-03-26 22:46:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9fa71a98-41e8-5bbe-99a8-dff2a6c43ead/9fa71a98-41e8-5bbe-99a8-dff2a6c43ead_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F367598e3b77a4ac4a0821e6fd67c04d0%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/367598e3b77a4ac4a0821e6fd67c04d0/images/large/2.jpg saved to cache
2026-03-26 22:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9fa71a98-41e8-5bbe-99a8-dff2a6c43ead
2026-03-26 22:46:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74b4a10>
2026-03-26 22:46:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3eddde3-6de0-5a86-94ca-bf01d083fe0f/a3eddde3-6de0-5a86-94ca-bf01d083fe0f_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F555a30ad031b4229a85dd8e5949424cc%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/555a30ad031b4229a85dd8e5949424cc/images/large/2.jpg saved to cache
2026-03-26 22:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a3eddde3-6de0-5a86-94ca-bf01d083fe0f
2026-03-26 22:46:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a3eddde3-6de0-5a86-94ca-bf01d083fe0f, skipping ID generation
2026-03-26 22:46:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3eddde3-6de0-5a86-94ca-bf01d083fe0f with scrape type 1
2026-03-26 22:46:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a3eddde3-6de0-5a86-94ca-bf01d083fe0f sending to next pipeline
2026-03-26 22:46:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a3eddde3-6de0-5a86-94ca-bf01d083fe0f, identifier: 1986072
2026-03-26 22:46:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a3eddde3-6de0-5a86-94ca-bf01d083fe0f with identifier: 1986072
2026-03-26 22:46:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a3eddde3-6de0-5a86-94ca-bf01d083fe0f with identifier: 1986072
2026-03-26 22:46:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a3eddde3-6de0-5a86-94ca-bf01d083fe0f with identifier: 1986072 to the API
2026-03-26 22:46:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:46:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:46:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bw/555a30ad031b4229a85dd8e5949424cc/images/large/2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'a3eddde3-6de0-5a86-94ca-bf01d083fe0f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 90381,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3eddde3-6de0-5a86-94ca-bf01d083fe0f/a3eddde3-6de0-5a86-94ca-bf01d083fe0f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 565998,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/555a30ad031b4229a85dd8e5949424cc/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3eddde3-6de0-5a86-94ca-bf01d083fe0f/a3eddde3-6de0-5a86-94ca-bf01d083fe0f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 563509,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/555a30ad031b4229a85dd8e5949424cc/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3eddde3-6de0-5a86-94ca-bf01d083fe0f/a3eddde3-6de0-5a86-94ca-bf01d083fe0f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 585927,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/555a30ad031b4229a85dd8e5949424cc/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3eddde3-6de0-5a86-94ca-bf01d083fe0f/a3eddde3-6de0-5a86-94ca-bf01d083fe0f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 581073,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/555a30ad031b4229a85dd8e5949424cc/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3eddde3-6de0-5a86-94ca-bf01d083fe0f/a3eddde3-6de0-5a86-94ca-bf01d083fe0f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 518941,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/555a30ad031b4229a85dd8e5949424cc/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3eddde3-6de0-5a86-94ca-bf01d083fe0f/a3eddde3-6de0-5a86-94ca-bf01d083fe0f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 526815,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/555a30ad031b4229a85dd8e5949424cc/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3eddde3-6de0-5a86-94ca-bf01d083fe0f/a3eddde3-6de0-5a86-94ca-bf01d083fe0f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 571618,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/555a30ad031b4229a85dd8e5949424cc/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3eddde3-6de0-5a86-94ca-bf01d083fe0f/a3eddde3-6de0-5a86-94ca-bf01d083fe0f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 623144,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/555a30ad031b4229a85dd8e5949424cc/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3eddde3-6de0-5a86-94ca-bf01d083fe0f/a3eddde3-6de0-5a86-94ca-bf01d083fe0f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 518476,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/555a30ad031b4229a85dd8e5949424cc/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3eddde3-6de0-5a86-94ca-bf01d083fe0f/a3eddde3-6de0-5a86-94ca-bf01d083fe0f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 451728,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/555a30ad031b4229a85dd8e5949424cc/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T4 PHEV INSCRIPTION EXPR. DCT',
 'transmission': 'automatic',
 'trim': '1.5 T4 PHEV INSCRIPTION EXPR. DCT',
 'vin': None,
 'year': 2022}
2026-03-26 22:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986072%27 HTTP/1.1" 200 None
2026-03-26 22:46:46 [ayvens.be] INFO: Saving data for 1986072: {'created_time': 1774565206.110522, 'last_price_update_time': 1774565206.110533, 'auction_closing_time': 1775028600.0}
2026-03-26 22:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986072') HTTP/1.1" 204 0
2026-03-26 22:46:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/367598e3b77a4ac4a0821e6fd67c04d0/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ax/65d65de752da4f1790e058409738cdcd/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ax/65d65de752da4f1790e058409738cdcd/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/367598e3b77a4ac4a0821e6fd67c04d0/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/367598e3b77a4ac4a0821e6fd67c04d0/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ax/65d65de752da4f1790e058409738cdcd/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/367598e3b77a4ac4a0821e6fd67c04d0/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ax/65d65de752da4f1790e058409738cdcd/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b725ff50>
2026-03-26 22:46:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9fa71a98-41e8-5bbe-99a8-dff2a6c43ead/9fa71a98-41e8-5bbe-99a8-dff2a6c43ead_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F367598e3b77a4ac4a0821e6fd67c04d0%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/367598e3b77a4ac4a0821e6fd67c04d0/images/large/7.jpg saved to cache
2026-03-26 22:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9fa71a98-41e8-5bbe-99a8-dff2a6c43ead
2026-03-26 22:46:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79fab50>
2026-03-26 22:46:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1c363ea-e892-5a47-b252-9beca2f973a5/e1c363ea-e892-5a47-b252-9beca2f973a5_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F65d65de752da4f1790e058409738cdcd%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/65d65de752da4f1790e058409738cdcd/images/large/3.jpg saved to cache
2026-03-26 22:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e1c363ea-e892-5a47-b252-9beca2f973a5
2026-03-26 22:46:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b16290>
2026-03-26 22:46:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1c363ea-e892-5a47-b252-9beca2f973a5/e1c363ea-e892-5a47-b252-9beca2f973a5_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F65d65de752da4f1790e058409738cdcd%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/65d65de752da4f1790e058409738cdcd/images/large/1.jpg saved to cache
2026-03-26 22:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e1c363ea-e892-5a47-b252-9beca2f973a5
2026-03-26 22:46:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7661050>
2026-03-26 22:46:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9fa71a98-41e8-5bbe-99a8-dff2a6c43ead/9fa71a98-41e8-5bbe-99a8-dff2a6c43ead_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F367598e3b77a4ac4a0821e6fd67c04d0%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/367598e3b77a4ac4a0821e6fd67c04d0/images/large/9.jpg saved to cache
2026-03-26 22:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9fa71a98-41e8-5bbe-99a8-dff2a6c43ead
2026-03-26 22:46:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77ad4d0>
2026-03-26 22:46:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9fa71a98-41e8-5bbe-99a8-dff2a6c43ead/9fa71a98-41e8-5bbe-99a8-dff2a6c43ead_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F367598e3b77a4ac4a0821e6fd67c04d0%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/367598e3b77a4ac4a0821e6fd67c04d0/images/large/8.jpg saved to cache
2026-03-26 22:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9fa71a98-41e8-5bbe-99a8-dff2a6c43ead
2026-03-26 22:46:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e1fe10>
2026-03-26 22:46:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1c363ea-e892-5a47-b252-9beca2f973a5/e1c363ea-e892-5a47-b252-9beca2f973a5_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F65d65de752da4f1790e058409738cdcd%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/65d65de752da4f1790e058409738cdcd/images/large/4.jpg saved to cache
2026-03-26 22:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e1c363ea-e892-5a47-b252-9beca2f973a5
2026-03-26 22:46:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e1e1d0>
2026-03-26 22:46:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9fa71a98-41e8-5bbe-99a8-dff2a6c43ead/9fa71a98-41e8-5bbe-99a8-dff2a6c43ead_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F367598e3b77a4ac4a0821e6fd67c04d0%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/367598e3b77a4ac4a0821e6fd67c04d0/images/large/10.jpg saved to cache
2026-03-26 22:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9fa71a98-41e8-5bbe-99a8-dff2a6c43ead
2026-03-26 22:46:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9fa71a98-41e8-5bbe-99a8-dff2a6c43ead, skipping ID generation
2026-03-26 22:46:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9fa71a98-41e8-5bbe-99a8-dff2a6c43ead with scrape type 1
2026-03-26 22:46:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9fa71a98-41e8-5bbe-99a8-dff2a6c43ead sending to next pipeline
2026-03-26 22:46:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 9fa71a98-41e8-5bbe-99a8-dff2a6c43ead, identifier: 1986073
2026-03-26 22:46:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd3a9510>
2026-03-26 22:46:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1c363ea-e892-5a47-b252-9beca2f973a5/e1c363ea-e892-5a47-b252-9beca2f973a5_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F65d65de752da4f1790e058409738cdcd%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/65d65de752da4f1790e058409738cdcd/images/large/2.jpg saved to cache
2026-03-26 22:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e1c363ea-e892-5a47-b252-9beca2f973a5
2026-03-26 22:46:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 9fa71a98-41e8-5bbe-99a8-dff2a6c43ead with identifier: 1986073
2026-03-26 22:46:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 9fa71a98-41e8-5bbe-99a8-dff2a6c43ead with identifier: 1986073
2026-03-26 22:46:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 9fa71a98-41e8-5bbe-99a8-dff2a6c43ead with identifier: 1986073 to the API
2026-03-26 22:46:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:46:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:46:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cc/367598e3b77a4ac4a0821e6fd67c04d0/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '9fa71a98-41e8-5bbe-99a8-dff2a6c43ead',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'SUPERB COMBI',
 'odometer': 188830,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fa71a98-41e8-5bbe-99a8-dff2a6c43ead/9fa71a98-41e8-5bbe-99a8-dff2a6c43ead_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 690825,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/367598e3b77a4ac4a0821e6fd67c04d0/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fa71a98-41e8-5bbe-99a8-dff2a6c43ead/9fa71a98-41e8-5bbe-99a8-dff2a6c43ead_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 682493,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/367598e3b77a4ac4a0821e6fd67c04d0/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fa71a98-41e8-5bbe-99a8-dff2a6c43ead/9fa71a98-41e8-5bbe-99a8-dff2a6c43ead_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 677179,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/367598e3b77a4ac4a0821e6fd67c04d0/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fa71a98-41e8-5bbe-99a8-dff2a6c43ead/9fa71a98-41e8-5bbe-99a8-dff2a6c43ead_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 697408,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/367598e3b77a4ac4a0821e6fd67c04d0/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fa71a98-41e8-5bbe-99a8-dff2a6c43ead/9fa71a98-41e8-5bbe-99a8-dff2a6c43ead_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 662885,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/367598e3b77a4ac4a0821e6fd67c04d0/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fa71a98-41e8-5bbe-99a8-dff2a6c43ead/9fa71a98-41e8-5bbe-99a8-dff2a6c43ead_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 690235,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/367598e3b77a4ac4a0821e6fd67c04d0/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fa71a98-41e8-5bbe-99a8-dff2a6c43ead/9fa71a98-41e8-5bbe-99a8-dff2a6c43ead_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 558359,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/367598e3b77a4ac4a0821e6fd67c04d0/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fa71a98-41e8-5bbe-99a8-dff2a6c43ead/9fa71a98-41e8-5bbe-99a8-dff2a6c43ead_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 877828,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/367598e3b77a4ac4a0821e6fd67c04d0/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fa71a98-41e8-5bbe-99a8-dff2a6c43ead/9fa71a98-41e8-5bbe-99a8-dff2a6c43ead_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 888866,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/367598e3b77a4ac4a0821e6fd67c04d0/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fa71a98-41e8-5bbe-99a8-dff2a6c43ead/9fa71a98-41e8-5bbe-99a8-dff2a6c43ead_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 726445,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/367598e3b77a4ac4a0821e6fd67c04d0/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA SUPERB COMBI 1.5 TSI ACT 110KW DSG7 CLEVER+',
 'transmission': 'automatic',
 'trim': '1.5 TSI ACT 110KW DSG7 CLEVER+',
 'vin': None,
 'year': 2022}
2026-03-26 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986073%27 HTTP/1.1" 200 None
2026-03-26 22:46:47 [ayvens.be] INFO: Saving data for 1986073: {'created_time': 1774565207.436747, 'last_price_update_time': 1774565207.436757, 'auction_closing_time': 1775028600.0}
2026-03-26 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986073') HTTP/1.1" 204 0
2026-03-26 22:46:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ax/65d65de752da4f1790e058409738cdcd/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ax/65d65de752da4f1790e058409738cdcd/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ax/65d65de752da4f1790e058409738cdcd/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ax/65d65de752da4f1790e058409738cdcd/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ax/65d65de752da4f1790e058409738cdcd/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ax/65d65de752da4f1790e058409738cdcd/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b782e7d0>
2026-03-26 22:46:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1c363ea-e892-5a47-b252-9beca2f973a5/e1c363ea-e892-5a47-b252-9beca2f973a5_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F65d65de752da4f1790e058409738cdcd%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/65d65de752da4f1790e058409738cdcd/images/large/8.jpg saved to cache
2026-03-26 22:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e1c363ea-e892-5a47-b252-9beca2f973a5
2026-03-26 22:46:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e15390>
2026-03-26 22:46:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1c363ea-e892-5a47-b252-9beca2f973a5/e1c363ea-e892-5a47-b252-9beca2f973a5_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F65d65de752da4f1790e058409738cdcd%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/65d65de752da4f1790e058409738cdcd/images/large/9.jpg saved to cache
2026-03-26 22:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e1c363ea-e892-5a47-b252-9beca2f973a5
2026-03-26 22:46:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b784e050>
2026-03-26 22:46:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1c363ea-e892-5a47-b252-9beca2f973a5/e1c363ea-e892-5a47-b252-9beca2f973a5_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F65d65de752da4f1790e058409738cdcd%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/65d65de752da4f1790e058409738cdcd/images/large/6.jpg saved to cache
2026-03-26 22:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e1c363ea-e892-5a47-b252-9beca2f973a5
2026-03-26 22:46:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e37c50>
2026-03-26 22:46:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1c363ea-e892-5a47-b252-9beca2f973a5/e1c363ea-e892-5a47-b252-9beca2f973a5_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F65d65de752da4f1790e058409738cdcd%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/65d65de752da4f1790e058409738cdcd/images/large/5.jpg saved to cache
2026-03-26 22:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e1c363ea-e892-5a47-b252-9beca2f973a5
2026-03-26 22:46:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e13fd0>
2026-03-26 22:46:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1c363ea-e892-5a47-b252-9beca2f973a5/e1c363ea-e892-5a47-b252-9beca2f973a5_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F65d65de752da4f1790e058409738cdcd%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/65d65de752da4f1790e058409738cdcd/images/large/7.jpg saved to cache
2026-03-26 22:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e1c363ea-e892-5a47-b252-9beca2f973a5
2026-03-26 22:46:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7927890>
2026-03-26 22:46:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1c363ea-e892-5a47-b252-9beca2f973a5/e1c363ea-e892-5a47-b252-9beca2f973a5_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F65d65de752da4f1790e058409738cdcd%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/65d65de752da4f1790e058409738cdcd/images/large/10.jpg saved to cache
2026-03-26 22:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e1c363ea-e892-5a47-b252-9beca2f973a5
2026-03-26 22:46:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e1c363ea-e892-5a47-b252-9beca2f973a5, skipping ID generation
2026-03-26 22:46:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e1c363ea-e892-5a47-b252-9beca2f973a5 with scrape type 1
2026-03-26 22:46:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e1c363ea-e892-5a47-b252-9beca2f973a5 sending to next pipeline
2026-03-26 22:46:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e1c363ea-e892-5a47-b252-9beca2f973a5, identifier: 1986074
2026-03-26 22:46:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e1c363ea-e892-5a47-b252-9beca2f973a5 with identifier: 1986074
2026-03-26 22:46:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e1c363ea-e892-5a47-b252-9beca2f973a5 with identifier: 1986074
2026-03-26 22:46:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e1c363ea-e892-5a47-b252-9beca2f973a5 with identifier: 1986074 to the API
2026-03-26 22:46:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:46:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:46:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ax/65d65de752da4f1790e058409738cdcd/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'e1c363ea-e892-5a47-b252-9beca2f973a5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '2 SERIES GRAN COUPAu2030',
 'odometer': 101108,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1c363ea-e892-5a47-b252-9beca2f973a5/e1c363ea-e892-5a47-b252-9beca2f973a5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 692396,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/65d65de752da4f1790e058409738cdcd/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1c363ea-e892-5a47-b252-9beca2f973a5/e1c363ea-e892-5a47-b252-9beca2f973a5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 692396,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/65d65de752da4f1790e058409738cdcd/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1c363ea-e892-5a47-b252-9beca2f973a5/e1c363ea-e892-5a47-b252-9beca2f973a5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 664163,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/65d65de752da4f1790e058409738cdcd/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1c363ea-e892-5a47-b252-9beca2f973a5/e1c363ea-e892-5a47-b252-9beca2f973a5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 668821,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/65d65de752da4f1790e058409738cdcd/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1c363ea-e892-5a47-b252-9beca2f973a5/e1c363ea-e892-5a47-b252-9beca2f973a5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 711228,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/65d65de752da4f1790e058409738cdcd/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1c363ea-e892-5a47-b252-9beca2f973a5/e1c363ea-e892-5a47-b252-9beca2f973a5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 679551,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/65d65de752da4f1790e058409738cdcd/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1c363ea-e892-5a47-b252-9beca2f973a5/e1c363ea-e892-5a47-b252-9beca2f973a5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 758779,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/65d65de752da4f1790e058409738cdcd/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1c363ea-e892-5a47-b252-9beca2f973a5/e1c363ea-e892-5a47-b252-9beca2f973a5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 590926,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/65d65de752da4f1790e058409738cdcd/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1c363ea-e892-5a47-b252-9beca2f973a5/e1c363ea-e892-5a47-b252-9beca2f973a5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 792755,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/65d65de752da4f1790e058409738cdcd/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1c363ea-e892-5a47-b252-9beca2f973a5/e1c363ea-e892-5a47-b252-9beca2f973a5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 753119,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/65d65de752da4f1790e058409738cdcd/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 2 SERIES GRAN COUPAu2030 1.5 216DA GRAN COUPE',
 'transmission': 'automatic',
 'trim': '1.5 216DA GRAN COUPE',
 'vin': None,
 'year': 2021}
2026-03-26 22:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986074%27 HTTP/1.1" 200 None
2026-03-26 22:46:48 [ayvens.be] INFO: Saving data for 1986074: {'created_time': 1774565208.617076, 'last_price_update_time': 1774565208.617085, 'auction_closing_time': 1775028600.0}
2026-03-26 22:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986074') HTTP/1.1" 204 0
2026-03-26 22:46:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-03-26 22:46:48 [ayvens.be] INFO: Found listing with ID: 1986075
2026-03-26 22:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986075%27 HTTP/1.1" 200 None
2026-03-26 22:46:48 [ayvens.be] INFO: Scrape type for 1986075: 1
2026-03-26 22:46:48 [ayvens.be] INFO: Extracting data for car ID: 1986075
2026-03-26 22:46:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 29d307d9-05dd-5759-b99d-a5f9d0d3678b with identifier: 1986075
2026-03-26 22:46:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29d307d9-05dd-5759-b99d-a5f9d0d3678b with scrape type 1
2026-03-26 22:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 29d307d9-05dd-5759-b99d-a5f9d0d3678b
2026-03-26 22:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252Fa249a284858c42928c459848f81fa80d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/a249a284858c42928c459848f81fa80d/images/large/1.jpg not downloaded yet
2026-03-26 22:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252Fa249a284858c42928c459848f81fa80d%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/a249a284858c42928c459848f81fa80d/images/large/2.jpg not downloaded yet
2026-03-26 22:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252Fa249a284858c42928c459848f81fa80d%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/a249a284858c42928c459848f81fa80d/images/large/3.jpg not downloaded yet
2026-03-26 22:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252Fa249a284858c42928c459848f81fa80d%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/a249a284858c42928c459848f81fa80d/images/large/4.jpg not downloaded yet
2026-03-26 22:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252Fa249a284858c42928c459848f81fa80d%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/a249a284858c42928c459848f81fa80d/images/large/5.jpg not downloaded yet
2026-03-26 22:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252Fa249a284858c42928c459848f81fa80d%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/a249a284858c42928c459848f81fa80d/images/large/6.jpg not downloaded yet
2026-03-26 22:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252Fa249a284858c42928c459848f81fa80d%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/a249a284858c42928c459848f81fa80d/images/large/7.jpg not downloaded yet
2026-03-26 22:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252Fa249a284858c42928c459848f81fa80d%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/a249a284858c42928c459848f81fa80d/images/large/8.jpg not downloaded yet
2026-03-26 22:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252Fa249a284858c42928c459848f81fa80d%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/a249a284858c42928c459848f81fa80d/images/large/9.jpg not downloaded yet
2026-03-26 22:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252Fa249a284858c42928c459848f81fa80d%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/a249a284858c42928c459848f81fa80d/images/large/10.jpg not downloaded yet
2026-03-26 22:46:48 [ayvens.be] INFO: Found listing with ID: 1986076
2026-03-26 22:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986076%27 HTTP/1.1" 200 None
2026-03-26 22:46:48 [ayvens.be] INFO: Scrape type for 1986076: 1
2026-03-26 22:46:48 [ayvens.be] INFO: Extracting data for car ID: 1986076
2026-03-26 22:46:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 39eec9d8-b033-5f55-9e59-aea05ec9d786 with identifier: 1986076
2026-03-26 22:46:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39eec9d8-b033-5f55-9e59-aea05ec9d786 with scrape type 1
2026-03-26 22:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 39eec9d8-b033-5f55-9e59-aea05ec9d786
2026-03-26 22:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aw%252F0baad5512e6542f2aa030ad5ace45359%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aw/0baad5512e6542f2aa030ad5ace45359/images/large/1.jpg not downloaded yet
2026-03-26 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aw%252F0baad5512e6542f2aa030ad5ace45359%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aw/0baad5512e6542f2aa030ad5ace45359/images/large/2.jpg not downloaded yet
2026-03-26 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aw%252F0baad5512e6542f2aa030ad5ace45359%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aw/0baad5512e6542f2aa030ad5ace45359/images/large/3.jpg not downloaded yet
2026-03-26 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aw%252F0baad5512e6542f2aa030ad5ace45359%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aw/0baad5512e6542f2aa030ad5ace45359/images/large/4.jpg not downloaded yet
2026-03-26 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aw%252F0baad5512e6542f2aa030ad5ace45359%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aw/0baad5512e6542f2aa030ad5ace45359/images/large/5.jpg not downloaded yet
2026-03-26 22:46:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/a249a284858c42928c459848f81fa80d/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aw%252F0baad5512e6542f2aa030ad5ace45359%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aw/0baad5512e6542f2aa030ad5ace45359/images/large/6.jpg not downloaded yet
2026-03-26 22:46:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/a249a284858c42928c459848f81fa80d/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/a249a284858c42928c459848f81fa80d/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aw%252F0baad5512e6542f2aa030ad5ace45359%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aw/0baad5512e6542f2aa030ad5ace45359/images/large/7.jpg not downloaded yet
2026-03-26 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aw%252F0baad5512e6542f2aa030ad5ace45359%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aw/0baad5512e6542f2aa030ad5ace45359/images/large/8.jpg not downloaded yet
2026-03-26 22:46:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/a249a284858c42928c459848f81fa80d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aw%252F0baad5512e6542f2aa030ad5ace45359%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aw/0baad5512e6542f2aa030ad5ace45359/images/large/9.jpg not downloaded yet
2026-03-26 22:46:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/a249a284858c42928c459848f81fa80d/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/a249a284858c42928c459848f81fa80d/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aw%252F0baad5512e6542f2aa030ad5ace45359%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aw/0baad5512e6542f2aa030ad5ace45359/images/large/10.jpg not downloaded yet
2026-03-26 22:46:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/a249a284858c42928c459848f81fa80d/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:49 [ayvens.be] INFO: Found listing with ID: 1986077
2026-03-26 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986077%27 HTTP/1.1" 200 None
2026-03-26 22:46:49 [ayvens.be] INFO: Scrape type for 1986077: 1
2026-03-26 22:46:49 [ayvens.be] INFO: Extracting data for car ID: 1986077
2026-03-26 22:46:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 130e9508-25a0-512c-84c2-a8a8de268073 with identifier: 1986077
2026-03-26 22:46:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 130e9508-25a0-512c-84c2-a8a8de268073 with scrape type 1
2026-03-26 22:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 130e9508-25a0-512c-84c2-a8a8de268073
2026-03-26 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252Fac25947f508d4ae7a66abeb3d35e13a4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/ac25947f508d4ae7a66abeb3d35e13a4/images/large/1.jpg not downloaded yet
2026-03-26 22:46:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77ea810>
2026-03-26 22:46:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29d307d9-05dd-5759-b99d-a5f9d0d3678b/29d307d9-05dd-5759-b99d-a5f9d0d3678b_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252Fa249a284858c42928c459848f81fa80d%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/a249a284858c42928c459848f81fa80d/images/large/3.jpg saved to cache
2026-03-26 22:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 29d307d9-05dd-5759-b99d-a5f9d0d3678b
2026-03-26 22:46:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/a249a284858c42928c459848f81fa80d/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252Fac25947f508d4ae7a66abeb3d35e13a4%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/ac25947f508d4ae7a66abeb3d35e13a4/images/large/2.jpg not downloaded yet
2026-03-26 22:46:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77ebb10>
2026-03-26 22:46:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29d307d9-05dd-5759-b99d-a5f9d0d3678b/29d307d9-05dd-5759-b99d-a5f9d0d3678b_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252Fa249a284858c42928c459848f81fa80d%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/a249a284858c42928c459848f81fa80d/images/large/5.jpg saved to cache
2026-03-26 22:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 29d307d9-05dd-5759-b99d-a5f9d0d3678b
2026-03-26 22:46:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e2af10>
2026-03-26 22:46:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29d307d9-05dd-5759-b99d-a5f9d0d3678b/29d307d9-05dd-5759-b99d-a5f9d0d3678b_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252Fa249a284858c42928c459848f81fa80d%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/a249a284858c42928c459848f81fa80d/images/large/7.jpg saved to cache
2026-03-26 22:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 29d307d9-05dd-5759-b99d-a5f9d0d3678b
2026-03-26 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252Fac25947f508d4ae7a66abeb3d35e13a4%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/ac25947f508d4ae7a66abeb3d35e13a4/images/large/3.jpg not downloaded yet
2026-03-26 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252Fac25947f508d4ae7a66abeb3d35e13a4%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/ac25947f508d4ae7a66abeb3d35e13a4/images/large/4.jpg not downloaded yet
2026-03-26 22:46:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6dc3dd0>
2026-03-26 22:46:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29d307d9-05dd-5759-b99d-a5f9d0d3678b/29d307d9-05dd-5759-b99d-a5f9d0d3678b_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252Fa249a284858c42928c459848f81fa80d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/a249a284858c42928c459848f81fa80d/images/large/1.jpg saved to cache
2026-03-26 22:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 29d307d9-05dd-5759-b99d-a5f9d0d3678b
2026-03-26 22:46:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7663f50>
2026-03-26 22:46:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29d307d9-05dd-5759-b99d-a5f9d0d3678b/29d307d9-05dd-5759-b99d-a5f9d0d3678b_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252Fa249a284858c42928c459848f81fa80d%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/a249a284858c42928c459848f81fa80d/images/large/8.jpg saved to cache
2026-03-26 22:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 29d307d9-05dd-5759-b99d-a5f9d0d3678b
2026-03-26 22:46:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7747e90>
2026-03-26 22:46:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29d307d9-05dd-5759-b99d-a5f9d0d3678b/29d307d9-05dd-5759-b99d-a5f9d0d3678b_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252Fa249a284858c42928c459848f81fa80d%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/a249a284858c42928c459848f81fa80d/images/large/2.jpg saved to cache
2026-03-26 22:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 29d307d9-05dd-5759-b99d-a5f9d0d3678b
2026-03-26 22:46:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6dc38d0>
2026-03-26 22:46:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29d307d9-05dd-5759-b99d-a5f9d0d3678b/29d307d9-05dd-5759-b99d-a5f9d0d3678b_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252Fa249a284858c42928c459848f81fa80d%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/a249a284858c42928c459848f81fa80d/images/large/4.jpg saved to cache
2026-03-26 22:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 29d307d9-05dd-5759-b99d-a5f9d0d3678b
2026-03-26 22:46:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e1ccd0>
2026-03-26 22:46:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29d307d9-05dd-5759-b99d-a5f9d0d3678b/29d307d9-05dd-5759-b99d-a5f9d0d3678b_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252Fa249a284858c42928c459848f81fa80d%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/a249a284858c42928c459848f81fa80d/images/large/6.jpg saved to cache
2026-03-26 22:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 29d307d9-05dd-5759-b99d-a5f9d0d3678b
2026-03-26 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252Fac25947f508d4ae7a66abeb3d35e13a4%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/ac25947f508d4ae7a66abeb3d35e13a4/images/large/5.jpg not downloaded yet
2026-03-26 22:46:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aw/0baad5512e6542f2aa030ad5ace45359/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/a249a284858c42928c459848f81fa80d/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aw/0baad5512e6542f2aa030ad5ace45359/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252Fac25947f508d4ae7a66abeb3d35e13a4%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/ac25947f508d4ae7a66abeb3d35e13a4/images/large/6.jpg not downloaded yet
2026-03-26 22:46:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aw/0baad5512e6542f2aa030ad5ace45359/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252Fac25947f508d4ae7a66abeb3d35e13a4%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/ac25947f508d4ae7a66abeb3d35e13a4/images/large/7.jpg not downloaded yet
2026-03-26 22:46:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aw/0baad5512e6542f2aa030ad5ace45359/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aw/0baad5512e6542f2aa030ad5ace45359/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252Fac25947f508d4ae7a66abeb3d35e13a4%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/ac25947f508d4ae7a66abeb3d35e13a4/images/large/8.jpg not downloaded yet
2026-03-26 22:46:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/a249a284858c42928c459848f81fa80d/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aw/0baad5512e6542f2aa030ad5ace45359/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252Fac25947f508d4ae7a66abeb3d35e13a4%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/ac25947f508d4ae7a66abeb3d35e13a4/images/large/9.jpg not downloaded yet
2026-03-26 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252Fac25947f508d4ae7a66abeb3d35e13a4%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/ac25947f508d4ae7a66abeb3d35e13a4/images/large/10.jpg not downloaded yet
2026-03-26 22:46:50 [ayvens.be] INFO: Found listing with ID: 1986078
2026-03-26 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986078%27 HTTP/1.1" 200 None
2026-03-26 22:46:50 [ayvens.be] INFO: Scrape type for 1986078: 1
2026-03-26 22:46:50 [ayvens.be] INFO: Extracting data for car ID: 1986078
2026-03-26 22:46:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a389b135-5d76-5c6e-b940-246705a2ed4e with identifier: 1986078
2026-03-26 22:46:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a389b135-5d76-5c6e-b940-246705a2ed4e with scrape type 1
2026-03-26 22:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a389b135-5d76-5c6e-b940-246705a2ed4e
2026-03-26 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F5ab20f106fa844519a3cd3d412d2c9b3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/5ab20f106fa844519a3cd3d412d2c9b3/images/large/1.jpg not downloaded yet
2026-03-26 22:46:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b727f150>
2026-03-26 22:46:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39eec9d8-b033-5f55-9e59-aea05ec9d786/39eec9d8-b033-5f55-9e59-aea05ec9d786_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aw%252F0baad5512e6542f2aa030ad5ace45359%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aw/0baad5512e6542f2aa030ad5ace45359/images/large/1.jpg saved to cache
2026-03-26 22:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 39eec9d8-b033-5f55-9e59-aea05ec9d786
2026-03-26 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F5ab20f106fa844519a3cd3d412d2c9b3%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/5ab20f106fa844519a3cd3d412d2c9b3/images/large/2.jpg not downloaded yet
2026-03-26 22:46:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b727c350>
2026-03-26 22:46:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29d307d9-05dd-5759-b99d-a5f9d0d3678b/29d307d9-05dd-5759-b99d-a5f9d0d3678b_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252Fa249a284858c42928c459848f81fa80d%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/a249a284858c42928c459848f81fa80d/images/large/9.jpg saved to cache
2026-03-26 22:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 29d307d9-05dd-5759-b99d-a5f9d0d3678b
2026-03-26 22:46:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7590150>
2026-03-26 22:46:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39eec9d8-b033-5f55-9e59-aea05ec9d786/39eec9d8-b033-5f55-9e59-aea05ec9d786_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aw%252F0baad5512e6542f2aa030ad5ace45359%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aw/0baad5512e6542f2aa030ad5ace45359/images/large/2.jpg saved to cache
2026-03-26 22:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 39eec9d8-b033-5f55-9e59-aea05ec9d786
2026-03-26 22:46:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c61590>
2026-03-26 22:46:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39eec9d8-b033-5f55-9e59-aea05ec9d786/39eec9d8-b033-5f55-9e59-aea05ec9d786_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aw%252F0baad5512e6542f2aa030ad5ace45359%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aw/0baad5512e6542f2aa030ad5ace45359/images/large/3.jpg saved to cache
2026-03-26 22:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 39eec9d8-b033-5f55-9e59-aea05ec9d786
2026-03-26 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F5ab20f106fa844519a3cd3d412d2c9b3%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/5ab20f106fa844519a3cd3d412d2c9b3/images/large/3.jpg not downloaded yet
2026-03-26 22:46:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aw/0baad5512e6542f2aa030ad5ace45359/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F5ab20f106fa844519a3cd3d412d2c9b3%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/5ab20f106fa844519a3cd3d412d2c9b3/images/large/4.jpg not downloaded yet
2026-03-26 22:46:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd235f10>
2026-03-26 22:46:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39eec9d8-b033-5f55-9e59-aea05ec9d786/39eec9d8-b033-5f55-9e59-aea05ec9d786_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aw%252F0baad5512e6542f2aa030ad5ace45359%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aw/0baad5512e6542f2aa030ad5ace45359/images/large/4.jpg saved to cache
2026-03-26 22:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 39eec9d8-b033-5f55-9e59-aea05ec9d786
2026-03-26 22:46:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7268410>
2026-03-26 22:46:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39eec9d8-b033-5f55-9e59-aea05ec9d786/39eec9d8-b033-5f55-9e59-aea05ec9d786_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aw%252F0baad5512e6542f2aa030ad5ace45359%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aw/0baad5512e6542f2aa030ad5ace45359/images/large/5.jpg saved to cache
2026-03-26 22:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 39eec9d8-b033-5f55-9e59-aea05ec9d786
2026-03-26 22:46:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7437ed0>
2026-03-26 22:46:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29d307d9-05dd-5759-b99d-a5f9d0d3678b/29d307d9-05dd-5759-b99d-a5f9d0d3678b_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252Fa249a284858c42928c459848f81fa80d%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/a249a284858c42928c459848f81fa80d/images/large/10.jpg saved to cache
2026-03-26 22:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 29d307d9-05dd-5759-b99d-a5f9d0d3678b
2026-03-26 22:46:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 29d307d9-05dd-5759-b99d-a5f9d0d3678b, skipping ID generation
2026-03-26 22:46:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29d307d9-05dd-5759-b99d-a5f9d0d3678b with scrape type 1
2026-03-26 22:46:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 29d307d9-05dd-5759-b99d-a5f9d0d3678b sending to next pipeline
2026-03-26 22:46:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 29d307d9-05dd-5759-b99d-a5f9d0d3678b, identifier: 1986075
2026-03-26 22:46:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b36e90>
2026-03-26 22:46:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39eec9d8-b033-5f55-9e59-aea05ec9d786/39eec9d8-b033-5f55-9e59-aea05ec9d786_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aw%252F0baad5512e6542f2aa030ad5ace45359%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aw/0baad5512e6542f2aa030ad5ace45359/images/large/6.jpg saved to cache
2026-03-26 22:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 39eec9d8-b033-5f55-9e59-aea05ec9d786
2026-03-26 22:46:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cu/ac25947f508d4ae7a66abeb3d35e13a4/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 29d307d9-05dd-5759-b99d-a5f9d0d3678b with identifier: 1986075
2026-03-26 22:46:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 29d307d9-05dd-5759-b99d-a5f9d0d3678b with identifier: 1986075
2026-03-26 22:46:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 29d307d9-05dd-5759-b99d-a5f9d0d3678b with identifier: 1986075 to the API
2026-03-26 22:46:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:46:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:46:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yn/a249a284858c42928c459848f81fa80d/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '29d307d9-05dd-5759-b99d-a5f9d0d3678b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '5008 DIESEL - 2020',
 'odometer': 92706,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29d307d9-05dd-5759-b99d-a5f9d0d3678b/29d307d9-05dd-5759-b99d-a5f9d0d3678b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 666804,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/a249a284858c42928c459848f81fa80d/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29d307d9-05dd-5759-b99d-a5f9d0d3678b/29d307d9-05dd-5759-b99d-a5f9d0d3678b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 695245,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/a249a284858c42928c459848f81fa80d/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29d307d9-05dd-5759-b99d-a5f9d0d3678b/29d307d9-05dd-5759-b99d-a5f9d0d3678b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 651952,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/a249a284858c42928c459848f81fa80d/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29d307d9-05dd-5759-b99d-a5f9d0d3678b/29d307d9-05dd-5759-b99d-a5f9d0d3678b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 678893,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/a249a284858c42928c459848f81fa80d/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29d307d9-05dd-5759-b99d-a5f9d0d3678b/29d307d9-05dd-5759-b99d-a5f9d0d3678b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 657878,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/a249a284858c42928c459848f81fa80d/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29d307d9-05dd-5759-b99d-a5f9d0d3678b/29d307d9-05dd-5759-b99d-a5f9d0d3678b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 729782,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/a249a284858c42928c459848f81fa80d/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29d307d9-05dd-5759-b99d-a5f9d0d3678b/29d307d9-05dd-5759-b99d-a5f9d0d3678b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 567962,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/a249a284858c42928c459848f81fa80d/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29d307d9-05dd-5759-b99d-a5f9d0d3678b/29d307d9-05dd-5759-b99d-a5f9d0d3678b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 883876,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/a249a284858c42928c459848f81fa80d/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29d307d9-05dd-5759-b99d-a5f9d0d3678b/29d307d9-05dd-5759-b99d-a5f9d0d3678b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 868147,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/a249a284858c42928c459848f81fa80d/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29d307d9-05dd-5759-b99d-a5f9d0d3678b/29d307d9-05dd-5759-b99d-a5f9d0d3678b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 881394,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/a249a284858c42928c459848f81fa80d/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-26',
 'seats_number': 7,
 'seller_name': None,
 'title': 'PEUGEOT 5008 DIESEL - 2020 1.5 BlueHDi Active',
 'transmission': 'automatic',
 'trim': '1.5 BlueHDi Active',
 'vin': None,
 'year': 2020}
2026-03-26 22:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986075%27 HTTP/1.1" 200 None
2026-03-26 22:46:51 [ayvens.be] INFO: Saving data for 1986075: {'created_time': 1774565211.73045, 'last_price_update_time': 1774565211.730459, 'auction_closing_time': 1775028600.0}
2026-03-26 22:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986075') HTTP/1.1" 204 0
2026-03-26 22:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F5ab20f106fa844519a3cd3d412d2c9b3%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/5ab20f106fa844519a3cd3d412d2c9b3/images/large/5.jpg not downloaded yet
2026-03-26 22:46:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cu/ac25947f508d4ae7a66abeb3d35e13a4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cu/ac25947f508d4ae7a66abeb3d35e13a4/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F5ab20f106fa844519a3cd3d412d2c9b3%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/5ab20f106fa844519a3cd3d412d2c9b3/images/large/6.jpg not downloaded yet
2026-03-26 22:46:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aw/0baad5512e6542f2aa030ad5ace45359/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cu/ac25947f508d4ae7a66abeb3d35e13a4/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7426a90>
2026-03-26 22:46:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39eec9d8-b033-5f55-9e59-aea05ec9d786/39eec9d8-b033-5f55-9e59-aea05ec9d786_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aw%252F0baad5512e6542f2aa030ad5ace45359%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aw/0baad5512e6542f2aa030ad5ace45359/images/large/7.jpg saved to cache
2026-03-26 22:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 39eec9d8-b033-5f55-9e59-aea05ec9d786
2026-03-26 22:46:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5ccaf10>
2026-03-26 22:46:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_130e9508-25a0-512c-84c2-a8a8de268073/130e9508-25a0-512c-84c2-a8a8de268073_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252Fac25947f508d4ae7a66abeb3d35e13a4%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/ac25947f508d4ae7a66abeb3d35e13a4/images/large/3.jpg saved to cache
2026-03-26 22:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 130e9508-25a0-512c-84c2-a8a8de268073
2026-03-26 22:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F5ab20f106fa844519a3cd3d412d2c9b3%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/5ab20f106fa844519a3cd3d412d2c9b3/images/large/7.jpg not downloaded yet
2026-03-26 22:46:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aw/0baad5512e6542f2aa030ad5ace45359/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aw/0baad5512e6542f2aa030ad5ace45359/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cu/ac25947f508d4ae7a66abeb3d35e13a4/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F5ab20f106fa844519a3cd3d412d2c9b3%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/5ab20f106fa844519a3cd3d412d2c9b3/images/large/8.jpg not downloaded yet
2026-03-26 22:46:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b78aacd0>
2026-03-26 22:46:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_130e9508-25a0-512c-84c2-a8a8de268073/130e9508-25a0-512c-84c2-a8a8de268073_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252Fac25947f508d4ae7a66abeb3d35e13a4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/ac25947f508d4ae7a66abeb3d35e13a4/images/large/1.jpg saved to cache
2026-03-26 22:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 130e9508-25a0-512c-84c2-a8a8de268073
2026-03-26 22:46:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7414050>
2026-03-26 22:46:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_130e9508-25a0-512c-84c2-a8a8de268073/130e9508-25a0-512c-84c2-a8a8de268073_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252Fac25947f508d4ae7a66abeb3d35e13a4%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/ac25947f508d4ae7a66abeb3d35e13a4/images/large/4.jpg saved to cache
2026-03-26 22:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 130e9508-25a0-512c-84c2-a8a8de268073
2026-03-26 22:46:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74f8510>
2026-03-26 22:46:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39eec9d8-b033-5f55-9e59-aea05ec9d786/39eec9d8-b033-5f55-9e59-aea05ec9d786_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aw%252F0baad5512e6542f2aa030ad5ace45359%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aw/0baad5512e6542f2aa030ad5ace45359/images/large/9.jpg saved to cache
2026-03-26 22:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 39eec9d8-b033-5f55-9e59-aea05ec9d786
2026-03-26 22:46:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7417810>
2026-03-26 22:46:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_130e9508-25a0-512c-84c2-a8a8de268073/130e9508-25a0-512c-84c2-a8a8de268073_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252Fac25947f508d4ae7a66abeb3d35e13a4%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/ac25947f508d4ae7a66abeb3d35e13a4/images/large/2.jpg saved to cache
2026-03-26 22:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 130e9508-25a0-512c-84c2-a8a8de268073
2026-03-26 22:46:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cu/ac25947f508d4ae7a66abeb3d35e13a4/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/5ab20f106fa844519a3cd3d412d2c9b3/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F5ab20f106fa844519a3cd3d412d2c9b3%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/5ab20f106fa844519a3cd3d412d2c9b3/images/large/9.jpg not downloaded yet
2026-03-26 22:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F5ab20f106fa844519a3cd3d412d2c9b3%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/5ab20f106fa844519a3cd3d412d2c9b3/images/large/10.jpg not downloaded yet
2026-03-26 22:46:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cu/ac25947f508d4ae7a66abeb3d35e13a4/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/5ab20f106fa844519a3cd3d412d2c9b3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cu/ac25947f508d4ae7a66abeb3d35e13a4/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b743bb10>
2026-03-26 22:46:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39eec9d8-b033-5f55-9e59-aea05ec9d786/39eec9d8-b033-5f55-9e59-aea05ec9d786_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aw%252F0baad5512e6542f2aa030ad5ace45359%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aw/0baad5512e6542f2aa030ad5ace45359/images/large/8.jpg saved to cache
2026-03-26 22:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 39eec9d8-b033-5f55-9e59-aea05ec9d786
2026-03-26 22:46:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74a5850>
2026-03-26 22:46:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39eec9d8-b033-5f55-9e59-aea05ec9d786/39eec9d8-b033-5f55-9e59-aea05ec9d786_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aw%252F0baad5512e6542f2aa030ad5ace45359%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aw/0baad5512e6542f2aa030ad5ace45359/images/large/10.jpg saved to cache
2026-03-26 22:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 39eec9d8-b033-5f55-9e59-aea05ec9d786
2026-03-26 22:46:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 39eec9d8-b033-5f55-9e59-aea05ec9d786, skipping ID generation
2026-03-26 22:46:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39eec9d8-b033-5f55-9e59-aea05ec9d786 with scrape type 1
2026-03-26 22:46:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 39eec9d8-b033-5f55-9e59-aea05ec9d786 sending to next pipeline
2026-03-26 22:46:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 39eec9d8-b033-5f55-9e59-aea05ec9d786, identifier: 1986076
2026-03-26 22:46:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b75a5c10>
2026-03-26 22:46:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_130e9508-25a0-512c-84c2-a8a8de268073/130e9508-25a0-512c-84c2-a8a8de268073_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252Fac25947f508d4ae7a66abeb3d35e13a4%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/ac25947f508d4ae7a66abeb3d35e13a4/images/large/5.jpg saved to cache
2026-03-26 22:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 130e9508-25a0-512c-84c2-a8a8de268073
2026-03-26 22:46:52 [ayvens.be] INFO: Found listing with ID: 1986079
2026-03-26 22:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986079%27 HTTP/1.1" 200 None
2026-03-26 22:46:52 [ayvens.be] INFO: Scrape type for 1986079: 1
2026-03-26 22:46:52 [ayvens.be] INFO: Extracting data for car ID: 1986079
2026-03-26 22:46:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac0ae577-68d3-564d-b024-571a2b36e74e with identifier: 1986079
2026-03-26 22:46:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac0ae577-68d3-564d-b024-571a2b36e74e with scrape type 1
2026-03-26 22:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ac0ae577-68d3-564d-b024-571a2b36e74e
2026-03-26 22:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252Fe6e93b3618b0405b8a448253e2aacd9f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/e6e93b3618b0405b8a448253e2aacd9f/images/large/1.jpg not downloaded yet
2026-03-26 22:46:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 39eec9d8-b033-5f55-9e59-aea05ec9d786 with identifier: 1986076
2026-03-26 22:46:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 39eec9d8-b033-5f55-9e59-aea05ec9d786 with identifier: 1986076
2026-03-26 22:46:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 39eec9d8-b033-5f55-9e59-aea05ec9d786 with identifier: 1986076 to the API
2026-03-26 22:46:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:46:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:46:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2aw/0baad5512e6542f2aa030ad5ace45359/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '39eec9d8-b033-5f55-9e59-aea05ec9d786',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLASS GLB DIESEL (X247)',
 'odometer': 75241,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39eec9d8-b033-5f55-9e59-aea05ec9d786/39eec9d8-b033-5f55-9e59-aea05ec9d786_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 643705,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aw/0baad5512e6542f2aa030ad5ace45359/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39eec9d8-b033-5f55-9e59-aea05ec9d786/39eec9d8-b033-5f55-9e59-aea05ec9d786_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 565411,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aw/0baad5512e6542f2aa030ad5ace45359/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39eec9d8-b033-5f55-9e59-aea05ec9d786/39eec9d8-b033-5f55-9e59-aea05ec9d786_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 601073,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aw/0baad5512e6542f2aa030ad5ace45359/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39eec9d8-b033-5f55-9e59-aea05ec9d786/39eec9d8-b033-5f55-9e59-aea05ec9d786_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 639433,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aw/0baad5512e6542f2aa030ad5ace45359/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39eec9d8-b033-5f55-9e59-aea05ec9d786/39eec9d8-b033-5f55-9e59-aea05ec9d786_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 617180,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aw/0baad5512e6542f2aa030ad5ace45359/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39eec9d8-b033-5f55-9e59-aea05ec9d786/39eec9d8-b033-5f55-9e59-aea05ec9d786_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 559519,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aw/0baad5512e6542f2aa030ad5ace45359/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39eec9d8-b033-5f55-9e59-aea05ec9d786/39eec9d8-b033-5f55-9e59-aea05ec9d786_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 691739,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aw/0baad5512e6542f2aa030ad5ace45359/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39eec9d8-b033-5f55-9e59-aea05ec9d786/39eec9d8-b033-5f55-9e59-aea05ec9d786_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 693890,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aw/0baad5512e6542f2aa030ad5ace45359/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39eec9d8-b033-5f55-9e59-aea05ec9d786/39eec9d8-b033-5f55-9e59-aea05ec9d786_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 574873,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aw/0baad5512e6542f2aa030ad5ace45359/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39eec9d8-b033-5f55-9e59-aea05ec9d786/39eec9d8-b033-5f55-9e59-aea05ec9d786_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 587824,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aw/0baad5512e6542f2aa030ad5ace45359/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-18',
 'seats_number': 7,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLASS GLB DIESEL (X247) GLB 180 d',
 'transmission': 'automatic',
 'trim': 'GLB 180 d',
 'vin': None,
 'year': 2021}
2026-03-26 22:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986076%27 HTTP/1.1" 200 None
2026-03-26 22:46:53 [ayvens.be] INFO: Saving data for 1986076: {'created_time': 1774565213.376642, 'last_price_update_time': 1774565213.376652, 'auction_closing_time': 1775028600.0}
2026-03-26 22:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986076') HTTP/1.1" 204 0
2026-03-26 22:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252Fe6e93b3618b0405b8a448253e2aacd9f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/e6e93b3618b0405b8a448253e2aacd9f/images/large/2.jpg not downloaded yet
2026-03-26 22:46:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/5ab20f106fa844519a3cd3d412d2c9b3/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252Fe6e93b3618b0405b8a448253e2aacd9f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/e6e93b3618b0405b8a448253e2aacd9f/images/large/3.jpg not downloaded yet
2026-03-26 22:46:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7746690>
2026-03-26 22:46:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_130e9508-25a0-512c-84c2-a8a8de268073/130e9508-25a0-512c-84c2-a8a8de268073_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252Fac25947f508d4ae7a66abeb3d35e13a4%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/ac25947f508d4ae7a66abeb3d35e13a4/images/large/6.jpg saved to cache
2026-03-26 22:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 130e9508-25a0-512c-84c2-a8a8de268073
2026-03-26 22:46:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b16f50>
2026-03-26 22:46:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a389b135-5d76-5c6e-b940-246705a2ed4e/a389b135-5d76-5c6e-b940-246705a2ed4e_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F5ab20f106fa844519a3cd3d412d2c9b3%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/5ab20f106fa844519a3cd3d412d2c9b3/images/large/2.jpg saved to cache
2026-03-26 22:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a389b135-5d76-5c6e-b940-246705a2ed4e
2026-03-26 22:46:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b787ddd0>
2026-03-26 22:46:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_130e9508-25a0-512c-84c2-a8a8de268073/130e9508-25a0-512c-84c2-a8a8de268073_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252Fac25947f508d4ae7a66abeb3d35e13a4%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/ac25947f508d4ae7a66abeb3d35e13a4/images/large/7.jpg saved to cache
2026-03-26 22:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 130e9508-25a0-512c-84c2-a8a8de268073
2026-03-26 22:46:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b75852d0>
2026-03-26 22:46:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a389b135-5d76-5c6e-b940-246705a2ed4e/a389b135-5d76-5c6e-b940-246705a2ed4e_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F5ab20f106fa844519a3cd3d412d2c9b3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/5ab20f106fa844519a3cd3d412d2c9b3/images/large/1.jpg saved to cache
2026-03-26 22:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a389b135-5d76-5c6e-b940-246705a2ed4e
2026-03-26 22:46:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b784c7d0>
2026-03-26 22:46:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_130e9508-25a0-512c-84c2-a8a8de268073/130e9508-25a0-512c-84c2-a8a8de268073_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252Fac25947f508d4ae7a66abeb3d35e13a4%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/ac25947f508d4ae7a66abeb3d35e13a4/images/large/10.jpg saved to cache
2026-03-26 22:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 130e9508-25a0-512c-84c2-a8a8de268073
2026-03-26 22:46:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cu/ac25947f508d4ae7a66abeb3d35e13a4/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cu/ac25947f508d4ae7a66abeb3d35e13a4/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/5ab20f106fa844519a3cd3d412d2c9b3/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/5ab20f106fa844519a3cd3d412d2c9b3/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/5ab20f106fa844519a3cd3d412d2c9b3/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/5ab20f106fa844519a3cd3d412d2c9b3/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252Fe6e93b3618b0405b8a448253e2aacd9f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/e6e93b3618b0405b8a448253e2aacd9f/images/large/4.jpg not downloaded yet
2026-03-26 22:46:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/5ab20f106fa844519a3cd3d412d2c9b3/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252Fe6e93b3618b0405b8a448253e2aacd9f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/e6e93b3618b0405b8a448253e2aacd9f/images/large/5.jpg not downloaded yet
2026-03-26 22:46:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74f9450>
2026-03-26 22:46:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a389b135-5d76-5c6e-b940-246705a2ed4e/a389b135-5d76-5c6e-b940-246705a2ed4e_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F5ab20f106fa844519a3cd3d412d2c9b3%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/5ab20f106fa844519a3cd3d412d2c9b3/images/large/3.jpg saved to cache
2026-03-26 22:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a389b135-5d76-5c6e-b940-246705a2ed4e
2026-03-26 22:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252Fe6e93b3618b0405b8a448253e2aacd9f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/e6e93b3618b0405b8a448253e2aacd9f/images/large/6.jpg not downloaded yet
2026-03-26 22:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252Fe6e93b3618b0405b8a448253e2aacd9f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/e6e93b3618b0405b8a448253e2aacd9f/images/large/7.jpg not downloaded yet
2026-03-26 22:46:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7926690>
2026-03-26 22:46:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_130e9508-25a0-512c-84c2-a8a8de268073/130e9508-25a0-512c-84c2-a8a8de268073_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252Fac25947f508d4ae7a66abeb3d35e13a4%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/ac25947f508d4ae7a66abeb3d35e13a4/images/large/8.jpg saved to cache
2026-03-26 22:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 130e9508-25a0-512c-84c2-a8a8de268073
2026-03-26 22:46:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7413e90>
2026-03-26 22:46:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_130e9508-25a0-512c-84c2-a8a8de268073/130e9508-25a0-512c-84c2-a8a8de268073_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252Fac25947f508d4ae7a66abeb3d35e13a4%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/ac25947f508d4ae7a66abeb3d35e13a4/images/large/9.jpg saved to cache
2026-03-26 22:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 130e9508-25a0-512c-84c2-a8a8de268073
2026-03-26 22:46:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 130e9508-25a0-512c-84c2-a8a8de268073, skipping ID generation
2026-03-26 22:46:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 130e9508-25a0-512c-84c2-a8a8de268073 with scrape type 1
2026-03-26 22:46:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 130e9508-25a0-512c-84c2-a8a8de268073 sending to next pipeline
2026-03-26 22:46:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 130e9508-25a0-512c-84c2-a8a8de268073, identifier: 1986077
2026-03-26 22:46:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7501090>
2026-03-26 22:46:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a389b135-5d76-5c6e-b940-246705a2ed4e/a389b135-5d76-5c6e-b940-246705a2ed4e_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F5ab20f106fa844519a3cd3d412d2c9b3%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/5ab20f106fa844519a3cd3d412d2c9b3/images/large/5.jpg saved to cache
2026-03-26 22:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a389b135-5d76-5c6e-b940-246705a2ed4e
2026-03-26 22:46:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7495450>
2026-03-26 22:46:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a389b135-5d76-5c6e-b940-246705a2ed4e/a389b135-5d76-5c6e-b940-246705a2ed4e_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F5ab20f106fa844519a3cd3d412d2c9b3%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/5ab20f106fa844519a3cd3d412d2c9b3/images/large/4.jpg saved to cache
2026-03-26 22:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a389b135-5d76-5c6e-b940-246705a2ed4e
2026-03-26 22:46:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74dc290>
2026-03-26 22:46:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a389b135-5d76-5c6e-b940-246705a2ed4e/a389b135-5d76-5c6e-b940-246705a2ed4e_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F5ab20f106fa844519a3cd3d412d2c9b3%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/5ab20f106fa844519a3cd3d412d2c9b3/images/large/8.jpg saved to cache
2026-03-26 22:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a389b135-5d76-5c6e-b940-246705a2ed4e
2026-03-26 22:46:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74507d0>
2026-03-26 22:46:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a389b135-5d76-5c6e-b940-246705a2ed4e/a389b135-5d76-5c6e-b940-246705a2ed4e_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F5ab20f106fa844519a3cd3d412d2c9b3%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/5ab20f106fa844519a3cd3d412d2c9b3/images/large/6.jpg saved to cache
2026-03-26 22:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a389b135-5d76-5c6e-b940-246705a2ed4e
2026-03-26 22:46:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7585ad0>
2026-03-26 22:46:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a389b135-5d76-5c6e-b940-246705a2ed4e/a389b135-5d76-5c6e-b940-246705a2ed4e_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F5ab20f106fa844519a3cd3d412d2c9b3%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/5ab20f106fa844519a3cd3d412d2c9b3/images/large/7.jpg saved to cache
2026-03-26 22:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a389b135-5d76-5c6e-b940-246705a2ed4e
2026-03-26 22:46:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 130e9508-25a0-512c-84c2-a8a8de268073 with identifier: 1986077
2026-03-26 22:46:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 130e9508-25a0-512c-84c2-a8a8de268073 with identifier: 1986077
2026-03-26 22:46:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 130e9508-25a0-512c-84c2-a8a8de268073 with identifier: 1986077 to the API
2026-03-26 22:46:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:46:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:46:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cu/ac25947f508d4ae7a66abeb3d35e13a4/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.1L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '130e9508-25a0-512c-84c2-a8a8de268073',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'SPRINTER',
 'odometer': 96175,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_130e9508-25a0-512c-84c2-a8a8de268073/130e9508-25a0-512c-84c2-a8a8de268073_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 404659,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cu/ac25947f508d4ae7a66abeb3d35e13a4/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_130e9508-25a0-512c-84c2-a8a8de268073/130e9508-25a0-512c-84c2-a8a8de268073_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 426012,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cu/ac25947f508d4ae7a66abeb3d35e13a4/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_130e9508-25a0-512c-84c2-a8a8de268073/130e9508-25a0-512c-84c2-a8a8de268073_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 346284,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cu/ac25947f508d4ae7a66abeb3d35e13a4/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_130e9508-25a0-512c-84c2-a8a8de268073/130e9508-25a0-512c-84c2-a8a8de268073_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 346481,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cu/ac25947f508d4ae7a66abeb3d35e13a4/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_130e9508-25a0-512c-84c2-a8a8de268073/130e9508-25a0-512c-84c2-a8a8de268073_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 362186,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cu/ac25947f508d4ae7a66abeb3d35e13a4/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_130e9508-25a0-512c-84c2-a8a8de268073/130e9508-25a0-512c-84c2-a8a8de268073_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 229010,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cu/ac25947f508d4ae7a66abeb3d35e13a4/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_130e9508-25a0-512c-84c2-a8a8de268073/130e9508-25a0-512c-84c2-a8a8de268073_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 319687,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cu/ac25947f508d4ae7a66abeb3d35e13a4/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_130e9508-25a0-512c-84c2-a8a8de268073/130e9508-25a0-512c-84c2-a8a8de268073_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 356349,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cu/ac25947f508d4ae7a66abeb3d35e13a4/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_130e9508-25a0-512c-84c2-a8a8de268073/130e9508-25a0-512c-84c2-a8a8de268073_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 279026,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cu/ac25947f508d4ae7a66abeb3d35e13a4/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_130e9508-25a0-512c-84c2-a8a8de268073/130e9508-25a0-512c-84c2-a8a8de268073_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 207272,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cu/ac25947f508d4ae7a66abeb3d35e13a4/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-29',
 'seats_number': 3,
 'seller_name': None,
 'title': 'MERCEDES-BENZ SPRINTER 2.1CDI 105KW 314 L1 FWD 3.5T FUNCTIONAL',
 'transmission': 'manual',
 'trim': '2.1CDI 105KW 314 L1 FWD 3.5T FUNCTIONAL',
 'vin': None,
 'year': 2022}
2026-03-26 22:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986077%27 HTTP/1.1" 200 None
2026-03-26 22:46:54 [ayvens.be] INFO: Saving data for 1986077: {'created_time': 1774565214.905524, 'last_price_update_time': 1774565214.905533, 'auction_closing_time': 1775028600.0}
2026-03-26 22:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986077') HTTP/1.1" 204 0
2026-03-26 22:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252Fe6e93b3618b0405b8a448253e2aacd9f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/e6e93b3618b0405b8a448253e2aacd9f/images/large/8.jpg not downloaded yet
2026-03-26 22:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252Fe6e93b3618b0405b8a448253e2aacd9f%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/e6e93b3618b0405b8a448253e2aacd9f/images/large/9.jpg not downloaded yet
2026-03-26 22:46:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/5ab20f106fa844519a3cd3d412d2c9b3/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/5ab20f106fa844519a3cd3d412d2c9b3/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252Fe6e93b3618b0405b8a448253e2aacd9f%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/e6e93b3618b0405b8a448253e2aacd9f/images/large/10.jpg not downloaded yet
2026-03-26 22:46:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/e6e93b3618b0405b8a448253e2aacd9f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/e6e93b3618b0405b8a448253e2aacd9f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:55 [ayvens.be] INFO: Found listing with ID: 1986080
2026-03-26 22:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986080%27 HTTP/1.1" 200 None
2026-03-26 22:46:55 [ayvens.be] INFO: Scrape type for 1986080: 1
2026-03-26 22:46:55 [ayvens.be] INFO: Extracting data for car ID: 1986080
2026-03-26 22:46:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6002d677-f9a6-5436-94d1-f956b03575d0 with identifier: 1986080
2026-03-26 22:46:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6002d677-f9a6-5436-94d1-f956b03575d0 with scrape type 1
2026-03-26 22:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6002d677-f9a6-5436-94d1-f956b03575d0
2026-03-26 22:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fa61b77e98a224e9ea17fa24847e867e0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/a61b77e98a224e9ea17fa24847e867e0/images/large/1.jpg not downloaded yet
2026-03-26 22:46:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/e6e93b3618b0405b8a448253e2aacd9f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/e6e93b3618b0405b8a448253e2aacd9f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fa61b77e98a224e9ea17fa24847e867e0%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/a61b77e98a224e9ea17fa24847e867e0/images/large/2.jpg not downloaded yet
2026-03-26 22:46:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/e6e93b3618b0405b8a448253e2aacd9f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fa61b77e98a224e9ea17fa24847e867e0%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/a61b77e98a224e9ea17fa24847e867e0/images/large/3.jpg not downloaded yet
2026-03-26 22:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fa61b77e98a224e9ea17fa24847e867e0%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/a61b77e98a224e9ea17fa24847e867e0/images/large/4.jpg not downloaded yet
2026-03-26 22:46:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7587d10>
2026-03-26 22:46:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a389b135-5d76-5c6e-b940-246705a2ed4e/a389b135-5d76-5c6e-b940-246705a2ed4e_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F5ab20f106fa844519a3cd3d412d2c9b3%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/5ab20f106fa844519a3cd3d412d2c9b3/images/large/10.jpg saved to cache
2026-03-26 22:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a389b135-5d76-5c6e-b940-246705a2ed4e
2026-03-26 22:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fa61b77e98a224e9ea17fa24847e867e0%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/a61b77e98a224e9ea17fa24847e867e0/images/large/5.jpg not downloaded yet
2026-03-26 22:46:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e03c90>
2026-03-26 22:46:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a389b135-5d76-5c6e-b940-246705a2ed4e/a389b135-5d76-5c6e-b940-246705a2ed4e_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F5ab20f106fa844519a3cd3d412d2c9b3%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/5ab20f106fa844519a3cd3d412d2c9b3/images/large/9.jpg saved to cache
2026-03-26 22:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a389b135-5d76-5c6e-b940-246705a2ed4e
2026-03-26 22:46:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a389b135-5d76-5c6e-b940-246705a2ed4e, skipping ID generation
2026-03-26 22:46:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a389b135-5d76-5c6e-b940-246705a2ed4e with scrape type 1
2026-03-26 22:46:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a389b135-5d76-5c6e-b940-246705a2ed4e sending to next pipeline
2026-03-26 22:46:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a389b135-5d76-5c6e-b940-246705a2ed4e, identifier: 1986078
2026-03-26 22:46:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7567d50>
2026-03-26 22:46:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac0ae577-68d3-564d-b024-571a2b36e74e/ac0ae577-68d3-564d-b024-571a2b36e74e_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252Fe6e93b3618b0405b8a448253e2aacd9f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/e6e93b3618b0405b8a448253e2aacd9f/images/large/1.jpg saved to cache
2026-03-26 22:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ac0ae577-68d3-564d-b024-571a2b36e74e
2026-03-26 22:46:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b784fd50>
2026-03-26 22:46:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac0ae577-68d3-564d-b024-571a2b36e74e/ac0ae577-68d3-564d-b024-571a2b36e74e_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252Fe6e93b3618b0405b8a448253e2aacd9f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/e6e93b3618b0405b8a448253e2aacd9f/images/large/2.jpg saved to cache
2026-03-26 22:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ac0ae577-68d3-564d-b024-571a2b36e74e
2026-03-26 22:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fa61b77e98a224e9ea17fa24847e867e0%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/a61b77e98a224e9ea17fa24847e867e0/images/large/6.jpg not downloaded yet
2026-03-26 22:46:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a389b135-5d76-5c6e-b940-246705a2ed4e with identifier: 1986078
2026-03-26 22:46:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a389b135-5d76-5c6e-b940-246705a2ed4e with identifier: 1986078
2026-03-26 22:46:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a389b135-5d76-5c6e-b940-246705a2ed4e with identifier: 1986078 to the API
2026-03-26 22:46:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:46:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:46:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ct/5ab20f106fa844519a3cd3d412d2c9b3/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'a389b135-5d76-5c6e-b940-246705a2ed4e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'ARONA',
 'odometer': 41950,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a389b135-5d76-5c6e-b940-246705a2ed4e/a389b135-5d76-5c6e-b940-246705a2ed4e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 239159,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/5ab20f106fa844519a3cd3d412d2c9b3/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a389b135-5d76-5c6e-b940-246705a2ed4e/a389b135-5d76-5c6e-b940-246705a2ed4e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 232864,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/5ab20f106fa844519a3cd3d412d2c9b3/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a389b135-5d76-5c6e-b940-246705a2ed4e/a389b135-5d76-5c6e-b940-246705a2ed4e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 263338,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/5ab20f106fa844519a3cd3d412d2c9b3/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a389b135-5d76-5c6e-b940-246705a2ed4e/a389b135-5d76-5c6e-b940-246705a2ed4e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 266051,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/5ab20f106fa844519a3cd3d412d2c9b3/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a389b135-5d76-5c6e-b940-246705a2ed4e/a389b135-5d76-5c6e-b940-246705a2ed4e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 321980,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/5ab20f106fa844519a3cd3d412d2c9b3/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a389b135-5d76-5c6e-b940-246705a2ed4e/a389b135-5d76-5c6e-b940-246705a2ed4e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 301129,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/5ab20f106fa844519a3cd3d412d2c9b3/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a389b135-5d76-5c6e-b940-246705a2ed4e/a389b135-5d76-5c6e-b940-246705a2ed4e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 344426,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/5ab20f106fa844519a3cd3d412d2c9b3/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a389b135-5d76-5c6e-b940-246705a2ed4e/a389b135-5d76-5c6e-b940-246705a2ed4e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 294368,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/5ab20f106fa844519a3cd3d412d2c9b3/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a389b135-5d76-5c6e-b940-246705a2ed4e/a389b135-5d76-5c6e-b940-246705a2ed4e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 318690,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/5ab20f106fa844519a3cd3d412d2c9b3/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a389b135-5d76-5c6e-b940-246705a2ed4e/a389b135-5d76-5c6e-b940-246705a2ed4e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 320674,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/5ab20f106fa844519a3cd3d412d2c9b3/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT ARONA 1.0 TSI 70KW MOVE',
 'transmission': 'manual',
 'trim': '1.0 TSI 70KW MOVE',
 'vin': None,
 'year': 2022}
2026-03-26 22:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986078%27 HTTP/1.1" 200 None
2026-03-26 22:46:55 [ayvens.be] INFO: Saving data for 1986078: {'created_time': 1774565215.886504, 'last_price_update_time': 1774565215.886515, 'auction_closing_time': 1775028600.0}
2026-03-26 22:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986078') HTTP/1.1" 204 0
2026-03-26 22:46:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/e6e93b3618b0405b8a448253e2aacd9f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fa61b77e98a224e9ea17fa24847e867e0%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/a61b77e98a224e9ea17fa24847e867e0/images/large/7.jpg not downloaded yet
2026-03-26 22:46:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7744d90>
2026-03-26 22:46:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac0ae577-68d3-564d-b024-571a2b36e74e/ac0ae577-68d3-564d-b024-571a2b36e74e_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252Fe6e93b3618b0405b8a448253e2aacd9f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/e6e93b3618b0405b8a448253e2aacd9f/images/large/3.jpg saved to cache
2026-03-26 22:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ac0ae577-68d3-564d-b024-571a2b36e74e
2026-03-26 22:46:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7727e10>
2026-03-26 22:46:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac0ae577-68d3-564d-b024-571a2b36e74e/ac0ae577-68d3-564d-b024-571a2b36e74e_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252Fe6e93b3618b0405b8a448253e2aacd9f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/e6e93b3618b0405b8a448253e2aacd9f/images/large/5.jpg saved to cache
2026-03-26 22:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ac0ae577-68d3-564d-b024-571a2b36e74e
2026-03-26 22:46:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7911450>
2026-03-26 22:46:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac0ae577-68d3-564d-b024-571a2b36e74e/ac0ae577-68d3-564d-b024-571a2b36e74e_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252Fe6e93b3618b0405b8a448253e2aacd9f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/e6e93b3618b0405b8a448253e2aacd9f/images/large/4.jpg saved to cache
2026-03-26 22:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ac0ae577-68d3-564d-b024-571a2b36e74e
2026-03-26 22:46:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/e6e93b3618b0405b8a448253e2aacd9f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fa61b77e98a224e9ea17fa24847e867e0%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/a61b77e98a224e9ea17fa24847e867e0/images/large/8.jpg not downloaded yet
2026-03-26 22:46:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/e6e93b3618b0405b8a448253e2aacd9f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/e6e93b3618b0405b8a448253e2aacd9f/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fa61b77e98a224e9ea17fa24847e867e0%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/a61b77e98a224e9ea17fa24847e867e0/images/large/9.jpg not downloaded yet
2026-03-26 22:46:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/e6e93b3618b0405b8a448253e2aacd9f/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7404bd0>
2026-03-26 22:46:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac0ae577-68d3-564d-b024-571a2b36e74e/ac0ae577-68d3-564d-b024-571a2b36e74e_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252Fe6e93b3618b0405b8a448253e2aacd9f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/e6e93b3618b0405b8a448253e2aacd9f/images/large/6.jpg saved to cache
2026-03-26 22:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ac0ae577-68d3-564d-b024-571a2b36e74e
2026-03-26 22:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fa61b77e98a224e9ea17fa24847e867e0%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/a61b77e98a224e9ea17fa24847e867e0/images/large/10.jpg not downloaded yet
2026-03-26 22:46:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/a61b77e98a224e9ea17fa24847e867e0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/a61b77e98a224e9ea17fa24847e867e0/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/a61b77e98a224e9ea17fa24847e867e0/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:56 [ayvens.be] INFO: Found listing with ID: 1986081
2026-03-26 22:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986081%27 HTTP/1.1" 200 None
2026-03-26 22:46:56 [ayvens.be] INFO: Scrape type for 1986081: 1
2026-03-26 22:46:56 [ayvens.be] INFO: Extracting data for car ID: 1986081
2026-03-26 22:46:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36c7a8a2-e03e-563f-8ba2-5ee7a63717aa with identifier: 1986081
2026-03-26 22:46:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36c7a8a2-e03e-563f-8ba2-5ee7a63717aa with scrape type 1
2026-03-26 22:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 36c7a8a2-e03e-563f-8ba2-5ee7a63717aa
2026-03-26 22:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dk%252Fe09bb021720b47819cf916f1d88a39af%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dk/e09bb021720b47819cf916f1d88a39af/images/large/1.jpg not downloaded yet
2026-03-26 22:46:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7400e50>
2026-03-26 22:46:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac0ae577-68d3-564d-b024-571a2b36e74e/ac0ae577-68d3-564d-b024-571a2b36e74e_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252Fe6e93b3618b0405b8a448253e2aacd9f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/e6e93b3618b0405b8a448253e2aacd9f/images/large/7.jpg saved to cache
2026-03-26 22:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ac0ae577-68d3-564d-b024-571a2b36e74e
2026-03-26 22:46:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7660350>
2026-03-26 22:46:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac0ae577-68d3-564d-b024-571a2b36e74e/ac0ae577-68d3-564d-b024-571a2b36e74e_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252Fe6e93b3618b0405b8a448253e2aacd9f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/e6e93b3618b0405b8a448253e2aacd9f/images/large/8.jpg saved to cache
2026-03-26 22:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ac0ae577-68d3-564d-b024-571a2b36e74e
2026-03-26 22:46:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7500250>
2026-03-26 22:46:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac0ae577-68d3-564d-b024-571a2b36e74e/ac0ae577-68d3-564d-b024-571a2b36e74e_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252Fe6e93b3618b0405b8a448253e2aacd9f%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/e6e93b3618b0405b8a448253e2aacd9f/images/large/9.jpg saved to cache
2026-03-26 22:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ac0ae577-68d3-564d-b024-571a2b36e74e
2026-03-26 22:46:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7492410>
2026-03-26 22:46:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac0ae577-68d3-564d-b024-571a2b36e74e/ac0ae577-68d3-564d-b024-571a2b36e74e_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252Fe6e93b3618b0405b8a448253e2aacd9f%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/e6e93b3618b0405b8a448253e2aacd9f/images/large/10.jpg saved to cache
2026-03-26 22:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ac0ae577-68d3-564d-b024-571a2b36e74e
2026-03-26 22:46:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ac0ae577-68d3-564d-b024-571a2b36e74e, skipping ID generation
2026-03-26 22:46:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac0ae577-68d3-564d-b024-571a2b36e74e with scrape type 1
2026-03-26 22:46:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ac0ae577-68d3-564d-b024-571a2b36e74e sending to next pipeline
2026-03-26 22:46:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: ac0ae577-68d3-564d-b024-571a2b36e74e, identifier: 1986079
2026-03-26 22:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dk%252Fe09bb021720b47819cf916f1d88a39af%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dk/e09bb021720b47819cf916f1d88a39af/images/large/2.jpg not downloaded yet
2026-03-26 22:46:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: ac0ae577-68d3-564d-b024-571a2b36e74e with identifier: 1986079
2026-03-26 22:46:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: ac0ae577-68d3-564d-b024-571a2b36e74e with identifier: 1986079
2026-03-26 22:46:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: ac0ae577-68d3-564d-b024-571a2b36e74e with identifier: 1986079 to the API
2026-03-26 22:46:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:46:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:46:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1xj/e6e93b3618b0405b8a448253e2aacd9f/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'ac0ae577-68d3-564d-b024-571a2b36e74e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'Tiguan',
 'odometer': 196214,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac0ae577-68d3-564d-b024-571a2b36e74e/ac0ae577-68d3-564d-b024-571a2b36e74e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 651620,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/e6e93b3618b0405b8a448253e2aacd9f/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac0ae577-68d3-564d-b024-571a2b36e74e/ac0ae577-68d3-564d-b024-571a2b36e74e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 594013,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/e6e93b3618b0405b8a448253e2aacd9f/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac0ae577-68d3-564d-b024-571a2b36e74e/ac0ae577-68d3-564d-b024-571a2b36e74e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 578955,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/e6e93b3618b0405b8a448253e2aacd9f/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac0ae577-68d3-564d-b024-571a2b36e74e/ac0ae577-68d3-564d-b024-571a2b36e74e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 623092,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/e6e93b3618b0405b8a448253e2aacd9f/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac0ae577-68d3-564d-b024-571a2b36e74e/ac0ae577-68d3-564d-b024-571a2b36e74e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 587201,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/e6e93b3618b0405b8a448253e2aacd9f/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac0ae577-68d3-564d-b024-571a2b36e74e/ac0ae577-68d3-564d-b024-571a2b36e74e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 555560,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/e6e93b3618b0405b8a448253e2aacd9f/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac0ae577-68d3-564d-b024-571a2b36e74e/ac0ae577-68d3-564d-b024-571a2b36e74e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 647377,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/e6e93b3618b0405b8a448253e2aacd9f/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac0ae577-68d3-564d-b024-571a2b36e74e/ac0ae577-68d3-564d-b024-571a2b36e74e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 658980,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/e6e93b3618b0405b8a448253e2aacd9f/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac0ae577-68d3-564d-b024-571a2b36e74e/ac0ae577-68d3-564d-b024-571a2b36e74e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 595006,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/e6e93b3618b0405b8a448253e2aacd9f/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac0ae577-68d3-564d-b024-571a2b36e74e/ac0ae577-68d3-564d-b024-571a2b36e74e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 593463,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/e6e93b3618b0405b8a448253e2aacd9f/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN Tiguan 1.5 TSI COMFORTLINE DSG',
 'transmission': 'automatic',
 'trim': '1.5 TSI COMFORTLINE DSG',
 'vin': None,
 'year': 2020}
2026-03-26 22:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986079%27 HTTP/1.1" 200 None
2026-03-26 22:46:57 [ayvens.be] INFO: Saving data for 1986079: {'created_time': 1774565217.31005, 'last_price_update_time': 1774565217.310059, 'auction_closing_time': 1775028600.0}
2026-03-26 22:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986079') HTTP/1.1" 204 0
2026-03-26 22:46:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bdd9ac10>
2026-03-26 22:46:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6002d677-f9a6-5436-94d1-f956b03575d0/6002d677-f9a6-5436-94d1-f956b03575d0_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fa61b77e98a224e9ea17fa24847e867e0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/a61b77e98a224e9ea17fa24847e867e0/images/large/1.jpg saved to cache
2026-03-26 22:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6002d677-f9a6-5436-94d1-f956b03575d0
2026-03-26 22:46:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b727a7d0>
2026-03-26 22:46:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6002d677-f9a6-5436-94d1-f956b03575d0/6002d677-f9a6-5436-94d1-f956b03575d0_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fa61b77e98a224e9ea17fa24847e867e0%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/a61b77e98a224e9ea17fa24847e867e0/images/large/2.jpg saved to cache
2026-03-26 22:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6002d677-f9a6-5436-94d1-f956b03575d0
2026-03-26 22:46:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c94fd0>
2026-03-26 22:46:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6002d677-f9a6-5436-94d1-f956b03575d0/6002d677-f9a6-5436-94d1-f956b03575d0_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fa61b77e98a224e9ea17fa24847e867e0%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/a61b77e98a224e9ea17fa24847e867e0/images/large/3.jpg saved to cache
2026-03-26 22:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6002d677-f9a6-5436-94d1-f956b03575d0
2026-03-26 22:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dk%252Fe09bb021720b47819cf916f1d88a39af%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dk/e09bb021720b47819cf916f1d88a39af/images/large/3.jpg not downloaded yet
2026-03-26 22:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dk%252Fe09bb021720b47819cf916f1d88a39af%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dk/e09bb021720b47819cf916f1d88a39af/images/large/4.jpg not downloaded yet
2026-03-26 22:46:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/a61b77e98a224e9ea17fa24847e867e0/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dk%252Fe09bb021720b47819cf916f1d88a39af%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dk/e09bb021720b47819cf916f1d88a39af/images/large/5.jpg not downloaded yet
2026-03-26 22:46:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/a61b77e98a224e9ea17fa24847e867e0/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/a61b77e98a224e9ea17fa24847e867e0/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dk%252Fe09bb021720b47819cf916f1d88a39af%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dk/e09bb021720b47819cf916f1d88a39af/images/large/6.jpg not downloaded yet
2026-03-26 22:46:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/a61b77e98a224e9ea17fa24847e867e0/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/a61b77e98a224e9ea17fa24847e867e0/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/a61b77e98a224e9ea17fa24847e867e0/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/a61b77e98a224e9ea17fa24847e867e0/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dk%252Fe09bb021720b47819cf916f1d88a39af%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dk/e09bb021720b47819cf916f1d88a39af/images/large/7.jpg not downloaded yet
2026-03-26 22:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dk%252Fe09bb021720b47819cf916f1d88a39af%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dk/e09bb021720b47819cf916f1d88a39af/images/large/8.jpg not downloaded yet
2026-03-26 22:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dk%252Fe09bb021720b47819cf916f1d88a39af%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dk/e09bb021720b47819cf916f1d88a39af/images/large/9.jpg not downloaded yet
2026-03-26 22:46:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dk/e09bb021720b47819cf916f1d88a39af/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dk/e09bb021720b47819cf916f1d88a39af/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dk/e09bb021720b47819cf916f1d88a39af/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e4dcd0>
2026-03-26 22:46:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6002d677-f9a6-5436-94d1-f956b03575d0/6002d677-f9a6-5436-94d1-f956b03575d0_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fa61b77e98a224e9ea17fa24847e867e0%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/a61b77e98a224e9ea17fa24847e867e0/images/large/6.jpg saved to cache
2026-03-26 22:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6002d677-f9a6-5436-94d1-f956b03575d0
2026-03-26 22:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dk%252Fe09bb021720b47819cf916f1d88a39af%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dk/e09bb021720b47819cf916f1d88a39af/images/large/10.jpg not downloaded yet
2026-03-26 22:46:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e10910>
2026-03-26 22:46:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6002d677-f9a6-5436-94d1-f956b03575d0/6002d677-f9a6-5436-94d1-f956b03575d0_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fa61b77e98a224e9ea17fa24847e867e0%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/a61b77e98a224e9ea17fa24847e867e0/images/large/5.jpg saved to cache
2026-03-26 22:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6002d677-f9a6-5436-94d1-f956b03575d0
2026-03-26 22:46:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5ca5150>
2026-03-26 22:46:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6002d677-f9a6-5436-94d1-f956b03575d0/6002d677-f9a6-5436-94d1-f956b03575d0_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fa61b77e98a224e9ea17fa24847e867e0%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/a61b77e98a224e9ea17fa24847e867e0/images/large/4.jpg saved to cache
2026-03-26 22:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6002d677-f9a6-5436-94d1-f956b03575d0
2026-03-26 22:46:58 [ayvens.be] INFO: Found listing with ID: 1986082
2026-03-26 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986082%27 HTTP/1.1" 200 None
2026-03-26 22:46:58 [ayvens.be] INFO: Scrape type for 1986082: 1
2026-03-26 22:46:58 [ayvens.be] INFO: Extracting data for car ID: 1986082
2026-03-26 22:46:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f468d374-ccd1-5d52-b210-0d5cf63ead13 with identifier: 1986082
2026-03-26 22:46:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f468d374-ccd1-5d52-b210-0d5cf63ead13 with scrape type 1
2026-03-26 22:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f468d374-ccd1-5d52-b210-0d5cf63ead13
2026-03-26 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252F27281ba68ec54783ba493f4af2bd928e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/27281ba68ec54783ba493f4af2bd928e/images/large/1.jpg not downloaded yet
2026-03-26 22:46:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dk/e09bb021720b47819cf916f1d88a39af/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd0af350>
2026-03-26 22:46:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6002d677-f9a6-5436-94d1-f956b03575d0/6002d677-f9a6-5436-94d1-f956b03575d0_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fa61b77e98a224e9ea17fa24847e867e0%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/a61b77e98a224e9ea17fa24847e867e0/images/large/8.jpg saved to cache
2026-03-26 22:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6002d677-f9a6-5436-94d1-f956b03575d0
2026-03-26 22:46:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7663310>
2026-03-26 22:46:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6002d677-f9a6-5436-94d1-f956b03575d0/6002d677-f9a6-5436-94d1-f956b03575d0_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fa61b77e98a224e9ea17fa24847e867e0%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/a61b77e98a224e9ea17fa24847e867e0/images/large/9.jpg saved to cache
2026-03-26 22:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6002d677-f9a6-5436-94d1-f956b03575d0
2026-03-26 22:46:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c6bad0>
2026-03-26 22:46:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6002d677-f9a6-5436-94d1-f956b03575d0/6002d677-f9a6-5436-94d1-f956b03575d0_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fa61b77e98a224e9ea17fa24847e867e0%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/a61b77e98a224e9ea17fa24847e867e0/images/large/7.jpg saved to cache
2026-03-26 22:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6002d677-f9a6-5436-94d1-f956b03575d0
2026-03-26 22:46:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c83990>
2026-03-26 22:46:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6002d677-f9a6-5436-94d1-f956b03575d0/6002d677-f9a6-5436-94d1-f956b03575d0_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fa61b77e98a224e9ea17fa24847e867e0%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/a61b77e98a224e9ea17fa24847e867e0/images/large/10.jpg saved to cache
2026-03-26 22:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6002d677-f9a6-5436-94d1-f956b03575d0
2026-03-26 22:46:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6002d677-f9a6-5436-94d1-f956b03575d0, skipping ID generation
2026-03-26 22:46:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6002d677-f9a6-5436-94d1-f956b03575d0 with scrape type 1
2026-03-26 22:46:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6002d677-f9a6-5436-94d1-f956b03575d0 sending to next pipeline
2026-03-26 22:46:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 6002d677-f9a6-5436-94d1-f956b03575d0, identifier: 1986080
2026-03-26 22:46:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6dc2e10>
2026-03-26 22:46:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36c7a8a2-e03e-563f-8ba2-5ee7a63717aa/36c7a8a2-e03e-563f-8ba2-5ee7a63717aa_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dk%252Fe09bb021720b47819cf916f1d88a39af%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dk/e09bb021720b47819cf916f1d88a39af/images/large/1.jpg saved to cache
2026-03-26 22:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 36c7a8a2-e03e-563f-8ba2-5ee7a63717aa
2026-03-26 22:46:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74e7b90>
2026-03-26 22:46:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36c7a8a2-e03e-563f-8ba2-5ee7a63717aa/36c7a8a2-e03e-563f-8ba2-5ee7a63717aa_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dk%252Fe09bb021720b47819cf916f1d88a39af%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dk/e09bb021720b47819cf916f1d88a39af/images/large/2.jpg saved to cache
2026-03-26 22:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 36c7a8a2-e03e-563f-8ba2-5ee7a63717aa
2026-03-26 22:46:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c6b7d0>
2026-03-26 22:46:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36c7a8a2-e03e-563f-8ba2-5ee7a63717aa/36c7a8a2-e03e-563f-8ba2-5ee7a63717aa_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dk%252Fe09bb021720b47819cf916f1d88a39af%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dk/e09bb021720b47819cf916f1d88a39af/images/large/3.jpg saved to cache
2026-03-26 22:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 36c7a8a2-e03e-563f-8ba2-5ee7a63717aa
2026-03-26 22:46:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dk/e09bb021720b47819cf916f1d88a39af/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252F27281ba68ec54783ba493f4af2bd928e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/27281ba68ec54783ba493f4af2bd928e/images/large/2.jpg not downloaded yet
2026-03-26 22:46:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 6002d677-f9a6-5436-94d1-f956b03575d0 with identifier: 1986080
2026-03-26 22:46:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 6002d677-f9a6-5436-94d1-f956b03575d0 with identifier: 1986080
2026-03-26 22:46:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 6002d677-f9a6-5436-94d1-f956b03575d0 with identifier: 1986080 to the API
2026-03-26 22:46:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:46:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:46:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yw/a61b77e98a224e9ea17fa24847e867e0/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '6002d677-f9a6-5436-94d1-f956b03575d0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TIGUAN',
 'odometer': 68076,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6002d677-f9a6-5436-94d1-f956b03575d0/6002d677-f9a6-5436-94d1-f956b03575d0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 654947,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/a61b77e98a224e9ea17fa24847e867e0/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6002d677-f9a6-5436-94d1-f956b03575d0/6002d677-f9a6-5436-94d1-f956b03575d0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 656447,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/a61b77e98a224e9ea17fa24847e867e0/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6002d677-f9a6-5436-94d1-f956b03575d0/6002d677-f9a6-5436-94d1-f956b03575d0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 641462,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/a61b77e98a224e9ea17fa24847e867e0/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6002d677-f9a6-5436-94d1-f956b03575d0/6002d677-f9a6-5436-94d1-f956b03575d0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 634759,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/a61b77e98a224e9ea17fa24847e867e0/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6002d677-f9a6-5436-94d1-f956b03575d0/6002d677-f9a6-5436-94d1-f956b03575d0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 667489,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/a61b77e98a224e9ea17fa24847e867e0/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6002d677-f9a6-5436-94d1-f956b03575d0/6002d677-f9a6-5436-94d1-f956b03575d0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 645277,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/a61b77e98a224e9ea17fa24847e867e0/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6002d677-f9a6-5436-94d1-f956b03575d0/6002d677-f9a6-5436-94d1-f956b03575d0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 687849,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/a61b77e98a224e9ea17fa24847e867e0/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6002d677-f9a6-5436-94d1-f956b03575d0/6002d677-f9a6-5436-94d1-f956b03575d0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 640905,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/a61b77e98a224e9ea17fa24847e867e0/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6002d677-f9a6-5436-94d1-f956b03575d0/6002d677-f9a6-5436-94d1-f956b03575d0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 567625,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/a61b77e98a224e9ea17fa24847e867e0/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6002d677-f9a6-5436-94d1-f956b03575d0/6002d677-f9a6-5436-94d1-f956b03575d0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 567873,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/a61b77e98a224e9ea17fa24847e867e0/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN TIGUAN 2.0 TDI 90KW LIFE',
 'transmission': 'manual',
 'trim': '2.0 TDI 90KW LIFE',
 'vin': None,
 'year': 2021}
2026-03-26 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986080%27 HTTP/1.1" 200 None
2026-03-26 22:46:59 [ayvens.be] INFO: Saving data for 1986080: {'created_time': 1774565219.181671, 'last_price_update_time': 1774565219.18168, 'auction_closing_time': 1775028600.0}
2026-03-26 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986080') HTTP/1.1" 204 0
2026-03-26 22:46:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dk/e09bb021720b47819cf916f1d88a39af/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dk/e09bb021720b47819cf916f1d88a39af/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252F27281ba68ec54783ba493f4af2bd928e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/27281ba68ec54783ba493f4af2bd928e/images/large/3.jpg not downloaded yet
2026-03-26 22:46:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79cf850>
2026-03-26 22:46:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36c7a8a2-e03e-563f-8ba2-5ee7a63717aa/36c7a8a2-e03e-563f-8ba2-5ee7a63717aa_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dk%252Fe09bb021720b47819cf916f1d88a39af%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dk/e09bb021720b47819cf916f1d88a39af/images/large/4.jpg saved to cache
2026-03-26 22:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 36c7a8a2-e03e-563f-8ba2-5ee7a63717aa
2026-03-26 22:46:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e3f5d0>
2026-03-26 22:46:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36c7a8a2-e03e-563f-8ba2-5ee7a63717aa/36c7a8a2-e03e-563f-8ba2-5ee7a63717aa_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dk%252Fe09bb021720b47819cf916f1d88a39af%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dk/e09bb021720b47819cf916f1d88a39af/images/large/7.jpg saved to cache
2026-03-26 22:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 36c7a8a2-e03e-563f-8ba2-5ee7a63717aa
2026-03-26 22:46:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dk/e09bb021720b47819cf916f1d88a39af/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252F27281ba68ec54783ba493f4af2bd928e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/27281ba68ec54783ba493f4af2bd928e/images/large/4.jpg not downloaded yet
2026-03-26 22:46:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dk/e09bb021720b47819cf916f1d88a39af/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dk/e09bb021720b47819cf916f1d88a39af/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252F27281ba68ec54783ba493f4af2bd928e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/27281ba68ec54783ba493f4af2bd928e/images/large/5.jpg not downloaded yet
2026-03-26 22:46:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e37d10>
2026-03-26 22:46:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36c7a8a2-e03e-563f-8ba2-5ee7a63717aa/36c7a8a2-e03e-563f-8ba2-5ee7a63717aa_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dk%252Fe09bb021720b47819cf916f1d88a39af%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dk/e09bb021720b47819cf916f1d88a39af/images/large/5.jpg saved to cache
2026-03-26 22:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 36c7a8a2-e03e-563f-8ba2-5ee7a63717aa
2026-03-26 22:46:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7565c10>
2026-03-26 22:46:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36c7a8a2-e03e-563f-8ba2-5ee7a63717aa/36c7a8a2-e03e-563f-8ba2-5ee7a63717aa_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dk%252Fe09bb021720b47819cf916f1d88a39af%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dk/e09bb021720b47819cf916f1d88a39af/images/large/6.jpg saved to cache
2026-03-26 22:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 36c7a8a2-e03e-563f-8ba2-5ee7a63717aa
2026-03-26 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252F27281ba68ec54783ba493f4af2bd928e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/27281ba68ec54783ba493f4af2bd928e/images/large/6.jpg not downloaded yet
2026-03-26 22:46:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e15490>
2026-03-26 22:46:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36c7a8a2-e03e-563f-8ba2-5ee7a63717aa/36c7a8a2-e03e-563f-8ba2-5ee7a63717aa_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dk%252Fe09bb021720b47819cf916f1d88a39af%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dk/e09bb021720b47819cf916f1d88a39af/images/large/8.jpg saved to cache
2026-03-26 22:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 36c7a8a2-e03e-563f-8ba2-5ee7a63717aa
2026-03-26 22:46:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7aa3dd0>
2026-03-26 22:46:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36c7a8a2-e03e-563f-8ba2-5ee7a63717aa/36c7a8a2-e03e-563f-8ba2-5ee7a63717aa_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dk%252Fe09bb021720b47819cf916f1d88a39af%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dk/e09bb021720b47819cf916f1d88a39af/images/large/9.jpg saved to cache
2026-03-26 22:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 36c7a8a2-e03e-563f-8ba2-5ee7a63717aa
2026-03-26 22:46:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:46:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79a7ad0>
2026-03-26 22:46:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:46:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36c7a8a2-e03e-563f-8ba2-5ee7a63717aa/36c7a8a2-e03e-563f-8ba2-5ee7a63717aa_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dk%252Fe09bb021720b47819cf916f1d88a39af%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dk/e09bb021720b47819cf916f1d88a39af/images/large/10.jpg saved to cache
2026-03-26 22:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 36c7a8a2-e03e-563f-8ba2-5ee7a63717aa
2026-03-26 22:46:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 36c7a8a2-e03e-563f-8ba2-5ee7a63717aa, skipping ID generation
2026-03-26 22:46:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36c7a8a2-e03e-563f-8ba2-5ee7a63717aa with scrape type 1
2026-03-26 22:46:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 36c7a8a2-e03e-563f-8ba2-5ee7a63717aa sending to next pipeline
2026-03-26 22:46:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 36c7a8a2-e03e-563f-8ba2-5ee7a63717aa, identifier: 1986081
2026-03-26 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252F27281ba68ec54783ba493f4af2bd928e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/27281ba68ec54783ba493f4af2bd928e/images/large/7.jpg not downloaded yet
2026-03-26 22:46:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 36c7a8a2-e03e-563f-8ba2-5ee7a63717aa with identifier: 1986081
2026-03-26 22:46:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 36c7a8a2-e03e-563f-8ba2-5ee7a63717aa with identifier: 1986081
2026-03-26 22:46:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 36c7a8a2-e03e-563f-8ba2-5ee7a63717aa with identifier: 1986081 to the API
2026-03-26 22:46:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:47:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:47:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2dk/e09bb021720b47819cf916f1d88a39af/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '36c7a8a2-e03e-563f-8ba2-5ee7a63717aa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3 SPORTBACK',
 'odometer': 40864,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36c7a8a2-e03e-563f-8ba2-5ee7a63717aa/36c7a8a2-e03e-563f-8ba2-5ee7a63717aa_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 225067,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dk/e09bb021720b47819cf916f1d88a39af/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36c7a8a2-e03e-563f-8ba2-5ee7a63717aa/36c7a8a2-e03e-563f-8ba2-5ee7a63717aa_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 209286,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dk/e09bb021720b47819cf916f1d88a39af/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36c7a8a2-e03e-563f-8ba2-5ee7a63717aa/36c7a8a2-e03e-563f-8ba2-5ee7a63717aa_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 242446,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dk/e09bb021720b47819cf916f1d88a39af/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36c7a8a2-e03e-563f-8ba2-5ee7a63717aa/36c7a8a2-e03e-563f-8ba2-5ee7a63717aa_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 235655,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dk/e09bb021720b47819cf916f1d88a39af/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36c7a8a2-e03e-563f-8ba2-5ee7a63717aa/36c7a8a2-e03e-563f-8ba2-5ee7a63717aa_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 268693,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dk/e09bb021720b47819cf916f1d88a39af/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36c7a8a2-e03e-563f-8ba2-5ee7a63717aa/36c7a8a2-e03e-563f-8ba2-5ee7a63717aa_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 267991,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dk/e09bb021720b47819cf916f1d88a39af/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36c7a8a2-e03e-563f-8ba2-5ee7a63717aa/36c7a8a2-e03e-563f-8ba2-5ee7a63717aa_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 254255,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dk/e09bb021720b47819cf916f1d88a39af/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36c7a8a2-e03e-563f-8ba2-5ee7a63717aa/36c7a8a2-e03e-563f-8ba2-5ee7a63717aa_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 340982,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dk/e09bb021720b47819cf916f1d88a39af/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36c7a8a2-e03e-563f-8ba2-5ee7a63717aa/36c7a8a2-e03e-563f-8ba2-5ee7a63717aa_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 320203,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dk/e09bb021720b47819cf916f1d88a39af/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36c7a8a2-e03e-563f-8ba2-5ee7a63717aa/36c7a8a2-e03e-563f-8ba2-5ee7a63717aa_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 282410,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dk/e09bb021720b47819cf916f1d88a39af/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-04-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 SPORTBACK 1.4 45 TFSI E S TRONIC S LINE',
 'transmission': 'automatic',
 'trim': '1.4 45 TFSI E S TRONIC S LINE',
 'vin': None,
 'year': 2023}
2026-03-26 22:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986081%27 HTTP/1.1" 200 None
2026-03-26 22:47:00 [ayvens.be] INFO: Saving data for 1986081: {'created_time': 1774565220.29481, 'last_price_update_time': 1774565220.294821, 'auction_closing_time': 1775028600.0}
2026-03-26 22:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986081') HTTP/1.1" 204 0
2026-03-26 22:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252F27281ba68ec54783ba493f4af2bd928e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/27281ba68ec54783ba493f4af2bd928e/images/large/8.jpg not downloaded yet
2026-03-26 22:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252F27281ba68ec54783ba493f4af2bd928e%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/27281ba68ec54783ba493f4af2bd928e/images/large/9.jpg not downloaded yet
2026-03-26 22:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252F27281ba68ec54783ba493f4af2bd928e%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/27281ba68ec54783ba493f4af2bd928e/images/large/10.jpg not downloaded yet
2026-03-26 22:47:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ap/27281ba68ec54783ba493f4af2bd928e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ap/27281ba68ec54783ba493f4af2bd928e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:00 [ayvens.be] INFO: Found listing with ID: 1986083
2026-03-26 22:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986083%27 HTTP/1.1" 200 None
2026-03-26 22:47:00 [ayvens.be] INFO: Scrape type for 1986083: 1
2026-03-26 22:47:00 [ayvens.be] INFO: Extracting data for car ID: 1986083
2026-03-26 22:47:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2cb39d9d-bb0f-5553-91eb-eb616d811f5b with identifier: 1986083
2026-03-26 22:47:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2cb39d9d-bb0f-5553-91eb-eb616d811f5b with scrape type 1
2026-03-26 22:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2cb39d9d-bb0f-5553-91eb-eb616d811f5b
2026-03-26 22:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F59a9420072fc4941bb1bbf4517f0e562%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/59a9420072fc4941bb1bbf4517f0e562/images/large/1.jpg not downloaded yet
2026-03-26 22:47:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ap/27281ba68ec54783ba493f4af2bd928e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F59a9420072fc4941bb1bbf4517f0e562%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/59a9420072fc4941bb1bbf4517f0e562/images/large/2.jpg not downloaded yet
2026-03-26 22:47:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ap/27281ba68ec54783ba493f4af2bd928e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F59a9420072fc4941bb1bbf4517f0e562%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/59a9420072fc4941bb1bbf4517f0e562/images/large/3.jpg not downloaded yet
2026-03-26 22:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F59a9420072fc4941bb1bbf4517f0e562%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/59a9420072fc4941bb1bbf4517f0e562/images/large/4.jpg not downloaded yet
2026-03-26 22:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F59a9420072fc4941bb1bbf4517f0e562%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/59a9420072fc4941bb1bbf4517f0e562/images/large/5.jpg not downloaded yet
2026-03-26 22:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F59a9420072fc4941bb1bbf4517f0e562%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/59a9420072fc4941bb1bbf4517f0e562/images/large/6.jpg not downloaded yet
2026-03-26 22:47:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ap/27281ba68ec54783ba493f4af2bd928e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79d6810>
2026-03-26 22:47:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f468d374-ccd1-5d52-b210-0d5cf63ead13/f468d374-ccd1-5d52-b210-0d5cf63ead13_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252F27281ba68ec54783ba493f4af2bd928e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/27281ba68ec54783ba493f4af2bd928e/images/large/1.jpg saved to cache
2026-03-26 22:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f468d374-ccd1-5d52-b210-0d5cf63ead13
2026-03-26 22:47:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77d7310>
2026-03-26 22:47:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f468d374-ccd1-5d52-b210-0d5cf63ead13/f468d374-ccd1-5d52-b210-0d5cf63ead13_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252F27281ba68ec54783ba493f4af2bd928e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/27281ba68ec54783ba493f4af2bd928e/images/large/2.jpg saved to cache
2026-03-26 22:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f468d374-ccd1-5d52-b210-0d5cf63ead13
2026-03-26 22:47:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ap/27281ba68ec54783ba493f4af2bd928e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F59a9420072fc4941bb1bbf4517f0e562%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/59a9420072fc4941bb1bbf4517f0e562/images/large/7.jpg not downloaded yet
2026-03-26 22:47:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ap/27281ba68ec54783ba493f4af2bd928e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F59a9420072fc4941bb1bbf4517f0e562%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/59a9420072fc4941bb1bbf4517f0e562/images/large/8.jpg not downloaded yet
2026-03-26 22:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F59a9420072fc4941bb1bbf4517f0e562%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/59a9420072fc4941bb1bbf4517f0e562/images/large/9.jpg not downloaded yet
2026-03-26 22:47:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e44c50>
2026-03-26 22:47:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f468d374-ccd1-5d52-b210-0d5cf63ead13/f468d374-ccd1-5d52-b210-0d5cf63ead13_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252F27281ba68ec54783ba493f4af2bd928e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/27281ba68ec54783ba493f4af2bd928e/images/large/3.jpg saved to cache
2026-03-26 22:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f468d374-ccd1-5d52-b210-0d5cf63ead13
2026-03-26 22:47:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79cd650>
2026-03-26 22:47:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f468d374-ccd1-5d52-b210-0d5cf63ead13/f468d374-ccd1-5d52-b210-0d5cf63ead13_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252F27281ba68ec54783ba493f4af2bd928e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/27281ba68ec54783ba493f4af2bd928e/images/large/4.jpg saved to cache
2026-03-26 22:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f468d374-ccd1-5d52-b210-0d5cf63ead13
2026-03-26 22:47:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7926690>
2026-03-26 22:47:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f468d374-ccd1-5d52-b210-0d5cf63ead13/f468d374-ccd1-5d52-b210-0d5cf63ead13_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252F27281ba68ec54783ba493f4af2bd928e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/27281ba68ec54783ba493f4af2bd928e/images/large/7.jpg saved to cache
2026-03-26 22:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f468d374-ccd1-5d52-b210-0d5cf63ead13
2026-03-26 22:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F59a9420072fc4941bb1bbf4517f0e562%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/59a9420072fc4941bb1bbf4517f0e562/images/large/10.jpg not downloaded yet
2026-03-26 22:47:01 [ayvens.be] INFO: Found listing with ID: 1986084
2026-03-26 22:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986084%27 HTTP/1.1" 200 None
2026-03-26 22:47:01 [ayvens.be] INFO: Scrape type for 1986084: 1
2026-03-26 22:47:01 [ayvens.be] INFO: Extracting data for car ID: 1986084
2026-03-26 22:47:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: abf05fb0-a1b8-56dc-9421-ae702229d085 with identifier: 1986084
2026-03-26 22:47:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item abf05fb0-a1b8-56dc-9421-ae702229d085 with scrape type 1
2026-03-26 22:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item abf05fb0-a1b8-56dc-9421-ae702229d085
2026-03-26 22:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xe%252F4efdcc6130e649df9ef70ee036433615%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xe/4efdcc6130e649df9ef70ee036433615/images/large/1.jpg not downloaded yet
2026-03-26 22:47:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ap/27281ba68ec54783ba493f4af2bd928e/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79f16d0>
2026-03-26 22:47:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f468d374-ccd1-5d52-b210-0d5cf63ead13/f468d374-ccd1-5d52-b210-0d5cf63ead13_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252F27281ba68ec54783ba493f4af2bd928e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/27281ba68ec54783ba493f4af2bd928e/images/large/5.jpg saved to cache
2026-03-26 22:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f468d374-ccd1-5d52-b210-0d5cf63ead13
2026-03-26 22:47:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77bc950>
2026-03-26 22:47:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f468d374-ccd1-5d52-b210-0d5cf63ead13/f468d374-ccd1-5d52-b210-0d5cf63ead13_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252F27281ba68ec54783ba493f4af2bd928e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/27281ba68ec54783ba493f4af2bd928e/images/large/6.jpg saved to cache
2026-03-26 22:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f468d374-ccd1-5d52-b210-0d5cf63ead13
2026-03-26 22:47:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/59a9420072fc4941bb1bbf4517f0e562/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xe%252F4efdcc6130e649df9ef70ee036433615%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xe/4efdcc6130e649df9ef70ee036433615/images/large/2.jpg not downloaded yet
2026-03-26 22:47:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ap/27281ba68ec54783ba493f4af2bd928e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/59a9420072fc4941bb1bbf4517f0e562/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xe%252F4efdcc6130e649df9ef70ee036433615%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xe/4efdcc6130e649df9ef70ee036433615/images/large/3.jpg not downloaded yet
2026-03-26 22:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xe%252F4efdcc6130e649df9ef70ee036433615%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xe/4efdcc6130e649df9ef70ee036433615/images/large/4.jpg not downloaded yet
2026-03-26 22:47:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74cd850>
2026-03-26 22:47:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f468d374-ccd1-5d52-b210-0d5cf63ead13/f468d374-ccd1-5d52-b210-0d5cf63ead13_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252F27281ba68ec54783ba493f4af2bd928e%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/27281ba68ec54783ba493f4af2bd928e/images/large/9.jpg saved to cache
2026-03-26 22:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f468d374-ccd1-5d52-b210-0d5cf63ead13
2026-03-26 22:47:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/59a9420072fc4941bb1bbf4517f0e562/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/59a9420072fc4941bb1bbf4517f0e562/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/59a9420072fc4941bb1bbf4517f0e562/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ap/27281ba68ec54783ba493f4af2bd928e/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xe%252F4efdcc6130e649df9ef70ee036433615%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xe/4efdcc6130e649df9ef70ee036433615/images/large/5.jpg not downloaded yet
2026-03-26 22:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xe%252F4efdcc6130e649df9ef70ee036433615%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xe/4efdcc6130e649df9ef70ee036433615/images/large/6.jpg not downloaded yet
2026-03-26 22:47:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c97250>
2026-03-26 22:47:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2cb39d9d-bb0f-5553-91eb-eb616d811f5b/2cb39d9d-bb0f-5553-91eb-eb616d811f5b_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F59a9420072fc4941bb1bbf4517f0e562%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/59a9420072fc4941bb1bbf4517f0e562/images/large/1.jpg saved to cache
2026-03-26 22:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2cb39d9d-bb0f-5553-91eb-eb616d811f5b
2026-03-26 22:47:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7495850>
2026-03-26 22:47:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f468d374-ccd1-5d52-b210-0d5cf63ead13/f468d374-ccd1-5d52-b210-0d5cf63ead13_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252F27281ba68ec54783ba493f4af2bd928e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/27281ba68ec54783ba493f4af2bd928e/images/large/8.jpg saved to cache
2026-03-26 22:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f468d374-ccd1-5d52-b210-0d5cf63ead13
2026-03-26 22:47:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cbf2d0>
2026-03-26 22:47:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2cb39d9d-bb0f-5553-91eb-eb616d811f5b/2cb39d9d-bb0f-5553-91eb-eb616d811f5b_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F59a9420072fc4941bb1bbf4517f0e562%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/59a9420072fc4941bb1bbf4517f0e562/images/large/2.jpg saved to cache
2026-03-26 22:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2cb39d9d-bb0f-5553-91eb-eb616d811f5b
2026-03-26 22:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xe%252F4efdcc6130e649df9ef70ee036433615%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xe/4efdcc6130e649df9ef70ee036433615/images/large/7.jpg not downloaded yet
2026-03-26 22:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xe%252F4efdcc6130e649df9ef70ee036433615%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xe/4efdcc6130e649df9ef70ee036433615/images/large/8.jpg not downloaded yet
2026-03-26 22:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xe%252F4efdcc6130e649df9ef70ee036433615%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xe/4efdcc6130e649df9ef70ee036433615/images/large/9.jpg not downloaded yet
2026-03-26 22:47:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e47d90>
2026-03-26 22:47:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2cb39d9d-bb0f-5553-91eb-eb616d811f5b/2cb39d9d-bb0f-5553-91eb-eb616d811f5b_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F59a9420072fc4941bb1bbf4517f0e562%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/59a9420072fc4941bb1bbf4517f0e562/images/large/4.jpg saved to cache
2026-03-26 22:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2cb39d9d-bb0f-5553-91eb-eb616d811f5b
2026-03-26 22:47:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7770950>
2026-03-26 22:47:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2cb39d9d-bb0f-5553-91eb-eb616d811f5b/2cb39d9d-bb0f-5553-91eb-eb616d811f5b_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F59a9420072fc4941bb1bbf4517f0e562%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/59a9420072fc4941bb1bbf4517f0e562/images/large/5.jpg saved to cache
2026-03-26 22:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2cb39d9d-bb0f-5553-91eb-eb616d811f5b
2026-03-26 22:47:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74816d0>
2026-03-26 22:47:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2cb39d9d-bb0f-5553-91eb-eb616d811f5b/2cb39d9d-bb0f-5553-91eb-eb616d811f5b_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F59a9420072fc4941bb1bbf4517f0e562%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/59a9420072fc4941bb1bbf4517f0e562/images/large/3.jpg saved to cache
2026-03-26 22:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2cb39d9d-bb0f-5553-91eb-eb616d811f5b
2026-03-26 22:47:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e1eb50>
2026-03-26 22:47:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f468d374-ccd1-5d52-b210-0d5cf63ead13/f468d374-ccd1-5d52-b210-0d5cf63ead13_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252F27281ba68ec54783ba493f4af2bd928e%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/27281ba68ec54783ba493f4af2bd928e/images/large/10.jpg saved to cache
2026-03-26 22:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f468d374-ccd1-5d52-b210-0d5cf63ead13
2026-03-26 22:47:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f468d374-ccd1-5d52-b210-0d5cf63ead13, skipping ID generation
2026-03-26 22:47:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f468d374-ccd1-5d52-b210-0d5cf63ead13 with scrape type 1
2026-03-26 22:47:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f468d374-ccd1-5d52-b210-0d5cf63ead13 sending to next pipeline
2026-03-26 22:47:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f468d374-ccd1-5d52-b210-0d5cf63ead13, identifier: 1986082
2026-03-26 22:47:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/59a9420072fc4941bb1bbf4517f0e562/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f468d374-ccd1-5d52-b210-0d5cf63ead13 with identifier: 1986082
2026-03-26 22:47:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f468d374-ccd1-5d52-b210-0d5cf63ead13 with identifier: 1986082
2026-03-26 22:47:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f468d374-ccd1-5d52-b210-0d5cf63ead13 with identifier: 1986082 to the API
2026-03-26 22:47:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:47:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:47:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ap/27281ba68ec54783ba493f4af2bd928e/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'f468d374-ccd1-5d52-b210-0d5cf63ead13',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLASS GLB DIESEL (X247)',
 'odometer': 114184,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f468d374-ccd1-5d52-b210-0d5cf63ead13/f468d374-ccd1-5d52-b210-0d5cf63ead13_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 722928,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ap/27281ba68ec54783ba493f4af2bd928e/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f468d374-ccd1-5d52-b210-0d5cf63ead13/f468d374-ccd1-5d52-b210-0d5cf63ead13_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 733541,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ap/27281ba68ec54783ba493f4af2bd928e/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f468d374-ccd1-5d52-b210-0d5cf63ead13/f468d374-ccd1-5d52-b210-0d5cf63ead13_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 721694,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ap/27281ba68ec54783ba493f4af2bd928e/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f468d374-ccd1-5d52-b210-0d5cf63ead13/f468d374-ccd1-5d52-b210-0d5cf63ead13_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 747474,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ap/27281ba68ec54783ba493f4af2bd928e/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f468d374-ccd1-5d52-b210-0d5cf63ead13/f468d374-ccd1-5d52-b210-0d5cf63ead13_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 736546,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ap/27281ba68ec54783ba493f4af2bd928e/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f468d374-ccd1-5d52-b210-0d5cf63ead13/f468d374-ccd1-5d52-b210-0d5cf63ead13_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 787278,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ap/27281ba68ec54783ba493f4af2bd928e/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f468d374-ccd1-5d52-b210-0d5cf63ead13/f468d374-ccd1-5d52-b210-0d5cf63ead13_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 619063,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ap/27281ba68ec54783ba493f4af2bd928e/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f468d374-ccd1-5d52-b210-0d5cf63ead13/f468d374-ccd1-5d52-b210-0d5cf63ead13_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 743314,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ap/27281ba68ec54783ba493f4af2bd928e/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f468d374-ccd1-5d52-b210-0d5cf63ead13/f468d374-ccd1-5d52-b210-0d5cf63ead13_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 666360,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ap/27281ba68ec54783ba493f4af2bd928e/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f468d374-ccd1-5d52-b210-0d5cf63ead13/f468d374-ccd1-5d52-b210-0d5cf63ead13_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 666484,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ap/27281ba68ec54783ba493f4af2bd928e/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-01',
 'seats_number': 7,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLASS GLB DIESEL (X247) GLB 200 d Business Solution',
 'transmission': 'automatic',
 'trim': 'GLB 200 d Business Solution',
 'vin': None,
 'year': 2021}
2026-03-26 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986082%27 HTTP/1.1" 200 None
2026-03-26 22:47:02 [ayvens.be] INFO: Saving data for 1986082: {'created_time': 1774565222.692336, 'last_price_update_time': 1774565222.692347, 'auction_closing_time': 1775028600.0}
2026-03-26 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986082') HTTP/1.1" 204 0
2026-03-26 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xe%252F4efdcc6130e649df9ef70ee036433615%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xe/4efdcc6130e649df9ef70ee036433615/images/large/10.jpg not downloaded yet
2026-03-26 22:47:02 [ayvens.be] INFO: Found listing with ID: 1986085
2026-03-26 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986085%27 HTTP/1.1" 200 None
2026-03-26 22:47:02 [ayvens.be] INFO: Scrape type for 1986085: 1
2026-03-26 22:47:02 [ayvens.be] INFO: Extracting data for car ID: 1986085
2026-03-26 22:47:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf5f4d0d-5182-5124-9122-5262a27fe735 with identifier: 1986085
2026-03-26 22:47:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf5f4d0d-5182-5124-9122-5262a27fe735 with scrape type 1
2026-03-26 22:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cf5f4d0d-5182-5124-9122-5262a27fe735
2026-03-26 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yg%252F32cf6afe15cf4056a24a3bf95e75db2c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yg/32cf6afe15cf4056a24a3bf95e75db2c/images/large/1.jpg not downloaded yet
2026-03-26 22:47:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/59a9420072fc4941bb1bbf4517f0e562/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6dd9590>
2026-03-26 22:47:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2cb39d9d-bb0f-5553-91eb-eb616d811f5b/2cb39d9d-bb0f-5553-91eb-eb616d811f5b_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F59a9420072fc4941bb1bbf4517f0e562%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/59a9420072fc4941bb1bbf4517f0e562/images/large/7.jpg saved to cache
2026-03-26 22:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2cb39d9d-bb0f-5553-91eb-eb616d811f5b
2026-03-26 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yg%252F32cf6afe15cf4056a24a3bf95e75db2c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yg/32cf6afe15cf4056a24a3bf95e75db2c/images/large/2.jpg not downloaded yet
2026-03-26 22:47:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/59a9420072fc4941bb1bbf4517f0e562/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xe/4efdcc6130e649df9ef70ee036433615/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xe/4efdcc6130e649df9ef70ee036433615/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/59a9420072fc4941bb1bbf4517f0e562/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yg%252F32cf6afe15cf4056a24a3bf95e75db2c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yg/32cf6afe15cf4056a24a3bf95e75db2c/images/large/3.jpg not downloaded yet
2026-03-26 22:47:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b788f710>
2026-03-26 22:47:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2cb39d9d-bb0f-5553-91eb-eb616d811f5b/2cb39d9d-bb0f-5553-91eb-eb616d811f5b_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F59a9420072fc4941bb1bbf4517f0e562%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/59a9420072fc4941bb1bbf4517f0e562/images/large/8.jpg saved to cache
2026-03-26 22:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2cb39d9d-bb0f-5553-91eb-eb616d811f5b
2026-03-26 22:47:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/59a9420072fc4941bb1bbf4517f0e562/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xe/4efdcc6130e649df9ef70ee036433615/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yg%252F32cf6afe15cf4056a24a3bf95e75db2c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yg/32cf6afe15cf4056a24a3bf95e75db2c/images/large/4.jpg not downloaded yet
2026-03-26 22:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yg%252F32cf6afe15cf4056a24a3bf95e75db2c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yg/32cf6afe15cf4056a24a3bf95e75db2c/images/large/5.jpg not downloaded yet
2026-03-26 22:47:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e16050>
2026-03-26 22:47:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2cb39d9d-bb0f-5553-91eb-eb616d811f5b/2cb39d9d-bb0f-5553-91eb-eb616d811f5b_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F59a9420072fc4941bb1bbf4517f0e562%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/59a9420072fc4941bb1bbf4517f0e562/images/large/6.jpg saved to cache
2026-03-26 22:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2cb39d9d-bb0f-5553-91eb-eb616d811f5b
2026-03-26 22:47:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7876e50>
2026-03-26 22:47:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_abf05fb0-a1b8-56dc-9421-ae702229d085/abf05fb0-a1b8-56dc-9421-ae702229d085_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xe%252F4efdcc6130e649df9ef70ee036433615%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xe/4efdcc6130e649df9ef70ee036433615/images/large/1.jpg saved to cache
2026-03-26 22:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item abf05fb0-a1b8-56dc-9421-ae702229d085
2026-03-26 22:47:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79a0410>
2026-03-26 22:47:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_abf05fb0-a1b8-56dc-9421-ae702229d085/abf05fb0-a1b8-56dc-9421-ae702229d085_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xe%252F4efdcc6130e649df9ef70ee036433615%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xe/4efdcc6130e649df9ef70ee036433615/images/large/2.jpg saved to cache
2026-03-26 22:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item abf05fb0-a1b8-56dc-9421-ae702229d085
2026-03-26 22:47:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79f0950>
2026-03-26 22:47:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2cb39d9d-bb0f-5553-91eb-eb616d811f5b/2cb39d9d-bb0f-5553-91eb-eb616d811f5b_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F59a9420072fc4941bb1bbf4517f0e562%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/59a9420072fc4941bb1bbf4517f0e562/images/large/9.jpg saved to cache
2026-03-26 22:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2cb39d9d-bb0f-5553-91eb-eb616d811f5b
2026-03-26 22:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yg%252F32cf6afe15cf4056a24a3bf95e75db2c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yg/32cf6afe15cf4056a24a3bf95e75db2c/images/large/6.jpg not downloaded yet
2026-03-26 22:47:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xe/4efdcc6130e649df9ef70ee036433615/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yg%252F32cf6afe15cf4056a24a3bf95e75db2c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yg/32cf6afe15cf4056a24a3bf95e75db2c/images/large/7.jpg not downloaded yet
2026-03-26 22:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yg%252F32cf6afe15cf4056a24a3bf95e75db2c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yg/32cf6afe15cf4056a24a3bf95e75db2c/images/large/8.jpg not downloaded yet
2026-03-26 22:47:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd0c47d0>
2026-03-26 22:47:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2cb39d9d-bb0f-5553-91eb-eb616d811f5b/2cb39d9d-bb0f-5553-91eb-eb616d811f5b_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F59a9420072fc4941bb1bbf4517f0e562%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/59a9420072fc4941bb1bbf4517f0e562/images/large/10.jpg saved to cache
2026-03-26 22:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2cb39d9d-bb0f-5553-91eb-eb616d811f5b
2026-03-26 22:47:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2cb39d9d-bb0f-5553-91eb-eb616d811f5b, skipping ID generation
2026-03-26 22:47:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2cb39d9d-bb0f-5553-91eb-eb616d811f5b with scrape type 1
2026-03-26 22:47:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2cb39d9d-bb0f-5553-91eb-eb616d811f5b sending to next pipeline
2026-03-26 22:47:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 2cb39d9d-bb0f-5553-91eb-eb616d811f5b, identifier: 1986083
2026-03-26 22:47:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7483710>
2026-03-26 22:47:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_abf05fb0-a1b8-56dc-9421-ae702229d085/abf05fb0-a1b8-56dc-9421-ae702229d085_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xe%252F4efdcc6130e649df9ef70ee036433615%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xe/4efdcc6130e649df9ef70ee036433615/images/large/3.jpg saved to cache
2026-03-26 22:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item abf05fb0-a1b8-56dc-9421-ae702229d085
2026-03-26 22:47:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 2cb39d9d-bb0f-5553-91eb-eb616d811f5b with identifier: 1986083
2026-03-26 22:47:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 2cb39d9d-bb0f-5553-91eb-eb616d811f5b with identifier: 1986083
2026-03-26 22:47:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 2cb39d9d-bb0f-5553-91eb-eb616d811f5b with identifier: 1986083 to the API
2026-03-26 22:47:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:47:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:47:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2dt/59a9420072fc4941bb1bbf4517f0e562/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '2cb39d9d-bb0f-5553-91eb-eb616d811f5b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF VIII',
 'odometer': 82007,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cb39d9d-bb0f-5553-91eb-eb616d811f5b/2cb39d9d-bb0f-5553-91eb-eb616d811f5b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 682238,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/59a9420072fc4941bb1bbf4517f0e562/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cb39d9d-bb0f-5553-91eb-eb616d811f5b/2cb39d9d-bb0f-5553-91eb-eb616d811f5b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 673334,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/59a9420072fc4941bb1bbf4517f0e562/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cb39d9d-bb0f-5553-91eb-eb616d811f5b/2cb39d9d-bb0f-5553-91eb-eb616d811f5b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 661788,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/59a9420072fc4941bb1bbf4517f0e562/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cb39d9d-bb0f-5553-91eb-eb616d811f5b/2cb39d9d-bb0f-5553-91eb-eb616d811f5b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 685379,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/59a9420072fc4941bb1bbf4517f0e562/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cb39d9d-bb0f-5553-91eb-eb616d811f5b/2cb39d9d-bb0f-5553-91eb-eb616d811f5b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 665844,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/59a9420072fc4941bb1bbf4517f0e562/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cb39d9d-bb0f-5553-91eb-eb616d811f5b/2cb39d9d-bb0f-5553-91eb-eb616d811f5b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 729457,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/59a9420072fc4941bb1bbf4517f0e562/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cb39d9d-bb0f-5553-91eb-eb616d811f5b/2cb39d9d-bb0f-5553-91eb-eb616d811f5b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 631965,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/59a9420072fc4941bb1bbf4517f0e562/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cb39d9d-bb0f-5553-91eb-eb616d811f5b/2cb39d9d-bb0f-5553-91eb-eb616d811f5b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 780416,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/59a9420072fc4941bb1bbf4517f0e562/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cb39d9d-bb0f-5553-91eb-eb616d811f5b/2cb39d9d-bb0f-5553-91eb-eb616d811f5b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 745847,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/59a9420072fc4941bb1bbf4517f0e562/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cb39d9d-bb0f-5553-91eb-eb616d811f5b/2cb39d9d-bb0f-5553-91eb-eb616d811f5b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 789481,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/59a9420072fc4941bb1bbf4517f0e562/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF VIII 1.4 EHYBRID STYLE BUSINESS DSG',
 'transmission': 'automatic',
 'trim': '1.4 EHYBRID STYLE BUSINESS DSG',
 'vin': None,
 'year': 2023}
2026-03-26 22:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986083%27 HTTP/1.1" 200 None
2026-03-26 22:47:04 [ayvens.be] INFO: Saving data for 1986083: {'created_time': 1774565224.329799, 'last_price_update_time': 1774565224.329809, 'auction_closing_time': 1775028600.0}
2026-03-26 22:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986083') HTTP/1.1" 204 0
2026-03-26 22:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yg%252F32cf6afe15cf4056a24a3bf95e75db2c%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yg/32cf6afe15cf4056a24a3bf95e75db2c/images/large/9.jpg not downloaded yet
2026-03-26 22:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yg%252F32cf6afe15cf4056a24a3bf95e75db2c%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yg/32cf6afe15cf4056a24a3bf95e75db2c/images/large/10.jpg not downloaded yet
2026-03-26 22:47:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xe/4efdcc6130e649df9ef70ee036433615/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7aa3590>
2026-03-26 22:47:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_abf05fb0-a1b8-56dc-9421-ae702229d085/abf05fb0-a1b8-56dc-9421-ae702229d085_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xe%252F4efdcc6130e649df9ef70ee036433615%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xe/4efdcc6130e649df9ef70ee036433615/images/large/7.jpg saved to cache
2026-03-26 22:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item abf05fb0-a1b8-56dc-9421-ae702229d085
2026-03-26 22:47:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xe/4efdcc6130e649df9ef70ee036433615/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:04 [ayvens.be] INFO: Found listing with ID: 1986086
2026-03-26 22:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986086%27 HTTP/1.1" 200 None
2026-03-26 22:47:04 [ayvens.be] INFO: Scrape type for 1986086: 1
2026-03-26 22:47:04 [ayvens.be] INFO: Extracting data for car ID: 1986086
2026-03-26 22:47:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ab31278-8474-5fb0-b017-07fe457e9b85 with identifier: 1986086
2026-03-26 22:47:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ab31278-8474-5fb0-b017-07fe457e9b85 with scrape type 1
2026-03-26 22:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5ab31278-8474-5fb0-b017-07fe457e9b85
2026-03-26 22:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F8b6b2c88a5cb467dacc3bab4bdba2c26%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/8b6b2c88a5cb467dacc3bab4bdba2c26/images/large/1.jpg not downloaded yet
2026-03-26 22:47:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xe/4efdcc6130e649df9ef70ee036433615/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xe/4efdcc6130e649df9ef70ee036433615/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xe/4efdcc6130e649df9ef70ee036433615/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F8b6b2c88a5cb467dacc3bab4bdba2c26%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/8b6b2c88a5cb467dacc3bab4bdba2c26/images/large/2.jpg not downloaded yet
2026-03-26 22:47:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xe/4efdcc6130e649df9ef70ee036433615/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F8b6b2c88a5cb467dacc3bab4bdba2c26%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/8b6b2c88a5cb467dacc3bab4bdba2c26/images/large/3.jpg not downloaded yet
2026-03-26 22:47:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cbfc90>
2026-03-26 22:47:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_abf05fb0-a1b8-56dc-9421-ae702229d085/abf05fb0-a1b8-56dc-9421-ae702229d085_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xe%252F4efdcc6130e649df9ef70ee036433615%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xe/4efdcc6130e649df9ef70ee036433615/images/large/6.jpg saved to cache
2026-03-26 22:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item abf05fb0-a1b8-56dc-9421-ae702229d085
2026-03-26 22:47:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yg/32cf6afe15cf4056a24a3bf95e75db2c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F8b6b2c88a5cb467dacc3bab4bdba2c26%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/8b6b2c88a5cb467dacc3bab4bdba2c26/images/large/4.jpg not downloaded yet
2026-03-26 22:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F8b6b2c88a5cb467dacc3bab4bdba2c26%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/8b6b2c88a5cb467dacc3bab4bdba2c26/images/large/5.jpg not downloaded yet
2026-03-26 22:47:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7981950>
2026-03-26 22:47:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_abf05fb0-a1b8-56dc-9421-ae702229d085/abf05fb0-a1b8-56dc-9421-ae702229d085_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xe%252F4efdcc6130e649df9ef70ee036433615%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xe/4efdcc6130e649df9ef70ee036433615/images/large/9.jpg saved to cache
2026-03-26 22:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item abf05fb0-a1b8-56dc-9421-ae702229d085
2026-03-26 22:47:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c5c4d0>
2026-03-26 22:47:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_abf05fb0-a1b8-56dc-9421-ae702229d085/abf05fb0-a1b8-56dc-9421-ae702229d085_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xe%252F4efdcc6130e649df9ef70ee036433615%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xe/4efdcc6130e649df9ef70ee036433615/images/large/4.jpg saved to cache
2026-03-26 22:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item abf05fb0-a1b8-56dc-9421-ae702229d085
2026-03-26 22:47:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7688110>
2026-03-26 22:47:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_abf05fb0-a1b8-56dc-9421-ae702229d085/abf05fb0-a1b8-56dc-9421-ae702229d085_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xe%252F4efdcc6130e649df9ef70ee036433615%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xe/4efdcc6130e649df9ef70ee036433615/images/large/5.jpg saved to cache
2026-03-26 22:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item abf05fb0-a1b8-56dc-9421-ae702229d085
2026-03-26 22:47:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b741ff10>
2026-03-26 22:47:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_abf05fb0-a1b8-56dc-9421-ae702229d085/abf05fb0-a1b8-56dc-9421-ae702229d085_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xe%252F4efdcc6130e649df9ef70ee036433615%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xe/4efdcc6130e649df9ef70ee036433615/images/large/10.jpg saved to cache
2026-03-26 22:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item abf05fb0-a1b8-56dc-9421-ae702229d085
2026-03-26 22:47:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77caf10>
2026-03-26 22:47:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_abf05fb0-a1b8-56dc-9421-ae702229d085/abf05fb0-a1b8-56dc-9421-ae702229d085_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xe%252F4efdcc6130e649df9ef70ee036433615%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xe/4efdcc6130e649df9ef70ee036433615/images/large/8.jpg saved to cache
2026-03-26 22:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item abf05fb0-a1b8-56dc-9421-ae702229d085
2026-03-26 22:47:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: abf05fb0-a1b8-56dc-9421-ae702229d085, skipping ID generation
2026-03-26 22:47:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item abf05fb0-a1b8-56dc-9421-ae702229d085 with scrape type 1
2026-03-26 22:47:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item abf05fb0-a1b8-56dc-9421-ae702229d085 sending to next pipeline
2026-03-26 22:47:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: abf05fb0-a1b8-56dc-9421-ae702229d085, identifier: 1986084
2026-03-26 22:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F8b6b2c88a5cb467dacc3bab4bdba2c26%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/8b6b2c88a5cb467dacc3bab4bdba2c26/images/large/6.jpg not downloaded yet
2026-03-26 22:47:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: abf05fb0-a1b8-56dc-9421-ae702229d085 with identifier: 1986084
2026-03-26 22:47:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: abf05fb0-a1b8-56dc-9421-ae702229d085 with identifier: 1986084
2026-03-26 22:47:05 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: abf05fb0-a1b8-56dc-9421-ae702229d085 with identifier: 1986084 to the API
2026-03-26 22:47:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:47:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:47:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1xe/4efdcc6130e649df9ef70ee036433615/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'abf05fb0-a1b8-56dc-9421-ae702229d085',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1 DIESEL - 2019',
 'odometer': 153675,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_abf05fb0-a1b8-56dc-9421-ae702229d085/abf05fb0-a1b8-56dc-9421-ae702229d085_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 670159,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xe/4efdcc6130e649df9ef70ee036433615/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_abf05fb0-a1b8-56dc-9421-ae702229d085/abf05fb0-a1b8-56dc-9421-ae702229d085_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 660129,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xe/4efdcc6130e649df9ef70ee036433615/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_abf05fb0-a1b8-56dc-9421-ae702229d085/abf05fb0-a1b8-56dc-9421-ae702229d085_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 663099,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xe/4efdcc6130e649df9ef70ee036433615/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_abf05fb0-a1b8-56dc-9421-ae702229d085/abf05fb0-a1b8-56dc-9421-ae702229d085_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 680832,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xe/4efdcc6130e649df9ef70ee036433615/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_abf05fb0-a1b8-56dc-9421-ae702229d085/abf05fb0-a1b8-56dc-9421-ae702229d085_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 696460,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xe/4efdcc6130e649df9ef70ee036433615/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_abf05fb0-a1b8-56dc-9421-ae702229d085/abf05fb0-a1b8-56dc-9421-ae702229d085_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 764242,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xe/4efdcc6130e649df9ef70ee036433615/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_abf05fb0-a1b8-56dc-9421-ae702229d085/abf05fb0-a1b8-56dc-9421-ae702229d085_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 618716,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xe/4efdcc6130e649df9ef70ee036433615/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_abf05fb0-a1b8-56dc-9421-ae702229d085/abf05fb0-a1b8-56dc-9421-ae702229d085_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 805557,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xe/4efdcc6130e649df9ef70ee036433615/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_abf05fb0-a1b8-56dc-9421-ae702229d085/abf05fb0-a1b8-56dc-9421-ae702229d085_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 711693,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xe/4efdcc6130e649df9ef70ee036433615/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_abf05fb0-a1b8-56dc-9421-ae702229d085/abf05fb0-a1b8-56dc-9421-ae702229d085_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 764004,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xe/4efdcc6130e649df9ef70ee036433615/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 DIESEL - 2019 1.5 d sDrive16 AdBlue',
 'transmission': 'manual',
 'trim': '1.5 d sDrive16 AdBlue',
 'vin': None,
 'year': 2019}
2026-03-26 22:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986084%27 HTTP/1.1" 200 None
2026-03-26 22:47:05 [ayvens.be] INFO: Saving data for 1986084: {'created_time': 1774565225.686637, 'last_price_update_time': 1774565225.686648, 'auction_closing_time': 1775028600.0}
2026-03-26 22:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986084') HTTP/1.1" 204 0
2026-03-26 22:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F8b6b2c88a5cb467dacc3bab4bdba2c26%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/8b6b2c88a5cb467dacc3bab4bdba2c26/images/large/7.jpg not downloaded yet
2026-03-26 22:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F8b6b2c88a5cb467dacc3bab4bdba2c26%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/8b6b2c88a5cb467dacc3bab4bdba2c26/images/large/8.jpg not downloaded yet
2026-03-26 22:47:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e3e610>
2026-03-26 22:47:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf5f4d0d-5182-5124-9122-5262a27fe735/cf5f4d0d-5182-5124-9122-5262a27fe735_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yg%252F32cf6afe15cf4056a24a3bf95e75db2c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yg/32cf6afe15cf4056a24a3bf95e75db2c/images/large/2.jpg saved to cache
2026-03-26 22:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cf5f4d0d-5182-5124-9122-5262a27fe735
2026-03-26 22:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F8b6b2c88a5cb467dacc3bab4bdba2c26%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/8b6b2c88a5cb467dacc3bab4bdba2c26/images/large/9.jpg not downloaded yet
2026-03-26 22:47:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yg/32cf6afe15cf4056a24a3bf95e75db2c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yg/32cf6afe15cf4056a24a3bf95e75db2c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yg/32cf6afe15cf4056a24a3bf95e75db2c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F8b6b2c88a5cb467dacc3bab4bdba2c26%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/8b6b2c88a5cb467dacc3bab4bdba2c26/images/large/10.jpg not downloaded yet
2026-03-26 22:47:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yg/32cf6afe15cf4056a24a3bf95e75db2c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:05 [ayvens.be] INFO: Found listing with ID: 1986087
2026-03-26 22:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986087%27 HTTP/1.1" 200 None
2026-03-26 22:47:05 [ayvens.be] INFO: Scrape type for 1986087: 1
2026-03-26 22:47:05 [ayvens.be] INFO: Extracting data for car ID: 1986087
2026-03-26 22:47:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99135a3f-f7a2-5591-a39c-c1ee2be1dc46 with identifier: 1986087
2026-03-26 22:47:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99135a3f-f7a2-5591-a39c-c1ee2be1dc46 with scrape type 1
2026-03-26 22:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 99135a3f-f7a2-5591-a39c-c1ee2be1dc46
2026-03-26 22:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fdfaf8bfef9a44f1d96806ff0372f83b1%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/dfaf8bfef9a44f1d96806ff0372f83b1/images/large/1.jpg not downloaded yet
2026-03-26 22:47:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yg/32cf6afe15cf4056a24a3bf95e75db2c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yg/32cf6afe15cf4056a24a3bf95e75db2c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yg/32cf6afe15cf4056a24a3bf95e75db2c/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fdfaf8bfef9a44f1d96806ff0372f83b1%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/dfaf8bfef9a44f1d96806ff0372f83b1/images/large/2.jpg not downloaded yet
2026-03-26 22:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fdfaf8bfef9a44f1d96806ff0372f83b1%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/dfaf8bfef9a44f1d96806ff0372f83b1/images/large/3.jpg not downloaded yet
2026-03-26 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fdfaf8bfef9a44f1d96806ff0372f83b1%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/dfaf8bfef9a44f1d96806ff0372f83b1/images/large/4.jpg not downloaded yet
2026-03-26 22:47:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b741da90>
2026-03-26 22:47:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf5f4d0d-5182-5124-9122-5262a27fe735/cf5f4d0d-5182-5124-9122-5262a27fe735_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yg%252F32cf6afe15cf4056a24a3bf95e75db2c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yg/32cf6afe15cf4056a24a3bf95e75db2c/images/large/3.jpg saved to cache
2026-03-26 22:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cf5f4d0d-5182-5124-9122-5262a27fe735
2026-03-26 22:47:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74074d0>
2026-03-26 22:47:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf5f4d0d-5182-5124-9122-5262a27fe735/cf5f4d0d-5182-5124-9122-5262a27fe735_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yg%252F32cf6afe15cf4056a24a3bf95e75db2c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yg/32cf6afe15cf4056a24a3bf95e75db2c/images/large/5.jpg saved to cache
2026-03-26 22:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cf5f4d0d-5182-5124-9122-5262a27fe735
2026-03-26 22:47:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7945b50>
2026-03-26 22:47:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf5f4d0d-5182-5124-9122-5262a27fe735/cf5f4d0d-5182-5124-9122-5262a27fe735_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yg%252F32cf6afe15cf4056a24a3bf95e75db2c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yg/32cf6afe15cf4056a24a3bf95e75db2c/images/large/7.jpg saved to cache
2026-03-26 22:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cf5f4d0d-5182-5124-9122-5262a27fe735
2026-03-26 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fdfaf8bfef9a44f1d96806ff0372f83b1%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/dfaf8bfef9a44f1d96806ff0372f83b1/images/large/5.jpg not downloaded yet
2026-03-26 22:47:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yg/32cf6afe15cf4056a24a3bf95e75db2c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fdfaf8bfef9a44f1d96806ff0372f83b1%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/dfaf8bfef9a44f1d96806ff0372f83b1/images/large/6.jpg not downloaded yet
2026-03-26 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fdfaf8bfef9a44f1d96806ff0372f83b1%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/dfaf8bfef9a44f1d96806ff0372f83b1/images/large/7.jpg not downloaded yet
2026-03-26 22:47:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77d6990>
2026-03-26 22:47:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf5f4d0d-5182-5124-9122-5262a27fe735/cf5f4d0d-5182-5124-9122-5262a27fe735_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yg%252F32cf6afe15cf4056a24a3bf95e75db2c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yg/32cf6afe15cf4056a24a3bf95e75db2c/images/large/8.jpg saved to cache
2026-03-26 22:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cf5f4d0d-5182-5124-9122-5262a27fe735
2026-03-26 22:47:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b745b450>
2026-03-26 22:47:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf5f4d0d-5182-5124-9122-5262a27fe735/cf5f4d0d-5182-5124-9122-5262a27fe735_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yg%252F32cf6afe15cf4056a24a3bf95e75db2c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yg/32cf6afe15cf4056a24a3bf95e75db2c/images/large/4.jpg saved to cache
2026-03-26 22:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cf5f4d0d-5182-5124-9122-5262a27fe735
2026-03-26 22:47:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7cebf90>
2026-03-26 22:47:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf5f4d0d-5182-5124-9122-5262a27fe735/cf5f4d0d-5182-5124-9122-5262a27fe735_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yg%252F32cf6afe15cf4056a24a3bf95e75db2c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yg/32cf6afe15cf4056a24a3bf95e75db2c/images/large/6.jpg saved to cache
2026-03-26 22:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cf5f4d0d-5182-5124-9122-5262a27fe735
2026-03-26 22:47:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b744bad0>
2026-03-26 22:47:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf5f4d0d-5182-5124-9122-5262a27fe735/cf5f4d0d-5182-5124-9122-5262a27fe735_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yg%252F32cf6afe15cf4056a24a3bf95e75db2c%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yg/32cf6afe15cf4056a24a3bf95e75db2c/images/large/9.jpg saved to cache
2026-03-26 22:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cf5f4d0d-5182-5124-9122-5262a27fe735
2026-03-26 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fdfaf8bfef9a44f1d96806ff0372f83b1%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/dfaf8bfef9a44f1d96806ff0372f83b1/images/large/8.jpg not downloaded yet
2026-03-26 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fdfaf8bfef9a44f1d96806ff0372f83b1%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/dfaf8bfef9a44f1d96806ff0372f83b1/images/large/9.jpg not downloaded yet
2026-03-26 22:47:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/8b6b2c88a5cb467dacc3bab4bdba2c26/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b740b4d0>
2026-03-26 22:47:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf5f4d0d-5182-5124-9122-5262a27fe735/cf5f4d0d-5182-5124-9122-5262a27fe735_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yg%252F32cf6afe15cf4056a24a3bf95e75db2c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yg/32cf6afe15cf4056a24a3bf95e75db2c/images/large/1.jpg saved to cache
2026-03-26 22:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cf5f4d0d-5182-5124-9122-5262a27fe735
2026-03-26 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fdfaf8bfef9a44f1d96806ff0372f83b1%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/dfaf8bfef9a44f1d96806ff0372f83b1/images/large/10.jpg not downloaded yet
2026-03-26 22:47:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/8b6b2c88a5cb467dacc3bab4bdba2c26/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/8b6b2c88a5cb467dacc3bab4bdba2c26/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:06 [scrapy.extensions.logstats] INFO: Crawled 6 pages (at 4 pages/min), scraped 56 items (at 35 items/min)
2026-03-26 22:47:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 181MiB
2026-03-26 22:47:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/8b6b2c88a5cb467dacc3bab4bdba2c26/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/8b6b2c88a5cb467dacc3bab4bdba2c26/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:06 [ayvens.be] INFO: Found listing with ID: 1986088
2026-03-26 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986088%27 HTTP/1.1" 200 None
2026-03-26 22:47:06 [ayvens.be] INFO: Scrape type for 1986088: 1
2026-03-26 22:47:06 [ayvens.be] INFO: Extracting data for car ID: 1986088
2026-03-26 22:47:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ac92778-2e6d-51b5-a3d8-10524ea99f71 with identifier: 1986088
2026-03-26 22:47:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ac92778-2e6d-51b5-a3d8-10524ea99f71 with scrape type 1
2026-03-26 22:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1ac92778-2e6d-51b5-a3d8-10524ea99f71
2026-03-26 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F010a5d90af3244e3bdf61fc77de40404%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/010a5d90af3244e3bdf61fc77de40404/images/large/1.jpg not downloaded yet
2026-03-26 22:47:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/8b6b2c88a5cb467dacc3bab4bdba2c26/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F010a5d90af3244e3bdf61fc77de40404%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/010a5d90af3244e3bdf61fc77de40404/images/large/2.jpg not downloaded yet
2026-03-26 22:47:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e2b7d0>
2026-03-26 22:47:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ab31278-8474-5fb0-b017-07fe457e9b85/5ab31278-8474-5fb0-b017-07fe457e9b85_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F8b6b2c88a5cb467dacc3bab4bdba2c26%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/8b6b2c88a5cb467dacc3bab4bdba2c26/images/large/1.jpg saved to cache
2026-03-26 22:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5ab31278-8474-5fb0-b017-07fe457e9b85
2026-03-26 22:47:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yg/32cf6afe15cf4056a24a3bf95e75db2c/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/8b6b2c88a5cb467dacc3bab4bdba2c26/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F010a5d90af3244e3bdf61fc77de40404%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/010a5d90af3244e3bdf61fc77de40404/images/large/3.jpg not downloaded yet
2026-03-26 22:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F010a5d90af3244e3bdf61fc77de40404%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/010a5d90af3244e3bdf61fc77de40404/images/large/4.jpg not downloaded yet
2026-03-26 22:47:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74cc150>
2026-03-26 22:47:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ab31278-8474-5fb0-b017-07fe457e9b85/5ab31278-8474-5fb0-b017-07fe457e9b85_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F8b6b2c88a5cb467dacc3bab4bdba2c26%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/8b6b2c88a5cb467dacc3bab4bdba2c26/images/large/2.jpg saved to cache
2026-03-26 22:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5ab31278-8474-5fb0-b017-07fe457e9b85
2026-03-26 22:47:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7400110>
2026-03-26 22:47:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ab31278-8474-5fb0-b017-07fe457e9b85/5ab31278-8474-5fb0-b017-07fe457e9b85_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F8b6b2c88a5cb467dacc3bab4bdba2c26%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/8b6b2c88a5cb467dacc3bab4bdba2c26/images/large/3.jpg saved to cache
2026-03-26 22:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5ab31278-8474-5fb0-b017-07fe457e9b85
2026-03-26 22:47:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c68f50>
2026-03-26 22:47:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ab31278-8474-5fb0-b017-07fe457e9b85/5ab31278-8474-5fb0-b017-07fe457e9b85_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F8b6b2c88a5cb467dacc3bab4bdba2c26%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/8b6b2c88a5cb467dacc3bab4bdba2c26/images/large/5.jpg saved to cache
2026-03-26 22:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5ab31278-8474-5fb0-b017-07fe457e9b85
2026-03-26 22:47:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76efd90>
2026-03-26 22:47:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ab31278-8474-5fb0-b017-07fe457e9b85/5ab31278-8474-5fb0-b017-07fe457e9b85_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F8b6b2c88a5cb467dacc3bab4bdba2c26%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/8b6b2c88a5cb467dacc3bab4bdba2c26/images/large/4.jpg saved to cache
2026-03-26 22:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5ab31278-8474-5fb0-b017-07fe457e9b85
2026-03-26 22:47:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74e5850>
2026-03-26 22:47:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ab31278-8474-5fb0-b017-07fe457e9b85/5ab31278-8474-5fb0-b017-07fe457e9b85_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F8b6b2c88a5cb467dacc3bab4bdba2c26%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/8b6b2c88a5cb467dacc3bab4bdba2c26/images/large/6.jpg saved to cache
2026-03-26 22:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5ab31278-8474-5fb0-b017-07fe457e9b85
2026-03-26 22:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F010a5d90af3244e3bdf61fc77de40404%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/010a5d90af3244e3bdf61fc77de40404/images/large/5.jpg not downloaded yet
2026-03-26 22:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F010a5d90af3244e3bdf61fc77de40404%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/010a5d90af3244e3bdf61fc77de40404/images/large/6.jpg not downloaded yet
2026-03-26 22:47:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/dfaf8bfef9a44f1d96806ff0372f83b1/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F010a5d90af3244e3bdf61fc77de40404%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/010a5d90af3244e3bdf61fc77de40404/images/large/7.jpg not downloaded yet
2026-03-26 22:47:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7926490>
2026-03-26 22:47:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf5f4d0d-5182-5124-9122-5262a27fe735/cf5f4d0d-5182-5124-9122-5262a27fe735_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yg%252F32cf6afe15cf4056a24a3bf95e75db2c%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yg/32cf6afe15cf4056a24a3bf95e75db2c/images/large/10.jpg saved to cache
2026-03-26 22:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cf5f4d0d-5182-5124-9122-5262a27fe735
2026-03-26 22:47:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cf5f4d0d-5182-5124-9122-5262a27fe735, skipping ID generation
2026-03-26 22:47:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf5f4d0d-5182-5124-9122-5262a27fe735 with scrape type 1
2026-03-26 22:47:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cf5f4d0d-5182-5124-9122-5262a27fe735 sending to next pipeline
2026-03-26 22:47:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: cf5f4d0d-5182-5124-9122-5262a27fe735, identifier: 1986085
2026-03-26 22:47:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c62b90>
2026-03-26 22:47:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ab31278-8474-5fb0-b017-07fe457e9b85/5ab31278-8474-5fb0-b017-07fe457e9b85_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F8b6b2c88a5cb467dacc3bab4bdba2c26%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/8b6b2c88a5cb467dacc3bab4bdba2c26/images/large/7.jpg saved to cache
2026-03-26 22:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5ab31278-8474-5fb0-b017-07fe457e9b85
2026-03-26 22:47:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/dfaf8bfef9a44f1d96806ff0372f83b1/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: cf5f4d0d-5182-5124-9122-5262a27fe735 with identifier: 1986085
2026-03-26 22:47:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: cf5f4d0d-5182-5124-9122-5262a27fe735 with identifier: 1986085
2026-03-26 22:47:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: cf5f4d0d-5182-5124-9122-5262a27fe735 with identifier: 1986085 to the API
2026-03-26 22:47:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:47:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:47:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yg/32cf6afe15cf4056a24a3bf95e75db2c/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'cf5f4d0d-5182-5124-9122-5262a27fe735',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '508',
 'odometer': 141000,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5f4d0d-5182-5124-9122-5262a27fe735/cf5f4d0d-5182-5124-9122-5262a27fe735_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 718502,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yg/32cf6afe15cf4056a24a3bf95e75db2c/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5f4d0d-5182-5124-9122-5262a27fe735/cf5f4d0d-5182-5124-9122-5262a27fe735_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 718502,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yg/32cf6afe15cf4056a24a3bf95e75db2c/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5f4d0d-5182-5124-9122-5262a27fe735/cf5f4d0d-5182-5124-9122-5262a27fe735_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 735436,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yg/32cf6afe15cf4056a24a3bf95e75db2c/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5f4d0d-5182-5124-9122-5262a27fe735/cf5f4d0d-5182-5124-9122-5262a27fe735_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 706962,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yg/32cf6afe15cf4056a24a3bf95e75db2c/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5f4d0d-5182-5124-9122-5262a27fe735/cf5f4d0d-5182-5124-9122-5262a27fe735_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 738627,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yg/32cf6afe15cf4056a24a3bf95e75db2c/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5f4d0d-5182-5124-9122-5262a27fe735/cf5f4d0d-5182-5124-9122-5262a27fe735_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 716129,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yg/32cf6afe15cf4056a24a3bf95e75db2c/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5f4d0d-5182-5124-9122-5262a27fe735/cf5f4d0d-5182-5124-9122-5262a27fe735_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 777396,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yg/32cf6afe15cf4056a24a3bf95e75db2c/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5f4d0d-5182-5124-9122-5262a27fe735/cf5f4d0d-5182-5124-9122-5262a27fe735_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 606742,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yg/32cf6afe15cf4056a24a3bf95e75db2c/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5f4d0d-5182-5124-9122-5262a27fe735/cf5f4d0d-5182-5124-9122-5262a27fe735_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 753134,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yg/32cf6afe15cf4056a24a3bf95e75db2c/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5f4d0d-5182-5124-9122-5262a27fe735/cf5f4d0d-5182-5124-9122-5262a27fe735_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 669215,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yg/32cf6afe15cf4056a24a3bf95e75db2c/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 508 1.5 BLUEHDI 130 S&S ACTIVE',
 'transmission': 'manual',
 'trim': '1.5 BLUEHDI 130 S&S ACTIVE',
 'vin': None,
 'year': 2020}
2026-03-26 22:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986085%27 HTTP/1.1" 200 None
2026-03-26 22:47:08 [ayvens.be] INFO: Saving data for 1986085: {'created_time': 1774565228.365214, 'last_price_update_time': 1774565228.365223, 'auction_closing_time': 1775028600.0}
2026-03-26 22:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986085') HTTP/1.1" 204 0
2026-03-26 22:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F010a5d90af3244e3bdf61fc77de40404%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/010a5d90af3244e3bdf61fc77de40404/images/large/8.jpg not downloaded yet
2026-03-26 22:47:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/8b6b2c88a5cb467dacc3bab4bdba2c26/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/8b6b2c88a5cb467dacc3bab4bdba2c26/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F010a5d90af3244e3bdf61fc77de40404%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/010a5d90af3244e3bdf61fc77de40404/images/large/9.jpg not downloaded yet
2026-03-26 22:47:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/dfaf8bfef9a44f1d96806ff0372f83b1/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/dfaf8bfef9a44f1d96806ff0372f83b1/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/dfaf8bfef9a44f1d96806ff0372f83b1/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6d738d0>
2026-03-26 22:47:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99135a3f-f7a2-5591-a39c-c1ee2be1dc46/99135a3f-f7a2-5591-a39c-c1ee2be1dc46_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fdfaf8bfef9a44f1d96806ff0372f83b1%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/dfaf8bfef9a44f1d96806ff0372f83b1/images/large/5.jpg saved to cache
2026-03-26 22:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 99135a3f-f7a2-5591-a39c-c1ee2be1dc46
2026-03-26 22:47:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c69e10>
2026-03-26 22:47:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99135a3f-f7a2-5591-a39c-c1ee2be1dc46/99135a3f-f7a2-5591-a39c-c1ee2be1dc46_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fdfaf8bfef9a44f1d96806ff0372f83b1%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/dfaf8bfef9a44f1d96806ff0372f83b1/images/large/4.jpg saved to cache
2026-03-26 22:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 99135a3f-f7a2-5591-a39c-c1ee2be1dc46
2026-03-26 22:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F010a5d90af3244e3bdf61fc77de40404%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/010a5d90af3244e3bdf61fc77de40404/images/large/10.jpg not downloaded yet
2026-03-26 22:47:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/8b6b2c88a5cb467dacc3bab4bdba2c26/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:08 [ayvens.be] INFO: Found listing with ID: 1986089
2026-03-26 22:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986089%27 HTTP/1.1" 200 None
2026-03-26 22:47:08 [ayvens.be] INFO: Scrape type for 1986089: 1
2026-03-26 22:47:08 [ayvens.be] INFO: Extracting data for car ID: 1986089
2026-03-26 22:47:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2278d22-bc6b-5ae7-a622-e79eb64ea72e with identifier: 1986089
2026-03-26 22:47:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2278d22-bc6b-5ae7-a622-e79eb64ea72e with scrape type 1
2026-03-26 22:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f2278d22-bc6b-5ae7-a622-e79eb64ea72e
2026-03-26 22:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Ff49ef6afd0e840f094406c171b7b678f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/f49ef6afd0e840f094406c171b7b678f/images/large/1.jpg not downloaded yet
2026-03-26 22:47:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd48e850>
2026-03-26 22:47:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ab31278-8474-5fb0-b017-07fe457e9b85/5ab31278-8474-5fb0-b017-07fe457e9b85_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F8b6b2c88a5cb467dacc3bab4bdba2c26%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/8b6b2c88a5cb467dacc3bab4bdba2c26/images/large/9.jpg saved to cache
2026-03-26 22:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5ab31278-8474-5fb0-b017-07fe457e9b85
2026-03-26 22:47:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76636d0>
2026-03-26 22:47:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ab31278-8474-5fb0-b017-07fe457e9b85/5ab31278-8474-5fb0-b017-07fe457e9b85_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F8b6b2c88a5cb467dacc3bab4bdba2c26%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/8b6b2c88a5cb467dacc3bab4bdba2c26/images/large/8.jpg saved to cache
2026-03-26 22:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5ab31278-8474-5fb0-b017-07fe457e9b85
2026-03-26 22:47:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b792d790>
2026-03-26 22:47:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99135a3f-f7a2-5591-a39c-c1ee2be1dc46/99135a3f-f7a2-5591-a39c-c1ee2be1dc46_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fdfaf8bfef9a44f1d96806ff0372f83b1%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/dfaf8bfef9a44f1d96806ff0372f83b1/images/large/3.jpg saved to cache
2026-03-26 22:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 99135a3f-f7a2-5591-a39c-c1ee2be1dc46
2026-03-26 22:47:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6d73b50>
2026-03-26 22:47:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99135a3f-f7a2-5591-a39c-c1ee2be1dc46/99135a3f-f7a2-5591-a39c-c1ee2be1dc46_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fdfaf8bfef9a44f1d96806ff0372f83b1%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/dfaf8bfef9a44f1d96806ff0372f83b1/images/large/1.jpg saved to cache
2026-03-26 22:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 99135a3f-f7a2-5591-a39c-c1ee2be1dc46
2026-03-26 22:47:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c5e390>
2026-03-26 22:47:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99135a3f-f7a2-5591-a39c-c1ee2be1dc46/99135a3f-f7a2-5591-a39c-c1ee2be1dc46_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fdfaf8bfef9a44f1d96806ff0372f83b1%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/dfaf8bfef9a44f1d96806ff0372f83b1/images/large/2.jpg saved to cache
2026-03-26 22:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 99135a3f-f7a2-5591-a39c-c1ee2be1dc46
2026-03-26 22:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Ff49ef6afd0e840f094406c171b7b678f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/f49ef6afd0e840f094406c171b7b678f/images/large/2.jpg not downloaded yet
2026-03-26 22:47:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/dfaf8bfef9a44f1d96806ff0372f83b1/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Ff49ef6afd0e840f094406c171b7b678f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/f49ef6afd0e840f094406c171b7b678f/images/large/3.jpg not downloaded yet
2026-03-26 22:47:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5ccb650>
2026-03-26 22:47:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ab31278-8474-5fb0-b017-07fe457e9b85/5ab31278-8474-5fb0-b017-07fe457e9b85_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F8b6b2c88a5cb467dacc3bab4bdba2c26%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/8b6b2c88a5cb467dacc3bab4bdba2c26/images/large/10.jpg saved to cache
2026-03-26 22:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5ab31278-8474-5fb0-b017-07fe457e9b85
2026-03-26 22:47:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5ab31278-8474-5fb0-b017-07fe457e9b85, skipping ID generation
2026-03-26 22:47:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ab31278-8474-5fb0-b017-07fe457e9b85 with scrape type 1
2026-03-26 22:47:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5ab31278-8474-5fb0-b017-07fe457e9b85 sending to next pipeline
2026-03-26 22:47:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 5ab31278-8474-5fb0-b017-07fe457e9b85, identifier: 1986086
2026-03-26 22:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Ff49ef6afd0e840f094406c171b7b678f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/f49ef6afd0e840f094406c171b7b678f/images/large/4.jpg not downloaded yet
2026-03-26 22:47:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 5ab31278-8474-5fb0-b017-07fe457e9b85 with identifier: 1986086
2026-03-26 22:47:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 5ab31278-8474-5fb0-b017-07fe457e9b85 with identifier: 1986086
2026-03-26 22:47:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 5ab31278-8474-5fb0-b017-07fe457e9b85 with identifier: 1986086 to the API
2026-03-26 22:47:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:47:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:47:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bv/8b6b2c88a5cb467dacc3bab4bdba2c26/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '5ab31278-8474-5fb0-b017-07fe457e9b85',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 79882,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ab31278-8474-5fb0-b017-07fe457e9b85/5ab31278-8474-5fb0-b017-07fe457e9b85_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 678407,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/8b6b2c88a5cb467dacc3bab4bdba2c26/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ab31278-8474-5fb0-b017-07fe457e9b85/5ab31278-8474-5fb0-b017-07fe457e9b85_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 703654,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/8b6b2c88a5cb467dacc3bab4bdba2c26/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ab31278-8474-5fb0-b017-07fe457e9b85/5ab31278-8474-5fb0-b017-07fe457e9b85_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 695752,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/8b6b2c88a5cb467dacc3bab4bdba2c26/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ab31278-8474-5fb0-b017-07fe457e9b85/5ab31278-8474-5fb0-b017-07fe457e9b85_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 731488,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/8b6b2c88a5cb467dacc3bab4bdba2c26/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ab31278-8474-5fb0-b017-07fe457e9b85/5ab31278-8474-5fb0-b017-07fe457e9b85_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 742781,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/8b6b2c88a5cb467dacc3bab4bdba2c26/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ab31278-8474-5fb0-b017-07fe457e9b85/5ab31278-8474-5fb0-b017-07fe457e9b85_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 784642,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/8b6b2c88a5cb467dacc3bab4bdba2c26/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ab31278-8474-5fb0-b017-07fe457e9b85/5ab31278-8474-5fb0-b017-07fe457e9b85_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 590774,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/8b6b2c88a5cb467dacc3bab4bdba2c26/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ab31278-8474-5fb0-b017-07fe457e9b85/5ab31278-8474-5fb0-b017-07fe457e9b85_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 650497,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/8b6b2c88a5cb467dacc3bab4bdba2c26/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ab31278-8474-5fb0-b017-07fe457e9b85/5ab31278-8474-5fb0-b017-07fe457e9b85_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 769639,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/8b6b2c88a5cb467dacc3bab4bdba2c26/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ab31278-8474-5fb0-b017-07fe457e9b85/5ab31278-8474-5fb0-b017-07fe457e9b85_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 771945,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/8b6b2c88a5cb467dacc3bab4bdba2c26/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 1.5 SDRIVE16DA',
 'transmission': 'automatic',
 'trim': '1.5 SDRIVE16DA',
 'vin': None,
 'year': 2022}
2026-03-26 22:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986086%27 HTTP/1.1" 200 None
2026-03-26 22:47:09 [ayvens.be] INFO: Saving data for 1986086: {'created_time': 1774565229.836965, 'last_price_update_time': 1774565229.836974, 'auction_closing_time': 1775028600.0}
2026-03-26 22:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986086') HTTP/1.1" 204 0
2026-03-26 22:47:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/dfaf8bfef9a44f1d96806ff0372f83b1/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/dfaf8bfef9a44f1d96806ff0372f83b1/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Ff49ef6afd0e840f094406c171b7b678f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/f49ef6afd0e840f094406c171b7b678f/images/large/5.jpg not downloaded yet
2026-03-26 22:47:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74042d0>
2026-03-26 22:47:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99135a3f-f7a2-5591-a39c-c1ee2be1dc46/99135a3f-f7a2-5591-a39c-c1ee2be1dc46_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fdfaf8bfef9a44f1d96806ff0372f83b1%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/dfaf8bfef9a44f1d96806ff0372f83b1/images/large/8.jpg saved to cache
2026-03-26 22:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 99135a3f-f7a2-5591-a39c-c1ee2be1dc46
2026-03-26 22:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Ff49ef6afd0e840f094406c171b7b678f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/f49ef6afd0e840f094406c171b7b678f/images/large/6.jpg not downloaded yet
2026-03-26 22:47:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/dfaf8bfef9a44f1d96806ff0372f83b1/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/dfaf8bfef9a44f1d96806ff0372f83b1/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/010a5d90af3244e3bdf61fc77de40404/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/010a5d90af3244e3bdf61fc77de40404/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Ff49ef6afd0e840f094406c171b7b678f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/f49ef6afd0e840f094406c171b7b678f/images/large/7.jpg not downloaded yet
2026-03-26 22:47:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7268a10>
2026-03-26 22:47:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99135a3f-f7a2-5591-a39c-c1ee2be1dc46/99135a3f-f7a2-5591-a39c-c1ee2be1dc46_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fdfaf8bfef9a44f1d96806ff0372f83b1%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/dfaf8bfef9a44f1d96806ff0372f83b1/images/large/9.jpg saved to cache
2026-03-26 22:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 99135a3f-f7a2-5591-a39c-c1ee2be1dc46
2026-03-26 22:47:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79dfb90>
2026-03-26 22:47:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99135a3f-f7a2-5591-a39c-c1ee2be1dc46/99135a3f-f7a2-5591-a39c-c1ee2be1dc46_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fdfaf8bfef9a44f1d96806ff0372f83b1%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/dfaf8bfef9a44f1d96806ff0372f83b1/images/large/7.jpg saved to cache
2026-03-26 22:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 99135a3f-f7a2-5591-a39c-c1ee2be1dc46
2026-03-26 22:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Ff49ef6afd0e840f094406c171b7b678f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/f49ef6afd0e840f094406c171b7b678f/images/large/8.jpg not downloaded yet
2026-03-26 22:47:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/010a5d90af3244e3bdf61fc77de40404/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Ff49ef6afd0e840f094406c171b7b678f%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/f49ef6afd0e840f094406c171b7b678f/images/large/9.jpg not downloaded yet
2026-03-26 22:47:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/010a5d90af3244e3bdf61fc77de40404/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b78c38d0>
2026-03-26 22:47:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99135a3f-f7a2-5591-a39c-c1ee2be1dc46/99135a3f-f7a2-5591-a39c-c1ee2be1dc46_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fdfaf8bfef9a44f1d96806ff0372f83b1%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/dfaf8bfef9a44f1d96806ff0372f83b1/images/large/6.jpg saved to cache
2026-03-26 22:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 99135a3f-f7a2-5591-a39c-c1ee2be1dc46
2026-03-26 22:47:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7451c50>
2026-03-26 22:47:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99135a3f-f7a2-5591-a39c-c1ee2be1dc46/99135a3f-f7a2-5591-a39c-c1ee2be1dc46_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fdfaf8bfef9a44f1d96806ff0372f83b1%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/dfaf8bfef9a44f1d96806ff0372f83b1/images/large/10.jpg saved to cache
2026-03-26 22:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 99135a3f-f7a2-5591-a39c-c1ee2be1dc46
2026-03-26 22:47:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 99135a3f-f7a2-5591-a39c-c1ee2be1dc46, skipping ID generation
2026-03-26 22:47:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99135a3f-f7a2-5591-a39c-c1ee2be1dc46 with scrape type 1
2026-03-26 22:47:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 99135a3f-f7a2-5591-a39c-c1ee2be1dc46 sending to next pipeline
2026-03-26 22:47:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 99135a3f-f7a2-5591-a39c-c1ee2be1dc46, identifier: 1986087
2026-03-26 22:47:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77e8650>
2026-03-26 22:47:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ac92778-2e6d-51b5-a3d8-10524ea99f71/1ac92778-2e6d-51b5-a3d8-10524ea99f71_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F010a5d90af3244e3bdf61fc77de40404%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/010a5d90af3244e3bdf61fc77de40404/images/large/1.jpg saved to cache
2026-03-26 22:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1ac92778-2e6d-51b5-a3d8-10524ea99f71
2026-03-26 22:47:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79cc890>
2026-03-26 22:47:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ac92778-2e6d-51b5-a3d8-10524ea99f71/1ac92778-2e6d-51b5-a3d8-10524ea99f71_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F010a5d90af3244e3bdf61fc77de40404%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/010a5d90af3244e3bdf61fc77de40404/images/large/5.jpg saved to cache
2026-03-26 22:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1ac92778-2e6d-51b5-a3d8-10524ea99f71
2026-03-26 22:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Ff49ef6afd0e840f094406c171b7b678f%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/f49ef6afd0e840f094406c171b7b678f/images/large/10.jpg not downloaded yet
2026-03-26 22:47:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 99135a3f-f7a2-5591-a39c-c1ee2be1dc46 with identifier: 1986087
2026-03-26 22:47:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 99135a3f-f7a2-5591-a39c-c1ee2be1dc46 with identifier: 1986087
2026-03-26 22:47:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 99135a3f-f7a2-5591-a39c-c1ee2be1dc46 with identifier: 1986087 to the API
2026-03-26 22:47:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:47:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:47:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bs/dfaf8bfef9a44f1d96806ff0372f83b1/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '99135a3f-f7a2-5591-a39c-c1ee2be1dc46',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLA SHOOTING BRAKE',
 'odometer': 126334,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99135a3f-f7a2-5591-a39c-c1ee2be1dc46/99135a3f-f7a2-5591-a39c-c1ee2be1dc46_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 573428,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/dfaf8bfef9a44f1d96806ff0372f83b1/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99135a3f-f7a2-5591-a39c-c1ee2be1dc46/99135a3f-f7a2-5591-a39c-c1ee2be1dc46_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 583871,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/dfaf8bfef9a44f1d96806ff0372f83b1/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99135a3f-f7a2-5591-a39c-c1ee2be1dc46/99135a3f-f7a2-5591-a39c-c1ee2be1dc46_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 537282,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/dfaf8bfef9a44f1d96806ff0372f83b1/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99135a3f-f7a2-5591-a39c-c1ee2be1dc46/99135a3f-f7a2-5591-a39c-c1ee2be1dc46_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 637443,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/dfaf8bfef9a44f1d96806ff0372f83b1/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99135a3f-f7a2-5591-a39c-c1ee2be1dc46/99135a3f-f7a2-5591-a39c-c1ee2be1dc46_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 521385,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/dfaf8bfef9a44f1d96806ff0372f83b1/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99135a3f-f7a2-5591-a39c-c1ee2be1dc46/99135a3f-f7a2-5591-a39c-c1ee2be1dc46_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 639597,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/dfaf8bfef9a44f1d96806ff0372f83b1/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99135a3f-f7a2-5591-a39c-c1ee2be1dc46/99135a3f-f7a2-5591-a39c-c1ee2be1dc46_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 645747,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/dfaf8bfef9a44f1d96806ff0372f83b1/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99135a3f-f7a2-5591-a39c-c1ee2be1dc46/99135a3f-f7a2-5591-a39c-c1ee2be1dc46_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 611546,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/dfaf8bfef9a44f1d96806ff0372f83b1/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99135a3f-f7a2-5591-a39c-c1ee2be1dc46/99135a3f-f7a2-5591-a39c-c1ee2be1dc46_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 564575,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/dfaf8bfef9a44f1d96806ff0372f83b1/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99135a3f-f7a2-5591-a39c-c1ee2be1dc46/99135a3f-f7a2-5591-a39c-c1ee2be1dc46_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 593568,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/dfaf8bfef9a44f1d96806ff0372f83b1/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLA SHOOTING BRAKE 1.3 CLA 250 E BUSINESS SOLUTION '
          'DCT',
 'transmission': 'automatic',
 'trim': '1.3 CLA 250 E BUSINESS SOLUTION DCT',
 'vin': None,
 'year': 2022}
2026-03-26 22:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986087%27 HTTP/1.1" 200 None
2026-03-26 22:47:11 [ayvens.be] INFO: Saving data for 1986087: {'created_time': 1774565231.083902, 'last_price_update_time': 1774565231.083913, 'auction_closing_time': 1775028600.0}
2026-03-26 22:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986087') HTTP/1.1" 204 0
2026-03-26 22:47:11 [ayvens.be] INFO: Found listing with ID: 1986090
2026-03-26 22:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986090%27 HTTP/1.1" 200 None
2026-03-26 22:47:11 [ayvens.be] INFO: Scrape type for 1986090: 1
2026-03-26 22:47:11 [ayvens.be] INFO: Extracting data for car ID: 1986090
2026-03-26 22:47:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab8e390a-818c-5cb0-8ed8-efc7879adb32 with identifier: 1986090
2026-03-26 22:47:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab8e390a-818c-5cb0-8ed8-efc7879adb32 with scrape type 1
2026-03-26 22:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ab8e390a-818c-5cb0-8ed8-efc7879adb32
2026-03-26 22:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F963dd281967047d8bb8931f029766451%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/963dd281967047d8bb8931f029766451/images/large/1.jpg not downloaded yet
2026-03-26 22:47:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/010a5d90af3244e3bdf61fc77de40404/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F963dd281967047d8bb8931f029766451%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/963dd281967047d8bb8931f029766451/images/large/2.jpg not downloaded yet
2026-03-26 22:47:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7409150>
2026-03-26 22:47:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ac92778-2e6d-51b5-a3d8-10524ea99f71/1ac92778-2e6d-51b5-a3d8-10524ea99f71_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F010a5d90af3244e3bdf61fc77de40404%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/010a5d90af3244e3bdf61fc77de40404/images/large/4.jpg saved to cache
2026-03-26 22:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1ac92778-2e6d-51b5-a3d8-10524ea99f71
2026-03-26 22:47:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77eae50>
2026-03-26 22:47:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ac92778-2e6d-51b5-a3d8-10524ea99f71/1ac92778-2e6d-51b5-a3d8-10524ea99f71_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F010a5d90af3244e3bdf61fc77de40404%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/010a5d90af3244e3bdf61fc77de40404/images/large/6.jpg saved to cache
2026-03-26 22:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1ac92778-2e6d-51b5-a3d8-10524ea99f71
2026-03-26 22:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F963dd281967047d8bb8931f029766451%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/963dd281967047d8bb8931f029766451/images/large/3.jpg not downloaded yet
2026-03-26 22:47:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/010a5d90af3244e3bdf61fc77de40404/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F963dd281967047d8bb8931f029766451%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/963dd281967047d8bb8931f029766451/images/large/4.jpg not downloaded yet
2026-03-26 22:47:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b726b1d0>
2026-03-26 22:47:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ac92778-2e6d-51b5-a3d8-10524ea99f71/1ac92778-2e6d-51b5-a3d8-10524ea99f71_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F010a5d90af3244e3bdf61fc77de40404%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/010a5d90af3244e3bdf61fc77de40404/images/large/7.jpg saved to cache
2026-03-26 22:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1ac92778-2e6d-51b5-a3d8-10524ea99f71
2026-03-26 22:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F963dd281967047d8bb8931f029766451%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/963dd281967047d8bb8931f029766451/images/large/5.jpg not downloaded yet
2026-03-26 22:47:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/010a5d90af3244e3bdf61fc77de40404/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/010a5d90af3244e3bdf61fc77de40404/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/f49ef6afd0e840f094406c171b7b678f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/f49ef6afd0e840f094406c171b7b678f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/010a5d90af3244e3bdf61fc77de40404/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/010a5d90af3244e3bdf61fc77de40404/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F963dd281967047d8bb8931f029766451%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/963dd281967047d8bb8931f029766451/images/large/6.jpg not downloaded yet
2026-03-26 22:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F963dd281967047d8bb8931f029766451%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/963dd281967047d8bb8931f029766451/images/large/7.jpg not downloaded yet
2026-03-26 22:47:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79f0410>
2026-03-26 22:47:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ac92778-2e6d-51b5-a3d8-10524ea99f71/1ac92778-2e6d-51b5-a3d8-10524ea99f71_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F010a5d90af3244e3bdf61fc77de40404%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/010a5d90af3244e3bdf61fc77de40404/images/large/3.jpg saved to cache
2026-03-26 22:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1ac92778-2e6d-51b5-a3d8-10524ea99f71
2026-03-26 22:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F963dd281967047d8bb8931f029766451%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/963dd281967047d8bb8931f029766451/images/large/8.jpg not downloaded yet
2026-03-26 22:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F963dd281967047d8bb8931f029766451%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/963dd281967047d8bb8931f029766451/images/large/9.jpg not downloaded yet
2026-03-26 22:47:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/f49ef6afd0e840f094406c171b7b678f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7567c90>
2026-03-26 22:47:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ac92778-2e6d-51b5-a3d8-10524ea99f71/1ac92778-2e6d-51b5-a3d8-10524ea99f71_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F010a5d90af3244e3bdf61fc77de40404%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/010a5d90af3244e3bdf61fc77de40404/images/large/2.jpg saved to cache
2026-03-26 22:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1ac92778-2e6d-51b5-a3d8-10524ea99f71
2026-03-26 22:47:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7744550>
2026-03-26 22:47:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ac92778-2e6d-51b5-a3d8-10524ea99f71/1ac92778-2e6d-51b5-a3d8-10524ea99f71_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F010a5d90af3244e3bdf61fc77de40404%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/010a5d90af3244e3bdf61fc77de40404/images/large/10.jpg saved to cache
2026-03-26 22:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1ac92778-2e6d-51b5-a3d8-10524ea99f71
2026-03-26 22:47:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c80b50>
2026-03-26 22:47:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2278d22-bc6b-5ae7-a622-e79eb64ea72e/f2278d22-bc6b-5ae7-a622-e79eb64ea72e_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Ff49ef6afd0e840f094406c171b7b678f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/f49ef6afd0e840f094406c171b7b678f/images/large/2.jpg saved to cache
2026-03-26 22:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f2278d22-bc6b-5ae7-a622-e79eb64ea72e
2026-03-26 22:47:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c832d0>
2026-03-26 22:47:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2278d22-bc6b-5ae7-a622-e79eb64ea72e/f2278d22-bc6b-5ae7-a622-e79eb64ea72e_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Ff49ef6afd0e840f094406c171b7b678f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/f49ef6afd0e840f094406c171b7b678f/images/large/1.jpg saved to cache
2026-03-26 22:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f2278d22-bc6b-5ae7-a622-e79eb64ea72e
2026-03-26 22:47:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7490650>
2026-03-26 22:47:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ac92778-2e6d-51b5-a3d8-10524ea99f71/1ac92778-2e6d-51b5-a3d8-10524ea99f71_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F010a5d90af3244e3bdf61fc77de40404%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/010a5d90af3244e3bdf61fc77de40404/images/large/9.jpg saved to cache
2026-03-26 22:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1ac92778-2e6d-51b5-a3d8-10524ea99f71
2026-03-26 22:47:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7491a90>
2026-03-26 22:47:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ac92778-2e6d-51b5-a3d8-10524ea99f71/1ac92778-2e6d-51b5-a3d8-10524ea99f71_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F010a5d90af3244e3bdf61fc77de40404%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/010a5d90af3244e3bdf61fc77de40404/images/large/8.jpg saved to cache
2026-03-26 22:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1ac92778-2e6d-51b5-a3d8-10524ea99f71
2026-03-26 22:47:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1ac92778-2e6d-51b5-a3d8-10524ea99f71, skipping ID generation
2026-03-26 22:47:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ac92778-2e6d-51b5-a3d8-10524ea99f71 with scrape type 1
2026-03-26 22:47:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1ac92778-2e6d-51b5-a3d8-10524ea99f71 sending to next pipeline
2026-03-26 22:47:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 1ac92778-2e6d-51b5-a3d8-10524ea99f71, identifier: 1986088
2026-03-26 22:47:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/f49ef6afd0e840f094406c171b7b678f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F963dd281967047d8bb8931f029766451%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/963dd281967047d8bb8931f029766451/images/large/10.jpg not downloaded yet
2026-03-26 22:47:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 1ac92778-2e6d-51b5-a3d8-10524ea99f71 with identifier: 1986088
2026-03-26 22:47:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 1ac92778-2e6d-51b5-a3d8-10524ea99f71 with identifier: 1986088
2026-03-26 22:47:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 1ac92778-2e6d-51b5-a3d8-10524ea99f71 with identifier: 1986088 to the API
2026-03-26 22:47:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:47:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:47:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bg/010a5d90af3244e3bdf61fc77de40404/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'electric',
 'id': '1ac92778-2e6d-51b5-a3d8-10524ea99f71',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'TESLA',
 'model': 'MODEL 3',
 'odometer': 107659,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ac92778-2e6d-51b5-a3d8-10524ea99f71/1ac92778-2e6d-51b5-a3d8-10524ea99f71_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 626747,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/010a5d90af3244e3bdf61fc77de40404/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ac92778-2e6d-51b5-a3d8-10524ea99f71/1ac92778-2e6d-51b5-a3d8-10524ea99f71_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 676209,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/010a5d90af3244e3bdf61fc77de40404/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ac92778-2e6d-51b5-a3d8-10524ea99f71/1ac92778-2e6d-51b5-a3d8-10524ea99f71_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 611076,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/010a5d90af3244e3bdf61fc77de40404/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ac92778-2e6d-51b5-a3d8-10524ea99f71/1ac92778-2e6d-51b5-a3d8-10524ea99f71_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 633536,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/010a5d90af3244e3bdf61fc77de40404/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ac92778-2e6d-51b5-a3d8-10524ea99f71/1ac92778-2e6d-51b5-a3d8-10524ea99f71_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 603595,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/010a5d90af3244e3bdf61fc77de40404/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ac92778-2e6d-51b5-a3d8-10524ea99f71/1ac92778-2e6d-51b5-a3d8-10524ea99f71_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 614006,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/010a5d90af3244e3bdf61fc77de40404/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ac92778-2e6d-51b5-a3d8-10524ea99f71/1ac92778-2e6d-51b5-a3d8-10524ea99f71_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 531057,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/010a5d90af3244e3bdf61fc77de40404/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ac92778-2e6d-51b5-a3d8-10524ea99f71/1ac92778-2e6d-51b5-a3d8-10524ea99f71_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 778569,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/010a5d90af3244e3bdf61fc77de40404/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ac92778-2e6d-51b5-a3d8-10524ea99f71/1ac92778-2e6d-51b5-a3d8-10524ea99f71_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 790099,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/010a5d90af3244e3bdf61fc77de40404/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ac92778-2e6d-51b5-a3d8-10524ea99f71/1ac92778-2e6d-51b5-a3d8-10524ea99f71_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 713016,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/010a5d90af3244e3bdf61fc77de40404/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TESLA MODEL 3 75 KWH LONG RANGE DUAL MOTOR 4WD AUTO',
 'transmission': 'automatic',
 'trim': '75 KWH LONG RANGE DUAL MOTOR 4WD AUTO',
 'vin': None,
 'year': 2021}
2026-03-26 22:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986088%27 HTTP/1.1" 200 None
2026-03-26 22:47:12 [ayvens.be] INFO: Saving data for 1986088: {'created_time': 1774565232.902704, 'last_price_update_time': 1774565232.902715, 'auction_closing_time': 1775028600.0}
2026-03-26 22:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986088') HTTP/1.1" 204 0
2026-03-26 22:47:12 [ayvens.be] INFO: Found listing with ID: 1986091
2026-03-26 22:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986091%27 HTTP/1.1" 200 None
2026-03-26 22:47:12 [ayvens.be] INFO: Scrape type for 1986091: 1
2026-03-26 22:47:12 [ayvens.be] INFO: Extracting data for car ID: 1986091
2026-03-26 22:47:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e679bfcc-7b17-50d8-b2fb-cb19d684a68d with identifier: 1986091
2026-03-26 22:47:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e679bfcc-7b17-50d8-b2fb-cb19d684a68d with scrape type 1
2026-03-26 22:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e679bfcc-7b17-50d8-b2fb-cb19d684a68d
2026-03-26 22:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Ff1b3467900684d4f9455135f7ddc136b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/f1b3467900684d4f9455135f7ddc136b/images/large/1.jpg not downloaded yet
2026-03-26 22:47:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/f49ef6afd0e840f094406c171b7b678f/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/f49ef6afd0e840f094406c171b7b678f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/f49ef6afd0e840f094406c171b7b678f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Ff1b3467900684d4f9455135f7ddc136b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/f1b3467900684d4f9455135f7ddc136b/images/large/2.jpg not downloaded yet
2026-03-26 22:47:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b741cd10>
2026-03-26 22:47:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2278d22-bc6b-5ae7-a622-e79eb64ea72e/f2278d22-bc6b-5ae7-a622-e79eb64ea72e_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Ff49ef6afd0e840f094406c171b7b678f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/f49ef6afd0e840f094406c171b7b678f/images/large/3.jpg saved to cache
2026-03-26 22:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f2278d22-bc6b-5ae7-a622-e79eb64ea72e
2026-03-26 22:47:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74e7a50>
2026-03-26 22:47:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2278d22-bc6b-5ae7-a622-e79eb64ea72e/f2278d22-bc6b-5ae7-a622-e79eb64ea72e_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Ff49ef6afd0e840f094406c171b7b678f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/f49ef6afd0e840f094406c171b7b678f/images/large/4.jpg saved to cache
2026-03-26 22:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f2278d22-bc6b-5ae7-a622-e79eb64ea72e
2026-03-26 22:47:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/f49ef6afd0e840f094406c171b7b678f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/f49ef6afd0e840f094406c171b7b678f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/f49ef6afd0e840f094406c171b7b678f/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Ff1b3467900684d4f9455135f7ddc136b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/f1b3467900684d4f9455135f7ddc136b/images/large/3.jpg not downloaded yet
2026-03-26 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Ff1b3467900684d4f9455135f7ddc136b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/f1b3467900684d4f9455135f7ddc136b/images/large/4.jpg not downloaded yet
2026-03-26 22:47:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79fa390>
2026-03-26 22:47:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2278d22-bc6b-5ae7-a622-e79eb64ea72e/f2278d22-bc6b-5ae7-a622-e79eb64ea72e_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Ff49ef6afd0e840f094406c171b7b678f%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/f49ef6afd0e840f094406c171b7b678f/images/large/10.jpg saved to cache
2026-03-26 22:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f2278d22-bc6b-5ae7-a622-e79eb64ea72e
2026-03-26 22:47:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7424f10>
2026-03-26 22:47:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2278d22-bc6b-5ae7-a622-e79eb64ea72e/f2278d22-bc6b-5ae7-a622-e79eb64ea72e_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Ff49ef6afd0e840f094406c171b7b678f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/f49ef6afd0e840f094406c171b7b678f/images/large/6.jpg saved to cache
2026-03-26 22:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f2278d22-bc6b-5ae7-a622-e79eb64ea72e
2026-03-26 22:47:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76ef610>
2026-03-26 22:47:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2278d22-bc6b-5ae7-a622-e79eb64ea72e/f2278d22-bc6b-5ae7-a622-e79eb64ea72e_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Ff49ef6afd0e840f094406c171b7b678f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/f49ef6afd0e840f094406c171b7b678f/images/large/5.jpg saved to cache
2026-03-26 22:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f2278d22-bc6b-5ae7-a622-e79eb64ea72e
2026-03-26 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Ff1b3467900684d4f9455135f7ddc136b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/f1b3467900684d4f9455135f7ddc136b/images/large/5.jpg not downloaded yet
2026-03-26 22:47:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/963dd281967047d8bb8931f029766451/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Ff1b3467900684d4f9455135f7ddc136b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/f1b3467900684d4f9455135f7ddc136b/images/large/6.jpg not downloaded yet
2026-03-26 22:47:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd4c8790>
2026-03-26 22:47:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2278d22-bc6b-5ae7-a622-e79eb64ea72e/f2278d22-bc6b-5ae7-a622-e79eb64ea72e_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Ff49ef6afd0e840f094406c171b7b678f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/f49ef6afd0e840f094406c171b7b678f/images/large/8.jpg saved to cache
2026-03-26 22:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f2278d22-bc6b-5ae7-a622-e79eb64ea72e
2026-03-26 22:47:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7411e50>
2026-03-26 22:47:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2278d22-bc6b-5ae7-a622-e79eb64ea72e/f2278d22-bc6b-5ae7-a622-e79eb64ea72e_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Ff49ef6afd0e840f094406c171b7b678f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/f49ef6afd0e840f094406c171b7b678f/images/large/7.jpg saved to cache
2026-03-26 22:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f2278d22-bc6b-5ae7-a622-e79eb64ea72e
2026-03-26 22:47:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6dc0610>
2026-03-26 22:47:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2278d22-bc6b-5ae7-a622-e79eb64ea72e/f2278d22-bc6b-5ae7-a622-e79eb64ea72e_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Ff49ef6afd0e840f094406c171b7b678f%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/f49ef6afd0e840f094406c171b7b678f/images/large/9.jpg saved to cache
2026-03-26 22:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f2278d22-bc6b-5ae7-a622-e79eb64ea72e
2026-03-26 22:47:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f2278d22-bc6b-5ae7-a622-e79eb64ea72e, skipping ID generation
2026-03-26 22:47:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2278d22-bc6b-5ae7-a622-e79eb64ea72e with scrape type 1
2026-03-26 22:47:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f2278d22-bc6b-5ae7-a622-e79eb64ea72e sending to next pipeline
2026-03-26 22:47:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f2278d22-bc6b-5ae7-a622-e79eb64ea72e, identifier: 1986089
2026-03-26 22:47:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f2278d22-bc6b-5ae7-a622-e79eb64ea72e with identifier: 1986089
2026-03-26 22:47:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f2278d22-bc6b-5ae7-a622-e79eb64ea72e with identifier: 1986089
2026-03-26 22:47:14 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f2278d22-bc6b-5ae7-a622-e79eb64ea72e with identifier: 1986089 to the API
2026-03-26 22:47:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:47:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:47:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bs/f49ef6afd0e840f094406c171b7b678f/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'f2278d22-bc6b-5ae7-a622-e79eb64ea72e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLA SHOOTING BRAKE',
 'odometer': 119957,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2278d22-bc6b-5ae7-a622-e79eb64ea72e/f2278d22-bc6b-5ae7-a622-e79eb64ea72e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 597991,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/f49ef6afd0e840f094406c171b7b678f/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2278d22-bc6b-5ae7-a622-e79eb64ea72e/f2278d22-bc6b-5ae7-a622-e79eb64ea72e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 598399,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/f49ef6afd0e840f094406c171b7b678f/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2278d22-bc6b-5ae7-a622-e79eb64ea72e/f2278d22-bc6b-5ae7-a622-e79eb64ea72e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 607487,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/f49ef6afd0e840f094406c171b7b678f/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2278d22-bc6b-5ae7-a622-e79eb64ea72e/f2278d22-bc6b-5ae7-a622-e79eb64ea72e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 633306,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/f49ef6afd0e840f094406c171b7b678f/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2278d22-bc6b-5ae7-a622-e79eb64ea72e/f2278d22-bc6b-5ae7-a622-e79eb64ea72e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 549207,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/f49ef6afd0e840f094406c171b7b678f/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2278d22-bc6b-5ae7-a622-e79eb64ea72e/f2278d22-bc6b-5ae7-a622-e79eb64ea72e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 551997,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/f49ef6afd0e840f094406c171b7b678f/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2278d22-bc6b-5ae7-a622-e79eb64ea72e/f2278d22-bc6b-5ae7-a622-e79eb64ea72e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 646655,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/f49ef6afd0e840f094406c171b7b678f/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2278d22-bc6b-5ae7-a622-e79eb64ea72e/f2278d22-bc6b-5ae7-a622-e79eb64ea72e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 628444,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/f49ef6afd0e840f094406c171b7b678f/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2278d22-bc6b-5ae7-a622-e79eb64ea72e/f2278d22-bc6b-5ae7-a622-e79eb64ea72e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 606175,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/f49ef6afd0e840f094406c171b7b678f/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2278d22-bc6b-5ae7-a622-e79eb64ea72e/f2278d22-bc6b-5ae7-a622-e79eb64ea72e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 488925,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/f49ef6afd0e840f094406c171b7b678f/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLA SHOOTING BRAKE 1.3 CLA 250 E BUSINESS SOLUTION '
          'DCT',
 'transmission': 'automatic',
 'trim': '1.3 CLA 250 E BUSINESS SOLUTION DCT',
 'vin': None,
 'year': 2022}
2026-03-26 22:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986089%27 HTTP/1.1" 200 None
2026-03-26 22:47:14 [ayvens.be] INFO: Saving data for 1986089: {'created_time': 1774565234.429851, 'last_price_update_time': 1774565234.42986, 'auction_closing_time': 1775028600.0}
2026-03-26 22:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986089') HTTP/1.1" 204 0
2026-03-26 22:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Ff1b3467900684d4f9455135f7ddc136b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/f1b3467900684d4f9455135f7ddc136b/images/large/7.jpg not downloaded yet
2026-03-26 22:47:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/963dd281967047d8bb8931f029766451/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Ff1b3467900684d4f9455135f7ddc136b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/f1b3467900684d4f9455135f7ddc136b/images/large/8.jpg not downloaded yet
2026-03-26 22:47:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7439e10>
2026-03-26 22:47:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab8e390a-818c-5cb0-8ed8-efc7879adb32/ab8e390a-818c-5cb0-8ed8-efc7879adb32_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F963dd281967047d8bb8931f029766451%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/963dd281967047d8bb8931f029766451/images/large/1.jpg saved to cache
2026-03-26 22:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ab8e390a-818c-5cb0-8ed8-efc7879adb32
2026-03-26 22:47:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/963dd281967047d8bb8931f029766451/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/963dd281967047d8bb8931f029766451/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/963dd281967047d8bb8931f029766451/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Ff1b3467900684d4f9455135f7ddc136b%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/f1b3467900684d4f9455135f7ddc136b/images/large/9.jpg not downloaded yet
2026-03-26 22:47:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/963dd281967047d8bb8931f029766451/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/963dd281967047d8bb8931f029766451/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/963dd281967047d8bb8931f029766451/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Ff1b3467900684d4f9455135f7ddc136b%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/f1b3467900684d4f9455135f7ddc136b/images/large/10.jpg not downloaded yet
2026-03-26 22:47:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b72686d0>
2026-03-26 22:47:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab8e390a-818c-5cb0-8ed8-efc7879adb32/ab8e390a-818c-5cb0-8ed8-efc7879adb32_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F963dd281967047d8bb8931f029766451%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/963dd281967047d8bb8931f029766451/images/large/2.jpg saved to cache
2026-03-26 22:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ab8e390a-818c-5cb0-8ed8-efc7879adb32
2026-03-26 22:47:14 [ayvens.be] INFO: Found listing with ID: 1986092
2026-03-26 22:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986092%27 HTTP/1.1" 200 None
2026-03-26 22:47:14 [ayvens.be] INFO: Scrape type for 1986092: 1
2026-03-26 22:47:14 [ayvens.be] INFO: Extracting data for car ID: 1986092
2026-03-26 22:47:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5180510f-bf8c-5918-b9d0-c59c4af40884 with identifier: 1986092
2026-03-26 22:47:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5180510f-bf8c-5918-b9d0-c59c4af40884 with scrape type 1
2026-03-26 22:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5180510f-bf8c-5918-b9d0-c59c4af40884
2026-03-26 22:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F190f38257f44487aa16a30dc5b9b4ec3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/190f38257f44487aa16a30dc5b9b4ec3/images/large/1.jpg not downloaded yet
2026-03-26 22:47:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/963dd281967047d8bb8931f029766451/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F190f38257f44487aa16a30dc5b9b4ec3%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/190f38257f44487aa16a30dc5b9b4ec3/images/large/2.jpg not downloaded yet
2026-03-26 22:47:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77d4410>
2026-03-26 22:47:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab8e390a-818c-5cb0-8ed8-efc7879adb32/ab8e390a-818c-5cb0-8ed8-efc7879adb32_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F963dd281967047d8bb8931f029766451%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/963dd281967047d8bb8931f029766451/images/large/3.jpg saved to cache
2026-03-26 22:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ab8e390a-818c-5cb0-8ed8-efc7879adb32
2026-03-26 22:47:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b792fd90>
2026-03-26 22:47:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab8e390a-818c-5cb0-8ed8-efc7879adb32/ab8e390a-818c-5cb0-8ed8-efc7879adb32_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F963dd281967047d8bb8931f029766451%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/963dd281967047d8bb8931f029766451/images/large/5.jpg saved to cache
2026-03-26 22:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ab8e390a-818c-5cb0-8ed8-efc7879adb32
2026-03-26 22:47:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b746d090>
2026-03-26 22:47:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab8e390a-818c-5cb0-8ed8-efc7879adb32/ab8e390a-818c-5cb0-8ed8-efc7879adb32_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F963dd281967047d8bb8931f029766451%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/963dd281967047d8bb8931f029766451/images/large/6.jpg saved to cache
2026-03-26 22:47:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ab8e390a-818c-5cb0-8ed8-efc7879adb32
2026-03-26 22:47:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74bc5d0>
2026-03-26 22:47:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab8e390a-818c-5cb0-8ed8-efc7879adb32/ab8e390a-818c-5cb0-8ed8-efc7879adb32_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F963dd281967047d8bb8931f029766451%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/963dd281967047d8bb8931f029766451/images/large/7.jpg saved to cache
2026-03-26 22:47:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ab8e390a-818c-5cb0-8ed8-efc7879adb32
2026-03-26 22:47:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7491890>
2026-03-26 22:47:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab8e390a-818c-5cb0-8ed8-efc7879adb32/ab8e390a-818c-5cb0-8ed8-efc7879adb32_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F963dd281967047d8bb8931f029766451%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/963dd281967047d8bb8931f029766451/images/large/4.jpg saved to cache
2026-03-26 22:47:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ab8e390a-818c-5cb0-8ed8-efc7879adb32
2026-03-26 22:47:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79d7c90>
2026-03-26 22:47:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab8e390a-818c-5cb0-8ed8-efc7879adb32/ab8e390a-818c-5cb0-8ed8-efc7879adb32_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F963dd281967047d8bb8931f029766451%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/963dd281967047d8bb8931f029766451/images/large/8.jpg saved to cache
2026-03-26 22:47:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ab8e390a-818c-5cb0-8ed8-efc7879adb32
2026-03-26 22:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F190f38257f44487aa16a30dc5b9b4ec3%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/190f38257f44487aa16a30dc5b9b4ec3/images/large/3.jpg not downloaded yet
2026-03-26 22:47:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/963dd281967047d8bb8931f029766451/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F190f38257f44487aa16a30dc5b9b4ec3%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/190f38257f44487aa16a30dc5b9b4ec3/images/large/4.jpg not downloaded yet
2026-03-26 22:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F190f38257f44487aa16a30dc5b9b4ec3%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/190f38257f44487aa16a30dc5b9b4ec3/images/large/5.jpg not downloaded yet
2026-03-26 22:47:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74020d0>
2026-03-26 22:47:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab8e390a-818c-5cb0-8ed8-efc7879adb32/ab8e390a-818c-5cb0-8ed8-efc7879adb32_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F963dd281967047d8bb8931f029766451%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/963dd281967047d8bb8931f029766451/images/large/10.jpg saved to cache
2026-03-26 22:47:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ab8e390a-818c-5cb0-8ed8-efc7879adb32
2026-03-26 22:47:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/f1b3467900684d4f9455135f7ddc136b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/f1b3467900684d4f9455135f7ddc136b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F190f38257f44487aa16a30dc5b9b4ec3%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/190f38257f44487aa16a30dc5b9b4ec3/images/large/6.jpg not downloaded yet
2026-03-26 22:47:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/f1b3467900684d4f9455135f7ddc136b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/f1b3467900684d4f9455135f7ddc136b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/f1b3467900684d4f9455135f7ddc136b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F190f38257f44487aa16a30dc5b9b4ec3%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/190f38257f44487aa16a30dc5b9b4ec3/images/large/7.jpg not downloaded yet
2026-03-26 22:47:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/f1b3467900684d4f9455135f7ddc136b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e28310>
2026-03-26 22:47:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab8e390a-818c-5cb0-8ed8-efc7879adb32/ab8e390a-818c-5cb0-8ed8-efc7879adb32_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F963dd281967047d8bb8931f029766451%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/963dd281967047d8bb8931f029766451/images/large/9.jpg saved to cache
2026-03-26 22:47:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ab8e390a-818c-5cb0-8ed8-efc7879adb32
2026-03-26 22:47:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ab8e390a-818c-5cb0-8ed8-efc7879adb32, skipping ID generation
2026-03-26 22:47:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab8e390a-818c-5cb0-8ed8-efc7879adb32 with scrape type 1
2026-03-26 22:47:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ab8e390a-818c-5cb0-8ed8-efc7879adb32 sending to next pipeline
2026-03-26 22:47:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: ab8e390a-818c-5cb0-8ed8-efc7879adb32, identifier: 1986090
2026-03-26 22:47:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/f1b3467900684d4f9455135f7ddc136b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F190f38257f44487aa16a30dc5b9b4ec3%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/190f38257f44487aa16a30dc5b9b4ec3/images/large/8.jpg not downloaded yet
2026-03-26 22:47:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: ab8e390a-818c-5cb0-8ed8-efc7879adb32 with identifier: 1986090
2026-03-26 22:47:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: ab8e390a-818c-5cb0-8ed8-efc7879adb32 with identifier: 1986090
2026-03-26 22:47:15 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: ab8e390a-818c-5cb0-8ed8-efc7879adb32 with identifier: 1986090 to the API
2026-03-26 22:47:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:47:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:47:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cv/963dd281967047d8bb8931f029766451/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'ab8e390a-818c-5cb0-8ed8-efc7879adb32',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': 'RIFTER SWB DIESEL',
 'odometer': 171461,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab8e390a-818c-5cb0-8ed8-efc7879adb32/ab8e390a-818c-5cb0-8ed8-efc7879adb32_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 608760,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/963dd281967047d8bb8931f029766451/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab8e390a-818c-5cb0-8ed8-efc7879adb32/ab8e390a-818c-5cb0-8ed8-efc7879adb32_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 649625,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/963dd281967047d8bb8931f029766451/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab8e390a-818c-5cb0-8ed8-efc7879adb32/ab8e390a-818c-5cb0-8ed8-efc7879adb32_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 551569,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/963dd281967047d8bb8931f029766451/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab8e390a-818c-5cb0-8ed8-efc7879adb32/ab8e390a-818c-5cb0-8ed8-efc7879adb32_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 663088,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/963dd281967047d8bb8931f029766451/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab8e390a-818c-5cb0-8ed8-efc7879adb32/ab8e390a-818c-5cb0-8ed8-efc7879adb32_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 579463,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/963dd281967047d8bb8931f029766451/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab8e390a-818c-5cb0-8ed8-efc7879adb32/ab8e390a-818c-5cb0-8ed8-efc7879adb32_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 563507,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/963dd281967047d8bb8931f029766451/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab8e390a-818c-5cb0-8ed8-efc7879adb32/ab8e390a-818c-5cb0-8ed8-efc7879adb32_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 651255,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/963dd281967047d8bb8931f029766451/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab8e390a-818c-5cb0-8ed8-efc7879adb32/ab8e390a-818c-5cb0-8ed8-efc7879adb32_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 683813,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/963dd281967047d8bb8931f029766451/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab8e390a-818c-5cb0-8ed8-efc7879adb32/ab8e390a-818c-5cb0-8ed8-efc7879adb32_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 560338,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/963dd281967047d8bb8931f029766451/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab8e390a-818c-5cb0-8ed8-efc7879adb32/ab8e390a-818c-5cb0-8ed8-efc7879adb32_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 557317,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/963dd281967047d8bb8931f029766451/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT RIFTER SWB DIESEL 1.5 BlueHDi Standard Allure AGC S&S',
 'transmission': 'manual',
 'trim': '1.5 BlueHDi Standard Allure AGC S&S',
 'vin': None,
 'year': 2022}
2026-03-26 22:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986090%27 HTTP/1.1" 200 None
2026-03-26 22:47:16 [ayvens.be] INFO: Saving data for 1986090: {'created_time': 1774565236.091017, 'last_price_update_time': 1774565236.091027, 'auction_closing_time': 1775028600.0}
2026-03-26 22:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986090') HTTP/1.1" 204 0
2026-03-26 22:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F190f38257f44487aa16a30dc5b9b4ec3%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/190f38257f44487aa16a30dc5b9b4ec3/images/large/9.jpg not downloaded yet
2026-03-26 22:47:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7412850>
2026-03-26 22:47:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e679bfcc-7b17-50d8-b2fb-cb19d684a68d/e679bfcc-7b17-50d8-b2fb-cb19d684a68d_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Ff1b3467900684d4f9455135f7ddc136b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/f1b3467900684d4f9455135f7ddc136b/images/large/3.jpg saved to cache
2026-03-26 22:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e679bfcc-7b17-50d8-b2fb-cb19d684a68d
2026-03-26 22:47:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7449810>
2026-03-26 22:47:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e679bfcc-7b17-50d8-b2fb-cb19d684a68d/e679bfcc-7b17-50d8-b2fb-cb19d684a68d_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Ff1b3467900684d4f9455135f7ddc136b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/f1b3467900684d4f9455135f7ddc136b/images/large/1.jpg saved to cache
2026-03-26 22:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e679bfcc-7b17-50d8-b2fb-cb19d684a68d
2026-03-26 22:47:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7ccef90>
2026-03-26 22:47:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e679bfcc-7b17-50d8-b2fb-cb19d684a68d/e679bfcc-7b17-50d8-b2fb-cb19d684a68d_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Ff1b3467900684d4f9455135f7ddc136b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/f1b3467900684d4f9455135f7ddc136b/images/large/2.jpg saved to cache
2026-03-26 22:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e679bfcc-7b17-50d8-b2fb-cb19d684a68d
2026-03-26 22:47:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c76bd0>
2026-03-26 22:47:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e679bfcc-7b17-50d8-b2fb-cb19d684a68d/e679bfcc-7b17-50d8-b2fb-cb19d684a68d_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Ff1b3467900684d4f9455135f7ddc136b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/f1b3467900684d4f9455135f7ddc136b/images/large/6.jpg saved to cache
2026-03-26 22:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e679bfcc-7b17-50d8-b2fb-cb19d684a68d
2026-03-26 22:47:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7ccd7d0>
2026-03-26 22:47:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e679bfcc-7b17-50d8-b2fb-cb19d684a68d/e679bfcc-7b17-50d8-b2fb-cb19d684a68d_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Ff1b3467900684d4f9455135f7ddc136b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/f1b3467900684d4f9455135f7ddc136b/images/large/5.jpg saved to cache
2026-03-26 22:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e679bfcc-7b17-50d8-b2fb-cb19d684a68d
2026-03-26 22:47:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b72fdfd0>
2026-03-26 22:47:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e679bfcc-7b17-50d8-b2fb-cb19d684a68d/e679bfcc-7b17-50d8-b2fb-cb19d684a68d_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Ff1b3467900684d4f9455135f7ddc136b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/f1b3467900684d4f9455135f7ddc136b/images/large/4.jpg saved to cache
2026-03-26 22:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e679bfcc-7b17-50d8-b2fb-cb19d684a68d
2026-03-26 22:47:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74ade10>
2026-03-26 22:47:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e679bfcc-7b17-50d8-b2fb-cb19d684a68d/e679bfcc-7b17-50d8-b2fb-cb19d684a68d_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Ff1b3467900684d4f9455135f7ddc136b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/f1b3467900684d4f9455135f7ddc136b/images/large/7.jpg saved to cache
2026-03-26 22:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e679bfcc-7b17-50d8-b2fb-cb19d684a68d
2026-03-26 22:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F190f38257f44487aa16a30dc5b9b4ec3%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/190f38257f44487aa16a30dc5b9b4ec3/images/large/10.jpg not downloaded yet
2026-03-26 22:47:16 [ayvens.be] INFO: Found listing with ID: 1986093
2026-03-26 22:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986093%27 HTTP/1.1" 200 None
2026-03-26 22:47:16 [ayvens.be] INFO: Scrape type for 1986093: 1
2026-03-26 22:47:16 [ayvens.be] INFO: Extracting data for car ID: 1986093
2026-03-26 22:47:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b90900cd-b928-549e-9757-b894d285e993 with identifier: 1986093
2026-03-26 22:47:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b90900cd-b928-549e-9757-b894d285e993 with scrape type 1
2026-03-26 22:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b90900cd-b928-549e-9757-b894d285e993
2026-03-26 22:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F7602ca708c2549bd91dcdd67ba71e636%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/7602ca708c2549bd91dcdd67ba71e636/images/large/1.jpg not downloaded yet
2026-03-26 22:47:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/f1b3467900684d4f9455135f7ddc136b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F7602ca708c2549bd91dcdd67ba71e636%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/7602ca708c2549bd91dcdd67ba71e636/images/large/2.jpg not downloaded yet
2026-03-26 22:47:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/f1b3467900684d4f9455135f7ddc136b/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F7602ca708c2549bd91dcdd67ba71e636%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/7602ca708c2549bd91dcdd67ba71e636/images/large/3.jpg not downloaded yet
2026-03-26 22:47:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/f1b3467900684d4f9455135f7ddc136b/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/190f38257f44487aa16a30dc5b9b4ec3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/190f38257f44487aa16a30dc5b9b4ec3/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/190f38257f44487aa16a30dc5b9b4ec3/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/190f38257f44487aa16a30dc5b9b4ec3/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F7602ca708c2549bd91dcdd67ba71e636%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/7602ca708c2549bd91dcdd67ba71e636/images/large/4.jpg not downloaded yet
2026-03-26 22:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F7602ca708c2549bd91dcdd67ba71e636%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/7602ca708c2549bd91dcdd67ba71e636/images/large/5.jpg not downloaded yet
2026-03-26 22:47:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/190f38257f44487aa16a30dc5b9b4ec3/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F7602ca708c2549bd91dcdd67ba71e636%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/7602ca708c2549bd91dcdd67ba71e636/images/large/6.jpg not downloaded yet
2026-03-26 22:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F7602ca708c2549bd91dcdd67ba71e636%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/7602ca708c2549bd91dcdd67ba71e636/images/large/7.jpg not downloaded yet
2026-03-26 22:47:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c6a150>
2026-03-26 22:47:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e679bfcc-7b17-50d8-b2fb-cb19d684a68d/e679bfcc-7b17-50d8-b2fb-cb19d684a68d_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Ff1b3467900684d4f9455135f7ddc136b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/f1b3467900684d4f9455135f7ddc136b/images/large/8.jpg saved to cache
2026-03-26 22:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e679bfcc-7b17-50d8-b2fb-cb19d684a68d
2026-03-26 22:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F7602ca708c2549bd91dcdd67ba71e636%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/7602ca708c2549bd91dcdd67ba71e636/images/large/8.jpg not downloaded yet
2026-03-26 22:47:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c69c90>
2026-03-26 22:47:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e679bfcc-7b17-50d8-b2fb-cb19d684a68d/e679bfcc-7b17-50d8-b2fb-cb19d684a68d_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Ff1b3467900684d4f9455135f7ddc136b%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/f1b3467900684d4f9455135f7ddc136b/images/large/10.jpg saved to cache
2026-03-26 22:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e679bfcc-7b17-50d8-b2fb-cb19d684a68d
2026-03-26 22:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F7602ca708c2549bd91dcdd67ba71e636%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/7602ca708c2549bd91dcdd67ba71e636/images/large/9.jpg not downloaded yet
2026-03-26 22:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F7602ca708c2549bd91dcdd67ba71e636%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/7602ca708c2549bd91dcdd67ba71e636/images/large/10.jpg not downloaded yet
2026-03-26 22:47:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6df3b10>
2026-03-26 22:47:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e679bfcc-7b17-50d8-b2fb-cb19d684a68d/e679bfcc-7b17-50d8-b2fb-cb19d684a68d_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Ff1b3467900684d4f9455135f7ddc136b%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/f1b3467900684d4f9455135f7ddc136b/images/large/9.jpg saved to cache
2026-03-26 22:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e679bfcc-7b17-50d8-b2fb-cb19d684a68d
2026-03-26 22:47:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e679bfcc-7b17-50d8-b2fb-cb19d684a68d, skipping ID generation
2026-03-26 22:47:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e679bfcc-7b17-50d8-b2fb-cb19d684a68d with scrape type 1
2026-03-26 22:47:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e679bfcc-7b17-50d8-b2fb-cb19d684a68d sending to next pipeline
2026-03-26 22:47:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e679bfcc-7b17-50d8-b2fb-cb19d684a68d, identifier: 1986091
2026-03-26 22:47:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6da42d0>
2026-03-26 22:47:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5180510f-bf8c-5918-b9d0-c59c4af40884/5180510f-bf8c-5918-b9d0-c59c4af40884_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F190f38257f44487aa16a30dc5b9b4ec3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/190f38257f44487aa16a30dc5b9b4ec3/images/large/1.jpg saved to cache
2026-03-26 22:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5180510f-bf8c-5918-b9d0-c59c4af40884
2026-03-26 22:47:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c760d0>
2026-03-26 22:47:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5180510f-bf8c-5918-b9d0-c59c4af40884/5180510f-bf8c-5918-b9d0-c59c4af40884_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F190f38257f44487aa16a30dc5b9b4ec3%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/190f38257f44487aa16a30dc5b9b4ec3/images/large/4.jpg saved to cache
2026-03-26 22:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5180510f-bf8c-5918-b9d0-c59c4af40884
2026-03-26 22:47:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76c52d0>
2026-03-26 22:47:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5180510f-bf8c-5918-b9d0-c59c4af40884/5180510f-bf8c-5918-b9d0-c59c4af40884_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F190f38257f44487aa16a30dc5b9b4ec3%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/190f38257f44487aa16a30dc5b9b4ec3/images/large/3.jpg saved to cache
2026-03-26 22:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5180510f-bf8c-5918-b9d0-c59c4af40884
2026-03-26 22:47:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7ccdb50>
2026-03-26 22:47:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5180510f-bf8c-5918-b9d0-c59c4af40884/5180510f-bf8c-5918-b9d0-c59c4af40884_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F190f38257f44487aa16a30dc5b9b4ec3%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/190f38257f44487aa16a30dc5b9b4ec3/images/large/2.jpg saved to cache
2026-03-26 22:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5180510f-bf8c-5918-b9d0-c59c4af40884
2026-03-26 22:47:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b72ff910>
2026-03-26 22:47:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5180510f-bf8c-5918-b9d0-c59c4af40884/5180510f-bf8c-5918-b9d0-c59c4af40884_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F190f38257f44487aa16a30dc5b9b4ec3%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/190f38257f44487aa16a30dc5b9b4ec3/images/large/5.jpg saved to cache
2026-03-26 22:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5180510f-bf8c-5918-b9d0-c59c4af40884
2026-03-26 22:47:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e679bfcc-7b17-50d8-b2fb-cb19d684a68d with identifier: 1986091
2026-03-26 22:47:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e679bfcc-7b17-50d8-b2fb-cb19d684a68d with identifier: 1986091
2026-03-26 22:47:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e679bfcc-7b17-50d8-b2fb-cb19d684a68d with identifier: 1986091 to the API
2026-03-26 22:47:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:47:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:47:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bk/f1b3467900684d4f9455135f7ddc136b/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'electric',
 'id': 'e679bfcc-7b17-50d8-b2fb-cb19d684a68d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'EQC',
 'odometer': 171408,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e679bfcc-7b17-50d8-b2fb-cb19d684a68d/e679bfcc-7b17-50d8-b2fb-cb19d684a68d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 605177,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/f1b3467900684d4f9455135f7ddc136b/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e679bfcc-7b17-50d8-b2fb-cb19d684a68d/e679bfcc-7b17-50d8-b2fb-cb19d684a68d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 642241,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/f1b3467900684d4f9455135f7ddc136b/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e679bfcc-7b17-50d8-b2fb-cb19d684a68d/e679bfcc-7b17-50d8-b2fb-cb19d684a68d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 638302,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/f1b3467900684d4f9455135f7ddc136b/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e679bfcc-7b17-50d8-b2fb-cb19d684a68d/e679bfcc-7b17-50d8-b2fb-cb19d684a68d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 693995,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/f1b3467900684d4f9455135f7ddc136b/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e679bfcc-7b17-50d8-b2fb-cb19d684a68d/e679bfcc-7b17-50d8-b2fb-cb19d684a68d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 574542,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/f1b3467900684d4f9455135f7ddc136b/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e679bfcc-7b17-50d8-b2fb-cb19d684a68d/e679bfcc-7b17-50d8-b2fb-cb19d684a68d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 556372,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/f1b3467900684d4f9455135f7ddc136b/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e679bfcc-7b17-50d8-b2fb-cb19d684a68d/e679bfcc-7b17-50d8-b2fb-cb19d684a68d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 606750,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/f1b3467900684d4f9455135f7ddc136b/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e679bfcc-7b17-50d8-b2fb-cb19d684a68d/e679bfcc-7b17-50d8-b2fb-cb19d684a68d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 689583,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/f1b3467900684d4f9455135f7ddc136b/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e679bfcc-7b17-50d8-b2fb-cb19d684a68d/e679bfcc-7b17-50d8-b2fb-cb19d684a68d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 668941,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/f1b3467900684d4f9455135f7ddc136b/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e679bfcc-7b17-50d8-b2fb-cb19d684a68d/e679bfcc-7b17-50d8-b2fb-cb19d684a68d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 604641,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/f1b3467900684d4f9455135f7ddc136b/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ EQC BEV 80KWH EQC 400 4M BUSINESS SOL AMG',
 'transmission': 'automatic',
 'trim': 'BEV 80KWH EQC 400 4M BUSINESS SOL AMG',
 'vin': None,
 'year': 2021}
2026-03-26 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986091%27 HTTP/1.1" 200 None
2026-03-26 22:47:18 [ayvens.be] INFO: Saving data for 1986091: {'created_time': 1774565238.383889, 'last_price_update_time': 1774565238.383898, 'auction_closing_time': 1775028600.0}
2026-03-26 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986091') HTTP/1.1" 204 0
2026-03-26 22:47:18 [ayvens.be] INFO: Found listing with ID: 1986094
2026-03-26 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986094%27 HTTP/1.1" 200 None
2026-03-26 22:47:18 [ayvens.be] INFO: Scrape type for 1986094: 1
2026-03-26 22:47:18 [ayvens.be] INFO: Extracting data for car ID: 1986094
2026-03-26 22:47:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2210c3c3-db88-5842-8418-cbfbdbf20245 with identifier: 1986094
2026-03-26 22:47:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2210c3c3-db88-5842-8418-cbfbdbf20245 with scrape type 1
2026-03-26 22:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2210c3c3-db88-5842-8418-cbfbdbf20245
2026-03-26 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F03eeeb06daaa46428d8e5b90fe4dd13a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/03eeeb06daaa46428d8e5b90fe4dd13a/images/large/1.jpg not downloaded yet
2026-03-26 22:47:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/190f38257f44487aa16a30dc5b9b4ec3/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F03eeeb06daaa46428d8e5b90fe4dd13a%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/03eeeb06daaa46428d8e5b90fe4dd13a/images/large/2.jpg not downloaded yet
2026-03-26 22:47:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/190f38257f44487aa16a30dc5b9b4ec3/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F03eeeb06daaa46428d8e5b90fe4dd13a%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/03eeeb06daaa46428d8e5b90fe4dd13a/images/large/3.jpg not downloaded yet
2026-03-26 22:47:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/190f38257f44487aa16a30dc5b9b4ec3/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/190f38257f44487aa16a30dc5b9b4ec3/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/7602ca708c2549bd91dcdd67ba71e636/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F03eeeb06daaa46428d8e5b90fe4dd13a%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/03eeeb06daaa46428d8e5b90fe4dd13a/images/large/4.jpg not downloaded yet
2026-03-26 22:47:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/190f38257f44487aa16a30dc5b9b4ec3/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/7602ca708c2549bd91dcdd67ba71e636/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F03eeeb06daaa46428d8e5b90fe4dd13a%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/03eeeb06daaa46428d8e5b90fe4dd13a/images/large/5.jpg not downloaded yet
2026-03-26 22:47:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/7602ca708c2549bd91dcdd67ba71e636/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F03eeeb06daaa46428d8e5b90fe4dd13a%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/03eeeb06daaa46428d8e5b90fe4dd13a/images/large/6.jpg not downloaded yet
2026-03-26 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F03eeeb06daaa46428d8e5b90fe4dd13a%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/03eeeb06daaa46428d8e5b90fe4dd13a/images/large/7.jpg not downloaded yet
2026-03-26 22:47:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b748ba50>
2026-03-26 22:47:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5180510f-bf8c-5918-b9d0-c59c4af40884/5180510f-bf8c-5918-b9d0-c59c4af40884_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F190f38257f44487aa16a30dc5b9b4ec3%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/190f38257f44487aa16a30dc5b9b4ec3/images/large/6.jpg saved to cache
2026-03-26 22:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5180510f-bf8c-5918-b9d0-c59c4af40884
2026-03-26 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F03eeeb06daaa46428d8e5b90fe4dd13a%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/03eeeb06daaa46428d8e5b90fe4dd13a/images/large/8.jpg not downloaded yet
2026-03-26 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F03eeeb06daaa46428d8e5b90fe4dd13a%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/03eeeb06daaa46428d8e5b90fe4dd13a/images/large/9.jpg not downloaded yet
2026-03-26 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F03eeeb06daaa46428d8e5b90fe4dd13a%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/03eeeb06daaa46428d8e5b90fe4dd13a/images/large/10.jpg not downloaded yet
2026-03-26 22:47:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c950d0>
2026-03-26 22:47:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5180510f-bf8c-5918-b9d0-c59c4af40884/5180510f-bf8c-5918-b9d0-c59c4af40884_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F190f38257f44487aa16a30dc5b9b4ec3%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/190f38257f44487aa16a30dc5b9b4ec3/images/large/7.jpg saved to cache
2026-03-26 22:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5180510f-bf8c-5918-b9d0-c59c4af40884
2026-03-26 22:47:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7ceb4d0>
2026-03-26 22:47:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5180510f-bf8c-5918-b9d0-c59c4af40884/5180510f-bf8c-5918-b9d0-c59c4af40884_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F190f38257f44487aa16a30dc5b9b4ec3%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/190f38257f44487aa16a30dc5b9b4ec3/images/large/8.jpg saved to cache
2026-03-26 22:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5180510f-bf8c-5918-b9d0-c59c4af40884
2026-03-26 22:47:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7591c50>
2026-03-26 22:47:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5180510f-bf8c-5918-b9d0-c59c4af40884/5180510f-bf8c-5918-b9d0-c59c4af40884_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F190f38257f44487aa16a30dc5b9b4ec3%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/190f38257f44487aa16a30dc5b9b4ec3/images/large/9.jpg saved to cache
2026-03-26 22:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5180510f-bf8c-5918-b9d0-c59c4af40884
2026-03-26 22:47:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74dfbd0>
2026-03-26 22:47:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b90900cd-b928-549e-9757-b894d285e993/b90900cd-b928-549e-9757-b894d285e993_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F7602ca708c2549bd91dcdd67ba71e636%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/7602ca708c2549bd91dcdd67ba71e636/images/large/3.jpg saved to cache
2026-03-26 22:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b90900cd-b928-549e-9757-b894d285e993
2026-03-26 22:47:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e36e10>
2026-03-26 22:47:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5180510f-bf8c-5918-b9d0-c59c4af40884/5180510f-bf8c-5918-b9d0-c59c4af40884_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F190f38257f44487aa16a30dc5b9b4ec3%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/190f38257f44487aa16a30dc5b9b4ec3/images/large/10.jpg saved to cache
2026-03-26 22:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5180510f-bf8c-5918-b9d0-c59c4af40884
2026-03-26 22:47:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5180510f-bf8c-5918-b9d0-c59c4af40884, skipping ID generation
2026-03-26 22:47:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5180510f-bf8c-5918-b9d0-c59c4af40884 with scrape type 1
2026-03-26 22:47:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5180510f-bf8c-5918-b9d0-c59c4af40884 sending to next pipeline
2026-03-26 22:47:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 5180510f-bf8c-5918-b9d0-c59c4af40884, identifier: 1986092
2026-03-26 22:47:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c680d0>
2026-03-26 22:47:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b90900cd-b928-549e-9757-b894d285e993/b90900cd-b928-549e-9757-b894d285e993_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F7602ca708c2549bd91dcdd67ba71e636%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/7602ca708c2549bd91dcdd67ba71e636/images/large/1.jpg saved to cache
2026-03-26 22:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b90900cd-b928-549e-9757-b894d285e993
2026-03-26 22:47:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7404910>
2026-03-26 22:47:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b90900cd-b928-549e-9757-b894d285e993/b90900cd-b928-549e-9757-b894d285e993_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F7602ca708c2549bd91dcdd67ba71e636%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/7602ca708c2549bd91dcdd67ba71e636/images/large/2.jpg saved to cache
2026-03-26 22:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b90900cd-b928-549e-9757-b894d285e993
2026-03-26 22:47:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 5180510f-bf8c-5918-b9d0-c59c4af40884 with identifier: 1986092
2026-03-26 22:47:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 5180510f-bf8c-5918-b9d0-c59c4af40884 with identifier: 1986092
2026-03-26 22:47:19 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 5180510f-bf8c-5918-b9d0-c59c4af40884 with identifier: 1986092 to the API
2026-03-26 22:47:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:47:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:47:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ab/190f38257f44487aa16a30dc5b9b4ec3/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '5180510f-bf8c-5918-b9d0-c59c4af40884',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLE COUPAu2030',
 'odometer': 108986,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5180510f-bf8c-5918-b9d0-c59c4af40884/5180510f-bf8c-5918-b9d0-c59c4af40884_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 689590,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/190f38257f44487aa16a30dc5b9b4ec3/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5180510f-bf8c-5918-b9d0-c59c4af40884/5180510f-bf8c-5918-b9d0-c59c4af40884_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 699639,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/190f38257f44487aa16a30dc5b9b4ec3/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5180510f-bf8c-5918-b9d0-c59c4af40884/5180510f-bf8c-5918-b9d0-c59c4af40884_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 696909,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/190f38257f44487aa16a30dc5b9b4ec3/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5180510f-bf8c-5918-b9d0-c59c4af40884/5180510f-bf8c-5918-b9d0-c59c4af40884_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 709160,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/190f38257f44487aa16a30dc5b9b4ec3/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5180510f-bf8c-5918-b9d0-c59c4af40884/5180510f-bf8c-5918-b9d0-c59c4af40884_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 680598,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/190f38257f44487aa16a30dc5b9b4ec3/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5180510f-bf8c-5918-b9d0-c59c4af40884/5180510f-bf8c-5918-b9d0-c59c4af40884_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 760541,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/190f38257f44487aa16a30dc5b9b4ec3/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5180510f-bf8c-5918-b9d0-c59c4af40884/5180510f-bf8c-5918-b9d0-c59c4af40884_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 634538,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/190f38257f44487aa16a30dc5b9b4ec3/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5180510f-bf8c-5918-b9d0-c59c4af40884/5180510f-bf8c-5918-b9d0-c59c4af40884_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 882737,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/190f38257f44487aa16a30dc5b9b4ec3/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5180510f-bf8c-5918-b9d0-c59c4af40884/5180510f-bf8c-5918-b9d0-c59c4af40884_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 847419,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/190f38257f44487aa16a30dc5b9b4ec3/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5180510f-bf8c-5918-b9d0-c59c4af40884/5180510f-bf8c-5918-b9d0-c59c4af40884_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 845730,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/190f38257f44487aa16a30dc5b9b4ec3/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLE COUPAu2030 2.0 GLE 350 DE 4MATIC 4WD AUTO',
 'transmission': 'automatic',
 'trim': '2.0 GLE 350 DE 4MATIC 4WD AUTO',
 'vin': None,
 'year': 2021}
2026-03-26 22:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986092%27 HTTP/1.1" 200 None
2026-03-26 22:47:20 [ayvens.be] INFO: Saving data for 1986092: {'created_time': 1774565240.064697, 'last_price_update_time': 1774565240.064706, 'auction_closing_time': 1775028600.0}
2026-03-26 22:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986092') HTTP/1.1" 204 0
2026-03-26 22:47:20 [ayvens.be] INFO: Found listing with ID: 1986095
2026-03-26 22:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986095%27 HTTP/1.1" 200 None
2026-03-26 22:47:20 [ayvens.be] INFO: Scrape type for 1986095: 1
2026-03-26 22:47:20 [ayvens.be] INFO: Extracting data for car ID: 1986095
2026-03-26 22:47:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 61b6d6b6-83de-527e-a30b-7d1dcea0a6a2 with identifier: 1986095
2026-03-26 22:47:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61b6d6b6-83de-527e-a30b-7d1dcea0a6a2 with scrape type 1
2026-03-26 22:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 61b6d6b6-83de-527e-a30b-7d1dcea0a6a2
2026-03-26 22:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fb9637912dc054098a3db21ea8cb813e0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/b9637912dc054098a3db21ea8cb813e0/images/large/1.jpg not downloaded yet
2026-03-26 22:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fb9637912dc054098a3db21ea8cb813e0%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/b9637912dc054098a3db21ea8cb813e0/images/large/2.jpg not downloaded yet
2026-03-26 22:47:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/03eeeb06daaa46428d8e5b90fe4dd13a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fb9637912dc054098a3db21ea8cb813e0%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/b9637912dc054098a3db21ea8cb813e0/images/large/3.jpg not downloaded yet
2026-03-26 22:47:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/7602ca708c2549bd91dcdd67ba71e636/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/7602ca708c2549bd91dcdd67ba71e636/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/7602ca708c2549bd91dcdd67ba71e636/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/7602ca708c2549bd91dcdd67ba71e636/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/7602ca708c2549bd91dcdd67ba71e636/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fb9637912dc054098a3db21ea8cb813e0%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/b9637912dc054098a3db21ea8cb813e0/images/large/4.jpg not downloaded yet
2026-03-26 22:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fb9637912dc054098a3db21ea8cb813e0%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/b9637912dc054098a3db21ea8cb813e0/images/large/5.jpg not downloaded yet
2026-03-26 22:47:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/7602ca708c2549bd91dcdd67ba71e636/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fb9637912dc054098a3db21ea8cb813e0%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/b9637912dc054098a3db21ea8cb813e0/images/large/6.jpg not downloaded yet
2026-03-26 22:47:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/7602ca708c2549bd91dcdd67ba71e636/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fb9637912dc054098a3db21ea8cb813e0%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/b9637912dc054098a3db21ea8cb813e0/images/large/7.jpg not downloaded yet
2026-03-26 22:47:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6d73c10>
2026-03-26 22:47:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2210c3c3-db88-5842-8418-cbfbdbf20245/2210c3c3-db88-5842-8418-cbfbdbf20245_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F03eeeb06daaa46428d8e5b90fe4dd13a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/03eeeb06daaa46428d8e5b90fe4dd13a/images/large/1.jpg saved to cache
2026-03-26 22:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2210c3c3-db88-5842-8418-cbfbdbf20245
2026-03-26 22:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fb9637912dc054098a3db21ea8cb813e0%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/b9637912dc054098a3db21ea8cb813e0/images/large/8.jpg not downloaded yet
2026-03-26 22:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fb9637912dc054098a3db21ea8cb813e0%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/b9637912dc054098a3db21ea8cb813e0/images/large/9.jpg not downloaded yet
2026-03-26 22:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fb9637912dc054098a3db21ea8cb813e0%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/b9637912dc054098a3db21ea8cb813e0/images/large/10.jpg not downloaded yet
2026-03-26 22:47:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd0d09d0>
2026-03-26 22:47:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b90900cd-b928-549e-9757-b894d285e993/b90900cd-b928-549e-9757-b894d285e993_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F7602ca708c2549bd91dcdd67ba71e636%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/7602ca708c2549bd91dcdd67ba71e636/images/large/5.jpg saved to cache
2026-03-26 22:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b90900cd-b928-549e-9757-b894d285e993
2026-03-26 22:47:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79f1350>
2026-03-26 22:47:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b90900cd-b928-549e-9757-b894d285e993/b90900cd-b928-549e-9757-b894d285e993_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F7602ca708c2549bd91dcdd67ba71e636%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/7602ca708c2549bd91dcdd67ba71e636/images/large/6.jpg saved to cache
2026-03-26 22:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b90900cd-b928-549e-9757-b894d285e993
2026-03-26 22:47:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e34710>
2026-03-26 22:47:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b90900cd-b928-549e-9757-b894d285e993/b90900cd-b928-549e-9757-b894d285e993_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F7602ca708c2549bd91dcdd67ba71e636%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/7602ca708c2549bd91dcdd67ba71e636/images/large/7.jpg saved to cache
2026-03-26 22:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b90900cd-b928-549e-9757-b894d285e993
2026-03-26 22:47:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79fa650>
2026-03-26 22:47:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b90900cd-b928-549e-9757-b894d285e993/b90900cd-b928-549e-9757-b894d285e993_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F7602ca708c2549bd91dcdd67ba71e636%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/7602ca708c2549bd91dcdd67ba71e636/images/large/9.jpg saved to cache
2026-03-26 22:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b90900cd-b928-549e-9757-b894d285e993
2026-03-26 22:47:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7278910>
2026-03-26 22:47:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b90900cd-b928-549e-9757-b894d285e993/b90900cd-b928-549e-9757-b894d285e993_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F7602ca708c2549bd91dcdd67ba71e636%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/7602ca708c2549bd91dcdd67ba71e636/images/large/10.jpg saved to cache
2026-03-26 22:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b90900cd-b928-549e-9757-b894d285e993
2026-03-26 22:47:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79fb6d0>
2026-03-26 22:47:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b90900cd-b928-549e-9757-b894d285e993/b90900cd-b928-549e-9757-b894d285e993_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F7602ca708c2549bd91dcdd67ba71e636%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/7602ca708c2549bd91dcdd67ba71e636/images/large/8.jpg saved to cache
2026-03-26 22:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b90900cd-b928-549e-9757-b894d285e993
2026-03-26 22:47:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79f1b10>
2026-03-26 22:47:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b90900cd-b928-549e-9757-b894d285e993/b90900cd-b928-549e-9757-b894d285e993_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F7602ca708c2549bd91dcdd67ba71e636%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/7602ca708c2549bd91dcdd67ba71e636/images/large/4.jpg saved to cache
2026-03-26 22:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b90900cd-b928-549e-9757-b894d285e993
2026-03-26 22:47:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b90900cd-b928-549e-9757-b894d285e993, skipping ID generation
2026-03-26 22:47:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b90900cd-b928-549e-9757-b894d285e993 with scrape type 1
2026-03-26 22:47:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b90900cd-b928-549e-9757-b894d285e993 sending to next pipeline
2026-03-26 22:47:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b90900cd-b928-549e-9757-b894d285e993, identifier: 1986093
2026-03-26 22:47:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b90900cd-b928-549e-9757-b894d285e993 with identifier: 1986093
2026-03-26 22:47:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b90900cd-b928-549e-9757-b894d285e993 with identifier: 1986093
2026-03-26 22:47:21 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b90900cd-b928-549e-9757-b894d285e993 with identifier: 1986093 to the API
2026-03-26 22:47:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:47:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:47:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bh/7602ca708c2549bd91dcdd67ba71e636/images/large/4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'b90900cd-b928-549e-9757-b894d285e993',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLB',
 'odometer': 133565,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b90900cd-b928-549e-9757-b894d285e993/b90900cd-b928-549e-9757-b894d285e993_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 737391,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/7602ca708c2549bd91dcdd67ba71e636/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b90900cd-b928-549e-9757-b894d285e993/b90900cd-b928-549e-9757-b894d285e993_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 754952,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/7602ca708c2549bd91dcdd67ba71e636/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b90900cd-b928-549e-9757-b894d285e993/b90900cd-b928-549e-9757-b894d285e993_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 747690,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/7602ca708c2549bd91dcdd67ba71e636/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b90900cd-b928-549e-9757-b894d285e993/b90900cd-b928-549e-9757-b894d285e993_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 768925,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/7602ca708c2549bd91dcdd67ba71e636/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b90900cd-b928-549e-9757-b894d285e993/b90900cd-b928-549e-9757-b894d285e993_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 733343,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/7602ca708c2549bd91dcdd67ba71e636/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b90900cd-b928-549e-9757-b894d285e993/b90900cd-b928-549e-9757-b894d285e993_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 775449,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/7602ca708c2549bd91dcdd67ba71e636/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b90900cd-b928-549e-9757-b894d285e993/b90900cd-b928-549e-9757-b894d285e993_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 682558,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/7602ca708c2549bd91dcdd67ba71e636/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b90900cd-b928-549e-9757-b894d285e993/b90900cd-b928-549e-9757-b894d285e993_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 790315,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/7602ca708c2549bd91dcdd67ba71e636/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b90900cd-b928-549e-9757-b894d285e993/b90900cd-b928-549e-9757-b894d285e993_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 781568,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/7602ca708c2549bd91dcdd67ba71e636/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b90900cd-b928-549e-9757-b894d285e993/b90900cd-b928-549e-9757-b894d285e993_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 759994,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/7602ca708c2549bd91dcdd67ba71e636/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLB 2.0 GLB 180 D BUSINESS SOLUTION',
 'transmission': 'automatic',
 'trim': '2.0 GLB 180 D BUSINESS SOLUTION',
 'vin': None,
 'year': 2021}
2026-03-26 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986093%27 HTTP/1.1" 200 None
2026-03-26 22:47:21 [ayvens.be] INFO: Saving data for 1986093: {'created_time': 1774565241.593402, 'last_price_update_time': 1774565241.593412, 'auction_closing_time': 1775028600.0}
2026-03-26 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986093') HTTP/1.1" 204 0
2026-03-26 22:47:21 [ayvens.be] INFO: Found listing with ID: 1986096
2026-03-26 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986096%27 HTTP/1.1" 200 None
2026-03-26 22:47:21 [ayvens.be] INFO: Scrape type for 1986096: 1
2026-03-26 22:47:21 [ayvens.be] INFO: Extracting data for car ID: 1986096
2026-03-26 22:47:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fda00ae2-cb85-5aaf-8fae-4fc7773133b1 with identifier: 1986096
2026-03-26 22:47:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fda00ae2-cb85-5aaf-8fae-4fc7773133b1 with scrape type 1
2026-03-26 22:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fda00ae2-cb85-5aaf-8fae-4fc7773133b1
2026-03-26 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dw%252F66be59447e6d4eed9e9c717c747f5eb9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dw/66be59447e6d4eed9e9c717c747f5eb9/images/large/1.jpg not downloaded yet
2026-03-26 22:47:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/b9637912dc054098a3db21ea8cb813e0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dw%252F66be59447e6d4eed9e9c717c747f5eb9%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dw/66be59447e6d4eed9e9c717c747f5eb9/images/large/2.jpg not downloaded yet
2026-03-26 22:47:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/03eeeb06daaa46428d8e5b90fe4dd13a/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dw%252F66be59447e6d4eed9e9c717c747f5eb9%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dw/66be59447e6d4eed9e9c717c747f5eb9/images/large/3.jpg not downloaded yet
2026-03-26 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dw%252F66be59447e6d4eed9e9c717c747f5eb9%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dw/66be59447e6d4eed9e9c717c747f5eb9/images/large/4.jpg not downloaded yet
2026-03-26 22:47:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/03eeeb06daaa46428d8e5b90fe4dd13a/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/03eeeb06daaa46428d8e5b90fe4dd13a/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/03eeeb06daaa46428d8e5b90fe4dd13a/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dw%252F66be59447e6d4eed9e9c717c747f5eb9%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dw/66be59447e6d4eed9e9c717c747f5eb9/images/large/5.jpg not downloaded yet
2026-03-26 22:47:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/03eeeb06daaa46428d8e5b90fe4dd13a/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dw%252F66be59447e6d4eed9e9c717c747f5eb9%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dw/66be59447e6d4eed9e9c717c747f5eb9/images/large/6.jpg not downloaded yet
2026-03-26 22:47:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/03eeeb06daaa46428d8e5b90fe4dd13a/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dw%252F66be59447e6d4eed9e9c717c747f5eb9%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dw/66be59447e6d4eed9e9c717c747f5eb9/images/large/7.jpg not downloaded yet
2026-03-26 22:47:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79d4510>
2026-03-26 22:47:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61b6d6b6-83de-527e-a30b-7d1dcea0a6a2/61b6d6b6-83de-527e-a30b-7d1dcea0a6a2_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fb9637912dc054098a3db21ea8cb813e0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/b9637912dc054098a3db21ea8cb813e0/images/large/1.jpg saved to cache
2026-03-26 22:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 61b6d6b6-83de-527e-a30b-7d1dcea0a6a2
2026-03-26 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dw%252F66be59447e6d4eed9e9c717c747f5eb9%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dw/66be59447e6d4eed9e9c717c747f5eb9/images/large/8.jpg not downloaded yet
2026-03-26 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dw%252F66be59447e6d4eed9e9c717c747f5eb9%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dw/66be59447e6d4eed9e9c717c747f5eb9/images/large/9.jpg not downloaded yet
2026-03-26 22:47:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76a6950>
2026-03-26 22:47:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2210c3c3-db88-5842-8418-cbfbdbf20245/2210c3c3-db88-5842-8418-cbfbdbf20245_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F03eeeb06daaa46428d8e5b90fe4dd13a%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/03eeeb06daaa46428d8e5b90fe4dd13a/images/large/7.jpg saved to cache
2026-03-26 22:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2210c3c3-db88-5842-8418-cbfbdbf20245
2026-03-26 22:47:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7565190>
2026-03-26 22:47:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2210c3c3-db88-5842-8418-cbfbdbf20245/2210c3c3-db88-5842-8418-cbfbdbf20245_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F03eeeb06daaa46428d8e5b90fe4dd13a%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/03eeeb06daaa46428d8e5b90fe4dd13a/images/large/6.jpg saved to cache
2026-03-26 22:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2210c3c3-db88-5842-8418-cbfbdbf20245
2026-03-26 22:47:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7449850>
2026-03-26 22:47:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2210c3c3-db88-5842-8418-cbfbdbf20245/2210c3c3-db88-5842-8418-cbfbdbf20245_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F03eeeb06daaa46428d8e5b90fe4dd13a%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/03eeeb06daaa46428d8e5b90fe4dd13a/images/large/10.jpg saved to cache
2026-03-26 22:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2210c3c3-db88-5842-8418-cbfbdbf20245
2026-03-26 22:47:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76a6490>
2026-03-26 22:47:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2210c3c3-db88-5842-8418-cbfbdbf20245/2210c3c3-db88-5842-8418-cbfbdbf20245_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F03eeeb06daaa46428d8e5b90fe4dd13a%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/03eeeb06daaa46428d8e5b90fe4dd13a/images/large/3.jpg saved to cache
2026-03-26 22:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2210c3c3-db88-5842-8418-cbfbdbf20245
2026-03-26 22:47:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7566950>
2026-03-26 22:47:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2210c3c3-db88-5842-8418-cbfbdbf20245/2210c3c3-db88-5842-8418-cbfbdbf20245_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F03eeeb06daaa46428d8e5b90fe4dd13a%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/03eeeb06daaa46428d8e5b90fe4dd13a/images/large/2.jpg saved to cache
2026-03-26 22:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2210c3c3-db88-5842-8418-cbfbdbf20245
2026-03-26 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dw%252F66be59447e6d4eed9e9c717c747f5eb9%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dw/66be59447e6d4eed9e9c717c747f5eb9/images/large/10.jpg not downloaded yet
2026-03-26 22:47:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd0cf990>
2026-03-26 22:47:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2210c3c3-db88-5842-8418-cbfbdbf20245/2210c3c3-db88-5842-8418-cbfbdbf20245_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F03eeeb06daaa46428d8e5b90fe4dd13a%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/03eeeb06daaa46428d8e5b90fe4dd13a/images/large/8.jpg saved to cache
2026-03-26 22:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2210c3c3-db88-5842-8418-cbfbdbf20245
2026-03-26 22:47:22 [ayvens.be] INFO: Found listing with ID: 1986097
2026-03-26 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986097%27 HTTP/1.1" 200 None
2026-03-26 22:47:22 [ayvens.be] INFO: Scrape type for 1986097: 1
2026-03-26 22:47:22 [ayvens.be] INFO: Extracting data for car ID: 1986097
2026-03-26 22:47:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b897af89-92d5-5fd7-96fb-123d33a94a50 with identifier: 1986097
2026-03-26 22:47:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b897af89-92d5-5fd7-96fb-123d33a94a50 with scrape type 1
2026-03-26 22:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b897af89-92d5-5fd7-96fb-123d33a94a50
2026-03-26 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fce8f75c04693462aa0f9ffb661e19a57%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/ce8f75c04693462aa0f9ffb661e19a57/images/large/1.jpg not downloaded yet
2026-03-26 22:47:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/b9637912dc054098a3db21ea8cb813e0/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fce8f75c04693462aa0f9ffb661e19a57%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/ce8f75c04693462aa0f9ffb661e19a57/images/large/2.jpg not downloaded yet
2026-03-26 22:47:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/03eeeb06daaa46428d8e5b90fe4dd13a/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/b9637912dc054098a3db21ea8cb813e0/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fce8f75c04693462aa0f9ffb661e19a57%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/ce8f75c04693462aa0f9ffb661e19a57/images/large/3.jpg not downloaded yet
2026-03-26 22:47:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dw/66be59447e6d4eed9e9c717c747f5eb9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fce8f75c04693462aa0f9ffb661e19a57%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/ce8f75c04693462aa0f9ffb661e19a57/images/large/4.jpg not downloaded yet
2026-03-26 22:47:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/b9637912dc054098a3db21ea8cb813e0/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/b9637912dc054098a3db21ea8cb813e0/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/03eeeb06daaa46428d8e5b90fe4dd13a/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fce8f75c04693462aa0f9ffb661e19a57%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/ce8f75c04693462aa0f9ffb661e19a57/images/large/5.jpg not downloaded yet
2026-03-26 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fce8f75c04693462aa0f9ffb661e19a57%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/ce8f75c04693462aa0f9ffb661e19a57/images/large/6.jpg not downloaded yet
2026-03-26 22:47:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/03eeeb06daaa46428d8e5b90fe4dd13a/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fce8f75c04693462aa0f9ffb661e19a57%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/ce8f75c04693462aa0f9ffb661e19a57/images/large/7.jpg not downloaded yet
2026-03-26 22:47:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7649cd0>
2026-03-26 22:47:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61b6d6b6-83de-527e-a30b-7d1dcea0a6a2/61b6d6b6-83de-527e-a30b-7d1dcea0a6a2_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fb9637912dc054098a3db21ea8cb813e0%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/b9637912dc054098a3db21ea8cb813e0/images/large/2.jpg saved to cache
2026-03-26 22:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 61b6d6b6-83de-527e-a30b-7d1dcea0a6a2
2026-03-26 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fce8f75c04693462aa0f9ffb661e19a57%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/ce8f75c04693462aa0f9ffb661e19a57/images/large/8.jpg not downloaded yet
2026-03-26 22:47:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7475d50>
2026-03-26 22:47:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2210c3c3-db88-5842-8418-cbfbdbf20245/2210c3c3-db88-5842-8418-cbfbdbf20245_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F03eeeb06daaa46428d8e5b90fe4dd13a%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/03eeeb06daaa46428d8e5b90fe4dd13a/images/large/5.jpg saved to cache
2026-03-26 22:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2210c3c3-db88-5842-8418-cbfbdbf20245
2026-03-26 22:47:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7448310>
2026-03-26 22:47:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61b6d6b6-83de-527e-a30b-7d1dcea0a6a2/61b6d6b6-83de-527e-a30b-7d1dcea0a6a2_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fb9637912dc054098a3db21ea8cb813e0%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/b9637912dc054098a3db21ea8cb813e0/images/large/4.jpg saved to cache
2026-03-26 22:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 61b6d6b6-83de-527e-a30b-7d1dcea0a6a2
2026-03-26 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fce8f75c04693462aa0f9ffb661e19a57%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/ce8f75c04693462aa0f9ffb661e19a57/images/large/9.jpg not downloaded yet
2026-03-26 22:47:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/b9637912dc054098a3db21ea8cb813e0/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fce8f75c04693462aa0f9ffb661e19a57%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/ce8f75c04693462aa0f9ffb661e19a57/images/large/10.jpg not downloaded yet
2026-03-26 22:47:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b35d10>
2026-03-26 22:47:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fda00ae2-cb85-5aaf-8fae-4fc7773133b1/fda00ae2-cb85-5aaf-8fae-4fc7773133b1_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dw%252F66be59447e6d4eed9e9c717c747f5eb9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dw/66be59447e6d4eed9e9c717c747f5eb9/images/large/1.jpg saved to cache
2026-03-26 22:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fda00ae2-cb85-5aaf-8fae-4fc7773133b1
2026-03-26 22:47:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c5ee90>
2026-03-26 22:47:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61b6d6b6-83de-527e-a30b-7d1dcea0a6a2/61b6d6b6-83de-527e-a30b-7d1dcea0a6a2_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fb9637912dc054098a3db21ea8cb813e0%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/b9637912dc054098a3db21ea8cb813e0/images/large/3.jpg saved to cache
2026-03-26 22:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 61b6d6b6-83de-527e-a30b-7d1dcea0a6a2
2026-03-26 22:47:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7440410>
2026-03-26 22:47:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61b6d6b6-83de-527e-a30b-7d1dcea0a6a2/61b6d6b6-83de-527e-a30b-7d1dcea0a6a2_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fb9637912dc054098a3db21ea8cb813e0%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/b9637912dc054098a3db21ea8cb813e0/images/large/10.jpg saved to cache
2026-03-26 22:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 61b6d6b6-83de-527e-a30b-7d1dcea0a6a2
2026-03-26 22:47:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e2b190>
2026-03-26 22:47:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2210c3c3-db88-5842-8418-cbfbdbf20245/2210c3c3-db88-5842-8418-cbfbdbf20245_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F03eeeb06daaa46428d8e5b90fe4dd13a%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/03eeeb06daaa46428d8e5b90fe4dd13a/images/large/4.jpg saved to cache
2026-03-26 22:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2210c3c3-db88-5842-8418-cbfbdbf20245
2026-03-26 22:47:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7747950>
2026-03-26 22:47:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2210c3c3-db88-5842-8418-cbfbdbf20245/2210c3c3-db88-5842-8418-cbfbdbf20245_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F03eeeb06daaa46428d8e5b90fe4dd13a%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/03eeeb06daaa46428d8e5b90fe4dd13a/images/large/9.jpg saved to cache
2026-03-26 22:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2210c3c3-db88-5842-8418-cbfbdbf20245
2026-03-26 22:47:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2210c3c3-db88-5842-8418-cbfbdbf20245, skipping ID generation
2026-03-26 22:47:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2210c3c3-db88-5842-8418-cbfbdbf20245 with scrape type 1
2026-03-26 22:47:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2210c3c3-db88-5842-8418-cbfbdbf20245 sending to next pipeline
2026-03-26 22:47:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 2210c3c3-db88-5842-8418-cbfbdbf20245, identifier: 1986094
2026-03-26 22:47:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 2210c3c3-db88-5842-8418-cbfbdbf20245 with identifier: 1986094
2026-03-26 22:47:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 2210c3c3-db88-5842-8418-cbfbdbf20245 with identifier: 1986094
2026-03-26 22:47:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 2210c3c3-db88-5842-8418-cbfbdbf20245 with identifier: 1986094 to the API
2026-03-26 22:47:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:47:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:47:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ab/03eeeb06daaa46428d8e5b90fe4dd13a/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '2210c3c3-db88-5842-8418-cbfbdbf20245',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 147472,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2210c3c3-db88-5842-8418-cbfbdbf20245/2210c3c3-db88-5842-8418-cbfbdbf20245_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 646743,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/03eeeb06daaa46428d8e5b90fe4dd13a/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2210c3c3-db88-5842-8418-cbfbdbf20245/2210c3c3-db88-5842-8418-cbfbdbf20245_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 678096,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/03eeeb06daaa46428d8e5b90fe4dd13a/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2210c3c3-db88-5842-8418-cbfbdbf20245/2210c3c3-db88-5842-8418-cbfbdbf20245_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 660401,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/03eeeb06daaa46428d8e5b90fe4dd13a/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2210c3c3-db88-5842-8418-cbfbdbf20245/2210c3c3-db88-5842-8418-cbfbdbf20245_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 659889,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/03eeeb06daaa46428d8e5b90fe4dd13a/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2210c3c3-db88-5842-8418-cbfbdbf20245/2210c3c3-db88-5842-8418-cbfbdbf20245_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 643780,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/03eeeb06daaa46428d8e5b90fe4dd13a/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2210c3c3-db88-5842-8418-cbfbdbf20245/2210c3c3-db88-5842-8418-cbfbdbf20245_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 709768,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/03eeeb06daaa46428d8e5b90fe4dd13a/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2210c3c3-db88-5842-8418-cbfbdbf20245/2210c3c3-db88-5842-8418-cbfbdbf20245_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 644043,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/03eeeb06daaa46428d8e5b90fe4dd13a/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2210c3c3-db88-5842-8418-cbfbdbf20245/2210c3c3-db88-5842-8418-cbfbdbf20245_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 852676,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/03eeeb06daaa46428d8e5b90fe4dd13a/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2210c3c3-db88-5842-8418-cbfbdbf20245/2210c3c3-db88-5842-8418-cbfbdbf20245_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 817380,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/03eeeb06daaa46428d8e5b90fe4dd13a/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2210c3c3-db88-5842-8418-cbfbdbf20245/2210c3c3-db88-5842-8418-cbfbdbf20245_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 885699,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/03eeeb06daaa46428d8e5b90fe4dd13a/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T4 RECHARGE GEARTR. INSCRIPTION EXPR',
 'transmission': 'automatic',
 'trim': '1.5 T4 RECHARGE GEARTR. INSCRIPTION EXPR',
 'vin': None,
 'year': 2021}
2026-03-26 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986094%27 HTTP/1.1" 200 None
2026-03-26 22:47:24 [ayvens.be] INFO: Saving data for 1986094: {'created_time': 1774565244.037265, 'last_price_update_time': 1774565244.037275, 'auction_closing_time': 1775028600.0}
2026-03-26 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986094') HTTP/1.1" 204 0
2026-03-26 22:47:24 [ayvens.be] INFO: Found listing with ID: 1986098
2026-03-26 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986098%27 HTTP/1.1" 200 None
2026-03-26 22:47:24 [ayvens.be] INFO: Scrape type for 1986098: 1
2026-03-26 22:47:24 [ayvens.be] INFO: Extracting data for car ID: 1986098
2026-03-26 22:47:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de3c7f05-fd73-53d0-9829-e3d2e4cb7d36 with identifier: 1986098
2026-03-26 22:47:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de3c7f05-fd73-53d0-9829-e3d2e4cb7d36 with scrape type 1
2026-03-26 22:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item de3c7f05-fd73-53d0-9829-e3d2e4cb7d36
2026-03-26 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xt%252Ffb54aba33b344a77acb87b1d483a39f6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xt/fb54aba33b344a77acb87b1d483a39f6/images/large/1.jpg not downloaded yet
2026-03-26 22:47:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/b9637912dc054098a3db21ea8cb813e0/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xt%252Ffb54aba33b344a77acb87b1d483a39f6%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xt/fb54aba33b344a77acb87b1d483a39f6/images/large/2.jpg not downloaded yet
2026-03-26 22:47:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dw/66be59447e6d4eed9e9c717c747f5eb9/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77eac90>
2026-03-26 22:47:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61b6d6b6-83de-527e-a30b-7d1dcea0a6a2/61b6d6b6-83de-527e-a30b-7d1dcea0a6a2_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fb9637912dc054098a3db21ea8cb813e0%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/b9637912dc054098a3db21ea8cb813e0/images/large/9.jpg saved to cache
2026-03-26 22:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 61b6d6b6-83de-527e-a30b-7d1dcea0a6a2
2026-03-26 22:47:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dw/66be59447e6d4eed9e9c717c747f5eb9/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dw/66be59447e6d4eed9e9c717c747f5eb9/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xt%252Ffb54aba33b344a77acb87b1d483a39f6%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xt/fb54aba33b344a77acb87b1d483a39f6/images/large/3.jpg not downloaded yet
2026-03-26 22:47:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dw/66be59447e6d4eed9e9c717c747f5eb9/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xt%252Ffb54aba33b344a77acb87b1d483a39f6%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xt/fb54aba33b344a77acb87b1d483a39f6/images/large/4.jpg not downloaded yet
2026-03-26 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xt%252Ffb54aba33b344a77acb87b1d483a39f6%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xt/fb54aba33b344a77acb87b1d483a39f6/images/large/5.jpg not downloaded yet
2026-03-26 22:47:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/ce8f75c04693462aa0f9ffb661e19a57/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77d4190>
2026-03-26 22:47:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61b6d6b6-83de-527e-a30b-7d1dcea0a6a2/61b6d6b6-83de-527e-a30b-7d1dcea0a6a2_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fb9637912dc054098a3db21ea8cb813e0%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/b9637912dc054098a3db21ea8cb813e0/images/large/8.jpg saved to cache
2026-03-26 22:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 61b6d6b6-83de-527e-a30b-7d1dcea0a6a2
2026-03-26 22:47:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dw/66be59447e6d4eed9e9c717c747f5eb9/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/b9637912dc054098a3db21ea8cb813e0/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xt%252Ffb54aba33b344a77acb87b1d483a39f6%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xt/fb54aba33b344a77acb87b1d483a39f6/images/large/6.jpg not downloaded yet
2026-03-26 22:47:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76cd850>
2026-03-26 22:47:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fda00ae2-cb85-5aaf-8fae-4fc7773133b1/fda00ae2-cb85-5aaf-8fae-4fc7773133b1_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dw%252F66be59447e6d4eed9e9c717c747f5eb9%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dw/66be59447e6d4eed9e9c717c747f5eb9/images/large/2.jpg saved to cache
2026-03-26 22:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fda00ae2-cb85-5aaf-8fae-4fc7773133b1
2026-03-26 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xt%252Ffb54aba33b344a77acb87b1d483a39f6%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xt/fb54aba33b344a77acb87b1d483a39f6/images/large/7.jpg not downloaded yet
2026-03-26 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xt%252Ffb54aba33b344a77acb87b1d483a39f6%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xt/fb54aba33b344a77acb87b1d483a39f6/images/large/8.jpg not downloaded yet
2026-03-26 22:47:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd0c4f50>
2026-03-26 22:47:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fda00ae2-cb85-5aaf-8fae-4fc7773133b1/fda00ae2-cb85-5aaf-8fae-4fc7773133b1_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dw%252F66be59447e6d4eed9e9c717c747f5eb9%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dw/66be59447e6d4eed9e9c717c747f5eb9/images/large/3.jpg saved to cache
2026-03-26 22:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fda00ae2-cb85-5aaf-8fae-4fc7773133b1
2026-03-26 22:47:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e44dd0>
2026-03-26 22:47:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fda00ae2-cb85-5aaf-8fae-4fc7773133b1/fda00ae2-cb85-5aaf-8fae-4fc7773133b1_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dw%252F66be59447e6d4eed9e9c717c747f5eb9%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dw/66be59447e6d4eed9e9c717c747f5eb9/images/large/8.jpg saved to cache
2026-03-26 22:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fda00ae2-cb85-5aaf-8fae-4fc7773133b1
2026-03-26 22:47:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e450d0>
2026-03-26 22:47:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fda00ae2-cb85-5aaf-8fae-4fc7773133b1/fda00ae2-cb85-5aaf-8fae-4fc7773133b1_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dw%252F66be59447e6d4eed9e9c717c747f5eb9%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dw/66be59447e6d4eed9e9c717c747f5eb9/images/large/4.jpg saved to cache
2026-03-26 22:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fda00ae2-cb85-5aaf-8fae-4fc7773133b1
2026-03-26 22:47:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b726ba50>
2026-03-26 22:47:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b897af89-92d5-5fd7-96fb-123d33a94a50/b897af89-92d5-5fd7-96fb-123d33a94a50_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fce8f75c04693462aa0f9ffb661e19a57%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/ce8f75c04693462aa0f9ffb661e19a57/images/large/1.jpg saved to cache
2026-03-26 22:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b897af89-92d5-5fd7-96fb-123d33a94a50
2026-03-26 22:47:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dw/66be59447e6d4eed9e9c717c747f5eb9/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xt%252Ffb54aba33b344a77acb87b1d483a39f6%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xt/fb54aba33b344a77acb87b1d483a39f6/images/large/9.jpg not downloaded yet
2026-03-26 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xt%252Ffb54aba33b344a77acb87b1d483a39f6%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xt/fb54aba33b344a77acb87b1d483a39f6/images/large/10.jpg not downloaded yet
2026-03-26 22:47:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76a78d0>
2026-03-26 22:47:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fda00ae2-cb85-5aaf-8fae-4fc7773133b1/fda00ae2-cb85-5aaf-8fae-4fc7773133b1_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dw%252F66be59447e6d4eed9e9c717c747f5eb9%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dw/66be59447e6d4eed9e9c717c747f5eb9/images/large/7.jpg saved to cache
2026-03-26 22:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fda00ae2-cb85-5aaf-8fae-4fc7773133b1
2026-03-26 22:47:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76a67d0>
2026-03-26 22:47:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61b6d6b6-83de-527e-a30b-7d1dcea0a6a2/61b6d6b6-83de-527e-a30b-7d1dcea0a6a2_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fb9637912dc054098a3db21ea8cb813e0%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/b9637912dc054098a3db21ea8cb813e0/images/large/7.jpg saved to cache
2026-03-26 22:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 61b6d6b6-83de-527e-a30b-7d1dcea0a6a2
2026-03-26 22:47:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/ce8f75c04693462aa0f9ffb661e19a57/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:25 [ayvens.be] INFO: Found listing with ID: 1986099
2026-03-26 22:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986099%27 HTTP/1.1" 200 None
2026-03-26 22:47:25 [ayvens.be] INFO: Scrape type for 1986099: 1
2026-03-26 22:47:25 [ayvens.be] INFO: Extracting data for car ID: 1986099
2026-03-26 22:47:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3dca273-170e-552b-ad06-a9ed40af2ea1 with identifier: 1986099
2026-03-26 22:47:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3dca273-170e-552b-ad06-a9ed40af2ea1 with scrape type 1
2026-03-26 22:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e3dca273-170e-552b-ad06-a9ed40af2ea1
2026-03-26 22:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fa2f535a26e2c4d1e836cf398adeb5620%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/a2f535a26e2c4d1e836cf398adeb5620/images/large/1.jpg not downloaded yet
2026-03-26 22:47:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/ce8f75c04693462aa0f9ffb661e19a57/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/ce8f75c04693462aa0f9ffb661e19a57/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fa2f535a26e2c4d1e836cf398adeb5620%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/a2f535a26e2c4d1e836cf398adeb5620/images/large/2.jpg not downloaded yet
2026-03-26 22:47:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dw/66be59447e6d4eed9e9c717c747f5eb9/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/ce8f75c04693462aa0f9ffb661e19a57/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/ce8f75c04693462aa0f9ffb661e19a57/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fa2f535a26e2c4d1e836cf398adeb5620%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/a2f535a26e2c4d1e836cf398adeb5620/images/large/3.jpg not downloaded yet
2026-03-26 22:47:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b75654d0>
2026-03-26 22:47:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fda00ae2-cb85-5aaf-8fae-4fc7773133b1/fda00ae2-cb85-5aaf-8fae-4fc7773133b1_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dw%252F66be59447e6d4eed9e9c717c747f5eb9%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dw/66be59447e6d4eed9e9c717c747f5eb9/images/large/9.jpg saved to cache
2026-03-26 22:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fda00ae2-cb85-5aaf-8fae-4fc7773133b1
2026-03-26 22:47:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dw/66be59447e6d4eed9e9c717c747f5eb9/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fa2f535a26e2c4d1e836cf398adeb5620%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/a2f535a26e2c4d1e836cf398adeb5620/images/large/4.jpg not downloaded yet
2026-03-26 22:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fa2f535a26e2c4d1e836cf398adeb5620%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/a2f535a26e2c4d1e836cf398adeb5620/images/large/5.jpg not downloaded yet
2026-03-26 22:47:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77cabd0>
2026-03-26 22:47:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b897af89-92d5-5fd7-96fb-123d33a94a50/b897af89-92d5-5fd7-96fb-123d33a94a50_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fce8f75c04693462aa0f9ffb661e19a57%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/ce8f75c04693462aa0f9ffb661e19a57/images/large/9.jpg saved to cache
2026-03-26 22:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b897af89-92d5-5fd7-96fb-123d33a94a50
2026-03-26 22:47:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76a5590>
2026-03-26 22:47:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b897af89-92d5-5fd7-96fb-123d33a94a50/b897af89-92d5-5fd7-96fb-123d33a94a50_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fce8f75c04693462aa0f9ffb661e19a57%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/ce8f75c04693462aa0f9ffb661e19a57/images/large/8.jpg saved to cache
2026-03-26 22:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b897af89-92d5-5fd7-96fb-123d33a94a50
2026-03-26 22:47:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7771c10>
2026-03-26 22:47:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b897af89-92d5-5fd7-96fb-123d33a94a50/b897af89-92d5-5fd7-96fb-123d33a94a50_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fce8f75c04693462aa0f9ffb661e19a57%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/ce8f75c04693462aa0f9ffb661e19a57/images/large/3.jpg saved to cache
2026-03-26 22:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b897af89-92d5-5fd7-96fb-123d33a94a50
2026-03-26 22:47:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7cea890>
2026-03-26 22:47:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fda00ae2-cb85-5aaf-8fae-4fc7773133b1/fda00ae2-cb85-5aaf-8fae-4fc7773133b1_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dw%252F66be59447e6d4eed9e9c717c747f5eb9%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dw/66be59447e6d4eed9e9c717c747f5eb9/images/large/6.jpg saved to cache
2026-03-26 22:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fda00ae2-cb85-5aaf-8fae-4fc7773133b1
2026-03-26 22:47:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7772c50>
2026-03-26 22:47:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b897af89-92d5-5fd7-96fb-123d33a94a50/b897af89-92d5-5fd7-96fb-123d33a94a50_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fce8f75c04693462aa0f9ffb661e19a57%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/ce8f75c04693462aa0f9ffb661e19a57/images/large/4.jpg saved to cache
2026-03-26 22:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b897af89-92d5-5fd7-96fb-123d33a94a50
2026-03-26 22:47:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74ceb10>
2026-03-26 22:47:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b897af89-92d5-5fd7-96fb-123d33a94a50/b897af89-92d5-5fd7-96fb-123d33a94a50_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fce8f75c04693462aa0f9ffb661e19a57%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/ce8f75c04693462aa0f9ffb661e19a57/images/large/2.jpg saved to cache
2026-03-26 22:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b897af89-92d5-5fd7-96fb-123d33a94a50
2026-03-26 22:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fa2f535a26e2c4d1e836cf398adeb5620%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/a2f535a26e2c4d1e836cf398adeb5620/images/large/6.jpg not downloaded yet
2026-03-26 22:47:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xt/fb54aba33b344a77acb87b1d483a39f6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fa2f535a26e2c4d1e836cf398adeb5620%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/a2f535a26e2c4d1e836cf398adeb5620/images/large/7.jpg not downloaded yet
2026-03-26 22:47:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e14a90>
2026-03-26 22:47:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fda00ae2-cb85-5aaf-8fae-4fc7773133b1/fda00ae2-cb85-5aaf-8fae-4fc7773133b1_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dw%252F66be59447e6d4eed9e9c717c747f5eb9%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dw/66be59447e6d4eed9e9c717c747f5eb9/images/large/10.jpg saved to cache
2026-03-26 22:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fda00ae2-cb85-5aaf-8fae-4fc7773133b1
2026-03-26 22:47:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/ce8f75c04693462aa0f9ffb661e19a57/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fa2f535a26e2c4d1e836cf398adeb5620%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/a2f535a26e2c4d1e836cf398adeb5620/images/large/8.jpg not downloaded yet
2026-03-26 22:47:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/ce8f75c04693462aa0f9ffb661e19a57/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fa2f535a26e2c4d1e836cf398adeb5620%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/a2f535a26e2c4d1e836cf398adeb5620/images/large/9.jpg not downloaded yet
2026-03-26 22:47:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e44fd0>
2026-03-26 22:47:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de3c7f05-fd73-53d0-9829-e3d2e4cb7d36/de3c7f05-fd73-53d0-9829-e3d2e4cb7d36_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xt%252Ffb54aba33b344a77acb87b1d483a39f6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xt/fb54aba33b344a77acb87b1d483a39f6/images/large/1.jpg saved to cache
2026-03-26 22:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item de3c7f05-fd73-53d0-9829-e3d2e4cb7d36
2026-03-26 22:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fa2f535a26e2c4d1e836cf398adeb5620%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/a2f535a26e2c4d1e836cf398adeb5620/images/large/10.jpg not downloaded yet
2026-03-26 22:47:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xt/fb54aba33b344a77acb87b1d483a39f6/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xt/fb54aba33b344a77acb87b1d483a39f6/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xt/fb54aba33b344a77acb87b1d483a39f6/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:26 [ayvens.be] INFO: Found listing with ID: 1986100
2026-03-26 22:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986100%27 HTTP/1.1" 200 None
2026-03-26 22:47:26 [ayvens.be] INFO: Scrape type for 1986100: 1
2026-03-26 22:47:26 [ayvens.be] INFO: Extracting data for car ID: 1986100
2026-03-26 22:47:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 917f2936-fc79-57a2-8b59-fbf3f397ac37 with identifier: 1986100
2026-03-26 22:47:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 917f2936-fc79-57a2-8b59-fbf3f397ac37 with scrape type 1
2026-03-26 22:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 917f2936-fc79-57a2-8b59-fbf3f397ac37
2026-03-26 22:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ak%252F71844024402e4e0eaa973992531398c6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ak/71844024402e4e0eaa973992531398c6/images/large/1.jpg not downloaded yet
2026-03-26 22:47:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xt/fb54aba33b344a77acb87b1d483a39f6/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xt/fb54aba33b344a77acb87b1d483a39f6/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ak%252F71844024402e4e0eaa973992531398c6%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ak/71844024402e4e0eaa973992531398c6/images/large/2.jpg not downloaded yet
2026-03-26 22:47:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7480410>
2026-03-26 22:47:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b897af89-92d5-5fd7-96fb-123d33a94a50/b897af89-92d5-5fd7-96fb-123d33a94a50_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fce8f75c04693462aa0f9ffb661e19a57%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/ce8f75c04693462aa0f9ffb661e19a57/images/large/10.jpg saved to cache
2026-03-26 22:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b897af89-92d5-5fd7-96fb-123d33a94a50
2026-03-26 22:47:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7436150>
2026-03-26 22:47:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b897af89-92d5-5fd7-96fb-123d33a94a50/b897af89-92d5-5fd7-96fb-123d33a94a50_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fce8f75c04693462aa0f9ffb661e19a57%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/ce8f75c04693462aa0f9ffb661e19a57/images/large/7.jpg saved to cache
2026-03-26 22:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b897af89-92d5-5fd7-96fb-123d33a94a50
2026-03-26 22:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ak%252F71844024402e4e0eaa973992531398c6%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ak/71844024402e4e0eaa973992531398c6/images/large/3.jpg not downloaded yet
2026-03-26 22:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ak%252F71844024402e4e0eaa973992531398c6%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ak/71844024402e4e0eaa973992531398c6/images/large/4.jpg not downloaded yet
2026-03-26 22:47:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79cc310>
2026-03-26 22:47:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de3c7f05-fd73-53d0-9829-e3d2e4cb7d36/de3c7f05-fd73-53d0-9829-e3d2e4cb7d36_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xt%252Ffb54aba33b344a77acb87b1d483a39f6%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xt/fb54aba33b344a77acb87b1d483a39f6/images/large/2.jpg saved to cache
2026-03-26 22:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item de3c7f05-fd73-53d0-9829-e3d2e4cb7d36
2026-03-26 22:47:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c5c350>
2026-03-26 22:47:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de3c7f05-fd73-53d0-9829-e3d2e4cb7d36/de3c7f05-fd73-53d0-9829-e3d2e4cb7d36_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xt%252Ffb54aba33b344a77acb87b1d483a39f6%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xt/fb54aba33b344a77acb87b1d483a39f6/images/large/4.jpg saved to cache
2026-03-26 22:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item de3c7f05-fd73-53d0-9829-e3d2e4cb7d36
2026-03-26 22:47:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7590410>
2026-03-26 22:47:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de3c7f05-fd73-53d0-9829-e3d2e4cb7d36/de3c7f05-fd73-53d0-9829-e3d2e4cb7d36_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xt%252Ffb54aba33b344a77acb87b1d483a39f6%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xt/fb54aba33b344a77acb87b1d483a39f6/images/large/6.jpg saved to cache
2026-03-26 22:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item de3c7f05-fd73-53d0-9829-e3d2e4cb7d36
2026-03-26 22:47:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5ccbed0>
2026-03-26 22:47:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de3c7f05-fd73-53d0-9829-e3d2e4cb7d36/de3c7f05-fd73-53d0-9829-e3d2e4cb7d36_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xt%252Ffb54aba33b344a77acb87b1d483a39f6%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xt/fb54aba33b344a77acb87b1d483a39f6/images/large/3.jpg saved to cache
2026-03-26 22:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item de3c7f05-fd73-53d0-9829-e3d2e4cb7d36
2026-03-26 22:47:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7439790>
2026-03-26 22:47:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de3c7f05-fd73-53d0-9829-e3d2e4cb7d36/de3c7f05-fd73-53d0-9829-e3d2e4cb7d36_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xt%252Ffb54aba33b344a77acb87b1d483a39f6%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xt/fb54aba33b344a77acb87b1d483a39f6/images/large/5.jpg saved to cache
2026-03-26 22:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item de3c7f05-fd73-53d0-9829-e3d2e4cb7d36
2026-03-26 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ak%252F71844024402e4e0eaa973992531398c6%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ak/71844024402e4e0eaa973992531398c6/images/large/5.jpg not downloaded yet
2026-03-26 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ak%252F71844024402e4e0eaa973992531398c6%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ak/71844024402e4e0eaa973992531398c6/images/large/6.jpg not downloaded yet
2026-03-26 22:47:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xt/fb54aba33b344a77acb87b1d483a39f6/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/a2f535a26e2c4d1e836cf398adeb5620/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ak%252F71844024402e4e0eaa973992531398c6%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ak/71844024402e4e0eaa973992531398c6/images/large/7.jpg not downloaded yet
2026-03-26 22:47:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/a2f535a26e2c4d1e836cf398adeb5620/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xt/fb54aba33b344a77acb87b1d483a39f6/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xt/fb54aba33b344a77acb87b1d483a39f6/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ak%252F71844024402e4e0eaa973992531398c6%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ak/71844024402e4e0eaa973992531398c6/images/large/8.jpg not downloaded yet
2026-03-26 22:47:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xt/fb54aba33b344a77acb87b1d483a39f6/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/ce8f75c04693462aa0f9ffb661e19a57/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/a2f535a26e2c4d1e836cf398adeb5620/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ak%252F71844024402e4e0eaa973992531398c6%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ak/71844024402e4e0eaa973992531398c6/images/large/9.jpg not downloaded yet
2026-03-26 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ak%252F71844024402e4e0eaa973992531398c6%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ak/71844024402e4e0eaa973992531398c6/images/large/10.jpg not downloaded yet
2026-03-26 22:47:27 [ayvens.be] INFO: Found listing with ID: 1986101
2026-03-26 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986101%27 HTTP/1.1" 200 None
2026-03-26 22:47:27 [ayvens.be] INFO: Scrape type for 1986101: 1
2026-03-26 22:47:27 [ayvens.be] INFO: Extracting data for car ID: 1986101
2026-03-26 22:47:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 59805e72-f6f4-5022-ad2e-bc7240d6c422 with identifier: 1986101
2026-03-26 22:47:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 59805e72-f6f4-5022-ad2e-bc7240d6c422 with scrape type 1
2026-03-26 22:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 59805e72-f6f4-5022-ad2e-bc7240d6c422
2026-03-26 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xb%252Ff29fe6134a1c49c892ff18910382ab30%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xb/f29fe6134a1c49c892ff18910382ab30/images/large/1.jpg not downloaded yet
2026-03-26 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xb%252Ff29fe6134a1c49c892ff18910382ab30%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xb/f29fe6134a1c49c892ff18910382ab30/images/large/2.jpg not downloaded yet
2026-03-26 22:47:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c5efd0>
2026-03-26 22:47:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de3c7f05-fd73-53d0-9829-e3d2e4cb7d36/de3c7f05-fd73-53d0-9829-e3d2e4cb7d36_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xt%252Ffb54aba33b344a77acb87b1d483a39f6%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xt/fb54aba33b344a77acb87b1d483a39f6/images/large/8.jpg saved to cache
2026-03-26 22:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item de3c7f05-fd73-53d0-9829-e3d2e4cb7d36
2026-03-26 22:47:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79d4510>
2026-03-26 22:47:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3dca273-170e-552b-ad06-a9ed40af2ea1/e3dca273-170e-552b-ad06-a9ed40af2ea1_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fa2f535a26e2c4d1e836cf398adeb5620%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/a2f535a26e2c4d1e836cf398adeb5620/images/large/1.jpg saved to cache
2026-03-26 22:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e3dca273-170e-552b-ad06-a9ed40af2ea1
2026-03-26 22:47:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77c9bd0>
2026-03-26 22:47:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3dca273-170e-552b-ad06-a9ed40af2ea1/e3dca273-170e-552b-ad06-a9ed40af2ea1_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fa2f535a26e2c4d1e836cf398adeb5620%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/a2f535a26e2c4d1e836cf398adeb5620/images/large/2.jpg saved to cache
2026-03-26 22:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e3dca273-170e-552b-ad06-a9ed40af2ea1
2026-03-26 22:47:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7451950>
2026-03-26 22:47:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de3c7f05-fd73-53d0-9829-e3d2e4cb7d36/de3c7f05-fd73-53d0-9829-e3d2e4cb7d36_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xt%252Ffb54aba33b344a77acb87b1d483a39f6%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xt/fb54aba33b344a77acb87b1d483a39f6/images/large/10.jpg saved to cache
2026-03-26 22:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item de3c7f05-fd73-53d0-9829-e3d2e4cb7d36
2026-03-26 22:47:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77c93d0>
2026-03-26 22:47:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de3c7f05-fd73-53d0-9829-e3d2e4cb7d36/de3c7f05-fd73-53d0-9829-e3d2e4cb7d36_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xt%252Ffb54aba33b344a77acb87b1d483a39f6%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xt/fb54aba33b344a77acb87b1d483a39f6/images/large/7.jpg saved to cache
2026-03-26 22:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item de3c7f05-fd73-53d0-9829-e3d2e4cb7d36
2026-03-26 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xb%252Ff29fe6134a1c49c892ff18910382ab30%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xb/f29fe6134a1c49c892ff18910382ab30/images/large/3.jpg not downloaded yet
2026-03-26 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xb%252Ff29fe6134a1c49c892ff18910382ab30%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xb/f29fe6134a1c49c892ff18910382ab30/images/large/4.jpg not downloaded yet
2026-03-26 22:47:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/a2f535a26e2c4d1e836cf398adeb5620/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xb%252Ff29fe6134a1c49c892ff18910382ab30%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xb/f29fe6134a1c49c892ff18910382ab30/images/large/5.jpg not downloaded yet
2026-03-26 22:47:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c685d0>
2026-03-26 22:47:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de3c7f05-fd73-53d0-9829-e3d2e4cb7d36/de3c7f05-fd73-53d0-9829-e3d2e4cb7d36_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xt%252Ffb54aba33b344a77acb87b1d483a39f6%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xt/fb54aba33b344a77acb87b1d483a39f6/images/large/9.jpg saved to cache
2026-03-26 22:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item de3c7f05-fd73-53d0-9829-e3d2e4cb7d36
2026-03-26 22:47:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: de3c7f05-fd73-53d0-9829-e3d2e4cb7d36, skipping ID generation
2026-03-26 22:47:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de3c7f05-fd73-53d0-9829-e3d2e4cb7d36 with scrape type 1
2026-03-26 22:47:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item de3c7f05-fd73-53d0-9829-e3d2e4cb7d36 sending to next pipeline
2026-03-26 22:47:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: de3c7f05-fd73-53d0-9829-e3d2e4cb7d36, identifier: 1986098
2026-03-26 22:47:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b75a4fd0>
2026-03-26 22:47:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b897af89-92d5-5fd7-96fb-123d33a94a50/b897af89-92d5-5fd7-96fb-123d33a94a50_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fce8f75c04693462aa0f9ffb661e19a57%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/ce8f75c04693462aa0f9ffb661e19a57/images/large/6.jpg saved to cache
2026-03-26 22:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b897af89-92d5-5fd7-96fb-123d33a94a50
2026-03-26 22:47:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b35f90>
2026-03-26 22:47:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3dca273-170e-552b-ad06-a9ed40af2ea1/e3dca273-170e-552b-ad06-a9ed40af2ea1_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fa2f535a26e2c4d1e836cf398adeb5620%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/a2f535a26e2c4d1e836cf398adeb5620/images/large/3.jpg saved to cache
2026-03-26 22:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e3dca273-170e-552b-ad06-a9ed40af2ea1
2026-03-26 22:47:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/a2f535a26e2c4d1e836cf398adeb5620/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: de3c7f05-fd73-53d0-9829-e3d2e4cb7d36 with identifier: 1986098
2026-03-26 22:47:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: de3c7f05-fd73-53d0-9829-e3d2e4cb7d36 with identifier: 1986098
2026-03-26 22:47:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: de3c7f05-fd73-53d0-9829-e3d2e4cb7d36 with identifier: 1986098 to the API
2026-03-26 22:47:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:47:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:47:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1xt/fb54aba33b344a77acb87b1d483a39f6/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'de3c7f05-fd73-53d0-9829-e3d2e4cb7d36',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'OPTIMA SPORTSWAGON PHEV - 2019',
 'odometer': 142856,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de3c7f05-fd73-53d0-9829-e3d2e4cb7d36/de3c7f05-fd73-53d0-9829-e3d2e4cb7d36_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 669468,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xt/fb54aba33b344a77acb87b1d483a39f6/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de3c7f05-fd73-53d0-9829-e3d2e4cb7d36/de3c7f05-fd73-53d0-9829-e3d2e4cb7d36_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 670389,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xt/fb54aba33b344a77acb87b1d483a39f6/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de3c7f05-fd73-53d0-9829-e3d2e4cb7d36/de3c7f05-fd73-53d0-9829-e3d2e4cb7d36_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 659151,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xt/fb54aba33b344a77acb87b1d483a39f6/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de3c7f05-fd73-53d0-9829-e3d2e4cb7d36/de3c7f05-fd73-53d0-9829-e3d2e4cb7d36_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 666293,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xt/fb54aba33b344a77acb87b1d483a39f6/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de3c7f05-fd73-53d0-9829-e3d2e4cb7d36/de3c7f05-fd73-53d0-9829-e3d2e4cb7d36_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 678321,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xt/fb54aba33b344a77acb87b1d483a39f6/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de3c7f05-fd73-53d0-9829-e3d2e4cb7d36/de3c7f05-fd73-53d0-9829-e3d2e4cb7d36_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 699599,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xt/fb54aba33b344a77acb87b1d483a39f6/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de3c7f05-fd73-53d0-9829-e3d2e4cb7d36/de3c7f05-fd73-53d0-9829-e3d2e4cb7d36_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 685885,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xt/fb54aba33b344a77acb87b1d483a39f6/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de3c7f05-fd73-53d0-9829-e3d2e4cb7d36/de3c7f05-fd73-53d0-9829-e3d2e4cb7d36_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 841994,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xt/fb54aba33b344a77acb87b1d483a39f6/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de3c7f05-fd73-53d0-9829-e3d2e4cb7d36/de3c7f05-fd73-53d0-9829-e3d2e4cb7d36_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 751314,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xt/fb54aba33b344a77acb87b1d483a39f6/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de3c7f05-fd73-53d0-9829-e3d2e4cb7d36/de3c7f05-fd73-53d0-9829-e3d2e4cb7d36_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 858717,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xt/fb54aba33b344a77acb87b1d483a39f6/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-05-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA OPTIMA SPORTSWAGON PHEV - 2019 2.0 GDi PHEV Sense (EU6d-T.)',
 'transmission': 'automatic',
 'trim': '2.0 GDi PHEV Sense (EU6d-T.)',
 'vin': None,
 'year': 2020}
2026-03-26 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986098%27 HTTP/1.1" 200 None
2026-03-26 22:47:28 [ayvens.be] INFO: Saving data for 1986098: {'created_time': 1774565248.828598, 'last_price_update_time': 1774565248.828608, 'auction_closing_time': 1775028600.0}
2026-03-26 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986098') HTTP/1.1" 204 0
2026-03-26 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xb%252Ff29fe6134a1c49c892ff18910382ab30%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xb/f29fe6134a1c49c892ff18910382ab30/images/large/6.jpg not downloaded yet
2026-03-26 22:47:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/a2f535a26e2c4d1e836cf398adeb5620/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/a2f535a26e2c4d1e836cf398adeb5620/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xb%252Ff29fe6134a1c49c892ff18910382ab30%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xb/f29fe6134a1c49c892ff18910382ab30/images/large/7.jpg not downloaded yet
2026-03-26 22:47:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ak/71844024402e4e0eaa973992531398c6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/a2f535a26e2c4d1e836cf398adeb5620/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd0c5cd0>
2026-03-26 22:47:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3dca273-170e-552b-ad06-a9ed40af2ea1/e3dca273-170e-552b-ad06-a9ed40af2ea1_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fa2f535a26e2c4d1e836cf398adeb5620%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/a2f535a26e2c4d1e836cf398adeb5620/images/large/6.jpg saved to cache
2026-03-26 22:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e3dca273-170e-552b-ad06-a9ed40af2ea1
2026-03-26 22:47:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5ca3750>
2026-03-26 22:47:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3dca273-170e-552b-ad06-a9ed40af2ea1/e3dca273-170e-552b-ad06-a9ed40af2ea1_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fa2f535a26e2c4d1e836cf398adeb5620%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/a2f535a26e2c4d1e836cf398adeb5620/images/large/7.jpg saved to cache
2026-03-26 22:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e3dca273-170e-552b-ad06-a9ed40af2ea1
2026-03-26 22:47:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/a2f535a26e2c4d1e836cf398adeb5620/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xb%252Ff29fe6134a1c49c892ff18910382ab30%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xb/f29fe6134a1c49c892ff18910382ab30/images/large/8.jpg not downloaded yet
2026-03-26 22:47:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/a2f535a26e2c4d1e836cf398adeb5620/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xb%252Ff29fe6134a1c49c892ff18910382ab30%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xb/f29fe6134a1c49c892ff18910382ab30/images/large/9.jpg not downloaded yet
2026-03-26 22:47:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76c4bd0>
2026-03-26 22:47:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3dca273-170e-552b-ad06-a9ed40af2ea1/e3dca273-170e-552b-ad06-a9ed40af2ea1_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fa2f535a26e2c4d1e836cf398adeb5620%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/a2f535a26e2c4d1e836cf398adeb5620/images/large/5.jpg saved to cache
2026-03-26 22:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e3dca273-170e-552b-ad06-a9ed40af2ea1
2026-03-26 22:47:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7434790>
2026-03-26 22:47:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3dca273-170e-552b-ad06-a9ed40af2ea1/e3dca273-170e-552b-ad06-a9ed40af2ea1_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fa2f535a26e2c4d1e836cf398adeb5620%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/a2f535a26e2c4d1e836cf398adeb5620/images/large/8.jpg saved to cache
2026-03-26 22:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e3dca273-170e-552b-ad06-a9ed40af2ea1
2026-03-26 22:47:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7458410>
2026-03-26 22:47:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_917f2936-fc79-57a2-8b59-fbf3f397ac37/917f2936-fc79-57a2-8b59-fbf3f397ac37_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ak%252F71844024402e4e0eaa973992531398c6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ak/71844024402e4e0eaa973992531398c6/images/large/1.jpg saved to cache
2026-03-26 22:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 917f2936-fc79-57a2-8b59-fbf3f397ac37
2026-03-26 22:47:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7435990>
2026-03-26 22:47:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3dca273-170e-552b-ad06-a9ed40af2ea1/e3dca273-170e-552b-ad06-a9ed40af2ea1_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fa2f535a26e2c4d1e836cf398adeb5620%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/a2f535a26e2c4d1e836cf398adeb5620/images/large/9.jpg saved to cache
2026-03-26 22:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e3dca273-170e-552b-ad06-a9ed40af2ea1
2026-03-26 22:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xb%252Ff29fe6134a1c49c892ff18910382ab30%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xb/f29fe6134a1c49c892ff18910382ab30/images/large/10.jpg not downloaded yet
2026-03-26 22:47:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ak/71844024402e4e0eaa973992531398c6/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:29 [ayvens.be] INFO: Found listing with ID: 1986102
2026-03-26 22:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986102%27 HTTP/1.1" 200 None
2026-03-26 22:47:29 [ayvens.be] INFO: Scrape type for 1986102: 1
2026-03-26 22:47:29 [ayvens.be] INFO: Extracting data for car ID: 1986102
2026-03-26 22:47:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe663be6-9724-57b4-b3f9-c897ef50756e with identifier: 1986102
2026-03-26 22:47:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe663be6-9724-57b4-b3f9-c897ef50756e with scrape type 1
2026-03-26 22:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fe663be6-9724-57b4-b3f9-c897ef50756e
2026-03-26 22:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F9817443283084a1bb181713a76532336%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/9817443283084a1bb181713a76532336/images/large/1.jpg not downloaded yet
2026-03-26 22:47:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7912c90>
2026-03-26 22:47:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3dca273-170e-552b-ad06-a9ed40af2ea1/e3dca273-170e-552b-ad06-a9ed40af2ea1_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fa2f535a26e2c4d1e836cf398adeb5620%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/a2f535a26e2c4d1e836cf398adeb5620/images/large/10.jpg saved to cache
2026-03-26 22:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e3dca273-170e-552b-ad06-a9ed40af2ea1
2026-03-26 22:47:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7779bd0>
2026-03-26 22:47:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3dca273-170e-552b-ad06-a9ed40af2ea1/e3dca273-170e-552b-ad06-a9ed40af2ea1_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fa2f535a26e2c4d1e836cf398adeb5620%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/a2f535a26e2c4d1e836cf398adeb5620/images/large/4.jpg saved to cache
2026-03-26 22:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e3dca273-170e-552b-ad06-a9ed40af2ea1
2026-03-26 22:47:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e3dca273-170e-552b-ad06-a9ed40af2ea1, skipping ID generation
2026-03-26 22:47:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3dca273-170e-552b-ad06-a9ed40af2ea1 with scrape type 1
2026-03-26 22:47:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e3dca273-170e-552b-ad06-a9ed40af2ea1 sending to next pipeline
2026-03-26 22:47:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e3dca273-170e-552b-ad06-a9ed40af2ea1, identifier: 1986099
2026-03-26 22:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F9817443283084a1bb181713a76532336%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/9817443283084a1bb181713a76532336/images/large/2.jpg not downloaded yet
2026-03-26 22:47:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e3dca273-170e-552b-ad06-a9ed40af2ea1 with identifier: 1986099
2026-03-26 22:47:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e3dca273-170e-552b-ad06-a9ed40af2ea1 with identifier: 1986099
2026-03-26 22:47:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e3dca273-170e-552b-ad06-a9ed40af2ea1 with identifier: 1986099 to the API
2026-03-26 22:47:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:47:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:47:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bt/a2f535a26e2c4d1e836cf398adeb5620/images/large/4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'e3dca273-170e-552b-ad06-a9ed40af2ea1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'SUPERB COMBI',
 'odometer': 136991,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3dca273-170e-552b-ad06-a9ed40af2ea1/e3dca273-170e-552b-ad06-a9ed40af2ea1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 644497,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/a2f535a26e2c4d1e836cf398adeb5620/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3dca273-170e-552b-ad06-a9ed40af2ea1/e3dca273-170e-552b-ad06-a9ed40af2ea1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 648451,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/a2f535a26e2c4d1e836cf398adeb5620/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3dca273-170e-552b-ad06-a9ed40af2ea1/e3dca273-170e-552b-ad06-a9ed40af2ea1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 568010,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/a2f535a26e2c4d1e836cf398adeb5620/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3dca273-170e-552b-ad06-a9ed40af2ea1/e3dca273-170e-552b-ad06-a9ed40af2ea1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 659158,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/a2f535a26e2c4d1e836cf398adeb5620/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3dca273-170e-552b-ad06-a9ed40af2ea1/e3dca273-170e-552b-ad06-a9ed40af2ea1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 562241,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/a2f535a26e2c4d1e836cf398adeb5620/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3dca273-170e-552b-ad06-a9ed40af2ea1/e3dca273-170e-552b-ad06-a9ed40af2ea1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 529570,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/a2f535a26e2c4d1e836cf398adeb5620/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3dca273-170e-552b-ad06-a9ed40af2ea1/e3dca273-170e-552b-ad06-a9ed40af2ea1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 612456,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/a2f535a26e2c4d1e836cf398adeb5620/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3dca273-170e-552b-ad06-a9ed40af2ea1/e3dca273-170e-552b-ad06-a9ed40af2ea1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 679195,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/a2f535a26e2c4d1e836cf398adeb5620/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3dca273-170e-552b-ad06-a9ed40af2ea1/e3dca273-170e-552b-ad06-a9ed40af2ea1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 549035,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/a2f535a26e2c4d1e836cf398adeb5620/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3dca273-170e-552b-ad06-a9ed40af2ea1/e3dca273-170e-552b-ad06-a9ed40af2ea1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 591911,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/a2f535a26e2c4d1e836cf398adeb5620/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA SUPERB COMBI 1.5 TSI ACT 110KW DSG7 CLEVER',
 'transmission': 'automatic',
 'trim': '1.5 TSI ACT 110KW DSG7 CLEVER',
 'vin': None,
 'year': 2022}
2026-03-26 22:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986099%27 HTTP/1.1" 200 None
2026-03-26 22:47:30 [ayvens.be] INFO: Saving data for 1986099: {'created_time': 1774565250.303148, 'last_price_update_time': 1774565250.303158, 'auction_closing_time': 1775028600.0}
2026-03-26 22:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986099') HTTP/1.1" 204 0
2026-03-26 22:47:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ak/71844024402e4e0eaa973992531398c6/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xb/f29fe6134a1c49c892ff18910382ab30/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F9817443283084a1bb181713a76532336%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/9817443283084a1bb181713a76532336/images/large/3.jpg not downloaded yet
2026-03-26 22:47:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ak/71844024402e4e0eaa973992531398c6/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ak/71844024402e4e0eaa973992531398c6/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xb/f29fe6134a1c49c892ff18910382ab30/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F9817443283084a1bb181713a76532336%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/9817443283084a1bb181713a76532336/images/large/4.jpg not downloaded yet
2026-03-26 22:47:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74b4690>
2026-03-26 22:47:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_917f2936-fc79-57a2-8b59-fbf3f397ac37/917f2936-fc79-57a2-8b59-fbf3f397ac37_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ak%252F71844024402e4e0eaa973992531398c6%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ak/71844024402e4e0eaa973992531398c6/images/large/6.jpg saved to cache
2026-03-26 22:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 917f2936-fc79-57a2-8b59-fbf3f397ac37
2026-03-26 22:47:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ak/71844024402e4e0eaa973992531398c6/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F9817443283084a1bb181713a76532336%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/9817443283084a1bb181713a76532336/images/large/5.jpg not downloaded yet
2026-03-26 22:47:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xb/f29fe6134a1c49c892ff18910382ab30/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xb/f29fe6134a1c49c892ff18910382ab30/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F9817443283084a1bb181713a76532336%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/9817443283084a1bb181713a76532336/images/large/6.jpg not downloaded yet
2026-03-26 22:47:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7875150>
2026-03-26 22:47:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_917f2936-fc79-57a2-8b59-fbf3f397ac37/917f2936-fc79-57a2-8b59-fbf3f397ac37_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ak%252F71844024402e4e0eaa973992531398c6%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ak/71844024402e4e0eaa973992531398c6/images/large/7.jpg saved to cache
2026-03-26 22:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 917f2936-fc79-57a2-8b59-fbf3f397ac37
2026-03-26 22:47:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79a1c10>
2026-03-26 22:47:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59805e72-f6f4-5022-ad2e-bc7240d6c422/59805e72-f6f4-5022-ad2e-bc7240d6c422_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xb%252Ff29fe6134a1c49c892ff18910382ab30%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xb/f29fe6134a1c49c892ff18910382ab30/images/large/3.jpg saved to cache
2026-03-26 22:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 59805e72-f6f4-5022-ad2e-bc7240d6c422
2026-03-26 22:47:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd0d0410>
2026-03-26 22:47:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_917f2936-fc79-57a2-8b59-fbf3f397ac37/917f2936-fc79-57a2-8b59-fbf3f397ac37_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ak%252F71844024402e4e0eaa973992531398c6%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ak/71844024402e4e0eaa973992531398c6/images/large/5.jpg saved to cache
2026-03-26 22:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 917f2936-fc79-57a2-8b59-fbf3f397ac37
2026-03-26 22:47:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7483d50>
2026-03-26 22:47:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_917f2936-fc79-57a2-8b59-fbf3f397ac37/917f2936-fc79-57a2-8b59-fbf3f397ac37_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ak%252F71844024402e4e0eaa973992531398c6%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ak/71844024402e4e0eaa973992531398c6/images/large/3.jpg saved to cache
2026-03-26 22:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 917f2936-fc79-57a2-8b59-fbf3f397ac37
2026-03-26 22:47:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77c9550>
2026-03-26 22:47:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59805e72-f6f4-5022-ad2e-bc7240d6c422/59805e72-f6f4-5022-ad2e-bc7240d6c422_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xb%252Ff29fe6134a1c49c892ff18910382ab30%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xb/f29fe6134a1c49c892ff18910382ab30/images/large/2.jpg saved to cache
2026-03-26 22:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 59805e72-f6f4-5022-ad2e-bc7240d6c422
2026-03-26 22:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F9817443283084a1bb181713a76532336%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/9817443283084a1bb181713a76532336/images/large/7.jpg not downloaded yet
2026-03-26 22:47:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xb/f29fe6134a1c49c892ff18910382ab30/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F9817443283084a1bb181713a76532336%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/9817443283084a1bb181713a76532336/images/large/8.jpg not downloaded yet
2026-03-26 22:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F9817443283084a1bb181713a76532336%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/9817443283084a1bb181713a76532336/images/large/9.jpg not downloaded yet
2026-03-26 22:47:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b78c20d0>
2026-03-26 22:47:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_917f2936-fc79-57a2-8b59-fbf3f397ac37/917f2936-fc79-57a2-8b59-fbf3f397ac37_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ak%252F71844024402e4e0eaa973992531398c6%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ak/71844024402e4e0eaa973992531398c6/images/large/4.jpg saved to cache
2026-03-26 22:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 917f2936-fc79-57a2-8b59-fbf3f397ac37
2026-03-26 22:47:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7437190>
2026-03-26 22:47:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59805e72-f6f4-5022-ad2e-bc7240d6c422/59805e72-f6f4-5022-ad2e-bc7240d6c422_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xb%252Ff29fe6134a1c49c892ff18910382ab30%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xb/f29fe6134a1c49c892ff18910382ab30/images/large/1.jpg saved to cache
2026-03-26 22:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 59805e72-f6f4-5022-ad2e-bc7240d6c422
2026-03-26 22:47:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b745b150>
2026-03-26 22:47:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59805e72-f6f4-5022-ad2e-bc7240d6c422/59805e72-f6f4-5022-ad2e-bc7240d6c422_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xb%252Ff29fe6134a1c49c892ff18910382ab30%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xb/f29fe6134a1c49c892ff18910382ab30/images/large/4.jpg saved to cache
2026-03-26 22:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 59805e72-f6f4-5022-ad2e-bc7240d6c422
2026-03-26 22:47:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xb/f29fe6134a1c49c892ff18910382ab30/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xb/f29fe6134a1c49c892ff18910382ab30/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F9817443283084a1bb181713a76532336%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/9817443283084a1bb181713a76532336/images/large/10.jpg not downloaded yet
2026-03-26 22:47:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ak/71844024402e4e0eaa973992531398c6/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:31 [ayvens.be] INFO: Found listing with ID: 1986103
2026-03-26 22:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986103%27 HTTP/1.1" 200 None
2026-03-26 22:47:31 [ayvens.be] INFO: Scrape type for 1986103: 1
2026-03-26 22:47:31 [ayvens.be] INFO: Extracting data for car ID: 1986103
2026-03-26 22:47:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d58c301-dab2-5aa2-8d0a-a5d15dbc93e3 with identifier: 1986103
2026-03-26 22:47:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d58c301-dab2-5aa2-8d0a-a5d15dbc93e3 with scrape type 1
2026-03-26 22:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9d58c301-dab2-5aa2-8d0a-a5d15dbc93e3
2026-03-26 22:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F7c113e01f0e84339bc54731ec915b719%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/7c113e01f0e84339bc54731ec915b719/images/large/1.jpg not downloaded yet
2026-03-26 22:47:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ak/71844024402e4e0eaa973992531398c6/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b72907d0>
2026-03-26 22:47:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59805e72-f6f4-5022-ad2e-bc7240d6c422/59805e72-f6f4-5022-ad2e-bc7240d6c422_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xb%252Ff29fe6134a1c49c892ff18910382ab30%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xb/f29fe6134a1c49c892ff18910382ab30/images/large/5.jpg saved to cache
2026-03-26 22:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 59805e72-f6f4-5022-ad2e-bc7240d6c422
2026-03-26 22:47:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ak/71844024402e4e0eaa973992531398c6/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F7c113e01f0e84339bc54731ec915b719%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/7c113e01f0e84339bc54731ec915b719/images/large/2.jpg not downloaded yet
2026-03-26 22:47:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xb/f29fe6134a1c49c892ff18910382ab30/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xb/f29fe6134a1c49c892ff18910382ab30/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F7c113e01f0e84339bc54731ec915b719%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/7c113e01f0e84339bc54731ec915b719/images/large/3.jpg not downloaded yet
2026-03-26 22:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F7c113e01f0e84339bc54731ec915b719%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/7c113e01f0e84339bc54731ec915b719/images/large/4.jpg not downloaded yet
2026-03-26 22:47:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b726b790>
2026-03-26 22:47:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59805e72-f6f4-5022-ad2e-bc7240d6c422/59805e72-f6f4-5022-ad2e-bc7240d6c422_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xb%252Ff29fe6134a1c49c892ff18910382ab30%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xb/f29fe6134a1c49c892ff18910382ab30/images/large/7.jpg saved to cache
2026-03-26 22:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 59805e72-f6f4-5022-ad2e-bc7240d6c422
2026-03-26 22:47:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b72efa10>
2026-03-26 22:47:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59805e72-f6f4-5022-ad2e-bc7240d6c422/59805e72-f6f4-5022-ad2e-bc7240d6c422_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xb%252Ff29fe6134a1c49c892ff18910382ab30%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xb/f29fe6134a1c49c892ff18910382ab30/images/large/6.jpg saved to cache
2026-03-26 22:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 59805e72-f6f4-5022-ad2e-bc7240d6c422
2026-03-26 22:47:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6dc0dd0>
2026-03-26 22:47:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_917f2936-fc79-57a2-8b59-fbf3f397ac37/917f2936-fc79-57a2-8b59-fbf3f397ac37_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ak%252F71844024402e4e0eaa973992531398c6%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ak/71844024402e4e0eaa973992531398c6/images/large/10.jpg saved to cache
2026-03-26 22:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 917f2936-fc79-57a2-8b59-fbf3f397ac37
2026-03-26 22:47:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/9817443283084a1bb181713a76532336/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F7c113e01f0e84339bc54731ec915b719%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/7c113e01f0e84339bc54731ec915b719/images/large/5.jpg not downloaded yet
2026-03-26 22:47:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b75a4690>
2026-03-26 22:47:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_917f2936-fc79-57a2-8b59-fbf3f397ac37/917f2936-fc79-57a2-8b59-fbf3f397ac37_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ak%252F71844024402e4e0eaa973992531398c6%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ak/71844024402e4e0eaa973992531398c6/images/large/9.jpg saved to cache
2026-03-26 22:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 917f2936-fc79-57a2-8b59-fbf3f397ac37
2026-03-26 22:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F7c113e01f0e84339bc54731ec915b719%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/7c113e01f0e84339bc54731ec915b719/images/large/6.jpg not downloaded yet
2026-03-26 22:47:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7441490>
2026-03-26 22:47:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_917f2936-fc79-57a2-8b59-fbf3f397ac37/917f2936-fc79-57a2-8b59-fbf3f397ac37_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ak%252F71844024402e4e0eaa973992531398c6%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ak/71844024402e4e0eaa973992531398c6/images/large/8.jpg saved to cache
2026-03-26 22:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 917f2936-fc79-57a2-8b59-fbf3f397ac37
2026-03-26 22:47:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76c6490>
2026-03-26 22:47:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59805e72-f6f4-5022-ad2e-bc7240d6c422/59805e72-f6f4-5022-ad2e-bc7240d6c422_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xb%252Ff29fe6134a1c49c892ff18910382ab30%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xb/f29fe6134a1c49c892ff18910382ab30/images/large/10.jpg saved to cache
2026-03-26 22:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 59805e72-f6f4-5022-ad2e-bc7240d6c422
2026-03-26 22:47:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b741e650>
2026-03-26 22:47:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59805e72-f6f4-5022-ad2e-bc7240d6c422/59805e72-f6f4-5022-ad2e-bc7240d6c422_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xb%252Ff29fe6134a1c49c892ff18910382ab30%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xb/f29fe6134a1c49c892ff18910382ab30/images/large/8.jpg saved to cache
2026-03-26 22:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 59805e72-f6f4-5022-ad2e-bc7240d6c422
2026-03-26 22:47:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7438550>
2026-03-26 22:47:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe663be6-9724-57b4-b3f9-c897ef50756e/fe663be6-9724-57b4-b3f9-c897ef50756e_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F9817443283084a1bb181713a76532336%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/9817443283084a1bb181713a76532336/images/large/2.jpg saved to cache
2026-03-26 22:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fe663be6-9724-57b4-b3f9-c897ef50756e
2026-03-26 22:47:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/9817443283084a1bb181713a76532336/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/ce8f75c04693462aa0f9ffb661e19a57/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F7c113e01f0e84339bc54731ec915b719%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/7c113e01f0e84339bc54731ec915b719/images/large/7.jpg not downloaded yet
2026-03-26 22:47:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xb/f29fe6134a1c49c892ff18910382ab30/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F7c113e01f0e84339bc54731ec915b719%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/7c113e01f0e84339bc54731ec915b719/images/large/8.jpg not downloaded yet
2026-03-26 22:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F7c113e01f0e84339bc54731ec915b719%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/7c113e01f0e84339bc54731ec915b719/images/large/9.jpg not downloaded yet
2026-03-26 22:47:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ak/71844024402e4e0eaa973992531398c6/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/9817443283084a1bb181713a76532336/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/9817443283084a1bb181713a76532336/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/9817443283084a1bb181713a76532336/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F7c113e01f0e84339bc54731ec915b719%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/7c113e01f0e84339bc54731ec915b719/images/large/10.jpg not downloaded yet
2026-03-26 22:47:32 [ayvens.be] INFO: Found listing with ID: 1986104
2026-03-26 22:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986104%27 HTTP/1.1" 200 None
2026-03-26 22:47:32 [ayvens.be] INFO: Scrape type for 1986104: 1
2026-03-26 22:47:32 [ayvens.be] INFO: Extracting data for car ID: 1986104
2026-03-26 22:47:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26ad01cb-b78b-5f5e-b11d-de81424be4a4 with identifier: 1986104
2026-03-26 22:47:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26ad01cb-b78b-5f5e-b11d-de81424be4a4 with scrape type 1
2026-03-26 22:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 26ad01cb-b78b-5f5e-b11d-de81424be4a4
2026-03-26 22:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F7865be64b85b4035823d13ed0a78c0d3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/7865be64b85b4035823d13ed0a78c0d3/images/large/1.jpg not downloaded yet
2026-03-26 22:47:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/9817443283084a1bb181713a76532336/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F7865be64b85b4035823d13ed0a78c0d3%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/7865be64b85b4035823d13ed0a78c0d3/images/large/2.jpg not downloaded yet
2026-03-26 22:47:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b75a4250>
2026-03-26 22:47:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe663be6-9724-57b4-b3f9-c897ef50756e/fe663be6-9724-57b4-b3f9-c897ef50756e_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F9817443283084a1bb181713a76532336%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/9817443283084a1bb181713a76532336/images/large/3.jpg saved to cache
2026-03-26 22:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fe663be6-9724-57b4-b3f9-c897ef50756e
2026-03-26 22:47:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b75a4b50>
2026-03-26 22:47:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b897af89-92d5-5fd7-96fb-123d33a94a50/b897af89-92d5-5fd7-96fb-123d33a94a50_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fce8f75c04693462aa0f9ffb661e19a57%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/ce8f75c04693462aa0f9ffb661e19a57/images/large/5.jpg saved to cache
2026-03-26 22:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b897af89-92d5-5fd7-96fb-123d33a94a50
2026-03-26 22:47:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b897af89-92d5-5fd7-96fb-123d33a94a50, skipping ID generation
2026-03-26 22:47:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b897af89-92d5-5fd7-96fb-123d33a94a50 with scrape type 1
2026-03-26 22:47:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b897af89-92d5-5fd7-96fb-123d33a94a50 sending to next pipeline
2026-03-26 22:47:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b897af89-92d5-5fd7-96fb-123d33a94a50, identifier: 1986097
2026-03-26 22:47:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b741e490>
2026-03-26 22:47:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59805e72-f6f4-5022-ad2e-bc7240d6c422/59805e72-f6f4-5022-ad2e-bc7240d6c422_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xb%252Ff29fe6134a1c49c892ff18910382ab30%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xb/f29fe6134a1c49c892ff18910382ab30/images/large/9.jpg saved to cache
2026-03-26 22:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 59805e72-f6f4-5022-ad2e-bc7240d6c422
2026-03-26 22:47:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 59805e72-f6f4-5022-ad2e-bc7240d6c422, skipping ID generation
2026-03-26 22:47:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 59805e72-f6f4-5022-ad2e-bc7240d6c422 with scrape type 1
2026-03-26 22:47:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 59805e72-f6f4-5022-ad2e-bc7240d6c422 sending to next pipeline
2026-03-26 22:47:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 59805e72-f6f4-5022-ad2e-bc7240d6c422, identifier: 1986101
2026-03-26 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F7865be64b85b4035823d13ed0a78c0d3%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/7865be64b85b4035823d13ed0a78c0d3/images/large/3.jpg not downloaded yet
2026-03-26 22:47:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b897af89-92d5-5fd7-96fb-123d33a94a50 with identifier: 1986097
2026-03-26 22:47:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b897af89-92d5-5fd7-96fb-123d33a94a50 with identifier: 1986097
2026-03-26 22:47:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b897af89-92d5-5fd7-96fb-123d33a94a50 with identifier: 1986097 to the API
2026-03-26 22:47:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:47:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:47:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ac/ce8f75c04693462aa0f9ffb661e19a57/images/large/5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'b897af89-92d5-5fd7-96fb-123d33a94a50',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 152950,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b897af89-92d5-5fd7-96fb-123d33a94a50/b897af89-92d5-5fd7-96fb-123d33a94a50_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 536368,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/ce8f75c04693462aa0f9ffb661e19a57/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b897af89-92d5-5fd7-96fb-123d33a94a50/b897af89-92d5-5fd7-96fb-123d33a94a50_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 641250,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/ce8f75c04693462aa0f9ffb661e19a57/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b897af89-92d5-5fd7-96fb-123d33a94a50/b897af89-92d5-5fd7-96fb-123d33a94a50_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 544803,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/ce8f75c04693462aa0f9ffb661e19a57/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b897af89-92d5-5fd7-96fb-123d33a94a50/b897af89-92d5-5fd7-96fb-123d33a94a50_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 726465,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/ce8f75c04693462aa0f9ffb661e19a57/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b897af89-92d5-5fd7-96fb-123d33a94a50/b897af89-92d5-5fd7-96fb-123d33a94a50_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 321401,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/ce8f75c04693462aa0f9ffb661e19a57/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b897af89-92d5-5fd7-96fb-123d33a94a50/b897af89-92d5-5fd7-96fb-123d33a94a50_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 437070,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/ce8f75c04693462aa0f9ffb661e19a57/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b897af89-92d5-5fd7-96fb-123d33a94a50/b897af89-92d5-5fd7-96fb-123d33a94a50_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 471253,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/ce8f75c04693462aa0f9ffb661e19a57/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b897af89-92d5-5fd7-96fb-123d33a94a50/b897af89-92d5-5fd7-96fb-123d33a94a50_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 379663,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/ce8f75c04693462aa0f9ffb661e19a57/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b897af89-92d5-5fd7-96fb-123d33a94a50/b897af89-92d5-5fd7-96fb-123d33a94a50_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 291028,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/ce8f75c04693462aa0f9ffb661e19a57/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b897af89-92d5-5fd7-96fb-123d33a94a50/b897af89-92d5-5fd7-96fb-123d33a94a50_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 297099,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/ce8f75c04693462aa0f9ffb661e19a57/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T4 RECHARGE GEARTR. INSCRIPTION EXPR',
 'transmission': 'automatic',
 'trim': '1.5 T4 RECHARGE GEARTR. INSCRIPTION EXPR',
 'vin': None,
 'year': 2021}
2026-03-26 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986097%27 HTTP/1.1" 200 None
2026-03-26 22:47:33 [ayvens.be] INFO: Saving data for 1986097: {'created_time': 1774565253.490316, 'last_price_update_time': 1774565253.490328, 'auction_closing_time': 1775028600.0}
2026-03-26 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986097') HTTP/1.1" 204 0
2026-03-26 22:47:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 59805e72-f6f4-5022-ad2e-bc7240d6c422 with identifier: 1986101
2026-03-26 22:47:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 59805e72-f6f4-5022-ad2e-bc7240d6c422 with identifier: 1986101
2026-03-26 22:47:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 59805e72-f6f4-5022-ad2e-bc7240d6c422 with identifier: 1986101 to the API
2026-03-26 22:47:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:47:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:47:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1xb/f29fe6134a1c49c892ff18910382ab30/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '59805e72-f6f4-5022-ad2e-bc7240d6c422',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLASSE CLA  COUPE DIESEL (C118',
 'odometer': 127894,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59805e72-f6f4-5022-ad2e-bc7240d6c422/59805e72-f6f4-5022-ad2e-bc7240d6c422_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 505207,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xb/f29fe6134a1c49c892ff18910382ab30/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59805e72-f6f4-5022-ad2e-bc7240d6c422/59805e72-f6f4-5022-ad2e-bc7240d6c422_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 530711,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xb/f29fe6134a1c49c892ff18910382ab30/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59805e72-f6f4-5022-ad2e-bc7240d6c422/59805e72-f6f4-5022-ad2e-bc7240d6c422_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 441573,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xb/f29fe6134a1c49c892ff18910382ab30/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59805e72-f6f4-5022-ad2e-bc7240d6c422/59805e72-f6f4-5022-ad2e-bc7240d6c422_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 453873,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xb/f29fe6134a1c49c892ff18910382ab30/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59805e72-f6f4-5022-ad2e-bc7240d6c422/59805e72-f6f4-5022-ad2e-bc7240d6c422_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 394952,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xb/f29fe6134a1c49c892ff18910382ab30/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59805e72-f6f4-5022-ad2e-bc7240d6c422/59805e72-f6f4-5022-ad2e-bc7240d6c422_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 336237,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xb/f29fe6134a1c49c892ff18910382ab30/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59805e72-f6f4-5022-ad2e-bc7240d6c422/59805e72-f6f4-5022-ad2e-bc7240d6c422_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 270549,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xb/f29fe6134a1c49c892ff18910382ab30/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59805e72-f6f4-5022-ad2e-bc7240d6c422/59805e72-f6f4-5022-ad2e-bc7240d6c422_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 374432,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xb/f29fe6134a1c49c892ff18910382ab30/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59805e72-f6f4-5022-ad2e-bc7240d6c422/59805e72-f6f4-5022-ad2e-bc7240d6c422_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 352209,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xb/f29fe6134a1c49c892ff18910382ab30/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59805e72-f6f4-5022-ad2e-bc7240d6c422/59805e72-f6f4-5022-ad2e-bc7240d6c422_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 342313,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xb/f29fe6134a1c49c892ff18910382ab30/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLASSE CLA  COUPE DIESEL (C118 CLA 180 d Business '
          'Solution',
 'transmission': 'automatic',
 'trim': 'CLA 180 d Business Solution',
 'vin': None,
 'year': 2019}
2026-03-26 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986101%27 HTTP/1.1" 200 None
2026-03-26 22:47:33 [ayvens.be] INFO: Saving data for 1986101: {'created_time': 1774565253.851652, 'last_price_update_time': 1774565253.851661, 'auction_closing_time': 1775028600.0}
2026-03-26 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986101') HTTP/1.1" 204 0
2026-03-26 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F7865be64b85b4035823d13ed0a78c0d3%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/7865be64b85b4035823d13ed0a78c0d3/images/large/4.jpg not downloaded yet
2026-03-26 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F7865be64b85b4035823d13ed0a78c0d3%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/7865be64b85b4035823d13ed0a78c0d3/images/large/5.jpg not downloaded yet
2026-03-26 22:47:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76e0290>
2026-03-26 22:47:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_917f2936-fc79-57a2-8b59-fbf3f397ac37/917f2936-fc79-57a2-8b59-fbf3f397ac37_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ak%252F71844024402e4e0eaa973992531398c6%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ak/71844024402e4e0eaa973992531398c6/images/large/2.jpg saved to cache
2026-03-26 22:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 917f2936-fc79-57a2-8b59-fbf3f397ac37
2026-03-26 22:47:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 917f2936-fc79-57a2-8b59-fbf3f397ac37, skipping ID generation
2026-03-26 22:47:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 917f2936-fc79-57a2-8b59-fbf3f397ac37 with scrape type 1
2026-03-26 22:47:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 917f2936-fc79-57a2-8b59-fbf3f397ac37 sending to next pipeline
2026-03-26 22:47:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 917f2936-fc79-57a2-8b59-fbf3f397ac37, identifier: 1986100
2026-03-26 22:47:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd235f50>
2026-03-26 22:47:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe663be6-9724-57b4-b3f9-c897ef50756e/fe663be6-9724-57b4-b3f9-c897ef50756e_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F9817443283084a1bb181713a76532336%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/9817443283084a1bb181713a76532336/images/large/1.jpg saved to cache
2026-03-26 22:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fe663be6-9724-57b4-b3f9-c897ef50756e
2026-03-26 22:47:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7475550>
2026-03-26 22:47:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe663be6-9724-57b4-b3f9-c897ef50756e/fe663be6-9724-57b4-b3f9-c897ef50756e_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F9817443283084a1bb181713a76532336%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/9817443283084a1bb181713a76532336/images/large/5.jpg saved to cache
2026-03-26 22:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fe663be6-9724-57b4-b3f9-c897ef50756e
2026-03-26 22:47:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e14190>
2026-03-26 22:47:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe663be6-9724-57b4-b3f9-c897ef50756e/fe663be6-9724-57b4-b3f9-c897ef50756e_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F9817443283084a1bb181713a76532336%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/9817443283084a1bb181713a76532336/images/large/4.jpg saved to cache
2026-03-26 22:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fe663be6-9724-57b4-b3f9-c897ef50756e
2026-03-26 22:47:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7ccd5d0>
2026-03-26 22:47:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe663be6-9724-57b4-b3f9-c897ef50756e/fe663be6-9724-57b4-b3f9-c897ef50756e_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F9817443283084a1bb181713a76532336%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/9817443283084a1bb181713a76532336/images/large/7.jpg saved to cache
2026-03-26 22:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fe663be6-9724-57b4-b3f9-c897ef50756e
2026-03-26 22:47:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/9817443283084a1bb181713a76532336/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 917f2936-fc79-57a2-8b59-fbf3f397ac37 with identifier: 1986100
2026-03-26 22:47:34 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 22:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 22:47:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 917f2936-fc79-57a2-8b59-fbf3f397ac37 with identifier: 1986100
2026-03-26 22:47:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 917f2936-fc79-57a2-8b59-fbf3f397ac37 with identifier: 1986100 to the API
2026-03-26 22:47:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:47:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:47:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ak/71844024402e4e0eaa973992531398c6/images/large/2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 38,
 'color': 'MYTHOS BLACK METALLIC',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '917f2936-fc79-57a2-8b59-fbf3f397ac37',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3 SPORTBACK',
 'odometer': 174014,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_917f2936-fc79-57a2-8b59-fbf3f397ac37/917f2936-fc79-57a2-8b59-fbf3f397ac37_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 659822,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ak/71844024402e4e0eaa973992531398c6/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_917f2936-fc79-57a2-8b59-fbf3f397ac37/917f2936-fc79-57a2-8b59-fbf3f397ac37_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 662453,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ak/71844024402e4e0eaa973992531398c6/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_917f2936-fc79-57a2-8b59-fbf3f397ac37/917f2936-fc79-57a2-8b59-fbf3f397ac37_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 584677,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ak/71844024402e4e0eaa973992531398c6/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_917f2936-fc79-57a2-8b59-fbf3f397ac37/917f2936-fc79-57a2-8b59-fbf3f397ac37_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 698046,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ak/71844024402e4e0eaa973992531398c6/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_917f2936-fc79-57a2-8b59-fbf3f397ac37/917f2936-fc79-57a2-8b59-fbf3f397ac37_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 610720,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ak/71844024402e4e0eaa973992531398c6/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_917f2936-fc79-57a2-8b59-fbf3f397ac37/917f2936-fc79-57a2-8b59-fbf3f397ac37_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 624332,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ak/71844024402e4e0eaa973992531398c6/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_917f2936-fc79-57a2-8b59-fbf3f397ac37/917f2936-fc79-57a2-8b59-fbf3f397ac37_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 648713,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ak/71844024402e4e0eaa973992531398c6/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_917f2936-fc79-57a2-8b59-fbf3f397ac37/917f2936-fc79-57a2-8b59-fbf3f397ac37_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 687969,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ak/71844024402e4e0eaa973992531398c6/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_917f2936-fc79-57a2-8b59-fbf3f397ac37/917f2936-fc79-57a2-8b59-fbf3f397ac37_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 539142,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ak/71844024402e4e0eaa973992531398c6/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_917f2936-fc79-57a2-8b59-fbf3f397ac37/917f2936-fc79-57a2-8b59-fbf3f397ac37_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 620680,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ak/71844024402e4e0eaa973992531398c6/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 SPORTBACK 1.4 45 TFSI E S TRONIC S LINE',
 'transmission': 'automatic',
 'trim': '1.4 45 TFSI E S TRONIC S LINE',
 'vin': None,
 'year': 2021}
2026-03-26 22:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986100%27 HTTP/1.1" 200 None
2026-03-26 22:47:34 [ayvens.be] INFO: Saving data for 1986100: {'created_time': 1774565254.820748, 'last_price_update_time': 1774565254.820761, 'auction_closing_time': 1775028600.0}
2026-03-26 22:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986100') HTTP/1.1" 204 0
2026-03-26 22:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F7865be64b85b4035823d13ed0a78c0d3%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/7865be64b85b4035823d13ed0a78c0d3/images/large/6.jpg not downloaded yet
2026-03-26 22:47:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/7c113e01f0e84339bc54731ec915b719/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dw/66be59447e6d4eed9e9c717c747f5eb9/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/9817443283084a1bb181713a76532336/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F7865be64b85b4035823d13ed0a78c0d3%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/7865be64b85b4035823d13ed0a78c0d3/images/large/7.jpg not downloaded yet
2026-03-26 22:47:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/b9637912dc054098a3db21ea8cb813e0/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/9817443283084a1bb181713a76532336/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76eff50>
2026-03-26 22:47:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe663be6-9724-57b4-b3f9-c897ef50756e/fe663be6-9724-57b4-b3f9-c897ef50756e_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F9817443283084a1bb181713a76532336%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/9817443283084a1bb181713a76532336/images/large/9.jpg saved to cache
2026-03-26 22:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fe663be6-9724-57b4-b3f9-c897ef50756e
2026-03-26 22:47:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/9817443283084a1bb181713a76532336/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/7c113e01f0e84339bc54731ec915b719/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F7865be64b85b4035823d13ed0a78c0d3%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/7865be64b85b4035823d13ed0a78c0d3/images/large/8.jpg not downloaded yet
2026-03-26 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F7865be64b85b4035823d13ed0a78c0d3%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/7865be64b85b4035823d13ed0a78c0d3/images/large/9.jpg not downloaded yet
2026-03-26 22:47:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c6a9d0>
2026-03-26 22:47:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d58c301-dab2-5aa2-8d0a-a5d15dbc93e3/9d58c301-dab2-5aa2-8d0a-a5d15dbc93e3_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F7c113e01f0e84339bc54731ec915b719%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/7c113e01f0e84339bc54731ec915b719/images/large/1.jpg saved to cache
2026-03-26 22:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9d58c301-dab2-5aa2-8d0a-a5d15dbc93e3
2026-03-26 22:47:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6da5990>
2026-03-26 22:47:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fda00ae2-cb85-5aaf-8fae-4fc7773133b1/fda00ae2-cb85-5aaf-8fae-4fc7773133b1_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dw%252F66be59447e6d4eed9e9c717c747f5eb9%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dw/66be59447e6d4eed9e9c717c747f5eb9/images/large/5.jpg saved to cache
2026-03-26 22:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fda00ae2-cb85-5aaf-8fae-4fc7773133b1
2026-03-26 22:47:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fda00ae2-cb85-5aaf-8fae-4fc7773133b1, skipping ID generation
2026-03-26 22:47:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fda00ae2-cb85-5aaf-8fae-4fc7773133b1 with scrape type 1
2026-03-26 22:47:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fda00ae2-cb85-5aaf-8fae-4fc7773133b1 sending to next pipeline
2026-03-26 22:47:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: fda00ae2-cb85-5aaf-8fae-4fc7773133b1, identifier: 1986096
2026-03-26 22:47:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74147d0>
2026-03-26 22:47:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe663be6-9724-57b4-b3f9-c897ef50756e/fe663be6-9724-57b4-b3f9-c897ef50756e_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F9817443283084a1bb181713a76532336%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/9817443283084a1bb181713a76532336/images/large/8.jpg saved to cache
2026-03-26 22:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fe663be6-9724-57b4-b3f9-c897ef50756e
2026-03-26 22:47:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76ee150>
2026-03-26 22:47:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61b6d6b6-83de-527e-a30b-7d1dcea0a6a2/61b6d6b6-83de-527e-a30b-7d1dcea0a6a2_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fb9637912dc054098a3db21ea8cb813e0%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/b9637912dc054098a3db21ea8cb813e0/images/large/6.jpg saved to cache
2026-03-26 22:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 61b6d6b6-83de-527e-a30b-7d1dcea0a6a2
2026-03-26 22:47:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7417950>
2026-03-26 22:47:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe663be6-9724-57b4-b3f9-c897ef50756e/fe663be6-9724-57b4-b3f9-c897ef50756e_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F9817443283084a1bb181713a76532336%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/9817443283084a1bb181713a76532336/images/large/10.jpg saved to cache
2026-03-26 22:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fe663be6-9724-57b4-b3f9-c897ef50756e
2026-03-26 22:47:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: fda00ae2-cb85-5aaf-8fae-4fc7773133b1 with identifier: 1986096
2026-03-26 22:47:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: fda00ae2-cb85-5aaf-8fae-4fc7773133b1 with identifier: 1986096
2026-03-26 22:47:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: fda00ae2-cb85-5aaf-8fae-4fc7773133b1 with identifier: 1986096 to the API
2026-03-26 22:47:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:47:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:47:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2dw/66be59447e6d4eed9e9c717c747f5eb9/images/large/5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'fda00ae2-cb85-5aaf-8fae-4fc7773133b1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF VIII',
 'odometer': 55309,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fda00ae2-cb85-5aaf-8fae-4fc7773133b1/fda00ae2-cb85-5aaf-8fae-4fc7773133b1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 641884,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dw/66be59447e6d4eed9e9c717c747f5eb9/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fda00ae2-cb85-5aaf-8fae-4fc7773133b1/fda00ae2-cb85-5aaf-8fae-4fc7773133b1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 642842,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dw/66be59447e6d4eed9e9c717c747f5eb9/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fda00ae2-cb85-5aaf-8fae-4fc7773133b1/fda00ae2-cb85-5aaf-8fae-4fc7773133b1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 718270,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dw/66be59447e6d4eed9e9c717c747f5eb9/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fda00ae2-cb85-5aaf-8fae-4fc7773133b1/fda00ae2-cb85-5aaf-8fae-4fc7773133b1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 603895,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dw/66be59447e6d4eed9e9c717c747f5eb9/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fda00ae2-cb85-5aaf-8fae-4fc7773133b1/fda00ae2-cb85-5aaf-8fae-4fc7773133b1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 590547,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dw/66be59447e6d4eed9e9c717c747f5eb9/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fda00ae2-cb85-5aaf-8fae-4fc7773133b1/fda00ae2-cb85-5aaf-8fae-4fc7773133b1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 617825,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dw/66be59447e6d4eed9e9c717c747f5eb9/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fda00ae2-cb85-5aaf-8fae-4fc7773133b1/fda00ae2-cb85-5aaf-8fae-4fc7773133b1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 658007,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dw/66be59447e6d4eed9e9c717c747f5eb9/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fda00ae2-cb85-5aaf-8fae-4fc7773133b1/fda00ae2-cb85-5aaf-8fae-4fc7773133b1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 615263,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dw/66be59447e6d4eed9e9c717c747f5eb9/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fda00ae2-cb85-5aaf-8fae-4fc7773133b1/fda00ae2-cb85-5aaf-8fae-4fc7773133b1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 446624,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dw/66be59447e6d4eed9e9c717c747f5eb9/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fda00ae2-cb85-5aaf-8fae-4fc7773133b1/fda00ae2-cb85-5aaf-8fae-4fc7773133b1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 675187,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dw/66be59447e6d4eed9e9c717c747f5eb9/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF VIII 1.4 EHYBRID STYLE BUSINESS DSG',
 'transmission': 'automatic',
 'trim': '1.4 EHYBRID STYLE BUSINESS DSG',
 'vin': None,
 'year': 2023}
2026-03-26 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986096%27 HTTP/1.1" 200 None
2026-03-26 22:47:35 [ayvens.be] INFO: Saving data for 1986096: {'created_time': 1774565255.996619, 'last_price_update_time': 1774565255.996629, 'auction_closing_time': 1775028600.0}
2026-03-26 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986096') HTTP/1.1" 204 0
2026-03-26 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F7865be64b85b4035823d13ed0a78c0d3%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/7865be64b85b4035823d13ed0a78c0d3/images/large/10.jpg not downloaded yet
2026-03-26 22:47:36 [ayvens.be] INFO: Found listing with ID: 1986105
2026-03-26 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986105%27 HTTP/1.1" 200 None
2026-03-26 22:47:36 [ayvens.be] INFO: Scrape type for 1986105: 1
2026-03-26 22:47:36 [ayvens.be] INFO: Extracting data for car ID: 1986105
2026-03-26 22:47:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c1337cdc-52f0-5c11-b22c-b6e1006cb547 with identifier: 1986105
2026-03-26 22:47:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1337cdc-52f0-5c11-b22c-b6e1006cb547 with scrape type 1
2026-03-26 22:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c1337cdc-52f0-5c11-b22c-b6e1006cb547
2026-03-26 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fa147416fd5084e1fa03915e89785353a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/a147416fd5084e1fa03915e89785353a/images/large/1.jpg not downloaded yet
2026-03-26 22:47:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76c7350>
2026-03-26 22:47:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe663be6-9724-57b4-b3f9-c897ef50756e/fe663be6-9724-57b4-b3f9-c897ef50756e_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F9817443283084a1bb181713a76532336%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/9817443283084a1bb181713a76532336/images/large/6.jpg saved to cache
2026-03-26 22:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fe663be6-9724-57b4-b3f9-c897ef50756e
2026-03-26 22:47:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fe663be6-9724-57b4-b3f9-c897ef50756e, skipping ID generation
2026-03-26 22:47:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe663be6-9724-57b4-b3f9-c897ef50756e with scrape type 1
2026-03-26 22:47:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fe663be6-9724-57b4-b3f9-c897ef50756e sending to next pipeline
2026-03-26 22:47:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: fe663be6-9724-57b4-b3f9-c897ef50756e, identifier: 1986102
2026-03-26 22:47:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c5c650>
2026-03-26 22:47:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d58c301-dab2-5aa2-8d0a-a5d15dbc93e3/9d58c301-dab2-5aa2-8d0a-a5d15dbc93e3_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F7c113e01f0e84339bc54731ec915b719%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/7c113e01f0e84339bc54731ec915b719/images/large/4.jpg saved to cache
2026-03-26 22:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9d58c301-dab2-5aa2-8d0a-a5d15dbc93e3
2026-03-26 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fa147416fd5084e1fa03915e89785353a%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/a147416fd5084e1fa03915e89785353a/images/large/2.jpg not downloaded yet
2026-03-26 22:47:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: fe663be6-9724-57b4-b3f9-c897ef50756e with identifier: 1986102
2026-03-26 22:47:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: fe663be6-9724-57b4-b3f9-c897ef50756e with identifier: 1986102
2026-03-26 22:47:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: fe663be6-9724-57b4-b3f9-c897ef50756e with identifier: 1986102 to the API
2026-03-26 22:47:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:47:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:47:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bm/9817443283084a1bb181713a76532336/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'fe663be6-9724-57b4-b3f9-c897ef50756e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '508',
 'odometer': 86792,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe663be6-9724-57b4-b3f9-c897ef50756e/fe663be6-9724-57b4-b3f9-c897ef50756e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 651756,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/9817443283084a1bb181713a76532336/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe663be6-9724-57b4-b3f9-c897ef50756e/fe663be6-9724-57b4-b3f9-c897ef50756e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 661409,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/9817443283084a1bb181713a76532336/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe663be6-9724-57b4-b3f9-c897ef50756e/fe663be6-9724-57b4-b3f9-c897ef50756e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 636344,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/9817443283084a1bb181713a76532336/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe663be6-9724-57b4-b3f9-c897ef50756e/fe663be6-9724-57b4-b3f9-c897ef50756e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 689687,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/9817443283084a1bb181713a76532336/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe663be6-9724-57b4-b3f9-c897ef50756e/fe663be6-9724-57b4-b3f9-c897ef50756e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 611310,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/9817443283084a1bb181713a76532336/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe663be6-9724-57b4-b3f9-c897ef50756e/fe663be6-9724-57b4-b3f9-c897ef50756e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 598245,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/9817443283084a1bb181713a76532336/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe663be6-9724-57b4-b3f9-c897ef50756e/fe663be6-9724-57b4-b3f9-c897ef50756e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 649933,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/9817443283084a1bb181713a76532336/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe663be6-9724-57b4-b3f9-c897ef50756e/fe663be6-9724-57b4-b3f9-c897ef50756e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 682470,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/9817443283084a1bb181713a76532336/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe663be6-9724-57b4-b3f9-c897ef50756e/fe663be6-9724-57b4-b3f9-c897ef50756e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 562021,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/9817443283084a1bb181713a76532336/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe663be6-9724-57b4-b3f9-c897ef50756e/fe663be6-9724-57b4-b3f9-c897ef50756e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 560565,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/9817443283084a1bb181713a76532336/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 508 1.6 PHEV 225 E-AUTO ALLURE',
 'transmission': 'automatic',
 'trim': '1.6 PHEV 225 E-AUTO ALLURE',
 'vin': None,
 'year': 2022}
2026-03-26 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986102%27 HTTP/1.1" 200 None
2026-03-26 22:47:36 [ayvens.be] INFO: Saving data for 1986102: {'created_time': 1774565256.677537, 'last_price_update_time': 1774565256.677547, 'auction_closing_time': 1775028600.0}
2026-03-26 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986102') HTTP/1.1" 204 0
2026-03-26 22:47:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/7c113e01f0e84339bc54731ec915b719/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/7c113e01f0e84339bc54731ec915b719/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/7c113e01f0e84339bc54731ec915b719/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fa147416fd5084e1fa03915e89785353a%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/a147416fd5084e1fa03915e89785353a/images/large/3.jpg not downloaded yet
2026-03-26 22:47:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/7c113e01f0e84339bc54731ec915b719/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/7c113e01f0e84339bc54731ec915b719/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fa147416fd5084e1fa03915e89785353a%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/a147416fd5084e1fa03915e89785353a/images/large/4.jpg not downloaded yet
2026-03-26 22:47:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/7c113e01f0e84339bc54731ec915b719/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/7c113e01f0e84339bc54731ec915b719/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/7c113e01f0e84339bc54731ec915b719/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fa147416fd5084e1fa03915e89785353a%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/a147416fd5084e1fa03915e89785353a/images/large/5.jpg not downloaded yet
2026-03-26 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fa147416fd5084e1fa03915e89785353a%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/a147416fd5084e1fa03915e89785353a/images/large/6.jpg not downloaded yet
2026-03-26 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fa147416fd5084e1fa03915e89785353a%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/a147416fd5084e1fa03915e89785353a/images/large/7.jpg not downloaded yet
2026-03-26 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fa147416fd5084e1fa03915e89785353a%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/a147416fd5084e1fa03915e89785353a/images/large/8.jpg not downloaded yet
2026-03-26 22:47:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76c7f50>
2026-03-26 22:47:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d58c301-dab2-5aa2-8d0a-a5d15dbc93e3/9d58c301-dab2-5aa2-8d0a-a5d15dbc93e3_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F7c113e01f0e84339bc54731ec915b719%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/7c113e01f0e84339bc54731ec915b719/images/large/5.jpg saved to cache
2026-03-26 22:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9d58c301-dab2-5aa2-8d0a-a5d15dbc93e3
2026-03-26 22:47:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd3c6b90>
2026-03-26 22:47:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d58c301-dab2-5aa2-8d0a-a5d15dbc93e3/9d58c301-dab2-5aa2-8d0a-a5d15dbc93e3_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F7c113e01f0e84339bc54731ec915b719%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/7c113e01f0e84339bc54731ec915b719/images/large/3.jpg saved to cache
2026-03-26 22:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9d58c301-dab2-5aa2-8d0a-a5d15dbc93e3
2026-03-26 22:47:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7591d90>
2026-03-26 22:47:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d58c301-dab2-5aa2-8d0a-a5d15dbc93e3/9d58c301-dab2-5aa2-8d0a-a5d15dbc93e3_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F7c113e01f0e84339bc54731ec915b719%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/7c113e01f0e84339bc54731ec915b719/images/large/6.jpg saved to cache
2026-03-26 22:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9d58c301-dab2-5aa2-8d0a-a5d15dbc93e3
2026-03-26 22:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fa147416fd5084e1fa03915e89785353a%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/a147416fd5084e1fa03915e89785353a/images/large/9.jpg not downloaded yet
2026-03-26 22:47:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e16dd0>
2026-03-26 22:47:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d58c301-dab2-5aa2-8d0a-a5d15dbc93e3/9d58c301-dab2-5aa2-8d0a-a5d15dbc93e3_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F7c113e01f0e84339bc54731ec915b719%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/7c113e01f0e84339bc54731ec915b719/images/large/9.jpg saved to cache
2026-03-26 22:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9d58c301-dab2-5aa2-8d0a-a5d15dbc93e3
2026-03-26 22:47:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7591b90>
2026-03-26 22:47:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d58c301-dab2-5aa2-8d0a-a5d15dbc93e3/9d58c301-dab2-5aa2-8d0a-a5d15dbc93e3_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F7c113e01f0e84339bc54731ec915b719%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/7c113e01f0e84339bc54731ec915b719/images/large/8.jpg saved to cache
2026-03-26 22:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9d58c301-dab2-5aa2-8d0a-a5d15dbc93e3
2026-03-26 22:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fa147416fd5084e1fa03915e89785353a%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/a147416fd5084e1fa03915e89785353a/images/large/10.jpg not downloaded yet
2026-03-26 22:47:37 [ayvens.be] INFO: Found listing with ID: 1986106
2026-03-26 22:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986106%27 HTTP/1.1" 200 None
2026-03-26 22:47:37 [ayvens.be] INFO: Scrape type for 1986106: 1
2026-03-26 22:47:37 [ayvens.be] INFO: Extracting data for car ID: 1986106
2026-03-26 22:47:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 85f1fb64-95ba-570e-a94a-6ccd7fe7ebfd with identifier: 1986106
2026-03-26 22:47:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85f1fb64-95ba-570e-a94a-6ccd7fe7ebfd with scrape type 1
2026-03-26 22:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 85f1fb64-95ba-570e-a94a-6ccd7fe7ebfd
2026-03-26 22:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fcd239e26d5ef4b22baa24c0910c51f54%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/cd239e26d5ef4b22baa24c0910c51f54/images/large/1.jpg not downloaded yet
2026-03-26 22:47:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b75a4e90>
2026-03-26 22:47:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d58c301-dab2-5aa2-8d0a-a5d15dbc93e3/9d58c301-dab2-5aa2-8d0a-a5d15dbc93e3_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F7c113e01f0e84339bc54731ec915b719%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/7c113e01f0e84339bc54731ec915b719/images/large/7.jpg saved to cache
2026-03-26 22:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9d58c301-dab2-5aa2-8d0a-a5d15dbc93e3
2026-03-26 22:47:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74f9e90>
2026-03-26 22:47:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d58c301-dab2-5aa2-8d0a-a5d15dbc93e3/9d58c301-dab2-5aa2-8d0a-a5d15dbc93e3_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F7c113e01f0e84339bc54731ec915b719%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/7c113e01f0e84339bc54731ec915b719/images/large/2.jpg saved to cache
2026-03-26 22:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9d58c301-dab2-5aa2-8d0a-a5d15dbc93e3
2026-03-26 22:47:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b746f1d0>
2026-03-26 22:47:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d58c301-dab2-5aa2-8d0a-a5d15dbc93e3/9d58c301-dab2-5aa2-8d0a-a5d15dbc93e3_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F7c113e01f0e84339bc54731ec915b719%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/7c113e01f0e84339bc54731ec915b719/images/large/10.jpg saved to cache
2026-03-26 22:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9d58c301-dab2-5aa2-8d0a-a5d15dbc93e3
2026-03-26 22:47:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9d58c301-dab2-5aa2-8d0a-a5d15dbc93e3, skipping ID generation
2026-03-26 22:47:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d58c301-dab2-5aa2-8d0a-a5d15dbc93e3 with scrape type 1
2026-03-26 22:47:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9d58c301-dab2-5aa2-8d0a-a5d15dbc93e3 sending to next pipeline
2026-03-26 22:47:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 9d58c301-dab2-5aa2-8d0a-a5d15dbc93e3, identifier: 1986103
2026-03-26 22:47:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 9d58c301-dab2-5aa2-8d0a-a5d15dbc93e3 with identifier: 1986103
2026-03-26 22:47:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 9d58c301-dab2-5aa2-8d0a-a5d15dbc93e3 with identifier: 1986103
2026-03-26 22:47:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 9d58c301-dab2-5aa2-8d0a-a5d15dbc93e3 with identifier: 1986103 to the API
2026-03-26 22:47:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:47:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:47:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bq/7c113e01f0e84339bc54731ec915b719/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '9d58c301-dab2-5aa2-8d0a-a5d15dbc93e3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLA SHOOTING BRAKE',
 'odometer': 15063,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d58c301-dab2-5aa2-8d0a-a5d15dbc93e3/9d58c301-dab2-5aa2-8d0a-a5d15dbc93e3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 596358,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/7c113e01f0e84339bc54731ec915b719/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d58c301-dab2-5aa2-8d0a-a5d15dbc93e3/9d58c301-dab2-5aa2-8d0a-a5d15dbc93e3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 591307,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/7c113e01f0e84339bc54731ec915b719/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d58c301-dab2-5aa2-8d0a-a5d15dbc93e3/9d58c301-dab2-5aa2-8d0a-a5d15dbc93e3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 586441,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/7c113e01f0e84339bc54731ec915b719/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d58c301-dab2-5aa2-8d0a-a5d15dbc93e3/9d58c301-dab2-5aa2-8d0a-a5d15dbc93e3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 592654,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/7c113e01f0e84339bc54731ec915b719/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d58c301-dab2-5aa2-8d0a-a5d15dbc93e3/9d58c301-dab2-5aa2-8d0a-a5d15dbc93e3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 526357,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/7c113e01f0e84339bc54731ec915b719/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d58c301-dab2-5aa2-8d0a-a5d15dbc93e3/9d58c301-dab2-5aa2-8d0a-a5d15dbc93e3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 613030,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/7c113e01f0e84339bc54731ec915b719/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d58c301-dab2-5aa2-8d0a-a5d15dbc93e3/9d58c301-dab2-5aa2-8d0a-a5d15dbc93e3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 590061,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/7c113e01f0e84339bc54731ec915b719/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d58c301-dab2-5aa2-8d0a-a5d15dbc93e3/9d58c301-dab2-5aa2-8d0a-a5d15dbc93e3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 582903,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/7c113e01f0e84339bc54731ec915b719/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d58c301-dab2-5aa2-8d0a-a5d15dbc93e3/9d58c301-dab2-5aa2-8d0a-a5d15dbc93e3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 502254,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/7c113e01f0e84339bc54731ec915b719/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d58c301-dab2-5aa2-8d0a-a5d15dbc93e3/9d58c301-dab2-5aa2-8d0a-a5d15dbc93e3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 615069,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/7c113e01f0e84339bc54731ec915b719/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLA SHOOTING BRAKE 1.3 CLA 250 E BUSINESS SOLUTION '
          'DCT',
 'transmission': 'automatic',
 'trim': '1.3 CLA 250 E BUSINESS SOLUTION DCT',
 'vin': None,
 'year': 2022}
2026-03-26 22:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986103%27 HTTP/1.1" 200 None
2026-03-26 22:47:37 [ayvens.be] INFO: Saving data for 1986103: {'created_time': 1774565257.955792, 'last_price_update_time': 1774565257.955801, 'auction_closing_time': 1775028600.0}
2026-03-26 22:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986103') HTTP/1.1" 204 0
2026-03-26 22:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fcd239e26d5ef4b22baa24c0910c51f54%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/cd239e26d5ef4b22baa24c0910c51f54/images/large/2.jpg not downloaded yet
2026-03-26 22:47:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/7865be64b85b4035823d13ed0a78c0d3/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/7865be64b85b4035823d13ed0a78c0d3/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/7865be64b85b4035823d13ed0a78c0d3/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fcd239e26d5ef4b22baa24c0910c51f54%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/cd239e26d5ef4b22baa24c0910c51f54/images/large/3.jpg not downloaded yet
2026-03-26 22:47:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/7865be64b85b4035823d13ed0a78c0d3/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/7865be64b85b4035823d13ed0a78c0d3/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/7865be64b85b4035823d13ed0a78c0d3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/7865be64b85b4035823d13ed0a78c0d3/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fcd239e26d5ef4b22baa24c0910c51f54%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/cd239e26d5ef4b22baa24c0910c51f54/images/large/4.jpg not downloaded yet
2026-03-26 22:47:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/7865be64b85b4035823d13ed0a78c0d3/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fcd239e26d5ef4b22baa24c0910c51f54%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/cd239e26d5ef4b22baa24c0910c51f54/images/large/5.jpg not downloaded yet
2026-03-26 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fcd239e26d5ef4b22baa24c0910c51f54%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/cd239e26d5ef4b22baa24c0910c51f54/images/large/6.jpg not downloaded yet
2026-03-26 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fcd239e26d5ef4b22baa24c0910c51f54%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/cd239e26d5ef4b22baa24c0910c51f54/images/large/7.jpg not downloaded yet
2026-03-26 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fcd239e26d5ef4b22baa24c0910c51f54%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/cd239e26d5ef4b22baa24c0910c51f54/images/large/8.jpg not downloaded yet
2026-03-26 22:47:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7415290>
2026-03-26 22:47:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26ad01cb-b78b-5f5e-b11d-de81424be4a4/26ad01cb-b78b-5f5e-b11d-de81424be4a4_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F7865be64b85b4035823d13ed0a78c0d3%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/7865be64b85b4035823d13ed0a78c0d3/images/large/5.jpg saved to cache
2026-03-26 22:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 26ad01cb-b78b-5f5e-b11d-de81424be4a4
2026-03-26 22:47:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7773ed0>
2026-03-26 22:47:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26ad01cb-b78b-5f5e-b11d-de81424be4a4/26ad01cb-b78b-5f5e-b11d-de81424be4a4_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F7865be64b85b4035823d13ed0a78c0d3%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/7865be64b85b4035823d13ed0a78c0d3/images/large/4.jpg saved to cache
2026-03-26 22:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 26ad01cb-b78b-5f5e-b11d-de81424be4a4
2026-03-26 22:47:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7ce9190>
2026-03-26 22:47:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26ad01cb-b78b-5f5e-b11d-de81424be4a4/26ad01cb-b78b-5f5e-b11d-de81424be4a4_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F7865be64b85b4035823d13ed0a78c0d3%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/7865be64b85b4035823d13ed0a78c0d3/images/large/2.jpg saved to cache
2026-03-26 22:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 26ad01cb-b78b-5f5e-b11d-de81424be4a4
2026-03-26 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fcd239e26d5ef4b22baa24c0910c51f54%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/cd239e26d5ef4b22baa24c0910c51f54/images/large/9.jpg not downloaded yet
2026-03-26 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fcd239e26d5ef4b22baa24c0910c51f54%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/cd239e26d5ef4b22baa24c0910c51f54/images/large/10.jpg not downloaded yet
2026-03-26 22:47:38 [ayvens.be] INFO: Found listing with ID: 1986107
2026-03-26 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986107%27 HTTP/1.1" 200 None
2026-03-26 22:47:38 [ayvens.be] INFO: Scrape type for 1986107: 1
2026-03-26 22:47:38 [ayvens.be] INFO: Extracting data for car ID: 1986107
2026-03-26 22:47:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 044d959a-eef7-583f-bf76-18ca8f11cefa with identifier: 1986107
2026-03-26 22:47:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 044d959a-eef7-583f-bf76-18ca8f11cefa with scrape type 1
2026-03-26 22:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 044d959a-eef7-583f-bf76-18ca8f11cefa
2026-03-26 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F0549aeca407a42faacaba818eb58f1a4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/0549aeca407a42faacaba818eb58f1a4/images/large/1.jpg not downloaded yet
2026-03-26 22:47:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cc88d0>
2026-03-26 22:47:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26ad01cb-b78b-5f5e-b11d-de81424be4a4/26ad01cb-b78b-5f5e-b11d-de81424be4a4_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F7865be64b85b4035823d13ed0a78c0d3%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/7865be64b85b4035823d13ed0a78c0d3/images/large/3.jpg saved to cache
2026-03-26 22:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 26ad01cb-b78b-5f5e-b11d-de81424be4a4
2026-03-26 22:47:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd0d16d0>
2026-03-26 22:47:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26ad01cb-b78b-5f5e-b11d-de81424be4a4/26ad01cb-b78b-5f5e-b11d-de81424be4a4_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F7865be64b85b4035823d13ed0a78c0d3%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/7865be64b85b4035823d13ed0a78c0d3/images/large/6.jpg saved to cache
2026-03-26 22:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 26ad01cb-b78b-5f5e-b11d-de81424be4a4
2026-03-26 22:47:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79a5ad0>
2026-03-26 22:47:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26ad01cb-b78b-5f5e-b11d-de81424be4a4/26ad01cb-b78b-5f5e-b11d-de81424be4a4_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F7865be64b85b4035823d13ed0a78c0d3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/7865be64b85b4035823d13ed0a78c0d3/images/large/1.jpg saved to cache
2026-03-26 22:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 26ad01cb-b78b-5f5e-b11d-de81424be4a4
2026-03-26 22:47:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79cd9d0>
2026-03-26 22:47:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26ad01cb-b78b-5f5e-b11d-de81424be4a4/26ad01cb-b78b-5f5e-b11d-de81424be4a4_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F7865be64b85b4035823d13ed0a78c0d3%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/7865be64b85b4035823d13ed0a78c0d3/images/large/7.jpg saved to cache
2026-03-26 22:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 26ad01cb-b78b-5f5e-b11d-de81424be4a4
2026-03-26 22:47:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79a4e10>
2026-03-26 22:47:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26ad01cb-b78b-5f5e-b11d-de81424be4a4/26ad01cb-b78b-5f5e-b11d-de81424be4a4_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F7865be64b85b4035823d13ed0a78c0d3%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/7865be64b85b4035823d13ed0a78c0d3/images/large/8.jpg saved to cache
2026-03-26 22:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 26ad01cb-b78b-5f5e-b11d-de81424be4a4
2026-03-26 22:47:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/a147416fd5084e1fa03915e89785353a/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F0549aeca407a42faacaba818eb58f1a4%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/0549aeca407a42faacaba818eb58f1a4/images/large/2.jpg not downloaded yet
2026-03-26 22:47:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/a147416fd5084e1fa03915e89785353a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/7865be64b85b4035823d13ed0a78c0d3/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/7865be64b85b4035823d13ed0a78c0d3/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F0549aeca407a42faacaba818eb58f1a4%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/0549aeca407a42faacaba818eb58f1a4/images/large/3.jpg not downloaded yet
2026-03-26 22:47:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/a147416fd5084e1fa03915e89785353a/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/a147416fd5084e1fa03915e89785353a/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/a147416fd5084e1fa03915e89785353a/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F0549aeca407a42faacaba818eb58f1a4%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/0549aeca407a42faacaba818eb58f1a4/images/large/4.jpg not downloaded yet
2026-03-26 22:47:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/b9637912dc054098a3db21ea8cb813e0/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F0549aeca407a42faacaba818eb58f1a4%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/0549aeca407a42faacaba818eb58f1a4/images/large/5.jpg not downloaded yet
2026-03-26 22:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F0549aeca407a42faacaba818eb58f1a4%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/0549aeca407a42faacaba818eb58f1a4/images/large/6.jpg not downloaded yet
2026-03-26 22:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F0549aeca407a42faacaba818eb58f1a4%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/0549aeca407a42faacaba818eb58f1a4/images/large/7.jpg not downloaded yet
2026-03-26 22:47:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b726a850>
2026-03-26 22:47:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1337cdc-52f0-5c11-b22c-b6e1006cb547/c1337cdc-52f0-5c11-b22c-b6e1006cb547_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fa147416fd5084e1fa03915e89785353a%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/a147416fd5084e1fa03915e89785353a/images/large/2.jpg saved to cache
2026-03-26 22:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c1337cdc-52f0-5c11-b22c-b6e1006cb547
2026-03-26 22:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F0549aeca407a42faacaba818eb58f1a4%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/0549aeca407a42faacaba818eb58f1a4/images/large/8.jpg not downloaded yet
2026-03-26 22:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F0549aeca407a42faacaba818eb58f1a4%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/0549aeca407a42faacaba818eb58f1a4/images/large/9.jpg not downloaded yet
2026-03-26 22:47:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b725d850>
2026-03-26 22:47:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1337cdc-52f0-5c11-b22c-b6e1006cb547/c1337cdc-52f0-5c11-b22c-b6e1006cb547_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fa147416fd5084e1fa03915e89785353a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/a147416fd5084e1fa03915e89785353a/images/large/1.jpg saved to cache
2026-03-26 22:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c1337cdc-52f0-5c11-b22c-b6e1006cb547
2026-03-26 22:47:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b78c2350>
2026-03-26 22:47:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26ad01cb-b78b-5f5e-b11d-de81424be4a4/26ad01cb-b78b-5f5e-b11d-de81424be4a4_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F7865be64b85b4035823d13ed0a78c0d3%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/7865be64b85b4035823d13ed0a78c0d3/images/large/10.jpg saved to cache
2026-03-26 22:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 26ad01cb-b78b-5f5e-b11d-de81424be4a4
2026-03-26 22:47:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b784dbd0>
2026-03-26 22:47:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26ad01cb-b78b-5f5e-b11d-de81424be4a4/26ad01cb-b78b-5f5e-b11d-de81424be4a4_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F7865be64b85b4035823d13ed0a78c0d3%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/7865be64b85b4035823d13ed0a78c0d3/images/large/9.jpg saved to cache
2026-03-26 22:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 26ad01cb-b78b-5f5e-b11d-de81424be4a4
2026-03-26 22:47:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 26ad01cb-b78b-5f5e-b11d-de81424be4a4, skipping ID generation
2026-03-26 22:47:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26ad01cb-b78b-5f5e-b11d-de81424be4a4 with scrape type 1
2026-03-26 22:47:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 26ad01cb-b78b-5f5e-b11d-de81424be4a4 sending to next pipeline
2026-03-26 22:47:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 26ad01cb-b78b-5f5e-b11d-de81424be4a4, identifier: 1986104
2026-03-26 22:47:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b72fd810>
2026-03-26 22:47:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1337cdc-52f0-5c11-b22c-b6e1006cb547/c1337cdc-52f0-5c11-b22c-b6e1006cb547_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fa147416fd5084e1fa03915e89785353a%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/a147416fd5084e1fa03915e89785353a/images/large/5.jpg saved to cache
2026-03-26 22:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c1337cdc-52f0-5c11-b22c-b6e1006cb547
2026-03-26 22:47:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77e8410>
2026-03-26 22:47:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1337cdc-52f0-5c11-b22c-b6e1006cb547/c1337cdc-52f0-5c11-b22c-b6e1006cb547_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fa147416fd5084e1fa03915e89785353a%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/a147416fd5084e1fa03915e89785353a/images/large/3.jpg saved to cache
2026-03-26 22:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c1337cdc-52f0-5c11-b22c-b6e1006cb547
2026-03-26 22:47:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b75a64d0>
2026-03-26 22:47:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1337cdc-52f0-5c11-b22c-b6e1006cb547/c1337cdc-52f0-5c11-b22c-b6e1006cb547_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fa147416fd5084e1fa03915e89785353a%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/a147416fd5084e1fa03915e89785353a/images/large/4.jpg saved to cache
2026-03-26 22:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c1337cdc-52f0-5c11-b22c-b6e1006cb547
2026-03-26 22:47:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e10f50>
2026-03-26 22:47:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61b6d6b6-83de-527e-a30b-7d1dcea0a6a2/61b6d6b6-83de-527e-a30b-7d1dcea0a6a2_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fb9637912dc054098a3db21ea8cb813e0%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/b9637912dc054098a3db21ea8cb813e0/images/large/5.jpg saved to cache
2026-03-26 22:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 61b6d6b6-83de-527e-a30b-7d1dcea0a6a2
2026-03-26 22:47:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 61b6d6b6-83de-527e-a30b-7d1dcea0a6a2, skipping ID generation
2026-03-26 22:47:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61b6d6b6-83de-527e-a30b-7d1dcea0a6a2 with scrape type 1
2026-03-26 22:47:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 61b6d6b6-83de-527e-a30b-7d1dcea0a6a2 sending to next pipeline
2026-03-26 22:47:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 61b6d6b6-83de-527e-a30b-7d1dcea0a6a2, identifier: 1986095
2026-03-26 22:47:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 26ad01cb-b78b-5f5e-b11d-de81424be4a4 with identifier: 1986104
2026-03-26 22:47:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 26ad01cb-b78b-5f5e-b11d-de81424be4a4 with identifier: 1986104
2026-03-26 22:47:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 26ad01cb-b78b-5f5e-b11d-de81424be4a4 with identifier: 1986104 to the API
2026-03-26 22:47:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:47:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:47:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bq/7865be64b85b4035823d13ed0a78c0d3/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '26ad01cb-b78b-5f5e-b11d-de81424be4a4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'KODIAQ',
 'odometer': 115482,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26ad01cb-b78b-5f5e-b11d-de81424be4a4/26ad01cb-b78b-5f5e-b11d-de81424be4a4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 609999,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/7865be64b85b4035823d13ed0a78c0d3/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26ad01cb-b78b-5f5e-b11d-de81424be4a4/26ad01cb-b78b-5f5e-b11d-de81424be4a4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 594478,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/7865be64b85b4035823d13ed0a78c0d3/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26ad01cb-b78b-5f5e-b11d-de81424be4a4/26ad01cb-b78b-5f5e-b11d-de81424be4a4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 570478,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/7865be64b85b4035823d13ed0a78c0d3/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26ad01cb-b78b-5f5e-b11d-de81424be4a4/26ad01cb-b78b-5f5e-b11d-de81424be4a4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 637954,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/7865be64b85b4035823d13ed0a78c0d3/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26ad01cb-b78b-5f5e-b11d-de81424be4a4/26ad01cb-b78b-5f5e-b11d-de81424be4a4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 587771,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/7865be64b85b4035823d13ed0a78c0d3/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26ad01cb-b78b-5f5e-b11d-de81424be4a4/26ad01cb-b78b-5f5e-b11d-de81424be4a4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 571066,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/7865be64b85b4035823d13ed0a78c0d3/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26ad01cb-b78b-5f5e-b11d-de81424be4a4/26ad01cb-b78b-5f5e-b11d-de81424be4a4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 637553,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/7865be64b85b4035823d13ed0a78c0d3/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26ad01cb-b78b-5f5e-b11d-de81424be4a4/26ad01cb-b78b-5f5e-b11d-de81424be4a4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 691178,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/7865be64b85b4035823d13ed0a78c0d3/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26ad01cb-b78b-5f5e-b11d-de81424be4a4/26ad01cb-b78b-5f5e-b11d-de81424be4a4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 496203,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/7865be64b85b4035823d13ed0a78c0d3/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26ad01cb-b78b-5f5e-b11d-de81424be4a4/26ad01cb-b78b-5f5e-b11d-de81424be4a4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 592020,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/7865be64b85b4035823d13ed0a78c0d3/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA KODIAQ 2.0 CRTDI 110KW DSG7 4WD CLEVER',
 'transmission': 'automatic',
 'trim': '2.0 CRTDI 110KW DSG7 4WD CLEVER',
 'vin': None,
 'year': 2022}
2026-03-26 22:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986104%27 HTTP/1.1" 200 None
2026-03-26 22:47:40 [ayvens.be] INFO: Saving data for 1986104: {'created_time': 1774565260.519678, 'last_price_update_time': 1774565260.519688, 'auction_closing_time': 1775028600.0}
2026-03-26 22:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986104') HTTP/1.1" 204 0
2026-03-26 22:47:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 61b6d6b6-83de-527e-a30b-7d1dcea0a6a2 with identifier: 1986095
2026-03-26 22:47:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 61b6d6b6-83de-527e-a30b-7d1dcea0a6a2 with identifier: 1986095
2026-03-26 22:47:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 61b6d6b6-83de-527e-a30b-7d1dcea0a6a2 with identifier: 1986095 to the API
2026-03-26 22:47:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:47:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:47:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bs/b9637912dc054098a3db21ea8cb813e0/images/large/5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '61b6d6b6-83de-527e-a30b-7d1dcea0a6a2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'V60',
 'odometer': 188584,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61b6d6b6-83de-527e-a30b-7d1dcea0a6a2/61b6d6b6-83de-527e-a30b-7d1dcea0a6a2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 591397,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/b9637912dc054098a3db21ea8cb813e0/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61b6d6b6-83de-527e-a30b-7d1dcea0a6a2/61b6d6b6-83de-527e-a30b-7d1dcea0a6a2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 598518,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/b9637912dc054098a3db21ea8cb813e0/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61b6d6b6-83de-527e-a30b-7d1dcea0a6a2/61b6d6b6-83de-527e-a30b-7d1dcea0a6a2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 592381,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/b9637912dc054098a3db21ea8cb813e0/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61b6d6b6-83de-527e-a30b-7d1dcea0a6a2/61b6d6b6-83de-527e-a30b-7d1dcea0a6a2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 646767,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/b9637912dc054098a3db21ea8cb813e0/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61b6d6b6-83de-527e-a30b-7d1dcea0a6a2/61b6d6b6-83de-527e-a30b-7d1dcea0a6a2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 656791,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/b9637912dc054098a3db21ea8cb813e0/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61b6d6b6-83de-527e-a30b-7d1dcea0a6a2/61b6d6b6-83de-527e-a30b-7d1dcea0a6a2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 596425,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/b9637912dc054098a3db21ea8cb813e0/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61b6d6b6-83de-527e-a30b-7d1dcea0a6a2/61b6d6b6-83de-527e-a30b-7d1dcea0a6a2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 709328,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/b9637912dc054098a3db21ea8cb813e0/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61b6d6b6-83de-527e-a30b-7d1dcea0a6a2/61b6d6b6-83de-527e-a30b-7d1dcea0a6a2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 614783,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/b9637912dc054098a3db21ea8cb813e0/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61b6d6b6-83de-527e-a30b-7d1dcea0a6a2/61b6d6b6-83de-527e-a30b-7d1dcea0a6a2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 542461,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/b9637912dc054098a3db21ea8cb813e0/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61b6d6b6-83de-527e-a30b-7d1dcea0a6a2/61b6d6b6-83de-527e-a30b-7d1dcea0a6a2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 634252,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/b9637912dc054098a3db21ea8cb813e0/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO V60 2.0 B3 MHEV MOMENTUM PRO AUTO',
 'transmission': 'automatic',
 'trim': '2.0 B3 MHEV MOMENTUM PRO AUTO',
 'vin': None,
 'year': 2022}
2026-03-26 22:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986095%27 HTTP/1.1" 200 None
2026-03-26 22:47:40 [ayvens.be] INFO: Saving data for 1986095: {'created_time': 1774565260.904431, 'last_price_update_time': 1774565260.90444, 'auction_closing_time': 1775028600.0}
2026-03-26 22:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986095') HTTP/1.1" 204 0
2026-03-26 22:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F0549aeca407a42faacaba818eb58f1a4%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/0549aeca407a42faacaba818eb58f1a4/images/large/10.jpg not downloaded yet
2026-03-26 22:47:40 [ayvens.be] INFO: Found listing with ID: 1986108
2026-03-26 22:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986108%27 HTTP/1.1" 200 None
2026-03-26 22:47:40 [ayvens.be] INFO: Scrape type for 1986108: 1
2026-03-26 22:47:40 [ayvens.be] INFO: Extracting data for car ID: 1986108
2026-03-26 22:47:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c69b35c-520e-512b-907d-80a9f87c56ee with identifier: 1986108
2026-03-26 22:47:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c69b35c-520e-512b-907d-80a9f87c56ee with scrape type 1
2026-03-26 22:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2c69b35c-520e-512b-907d-80a9f87c56ee
2026-03-26 22:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xs%252F2274dc0dee944819bf6280edd89bb3d8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xs/2274dc0dee944819bf6280edd89bb3d8/images/large/1.jpg not downloaded yet
2026-03-26 22:47:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/cd239e26d5ef4b22baa24c0910c51f54/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/cd239e26d5ef4b22baa24c0910c51f54/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xs%252F2274dc0dee944819bf6280edd89bb3d8%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xs/2274dc0dee944819bf6280edd89bb3d8/images/large/2.jpg not downloaded yet
2026-03-26 22:47:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/cd239e26d5ef4b22baa24c0910c51f54/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/cd239e26d5ef4b22baa24c0910c51f54/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xs%252F2274dc0dee944819bf6280edd89bb3d8%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xs/2274dc0dee944819bf6280edd89bb3d8/images/large/3.jpg not downloaded yet
2026-03-26 22:47:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/a147416fd5084e1fa03915e89785353a/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/cd239e26d5ef4b22baa24c0910c51f54/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/a147416fd5084e1fa03915e89785353a/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/a147416fd5084e1fa03915e89785353a/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xs%252F2274dc0dee944819bf6280edd89bb3d8%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xs/2274dc0dee944819bf6280edd89bb3d8/images/large/4.jpg not downloaded yet
2026-03-26 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xs%252F2274dc0dee944819bf6280edd89bb3d8%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xs/2274dc0dee944819bf6280edd89bb3d8/images/large/5.jpg not downloaded yet
2026-03-26 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xs%252F2274dc0dee944819bf6280edd89bb3d8%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xs/2274dc0dee944819bf6280edd89bb3d8/images/large/6.jpg not downloaded yet
2026-03-26 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xs%252F2274dc0dee944819bf6280edd89bb3d8%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xs/2274dc0dee944819bf6280edd89bb3d8/images/large/7.jpg not downloaded yet
2026-03-26 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xs%252F2274dc0dee944819bf6280edd89bb3d8%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xs/2274dc0dee944819bf6280edd89bb3d8/images/large/8.jpg not downloaded yet
2026-03-26 22:47:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd3bb850>
2026-03-26 22:47:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85f1fb64-95ba-570e-a94a-6ccd7fe7ebfd/85f1fb64-95ba-570e-a94a-6ccd7fe7ebfd_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fcd239e26d5ef4b22baa24c0910c51f54%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/cd239e26d5ef4b22baa24c0910c51f54/images/large/2.jpg saved to cache
2026-03-26 22:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 85f1fb64-95ba-570e-a94a-6ccd7fe7ebfd
2026-03-26 22:47:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c75a10>
2026-03-26 22:47:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85f1fb64-95ba-570e-a94a-6ccd7fe7ebfd/85f1fb64-95ba-570e-a94a-6ccd7fe7ebfd_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fcd239e26d5ef4b22baa24c0910c51f54%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/cd239e26d5ef4b22baa24c0910c51f54/images/large/9.jpg saved to cache
2026-03-26 22:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 85f1fb64-95ba-570e-a94a-6ccd7fe7ebfd
2026-03-26 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xs%252F2274dc0dee944819bf6280edd89bb3d8%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xs/2274dc0dee944819bf6280edd89bb3d8/images/large/9.jpg not downloaded yet
2026-03-26 22:47:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b781a0d0>
2026-03-26 22:47:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85f1fb64-95ba-570e-a94a-6ccd7fe7ebfd/85f1fb64-95ba-570e-a94a-6ccd7fe7ebfd_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fcd239e26d5ef4b22baa24c0910c51f54%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/cd239e26d5ef4b22baa24c0910c51f54/images/large/8.jpg saved to cache
2026-03-26 22:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 85f1fb64-95ba-570e-a94a-6ccd7fe7ebfd
2026-03-26 22:47:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7663810>
2026-03-26 22:47:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85f1fb64-95ba-570e-a94a-6ccd7fe7ebfd/85f1fb64-95ba-570e-a94a-6ccd7fe7ebfd_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fcd239e26d5ef4b22baa24c0910c51f54%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/cd239e26d5ef4b22baa24c0910c51f54/images/large/1.jpg saved to cache
2026-03-26 22:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 85f1fb64-95ba-570e-a94a-6ccd7fe7ebfd
2026-03-26 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xs%252F2274dc0dee944819bf6280edd89bb3d8%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xs/2274dc0dee944819bf6280edd89bb3d8/images/large/10.jpg not downloaded yet
2026-03-26 22:47:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/0549aeca407a42faacaba818eb58f1a4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:41 [ayvens.be] INFO: Found listing with ID: 1986109
2026-03-26 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986109%27 HTTP/1.1" 200 None
2026-03-26 22:47:41 [ayvens.be] INFO: Scrape type for 1986109: 1
2026-03-26 22:47:41 [ayvens.be] INFO: Extracting data for car ID: 1986109
2026-03-26 22:47:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 200aebf9-af41-5b65-8832-43f5d7dfd460 with identifier: 1986109
2026-03-26 22:47:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 200aebf9-af41-5b65-8832-43f5d7dfd460 with scrape type 1
2026-03-26 22:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 200aebf9-af41-5b65-8832-43f5d7dfd460
2026-03-26 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252F143a431a8b164c17a155a14952a42e7d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/143a431a8b164c17a155a14952a42e7d/images/large/1.jpg not downloaded yet
2026-03-26 22:47:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c5ea50>
2026-03-26 22:47:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1337cdc-52f0-5c11-b22c-b6e1006cb547/c1337cdc-52f0-5c11-b22c-b6e1006cb547_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fa147416fd5084e1fa03915e89785353a%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/a147416fd5084e1fa03915e89785353a/images/large/9.jpg saved to cache
2026-03-26 22:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c1337cdc-52f0-5c11-b22c-b6e1006cb547
2026-03-26 22:47:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74de2d0>
2026-03-26 22:47:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85f1fb64-95ba-570e-a94a-6ccd7fe7ebfd/85f1fb64-95ba-570e-a94a-6ccd7fe7ebfd_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fcd239e26d5ef4b22baa24c0910c51f54%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/cd239e26d5ef4b22baa24c0910c51f54/images/large/7.jpg saved to cache
2026-03-26 22:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 85f1fb64-95ba-570e-a94a-6ccd7fe7ebfd
2026-03-26 22:47:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e16dd0>
2026-03-26 22:47:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1337cdc-52f0-5c11-b22c-b6e1006cb547/c1337cdc-52f0-5c11-b22c-b6e1006cb547_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fa147416fd5084e1fa03915e89785353a%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/a147416fd5084e1fa03915e89785353a/images/large/8.jpg saved to cache
2026-03-26 22:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c1337cdc-52f0-5c11-b22c-b6e1006cb547
2026-03-26 22:47:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e1ca90>
2026-03-26 22:47:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1337cdc-52f0-5c11-b22c-b6e1006cb547/c1337cdc-52f0-5c11-b22c-b6e1006cb547_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fa147416fd5084e1fa03915e89785353a%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/a147416fd5084e1fa03915e89785353a/images/large/10.jpg saved to cache
2026-03-26 22:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c1337cdc-52f0-5c11-b22c-b6e1006cb547
2026-03-26 22:47:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/0549aeca407a42faacaba818eb58f1a4/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252F143a431a8b164c17a155a14952a42e7d%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/143a431a8b164c17a155a14952a42e7d/images/large/2.jpg not downloaded yet
2026-03-26 22:47:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/cd239e26d5ef4b22baa24c0910c51f54/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/cd239e26d5ef4b22baa24c0910c51f54/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/0549aeca407a42faacaba818eb58f1a4/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252F143a431a8b164c17a155a14952a42e7d%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/143a431a8b164c17a155a14952a42e7d/images/large/3.jpg not downloaded yet
2026-03-26 22:47:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/0549aeca407a42faacaba818eb58f1a4/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/0549aeca407a42faacaba818eb58f1a4/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79a57d0>
2026-03-26 22:47:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_044d959a-eef7-583f-bf76-18ca8f11cefa/044d959a-eef7-583f-bf76-18ca8f11cefa_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F0549aeca407a42faacaba818eb58f1a4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/0549aeca407a42faacaba818eb58f1a4/images/large/1.jpg saved to cache
2026-03-26 22:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 044d959a-eef7-583f-bf76-18ca8f11cefa
2026-03-26 22:47:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/0549aeca407a42faacaba818eb58f1a4/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252F143a431a8b164c17a155a14952a42e7d%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/143a431a8b164c17a155a14952a42e7d/images/large/4.jpg not downloaded yet
2026-03-26 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252F143a431a8b164c17a155a14952a42e7d%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/143a431a8b164c17a155a14952a42e7d/images/large/5.jpg not downloaded yet
2026-03-26 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252F143a431a8b164c17a155a14952a42e7d%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/143a431a8b164c17a155a14952a42e7d/images/large/6.jpg not downloaded yet
2026-03-26 22:47:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b782c5d0>
2026-03-26 22:47:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_044d959a-eef7-583f-bf76-18ca8f11cefa/044d959a-eef7-583f-bf76-18ca8f11cefa_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F0549aeca407a42faacaba818eb58f1a4%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/0549aeca407a42faacaba818eb58f1a4/images/large/2.jpg saved to cache
2026-03-26 22:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 044d959a-eef7-583f-bf76-18ca8f11cefa
2026-03-26 22:47:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b787c4d0>
2026-03-26 22:47:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85f1fb64-95ba-570e-a94a-6ccd7fe7ebfd/85f1fb64-95ba-570e-a94a-6ccd7fe7ebfd_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fcd239e26d5ef4b22baa24c0910c51f54%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/cd239e26d5ef4b22baa24c0910c51f54/images/large/10.jpg saved to cache
2026-03-26 22:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 85f1fb64-95ba-570e-a94a-6ccd7fe7ebfd
2026-03-26 22:47:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6dc0350>
2026-03-26 22:47:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85f1fb64-95ba-570e-a94a-6ccd7fe7ebfd/85f1fb64-95ba-570e-a94a-6ccd7fe7ebfd_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fcd239e26d5ef4b22baa24c0910c51f54%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/cd239e26d5ef4b22baa24c0910c51f54/images/large/6.jpg saved to cache
2026-03-26 22:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 85f1fb64-95ba-570e-a94a-6ccd7fe7ebfd
2026-03-26 22:47:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7924110>
2026-03-26 22:47:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_044d959a-eef7-583f-bf76-18ca8f11cefa/044d959a-eef7-583f-bf76-18ca8f11cefa_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F0549aeca407a42faacaba818eb58f1a4%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/0549aeca407a42faacaba818eb58f1a4/images/large/5.jpg saved to cache
2026-03-26 22:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 044d959a-eef7-583f-bf76-18ca8f11cefa
2026-03-26 22:47:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd0d1e90>
2026-03-26 22:47:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_044d959a-eef7-583f-bf76-18ca8f11cefa/044d959a-eef7-583f-bf76-18ca8f11cefa_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F0549aeca407a42faacaba818eb58f1a4%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/0549aeca407a42faacaba818eb58f1a4/images/large/8.jpg saved to cache
2026-03-26 22:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 044d959a-eef7-583f-bf76-18ca8f11cefa
2026-03-26 22:47:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b75924d0>
2026-03-26 22:47:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_044d959a-eef7-583f-bf76-18ca8f11cefa/044d959a-eef7-583f-bf76-18ca8f11cefa_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F0549aeca407a42faacaba818eb58f1a4%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/0549aeca407a42faacaba818eb58f1a4/images/large/6.jpg saved to cache
2026-03-26 22:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 044d959a-eef7-583f-bf76-18ca8f11cefa
2026-03-26 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252F143a431a8b164c17a155a14952a42e7d%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/143a431a8b164c17a155a14952a42e7d/images/large/7.jpg not downloaded yet
2026-03-26 22:47:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/0549aeca407a42faacaba818eb58f1a4/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/0549aeca407a42faacaba818eb58f1a4/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252F143a431a8b164c17a155a14952a42e7d%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/143a431a8b164c17a155a14952a42e7d/images/large/8.jpg not downloaded yet
2026-03-26 22:47:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7591310>
2026-03-26 22:47:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_044d959a-eef7-583f-bf76-18ca8f11cefa/044d959a-eef7-583f-bf76-18ca8f11cefa_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F0549aeca407a42faacaba818eb58f1a4%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/0549aeca407a42faacaba818eb58f1a4/images/large/7.jpg saved to cache
2026-03-26 22:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 044d959a-eef7-583f-bf76-18ca8f11cefa
2026-03-26 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252F143a431a8b164c17a155a14952a42e7d%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/143a431a8b164c17a155a14952a42e7d/images/large/9.jpg not downloaded yet
2026-03-26 22:47:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xs/2274dc0dee944819bf6280edd89bb3d8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252F143a431a8b164c17a155a14952a42e7d%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/143a431a8b164c17a155a14952a42e7d/images/large/10.jpg not downloaded yet
2026-03-26 22:47:42 [ayvens.be] INFO: Found listing with ID: 1986110
2026-03-26 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986110%27 HTTP/1.1" 200 None
2026-03-26 22:47:42 [ayvens.be] INFO: Scrape type for 1986110: 1
2026-03-26 22:47:42 [ayvens.be] INFO: Extracting data for car ID: 1986110
2026-03-26 22:47:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 101d4a91-593b-5171-a207-9f994ad6bf13 with identifier: 1986110
2026-03-26 22:47:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 101d4a91-593b-5171-a207-9f994ad6bf13 with scrape type 1
2026-03-26 22:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 101d4a91-593b-5171-a207-9f994ad6bf13
2026-03-26 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F0283d760790f4ae7ad28362e5f5f2c88%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/0283d760790f4ae7ad28362e5f5f2c88/images/large/1.jpg not downloaded yet
2026-03-26 22:47:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7ccc3d0>
2026-03-26 22:47:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_044d959a-eef7-583f-bf76-18ca8f11cefa/044d959a-eef7-583f-bf76-18ca8f11cefa_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F0549aeca407a42faacaba818eb58f1a4%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/0549aeca407a42faacaba818eb58f1a4/images/large/10.jpg saved to cache
2026-03-26 22:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 044d959a-eef7-583f-bf76-18ca8f11cefa
2026-03-26 22:47:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7435250>
2026-03-26 22:47:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_044d959a-eef7-583f-bf76-18ca8f11cefa/044d959a-eef7-583f-bf76-18ca8f11cefa_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F0549aeca407a42faacaba818eb58f1a4%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/0549aeca407a42faacaba818eb58f1a4/images/large/9.jpg saved to cache
2026-03-26 22:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 044d959a-eef7-583f-bf76-18ca8f11cefa
2026-03-26 22:47:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xs/2274dc0dee944819bf6280edd89bb3d8/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/0549aeca407a42faacaba818eb58f1a4/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F0283d760790f4ae7ad28362e5f5f2c88%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/0283d760790f4ae7ad28362e5f5f2c88/images/large/2.jpg not downloaded yet
2026-03-26 22:47:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/0549aeca407a42faacaba818eb58f1a4/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F0283d760790f4ae7ad28362e5f5f2c88%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/0283d760790f4ae7ad28362e5f5f2c88/images/large/3.jpg not downloaded yet
2026-03-26 22:47:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b746d950>
2026-03-26 22:47:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c69b35c-520e-512b-907d-80a9f87c56ee/2c69b35c-520e-512b-907d-80a9f87c56ee_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xs%252F2274dc0dee944819bf6280edd89bb3d8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xs/2274dc0dee944819bf6280edd89bb3d8/images/large/1.jpg saved to cache
2026-03-26 22:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2c69b35c-520e-512b-907d-80a9f87c56ee
2026-03-26 22:47:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xs/2274dc0dee944819bf6280edd89bb3d8/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xs/2274dc0dee944819bf6280edd89bb3d8/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F0283d760790f4ae7ad28362e5f5f2c88%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/0283d760790f4ae7ad28362e5f5f2c88/images/large/4.jpg not downloaded yet
2026-03-26 22:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F0283d760790f4ae7ad28362e5f5f2c88%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/0283d760790f4ae7ad28362e5f5f2c88/images/large/5.jpg not downloaded yet
2026-03-26 22:47:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ym/143a431a8b164c17a155a14952a42e7d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xs/2274dc0dee944819bf6280edd89bb3d8/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F0283d760790f4ae7ad28362e5f5f2c88%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/0283d760790f4ae7ad28362e5f5f2c88/images/large/6.jpg not downloaded yet
2026-03-26 22:47:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7474750>
2026-03-26 22:47:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c69b35c-520e-512b-907d-80a9f87c56ee/2c69b35c-520e-512b-907d-80a9f87c56ee_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xs%252F2274dc0dee944819bf6280edd89bb3d8%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xs/2274dc0dee944819bf6280edd89bb3d8/images/large/2.jpg saved to cache
2026-03-26 22:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2c69b35c-520e-512b-907d-80a9f87c56ee
2026-03-26 22:47:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7278250>
2026-03-26 22:47:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_044d959a-eef7-583f-bf76-18ca8f11cefa/044d959a-eef7-583f-bf76-18ca8f11cefa_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F0549aeca407a42faacaba818eb58f1a4%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/0549aeca407a42faacaba818eb58f1a4/images/large/4.jpg saved to cache
2026-03-26 22:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 044d959a-eef7-583f-bf76-18ca8f11cefa
2026-03-26 22:47:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74037d0>
2026-03-26 22:47:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_044d959a-eef7-583f-bf76-18ca8f11cefa/044d959a-eef7-583f-bf76-18ca8f11cefa_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F0549aeca407a42faacaba818eb58f1a4%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/0549aeca407a42faacaba818eb58f1a4/images/large/3.jpg saved to cache
2026-03-26 22:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 044d959a-eef7-583f-bf76-18ca8f11cefa
2026-03-26 22:47:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 044d959a-eef7-583f-bf76-18ca8f11cefa, skipping ID generation
2026-03-26 22:47:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 044d959a-eef7-583f-bf76-18ca8f11cefa with scrape type 1
2026-03-26 22:47:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 044d959a-eef7-583f-bf76-18ca8f11cefa sending to next pipeline
2026-03-26 22:47:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 044d959a-eef7-583f-bf76-18ca8f11cefa, identifier: 1986107
2026-03-26 22:47:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 044d959a-eef7-583f-bf76-18ca8f11cefa with identifier: 1986107
2026-03-26 22:47:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 044d959a-eef7-583f-bf76-18ca8f11cefa with identifier: 1986107
2026-03-26 22:47:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 044d959a-eef7-583f-bf76-18ca8f11cefa with identifier: 1986107 to the API
2026-03-26 22:47:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:47:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:47:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bp/0549aeca407a42faacaba818eb58f1a4/images/large/3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '044d959a-eef7-583f-bf76-18ca8f11cefa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'NIRO',
 'odometer': 86950,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 18,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_044d959a-eef7-583f-bf76-18ca8f11cefa/044d959a-eef7-583f-bf76-18ca8f11cefa_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 626154,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/0549aeca407a42faacaba818eb58f1a4/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_044d959a-eef7-583f-bf76-18ca8f11cefa/044d959a-eef7-583f-bf76-18ca8f11cefa_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 608976,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/0549aeca407a42faacaba818eb58f1a4/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_044d959a-eef7-583f-bf76-18ca8f11cefa/044d959a-eef7-583f-bf76-18ca8f11cefa_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 737668,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/0549aeca407a42faacaba818eb58f1a4/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_044d959a-eef7-583f-bf76-18ca8f11cefa/044d959a-eef7-583f-bf76-18ca8f11cefa_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 659251,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/0549aeca407a42faacaba818eb58f1a4/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_044d959a-eef7-583f-bf76-18ca8f11cefa/044d959a-eef7-583f-bf76-18ca8f11cefa_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 582211,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/0549aeca407a42faacaba818eb58f1a4/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_044d959a-eef7-583f-bf76-18ca8f11cefa/044d959a-eef7-583f-bf76-18ca8f11cefa_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 572453,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/0549aeca407a42faacaba818eb58f1a4/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_044d959a-eef7-583f-bf76-18ca8f11cefa/044d959a-eef7-583f-bf76-18ca8f11cefa_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 738610,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/0549aeca407a42faacaba818eb58f1a4/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_044d959a-eef7-583f-bf76-18ca8f11cefa/044d959a-eef7-583f-bf76-18ca8f11cefa_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 651098,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/0549aeca407a42faacaba818eb58f1a4/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_044d959a-eef7-583f-bf76-18ca8f11cefa/044d959a-eef7-583f-bf76-18ca8f11cefa_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 471261,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/0549aeca407a42faacaba818eb58f1a4/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_044d959a-eef7-583f-bf76-18ca8f11cefa/044d959a-eef7-583f-bf76-18ca8f11cefa_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 565914,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/0549aeca407a42faacaba818eb58f1a4/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA NIRO 1.6 GDI PHEV PULSE',
 'transmission': 'automatic',
 'trim': '1.6 GDI PHEV PULSE',
 'vin': None,
 'year': 2022}
2026-03-26 22:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986107%27 HTTP/1.1" 200 None
2026-03-26 22:47:44 [ayvens.be] INFO: Saving data for 1986107: {'created_time': 1774565264.095872, 'last_price_update_time': 1774565264.095882, 'auction_closing_time': 1775028600.0}
2026-03-26 22:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986107') HTTP/1.1" 204 0
2026-03-26 22:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F0283d760790f4ae7ad28362e5f5f2c88%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/0283d760790f4ae7ad28362e5f5f2c88/images/large/7.jpg not downloaded yet
2026-03-26 22:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F0283d760790f4ae7ad28362e5f5f2c88%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/0283d760790f4ae7ad28362e5f5f2c88/images/large/8.jpg not downloaded yet
2026-03-26 22:47:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xs/2274dc0dee944819bf6280edd89bb3d8/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ym/143a431a8b164c17a155a14952a42e7d/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7279a50>
2026-03-26 22:47:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c69b35c-520e-512b-907d-80a9f87c56ee/2c69b35c-520e-512b-907d-80a9f87c56ee_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xs%252F2274dc0dee944819bf6280edd89bb3d8%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xs/2274dc0dee944819bf6280edd89bb3d8/images/large/8.jpg saved to cache
2026-03-26 22:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2c69b35c-520e-512b-907d-80a9f87c56ee
2026-03-26 22:47:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79de310>
2026-03-26 22:47:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c69b35c-520e-512b-907d-80a9f87c56ee/2c69b35c-520e-512b-907d-80a9f87c56ee_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xs%252F2274dc0dee944819bf6280edd89bb3d8%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xs/2274dc0dee944819bf6280edd89bb3d8/images/large/9.jpg saved to cache
2026-03-26 22:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2c69b35c-520e-512b-907d-80a9f87c56ee
2026-03-26 22:47:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b777bc10>
2026-03-26 22:47:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_200aebf9-af41-5b65-8832-43f5d7dfd460/200aebf9-af41-5b65-8832-43f5d7dfd460_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252F143a431a8b164c17a155a14952a42e7d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/143a431a8b164c17a155a14952a42e7d/images/large/1.jpg saved to cache
2026-03-26 22:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 200aebf9-af41-5b65-8832-43f5d7dfd460
2026-03-26 22:47:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b741f690>
2026-03-26 22:47:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c69b35c-520e-512b-907d-80a9f87c56ee/2c69b35c-520e-512b-907d-80a9f87c56ee_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xs%252F2274dc0dee944819bf6280edd89bb3d8%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xs/2274dc0dee944819bf6280edd89bb3d8/images/large/7.jpg saved to cache
2026-03-26 22:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2c69b35c-520e-512b-907d-80a9f87c56ee
2026-03-26 22:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F0283d760790f4ae7ad28362e5f5f2c88%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/0283d760790f4ae7ad28362e5f5f2c88/images/large/9.jpg not downloaded yet
2026-03-26 22:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F0283d760790f4ae7ad28362e5f5f2c88%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/0283d760790f4ae7ad28362e5f5f2c88/images/large/10.jpg not downloaded yet
2026-03-26 22:47:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7769110>
2026-03-26 22:47:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c69b35c-520e-512b-907d-80a9f87c56ee/2c69b35c-520e-512b-907d-80a9f87c56ee_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xs%252F2274dc0dee944819bf6280edd89bb3d8%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xs/2274dc0dee944819bf6280edd89bb3d8/images/large/10.jpg saved to cache
2026-03-26 22:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2c69b35c-520e-512b-907d-80a9f87c56ee
2026-03-26 22:47:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd3ac290>
2026-03-26 22:47:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_200aebf9-af41-5b65-8832-43f5d7dfd460/200aebf9-af41-5b65-8832-43f5d7dfd460_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252F143a431a8b164c17a155a14952a42e7d%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/143a431a8b164c17a155a14952a42e7d/images/large/2.jpg saved to cache
2026-03-26 22:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 200aebf9-af41-5b65-8832-43f5d7dfd460
2026-03-26 22:47:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xs/2274dc0dee944819bf6280edd89bb3d8/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ym/143a431a8b164c17a155a14952a42e7d/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:44 [ayvens.be] INFO: Found listing with ID: 1986111
2026-03-26 22:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986111%27 HTTP/1.1" 200 None
2026-03-26 22:47:44 [ayvens.be] INFO: Scrape type for 1986111: 1
2026-03-26 22:47:44 [ayvens.be] INFO: Extracting data for car ID: 1986111
2026-03-26 22:47:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 38b6522c-3b16-5915-8240-889381cbcf12 with identifier: 1986111
2026-03-26 22:47:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38b6522c-3b16-5915-8240-889381cbcf12 with scrape type 1
2026-03-26 22:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 38b6522c-3b16-5915-8240-889381cbcf12
2026-03-26 22:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fa1c64c3b40a24a14b37841df476fc572%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/a1c64c3b40a24a14b37841df476fc572/images/large/1.jpg not downloaded yet
2026-03-26 22:47:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ym/143a431a8b164c17a155a14952a42e7d/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xs/2274dc0dee944819bf6280edd89bb3d8/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xs/2274dc0dee944819bf6280edd89bb3d8/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ym/143a431a8b164c17a155a14952a42e7d/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fa1c64c3b40a24a14b37841df476fc572%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/a1c64c3b40a24a14b37841df476fc572/images/large/2.jpg not downloaded yet
2026-03-26 22:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fa1c64c3b40a24a14b37841df476fc572%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/a1c64c3b40a24a14b37841df476fc572/images/large/3.jpg not downloaded yet
2026-03-26 22:47:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b75a7c10>
2026-03-26 22:47:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c69b35c-520e-512b-907d-80a9f87c56ee/2c69b35c-520e-512b-907d-80a9f87c56ee_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xs%252F2274dc0dee944819bf6280edd89bb3d8%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xs/2274dc0dee944819bf6280edd89bb3d8/images/large/6.jpg saved to cache
2026-03-26 22:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2c69b35c-520e-512b-907d-80a9f87c56ee
2026-03-26 22:47:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74b7dd0>
2026-03-26 22:47:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_200aebf9-af41-5b65-8832-43f5d7dfd460/200aebf9-af41-5b65-8832-43f5d7dfd460_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252F143a431a8b164c17a155a14952a42e7d%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/143a431a8b164c17a155a14952a42e7d/images/large/4.jpg saved to cache
2026-03-26 22:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 200aebf9-af41-5b65-8832-43f5d7dfd460
2026-03-26 22:47:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/0283d760790f4ae7ad28362e5f5f2c88/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fa1c64c3b40a24a14b37841df476fc572%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/a1c64c3b40a24a14b37841df476fc572/images/large/4.jpg not downloaded yet
2026-03-26 22:47:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ym/143a431a8b164c17a155a14952a42e7d/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fa1c64c3b40a24a14b37841df476fc572%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/a1c64c3b40a24a14b37841df476fc572/images/large/5.jpg not downloaded yet
2026-03-26 22:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fa1c64c3b40a24a14b37841df476fc572%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/a1c64c3b40a24a14b37841df476fc572/images/large/6.jpg not downloaded yet
2026-03-26 22:47:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7592fd0>
2026-03-26 22:47:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_200aebf9-af41-5b65-8832-43f5d7dfd460/200aebf9-af41-5b65-8832-43f5d7dfd460_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252F143a431a8b164c17a155a14952a42e7d%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/143a431a8b164c17a155a14952a42e7d/images/large/6.jpg saved to cache
2026-03-26 22:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 200aebf9-af41-5b65-8832-43f5d7dfd460
2026-03-26 22:47:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7412c50>
2026-03-26 22:47:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c69b35c-520e-512b-907d-80a9f87c56ee/2c69b35c-520e-512b-907d-80a9f87c56ee_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xs%252F2274dc0dee944819bf6280edd89bb3d8%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xs/2274dc0dee944819bf6280edd89bb3d8/images/large/5.jpg saved to cache
2026-03-26 22:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2c69b35c-520e-512b-907d-80a9f87c56ee
2026-03-26 22:47:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5ca4090>
2026-03-26 22:47:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c69b35c-520e-512b-907d-80a9f87c56ee/2c69b35c-520e-512b-907d-80a9f87c56ee_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xs%252F2274dc0dee944819bf6280edd89bb3d8%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xs/2274dc0dee944819bf6280edd89bb3d8/images/large/4.jpg saved to cache
2026-03-26 22:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2c69b35c-520e-512b-907d-80a9f87c56ee
2026-03-26 22:47:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b781b090>
2026-03-26 22:47:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_200aebf9-af41-5b65-8832-43f5d7dfd460/200aebf9-af41-5b65-8832-43f5d7dfd460_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252F143a431a8b164c17a155a14952a42e7d%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/143a431a8b164c17a155a14952a42e7d/images/large/7.jpg saved to cache
2026-03-26 22:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 200aebf9-af41-5b65-8832-43f5d7dfd460
2026-03-26 22:47:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/0283d760790f4ae7ad28362e5f5f2c88/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/0283d760790f4ae7ad28362e5f5f2c88/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/0283d760790f4ae7ad28362e5f5f2c88/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fa1c64c3b40a24a14b37841df476fc572%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/a1c64c3b40a24a14b37841df476fc572/images/large/7.jpg not downloaded yet
2026-03-26 22:47:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ym/143a431a8b164c17a155a14952a42e7d/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/0283d760790f4ae7ad28362e5f5f2c88/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fa1c64c3b40a24a14b37841df476fc572%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/a1c64c3b40a24a14b37841df476fc572/images/large/8.jpg not downloaded yet
2026-03-26 22:47:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c6b010>
2026-03-26 22:47:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_101d4a91-593b-5171-a207-9f994ad6bf13/101d4a91-593b-5171-a207-9f994ad6bf13_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F0283d760790f4ae7ad28362e5f5f2c88%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/0283d760790f4ae7ad28362e5f5f2c88/images/large/1.jpg saved to cache
2026-03-26 22:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 101d4a91-593b-5171-a207-9f994ad6bf13
2026-03-26 22:47:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e14b50>
2026-03-26 22:47:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_200aebf9-af41-5b65-8832-43f5d7dfd460/200aebf9-af41-5b65-8832-43f5d7dfd460_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252F143a431a8b164c17a155a14952a42e7d%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/143a431a8b164c17a155a14952a42e7d/images/large/8.jpg saved to cache
2026-03-26 22:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 200aebf9-af41-5b65-8832-43f5d7dfd460
2026-03-26 22:47:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ym/143a431a8b164c17a155a14952a42e7d/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/0283d760790f4ae7ad28362e5f5f2c88/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fa1c64c3b40a24a14b37841df476fc572%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/a1c64c3b40a24a14b37841df476fc572/images/large/9.jpg not downloaded yet
2026-03-26 22:47:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/0283d760790f4ae7ad28362e5f5f2c88/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fa1c64c3b40a24a14b37841df476fc572%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/a1c64c3b40a24a14b37841df476fc572/images/large/10.jpg not downloaded yet
2026-03-26 22:47:45 [ayvens.be] INFO: Found listing with ID: 1986112
2026-03-26 22:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986112%27 HTTP/1.1" 200 None
2026-03-26 22:47:45 [ayvens.be] INFO: Scrape type for 1986112: 1
2026-03-26 22:47:45 [ayvens.be] INFO: Extracting data for car ID: 1986112
2026-03-26 22:47:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e1b696bd-cdc7-5c8f-a787-cc9fb6644017 with identifier: 1986112
2026-03-26 22:47:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e1b696bd-cdc7-5c8f-a787-cc9fb6644017 with scrape type 1
2026-03-26 22:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e1b696bd-cdc7-5c8f-a787-cc9fb6644017
2026-03-26 22:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Ff98b183446d04e7c97e0ccdec5428509%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/f98b183446d04e7c97e0ccdec5428509/images/large/1.jpg not downloaded yet
2026-03-26 22:47:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e10250>
2026-03-26 22:47:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_101d4a91-593b-5171-a207-9f994ad6bf13/101d4a91-593b-5171-a207-9f994ad6bf13_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F0283d760790f4ae7ad28362e5f5f2c88%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/0283d760790f4ae7ad28362e5f5f2c88/images/large/6.jpg saved to cache
2026-03-26 22:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 101d4a91-593b-5171-a207-9f994ad6bf13
2026-03-26 22:47:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7435d10>
2026-03-26 22:47:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_101d4a91-593b-5171-a207-9f994ad6bf13/101d4a91-593b-5171-a207-9f994ad6bf13_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F0283d760790f4ae7ad28362e5f5f2c88%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/0283d760790f4ae7ad28362e5f5f2c88/images/large/5.jpg saved to cache
2026-03-26 22:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 101d4a91-593b-5171-a207-9f994ad6bf13
2026-03-26 22:47:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e47110>
2026-03-26 22:47:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_101d4a91-593b-5171-a207-9f994ad6bf13/101d4a91-593b-5171-a207-9f994ad6bf13_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F0283d760790f4ae7ad28362e5f5f2c88%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/0283d760790f4ae7ad28362e5f5f2c88/images/large/3.jpg saved to cache
2026-03-26 22:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 101d4a91-593b-5171-a207-9f994ad6bf13
2026-03-26 22:47:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76eca10>
2026-03-26 22:47:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_200aebf9-af41-5b65-8832-43f5d7dfd460/200aebf9-af41-5b65-8832-43f5d7dfd460_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252F143a431a8b164c17a155a14952a42e7d%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/143a431a8b164c17a155a14952a42e7d/images/large/10.jpg saved to cache
2026-03-26 22:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 200aebf9-af41-5b65-8832-43f5d7dfd460
2026-03-26 22:47:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b740a3d0>
2026-03-26 22:47:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_101d4a91-593b-5171-a207-9f994ad6bf13/101d4a91-593b-5171-a207-9f994ad6bf13_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F0283d760790f4ae7ad28362e5f5f2c88%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/0283d760790f4ae7ad28362e5f5f2c88/images/large/2.jpg saved to cache
2026-03-26 22:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 101d4a91-593b-5171-a207-9f994ad6bf13
2026-03-26 22:47:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/0283d760790f4ae7ad28362e5f5f2c88/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/0283d760790f4ae7ad28362e5f5f2c88/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Ff98b183446d04e7c97e0ccdec5428509%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/f98b183446d04e7c97e0ccdec5428509/images/large/2.jpg not downloaded yet
2026-03-26 22:47:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/0283d760790f4ae7ad28362e5f5f2c88/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77c9690>
2026-03-26 22:47:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_200aebf9-af41-5b65-8832-43f5d7dfd460/200aebf9-af41-5b65-8832-43f5d7dfd460_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252F143a431a8b164c17a155a14952a42e7d%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/143a431a8b164c17a155a14952a42e7d/images/large/9.jpg saved to cache
2026-03-26 22:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 200aebf9-af41-5b65-8832-43f5d7dfd460
2026-03-26 22:47:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7453110>
2026-03-26 22:47:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_101d4a91-593b-5171-a207-9f994ad6bf13/101d4a91-593b-5171-a207-9f994ad6bf13_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F0283d760790f4ae7ad28362e5f5f2c88%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/0283d760790f4ae7ad28362e5f5f2c88/images/large/8.jpg saved to cache
2026-03-26 22:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 101d4a91-593b-5171-a207-9f994ad6bf13
2026-03-26 22:47:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b72ff950>
2026-03-26 22:47:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_101d4a91-593b-5171-a207-9f994ad6bf13/101d4a91-593b-5171-a207-9f994ad6bf13_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F0283d760790f4ae7ad28362e5f5f2c88%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/0283d760790f4ae7ad28362e5f5f2c88/images/large/7.jpg saved to cache
2026-03-26 22:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 101d4a91-593b-5171-a207-9f994ad6bf13
2026-03-26 22:47:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/a1c64c3b40a24a14b37841df476fc572/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Ff98b183446d04e7c97e0ccdec5428509%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/f98b183446d04e7c97e0ccdec5428509/images/large/3.jpg not downloaded yet
2026-03-26 22:47:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ym/143a431a8b164c17a155a14952a42e7d/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Ff98b183446d04e7c97e0ccdec5428509%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/f98b183446d04e7c97e0ccdec5428509/images/large/4.jpg not downloaded yet
2026-03-26 22:47:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79f9f10>
2026-03-26 22:47:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_101d4a91-593b-5171-a207-9f994ad6bf13/101d4a91-593b-5171-a207-9f994ad6bf13_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F0283d760790f4ae7ad28362e5f5f2c88%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/0283d760790f4ae7ad28362e5f5f2c88/images/large/4.jpg saved to cache
2026-03-26 22:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 101d4a91-593b-5171-a207-9f994ad6bf13
2026-03-26 22:47:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7770690>
2026-03-26 22:47:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_101d4a91-593b-5171-a207-9f994ad6bf13/101d4a91-593b-5171-a207-9f994ad6bf13_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F0283d760790f4ae7ad28362e5f5f2c88%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/0283d760790f4ae7ad28362e5f5f2c88/images/large/9.jpg saved to cache
2026-03-26 22:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 101d4a91-593b-5171-a207-9f994ad6bf13
2026-03-26 22:47:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6da6150>
2026-03-26 22:47:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_101d4a91-593b-5171-a207-9f994ad6bf13/101d4a91-593b-5171-a207-9f994ad6bf13_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F0283d760790f4ae7ad28362e5f5f2c88%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/0283d760790f4ae7ad28362e5f5f2c88/images/large/10.jpg saved to cache
2026-03-26 22:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 101d4a91-593b-5171-a207-9f994ad6bf13
2026-03-26 22:47:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 101d4a91-593b-5171-a207-9f994ad6bf13, skipping ID generation
2026-03-26 22:47:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 101d4a91-593b-5171-a207-9f994ad6bf13 with scrape type 1
2026-03-26 22:47:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 101d4a91-593b-5171-a207-9f994ad6bf13 sending to next pipeline
2026-03-26 22:47:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 101d4a91-593b-5171-a207-9f994ad6bf13, identifier: 1986110
2026-03-26 22:47:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 101d4a91-593b-5171-a207-9f994ad6bf13 with identifier: 1986110
2026-03-26 22:47:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 101d4a91-593b-5171-a207-9f994ad6bf13 with identifier: 1986110
2026-03-26 22:47:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 101d4a91-593b-5171-a207-9f994ad6bf13 with identifier: 1986110 to the API
2026-03-26 22:47:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:47:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:47:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bd/0283d760790f4ae7ad28362e5f5f2c88/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '101d4a91-593b-5171-a207-9f994ad6bf13',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLASS A (W177)',
 'odometer': 54907,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_101d4a91-593b-5171-a207-9f994ad6bf13/101d4a91-593b-5171-a207-9f994ad6bf13_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 425251,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/0283d760790f4ae7ad28362e5f5f2c88/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_101d4a91-593b-5171-a207-9f994ad6bf13/101d4a91-593b-5171-a207-9f994ad6bf13_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 406520,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/0283d760790f4ae7ad28362e5f5f2c88/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_101d4a91-593b-5171-a207-9f994ad6bf13/101d4a91-593b-5171-a207-9f994ad6bf13_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 390207,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/0283d760790f4ae7ad28362e5f5f2c88/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_101d4a91-593b-5171-a207-9f994ad6bf13/101d4a91-593b-5171-a207-9f994ad6bf13_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 358751,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/0283d760790f4ae7ad28362e5f5f2c88/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_101d4a91-593b-5171-a207-9f994ad6bf13/101d4a91-593b-5171-a207-9f994ad6bf13_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 310494,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/0283d760790f4ae7ad28362e5f5f2c88/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_101d4a91-593b-5171-a207-9f994ad6bf13/101d4a91-593b-5171-a207-9f994ad6bf13_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 284480,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/0283d760790f4ae7ad28362e5f5f2c88/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_101d4a91-593b-5171-a207-9f994ad6bf13/101d4a91-593b-5171-a207-9f994ad6bf13_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 378278,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/0283d760790f4ae7ad28362e5f5f2c88/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_101d4a91-593b-5171-a207-9f994ad6bf13/101d4a91-593b-5171-a207-9f994ad6bf13_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 326129,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/0283d760790f4ae7ad28362e5f5f2c88/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_101d4a91-593b-5171-a207-9f994ad6bf13/101d4a91-593b-5171-a207-9f994ad6bf13_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 344303,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/0283d760790f4ae7ad28362e5f5f2c88/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_101d4a91-593b-5171-a207-9f994ad6bf13/101d4a91-593b-5171-a207-9f994ad6bf13_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 434187,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/0283d760790f4ae7ad28362e5f5f2c88/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLASS A (W177) A 250 e PHEV Business Solution',
 'transmission': 'automatic',
 'trim': 'A 250 e PHEV Business Solution',
 'vin': None,
 'year': 2021}
2026-03-26 22:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986110%27 HTTP/1.1" 200 None
2026-03-26 22:47:47 [ayvens.be] INFO: Saving data for 1986110: {'created_time': 1774565267.52955, 'last_price_update_time': 1774565267.529558, 'auction_closing_time': 1775028600.0}
2026-03-26 22:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986110') HTTP/1.1" 204 0
2026-03-26 22:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Ff98b183446d04e7c97e0ccdec5428509%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/f98b183446d04e7c97e0ccdec5428509/images/large/5.jpg not downloaded yet
2026-03-26 22:47:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/a1c64c3b40a24a14b37841df476fc572/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/a1c64c3b40a24a14b37841df476fc572/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Ff98b183446d04e7c97e0ccdec5428509%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/f98b183446d04e7c97e0ccdec5428509/images/large/6.jpg not downloaded yet
2026-03-26 22:47:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ym/143a431a8b164c17a155a14952a42e7d/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b164d0>
2026-03-26 22:47:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38b6522c-3b16-5915-8240-889381cbcf12/38b6522c-3b16-5915-8240-889381cbcf12_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fa1c64c3b40a24a14b37841df476fc572%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/a1c64c3b40a24a14b37841df476fc572/images/large/1.jpg saved to cache
2026-03-26 22:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 38b6522c-3b16-5915-8240-889381cbcf12
2026-03-26 22:47:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7482450>
2026-03-26 22:47:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_200aebf9-af41-5b65-8832-43f5d7dfd460/200aebf9-af41-5b65-8832-43f5d7dfd460_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252F143a431a8b164c17a155a14952a42e7d%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/143a431a8b164c17a155a14952a42e7d/images/large/5.jpg saved to cache
2026-03-26 22:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 200aebf9-af41-5b65-8832-43f5d7dfd460
2026-03-26 22:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Ff98b183446d04e7c97e0ccdec5428509%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/f98b183446d04e7c97e0ccdec5428509/images/large/7.jpg not downloaded yet
2026-03-26 22:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Ff98b183446d04e7c97e0ccdec5428509%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/f98b183446d04e7c97e0ccdec5428509/images/large/8.jpg not downloaded yet
2026-03-26 22:47:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7727950>
2026-03-26 22:47:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38b6522c-3b16-5915-8240-889381cbcf12/38b6522c-3b16-5915-8240-889381cbcf12_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fa1c64c3b40a24a14b37841df476fc572%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/a1c64c3b40a24a14b37841df476fc572/images/large/3.jpg saved to cache
2026-03-26 22:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 38b6522c-3b16-5915-8240-889381cbcf12
2026-03-26 22:47:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5ca4d10>
2026-03-26 22:47:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38b6522c-3b16-5915-8240-889381cbcf12/38b6522c-3b16-5915-8240-889381cbcf12_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fa1c64c3b40a24a14b37841df476fc572%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/a1c64c3b40a24a14b37841df476fc572/images/large/4.jpg saved to cache
2026-03-26 22:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 38b6522c-3b16-5915-8240-889381cbcf12
2026-03-26 22:47:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79f9350>
2026-03-26 22:47:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_200aebf9-af41-5b65-8832-43f5d7dfd460/200aebf9-af41-5b65-8832-43f5d7dfd460_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252F143a431a8b164c17a155a14952a42e7d%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/143a431a8b164c17a155a14952a42e7d/images/large/3.jpg saved to cache
2026-03-26 22:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 200aebf9-af41-5b65-8832-43f5d7dfd460
2026-03-26 22:47:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 200aebf9-af41-5b65-8832-43f5d7dfd460, skipping ID generation
2026-03-26 22:47:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 200aebf9-af41-5b65-8832-43f5d7dfd460 with scrape type 1
2026-03-26 22:47:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 200aebf9-af41-5b65-8832-43f5d7dfd460 sending to next pipeline
2026-03-26 22:47:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 200aebf9-af41-5b65-8832-43f5d7dfd460, identifier: 1986109
2026-03-26 22:47:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 200aebf9-af41-5b65-8832-43f5d7dfd460 with identifier: 1986109
2026-03-26 22:47:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 200aebf9-af41-5b65-8832-43f5d7dfd460 with identifier: 1986109
2026-03-26 22:47:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 200aebf9-af41-5b65-8832-43f5d7dfd460 with identifier: 1986109 to the API
2026-03-26 22:47:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:47:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:47:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1ym/143a431a8b164c17a155a14952a42e7d/images/large/3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '200aebf9-af41-5b65-8832-43f5d7dfd460',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'OCTAVIA DIESEL - 2020',
 'odometer': 195310,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_200aebf9-af41-5b65-8832-43f5d7dfd460/200aebf9-af41-5b65-8832-43f5d7dfd460_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 568833,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ym/143a431a8b164c17a155a14952a42e7d/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_200aebf9-af41-5b65-8832-43f5d7dfd460/200aebf9-af41-5b65-8832-43f5d7dfd460_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 567881,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ym/143a431a8b164c17a155a14952a42e7d/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_200aebf9-af41-5b65-8832-43f5d7dfd460/200aebf9-af41-5b65-8832-43f5d7dfd460_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 607462,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ym/143a431a8b164c17a155a14952a42e7d/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_200aebf9-af41-5b65-8832-43f5d7dfd460/200aebf9-af41-5b65-8832-43f5d7dfd460_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 578196,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ym/143a431a8b164c17a155a14952a42e7d/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_200aebf9-af41-5b65-8832-43f5d7dfd460/200aebf9-af41-5b65-8832-43f5d7dfd460_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 564724,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ym/143a431a8b164c17a155a14952a42e7d/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_200aebf9-af41-5b65-8832-43f5d7dfd460/200aebf9-af41-5b65-8832-43f5d7dfd460_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 545793,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ym/143a431a8b164c17a155a14952a42e7d/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_200aebf9-af41-5b65-8832-43f5d7dfd460/200aebf9-af41-5b65-8832-43f5d7dfd460_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 612367,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ym/143a431a8b164c17a155a14952a42e7d/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_200aebf9-af41-5b65-8832-43f5d7dfd460/200aebf9-af41-5b65-8832-43f5d7dfd460_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 583768,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ym/143a431a8b164c17a155a14952a42e7d/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_200aebf9-af41-5b65-8832-43f5d7dfd460/200aebf9-af41-5b65-8832-43f5d7dfd460_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 611764,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ym/143a431a8b164c17a155a14952a42e7d/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_200aebf9-af41-5b65-8832-43f5d7dfd460/200aebf9-af41-5b65-8832-43f5d7dfd460_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 459481,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ym/143a431a8b164c17a155a14952a42e7d/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA OCTAVIA DIESEL - 2020 2.0 CR TDi EVO Ambition DSG',
 'transmission': 'automatic',
 'trim': '2.0 CR TDi EVO Ambition DSG',
 'vin': None,
 'year': 2020}
2026-03-26 22:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986109%27 HTTP/1.1" 200 None
2026-03-26 22:47:48 [ayvens.be] INFO: Saving data for 1986109: {'created_time': 1774565268.697338, 'last_price_update_time': 1774565268.697347, 'auction_closing_time': 1775028600.0}
2026-03-26 22:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986109') HTTP/1.1" 204 0
2026-03-26 22:47:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/a1c64c3b40a24a14b37841df476fc572/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/a1c64c3b40a24a14b37841df476fc572/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/a1c64c3b40a24a14b37841df476fc572/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Ff98b183446d04e7c97e0ccdec5428509%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/f98b183446d04e7c97e0ccdec5428509/images/large/9.jpg not downloaded yet
2026-03-26 22:47:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/cd239e26d5ef4b22baa24c0910c51f54/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xs/2274dc0dee944819bf6280edd89bb3d8/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Ff98b183446d04e7c97e0ccdec5428509%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/f98b183446d04e7c97e0ccdec5428509/images/large/10.jpg not downloaded yet
2026-03-26 22:47:48 [ayvens.be] INFO: Found listing with ID: 1986113
2026-03-26 22:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986113%27 HTTP/1.1" 200 None
2026-03-26 22:47:48 [ayvens.be] INFO: Scrape type for 1986113: 1
2026-03-26 22:47:48 [ayvens.be] INFO: Extracting data for car ID: 1986113
2026-03-26 22:47:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d09e213b-dcb3-5849-8c5a-aff923d9a202 with identifier: 1986113
2026-03-26 22:47:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d09e213b-dcb3-5849-8c5a-aff923d9a202 with scrape type 1
2026-03-26 22:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d09e213b-dcb3-5849-8c5a-aff923d9a202
2026-03-26 22:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gf%252F56502af294714427b343350ff02db38e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gf/56502af294714427b343350ff02db38e/images/large/1.jpg not downloaded yet
2026-03-26 22:47:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/a1c64c3b40a24a14b37841df476fc572/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gf%252F56502af294714427b343350ff02db38e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gf/56502af294714427b343350ff02db38e/images/large/2.jpg not downloaded yet
2026-03-26 22:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gf%252F56502af294714427b343350ff02db38e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gf/56502af294714427b343350ff02db38e/images/large/3.jpg not downloaded yet
2026-03-26 22:47:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/a1c64c3b40a24a14b37841df476fc572/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/cd239e26d5ef4b22baa24c0910c51f54/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7474e50>
2026-03-26 22:47:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38b6522c-3b16-5915-8240-889381cbcf12/38b6522c-3b16-5915-8240-889381cbcf12_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fa1c64c3b40a24a14b37841df476fc572%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/a1c64c3b40a24a14b37841df476fc572/images/large/6.jpg saved to cache
2026-03-26 22:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 38b6522c-3b16-5915-8240-889381cbcf12
2026-03-26 22:47:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7925850>
2026-03-26 22:47:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38b6522c-3b16-5915-8240-889381cbcf12/38b6522c-3b16-5915-8240-889381cbcf12_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fa1c64c3b40a24a14b37841df476fc572%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/a1c64c3b40a24a14b37841df476fc572/images/large/5.jpg saved to cache
2026-03-26 22:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 38b6522c-3b16-5915-8240-889381cbcf12
2026-03-26 22:47:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b768b3d0>
2026-03-26 22:47:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38b6522c-3b16-5915-8240-889381cbcf12/38b6522c-3b16-5915-8240-889381cbcf12_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fa1c64c3b40a24a14b37841df476fc572%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/a1c64c3b40a24a14b37841df476fc572/images/large/2.jpg saved to cache
2026-03-26 22:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 38b6522c-3b16-5915-8240-889381cbcf12
2026-03-26 22:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gf%252F56502af294714427b343350ff02db38e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gf/56502af294714427b343350ff02db38e/images/large/4.jpg not downloaded yet
2026-03-26 22:47:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd235fd0>
2026-03-26 22:47:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85f1fb64-95ba-570e-a94a-6ccd7fe7ebfd/85f1fb64-95ba-570e-a94a-6ccd7fe7ebfd_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fcd239e26d5ef4b22baa24c0910c51f54%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/cd239e26d5ef4b22baa24c0910c51f54/images/large/5.jpg saved to cache
2026-03-26 22:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 85f1fb64-95ba-570e-a94a-6ccd7fe7ebfd
2026-03-26 22:47:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c5f2d0>
2026-03-26 22:47:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c69b35c-520e-512b-907d-80a9f87c56ee/2c69b35c-520e-512b-907d-80a9f87c56ee_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xs%252F2274dc0dee944819bf6280edd89bb3d8%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xs/2274dc0dee944819bf6280edd89bb3d8/images/large/3.jpg saved to cache
2026-03-26 22:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2c69b35c-520e-512b-907d-80a9f87c56ee
2026-03-26 22:47:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2c69b35c-520e-512b-907d-80a9f87c56ee, skipping ID generation
2026-03-26 22:47:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c69b35c-520e-512b-907d-80a9f87c56ee with scrape type 1
2026-03-26 22:47:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2c69b35c-520e-512b-907d-80a9f87c56ee sending to next pipeline
2026-03-26 22:47:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 2c69b35c-520e-512b-907d-80a9f87c56ee, identifier: 1986108
2026-03-26 22:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gf%252F56502af294714427b343350ff02db38e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gf/56502af294714427b343350ff02db38e/images/large/5.jpg not downloaded yet
2026-03-26 22:47:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 2c69b35c-520e-512b-907d-80a9f87c56ee with identifier: 1986108
2026-03-26 22:47:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 2c69b35c-520e-512b-907d-80a9f87c56ee with identifier: 1986108
2026-03-26 22:47:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 2c69b35c-520e-512b-907d-80a9f87c56ee with identifier: 1986108 to the API
2026-03-26 22:47:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:47:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:47:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1xs/2274dc0dee944819bf6280edd89bb3d8/images/large/3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '2c69b35c-520e-512b-907d-80a9f87c56ee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1 DIESEL - 2019',
 'odometer': 76510,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c69b35c-520e-512b-907d-80a9f87c56ee/2c69b35c-520e-512b-907d-80a9f87c56ee_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 655895,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xs/2274dc0dee944819bf6280edd89bb3d8/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c69b35c-520e-512b-907d-80a9f87c56ee/2c69b35c-520e-512b-907d-80a9f87c56ee_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 633175,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xs/2274dc0dee944819bf6280edd89bb3d8/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c69b35c-520e-512b-907d-80a9f87c56ee/2c69b35c-520e-512b-907d-80a9f87c56ee_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 697867,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xs/2274dc0dee944819bf6280edd89bb3d8/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c69b35c-520e-512b-907d-80a9f87c56ee/2c69b35c-520e-512b-907d-80a9f87c56ee_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 704888,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xs/2274dc0dee944819bf6280edd89bb3d8/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c69b35c-520e-512b-907d-80a9f87c56ee/2c69b35c-520e-512b-907d-80a9f87c56ee_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 687117,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xs/2274dc0dee944819bf6280edd89bb3d8/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c69b35c-520e-512b-907d-80a9f87c56ee/2c69b35c-520e-512b-907d-80a9f87c56ee_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 745621,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xs/2274dc0dee944819bf6280edd89bb3d8/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c69b35c-520e-512b-907d-80a9f87c56ee/2c69b35c-520e-512b-907d-80a9f87c56ee_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 537285,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xs/2274dc0dee944819bf6280edd89bb3d8/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c69b35c-520e-512b-907d-80a9f87c56ee/2c69b35c-520e-512b-907d-80a9f87c56ee_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 974102,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xs/2274dc0dee944819bf6280edd89bb3d8/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c69b35c-520e-512b-907d-80a9f87c56ee/2c69b35c-520e-512b-907d-80a9f87c56ee_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 924214,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xs/2274dc0dee944819bf6280edd89bb3d8/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c69b35c-520e-512b-907d-80a9f87c56ee/2c69b35c-520e-512b-907d-80a9f87c56ee_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 869555,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xs/2274dc0dee944819bf6280edd89bb3d8/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-05-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 DIESEL - 2019 1.5 d sDrive16 AdBlue',
 'transmission': 'manual',
 'trim': '1.5 d sDrive16 AdBlue',
 'vin': None,
 'year': 2020}
2026-03-26 22:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986108%27 HTTP/1.1" 200 None
2026-03-26 22:47:49 [ayvens.be] INFO: Saving data for 1986108: {'created_time': 1774565269.862624, 'last_price_update_time': 1774565269.862635, 'auction_closing_time': 1775028600.0}
2026-03-26 22:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986108') HTTP/1.1" 204 0
2026-03-26 22:47:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/f98b183446d04e7c97e0ccdec5428509/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/f98b183446d04e7c97e0ccdec5428509/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/f98b183446d04e7c97e0ccdec5428509/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/f98b183446d04e7c97e0ccdec5428509/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gf%252F56502af294714427b343350ff02db38e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gf/56502af294714427b343350ff02db38e/images/large/6.jpg not downloaded yet
2026-03-26 22:47:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7571e10>
2026-03-26 22:47:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38b6522c-3b16-5915-8240-889381cbcf12/38b6522c-3b16-5915-8240-889381cbcf12_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fa1c64c3b40a24a14b37841df476fc572%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/a1c64c3b40a24a14b37841df476fc572/images/large/8.jpg saved to cache
2026-03-26 22:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 38b6522c-3b16-5915-8240-889381cbcf12
2026-03-26 22:47:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b727fa90>
2026-03-26 22:47:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38b6522c-3b16-5915-8240-889381cbcf12/38b6522c-3b16-5915-8240-889381cbcf12_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fa1c64c3b40a24a14b37841df476fc572%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/a1c64c3b40a24a14b37841df476fc572/images/large/7.jpg saved to cache
2026-03-26 22:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 38b6522c-3b16-5915-8240-889381cbcf12
2026-03-26 22:47:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7435650>
2026-03-26 22:47:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85f1fb64-95ba-570e-a94a-6ccd7fe7ebfd/85f1fb64-95ba-570e-a94a-6ccd7fe7ebfd_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fcd239e26d5ef4b22baa24c0910c51f54%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/cd239e26d5ef4b22baa24c0910c51f54/images/large/4.jpg saved to cache
2026-03-26 22:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 85f1fb64-95ba-570e-a94a-6ccd7fe7ebfd
2026-03-26 22:47:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/f98b183446d04e7c97e0ccdec5428509/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gf%252F56502af294714427b343350ff02db38e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gf/56502af294714427b343350ff02db38e/images/large/7.jpg not downloaded yet
2026-03-26 22:47:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/a1c64c3b40a24a14b37841df476fc572/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/a1c64c3b40a24a14b37841df476fc572/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gf%252F56502af294714427b343350ff02db38e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gf/56502af294714427b343350ff02db38e/images/large/8.jpg not downloaded yet
2026-03-26 22:47:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b727e450>
2026-03-26 22:47:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1b696bd-cdc7-5c8f-a787-cc9fb6644017/e1b696bd-cdc7-5c8f-a787-cc9fb6644017_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Ff98b183446d04e7c97e0ccdec5428509%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/f98b183446d04e7c97e0ccdec5428509/images/large/4.jpg saved to cache
2026-03-26 22:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e1b696bd-cdc7-5c8f-a787-cc9fb6644017
2026-03-26 22:47:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b768b310>
2026-03-26 22:47:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1b696bd-cdc7-5c8f-a787-cc9fb6644017/e1b696bd-cdc7-5c8f-a787-cc9fb6644017_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Ff98b183446d04e7c97e0ccdec5428509%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/f98b183446d04e7c97e0ccdec5428509/images/large/1.jpg saved to cache
2026-03-26 22:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e1b696bd-cdc7-5c8f-a787-cc9fb6644017
2026-03-26 22:47:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7436190>
2026-03-26 22:47:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1b696bd-cdc7-5c8f-a787-cc9fb6644017/e1b696bd-cdc7-5c8f-a787-cc9fb6644017_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Ff98b183446d04e7c97e0ccdec5428509%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/f98b183446d04e7c97e0ccdec5428509/images/large/3.jpg saved to cache
2026-03-26 22:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e1b696bd-cdc7-5c8f-a787-cc9fb6644017
2026-03-26 22:47:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74bd7d0>
2026-03-26 22:47:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1b696bd-cdc7-5c8f-a787-cc9fb6644017/e1b696bd-cdc7-5c8f-a787-cc9fb6644017_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Ff98b183446d04e7c97e0ccdec5428509%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/f98b183446d04e7c97e0ccdec5428509/images/large/2.jpg saved to cache
2026-03-26 22:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e1b696bd-cdc7-5c8f-a787-cc9fb6644017
2026-03-26 22:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gf%252F56502af294714427b343350ff02db38e%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gf/56502af294714427b343350ff02db38e/images/large/9.jpg not downloaded yet
2026-03-26 22:47:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/cd239e26d5ef4b22baa24c0910c51f54/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gf%252F56502af294714427b343350ff02db38e%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gf/56502af294714427b343350ff02db38e/images/large/10.jpg not downloaded yet
2026-03-26 22:47:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/f98b183446d04e7c97e0ccdec5428509/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:50 [ayvens.be] INFO: Found listing with ID: 1986114
2026-03-26 22:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986114%27 HTTP/1.1" 200 None
2026-03-26 22:47:50 [ayvens.be] INFO: Scrape type for 1986114: 1
2026-03-26 22:47:50 [ayvens.be] INFO: Extracting data for car ID: 1986114
2026-03-26 22:47:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc3a069a-ed71-5f2e-8d9a-86ad24a3f2a8 with identifier: 1986114
2026-03-26 22:47:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc3a069a-ed71-5f2e-8d9a-86ad24a3f2a8 with scrape type 1
2026-03-26 22:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fc3a069a-ed71-5f2e-8d9a-86ad24a3f2a8
2026-03-26 22:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fac0e1348124c4302ad0da1d370775b7c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/ac0e1348124c4302ad0da1d370775b7c/images/large/1.jpg not downloaded yet
2026-03-26 22:47:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79f9090>
2026-03-26 22:47:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1b696bd-cdc7-5c8f-a787-cc9fb6644017/e1b696bd-cdc7-5c8f-a787-cc9fb6644017_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Ff98b183446d04e7c97e0ccdec5428509%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/f98b183446d04e7c97e0ccdec5428509/images/large/5.jpg saved to cache
2026-03-26 22:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e1b696bd-cdc7-5c8f-a787-cc9fb6644017
2026-03-26 22:47:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7662290>
2026-03-26 22:47:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38b6522c-3b16-5915-8240-889381cbcf12/38b6522c-3b16-5915-8240-889381cbcf12_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fa1c64c3b40a24a14b37841df476fc572%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/a1c64c3b40a24a14b37841df476fc572/images/large/9.jpg saved to cache
2026-03-26 22:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 38b6522c-3b16-5915-8240-889381cbcf12
2026-03-26 22:47:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b746e410>
2026-03-26 22:47:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38b6522c-3b16-5915-8240-889381cbcf12/38b6522c-3b16-5915-8240-889381cbcf12_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fa1c64c3b40a24a14b37841df476fc572%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/a1c64c3b40a24a14b37841df476fc572/images/large/10.jpg saved to cache
2026-03-26 22:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 38b6522c-3b16-5915-8240-889381cbcf12
2026-03-26 22:47:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 38b6522c-3b16-5915-8240-889381cbcf12, skipping ID generation
2026-03-26 22:47:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38b6522c-3b16-5915-8240-889381cbcf12 with scrape type 1
2026-03-26 22:47:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 38b6522c-3b16-5915-8240-889381cbcf12 sending to next pipeline
2026-03-26 22:47:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 38b6522c-3b16-5915-8240-889381cbcf12, identifier: 1986111
2026-03-26 22:47:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/f98b183446d04e7c97e0ccdec5428509/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/f98b183446d04e7c97e0ccdec5428509/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 38b6522c-3b16-5915-8240-889381cbcf12 with identifier: 1986111
2026-03-26 22:47:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 38b6522c-3b16-5915-8240-889381cbcf12 with identifier: 1986111
2026-03-26 22:47:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 38b6522c-3b16-5915-8240-889381cbcf12 with identifier: 1986111 to the API
2026-03-26 22:47:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:47:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:47:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ad/a1c64c3b40a24a14b37841df476fc572/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '38b6522c-3b16-5915-8240-889381cbcf12',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'Touran',
 'odometer': 103372,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38b6522c-3b16-5915-8240-889381cbcf12/38b6522c-3b16-5915-8240-889381cbcf12_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 522257,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/a1c64c3b40a24a14b37841df476fc572/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38b6522c-3b16-5915-8240-889381cbcf12/38b6522c-3b16-5915-8240-889381cbcf12_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 554303,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/a1c64c3b40a24a14b37841df476fc572/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38b6522c-3b16-5915-8240-889381cbcf12/38b6522c-3b16-5915-8240-889381cbcf12_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 573897,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/a1c64c3b40a24a14b37841df476fc572/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38b6522c-3b16-5915-8240-889381cbcf12/38b6522c-3b16-5915-8240-889381cbcf12_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 586596,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/a1c64c3b40a24a14b37841df476fc572/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38b6522c-3b16-5915-8240-889381cbcf12/38b6522c-3b16-5915-8240-889381cbcf12_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 561106,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/a1c64c3b40a24a14b37841df476fc572/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38b6522c-3b16-5915-8240-889381cbcf12/38b6522c-3b16-5915-8240-889381cbcf12_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 565246,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/a1c64c3b40a24a14b37841df476fc572/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38b6522c-3b16-5915-8240-889381cbcf12/38b6522c-3b16-5915-8240-889381cbcf12_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 625411,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/a1c64c3b40a24a14b37841df476fc572/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38b6522c-3b16-5915-8240-889381cbcf12/38b6522c-3b16-5915-8240-889381cbcf12_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 584753,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/a1c64c3b40a24a14b37841df476fc572/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38b6522c-3b16-5915-8240-889381cbcf12/38b6522c-3b16-5915-8240-889381cbcf12_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 575623,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/a1c64c3b40a24a14b37841df476fc572/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38b6522c-3b16-5915-8240-889381cbcf12/38b6522c-3b16-5915-8240-889381cbcf12_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 563678,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/a1c64c3b40a24a14b37841df476fc572/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN Touran 2.0 TDI 90KW TRENDLINE',
 'transmission': 'manual',
 'trim': '2.0 TDI 90KW TRENDLINE',
 'vin': None,
 'year': 2021}
2026-03-26 22:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986111%27 HTTP/1.1" 200 None
2026-03-26 22:47:51 [ayvens.be] INFO: Saving data for 1986111: {'created_time': 1774565271.167112, 'last_price_update_time': 1774565271.167121, 'auction_closing_time': 1775028600.0}
2026-03-26 22:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986111') HTTP/1.1" 204 0
2026-03-26 22:47:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/f98b183446d04e7c97e0ccdec5428509/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/f98b183446d04e7c97e0ccdec5428509/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fac0e1348124c4302ad0da1d370775b7c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/ac0e1348124c4302ad0da1d370775b7c/images/large/2.jpg not downloaded yet
2026-03-26 22:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fac0e1348124c4302ad0da1d370775b7c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/ac0e1348124c4302ad0da1d370775b7c/images/large/3.jpg not downloaded yet
2026-03-26 22:47:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74820d0>
2026-03-26 22:47:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85f1fb64-95ba-570e-a94a-6ccd7fe7ebfd/85f1fb64-95ba-570e-a94a-6ccd7fe7ebfd_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fcd239e26d5ef4b22baa24c0910c51f54%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/cd239e26d5ef4b22baa24c0910c51f54/images/large/3.jpg saved to cache
2026-03-26 22:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 85f1fb64-95ba-570e-a94a-6ccd7fe7ebfd
2026-03-26 22:47:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 85f1fb64-95ba-570e-a94a-6ccd7fe7ebfd, skipping ID generation
2026-03-26 22:47:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85f1fb64-95ba-570e-a94a-6ccd7fe7ebfd with scrape type 1
2026-03-26 22:47:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 85f1fb64-95ba-570e-a94a-6ccd7fe7ebfd sending to next pipeline
2026-03-26 22:47:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 85f1fb64-95ba-570e-a94a-6ccd7fe7ebfd, identifier: 1986106
2026-03-26 22:47:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79a1810>
2026-03-26 22:47:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1b696bd-cdc7-5c8f-a787-cc9fb6644017/e1b696bd-cdc7-5c8f-a787-cc9fb6644017_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Ff98b183446d04e7c97e0ccdec5428509%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/f98b183446d04e7c97e0ccdec5428509/images/large/6.jpg saved to cache
2026-03-26 22:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e1b696bd-cdc7-5c8f-a787-cc9fb6644017
2026-03-26 22:47:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e1f050>
2026-03-26 22:47:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1b696bd-cdc7-5c8f-a787-cc9fb6644017/e1b696bd-cdc7-5c8f-a787-cc9fb6644017_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Ff98b183446d04e7c97e0ccdec5428509%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/f98b183446d04e7c97e0ccdec5428509/images/large/8.jpg saved to cache
2026-03-26 22:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e1b696bd-cdc7-5c8f-a787-cc9fb6644017
2026-03-26 22:47:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cc32d0>
2026-03-26 22:47:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1b696bd-cdc7-5c8f-a787-cc9fb6644017/e1b696bd-cdc7-5c8f-a787-cc9fb6644017_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Ff98b183446d04e7c97e0ccdec5428509%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/f98b183446d04e7c97e0ccdec5428509/images/large/7.jpg saved to cache
2026-03-26 22:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e1b696bd-cdc7-5c8f-a787-cc9fb6644017
2026-03-26 22:47:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/a147416fd5084e1fa03915e89785353a/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fac0e1348124c4302ad0da1d370775b7c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/ac0e1348124c4302ad0da1d370775b7c/images/large/4.jpg not downloaded yet
2026-03-26 22:47:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 85f1fb64-95ba-570e-a94a-6ccd7fe7ebfd with identifier: 1986106
2026-03-26 22:47:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 85f1fb64-95ba-570e-a94a-6ccd7fe7ebfd with identifier: 1986106
2026-03-26 22:47:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 85f1fb64-95ba-570e-a94a-6ccd7fe7ebfd with identifier: 1986106 to the API
2026-03-26 22:47:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:47:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:47:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bp/cd239e26d5ef4b22baa24c0910c51f54/images/large/3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '85f1fb64-95ba-570e-a94a-6ccd7fe7ebfd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'Octavia',
 'odometer': 207402,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85f1fb64-95ba-570e-a94a-6ccd7fe7ebfd/85f1fb64-95ba-570e-a94a-6ccd7fe7ebfd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 633930,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/cd239e26d5ef4b22baa24c0910c51f54/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85f1fb64-95ba-570e-a94a-6ccd7fe7ebfd/85f1fb64-95ba-570e-a94a-6ccd7fe7ebfd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 622531,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/cd239e26d5ef4b22baa24c0910c51f54/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85f1fb64-95ba-570e-a94a-6ccd7fe7ebfd/85f1fb64-95ba-570e-a94a-6ccd7fe7ebfd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 643631,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/cd239e26d5ef4b22baa24c0910c51f54/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85f1fb64-95ba-570e-a94a-6ccd7fe7ebfd/85f1fb64-95ba-570e-a94a-6ccd7fe7ebfd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 630371,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/cd239e26d5ef4b22baa24c0910c51f54/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85f1fb64-95ba-570e-a94a-6ccd7fe7ebfd/85f1fb64-95ba-570e-a94a-6ccd7fe7ebfd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 575605,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/cd239e26d5ef4b22baa24c0910c51f54/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85f1fb64-95ba-570e-a94a-6ccd7fe7ebfd/85f1fb64-95ba-570e-a94a-6ccd7fe7ebfd_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 588795,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/cd239e26d5ef4b22baa24c0910c51f54/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85f1fb64-95ba-570e-a94a-6ccd7fe7ebfd/85f1fb64-95ba-570e-a94a-6ccd7fe7ebfd_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 665694,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/cd239e26d5ef4b22baa24c0910c51f54/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85f1fb64-95ba-570e-a94a-6ccd7fe7ebfd/85f1fb64-95ba-570e-a94a-6ccd7fe7ebfd_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 638951,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/cd239e26d5ef4b22baa24c0910c51f54/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85f1fb64-95ba-570e-a94a-6ccd7fe7ebfd/85f1fb64-95ba-570e-a94a-6ccd7fe7ebfd_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 541119,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/cd239e26d5ef4b22baa24c0910c51f54/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85f1fb64-95ba-570e-a94a-6ccd7fe7ebfd/85f1fb64-95ba-570e-a94a-6ccd7fe7ebfd_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 451772,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/cd239e26d5ef4b22baa24c0910c51f54/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA Octavia 2.0 CRTDI 110KW DSG7 CLEVER',
 'transmission': 'automatic',
 'trim': '2.0 CRTDI 110KW DSG7 CLEVER',
 'vin': None,
 'year': 2022}
2026-03-26 22:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986106%27 HTTP/1.1" 200 None
2026-03-26 22:47:51 [ayvens.be] INFO: Saving data for 1986106: {'created_time': 1774565271.964456, 'last_price_update_time': 1774565271.964469, 'auction_closing_time': 1775028600.0}
2026-03-26 22:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986106') HTTP/1.1" 204 0
2026-03-26 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fac0e1348124c4302ad0da1d370775b7c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/ac0e1348124c4302ad0da1d370775b7c/images/large/5.jpg not downloaded yet
2026-03-26 22:47:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e1d590>
2026-03-26 22:47:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1b696bd-cdc7-5c8f-a787-cc9fb6644017/e1b696bd-cdc7-5c8f-a787-cc9fb6644017_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Ff98b183446d04e7c97e0ccdec5428509%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/f98b183446d04e7c97e0ccdec5428509/images/large/9.jpg saved to cache
2026-03-26 22:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e1b696bd-cdc7-5c8f-a787-cc9fb6644017
2026-03-26 22:47:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79250d0>
2026-03-26 22:47:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1b696bd-cdc7-5c8f-a787-cc9fb6644017/e1b696bd-cdc7-5c8f-a787-cc9fb6644017_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Ff98b183446d04e7c97e0ccdec5428509%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/f98b183446d04e7c97e0ccdec5428509/images/large/10.jpg saved to cache
2026-03-26 22:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e1b696bd-cdc7-5c8f-a787-cc9fb6644017
2026-03-26 22:47:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e1b696bd-cdc7-5c8f-a787-cc9fb6644017, skipping ID generation
2026-03-26 22:47:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e1b696bd-cdc7-5c8f-a787-cc9fb6644017 with scrape type 1
2026-03-26 22:47:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e1b696bd-cdc7-5c8f-a787-cc9fb6644017 sending to next pipeline
2026-03-26 22:47:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e1b696bd-cdc7-5c8f-a787-cc9fb6644017, identifier: 1986112
2026-03-26 22:47:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e1b696bd-cdc7-5c8f-a787-cc9fb6644017 with identifier: 1986112
2026-03-26 22:47:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e1b696bd-cdc7-5c8f-a787-cc9fb6644017 with identifier: 1986112
2026-03-26 22:47:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e1b696bd-cdc7-5c8f-a787-cc9fb6644017 with identifier: 1986112 to the API
2026-03-26 22:47:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:47:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:47:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bp/f98b183446d04e7c97e0ccdec5428509/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 44,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'e1b696bd-cdc7-5c8f-a787-cc9fb6644017',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'MINI',
 'model': 'COUNTRYMAN',
 'odometer': 54455,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1b696bd-cdc7-5c8f-a787-cc9fb6644017/e1b696bd-cdc7-5c8f-a787-cc9fb6644017_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 226469,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/f98b183446d04e7c97e0ccdec5428509/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1b696bd-cdc7-5c8f-a787-cc9fb6644017/e1b696bd-cdc7-5c8f-a787-cc9fb6644017_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 226169,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/f98b183446d04e7c97e0ccdec5428509/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1b696bd-cdc7-5c8f-a787-cc9fb6644017/e1b696bd-cdc7-5c8f-a787-cc9fb6644017_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 224408,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/f98b183446d04e7c97e0ccdec5428509/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1b696bd-cdc7-5c8f-a787-cc9fb6644017/e1b696bd-cdc7-5c8f-a787-cc9fb6644017_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 226121,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/f98b183446d04e7c97e0ccdec5428509/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1b696bd-cdc7-5c8f-a787-cc9fb6644017/e1b696bd-cdc7-5c8f-a787-cc9fb6644017_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 248120,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/f98b183446d04e7c97e0ccdec5428509/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1b696bd-cdc7-5c8f-a787-cc9fb6644017/e1b696bd-cdc7-5c8f-a787-cc9fb6644017_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 225972,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/f98b183446d04e7c97e0ccdec5428509/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1b696bd-cdc7-5c8f-a787-cc9fb6644017/e1b696bd-cdc7-5c8f-a787-cc9fb6644017_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 321799,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/f98b183446d04e7c97e0ccdec5428509/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1b696bd-cdc7-5c8f-a787-cc9fb6644017/e1b696bd-cdc7-5c8f-a787-cc9fb6644017_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 292701,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/f98b183446d04e7c97e0ccdec5428509/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1b696bd-cdc7-5c8f-a787-cc9fb6644017/e1b696bd-cdc7-5c8f-a787-cc9fb6644017_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 341827,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/f98b183446d04e7c97e0ccdec5428509/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1b696bd-cdc7-5c8f-a787-cc9fb6644017/e1b696bd-cdc7-5c8f-a787-cc9fb6644017_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 331317,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/f98b183446d04e7c97e0ccdec5428509/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI COUNTRYMAN 1.5 COOPER S E 4WD AUTO',
 'transmission': 'automatic',
 'trim': '1.5 COOPER S E 4WD AUTO',
 'vin': None,
 'year': 2022}
2026-03-26 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986112%27 HTTP/1.1" 200 None
2026-03-26 22:47:52 [ayvens.be] INFO: Saving data for 1986112: {'created_time': 1774565272.632131, 'last_price_update_time': 1774565272.632143, 'auction_closing_time': 1775028600.0}
2026-03-26 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986112') HTTP/1.1" 204 0
2026-03-26 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fac0e1348124c4302ad0da1d370775b7c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/ac0e1348124c4302ad0da1d370775b7c/images/large/6.jpg not downloaded yet
2026-03-26 22:47:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6d81910>
2026-03-26 22:47:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1337cdc-52f0-5c11-b22c-b6e1006cb547/c1337cdc-52f0-5c11-b22c-b6e1006cb547_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fa147416fd5084e1fa03915e89785353a%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/a147416fd5084e1fa03915e89785353a/images/large/7.jpg saved to cache
2026-03-26 22:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c1337cdc-52f0-5c11-b22c-b6e1006cb547
2026-03-26 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fac0e1348124c4302ad0da1d370775b7c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/ac0e1348124c4302ad0da1d370775b7c/images/large/7.jpg not downloaded yet
2026-03-26 22:47:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gf/56502af294714427b343350ff02db38e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gf/56502af294714427b343350ff02db38e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gf/56502af294714427b343350ff02db38e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fac0e1348124c4302ad0da1d370775b7c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/ac0e1348124c4302ad0da1d370775b7c/images/large/8.jpg not downloaded yet
2026-03-26 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fac0e1348124c4302ad0da1d370775b7c%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/ac0e1348124c4302ad0da1d370775b7c/images/large/9.jpg not downloaded yet
2026-03-26 22:47:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gf/56502af294714427b343350ff02db38e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gf/56502af294714427b343350ff02db38e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gf/56502af294714427b343350ff02db38e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fac0e1348124c4302ad0da1d370775b7c%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/ac0e1348124c4302ad0da1d370775b7c/images/large/10.jpg not downloaded yet
2026-03-26 22:47:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/a147416fd5084e1fa03915e89785353a/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:52 [ayvens.be] INFO: Found listing with ID: 1986115
2026-03-26 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986115%27 HTTP/1.1" 200 None
2026-03-26 22:47:52 [ayvens.be] INFO: Scrape type for 1986115: 1
2026-03-26 22:47:52 [ayvens.be] INFO: Extracting data for car ID: 1986115
2026-03-26 22:47:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0c2f1084-9ea9-5906-8c9c-c7eddb6bb6a3 with identifier: 1986115
2026-03-26 22:47:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c2f1084-9ea9-5906-8c9c-c7eddb6bb6a3 with scrape type 1
2026-03-26 22:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0c2f1084-9ea9-5906-8c9c-c7eddb6bb6a3
2026-03-26 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F59d814c8a95f44f5804bd516ad548727%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/59d814c8a95f44f5804bd516ad548727/images/large/1.jpg not downloaded yet
2026-03-26 22:47:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gf/56502af294714427b343350ff02db38e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F59d814c8a95f44f5804bd516ad548727%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/59d814c8a95f44f5804bd516ad548727/images/large/2.jpg not downloaded yet
2026-03-26 22:47:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7408b50>
2026-03-26 22:47:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d09e213b-dcb3-5849-8c5a-aff923d9a202/d09e213b-dcb3-5849-8c5a-aff923d9a202_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gf%252F56502af294714427b343350ff02db38e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gf/56502af294714427b343350ff02db38e/images/large/4.jpg saved to cache
2026-03-26 22:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d09e213b-dcb3-5849-8c5a-aff923d9a202
2026-03-26 22:47:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7416190>
2026-03-26 22:47:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d09e213b-dcb3-5849-8c5a-aff923d9a202/d09e213b-dcb3-5849-8c5a-aff923d9a202_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gf%252F56502af294714427b343350ff02db38e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gf/56502af294714427b343350ff02db38e/images/large/3.jpg saved to cache
2026-03-26 22:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d09e213b-dcb3-5849-8c5a-aff923d9a202
2026-03-26 22:47:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7476510>
2026-03-26 22:47:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d09e213b-dcb3-5849-8c5a-aff923d9a202/d09e213b-dcb3-5849-8c5a-aff923d9a202_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gf%252F56502af294714427b343350ff02db38e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gf/56502af294714427b343350ff02db38e/images/large/5.jpg saved to cache
2026-03-26 22:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d09e213b-dcb3-5849-8c5a-aff923d9a202
2026-03-26 22:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F59d814c8a95f44f5804bd516ad548727%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/59d814c8a95f44f5804bd516ad548727/images/large/3.jpg not downloaded yet
2026-03-26 22:47:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7415310>
2026-03-26 22:47:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d09e213b-dcb3-5849-8c5a-aff923d9a202/d09e213b-dcb3-5849-8c5a-aff923d9a202_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gf%252F56502af294714427b343350ff02db38e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gf/56502af294714427b343350ff02db38e/images/large/1.jpg saved to cache
2026-03-26 22:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d09e213b-dcb3-5849-8c5a-aff923d9a202
2026-03-26 22:47:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e17150>
2026-03-26 22:47:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d09e213b-dcb3-5849-8c5a-aff923d9a202/d09e213b-dcb3-5849-8c5a-aff923d9a202_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gf%252F56502af294714427b343350ff02db38e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gf/56502af294714427b343350ff02db38e/images/large/6.jpg saved to cache
2026-03-26 22:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d09e213b-dcb3-5849-8c5a-aff923d9a202
2026-03-26 22:47:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6ded810>
2026-03-26 22:47:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d09e213b-dcb3-5849-8c5a-aff923d9a202/d09e213b-dcb3-5849-8c5a-aff923d9a202_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gf%252F56502af294714427b343350ff02db38e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gf/56502af294714427b343350ff02db38e/images/large/2.jpg saved to cache
2026-03-26 22:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d09e213b-dcb3-5849-8c5a-aff923d9a202
2026-03-26 22:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F59d814c8a95f44f5804bd516ad548727%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/59d814c8a95f44f5804bd516ad548727/images/large/4.jpg not downloaded yet
2026-03-26 22:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F59d814c8a95f44f5804bd516ad548727%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/59d814c8a95f44f5804bd516ad548727/images/large/5.jpg not downloaded yet
2026-03-26 22:47:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74bee90>
2026-03-26 22:47:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1337cdc-52f0-5c11-b22c-b6e1006cb547/c1337cdc-52f0-5c11-b22c-b6e1006cb547_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fa147416fd5084e1fa03915e89785353a%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/a147416fd5084e1fa03915e89785353a/images/large/6.jpg saved to cache
2026-03-26 22:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c1337cdc-52f0-5c11-b22c-b6e1006cb547
2026-03-26 22:47:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c1337cdc-52f0-5c11-b22c-b6e1006cb547, skipping ID generation
2026-03-26 22:47:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1337cdc-52f0-5c11-b22c-b6e1006cb547 with scrape type 1
2026-03-26 22:47:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c1337cdc-52f0-5c11-b22c-b6e1006cb547 sending to next pipeline
2026-03-26 22:47:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c1337cdc-52f0-5c11-b22c-b6e1006cb547, identifier: 1986105
2026-03-26 22:47:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6def710>
2026-03-26 22:47:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d09e213b-dcb3-5849-8c5a-aff923d9a202/d09e213b-dcb3-5849-8c5a-aff923d9a202_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gf%252F56502af294714427b343350ff02db38e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gf/56502af294714427b343350ff02db38e/images/large/7.jpg saved to cache
2026-03-26 22:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d09e213b-dcb3-5849-8c5a-aff923d9a202
2026-03-26 22:47:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c1337cdc-52f0-5c11-b22c-b6e1006cb547 with identifier: 1986105
2026-03-26 22:47:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c1337cdc-52f0-5c11-b22c-b6e1006cb547 with identifier: 1986105
2026-03-26 22:47:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c1337cdc-52f0-5c11-b22c-b6e1006cb547 with identifier: 1986105 to the API
2026-03-26 22:47:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:47:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:47:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bm/a147416fd5084e1fa03915e89785353a/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'electric',
 'id': 'c1337cdc-52f0-5c11-b22c-b6e1006cb547',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'EQA',
 'odometer': 40652,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 24,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1337cdc-52f0-5c11-b22c-b6e1006cb547/c1337cdc-52f0-5c11-b22c-b6e1006cb547_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 725589,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/a147416fd5084e1fa03915e89785353a/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1337cdc-52f0-5c11-b22c-b6e1006cb547/c1337cdc-52f0-5c11-b22c-b6e1006cb547_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 731278,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/a147416fd5084e1fa03915e89785353a/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1337cdc-52f0-5c11-b22c-b6e1006cb547/c1337cdc-52f0-5c11-b22c-b6e1006cb547_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 695233,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/a147416fd5084e1fa03915e89785353a/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1337cdc-52f0-5c11-b22c-b6e1006cb547/c1337cdc-52f0-5c11-b22c-b6e1006cb547_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 695574,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/a147416fd5084e1fa03915e89785353a/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1337cdc-52f0-5c11-b22c-b6e1006cb547/c1337cdc-52f0-5c11-b22c-b6e1006cb547_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 696860,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/a147416fd5084e1fa03915e89785353a/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1337cdc-52f0-5c11-b22c-b6e1006cb547/c1337cdc-52f0-5c11-b22c-b6e1006cb547_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 869991,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/a147416fd5084e1fa03915e89785353a/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1337cdc-52f0-5c11-b22c-b6e1006cb547/c1337cdc-52f0-5c11-b22c-b6e1006cb547_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 612771,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/a147416fd5084e1fa03915e89785353a/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1337cdc-52f0-5c11-b22c-b6e1006cb547/c1337cdc-52f0-5c11-b22c-b6e1006cb547_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 827645,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/a147416fd5084e1fa03915e89785353a/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1337cdc-52f0-5c11-b22c-b6e1006cb547/c1337cdc-52f0-5c11-b22c-b6e1006cb547_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 782195,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/a147416fd5084e1fa03915e89785353a/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1337cdc-52f0-5c11-b22c-b6e1006cb547/c1337cdc-52f0-5c11-b22c-b6e1006cb547_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 784294,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/a147416fd5084e1fa03915e89785353a/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ EQA BEV 67KWH EQA 250 BUSINESS SOL LUX',
 'transmission': 'automatic',
 'trim': 'BEV 67KWH EQA 250 BUSINESS SOL LUX',
 'vin': None,
 'year': 2022}
2026-03-26 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986105%27 HTTP/1.1" 200 None
2026-03-26 22:47:54 [ayvens.be] INFO: Saving data for 1986105: {'created_time': 1774565274.26765, 'last_price_update_time': 1774565274.26766, 'auction_closing_time': 1775028600.0}
2026-03-26 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986105') HTTP/1.1" 204 0
2026-03-26 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F59d814c8a95f44f5804bd516ad548727%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/59d814c8a95f44f5804bd516ad548727/images/large/6.jpg not downloaded yet
2026-03-26 22:47:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gf/56502af294714427b343350ff02db38e/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F59d814c8a95f44f5804bd516ad548727%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/59d814c8a95f44f5804bd516ad548727/images/large/7.jpg not downloaded yet
2026-03-26 22:47:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/ac0e1348124c4302ad0da1d370775b7c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/ac0e1348124c4302ad0da1d370775b7c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gf/56502af294714427b343350ff02db38e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/ac0e1348124c4302ad0da1d370775b7c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F59d814c8a95f44f5804bd516ad548727%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/59d814c8a95f44f5804bd516ad548727/images/large/8.jpg not downloaded yet
2026-03-26 22:47:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/ac0e1348124c4302ad0da1d370775b7c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/ac0e1348124c4302ad0da1d370775b7c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F59d814c8a95f44f5804bd516ad548727%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/59d814c8a95f44f5804bd516ad548727/images/large/9.jpg not downloaded yet
2026-03-26 22:47:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gf/56502af294714427b343350ff02db38e/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F59d814c8a95f44f5804bd516ad548727%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/59d814c8a95f44f5804bd516ad548727/images/large/10.jpg not downloaded yet
2026-03-26 22:47:54 [ayvens.be] INFO: Found listing with ID: 1986116
2026-03-26 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986116%27 HTTP/1.1" 200 None
2026-03-26 22:47:54 [ayvens.be] INFO: Scrape type for 1986116: 1
2026-03-26 22:47:54 [ayvens.be] INFO: Extracting data for car ID: 1986116
2026-03-26 22:47:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd05defc-932e-5f41-9fe2-636638421e1a with identifier: 1986116
2026-03-26 22:47:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd05defc-932e-5f41-9fe2-636638421e1a with scrape type 1
2026-03-26 22:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bd05defc-932e-5f41-9fe2-636638421e1a
2026-03-26 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F13221be0df8a4ffe8ee6ffacbd25c41a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/13221be0df8a4ffe8ee6ffacbd25c41a/images/large/1.jpg not downloaded yet
2026-03-26 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F13221be0df8a4ffe8ee6ffacbd25c41a%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/13221be0df8a4ffe8ee6ffacbd25c41a/images/large/2.jpg not downloaded yet
2026-03-26 22:47:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e4dcd0>
2026-03-26 22:47:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d09e213b-dcb3-5849-8c5a-aff923d9a202/d09e213b-dcb3-5849-8c5a-aff923d9a202_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gf%252F56502af294714427b343350ff02db38e%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gf/56502af294714427b343350ff02db38e/images/large/10.jpg saved to cache
2026-03-26 22:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d09e213b-dcb3-5849-8c5a-aff923d9a202
2026-03-26 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F13221be0df8a4ffe8ee6ffacbd25c41a%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/13221be0df8a4ffe8ee6ffacbd25c41a/images/large/3.jpg not downloaded yet
2026-03-26 22:47:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79d4450>
2026-03-26 22:47:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc3a069a-ed71-5f2e-8d9a-86ad24a3f2a8/fc3a069a-ed71-5f2e-8d9a-86ad24a3f2a8_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fac0e1348124c4302ad0da1d370775b7c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/ac0e1348124c4302ad0da1d370775b7c/images/large/2.jpg saved to cache
2026-03-26 22:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fc3a069a-ed71-5f2e-8d9a-86ad24a3f2a8
2026-03-26 22:47:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77d6ed0>
2026-03-26 22:47:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc3a069a-ed71-5f2e-8d9a-86ad24a3f2a8/fc3a069a-ed71-5f2e-8d9a-86ad24a3f2a8_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fac0e1348124c4302ad0da1d370775b7c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/ac0e1348124c4302ad0da1d370775b7c/images/large/1.jpg saved to cache
2026-03-26 22:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fc3a069a-ed71-5f2e-8d9a-86ad24a3f2a8
2026-03-26 22:47:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6defe50>
2026-03-26 22:47:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d09e213b-dcb3-5849-8c5a-aff923d9a202/d09e213b-dcb3-5849-8c5a-aff923d9a202_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gf%252F56502af294714427b343350ff02db38e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gf/56502af294714427b343350ff02db38e/images/large/8.jpg saved to cache
2026-03-26 22:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d09e213b-dcb3-5849-8c5a-aff923d9a202
2026-03-26 22:47:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e02390>
2026-03-26 22:47:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc3a069a-ed71-5f2e-8d9a-86ad24a3f2a8/fc3a069a-ed71-5f2e-8d9a-86ad24a3f2a8_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fac0e1348124c4302ad0da1d370775b7c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/ac0e1348124c4302ad0da1d370775b7c/images/large/3.jpg saved to cache
2026-03-26 22:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fc3a069a-ed71-5f2e-8d9a-86ad24a3f2a8
2026-03-26 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F13221be0df8a4ffe8ee6ffacbd25c41a%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/13221be0df8a4ffe8ee6ffacbd25c41a/images/large/4.jpg not downloaded yet
2026-03-26 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F13221be0df8a4ffe8ee6ffacbd25c41a%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/13221be0df8a4ffe8ee6ffacbd25c41a/images/large/5.jpg not downloaded yet
2026-03-26 22:47:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7770250>
2026-03-26 22:47:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc3a069a-ed71-5f2e-8d9a-86ad24a3f2a8/fc3a069a-ed71-5f2e-8d9a-86ad24a3f2a8_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fac0e1348124c4302ad0da1d370775b7c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/ac0e1348124c4302ad0da1d370775b7c/images/large/4.jpg saved to cache
2026-03-26 22:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fc3a069a-ed71-5f2e-8d9a-86ad24a3f2a8
2026-03-26 22:47:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b746d850>
2026-03-26 22:47:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc3a069a-ed71-5f2e-8d9a-86ad24a3f2a8/fc3a069a-ed71-5f2e-8d9a-86ad24a3f2a8_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fac0e1348124c4302ad0da1d370775b7c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/ac0e1348124c4302ad0da1d370775b7c/images/large/5.jpg saved to cache
2026-03-26 22:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fc3a069a-ed71-5f2e-8d9a-86ad24a3f2a8
2026-03-26 22:47:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7747690>
2026-03-26 22:47:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d09e213b-dcb3-5849-8c5a-aff923d9a202/d09e213b-dcb3-5849-8c5a-aff923d9a202_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gf%252F56502af294714427b343350ff02db38e%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gf/56502af294714427b343350ff02db38e/images/large/9.jpg saved to cache
2026-03-26 22:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d09e213b-dcb3-5849-8c5a-aff923d9a202
2026-03-26 22:47:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d09e213b-dcb3-5849-8c5a-aff923d9a202, skipping ID generation
2026-03-26 22:47:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d09e213b-dcb3-5849-8c5a-aff923d9a202 with scrape type 1
2026-03-26 22:47:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d09e213b-dcb3-5849-8c5a-aff923d9a202 sending to next pipeline
2026-03-26 22:47:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d09e213b-dcb3-5849-8c5a-aff923d9a202, identifier: 1986113
2026-03-26 22:47:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d09e213b-dcb3-5849-8c5a-aff923d9a202 with identifier: 1986113
2026-03-26 22:47:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d09e213b-dcb3-5849-8c5a-aff923d9a202 with identifier: 1986113
2026-03-26 22:47:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d09e213b-dcb3-5849-8c5a-aff923d9a202 with identifier: 1986113 to the API
2026-03-26 22:47:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:47:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:47:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2gf/56502af294714427b343350ff02db38e/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'd09e213b-dcb3-5849-8c5a-aff923d9a202',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'SPORTAGE',
 'odometer': 47774,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d09e213b-dcb3-5849-8c5a-aff923d9a202/d09e213b-dcb3-5849-8c5a-aff923d9a202_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 734919,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gf/56502af294714427b343350ff02db38e/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d09e213b-dcb3-5849-8c5a-aff923d9a202/d09e213b-dcb3-5849-8c5a-aff923d9a202_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 764396,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gf/56502af294714427b343350ff02db38e/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d09e213b-dcb3-5849-8c5a-aff923d9a202/d09e213b-dcb3-5849-8c5a-aff923d9a202_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 728043,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gf/56502af294714427b343350ff02db38e/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d09e213b-dcb3-5849-8c5a-aff923d9a202/d09e213b-dcb3-5849-8c5a-aff923d9a202_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 778606,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gf/56502af294714427b343350ff02db38e/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d09e213b-dcb3-5849-8c5a-aff923d9a202/d09e213b-dcb3-5849-8c5a-aff923d9a202_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 733070,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gf/56502af294714427b343350ff02db38e/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d09e213b-dcb3-5849-8c5a-aff923d9a202/d09e213b-dcb3-5849-8c5a-aff923d9a202_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 759737,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gf/56502af294714427b343350ff02db38e/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d09e213b-dcb3-5849-8c5a-aff923d9a202/d09e213b-dcb3-5849-8c5a-aff923d9a202_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 787014,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gf/56502af294714427b343350ff02db38e/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d09e213b-dcb3-5849-8c5a-aff923d9a202/d09e213b-dcb3-5849-8c5a-aff923d9a202_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 878555,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gf/56502af294714427b343350ff02db38e/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d09e213b-dcb3-5849-8c5a-aff923d9a202/d09e213b-dcb3-5849-8c5a-aff923d9a202_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 913620,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gf/56502af294714427b343350ff02db38e/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d09e213b-dcb3-5849-8c5a-aff923d9a202/d09e213b-dcb3-5849-8c5a-aff923d9a202_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 707902,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gf/56502af294714427b343350ff02db38e/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-11-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA SPORTAGE 1.6 T-GDI 245 PHEV STYLE EDITION AT 4WD',
 'transmission': 'automatic',
 'trim': '1.6 T-GDI 245 PHEV STYLE EDITION AT 4WD',
 'vin': None,
 'year': 2024}
2026-03-26 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986113%27 HTTP/1.1" 200 None
2026-03-26 22:47:55 [ayvens.be] INFO: Saving data for 1986113: {'created_time': 1774565275.834599, 'last_price_update_time': 1774565275.834617, 'auction_closing_time': 1775028600.0}
2026-03-26 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986113') HTTP/1.1" 204 0
2026-03-26 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F13221be0df8a4ffe8ee6ffacbd25c41a%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/13221be0df8a4ffe8ee6ffacbd25c41a/images/large/6.jpg not downloaded yet
2026-03-26 22:47:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/59d814c8a95f44f5804bd516ad548727/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/ac0e1348124c4302ad0da1d370775b7c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/ac0e1348124c4302ad0da1d370775b7c/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/ac0e1348124c4302ad0da1d370775b7c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/59d814c8a95f44f5804bd516ad548727/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F13221be0df8a4ffe8ee6ffacbd25c41a%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/13221be0df8a4ffe8ee6ffacbd25c41a/images/large/7.jpg not downloaded yet
2026-03-26 22:47:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/ac0e1348124c4302ad0da1d370775b7c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/ac0e1348124c4302ad0da1d370775b7c/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F13221be0df8a4ffe8ee6ffacbd25c41a%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/13221be0df8a4ffe8ee6ffacbd25c41a/images/large/8.jpg not downloaded yet
2026-03-26 22:47:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/59d814c8a95f44f5804bd516ad548727/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F13221be0df8a4ffe8ee6ffacbd25c41a%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/13221be0df8a4ffe8ee6ffacbd25c41a/images/large/9.jpg not downloaded yet
2026-03-26 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F13221be0df8a4ffe8ee6ffacbd25c41a%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/13221be0df8a4ffe8ee6ffacbd25c41a/images/large/10.jpg not downloaded yet
2026-03-26 22:47:55 [ayvens.be] INFO: Found listing with ID: 1986117
2026-03-26 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986117%27 HTTP/1.1" 200 None
2026-03-26 22:47:55 [ayvens.be] INFO: Scrape type for 1986117: 1
2026-03-26 22:47:55 [ayvens.be] INFO: Extracting data for car ID: 1986117
2026-03-26 22:47:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 796264d2-ef71-5414-ba30-f0650c221ace with identifier: 1986117
2026-03-26 22:47:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 796264d2-ef71-5414-ba30-f0650c221ace with scrape type 1
2026-03-26 22:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 796264d2-ef71-5414-ba30-f0650c221ace
2026-03-26 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F1cf8f78f48424eb1834151b134f7cfd0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/1cf8f78f48424eb1834151b134f7cfd0/images/large/1.jpg not downloaded yet
2026-03-26 22:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F1cf8f78f48424eb1834151b134f7cfd0%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/1cf8f78f48424eb1834151b134f7cfd0/images/large/2.jpg not downloaded yet
2026-03-26 22:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F1cf8f78f48424eb1834151b134f7cfd0%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/1cf8f78f48424eb1834151b134f7cfd0/images/large/3.jpg not downloaded yet
2026-03-26 22:47:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7434750>
2026-03-26 22:47:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c2f1084-9ea9-5906-8c9c-c7eddb6bb6a3/0c2f1084-9ea9-5906-8c9c-c7eddb6bb6a3_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F59d814c8a95f44f5804bd516ad548727%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/59d814c8a95f44f5804bd516ad548727/images/large/2.jpg saved to cache
2026-03-26 22:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0c2f1084-9ea9-5906-8c9c-c7eddb6bb6a3
2026-03-26 22:47:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b725c790>
2026-03-26 22:47:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc3a069a-ed71-5f2e-8d9a-86ad24a3f2a8/fc3a069a-ed71-5f2e-8d9a-86ad24a3f2a8_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fac0e1348124c4302ad0da1d370775b7c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/ac0e1348124c4302ad0da1d370775b7c/images/large/7.jpg saved to cache
2026-03-26 22:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fc3a069a-ed71-5f2e-8d9a-86ad24a3f2a8
2026-03-26 22:47:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b727b350>
2026-03-26 22:47:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc3a069a-ed71-5f2e-8d9a-86ad24a3f2a8/fc3a069a-ed71-5f2e-8d9a-86ad24a3f2a8_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fac0e1348124c4302ad0da1d370775b7c%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/ac0e1348124c4302ad0da1d370775b7c/images/large/9.jpg saved to cache
2026-03-26 22:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fc3a069a-ed71-5f2e-8d9a-86ad24a3f2a8
2026-03-26 22:47:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b75739d0>
2026-03-26 22:47:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc3a069a-ed71-5f2e-8d9a-86ad24a3f2a8/fc3a069a-ed71-5f2e-8d9a-86ad24a3f2a8_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fac0e1348124c4302ad0da1d370775b7c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/ac0e1348124c4302ad0da1d370775b7c/images/large/8.jpg saved to cache
2026-03-26 22:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fc3a069a-ed71-5f2e-8d9a-86ad24a3f2a8
2026-03-26 22:47:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74a5dd0>
2026-03-26 22:47:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c2f1084-9ea9-5906-8c9c-c7eddb6bb6a3/0c2f1084-9ea9-5906-8c9c-c7eddb6bb6a3_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F59d814c8a95f44f5804bd516ad548727%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/59d814c8a95f44f5804bd516ad548727/images/large/3.jpg saved to cache
2026-03-26 22:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0c2f1084-9ea9-5906-8c9c-c7eddb6bb6a3
2026-03-26 22:47:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b741c1d0>
2026-03-26 22:47:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc3a069a-ed71-5f2e-8d9a-86ad24a3f2a8/fc3a069a-ed71-5f2e-8d9a-86ad24a3f2a8_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fac0e1348124c4302ad0da1d370775b7c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/ac0e1348124c4302ad0da1d370775b7c/images/large/6.jpg saved to cache
2026-03-26 22:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fc3a069a-ed71-5f2e-8d9a-86ad24a3f2a8
2026-03-26 22:47:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd3bb690>
2026-03-26 22:47:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc3a069a-ed71-5f2e-8d9a-86ad24a3f2a8/fc3a069a-ed71-5f2e-8d9a-86ad24a3f2a8_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fac0e1348124c4302ad0da1d370775b7c%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/ac0e1348124c4302ad0da1d370775b7c/images/large/10.jpg saved to cache
2026-03-26 22:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fc3a069a-ed71-5f2e-8d9a-86ad24a3f2a8
2026-03-26 22:47:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fc3a069a-ed71-5f2e-8d9a-86ad24a3f2a8, skipping ID generation
2026-03-26 22:47:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc3a069a-ed71-5f2e-8d9a-86ad24a3f2a8 with scrape type 1
2026-03-26 22:47:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fc3a069a-ed71-5f2e-8d9a-86ad24a3f2a8 sending to next pipeline
2026-03-26 22:47:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: fc3a069a-ed71-5f2e-8d9a-86ad24a3f2a8, identifier: 1986114
2026-03-26 22:47:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: fc3a069a-ed71-5f2e-8d9a-86ad24a3f2a8 with identifier: 1986114
2026-03-26 22:47:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: fc3a069a-ed71-5f2e-8d9a-86ad24a3f2a8 with identifier: 1986114
2026-03-26 22:47:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: fc3a069a-ed71-5f2e-8d9a-86ad24a3f2a8 with identifier: 1986114 to the API
2026-03-26 22:47:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:47:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:47:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bx/ac0e1348124c4302ad0da1d370775b7c/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'electric',
 'id': 'fc3a069a-ed71-5f2e-8d9a-86ad24a3f2a8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q4 E-TRON',
 'odometer': 96788,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc3a069a-ed71-5f2e-8d9a-86ad24a3f2a8/fc3a069a-ed71-5f2e-8d9a-86ad24a3f2a8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 623963,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/ac0e1348124c4302ad0da1d370775b7c/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc3a069a-ed71-5f2e-8d9a-86ad24a3f2a8/fc3a069a-ed71-5f2e-8d9a-86ad24a3f2a8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 622830,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/ac0e1348124c4302ad0da1d370775b7c/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc3a069a-ed71-5f2e-8d9a-86ad24a3f2a8/fc3a069a-ed71-5f2e-8d9a-86ad24a3f2a8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 602360,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/ac0e1348124c4302ad0da1d370775b7c/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc3a069a-ed71-5f2e-8d9a-86ad24a3f2a8/fc3a069a-ed71-5f2e-8d9a-86ad24a3f2a8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 667471,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/ac0e1348124c4302ad0da1d370775b7c/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc3a069a-ed71-5f2e-8d9a-86ad24a3f2a8/fc3a069a-ed71-5f2e-8d9a-86ad24a3f2a8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 543400,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/ac0e1348124c4302ad0da1d370775b7c/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc3a069a-ed71-5f2e-8d9a-86ad24a3f2a8/fc3a069a-ed71-5f2e-8d9a-86ad24a3f2a8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 572063,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/ac0e1348124c4302ad0da1d370775b7c/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc3a069a-ed71-5f2e-8d9a-86ad24a3f2a8/fc3a069a-ed71-5f2e-8d9a-86ad24a3f2a8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 628142,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/ac0e1348124c4302ad0da1d370775b7c/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc3a069a-ed71-5f2e-8d9a-86ad24a3f2a8/fc3a069a-ed71-5f2e-8d9a-86ad24a3f2a8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 687368,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/ac0e1348124c4302ad0da1d370775b7c/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc3a069a-ed71-5f2e-8d9a-86ad24a3f2a8/fc3a069a-ed71-5f2e-8d9a-86ad24a3f2a8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 541485,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/ac0e1348124c4302ad0da1d370775b7c/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc3a069a-ed71-5f2e-8d9a-86ad24a3f2a8/fc3a069a-ed71-5f2e-8d9a-86ad24a3f2a8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 515244,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/ac0e1348124c4302ad0da1d370775b7c/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q4 E-TRON BEV 82KWH 40 S LINE AUTO',
 'transmission': 'automatic',
 'trim': 'BEV 82KWH 40 S LINE AUTO',
 'vin': None,
 'year': 2022}
2026-03-26 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986114%27 HTTP/1.1" 200 None
2026-03-26 22:47:57 [ayvens.be] INFO: Saving data for 1986114: {'created_time': 1774565277.109869, 'last_price_update_time': 1774565277.109878, 'auction_closing_time': 1775028600.0}
2026-03-26 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986114') HTTP/1.1" 204 0
2026-03-26 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F1cf8f78f48424eb1834151b134f7cfd0%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/1cf8f78f48424eb1834151b134f7cfd0/images/large/4.jpg not downloaded yet
2026-03-26 22:47:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77276d0>
2026-03-26 22:47:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c2f1084-9ea9-5906-8c9c-c7eddb6bb6a3/0c2f1084-9ea9-5906-8c9c-c7eddb6bb6a3_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F59d814c8a95f44f5804bd516ad548727%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/59d814c8a95f44f5804bd516ad548727/images/large/1.jpg saved to cache
2026-03-26 22:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0c2f1084-9ea9-5906-8c9c-c7eddb6bb6a3
2026-03-26 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F1cf8f78f48424eb1834151b134f7cfd0%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/1cf8f78f48424eb1834151b134f7cfd0/images/large/5.jpg not downloaded yet
2026-03-26 22:47:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/59d814c8a95f44f5804bd516ad548727/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F1cf8f78f48424eb1834151b134f7cfd0%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/1cf8f78f48424eb1834151b134f7cfd0/images/large/6.jpg not downloaded yet
2026-03-26 22:47:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/59d814c8a95f44f5804bd516ad548727/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/13221be0df8a4ffe8ee6ffacbd25c41a/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/59d814c8a95f44f5804bd516ad548727/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/13221be0df8a4ffe8ee6ffacbd25c41a/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/13221be0df8a4ffe8ee6ffacbd25c41a/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F1cf8f78f48424eb1834151b134f7cfd0%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/1cf8f78f48424eb1834151b134f7cfd0/images/large/7.jpg not downloaded yet
2026-03-26 22:47:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/59d814c8a95f44f5804bd516ad548727/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/59d814c8a95f44f5804bd516ad548727/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F1cf8f78f48424eb1834151b134f7cfd0%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/1cf8f78f48424eb1834151b134f7cfd0/images/large/8.jpg not downloaded yet
2026-03-26 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F1cf8f78f48424eb1834151b134f7cfd0%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/1cf8f78f48424eb1834151b134f7cfd0/images/large/9.jpg not downloaded yet
2026-03-26 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F1cf8f78f48424eb1834151b134f7cfd0%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/1cf8f78f48424eb1834151b134f7cfd0/images/large/10.jpg not downloaded yet
2026-03-26 22:47:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b748b290>
2026-03-26 22:47:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c2f1084-9ea9-5906-8c9c-c7eddb6bb6a3/0c2f1084-9ea9-5906-8c9c-c7eddb6bb6a3_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F59d814c8a95f44f5804bd516ad548727%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/59d814c8a95f44f5804bd516ad548727/images/large/5.jpg saved to cache
2026-03-26 22:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0c2f1084-9ea9-5906-8c9c-c7eddb6bb6a3
2026-03-26 22:47:57 [ayvens.be] INFO: Found listing with ID: 1986118
2026-03-26 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986118%27 HTTP/1.1" 200 None
2026-03-26 22:47:57 [ayvens.be] INFO: Scrape type for 1986118: 1
2026-03-26 22:47:57 [ayvens.be] INFO: Extracting data for car ID: 1986118
2026-03-26 22:47:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0876d05a-e310-51a9-871a-8c4c4e06706d with identifier: 1986118
2026-03-26 22:47:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0876d05a-e310-51a9-871a-8c4c4e06706d with scrape type 1
2026-03-26 22:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0876d05a-e310-51a9-871a-8c4c4e06706d
2026-03-26 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2db%252Feaab306cefa74a61b51f6530e6745b15%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2db/eaab306cefa74a61b51f6530e6745b15/images/large/1.jpg not downloaded yet
2026-03-26 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2db%252Feaab306cefa74a61b51f6530e6745b15%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2db/eaab306cefa74a61b51f6530e6745b15/images/large/2.jpg not downloaded yet
2026-03-26 22:47:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/13221be0df8a4ffe8ee6ffacbd25c41a/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/13221be0df8a4ffe8ee6ffacbd25c41a/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2db%252Feaab306cefa74a61b51f6530e6745b15%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2db/eaab306cefa74a61b51f6530e6745b15/images/large/3.jpg not downloaded yet
2026-03-26 22:47:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b78c2c90>
2026-03-26 22:47:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c2f1084-9ea9-5906-8c9c-c7eddb6bb6a3/0c2f1084-9ea9-5906-8c9c-c7eddb6bb6a3_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F59d814c8a95f44f5804bd516ad548727%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/59d814c8a95f44f5804bd516ad548727/images/large/4.jpg saved to cache
2026-03-26 22:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0c2f1084-9ea9-5906-8c9c-c7eddb6bb6a3
2026-03-26 22:47:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79ddf10>
2026-03-26 22:47:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd05defc-932e-5f41-9fe2-636638421e1a/bd05defc-932e-5f41-9fe2-636638421e1a_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F13221be0df8a4ffe8ee6ffacbd25c41a%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/13221be0df8a4ffe8ee6ffacbd25c41a/images/large/4.jpg saved to cache
2026-03-26 22:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bd05defc-932e-5f41-9fe2-636638421e1a
2026-03-26 22:47:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77af8d0>
2026-03-26 22:47:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c2f1084-9ea9-5906-8c9c-c7eddb6bb6a3/0c2f1084-9ea9-5906-8c9c-c7eddb6bb6a3_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F59d814c8a95f44f5804bd516ad548727%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/59d814c8a95f44f5804bd516ad548727/images/large/7.jpg saved to cache
2026-03-26 22:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0c2f1084-9ea9-5906-8c9c-c7eddb6bb6a3
2026-03-26 22:47:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b787cd90>
2026-03-26 22:47:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd05defc-932e-5f41-9fe2-636638421e1a/bd05defc-932e-5f41-9fe2-636638421e1a_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F13221be0df8a4ffe8ee6ffacbd25c41a%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/13221be0df8a4ffe8ee6ffacbd25c41a/images/large/2.jpg saved to cache
2026-03-26 22:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bd05defc-932e-5f41-9fe2-636638421e1a
2026-03-26 22:47:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c7e510>
2026-03-26 22:47:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd05defc-932e-5f41-9fe2-636638421e1a/bd05defc-932e-5f41-9fe2-636638421e1a_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F13221be0df8a4ffe8ee6ffacbd25c41a%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/13221be0df8a4ffe8ee6ffacbd25c41a/images/large/3.jpg saved to cache
2026-03-26 22:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bd05defc-932e-5f41-9fe2-636638421e1a
2026-03-26 22:47:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6da7050>
2026-03-26 22:47:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c2f1084-9ea9-5906-8c9c-c7eddb6bb6a3/0c2f1084-9ea9-5906-8c9c-c7eddb6bb6a3_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F59d814c8a95f44f5804bd516ad548727%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/59d814c8a95f44f5804bd516ad548727/images/large/8.jpg saved to cache
2026-03-26 22:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0c2f1084-9ea9-5906-8c9c-c7eddb6bb6a3
2026-03-26 22:47:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77ad250>
2026-03-26 22:47:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c2f1084-9ea9-5906-8c9c-c7eddb6bb6a3/0c2f1084-9ea9-5906-8c9c-c7eddb6bb6a3_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F59d814c8a95f44f5804bd516ad548727%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/59d814c8a95f44f5804bd516ad548727/images/large/6.jpg saved to cache
2026-03-26 22:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0c2f1084-9ea9-5906-8c9c-c7eddb6bb6a3
2026-03-26 22:47:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/13221be0df8a4ffe8ee6ffacbd25c41a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2db%252Feaab306cefa74a61b51f6530e6745b15%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2db/eaab306cefa74a61b51f6530e6745b15/images/large/4.jpg not downloaded yet
2026-03-26 22:47:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/13221be0df8a4ffe8ee6ffacbd25c41a/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/59d814c8a95f44f5804bd516ad548727/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2db%252Feaab306cefa74a61b51f6530e6745b15%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2db/eaab306cefa74a61b51f6530e6745b15/images/large/5.jpg not downloaded yet
2026-03-26 22:47:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e158d0>
2026-03-26 22:47:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd05defc-932e-5f41-9fe2-636638421e1a/bd05defc-932e-5f41-9fe2-636638421e1a_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F13221be0df8a4ffe8ee6ffacbd25c41a%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/13221be0df8a4ffe8ee6ffacbd25c41a/images/large/5.jpg saved to cache
2026-03-26 22:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bd05defc-932e-5f41-9fe2-636638421e1a
2026-03-26 22:47:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7402f90>
2026-03-26 22:47:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd05defc-932e-5f41-9fe2-636638421e1a/bd05defc-932e-5f41-9fe2-636638421e1a_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F13221be0df8a4ffe8ee6ffacbd25c41a%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/13221be0df8a4ffe8ee6ffacbd25c41a/images/large/6.jpg saved to cache
2026-03-26 22:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bd05defc-932e-5f41-9fe2-636638421e1a
2026-03-26 22:47:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/1cf8f78f48424eb1834151b134f7cfd0/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/1cf8f78f48424eb1834151b134f7cfd0/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/59d814c8a95f44f5804bd516ad548727/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2db%252Feaab306cefa74a61b51f6530e6745b15%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2db/eaab306cefa74a61b51f6530e6745b15/images/large/6.jpg not downloaded yet
2026-03-26 22:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2db%252Feaab306cefa74a61b51f6530e6745b15%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2db/eaab306cefa74a61b51f6530e6745b15/images/large/7.jpg not downloaded yet
2026-03-26 22:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2db%252Feaab306cefa74a61b51f6530e6745b15%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2db/eaab306cefa74a61b51f6530e6745b15/images/large/8.jpg not downloaded yet
2026-03-26 22:47:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7564a10>
2026-03-26 22:47:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd05defc-932e-5f41-9fe2-636638421e1a/bd05defc-932e-5f41-9fe2-636638421e1a_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F13221be0df8a4ffe8ee6ffacbd25c41a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/13221be0df8a4ffe8ee6ffacbd25c41a/images/large/1.jpg saved to cache
2026-03-26 22:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bd05defc-932e-5f41-9fe2-636638421e1a
2026-03-26 22:47:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7662fd0>
2026-03-26 22:47:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd05defc-932e-5f41-9fe2-636638421e1a/bd05defc-932e-5f41-9fe2-636638421e1a_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F13221be0df8a4ffe8ee6ffacbd25c41a%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/13221be0df8a4ffe8ee6ffacbd25c41a/images/large/7.jpg saved to cache
2026-03-26 22:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bd05defc-932e-5f41-9fe2-636638421e1a
2026-03-26 22:47:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7772650>
2026-03-26 22:47:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c2f1084-9ea9-5906-8c9c-c7eddb6bb6a3/0c2f1084-9ea9-5906-8c9c-c7eddb6bb6a3_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F59d814c8a95f44f5804bd516ad548727%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/59d814c8a95f44f5804bd516ad548727/images/large/10.jpg saved to cache
2026-03-26 22:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0c2f1084-9ea9-5906-8c9c-c7eddb6bb6a3
2026-03-26 22:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2db%252Feaab306cefa74a61b51f6530e6745b15%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2db/eaab306cefa74a61b51f6530e6745b15/images/large/9.jpg not downloaded yet
2026-03-26 22:47:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/1cf8f78f48424eb1834151b134f7cfd0/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2db%252Feaab306cefa74a61b51f6530e6745b15%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2db/eaab306cefa74a61b51f6530e6745b15/images/large/10.jpg not downloaded yet
2026-03-26 22:47:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/1cf8f78f48424eb1834151b134f7cfd0/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/1cf8f78f48424eb1834151b134f7cfd0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/13221be0df8a4ffe8ee6ffacbd25c41a/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/13221be0df8a4ffe8ee6ffacbd25c41a/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cc1d50>
2026-03-26 22:47:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_796264d2-ef71-5414-ba30-f0650c221ace/796264d2-ef71-5414-ba30-f0650c221ace_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F1cf8f78f48424eb1834151b134f7cfd0%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/1cf8f78f48424eb1834151b134f7cfd0/images/large/4.jpg saved to cache
2026-03-26 22:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 796264d2-ef71-5414-ba30-f0650c221ace
2026-03-26 22:47:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79d5710>
2026-03-26 22:47:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_796264d2-ef71-5414-ba30-f0650c221ace/796264d2-ef71-5414-ba30-f0650c221ace_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F1cf8f78f48424eb1834151b134f7cfd0%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/1cf8f78f48424eb1834151b134f7cfd0/images/large/3.jpg saved to cache
2026-03-26 22:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 796264d2-ef71-5414-ba30-f0650c221ace
2026-03-26 22:47:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7452050>
2026-03-26 22:47:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c2f1084-9ea9-5906-8c9c-c7eddb6bb6a3/0c2f1084-9ea9-5906-8c9c-c7eddb6bb6a3_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F59d814c8a95f44f5804bd516ad548727%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/59d814c8a95f44f5804bd516ad548727/images/large/9.jpg saved to cache
2026-03-26 22:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0c2f1084-9ea9-5906-8c9c-c7eddb6bb6a3
2026-03-26 22:47:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0c2f1084-9ea9-5906-8c9c-c7eddb6bb6a3, skipping ID generation
2026-03-26 22:47:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c2f1084-9ea9-5906-8c9c-c7eddb6bb6a3 with scrape type 1
2026-03-26 22:47:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0c2f1084-9ea9-5906-8c9c-c7eddb6bb6a3 sending to next pipeline
2026-03-26 22:47:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 0c2f1084-9ea9-5906-8c9c-c7eddb6bb6a3, identifier: 1986115
2026-03-26 22:47:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/1cf8f78f48424eb1834151b134f7cfd0/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:59 [ayvens.be] INFO: Found listing with ID: 1986119
2026-03-26 22:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986119%27 HTTP/1.1" 200 None
2026-03-26 22:47:59 [ayvens.be] INFO: Scrape type for 1986119: 1
2026-03-26 22:47:59 [ayvens.be] INFO: Extracting data for car ID: 1986119
2026-03-26 22:47:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e83682af-c1d5-556f-98a5-e781e5a0138b with identifier: 1986119
2026-03-26 22:47:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e83682af-c1d5-556f-98a5-e781e5a0138b with scrape type 1
2026-03-26 22:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e83682af-c1d5-556f-98a5-e781e5a0138b
2026-03-26 22:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252Fdd9c567f7248403fa3994886528b2a27%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/dd9c567f7248403fa3994886528b2a27/images/large/1.jpg not downloaded yet
2026-03-26 22:47:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 0c2f1084-9ea9-5906-8c9c-c7eddb6bb6a3 with identifier: 1986115
2026-03-26 22:47:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 0c2f1084-9ea9-5906-8c9c-c7eddb6bb6a3 with identifier: 1986115
2026-03-26 22:47:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 0c2f1084-9ea9-5906-8c9c-c7eddb6bb6a3 with identifier: 1986115 to the API
2026-03-26 22:47:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:47:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:47:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bh/59d814c8a95f44f5804bd516ad548727/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '0c2f1084-9ea9-5906-8c9c-c7eddb6bb6a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'OCTAVIA COMBI',
 'odometer': 106114,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c2f1084-9ea9-5906-8c9c-c7eddb6bb6a3/0c2f1084-9ea9-5906-8c9c-c7eddb6bb6a3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 720945,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/59d814c8a95f44f5804bd516ad548727/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c2f1084-9ea9-5906-8c9c-c7eddb6bb6a3/0c2f1084-9ea9-5906-8c9c-c7eddb6bb6a3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 616410,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/59d814c8a95f44f5804bd516ad548727/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c2f1084-9ea9-5906-8c9c-c7eddb6bb6a3/0c2f1084-9ea9-5906-8c9c-c7eddb6bb6a3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 679056,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/59d814c8a95f44f5804bd516ad548727/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c2f1084-9ea9-5906-8c9c-c7eddb6bb6a3/0c2f1084-9ea9-5906-8c9c-c7eddb6bb6a3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 813602,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/59d814c8a95f44f5804bd516ad548727/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c2f1084-9ea9-5906-8c9c-c7eddb6bb6a3/0c2f1084-9ea9-5906-8c9c-c7eddb6bb6a3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 653043,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/59d814c8a95f44f5804bd516ad548727/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c2f1084-9ea9-5906-8c9c-c7eddb6bb6a3/0c2f1084-9ea9-5906-8c9c-c7eddb6bb6a3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 565398,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/59d814c8a95f44f5804bd516ad548727/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c2f1084-9ea9-5906-8c9c-c7eddb6bb6a3/0c2f1084-9ea9-5906-8c9c-c7eddb6bb6a3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 670876,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/59d814c8a95f44f5804bd516ad548727/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c2f1084-9ea9-5906-8c9c-c7eddb6bb6a3/0c2f1084-9ea9-5906-8c9c-c7eddb6bb6a3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 813277,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/59d814c8a95f44f5804bd516ad548727/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c2f1084-9ea9-5906-8c9c-c7eddb6bb6a3/0c2f1084-9ea9-5906-8c9c-c7eddb6bb6a3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 645762,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/59d814c8a95f44f5804bd516ad548727/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c2f1084-9ea9-5906-8c9c-c7eddb6bb6a3/0c2f1084-9ea9-5906-8c9c-c7eddb6bb6a3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 572382,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/59d814c8a95f44f5804bd516ad548727/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA OCTAVIA COMBI 1.5 TGI 96KW DSG7 AMBITION',
 'transmission': 'automatic',
 'trim': '1.5 TGI 96KW DSG7 AMBITION',
 'vin': None,
 'year': 2021}
2026-03-26 22:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986115%27 HTTP/1.1" 200 None
2026-03-26 22:47:59 [ayvens.be] INFO: Saving data for 1986115: {'created_time': 1774565279.733715, 'last_price_update_time': 1774565279.733724, 'auction_closing_time': 1775028600.0}
2026-03-26 22:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986115') HTTP/1.1" 204 0
2026-03-26 22:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252Fdd9c567f7248403fa3994886528b2a27%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/dd9c567f7248403fa3994886528b2a27/images/large/2.jpg not downloaded yet
2026-03-26 22:47:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2db/eaab306cefa74a61b51f6530e6745b15/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252Fdd9c567f7248403fa3994886528b2a27%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/dd9c567f7248403fa3994886528b2a27/images/large/3.jpg not downloaded yet
2026-03-26 22:47:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7570b10>
2026-03-26 22:47:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_796264d2-ef71-5414-ba30-f0650c221ace/796264d2-ef71-5414-ba30-f0650c221ace_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F1cf8f78f48424eb1834151b134f7cfd0%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/1cf8f78f48424eb1834151b134f7cfd0/images/large/5.jpg saved to cache
2026-03-26 22:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 796264d2-ef71-5414-ba30-f0650c221ace
2026-03-26 22:47:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c7c790>
2026-03-26 22:47:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:47:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_796264d2-ef71-5414-ba30-f0650c221ace/796264d2-ef71-5414-ba30-f0650c221ace_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F1cf8f78f48424eb1834151b134f7cfd0%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/1cf8f78f48424eb1834151b134f7cfd0/images/large/6.jpg saved to cache
2026-03-26 22:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 796264d2-ef71-5414-ba30-f0650c221ace
2026-03-26 22:47:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:47:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e44990>
2026-03-26 22:47:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:47:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:47:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_796264d2-ef71-5414-ba30-f0650c221ace/796264d2-ef71-5414-ba30-f0650c221ace_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F1cf8f78f48424eb1834151b134f7cfd0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/1cf8f78f48424eb1834151b134f7cfd0/images/large/1.jpg saved to cache
2026-03-26 22:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 796264d2-ef71-5414-ba30-f0650c221ace
2026-03-26 22:48:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7725e10>
2026-03-26 22:48:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd05defc-932e-5f41-9fe2-636638421e1a/bd05defc-932e-5f41-9fe2-636638421e1a_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F13221be0df8a4ffe8ee6ffacbd25c41a%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/13221be0df8a4ffe8ee6ffacbd25c41a/images/large/9.jpg saved to cache
2026-03-26 22:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bd05defc-932e-5f41-9fe2-636638421e1a
2026-03-26 22:48:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b748b210>
2026-03-26 22:48:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd05defc-932e-5f41-9fe2-636638421e1a/bd05defc-932e-5f41-9fe2-636638421e1a_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F13221be0df8a4ffe8ee6ffacbd25c41a%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/13221be0df8a4ffe8ee6ffacbd25c41a/images/large/10.jpg saved to cache
2026-03-26 22:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bd05defc-932e-5f41-9fe2-636638421e1a
2026-03-26 22:48:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd0d8410>
2026-03-26 22:48:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_796264d2-ef71-5414-ba30-f0650c221ace/796264d2-ef71-5414-ba30-f0650c221ace_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F1cf8f78f48424eb1834151b134f7cfd0%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/1cf8f78f48424eb1834151b134f7cfd0/images/large/2.jpg saved to cache
2026-03-26 22:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 796264d2-ef71-5414-ba30-f0650c221ace
2026-03-26 22:48:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/1cf8f78f48424eb1834151b134f7cfd0/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252Fdd9c567f7248403fa3994886528b2a27%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/dd9c567f7248403fa3994886528b2a27/images/large/4.jpg not downloaded yet
2026-03-26 22:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252Fdd9c567f7248403fa3994886528b2a27%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/dd9c567f7248403fa3994886528b2a27/images/large/5.jpg not downloaded yet
2026-03-26 22:48:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2db/eaab306cefa74a61b51f6530e6745b15/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7567650>
2026-03-26 22:48:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0876d05a-e310-51a9-871a-8c4c4e06706d/0876d05a-e310-51a9-871a-8c4c4e06706d_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2db%252Feaab306cefa74a61b51f6530e6745b15%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2db/eaab306cefa74a61b51f6530e6745b15/images/large/1.jpg saved to cache
2026-03-26 22:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0876d05a-e310-51a9-871a-8c4c4e06706d
2026-03-26 22:48:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2db/eaab306cefa74a61b51f6530e6745b15/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252Fdd9c567f7248403fa3994886528b2a27%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/dd9c567f7248403fa3994886528b2a27/images/large/6.jpg not downloaded yet
2026-03-26 22:48:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/1cf8f78f48424eb1834151b134f7cfd0/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/1cf8f78f48424eb1834151b134f7cfd0/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2db/eaab306cefa74a61b51f6530e6745b15/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b744a210>
2026-03-26 22:48:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_796264d2-ef71-5414-ba30-f0650c221ace/796264d2-ef71-5414-ba30-f0650c221ace_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F1cf8f78f48424eb1834151b134f7cfd0%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/1cf8f78f48424eb1834151b134f7cfd0/images/large/10.jpg saved to cache
2026-03-26 22:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 796264d2-ef71-5414-ba30-f0650c221ace
2026-03-26 22:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252Fdd9c567f7248403fa3994886528b2a27%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/dd9c567f7248403fa3994886528b2a27/images/large/7.jpg not downloaded yet
2026-03-26 22:48:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2db/eaab306cefa74a61b51f6530e6745b15/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252Fdd9c567f7248403fa3994886528b2a27%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/dd9c567f7248403fa3994886528b2a27/images/large/8.jpg not downloaded yet
2026-03-26 22:48:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77ac5d0>
2026-03-26 22:48:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0876d05a-e310-51a9-871a-8c4c4e06706d/0876d05a-e310-51a9-871a-8c4c4e06706d_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2db%252Feaab306cefa74a61b51f6530e6745b15%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2db/eaab306cefa74a61b51f6530e6745b15/images/large/2.jpg saved to cache
2026-03-26 22:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0876d05a-e310-51a9-871a-8c4c4e06706d
2026-03-26 22:48:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7818450>
2026-03-26 22:48:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0876d05a-e310-51a9-871a-8c4c4e06706d/0876d05a-e310-51a9-871a-8c4c4e06706d_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2db%252Feaab306cefa74a61b51f6530e6745b15%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2db/eaab306cefa74a61b51f6530e6745b15/images/large/3.jpg saved to cache
2026-03-26 22:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0876d05a-e310-51a9-871a-8c4c4e06706d
2026-03-26 22:48:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74ddd10>
2026-03-26 22:48:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_796264d2-ef71-5414-ba30-f0650c221ace/796264d2-ef71-5414-ba30-f0650c221ace_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F1cf8f78f48424eb1834151b134f7cfd0%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/1cf8f78f48424eb1834151b134f7cfd0/images/large/9.jpg saved to cache
2026-03-26 22:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 796264d2-ef71-5414-ba30-f0650c221ace
2026-03-26 22:48:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7459e10>
2026-03-26 22:48:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_796264d2-ef71-5414-ba30-f0650c221ace/796264d2-ef71-5414-ba30-f0650c221ace_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F1cf8f78f48424eb1834151b134f7cfd0%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/1cf8f78f48424eb1834151b134f7cfd0/images/large/8.jpg saved to cache
2026-03-26 22:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 796264d2-ef71-5414-ba30-f0650c221ace
2026-03-26 22:48:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7ceb210>
2026-03-26 22:48:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0876d05a-e310-51a9-871a-8c4c4e06706d/0876d05a-e310-51a9-871a-8c4c4e06706d_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2db%252Feaab306cefa74a61b51f6530e6745b15%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2db/eaab306cefa74a61b51f6530e6745b15/images/large/4.jpg saved to cache
2026-03-26 22:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0876d05a-e310-51a9-871a-8c4c4e06706d
2026-03-26 22:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252Fdd9c567f7248403fa3994886528b2a27%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/dd9c567f7248403fa3994886528b2a27/images/large/9.jpg not downloaded yet
2026-03-26 22:48:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/13221be0df8a4ffe8ee6ffacbd25c41a/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252Fdd9c567f7248403fa3994886528b2a27%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/dd9c567f7248403fa3994886528b2a27/images/large/10.jpg not downloaded yet
2026-03-26 22:48:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/1cf8f78f48424eb1834151b134f7cfd0/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7491410>
2026-03-26 22:48:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0876d05a-e310-51a9-871a-8c4c4e06706d/0876d05a-e310-51a9-871a-8c4c4e06706d_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2db%252Feaab306cefa74a61b51f6530e6745b15%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2db/eaab306cefa74a61b51f6530e6745b15/images/large/5.jpg saved to cache
2026-03-26 22:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0876d05a-e310-51a9-871a-8c4c4e06706d
2026-03-26 22:48:01 [ayvens.be] INFO: Found listing with ID: 1986120
2026-03-26 22:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986120%27 HTTP/1.1" 200 None
2026-03-26 22:48:01 [ayvens.be] INFO: Scrape type for 1986120: 1
2026-03-26 22:48:01 [ayvens.be] INFO: Extracting data for car ID: 1986120
2026-03-26 22:48:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d305006-0852-5850-8020-cc419dbd9f86 with identifier: 1986120
2026-03-26 22:48:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d305006-0852-5850-8020-cc419dbd9f86 with scrape type 1
2026-03-26 22:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2d305006-0852-5850-8020-cc419dbd9f86
2026-03-26 22:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F4280ec5a05c54f64b2ef78b66b2eac0d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/4280ec5a05c54f64b2ef78b66b2eac0d/images/large/1.jpg not downloaded yet
2026-03-26 22:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F4280ec5a05c54f64b2ef78b66b2eac0d%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/4280ec5a05c54f64b2ef78b66b2eac0d/images/large/2.jpg not downloaded yet
2026-03-26 22:48:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2db/eaab306cefa74a61b51f6530e6745b15/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F4280ec5a05c54f64b2ef78b66b2eac0d%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/4280ec5a05c54f64b2ef78b66b2eac0d/images/large/3.jpg not downloaded yet
2026-03-26 22:48:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7494890>
2026-03-26 22:48:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd05defc-932e-5f41-9fe2-636638421e1a/bd05defc-932e-5f41-9fe2-636638421e1a_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F13221be0df8a4ffe8ee6ffacbd25c41a%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/13221be0df8a4ffe8ee6ffacbd25c41a/images/large/8.jpg saved to cache
2026-03-26 22:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bd05defc-932e-5f41-9fe2-636638421e1a
2026-03-26 22:48:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bd05defc-932e-5f41-9fe2-636638421e1a, skipping ID generation
2026-03-26 22:48:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd05defc-932e-5f41-9fe2-636638421e1a with scrape type 1
2026-03-26 22:48:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bd05defc-932e-5f41-9fe2-636638421e1a sending to next pipeline
2026-03-26 22:48:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: bd05defc-932e-5f41-9fe2-636638421e1a, identifier: 1986116
2026-03-26 22:48:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77eb3d0>
2026-03-26 22:48:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_796264d2-ef71-5414-ba30-f0650c221ace/796264d2-ef71-5414-ba30-f0650c221ace_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F1cf8f78f48424eb1834151b134f7cfd0%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/1cf8f78f48424eb1834151b134f7cfd0/images/large/7.jpg saved to cache
2026-03-26 22:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 796264d2-ef71-5414-ba30-f0650c221ace
2026-03-26 22:48:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 796264d2-ef71-5414-ba30-f0650c221ace, skipping ID generation
2026-03-26 22:48:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 796264d2-ef71-5414-ba30-f0650c221ace with scrape type 1
2026-03-26 22:48:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 796264d2-ef71-5414-ba30-f0650c221ace sending to next pipeline
2026-03-26 22:48:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 796264d2-ef71-5414-ba30-f0650c221ace, identifier: 1986117
2026-03-26 22:48:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2db/eaab306cefa74a61b51f6530e6745b15/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2db/eaab306cefa74a61b51f6530e6745b15/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: bd05defc-932e-5f41-9fe2-636638421e1a with identifier: 1986116
2026-03-26 22:48:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: bd05defc-932e-5f41-9fe2-636638421e1a with identifier: 1986116
2026-03-26 22:48:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: bd05defc-932e-5f41-9fe2-636638421e1a with identifier: 1986116 to the API
2026-03-26 22:48:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:48:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:48:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bt/13221be0df8a4ffe8ee6ffacbd25c41a/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'electric',
 'id': 'bd05defc-932e-5f41-9fe2-636638421e1a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'TESLA',
 'model': 'MODEL 3',
 'odometer': 146140,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd05defc-932e-5f41-9fe2-636638421e1a/bd05defc-932e-5f41-9fe2-636638421e1a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 354293,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/13221be0df8a4ffe8ee6ffacbd25c41a/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd05defc-932e-5f41-9fe2-636638421e1a/bd05defc-932e-5f41-9fe2-636638421e1a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 429883,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/13221be0df8a4ffe8ee6ffacbd25c41a/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd05defc-932e-5f41-9fe2-636638421e1a/bd05defc-932e-5f41-9fe2-636638421e1a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 436307,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/13221be0df8a4ffe8ee6ffacbd25c41a/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd05defc-932e-5f41-9fe2-636638421e1a/bd05defc-932e-5f41-9fe2-636638421e1a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 430997,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/13221be0df8a4ffe8ee6ffacbd25c41a/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd05defc-932e-5f41-9fe2-636638421e1a/bd05defc-932e-5f41-9fe2-636638421e1a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 290062,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/13221be0df8a4ffe8ee6ffacbd25c41a/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd05defc-932e-5f41-9fe2-636638421e1a/bd05defc-932e-5f41-9fe2-636638421e1a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 214257,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/13221be0df8a4ffe8ee6ffacbd25c41a/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd05defc-932e-5f41-9fe2-636638421e1a/bd05defc-932e-5f41-9fe2-636638421e1a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 341103,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/13221be0df8a4ffe8ee6ffacbd25c41a/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd05defc-932e-5f41-9fe2-636638421e1a/bd05defc-932e-5f41-9fe2-636638421e1a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 321598,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/13221be0df8a4ffe8ee6ffacbd25c41a/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd05defc-932e-5f41-9fe2-636638421e1a/bd05defc-932e-5f41-9fe2-636638421e1a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 235234,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/13221be0df8a4ffe8ee6ffacbd25c41a/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd05defc-932e-5f41-9fe2-636638421e1a/bd05defc-932e-5f41-9fe2-636638421e1a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 235937,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/13221be0df8a4ffe8ee6ffacbd25c41a/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TESLA MODEL 3 BEV 75KWH LONG RANGE DUAL MOTOR 4WD AUTO',
 'transmission': 'automatic',
 'trim': 'BEV 75KWH LONG RANGE DUAL MOTOR 4WD AUTO',
 'vin': None,
 'year': 2022}
2026-03-26 22:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986116%27 HTTP/1.1" 200 None
2026-03-26 22:48:02 [ayvens.be] INFO: Saving data for 1986116: {'created_time': 1774565282.322426, 'last_price_update_time': 1774565282.322437, 'auction_closing_time': 1775028600.0}
2026-03-26 22:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986116') HTTP/1.1" 204 0
2026-03-26 22:48:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 796264d2-ef71-5414-ba30-f0650c221ace with identifier: 1986117
2026-03-26 22:48:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 796264d2-ef71-5414-ba30-f0650c221ace with identifier: 1986117
2026-03-26 22:48:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 796264d2-ef71-5414-ba30-f0650c221ace with identifier: 1986117 to the API
2026-03-26 22:48:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:48:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:48:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2da/1cf8f78f48424eb1834151b134f7cfd0/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '796264d2-ef71-5414-ba30-f0650c221ace',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLA',
 'odometer': 87698,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_796264d2-ef71-5414-ba30-f0650c221ace/796264d2-ef71-5414-ba30-f0650c221ace_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 578643,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/1cf8f78f48424eb1834151b134f7cfd0/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_796264d2-ef71-5414-ba30-f0650c221ace/796264d2-ef71-5414-ba30-f0650c221ace_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 588199,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/1cf8f78f48424eb1834151b134f7cfd0/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_796264d2-ef71-5414-ba30-f0650c221ace/796264d2-ef71-5414-ba30-f0650c221ace_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 612521,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/1cf8f78f48424eb1834151b134f7cfd0/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_796264d2-ef71-5414-ba30-f0650c221ace/796264d2-ef71-5414-ba30-f0650c221ace_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 624219,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/1cf8f78f48424eb1834151b134f7cfd0/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_796264d2-ef71-5414-ba30-f0650c221ace/796264d2-ef71-5414-ba30-f0650c221ace_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 513630,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/1cf8f78f48424eb1834151b134f7cfd0/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_796264d2-ef71-5414-ba30-f0650c221ace/796264d2-ef71-5414-ba30-f0650c221ace_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 629085,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/1cf8f78f48424eb1834151b134f7cfd0/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_796264d2-ef71-5414-ba30-f0650c221ace/796264d2-ef71-5414-ba30-f0650c221ace_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 604603,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/1cf8f78f48424eb1834151b134f7cfd0/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_796264d2-ef71-5414-ba30-f0650c221ace/796264d2-ef71-5414-ba30-f0650c221ace_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 639509,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/1cf8f78f48424eb1834151b134f7cfd0/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_796264d2-ef71-5414-ba30-f0650c221ace/796264d2-ef71-5414-ba30-f0650c221ace_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 600350,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/1cf8f78f48424eb1834151b134f7cfd0/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_796264d2-ef71-5414-ba30-f0650c221ace/796264d2-ef71-5414-ba30-f0650c221ace_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 629085,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/1cf8f78f48424eb1834151b134f7cfd0/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLA 1.3 GLA 250 E DCT AMG LINE',
 'transmission': 'automatic',
 'trim': '1.3 GLA 250 E DCT AMG LINE',
 'vin': None,
 'year': 2023}
2026-03-26 22:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986117%27 HTTP/1.1" 200 None
2026-03-26 22:48:02 [ayvens.be] INFO: Saving data for 1986117: {'created_time': 1774565282.673191, 'last_price_update_time': 1774565282.6732, 'auction_closing_time': 1775028600.0}
2026-03-26 22:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986117') HTTP/1.1" 204 0
2026-03-26 22:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F4280ec5a05c54f64b2ef78b66b2eac0d%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/4280ec5a05c54f64b2ef78b66b2eac0d/images/large/4.jpg not downloaded yet
2026-03-26 22:48:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2db/eaab306cefa74a61b51f6530e6745b15/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2db/eaab306cefa74a61b51f6530e6745b15/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F4280ec5a05c54f64b2ef78b66b2eac0d%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/4280ec5a05c54f64b2ef78b66b2eac0d/images/large/5.jpg not downloaded yet
2026-03-26 22:48:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79a1850>
2026-03-26 22:48:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0876d05a-e310-51a9-871a-8c4c4e06706d/0876d05a-e310-51a9-871a-8c4c4e06706d_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2db%252Feaab306cefa74a61b51f6530e6745b15%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2db/eaab306cefa74a61b51f6530e6745b15/images/large/10.jpg saved to cache
2026-03-26 22:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0876d05a-e310-51a9-871a-8c4c4e06706d
2026-03-26 22:48:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd275cd0>
2026-03-26 22:48:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0876d05a-e310-51a9-871a-8c4c4e06706d/0876d05a-e310-51a9-871a-8c4c4e06706d_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2db%252Feaab306cefa74a61b51f6530e6745b15%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2db/eaab306cefa74a61b51f6530e6745b15/images/large/8.jpg saved to cache
2026-03-26 22:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0876d05a-e310-51a9-871a-8c4c4e06706d
2026-03-26 22:48:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b781ad50>
2026-03-26 22:48:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0876d05a-e310-51a9-871a-8c4c4e06706d/0876d05a-e310-51a9-871a-8c4c4e06706d_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2db%252Feaab306cefa74a61b51f6530e6745b15%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2db/eaab306cefa74a61b51f6530e6745b15/images/large/7.jpg saved to cache
2026-03-26 22:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0876d05a-e310-51a9-871a-8c4c4e06706d
2026-03-26 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F4280ec5a05c54f64b2ef78b66b2eac0d%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/4280ec5a05c54f64b2ef78b66b2eac0d/images/large/6.jpg not downloaded yet
2026-03-26 22:48:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bc/dd9c567f7248403fa3994886528b2a27/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b728ed10>
2026-03-26 22:48:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0876d05a-e310-51a9-871a-8c4c4e06706d/0876d05a-e310-51a9-871a-8c4c4e06706d_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2db%252Feaab306cefa74a61b51f6530e6745b15%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2db/eaab306cefa74a61b51f6530e6745b15/images/large/6.jpg saved to cache
2026-03-26 22:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0876d05a-e310-51a9-871a-8c4c4e06706d
2026-03-26 22:48:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6d73550>
2026-03-26 22:48:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0876d05a-e310-51a9-871a-8c4c4e06706d/0876d05a-e310-51a9-871a-8c4c4e06706d_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2db%252Feaab306cefa74a61b51f6530e6745b15%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2db/eaab306cefa74a61b51f6530e6745b15/images/large/9.jpg saved to cache
2026-03-26 22:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0876d05a-e310-51a9-871a-8c4c4e06706d
2026-03-26 22:48:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0876d05a-e310-51a9-871a-8c4c4e06706d, skipping ID generation
2026-03-26 22:48:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0876d05a-e310-51a9-871a-8c4c4e06706d with scrape type 1
2026-03-26 22:48:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0876d05a-e310-51a9-871a-8c4c4e06706d sending to next pipeline
2026-03-26 22:48:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 0876d05a-e310-51a9-871a-8c4c4e06706d, identifier: 1986118
2026-03-26 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F4280ec5a05c54f64b2ef78b66b2eac0d%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/4280ec5a05c54f64b2ef78b66b2eac0d/images/large/7.jpg not downloaded yet
2026-03-26 22:48:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 0876d05a-e310-51a9-871a-8c4c4e06706d with identifier: 1986118
2026-03-26 22:48:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 0876d05a-e310-51a9-871a-8c4c4e06706d with identifier: 1986118
2026-03-26 22:48:03 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 0876d05a-e310-51a9-871a-8c4c4e06706d with identifier: 1986118 to the API
2026-03-26 22:48:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:48:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:48:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2db/eaab306cefa74a61b51f6530e6745b15/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '0876d05a-e310-51a9-871a-8c4c4e06706d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'EXPRESS',
 'odometer': 66102,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0876d05a-e310-51a9-871a-8c4c4e06706d/0876d05a-e310-51a9-871a-8c4c4e06706d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 584826,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2db/eaab306cefa74a61b51f6530e6745b15/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0876d05a-e310-51a9-871a-8c4c4e06706d/0876d05a-e310-51a9-871a-8c4c4e06706d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 583709,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2db/eaab306cefa74a61b51f6530e6745b15/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0876d05a-e310-51a9-871a-8c4c4e06706d/0876d05a-e310-51a9-871a-8c4c4e06706d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 560540,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2db/eaab306cefa74a61b51f6530e6745b15/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0876d05a-e310-51a9-871a-8c4c4e06706d/0876d05a-e310-51a9-871a-8c4c4e06706d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 598629,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2db/eaab306cefa74a61b51f6530e6745b15/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0876d05a-e310-51a9-871a-8c4c4e06706d/0876d05a-e310-51a9-871a-8c4c4e06706d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 538264,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2db/eaab306cefa74a61b51f6530e6745b15/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0876d05a-e310-51a9-871a-8c4c4e06706d/0876d05a-e310-51a9-871a-8c4c4e06706d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 723994,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2db/eaab306cefa74a61b51f6530e6745b15/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0876d05a-e310-51a9-871a-8c4c4e06706d/0876d05a-e310-51a9-871a-8c4c4e06706d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 613938,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2db/eaab306cefa74a61b51f6530e6745b15/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0876d05a-e310-51a9-871a-8c4c4e06706d/0876d05a-e310-51a9-871a-8c4c4e06706d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 849581,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2db/eaab306cefa74a61b51f6530e6745b15/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0876d05a-e310-51a9-871a-8c4c4e06706d/0876d05a-e310-51a9-871a-8c4c4e06706d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 800653,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2db/eaab306cefa74a61b51f6530e6745b15/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0876d05a-e310-51a9-871a-8c4c4e06706d/0876d05a-e310-51a9-871a-8c4c4e06706d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 570528,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2db/eaab306cefa74a61b51f6530e6745b15/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-15',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT EXPRESS 1.5 DCI BLUE 75 CONFORT',
 'transmission': 'manual',
 'trim': '1.5 DCI BLUE 75 CONFORT',
 'vin': None,
 'year': 2022}
2026-03-26 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986118%27 HTTP/1.1" 200 None
2026-03-26 22:48:03 [ayvens.be] INFO: Saving data for 1986118: {'created_time': 1774565283.687203, 'last_price_update_time': 1774565283.687212, 'auction_closing_time': 1775028600.0}
2026-03-26 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986118') HTTP/1.1" 204 0
2026-03-26 22:48:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bc/dd9c567f7248403fa3994886528b2a27/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bc/dd9c567f7248403fa3994886528b2a27/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F4280ec5a05c54f64b2ef78b66b2eac0d%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/4280ec5a05c54f64b2ef78b66b2eac0d/images/large/8.jpg not downloaded yet
2026-03-26 22:48:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cc8ad0>
2026-03-26 22:48:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e83682af-c1d5-556f-98a5-e781e5a0138b/e83682af-c1d5-556f-98a5-e781e5a0138b_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252Fdd9c567f7248403fa3994886528b2a27%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/dd9c567f7248403fa3994886528b2a27/images/large/1.jpg saved to cache
2026-03-26 22:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e83682af-c1d5-556f-98a5-e781e5a0138b
2026-03-26 22:48:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bc/dd9c567f7248403fa3994886528b2a27/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F4280ec5a05c54f64b2ef78b66b2eac0d%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/4280ec5a05c54f64b2ef78b66b2eac0d/images/large/9.jpg not downloaded yet
2026-03-26 22:48:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bc/dd9c567f7248403fa3994886528b2a27/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F4280ec5a05c54f64b2ef78b66b2eac0d%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/4280ec5a05c54f64b2ef78b66b2eac0d/images/large/10.jpg not downloaded yet
2026-03-26 22:48:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bc/dd9c567f7248403fa3994886528b2a27/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e34d90>
2026-03-26 22:48:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e83682af-c1d5-556f-98a5-e781e5a0138b/e83682af-c1d5-556f-98a5-e781e5a0138b_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252Fdd9c567f7248403fa3994886528b2a27%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/dd9c567f7248403fa3994886528b2a27/images/large/2.jpg saved to cache
2026-03-26 22:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e83682af-c1d5-556f-98a5-e781e5a0138b
2026-03-26 22:48:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7aa2b50>
2026-03-26 22:48:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e83682af-c1d5-556f-98a5-e781e5a0138b/e83682af-c1d5-556f-98a5-e781e5a0138b_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252Fdd9c567f7248403fa3994886528b2a27%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/dd9c567f7248403fa3994886528b2a27/images/large/3.jpg saved to cache
2026-03-26 22:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e83682af-c1d5-556f-98a5-e781e5a0138b
2026-03-26 22:48:04 [ayvens.be] INFO: Found listing with ID: 1986121
2026-03-26 22:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986121%27 HTTP/1.1" 200 None
2026-03-26 22:48:04 [ayvens.be] INFO: Scrape type for 1986121: 1
2026-03-26 22:48:04 [ayvens.be] INFO: Extracting data for car ID: 1986121
2026-03-26 22:48:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c962d856-a1e1-5c8f-bee9-de129749fcf4 with identifier: 1986121
2026-03-26 22:48:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c962d856-a1e1-5c8f-bee9-de129749fcf4 with scrape type 1
2026-03-26 22:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c962d856-a1e1-5c8f-bee9-de129749fcf4
2026-03-26 22:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252Fd293fb6265c34a66b7d826ab796c8445%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/d293fb6265c34a66b7d826ab796c8445/images/large/1.jpg not downloaded yet
2026-03-26 22:48:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bc/dd9c567f7248403fa3994886528b2a27/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bc/dd9c567f7248403fa3994886528b2a27/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252Fd293fb6265c34a66b7d826ab796c8445%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/d293fb6265c34a66b7d826ab796c8445/images/large/2.jpg not downloaded yet
2026-03-26 22:48:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bc/dd9c567f7248403fa3994886528b2a27/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252Fd293fb6265c34a66b7d826ab796c8445%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/d293fb6265c34a66b7d826ab796c8445/images/large/3.jpg not downloaded yet
2026-03-26 22:48:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79d4f10>
2026-03-26 22:48:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e83682af-c1d5-556f-98a5-e781e5a0138b/e83682af-c1d5-556f-98a5-e781e5a0138b_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252Fdd9c567f7248403fa3994886528b2a27%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/dd9c567f7248403fa3994886528b2a27/images/large/4.jpg saved to cache
2026-03-26 22:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e83682af-c1d5-556f-98a5-e781e5a0138b
2026-03-26 22:48:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5ca1d50>
2026-03-26 22:48:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e83682af-c1d5-556f-98a5-e781e5a0138b/e83682af-c1d5-556f-98a5-e781e5a0138b_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252Fdd9c567f7248403fa3994886528b2a27%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/dd9c567f7248403fa3994886528b2a27/images/large/5.jpg saved to cache
2026-03-26 22:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e83682af-c1d5-556f-98a5-e781e5a0138b
2026-03-26 22:48:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd8e04d0>
2026-03-26 22:48:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e83682af-c1d5-556f-98a5-e781e5a0138b/e83682af-c1d5-556f-98a5-e781e5a0138b_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252Fdd9c567f7248403fa3994886528b2a27%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/dd9c567f7248403fa3994886528b2a27/images/large/6.jpg saved to cache
2026-03-26 22:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e83682af-c1d5-556f-98a5-e781e5a0138b
2026-03-26 22:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252Fd293fb6265c34a66b7d826ab796c8445%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/d293fb6265c34a66b7d826ab796c8445/images/large/4.jpg not downloaded yet
2026-03-26 22:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252Fd293fb6265c34a66b7d826ab796c8445%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/d293fb6265c34a66b7d826ab796c8445/images/large/5.jpg not downloaded yet
2026-03-26 22:48:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79cc090>
2026-03-26 22:48:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e83682af-c1d5-556f-98a5-e781e5a0138b/e83682af-c1d5-556f-98a5-e781e5a0138b_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252Fdd9c567f7248403fa3994886528b2a27%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/dd9c567f7248403fa3994886528b2a27/images/large/7.jpg saved to cache
2026-03-26 22:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e83682af-c1d5-556f-98a5-e781e5a0138b
2026-03-26 22:48:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7661850>
2026-03-26 22:48:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e83682af-c1d5-556f-98a5-e781e5a0138b/e83682af-c1d5-556f-98a5-e781e5a0138b_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252Fdd9c567f7248403fa3994886528b2a27%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/dd9c567f7248403fa3994886528b2a27/images/large/9.jpg saved to cache
2026-03-26 22:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e83682af-c1d5-556f-98a5-e781e5a0138b
2026-03-26 22:48:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7771d10>
2026-03-26 22:48:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e83682af-c1d5-556f-98a5-e781e5a0138b/e83682af-c1d5-556f-98a5-e781e5a0138b_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252Fdd9c567f7248403fa3994886528b2a27%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/dd9c567f7248403fa3994886528b2a27/images/large/8.jpg saved to cache
2026-03-26 22:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e83682af-c1d5-556f-98a5-e781e5a0138b
2026-03-26 22:48:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/4280ec5a05c54f64b2ef78b66b2eac0d/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252Fd293fb6265c34a66b7d826ab796c8445%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/d293fb6265c34a66b7d826ab796c8445/images/large/6.jpg not downloaded yet
2026-03-26 22:48:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/4280ec5a05c54f64b2ef78b66b2eac0d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bc/dd9c567f7248403fa3994886528b2a27/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252Fd293fb6265c34a66b7d826ab796c8445%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/d293fb6265c34a66b7d826ab796c8445/images/large/7.jpg not downloaded yet
2026-03-26 22:48:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/4280ec5a05c54f64b2ef78b66b2eac0d/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/4280ec5a05c54f64b2ef78b66b2eac0d/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/4280ec5a05c54f64b2ef78b66b2eac0d/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252Fd293fb6265c34a66b7d826ab796c8445%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/d293fb6265c34a66b7d826ab796c8445/images/large/8.jpg not downloaded yet
2026-03-26 22:48:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/4280ec5a05c54f64b2ef78b66b2eac0d/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252Fd293fb6265c34a66b7d826ab796c8445%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/d293fb6265c34a66b7d826ab796c8445/images/large/9.jpg not downloaded yet
2026-03-26 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252Fd293fb6265c34a66b7d826ab796c8445%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/d293fb6265c34a66b7d826ab796c8445/images/large/10.jpg not downloaded yet
2026-03-26 22:48:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/4280ec5a05c54f64b2ef78b66b2eac0d/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:05 [ayvens.be] INFO: Found listing with ID: 1986122
2026-03-26 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986122%27 HTTP/1.1" 200 None
2026-03-26 22:48:05 [ayvens.be] INFO: Scrape type for 1986122: 1
2026-03-26 22:48:05 [ayvens.be] INFO: Extracting data for car ID: 1986122
2026-03-26 22:48:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f23e36f3-99cf-5de1-97ea-022894fd7d70 with identifier: 1986122
2026-03-26 22:48:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f23e36f3-99cf-5de1-97ea-022894fd7d70 with scrape type 1
2026-03-26 22:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f23e36f3-99cf-5de1-97ea-022894fd7d70
2026-03-26 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F08078458ca6445c6ae8123e49d1713c5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/08078458ca6445c6ae8123e49d1713c5/images/large/1.jpg not downloaded yet
2026-03-26 22:48:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e2b210>
2026-03-26 22:48:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d305006-0852-5850-8020-cc419dbd9f86/2d305006-0852-5850-8020-cc419dbd9f86_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F4280ec5a05c54f64b2ef78b66b2eac0d%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/4280ec5a05c54f64b2ef78b66b2eac0d/images/large/2.jpg saved to cache
2026-03-26 22:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2d305006-0852-5850-8020-cc419dbd9f86
2026-03-26 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F08078458ca6445c6ae8123e49d1713c5%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/08078458ca6445c6ae8123e49d1713c5/images/large/2.jpg not downloaded yet
2026-03-26 22:48:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79a0690>
2026-03-26 22:48:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d305006-0852-5850-8020-cc419dbd9f86/2d305006-0852-5850-8020-cc419dbd9f86_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F4280ec5a05c54f64b2ef78b66b2eac0d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/4280ec5a05c54f64b2ef78b66b2eac0d/images/large/1.jpg saved to cache
2026-03-26 22:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2d305006-0852-5850-8020-cc419dbd9f86
2026-03-26 22:48:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cca510>
2026-03-26 22:48:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e83682af-c1d5-556f-98a5-e781e5a0138b/e83682af-c1d5-556f-98a5-e781e5a0138b_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252Fdd9c567f7248403fa3994886528b2a27%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/dd9c567f7248403fa3994886528b2a27/images/large/10.jpg saved to cache
2026-03-26 22:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e83682af-c1d5-556f-98a5-e781e5a0138b
2026-03-26 22:48:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e83682af-c1d5-556f-98a5-e781e5a0138b, skipping ID generation
2026-03-26 22:48:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e83682af-c1d5-556f-98a5-e781e5a0138b with scrape type 1
2026-03-26 22:48:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e83682af-c1d5-556f-98a5-e781e5a0138b sending to next pipeline
2026-03-26 22:48:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e83682af-c1d5-556f-98a5-e781e5a0138b, identifier: 1986119
2026-03-26 22:48:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c7c810>
2026-03-26 22:48:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d305006-0852-5850-8020-cc419dbd9f86/2d305006-0852-5850-8020-cc419dbd9f86_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F4280ec5a05c54f64b2ef78b66b2eac0d%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/4280ec5a05c54f64b2ef78b66b2eac0d/images/large/3.jpg saved to cache
2026-03-26 22:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2d305006-0852-5850-8020-cc419dbd9f86
2026-03-26 22:48:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7400ad0>
2026-03-26 22:48:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d305006-0852-5850-8020-cc419dbd9f86/2d305006-0852-5850-8020-cc419dbd9f86_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F4280ec5a05c54f64b2ef78b66b2eac0d%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/4280ec5a05c54f64b2ef78b66b2eac0d/images/large/5.jpg saved to cache
2026-03-26 22:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2d305006-0852-5850-8020-cc419dbd9f86
2026-03-26 22:48:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74fbf10>
2026-03-26 22:48:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d305006-0852-5850-8020-cc419dbd9f86/2d305006-0852-5850-8020-cc419dbd9f86_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F4280ec5a05c54f64b2ef78b66b2eac0d%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/4280ec5a05c54f64b2ef78b66b2eac0d/images/large/6.jpg saved to cache
2026-03-26 22:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2d305006-0852-5850-8020-cc419dbd9f86
2026-03-26 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F08078458ca6445c6ae8123e49d1713c5%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/08078458ca6445c6ae8123e49d1713c5/images/large/3.jpg not downloaded yet
2026-03-26 22:48:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e83682af-c1d5-556f-98a5-e781e5a0138b with identifier: 1986119
2026-03-26 22:48:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e83682af-c1d5-556f-98a5-e781e5a0138b with identifier: 1986119
2026-03-26 22:48:05 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e83682af-c1d5-556f-98a5-e781e5a0138b with identifier: 1986119 to the API
2026-03-26 22:48:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:48:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:48:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bc/dd9c567f7248403fa3994886528b2a27/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'e83682af-c1d5-556f-98a5-e781e5a0138b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '5008',
 'odometer': 153859,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e83682af-c1d5-556f-98a5-e781e5a0138b/e83682af-c1d5-556f-98a5-e781e5a0138b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 685108,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/dd9c567f7248403fa3994886528b2a27/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e83682af-c1d5-556f-98a5-e781e5a0138b/e83682af-c1d5-556f-98a5-e781e5a0138b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 623817,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/dd9c567f7248403fa3994886528b2a27/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e83682af-c1d5-556f-98a5-e781e5a0138b/e83682af-c1d5-556f-98a5-e781e5a0138b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 566215,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/dd9c567f7248403fa3994886528b2a27/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e83682af-c1d5-556f-98a5-e781e5a0138b/e83682af-c1d5-556f-98a5-e781e5a0138b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 639536,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/dd9c567f7248403fa3994886528b2a27/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e83682af-c1d5-556f-98a5-e781e5a0138b/e83682af-c1d5-556f-98a5-e781e5a0138b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 550445,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/dd9c567f7248403fa3994886528b2a27/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e83682af-c1d5-556f-98a5-e781e5a0138b/e83682af-c1d5-556f-98a5-e781e5a0138b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 641014,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/dd9c567f7248403fa3994886528b2a27/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e83682af-c1d5-556f-98a5-e781e5a0138b/e83682af-c1d5-556f-98a5-e781e5a0138b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 639573,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/dd9c567f7248403fa3994886528b2a27/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e83682af-c1d5-556f-98a5-e781e5a0138b/e83682af-c1d5-556f-98a5-e781e5a0138b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 734914,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/dd9c567f7248403fa3994886528b2a27/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e83682af-c1d5-556f-98a5-e781e5a0138b/e83682af-c1d5-556f-98a5-e781e5a0138b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 562069,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/dd9c567f7248403fa3994886528b2a27/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e83682af-c1d5-556f-98a5-e781e5a0138b/e83682af-c1d5-556f-98a5-e781e5a0138b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 610535,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/dd9c567f7248403fa3994886528b2a27/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-05',
 'seats_number': 7,
 'seller_name': None,
 'title': 'PEUGEOT 5008 1.5 BLUEHDI 130 AUTO GT PACK',
 'transmission': 'automatic',
 'trim': '1.5 BLUEHDI 130 AUTO GT PACK',
 'vin': None,
 'year': 2021}
2026-03-26 22:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986119%27 HTTP/1.1" 200 None
2026-03-26 22:48:06 [ayvens.be] INFO: Saving data for 1986119: {'created_time': 1774565286.139477, 'last_price_update_time': 1774565286.139489, 'auction_closing_time': 1775028600.0}
2026-03-26 22:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986119') HTTP/1.1" 204 0
2026-03-26 22:48:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/4280ec5a05c54f64b2ef78b66b2eac0d/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F08078458ca6445c6ae8123e49d1713c5%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/08078458ca6445c6ae8123e49d1713c5/images/large/4.jpg not downloaded yet
2026-03-26 22:48:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b768ae10>
2026-03-26 22:48:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d305006-0852-5850-8020-cc419dbd9f86/2d305006-0852-5850-8020-cc419dbd9f86_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F4280ec5a05c54f64b2ef78b66b2eac0d%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/4280ec5a05c54f64b2ef78b66b2eac0d/images/large/4.jpg saved to cache
2026-03-26 22:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2d305006-0852-5850-8020-cc419dbd9f86
2026-03-26 22:48:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76eed10>
2026-03-26 22:48:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d305006-0852-5850-8020-cc419dbd9f86/2d305006-0852-5850-8020-cc419dbd9f86_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F4280ec5a05c54f64b2ef78b66b2eac0d%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/4280ec5a05c54f64b2ef78b66b2eac0d/images/large/7.jpg saved to cache
2026-03-26 22:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2d305006-0852-5850-8020-cc419dbd9f86
2026-03-26 22:48:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/4280ec5a05c54f64b2ef78b66b2eac0d/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F08078458ca6445c6ae8123e49d1713c5%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/08078458ca6445c6ae8123e49d1713c5/images/large/5.jpg not downloaded yet
2026-03-26 22:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F08078458ca6445c6ae8123e49d1713c5%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/08078458ca6445c6ae8123e49d1713c5/images/large/6.jpg not downloaded yet
2026-03-26 22:48:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/4280ec5a05c54f64b2ef78b66b2eac0d/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/d293fb6265c34a66b7d826ab796c8445/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/d293fb6265c34a66b7d826ab796c8445/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/d293fb6265c34a66b7d826ab796c8445/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74be690>
2026-03-26 22:48:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d305006-0852-5850-8020-cc419dbd9f86/2d305006-0852-5850-8020-cc419dbd9f86_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F4280ec5a05c54f64b2ef78b66b2eac0d%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/4280ec5a05c54f64b2ef78b66b2eac0d/images/large/9.jpg saved to cache
2026-03-26 22:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2d305006-0852-5850-8020-cc419dbd9f86
2026-03-26 22:48:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/d293fb6265c34a66b7d826ab796c8445/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F08078458ca6445c6ae8123e49d1713c5%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/08078458ca6445c6ae8123e49d1713c5/images/large/7.jpg not downloaded yet
2026-03-26 22:48:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/d293fb6265c34a66b7d826ab796c8445/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F08078458ca6445c6ae8123e49d1713c5%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/08078458ca6445c6ae8123e49d1713c5/images/large/8.jpg not downloaded yet
2026-03-26 22:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F08078458ca6445c6ae8123e49d1713c5%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/08078458ca6445c6ae8123e49d1713c5/images/large/9.jpg not downloaded yet
2026-03-26 22:48:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74be210>
2026-03-26 22:48:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d305006-0852-5850-8020-cc419dbd9f86/2d305006-0852-5850-8020-cc419dbd9f86_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F4280ec5a05c54f64b2ef78b66b2eac0d%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/4280ec5a05c54f64b2ef78b66b2eac0d/images/large/10.jpg saved to cache
2026-03-26 22:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2d305006-0852-5850-8020-cc419dbd9f86
2026-03-26 22:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F08078458ca6445c6ae8123e49d1713c5%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/08078458ca6445c6ae8123e49d1713c5/images/large/10.jpg not downloaded yet
2026-03-26 22:48:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7926790>
2026-03-26 22:48:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d305006-0852-5850-8020-cc419dbd9f86/2d305006-0852-5850-8020-cc419dbd9f86_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F4280ec5a05c54f64b2ef78b66b2eac0d%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/4280ec5a05c54f64b2ef78b66b2eac0d/images/large/8.jpg saved to cache
2026-03-26 22:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2d305006-0852-5850-8020-cc419dbd9f86
2026-03-26 22:48:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2d305006-0852-5850-8020-cc419dbd9f86, skipping ID generation
2026-03-26 22:48:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d305006-0852-5850-8020-cc419dbd9f86 with scrape type 1
2026-03-26 22:48:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2d305006-0852-5850-8020-cc419dbd9f86 sending to next pipeline
2026-03-26 22:48:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 2d305006-0852-5850-8020-cc419dbd9f86, identifier: 1986120
2026-03-26 22:48:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76ee7d0>
2026-03-26 22:48:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c962d856-a1e1-5c8f-bee9-de129749fcf4/c962d856-a1e1-5c8f-bee9-de129749fcf4_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252Fd293fb6265c34a66b7d826ab796c8445%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/d293fb6265c34a66b7d826ab796c8445/images/large/3.jpg saved to cache
2026-03-26 22:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c962d856-a1e1-5c8f-bee9-de129749fcf4
2026-03-26 22:48:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7724710>
2026-03-26 22:48:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c962d856-a1e1-5c8f-bee9-de129749fcf4/c962d856-a1e1-5c8f-bee9-de129749fcf4_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252Fd293fb6265c34a66b7d826ab796c8445%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/d293fb6265c34a66b7d826ab796c8445/images/large/2.jpg saved to cache
2026-03-26 22:48:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c962d856-a1e1-5c8f-bee9-de129749fcf4
2026-03-26 22:48:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79f3790>
2026-03-26 22:48:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c962d856-a1e1-5c8f-bee9-de129749fcf4/c962d856-a1e1-5c8f-bee9-de129749fcf4_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252Fd293fb6265c34a66b7d826ab796c8445%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/d293fb6265c34a66b7d826ab796c8445/images/large/4.jpg saved to cache
2026-03-26 22:48:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c962d856-a1e1-5c8f-bee9-de129749fcf4
2026-03-26 22:48:07 [scrapy.extensions.logstats] INFO: Crawled 5 pages (at -1 pages/min), scraped 91 items (at 35 items/min)
2026-03-26 22:48:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 181MiB
2026-03-26 22:48:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 2d305006-0852-5850-8020-cc419dbd9f86 with identifier: 1986120
2026-03-26 22:48:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 2d305006-0852-5850-8020-cc419dbd9f86 with identifier: 1986120
2026-03-26 22:48:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 2d305006-0852-5850-8020-cc419dbd9f86 with identifier: 1986120 to the API
2026-03-26 22:48:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:48:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:48:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bg/4280ec5a05c54f64b2ef78b66b2eac0d/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '2d305006-0852-5850-8020-cc419dbd9f86',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A6 AVANT',
 'odometer': 89229,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d305006-0852-5850-8020-cc419dbd9f86/2d305006-0852-5850-8020-cc419dbd9f86_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 684897,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/4280ec5a05c54f64b2ef78b66b2eac0d/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d305006-0852-5850-8020-cc419dbd9f86/2d305006-0852-5850-8020-cc419dbd9f86_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 647992,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/4280ec5a05c54f64b2ef78b66b2eac0d/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d305006-0852-5850-8020-cc419dbd9f86/2d305006-0852-5850-8020-cc419dbd9f86_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 594099,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/4280ec5a05c54f64b2ef78b66b2eac0d/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d305006-0852-5850-8020-cc419dbd9f86/2d305006-0852-5850-8020-cc419dbd9f86_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 723674,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/4280ec5a05c54f64b2ef78b66b2eac0d/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d305006-0852-5850-8020-cc419dbd9f86/2d305006-0852-5850-8020-cc419dbd9f86_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 573277,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/4280ec5a05c54f64b2ef78b66b2eac0d/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d305006-0852-5850-8020-cc419dbd9f86/2d305006-0852-5850-8020-cc419dbd9f86_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 560548,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/4280ec5a05c54f64b2ef78b66b2eac0d/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d305006-0852-5850-8020-cc419dbd9f86/2d305006-0852-5850-8020-cc419dbd9f86_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 614602,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/4280ec5a05c54f64b2ef78b66b2eac0d/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d305006-0852-5850-8020-cc419dbd9f86/2d305006-0852-5850-8020-cc419dbd9f86_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 675750,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/4280ec5a05c54f64b2ef78b66b2eac0d/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d305006-0852-5850-8020-cc419dbd9f86/2d305006-0852-5850-8020-cc419dbd9f86_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 514151,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/4280ec5a05c54f64b2ef78b66b2eac0d/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d305006-0852-5850-8020-cc419dbd9f86/2d305006-0852-5850-8020-cc419dbd9f86_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 481166,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/4280ec5a05c54f64b2ef78b66b2eac0d/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A6 AVANT 2.0 TDI 35 S TRONIC BUSINESS ED ATTR',
 'transmission': 'automatic',
 'trim': '2.0 TDI 35 S TRONIC BUSINESS ED ATTR',
 'vin': None,
 'year': 2021}
2026-03-26 22:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986120%27 HTTP/1.1" 200 None
2026-03-26 22:48:07 [ayvens.be] INFO: Saving data for 1986120: {'created_time': 1774565287.523679, 'last_price_update_time': 1774565287.523688, 'auction_closing_time': 1775028600.0}
2026-03-26 22:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986120') HTTP/1.1" 204 0
2026-03-26 22:48:07 [ayvens.be] INFO: Found listing with ID: 1986123
2026-03-26 22:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986123%27 HTTP/1.1" 200 None
2026-03-26 22:48:07 [ayvens.be] INFO: Scrape type for 1986123: 1
2026-03-26 22:48:07 [ayvens.be] INFO: Extracting data for car ID: 1986123
2026-03-26 22:48:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5aced6b-d46f-5dc2-a6cd-9bb903a1397d with identifier: 1986123
2026-03-26 22:48:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5aced6b-d46f-5dc2-a6cd-9bb903a1397d with scrape type 1
2026-03-26 22:48:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c5aced6b-d46f-5dc2-a6cd-9bb903a1397d
2026-03-26 22:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F0380973a4a8c4fac9683d9829c7a5040%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/0380973a4a8c4fac9683d9829c7a5040/images/large/1.jpg not downloaded yet
2026-03-26 22:48:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77ad1d0>
2026-03-26 22:48:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c962d856-a1e1-5c8f-bee9-de129749fcf4/c962d856-a1e1-5c8f-bee9-de129749fcf4_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252Fd293fb6265c34a66b7d826ab796c8445%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/d293fb6265c34a66b7d826ab796c8445/images/large/1.jpg saved to cache
2026-03-26 22:48:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c962d856-a1e1-5c8f-bee9-de129749fcf4
2026-03-26 22:48:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd4c86d0>
2026-03-26 22:48:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c962d856-a1e1-5c8f-bee9-de129749fcf4/c962d856-a1e1-5c8f-bee9-de129749fcf4_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252Fd293fb6265c34a66b7d826ab796c8445%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/d293fb6265c34a66b7d826ab796c8445/images/large/5.jpg saved to cache
2026-03-26 22:48:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c962d856-a1e1-5c8f-bee9-de129749fcf4
2026-03-26 22:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F0380973a4a8c4fac9683d9829c7a5040%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/0380973a4a8c4fac9683d9829c7a5040/images/large/2.jpg not downloaded yet
2026-03-26 22:48:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/d293fb6265c34a66b7d826ab796c8445/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/d293fb6265c34a66b7d826ab796c8445/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F0380973a4a8c4fac9683d9829c7a5040%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/0380973a4a8c4fac9683d9829c7a5040/images/large/3.jpg not downloaded yet
2026-03-26 22:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F0380973a4a8c4fac9683d9829c7a5040%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/0380973a4a8c4fac9683d9829c7a5040/images/large/4.jpg not downloaded yet
2026-03-26 22:48:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/08078458ca6445c6ae8123e49d1713c5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/d293fb6265c34a66b7d826ab796c8445/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F0380973a4a8c4fac9683d9829c7a5040%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/0380973a4a8c4fac9683d9829c7a5040/images/large/5.jpg not downloaded yet
2026-03-26 22:48:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/08078458ca6445c6ae8123e49d1713c5/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/08078458ca6445c6ae8123e49d1713c5/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/d293fb6265c34a66b7d826ab796c8445/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/d293fb6265c34a66b7d826ab796c8445/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F0380973a4a8c4fac9683d9829c7a5040%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/0380973a4a8c4fac9683d9829c7a5040/images/large/6.jpg not downloaded yet
2026-03-26 22:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F0380973a4a8c4fac9683d9829c7a5040%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/0380973a4a8c4fac9683d9829c7a5040/images/large/7.jpg not downloaded yet
2026-03-26 22:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F0380973a4a8c4fac9683d9829c7a5040%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/0380973a4a8c4fac9683d9829c7a5040/images/large/8.jpg not downloaded yet
2026-03-26 22:48:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74587d0>
2026-03-26 22:48:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c962d856-a1e1-5c8f-bee9-de129749fcf4/c962d856-a1e1-5c8f-bee9-de129749fcf4_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252Fd293fb6265c34a66b7d826ab796c8445%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/d293fb6265c34a66b7d826ab796c8445/images/large/7.jpg saved to cache
2026-03-26 22:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c962d856-a1e1-5c8f-bee9-de129749fcf4
2026-03-26 22:48:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6da50d0>
2026-03-26 22:48:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c962d856-a1e1-5c8f-bee9-de129749fcf4/c962d856-a1e1-5c8f-bee9-de129749fcf4_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252Fd293fb6265c34a66b7d826ab796c8445%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/d293fb6265c34a66b7d826ab796c8445/images/large/6.jpg saved to cache
2026-03-26 22:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c962d856-a1e1-5c8f-bee9-de129749fcf4
2026-03-26 22:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F0380973a4a8c4fac9683d9829c7a5040%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/0380973a4a8c4fac9683d9829c7a5040/images/large/9.jpg not downloaded yet
2026-03-26 22:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F0380973a4a8c4fac9683d9829c7a5040%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/0380973a4a8c4fac9683d9829c7a5040/images/large/10.jpg not downloaded yet
2026-03-26 22:48:08 [ayvens.be] INFO: Found listing with ID: 1986124
2026-03-26 22:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986124%27 HTTP/1.1" 200 None
2026-03-26 22:48:08 [ayvens.be] INFO: Scrape type for 1986124: 1
2026-03-26 22:48:08 [ayvens.be] INFO: Extracting data for car ID: 1986124
2026-03-26 22:48:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8a013bd-22c1-5c6d-bce6-42fd909ba0f5 with identifier: 1986124
2026-03-26 22:48:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8a013bd-22c1-5c6d-bce6-42fd909ba0f5 with scrape type 1
2026-03-26 22:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e8a013bd-22c1-5c6d-bce6-42fd909ba0f5
2026-03-26 22:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2et%252F54741e6bcaf44d638e0230c31d4fba99%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2et/54741e6bcaf44d638e0230c31d4fba99/images/large/1.jpg not downloaded yet
2026-03-26 22:48:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b727a850>
2026-03-26 22:48:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f23e36f3-99cf-5de1-97ea-022894fd7d70/f23e36f3-99cf-5de1-97ea-022894fd7d70_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F08078458ca6445c6ae8123e49d1713c5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/08078458ca6445c6ae8123e49d1713c5/images/large/1.jpg saved to cache
2026-03-26 22:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f23e36f3-99cf-5de1-97ea-022894fd7d70
2026-03-26 22:48:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6d73850>
2026-03-26 22:48:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c962d856-a1e1-5c8f-bee9-de129749fcf4/c962d856-a1e1-5c8f-bee9-de129749fcf4_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252Fd293fb6265c34a66b7d826ab796c8445%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/d293fb6265c34a66b7d826ab796c8445/images/large/10.jpg saved to cache
2026-03-26 22:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c962d856-a1e1-5c8f-bee9-de129749fcf4
2026-03-26 22:48:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b744a850>
2026-03-26 22:48:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f23e36f3-99cf-5de1-97ea-022894fd7d70/f23e36f3-99cf-5de1-97ea-022894fd7d70_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F08078458ca6445c6ae8123e49d1713c5%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/08078458ca6445c6ae8123e49d1713c5/images/large/2.jpg saved to cache
2026-03-26 22:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f23e36f3-99cf-5de1-97ea-022894fd7d70
2026-03-26 22:48:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b764bad0>
2026-03-26 22:48:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f23e36f3-99cf-5de1-97ea-022894fd7d70/f23e36f3-99cf-5de1-97ea-022894fd7d70_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F08078458ca6445c6ae8123e49d1713c5%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/08078458ca6445c6ae8123e49d1713c5/images/large/3.jpg saved to cache
2026-03-26 22:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f23e36f3-99cf-5de1-97ea-022894fd7d70
2026-03-26 22:48:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5ccb110>
2026-03-26 22:48:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c962d856-a1e1-5c8f-bee9-de129749fcf4/c962d856-a1e1-5c8f-bee9-de129749fcf4_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252Fd293fb6265c34a66b7d826ab796c8445%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/d293fb6265c34a66b7d826ab796c8445/images/large/8.jpg saved to cache
2026-03-26 22:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c962d856-a1e1-5c8f-bee9-de129749fcf4
2026-03-26 22:48:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5ccbbd0>
2026-03-26 22:48:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c962d856-a1e1-5c8f-bee9-de129749fcf4/c962d856-a1e1-5c8f-bee9-de129749fcf4_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252Fd293fb6265c34a66b7d826ab796c8445%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/d293fb6265c34a66b7d826ab796c8445/images/large/9.jpg saved to cache
2026-03-26 22:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c962d856-a1e1-5c8f-bee9-de129749fcf4
2026-03-26 22:48:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c962d856-a1e1-5c8f-bee9-de129749fcf4, skipping ID generation
2026-03-26 22:48:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c962d856-a1e1-5c8f-bee9-de129749fcf4 with scrape type 1
2026-03-26 22:48:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c962d856-a1e1-5c8f-bee9-de129749fcf4 sending to next pipeline
2026-03-26 22:48:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c962d856-a1e1-5c8f-bee9-de129749fcf4, identifier: 1986121
2026-03-26 22:48:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c962d856-a1e1-5c8f-bee9-de129749fcf4 with identifier: 1986121
2026-03-26 22:48:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c962d856-a1e1-5c8f-bee9-de129749fcf4 with identifier: 1986121
2026-03-26 22:48:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c962d856-a1e1-5c8f-bee9-de129749fcf4 with identifier: 1986121 to the API
2026-03-26 22:48:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:48:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:48:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cq/d293fb6265c34a66b7d826ab796c8445/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'electric',
 'id': 'c962d856-a1e1-5c8f-bee9-de129749fcf4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'C40',
 'odometer': 127822,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 18,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c962d856-a1e1-5c8f-bee9-de129749fcf4/c962d856-a1e1-5c8f-bee9-de129749fcf4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 615952,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/d293fb6265c34a66b7d826ab796c8445/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c962d856-a1e1-5c8f-bee9-de129749fcf4/c962d856-a1e1-5c8f-bee9-de129749fcf4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 625990,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/d293fb6265c34a66b7d826ab796c8445/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c962d856-a1e1-5c8f-bee9-de129749fcf4/c962d856-a1e1-5c8f-bee9-de129749fcf4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 648253,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/d293fb6265c34a66b7d826ab796c8445/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c962d856-a1e1-5c8f-bee9-de129749fcf4/c962d856-a1e1-5c8f-bee9-de129749fcf4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 651526,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/d293fb6265c34a66b7d826ab796c8445/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c962d856-a1e1-5c8f-bee9-de129749fcf4/c962d856-a1e1-5c8f-bee9-de129749fcf4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 612139,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/d293fb6265c34a66b7d826ab796c8445/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c962d856-a1e1-5c8f-bee9-de129749fcf4/c962d856-a1e1-5c8f-bee9-de129749fcf4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 669708,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/d293fb6265c34a66b7d826ab796c8445/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c962d856-a1e1-5c8f-bee9-de129749fcf4/c962d856-a1e1-5c8f-bee9-de129749fcf4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 576738,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/d293fb6265c34a66b7d826ab796c8445/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c962d856-a1e1-5c8f-bee9-de129749fcf4/c962d856-a1e1-5c8f-bee9-de129749fcf4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 789758,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/d293fb6265c34a66b7d826ab796c8445/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c962d856-a1e1-5c8f-bee9-de129749fcf4/c962d856-a1e1-5c8f-bee9-de129749fcf4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 824036,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/d293fb6265c34a66b7d826ab796c8445/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c962d856-a1e1-5c8f-bee9-de129749fcf4/c962d856-a1e1-5c8f-bee9-de129749fcf4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 715201,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/d293fb6265c34a66b7d826ab796c8445/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO C40 BEV 69KWH RECHARGE ULTIMATE',
 'transmission': 'automatic',
 'trim': 'BEV 69KWH RECHARGE ULTIMATE',
 'vin': None,
 'year': 2022}
2026-03-26 22:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986121%27 HTTP/1.1" 200 None
2026-03-26 22:48:09 [ayvens.be] INFO: Saving data for 1986121: {'created_time': 1774565289.581252, 'last_price_update_time': 1774565289.581262, 'auction_closing_time': 1775028600.0}
2026-03-26 22:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986121') HTTP/1.1" 204 0
2026-03-26 22:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2et%252F54741e6bcaf44d638e0230c31d4fba99%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2et/54741e6bcaf44d638e0230c31d4fba99/images/large/2.jpg not downloaded yet
2026-03-26 22:48:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/08078458ca6445c6ae8123e49d1713c5/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2et%252F54741e6bcaf44d638e0230c31d4fba99%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2et/54741e6bcaf44d638e0230c31d4fba99/images/large/3.jpg not downloaded yet
2026-03-26 22:48:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/08078458ca6445c6ae8123e49d1713c5/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/08078458ca6445c6ae8123e49d1713c5/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/08078458ca6445c6ae8123e49d1713c5/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/08078458ca6445c6ae8123e49d1713c5/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/08078458ca6445c6ae8123e49d1713c5/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2et%252F54741e6bcaf44d638e0230c31d4fba99%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2et/54741e6bcaf44d638e0230c31d4fba99/images/large/4.jpg not downloaded yet
2026-03-26 22:48:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/0380973a4a8c4fac9683d9829c7a5040/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/08078458ca6445c6ae8123e49d1713c5/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2et%252F54741e6bcaf44d638e0230c31d4fba99%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2et/54741e6bcaf44d638e0230c31d4fba99/images/large/5.jpg not downloaded yet
2026-03-26 22:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2et%252F54741e6bcaf44d638e0230c31d4fba99%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2et/54741e6bcaf44d638e0230c31d4fba99/images/large/6.jpg not downloaded yet
2026-03-26 22:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2et%252F54741e6bcaf44d638e0230c31d4fba99%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2et/54741e6bcaf44d638e0230c31d4fba99/images/large/7.jpg not downloaded yet
2026-03-26 22:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2et%252F54741e6bcaf44d638e0230c31d4fba99%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2et/54741e6bcaf44d638e0230c31d4fba99/images/large/8.jpg not downloaded yet
2026-03-26 22:48:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7648050>
2026-03-26 22:48:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f23e36f3-99cf-5de1-97ea-022894fd7d70/f23e36f3-99cf-5de1-97ea-022894fd7d70_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F08078458ca6445c6ae8123e49d1713c5%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/08078458ca6445c6ae8123e49d1713c5/images/large/6.jpg saved to cache
2026-03-26 22:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f23e36f3-99cf-5de1-97ea-022894fd7d70
2026-03-26 22:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2et%252F54741e6bcaf44d638e0230c31d4fba99%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2et/54741e6bcaf44d638e0230c31d4fba99/images/large/9.jpg not downloaded yet
2026-03-26 22:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2et%252F54741e6bcaf44d638e0230c31d4fba99%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2et/54741e6bcaf44d638e0230c31d4fba99/images/large/10.jpg not downloaded yet
2026-03-26 22:48:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7573390>
2026-03-26 22:48:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f23e36f3-99cf-5de1-97ea-022894fd7d70/f23e36f3-99cf-5de1-97ea-022894fd7d70_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F08078458ca6445c6ae8123e49d1713c5%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/08078458ca6445c6ae8123e49d1713c5/images/large/7.jpg saved to cache
2026-03-26 22:48:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f23e36f3-99cf-5de1-97ea-022894fd7d70
2026-03-26 22:48:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74a7fd0>
2026-03-26 22:48:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f23e36f3-99cf-5de1-97ea-022894fd7d70/f23e36f3-99cf-5de1-97ea-022894fd7d70_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F08078458ca6445c6ae8123e49d1713c5%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/08078458ca6445c6ae8123e49d1713c5/images/large/9.jpg saved to cache
2026-03-26 22:48:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f23e36f3-99cf-5de1-97ea-022894fd7d70
2026-03-26 22:48:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74a4050>
2026-03-26 22:48:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f23e36f3-99cf-5de1-97ea-022894fd7d70/f23e36f3-99cf-5de1-97ea-022894fd7d70_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F08078458ca6445c6ae8123e49d1713c5%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/08078458ca6445c6ae8123e49d1713c5/images/large/5.jpg saved to cache
2026-03-26 22:48:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f23e36f3-99cf-5de1-97ea-022894fd7d70
2026-03-26 22:48:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7475710>
2026-03-26 22:48:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f23e36f3-99cf-5de1-97ea-022894fd7d70/f23e36f3-99cf-5de1-97ea-022894fd7d70_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F08078458ca6445c6ae8123e49d1713c5%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/08078458ca6445c6ae8123e49d1713c5/images/large/10.jpg saved to cache
2026-03-26 22:48:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f23e36f3-99cf-5de1-97ea-022894fd7d70
2026-03-26 22:48:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cbde50>
2026-03-26 22:48:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f23e36f3-99cf-5de1-97ea-022894fd7d70/f23e36f3-99cf-5de1-97ea-022894fd7d70_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F08078458ca6445c6ae8123e49d1713c5%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/08078458ca6445c6ae8123e49d1713c5/images/large/8.jpg saved to cache
2026-03-26 22:48:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f23e36f3-99cf-5de1-97ea-022894fd7d70
2026-03-26 22:48:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c5f950>
2026-03-26 22:48:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5aced6b-d46f-5dc2-a6cd-9bb903a1397d/c5aced6b-d46f-5dc2-a6cd-9bb903a1397d_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F0380973a4a8c4fac9683d9829c7a5040%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/0380973a4a8c4fac9683d9829c7a5040/images/large/1.jpg saved to cache
2026-03-26 22:48:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c5aced6b-d46f-5dc2-a6cd-9bb903a1397d
2026-03-26 22:48:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7474f10>
2026-03-26 22:48:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f23e36f3-99cf-5de1-97ea-022894fd7d70/f23e36f3-99cf-5de1-97ea-022894fd7d70_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F08078458ca6445c6ae8123e49d1713c5%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/08078458ca6445c6ae8123e49d1713c5/images/large/4.jpg saved to cache
2026-03-26 22:48:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f23e36f3-99cf-5de1-97ea-022894fd7d70
2026-03-26 22:48:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f23e36f3-99cf-5de1-97ea-022894fd7d70, skipping ID generation
2026-03-26 22:48:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f23e36f3-99cf-5de1-97ea-022894fd7d70 with scrape type 1
2026-03-26 22:48:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f23e36f3-99cf-5de1-97ea-022894fd7d70 sending to next pipeline
2026-03-26 22:48:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f23e36f3-99cf-5de1-97ea-022894fd7d70, identifier: 1986122
2026-03-26 22:48:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f23e36f3-99cf-5de1-97ea-022894fd7d70 with identifier: 1986122
2026-03-26 22:48:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f23e36f3-99cf-5de1-97ea-022894fd7d70 with identifier: 1986122
2026-03-26 22:48:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f23e36f3-99cf-5de1-97ea-022894fd7d70 with identifier: 1986122 to the API
2026-03-26 22:48:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:48:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:48:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ab/08078458ca6445c6ae8123e49d1713c5/images/large/4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'f23e36f3-99cf-5de1-97ea-022894fd7d70',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '5 SERIES BERLINE',
 'odometer': 144677,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f23e36f3-99cf-5de1-97ea-022894fd7d70/f23e36f3-99cf-5de1-97ea-022894fd7d70_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 608079,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/08078458ca6445c6ae8123e49d1713c5/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f23e36f3-99cf-5de1-97ea-022894fd7d70/f23e36f3-99cf-5de1-97ea-022894fd7d70_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 632418,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/08078458ca6445c6ae8123e49d1713c5/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f23e36f3-99cf-5de1-97ea-022894fd7d70/f23e36f3-99cf-5de1-97ea-022894fd7d70_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 613201,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/08078458ca6445c6ae8123e49d1713c5/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f23e36f3-99cf-5de1-97ea-022894fd7d70/f23e36f3-99cf-5de1-97ea-022894fd7d70_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 655540,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/08078458ca6445c6ae8123e49d1713c5/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f23e36f3-99cf-5de1-97ea-022894fd7d70/f23e36f3-99cf-5de1-97ea-022894fd7d70_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 553372,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/08078458ca6445c6ae8123e49d1713c5/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f23e36f3-99cf-5de1-97ea-022894fd7d70/f23e36f3-99cf-5de1-97ea-022894fd7d70_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 585672,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/08078458ca6445c6ae8123e49d1713c5/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f23e36f3-99cf-5de1-97ea-022894fd7d70/f23e36f3-99cf-5de1-97ea-022894fd7d70_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 623760,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/08078458ca6445c6ae8123e49d1713c5/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f23e36f3-99cf-5de1-97ea-022894fd7d70/f23e36f3-99cf-5de1-97ea-022894fd7d70_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 645738,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/08078458ca6445c6ae8123e49d1713c5/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f23e36f3-99cf-5de1-97ea-022894fd7d70/f23e36f3-99cf-5de1-97ea-022894fd7d70_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 569885,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/08078458ca6445c6ae8123e49d1713c5/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f23e36f3-99cf-5de1-97ea-022894fd7d70/f23e36f3-99cf-5de1-97ea-022894fd7d70_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 534078,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/08078458ca6445c6ae8123e49d1713c5/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 5 SERIES BERLINE 2.0 530E 170KW AUTO',
 'transmission': 'automatic',
 'trim': '2.0 530E 170KW AUTO',
 'vin': None,
 'year': 2021}
2026-03-26 22:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986122%27 HTTP/1.1" 200 None
2026-03-26 22:48:10 [ayvens.be] INFO: Saving data for 1986122: {'created_time': 1774565290.957745, 'last_price_update_time': 1774565290.957755, 'auction_closing_time': 1775028600.0}
2026-03-26 22:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986122') HTTP/1.1" 204 0
2026-03-26 22:48:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/0380973a4a8c4fac9683d9829c7a5040/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:10 [ayvens.be] INFO: Found listing with ID: 1986125
2026-03-26 22:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986125%27 HTTP/1.1" 200 None
2026-03-26 22:48:10 [ayvens.be] INFO: Scrape type for 1986125: 1
2026-03-26 22:48:10 [ayvens.be] INFO: Extracting data for car ID: 1986125
2026-03-26 22:48:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 627821ca-29b1-5fd9-bb5c-154f2a67d644 with identifier: 1986125
2026-03-26 22:48:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 627821ca-29b1-5fd9-bb5c-154f2a67d644 with scrape type 1
2026-03-26 22:48:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 627821ca-29b1-5fd9-bb5c-154f2a67d644
2026-03-26 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F1cc5f6dea6384b9a96afbbf4da863a38%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/1cc5f6dea6384b9a96afbbf4da863a38/images/large/1.jpg not downloaded yet
2026-03-26 22:48:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/0380973a4a8c4fac9683d9829c7a5040/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/0380973a4a8c4fac9683d9829c7a5040/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F1cc5f6dea6384b9a96afbbf4da863a38%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/1cc5f6dea6384b9a96afbbf4da863a38/images/large/2.jpg not downloaded yet
2026-03-26 22:48:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/0380973a4a8c4fac9683d9829c7a5040/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/0380973a4a8c4fac9683d9829c7a5040/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/0380973a4a8c4fac9683d9829c7a5040/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/0380973a4a8c4fac9683d9829c7a5040/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F1cc5f6dea6384b9a96afbbf4da863a38%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/1cc5f6dea6384b9a96afbbf4da863a38/images/large/3.jpg not downloaded yet
2026-03-26 22:48:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/0380973a4a8c4fac9683d9829c7a5040/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F1cc5f6dea6384b9a96afbbf4da863a38%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/1cc5f6dea6384b9a96afbbf4da863a38/images/large/4.jpg not downloaded yet
2026-03-26 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F1cc5f6dea6384b9a96afbbf4da863a38%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/1cc5f6dea6384b9a96afbbf4da863a38/images/large/5.jpg not downloaded yet
2026-03-26 22:48:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76ed110>
2026-03-26 22:48:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5aced6b-d46f-5dc2-a6cd-9bb903a1397d/c5aced6b-d46f-5dc2-a6cd-9bb903a1397d_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F0380973a4a8c4fac9683d9829c7a5040%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/0380973a4a8c4fac9683d9829c7a5040/images/large/9.jpg saved to cache
2026-03-26 22:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c5aced6b-d46f-5dc2-a6cd-9bb903a1397d
2026-03-26 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F1cc5f6dea6384b9a96afbbf4da863a38%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/1cc5f6dea6384b9a96afbbf4da863a38/images/large/6.jpg not downloaded yet
2026-03-26 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F1cc5f6dea6384b9a96afbbf4da863a38%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/1cc5f6dea6384b9a96afbbf4da863a38/images/large/7.jpg not downloaded yet
2026-03-26 22:48:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2et/54741e6bcaf44d638e0230c31d4fba99/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2et/54741e6bcaf44d638e0230c31d4fba99/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F1cc5f6dea6384b9a96afbbf4da863a38%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/1cc5f6dea6384b9a96afbbf4da863a38/images/large/8.jpg not downloaded yet
2026-03-26 22:48:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74a5bd0>
2026-03-26 22:48:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5aced6b-d46f-5dc2-a6cd-9bb903a1397d/c5aced6b-d46f-5dc2-a6cd-9bb903a1397d_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F0380973a4a8c4fac9683d9829c7a5040%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/0380973a4a8c4fac9683d9829c7a5040/images/large/6.jpg saved to cache
2026-03-26 22:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c5aced6b-d46f-5dc2-a6cd-9bb903a1397d
2026-03-26 22:48:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7438410>
2026-03-26 22:48:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5aced6b-d46f-5dc2-a6cd-9bb903a1397d/c5aced6b-d46f-5dc2-a6cd-9bb903a1397d_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F0380973a4a8c4fac9683d9829c7a5040%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/0380973a4a8c4fac9683d9829c7a5040/images/large/2.jpg saved to cache
2026-03-26 22:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c5aced6b-d46f-5dc2-a6cd-9bb903a1397d
2026-03-26 22:48:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7aa1b90>
2026-03-26 22:48:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5aced6b-d46f-5dc2-a6cd-9bb903a1397d/c5aced6b-d46f-5dc2-a6cd-9bb903a1397d_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F0380973a4a8c4fac9683d9829c7a5040%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/0380973a4a8c4fac9683d9829c7a5040/images/large/3.jpg saved to cache
2026-03-26 22:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c5aced6b-d46f-5dc2-a6cd-9bb903a1397d
2026-03-26 22:48:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cbcc10>
2026-03-26 22:48:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5aced6b-d46f-5dc2-a6cd-9bb903a1397d/c5aced6b-d46f-5dc2-a6cd-9bb903a1397d_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F0380973a4a8c4fac9683d9829c7a5040%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/0380973a4a8c4fac9683d9829c7a5040/images/large/5.jpg saved to cache
2026-03-26 22:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c5aced6b-d46f-5dc2-a6cd-9bb903a1397d
2026-03-26 22:48:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7438550>
2026-03-26 22:48:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5aced6b-d46f-5dc2-a6cd-9bb903a1397d/c5aced6b-d46f-5dc2-a6cd-9bb903a1397d_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F0380973a4a8c4fac9683d9829c7a5040%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/0380973a4a8c4fac9683d9829c7a5040/images/large/7.jpg saved to cache
2026-03-26 22:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c5aced6b-d46f-5dc2-a6cd-9bb903a1397d
2026-03-26 22:48:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c5fcd0>
2026-03-26 22:48:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5aced6b-d46f-5dc2-a6cd-9bb903a1397d/c5aced6b-d46f-5dc2-a6cd-9bb903a1397d_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F0380973a4a8c4fac9683d9829c7a5040%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/0380973a4a8c4fac9683d9829c7a5040/images/large/4.jpg saved to cache
2026-03-26 22:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c5aced6b-d46f-5dc2-a6cd-9bb903a1397d
2026-03-26 22:48:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd0d0f50>
2026-03-26 22:48:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5aced6b-d46f-5dc2-a6cd-9bb903a1397d/c5aced6b-d46f-5dc2-a6cd-9bb903a1397d_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F0380973a4a8c4fac9683d9829c7a5040%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/0380973a4a8c4fac9683d9829c7a5040/images/large/8.jpg saved to cache
2026-03-26 22:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c5aced6b-d46f-5dc2-a6cd-9bb903a1397d
2026-03-26 22:48:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2et/54741e6bcaf44d638e0230c31d4fba99/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2et/54741e6bcaf44d638e0230c31d4fba99/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2et/54741e6bcaf44d638e0230c31d4fba99/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/0380973a4a8c4fac9683d9829c7a5040/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2et/54741e6bcaf44d638e0230c31d4fba99/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F1cc5f6dea6384b9a96afbbf4da863a38%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/1cc5f6dea6384b9a96afbbf4da863a38/images/large/9.jpg not downloaded yet
2026-03-26 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F1cc5f6dea6384b9a96afbbf4da863a38%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/1cc5f6dea6384b9a96afbbf4da863a38/images/large/10.jpg not downloaded yet
2026-03-26 22:48:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79d5290>
2026-03-26 22:48:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8a013bd-22c1-5c6d-bce6-42fd909ba0f5/e8a013bd-22c1-5c6d-bce6-42fd909ba0f5_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2et%252F54741e6bcaf44d638e0230c31d4fba99%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2et/54741e6bcaf44d638e0230c31d4fba99/images/large/9.jpg saved to cache
2026-03-26 22:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e8a013bd-22c1-5c6d-bce6-42fd909ba0f5
2026-03-26 22:48:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b75a4650>
2026-03-26 22:48:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8a013bd-22c1-5c6d-bce6-42fd909ba0f5/e8a013bd-22c1-5c6d-bce6-42fd909ba0f5_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2et%252F54741e6bcaf44d638e0230c31d4fba99%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2et/54741e6bcaf44d638e0230c31d4fba99/images/large/6.jpg saved to cache
2026-03-26 22:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e8a013bd-22c1-5c6d-bce6-42fd909ba0f5
2026-03-26 22:48:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2et/54741e6bcaf44d638e0230c31d4fba99/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:12 [ayvens.be] INFO: Found listing with ID: 1986126
2026-03-26 22:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986126%27 HTTP/1.1" 200 None
2026-03-26 22:48:12 [ayvens.be] INFO: Scrape type for 1986126: 1
2026-03-26 22:48:12 [ayvens.be] INFO: Extracting data for car ID: 1986126
2026-03-26 22:48:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a58a0a4-49a0-521b-ae92-ee9919a76463 with identifier: 1986126
2026-03-26 22:48:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a58a0a4-49a0-521b-ae92-ee9919a76463 with scrape type 1
2026-03-26 22:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9a58a0a4-49a0-521b-ae92-ee9919a76463
2026-03-26 22:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aw%252Fb0d62c15ffa743549d37a36b235079de%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aw/b0d62c15ffa743549d37a36b235079de/images/large/1.jpg not downloaded yet
2026-03-26 22:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aw%252Fb0d62c15ffa743549d37a36b235079de%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aw/b0d62c15ffa743549d37a36b235079de/images/large/2.jpg not downloaded yet
2026-03-26 22:48:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2et/54741e6bcaf44d638e0230c31d4fba99/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/1cc5f6dea6384b9a96afbbf4da863a38/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/1cc5f6dea6384b9a96afbbf4da863a38/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/1cc5f6dea6384b9a96afbbf4da863a38/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aw%252Fb0d62c15ffa743549d37a36b235079de%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aw/b0d62c15ffa743549d37a36b235079de/images/large/3.jpg not downloaded yet
2026-03-26 22:48:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74091d0>
2026-03-26 22:48:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8a013bd-22c1-5c6d-bce6-42fd909ba0f5/e8a013bd-22c1-5c6d-bce6-42fd909ba0f5_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2et%252F54741e6bcaf44d638e0230c31d4fba99%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2et/54741e6bcaf44d638e0230c31d4fba99/images/large/2.jpg saved to cache
2026-03-26 22:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e8a013bd-22c1-5c6d-bce6-42fd909ba0f5
2026-03-26 22:48:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7726350>
2026-03-26 22:48:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8a013bd-22c1-5c6d-bce6-42fd909ba0f5/e8a013bd-22c1-5c6d-bce6-42fd909ba0f5_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2et%252F54741e6bcaf44d638e0230c31d4fba99%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2et/54741e6bcaf44d638e0230c31d4fba99/images/large/1.jpg saved to cache
2026-03-26 22:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e8a013bd-22c1-5c6d-bce6-42fd909ba0f5
2026-03-26 22:48:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77737d0>
2026-03-26 22:48:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8a013bd-22c1-5c6d-bce6-42fd909ba0f5/e8a013bd-22c1-5c6d-bce6-42fd909ba0f5_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2et%252F54741e6bcaf44d638e0230c31d4fba99%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2et/54741e6bcaf44d638e0230c31d4fba99/images/large/7.jpg saved to cache
2026-03-26 22:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e8a013bd-22c1-5c6d-bce6-42fd909ba0f5
2026-03-26 22:48:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e17590>
2026-03-26 22:48:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5aced6b-d46f-5dc2-a6cd-9bb903a1397d/c5aced6b-d46f-5dc2-a6cd-9bb903a1397d_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F0380973a4a8c4fac9683d9829c7a5040%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/0380973a4a8c4fac9683d9829c7a5040/images/large/10.jpg saved to cache
2026-03-26 22:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c5aced6b-d46f-5dc2-a6cd-9bb903a1397d
2026-03-26 22:48:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c5aced6b-d46f-5dc2-a6cd-9bb903a1397d, skipping ID generation
2026-03-26 22:48:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5aced6b-d46f-5dc2-a6cd-9bb903a1397d with scrape type 1
2026-03-26 22:48:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c5aced6b-d46f-5dc2-a6cd-9bb903a1397d sending to next pipeline
2026-03-26 22:48:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c5aced6b-d46f-5dc2-a6cd-9bb903a1397d, identifier: 1986123
2026-03-26 22:48:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b764ae90>
2026-03-26 22:48:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8a013bd-22c1-5c6d-bce6-42fd909ba0f5/e8a013bd-22c1-5c6d-bce6-42fd909ba0f5_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2et%252F54741e6bcaf44d638e0230c31d4fba99%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2et/54741e6bcaf44d638e0230c31d4fba99/images/large/8.jpg saved to cache
2026-03-26 22:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e8a013bd-22c1-5c6d-bce6-42fd909ba0f5
2026-03-26 22:48:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c5aced6b-d46f-5dc2-a6cd-9bb903a1397d with identifier: 1986123
2026-03-26 22:48:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c5aced6b-d46f-5dc2-a6cd-9bb903a1397d with identifier: 1986123
2026-03-26 22:48:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c5aced6b-d46f-5dc2-a6cd-9bb903a1397d with identifier: 1986123 to the API
2026-03-26 22:48:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:48:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:48:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bs/0380973a4a8c4fac9683d9829c7a5040/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'c5aced6b-d46f-5dc2-a6cd-9bb903a1397d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'YARIS CROSS',
 'odometer': 69353,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5aced6b-d46f-5dc2-a6cd-9bb903a1397d/c5aced6b-d46f-5dc2-a6cd-9bb903a1397d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 670406,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/0380973a4a8c4fac9683d9829c7a5040/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5aced6b-d46f-5dc2-a6cd-9bb903a1397d/c5aced6b-d46f-5dc2-a6cd-9bb903a1397d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 547446,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/0380973a4a8c4fac9683d9829c7a5040/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5aced6b-d46f-5dc2-a6cd-9bb903a1397d/c5aced6b-d46f-5dc2-a6cd-9bb903a1397d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 609568,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/0380973a4a8c4fac9683d9829c7a5040/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5aced6b-d46f-5dc2-a6cd-9bb903a1397d/c5aced6b-d46f-5dc2-a6cd-9bb903a1397d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 584578,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/0380973a4a8c4fac9683d9829c7a5040/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5aced6b-d46f-5dc2-a6cd-9bb903a1397d/c5aced6b-d46f-5dc2-a6cd-9bb903a1397d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 499181,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/0380973a4a8c4fac9683d9829c7a5040/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5aced6b-d46f-5dc2-a6cd-9bb903a1397d/c5aced6b-d46f-5dc2-a6cd-9bb903a1397d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 383187,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/0380973a4a8c4fac9683d9829c7a5040/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5aced6b-d46f-5dc2-a6cd-9bb903a1397d/c5aced6b-d46f-5dc2-a6cd-9bb903a1397d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 491240,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/0380973a4a8c4fac9683d9829c7a5040/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5aced6b-d46f-5dc2-a6cd-9bb903a1397d/c5aced6b-d46f-5dc2-a6cd-9bb903a1397d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 406765,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/0380973a4a8c4fac9683d9829c7a5040/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5aced6b-d46f-5dc2-a6cd-9bb903a1397d/c5aced6b-d46f-5dc2-a6cd-9bb903a1397d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 354549,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/0380973a4a8c4fac9683d9829c7a5040/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5aced6b-d46f-5dc2-a6cd-9bb903a1397d/c5aced6b-d46f-5dc2-a6cd-9bb903a1397d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 316613,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/0380973a4a8c4fac9683d9829c7a5040/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA YARIS CROSS 1.5 VVT-IE HEV DYNAMIC PLUS CVT',
 'transmission': 'automatic',
 'trim': '1.5 VVT-IE HEV DYNAMIC PLUS CVT',
 'vin': None,
 'year': 2022}
2026-03-26 22:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986123%27 HTTP/1.1" 200 None
2026-03-26 22:48:13 [ayvens.be] INFO: Saving data for 1986123: {'created_time': 1774565293.135142, 'last_price_update_time': 1774565293.135152, 'auction_closing_time': 1775028600.0}
2026-03-26 22:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986123') HTTP/1.1" 204 0
2026-03-26 22:48:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2et/54741e6bcaf44d638e0230c31d4fba99/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aw%252Fb0d62c15ffa743549d37a36b235079de%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aw/b0d62c15ffa743549d37a36b235079de/images/large/4.jpg not downloaded yet
2026-03-26 22:48:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/1cc5f6dea6384b9a96afbbf4da863a38/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aw%252Fb0d62c15ffa743549d37a36b235079de%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aw/b0d62c15ffa743549d37a36b235079de/images/large/5.jpg not downloaded yet
2026-03-26 22:48:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2et/54741e6bcaf44d638e0230c31d4fba99/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b746dcd0>
2026-03-26 22:48:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8a013bd-22c1-5c6d-bce6-42fd909ba0f5/e8a013bd-22c1-5c6d-bce6-42fd909ba0f5_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2et%252F54741e6bcaf44d638e0230c31d4fba99%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2et/54741e6bcaf44d638e0230c31d4fba99/images/large/5.jpg saved to cache
2026-03-26 22:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e8a013bd-22c1-5c6d-bce6-42fd909ba0f5
2026-03-26 22:48:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b764b5d0>
2026-03-26 22:48:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8a013bd-22c1-5c6d-bce6-42fd909ba0f5/e8a013bd-22c1-5c6d-bce6-42fd909ba0f5_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2et%252F54741e6bcaf44d638e0230c31d4fba99%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2et/54741e6bcaf44d638e0230c31d4fba99/images/large/10.jpg saved to cache
2026-03-26 22:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e8a013bd-22c1-5c6d-bce6-42fd909ba0f5
2026-03-26 22:48:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c776d0>
2026-03-26 22:48:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_627821ca-29b1-5fd9-bb5c-154f2a67d644/627821ca-29b1-5fd9-bb5c-154f2a67d644_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F1cc5f6dea6384b9a96afbbf4da863a38%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/1cc5f6dea6384b9a96afbbf4da863a38/images/large/3.jpg saved to cache
2026-03-26 22:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 627821ca-29b1-5fd9-bb5c-154f2a67d644
2026-03-26 22:48:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e14050>
2026-03-26 22:48:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_627821ca-29b1-5fd9-bb5c-154f2a67d644/627821ca-29b1-5fd9-bb5c-154f2a67d644_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F1cc5f6dea6384b9a96afbbf4da863a38%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/1cc5f6dea6384b9a96afbbf4da863a38/images/large/2.jpg saved to cache
2026-03-26 22:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 627821ca-29b1-5fd9-bb5c-154f2a67d644
2026-03-26 22:48:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c75690>
2026-03-26 22:48:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_627821ca-29b1-5fd9-bb5c-154f2a67d644/627821ca-29b1-5fd9-bb5c-154f2a67d644_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F1cc5f6dea6384b9a96afbbf4da863a38%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/1cc5f6dea6384b9a96afbbf4da863a38/images/large/4.jpg saved to cache
2026-03-26 22:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 627821ca-29b1-5fd9-bb5c-154f2a67d644
2026-03-26 22:48:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/1cc5f6dea6384b9a96afbbf4da863a38/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/1cc5f6dea6384b9a96afbbf4da863a38/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/1cc5f6dea6384b9a96afbbf4da863a38/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/1cc5f6dea6384b9a96afbbf4da863a38/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aw%252Fb0d62c15ffa743549d37a36b235079de%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aw/b0d62c15ffa743549d37a36b235079de/images/large/6.jpg not downloaded yet
2026-03-26 22:48:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/1cc5f6dea6384b9a96afbbf4da863a38/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aw%252Fb0d62c15ffa743549d37a36b235079de%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aw/b0d62c15ffa743549d37a36b235079de/images/large/7.jpg not downloaded yet
2026-03-26 22:48:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/1cc5f6dea6384b9a96afbbf4da863a38/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b727ced0>
2026-03-26 22:48:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8a013bd-22c1-5c6d-bce6-42fd909ba0f5/e8a013bd-22c1-5c6d-bce6-42fd909ba0f5_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2et%252F54741e6bcaf44d638e0230c31d4fba99%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2et/54741e6bcaf44d638e0230c31d4fba99/images/large/3.jpg saved to cache
2026-03-26 22:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e8a013bd-22c1-5c6d-bce6-42fd909ba0f5
2026-03-26 22:48:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7773310>
2026-03-26 22:48:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_627821ca-29b1-5fd9-bb5c-154f2a67d644/627821ca-29b1-5fd9-bb5c-154f2a67d644_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F1cc5f6dea6384b9a96afbbf4da863a38%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/1cc5f6dea6384b9a96afbbf4da863a38/images/large/1.jpg saved to cache
2026-03-26 22:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 627821ca-29b1-5fd9-bb5c-154f2a67d644
2026-03-26 22:48:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7877cd0>
2026-03-26 22:48:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8a013bd-22c1-5c6d-bce6-42fd909ba0f5/e8a013bd-22c1-5c6d-bce6-42fd909ba0f5_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2et%252F54741e6bcaf44d638e0230c31d4fba99%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2et/54741e6bcaf44d638e0230c31d4fba99/images/large/4.jpg saved to cache
2026-03-26 22:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e8a013bd-22c1-5c6d-bce6-42fd909ba0f5
2026-03-26 22:48:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e8a013bd-22c1-5c6d-bce6-42fd909ba0f5, skipping ID generation
2026-03-26 22:48:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8a013bd-22c1-5c6d-bce6-42fd909ba0f5 with scrape type 1
2026-03-26 22:48:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e8a013bd-22c1-5c6d-bce6-42fd909ba0f5 sending to next pipeline
2026-03-26 22:48:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e8a013bd-22c1-5c6d-bce6-42fd909ba0f5, identifier: 1986124
2026-03-26 22:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aw%252Fb0d62c15ffa743549d37a36b235079de%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aw/b0d62c15ffa743549d37a36b235079de/images/large/8.jpg not downloaded yet
2026-03-26 22:48:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e8a013bd-22c1-5c6d-bce6-42fd909ba0f5 with identifier: 1986124
2026-03-26 22:48:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e8a013bd-22c1-5c6d-bce6-42fd909ba0f5 with identifier: 1986124
2026-03-26 22:48:13 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e8a013bd-22c1-5c6d-bce6-42fd909ba0f5 with identifier: 1986124 to the API
2026-03-26 22:48:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:48:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:48:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2et/54741e6bcaf44d638e0230c31d4fba99/images/large/4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'electric',
 'id': 'e8a013bd-22c1-5c6d-bce6-42fd909ba0f5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '308',
 'odometer': 26637,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8a013bd-22c1-5c6d-bce6-42fd909ba0f5/e8a013bd-22c1-5c6d-bce6-42fd909ba0f5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 374439,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2et/54741e6bcaf44d638e0230c31d4fba99/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8a013bd-22c1-5c6d-bce6-42fd909ba0f5/e8a013bd-22c1-5c6d-bce6-42fd909ba0f5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 371179,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2et/54741e6bcaf44d638e0230c31d4fba99/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8a013bd-22c1-5c6d-bce6-42fd909ba0f5/e8a013bd-22c1-5c6d-bce6-42fd909ba0f5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 362988,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2et/54741e6bcaf44d638e0230c31d4fba99/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8a013bd-22c1-5c6d-bce6-42fd909ba0f5/e8a013bd-22c1-5c6d-bce6-42fd909ba0f5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 361887,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2et/54741e6bcaf44d638e0230c31d4fba99/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8a013bd-22c1-5c6d-bce6-42fd909ba0f5/e8a013bd-22c1-5c6d-bce6-42fd909ba0f5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 289210,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2et/54741e6bcaf44d638e0230c31d4fba99/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8a013bd-22c1-5c6d-bce6-42fd909ba0f5/e8a013bd-22c1-5c6d-bce6-42fd909ba0f5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 199046,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2et/54741e6bcaf44d638e0230c31d4fba99/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8a013bd-22c1-5c6d-bce6-42fd909ba0f5/e8a013bd-22c1-5c6d-bce6-42fd909ba0f5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 304869,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2et/54741e6bcaf44d638e0230c31d4fba99/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8a013bd-22c1-5c6d-bce6-42fd909ba0f5/e8a013bd-22c1-5c6d-bce6-42fd909ba0f5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 359026,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2et/54741e6bcaf44d638e0230c31d4fba99/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8a013bd-22c1-5c6d-bce6-42fd909ba0f5/e8a013bd-22c1-5c6d-bce6-42fd909ba0f5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 308795,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2et/54741e6bcaf44d638e0230c31d4fba99/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8a013bd-22c1-5c6d-bce6-42fd909ba0f5/e8a013bd-22c1-5c6d-bce6-42fd909ba0f5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 232326,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2et/54741e6bcaf44d638e0230c31d4fba99/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-01-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 308 BEV 51KWH ELECTRIQUE E-308 AUTO GT',
 'transmission': 'automatic',
 'trim': 'BEV 51KWH ELECTRIQUE E-308 AUTO GT',
 'vin': None,
 'year': 2024}
2026-03-26 22:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986124%27 HTTP/1.1" 200 None
2026-03-26 22:48:14 [ayvens.be] INFO: Saving data for 1986124: {'created_time': 1774565294.234558, 'last_price_update_time': 1774565294.234566, 'auction_closing_time': 1775028600.0}
2026-03-26 22:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986124') HTTP/1.1" 204 0
2026-03-26 22:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aw%252Fb0d62c15ffa743549d37a36b235079de%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aw/b0d62c15ffa743549d37a36b235079de/images/large/9.jpg not downloaded yet
2026-03-26 22:48:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b768b950>
2026-03-26 22:48:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_627821ca-29b1-5fd9-bb5c-154f2a67d644/627821ca-29b1-5fd9-bb5c-154f2a67d644_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F1cc5f6dea6384b9a96afbbf4da863a38%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/1cc5f6dea6384b9a96afbbf4da863a38/images/large/5.jpg saved to cache
2026-03-26 22:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 627821ca-29b1-5fd9-bb5c-154f2a67d644
2026-03-26 22:48:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7565c90>
2026-03-26 22:48:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_627821ca-29b1-5fd9-bb5c-154f2a67d644/627821ca-29b1-5fd9-bb5c-154f2a67d644_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F1cc5f6dea6384b9a96afbbf4da863a38%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/1cc5f6dea6384b9a96afbbf4da863a38/images/large/8.jpg saved to cache
2026-03-26 22:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 627821ca-29b1-5fd9-bb5c-154f2a67d644
2026-03-26 22:48:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7565510>
2026-03-26 22:48:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_627821ca-29b1-5fd9-bb5c-154f2a67d644/627821ca-29b1-5fd9-bb5c-154f2a67d644_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F1cc5f6dea6384b9a96afbbf4da863a38%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/1cc5f6dea6384b9a96afbbf4da863a38/images/large/6.jpg saved to cache
2026-03-26 22:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 627821ca-29b1-5fd9-bb5c-154f2a67d644
2026-03-26 22:48:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76e32d0>
2026-03-26 22:48:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_627821ca-29b1-5fd9-bb5c-154f2a67d644/627821ca-29b1-5fd9-bb5c-154f2a67d644_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F1cc5f6dea6384b9a96afbbf4da863a38%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/1cc5f6dea6384b9a96afbbf4da863a38/images/large/7.jpg saved to cache
2026-03-26 22:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 627821ca-29b1-5fd9-bb5c-154f2a67d644
2026-03-26 22:48:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b782ca50>
2026-03-26 22:48:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_627821ca-29b1-5fd9-bb5c-154f2a67d644/627821ca-29b1-5fd9-bb5c-154f2a67d644_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F1cc5f6dea6384b9a96afbbf4da863a38%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/1cc5f6dea6384b9a96afbbf4da863a38/images/large/9.jpg saved to cache
2026-03-26 22:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 627821ca-29b1-5fd9-bb5c-154f2a67d644
2026-03-26 22:48:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7567010>
2026-03-26 22:48:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_627821ca-29b1-5fd9-bb5c-154f2a67d644/627821ca-29b1-5fd9-bb5c-154f2a67d644_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F1cc5f6dea6384b9a96afbbf4da863a38%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/1cc5f6dea6384b9a96afbbf4da863a38/images/large/10.jpg saved to cache
2026-03-26 22:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 627821ca-29b1-5fd9-bb5c-154f2a67d644
2026-03-26 22:48:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 627821ca-29b1-5fd9-bb5c-154f2a67d644, skipping ID generation
2026-03-26 22:48:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 627821ca-29b1-5fd9-bb5c-154f2a67d644 with scrape type 1
2026-03-26 22:48:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 627821ca-29b1-5fd9-bb5c-154f2a67d644 sending to next pipeline
2026-03-26 22:48:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 627821ca-29b1-5fd9-bb5c-154f2a67d644, identifier: 1986125
2026-03-26 22:48:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 627821ca-29b1-5fd9-bb5c-154f2a67d644 with identifier: 1986125
2026-03-26 22:48:14 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 22:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 22:48:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 627821ca-29b1-5fd9-bb5c-154f2a67d644 with identifier: 1986125
2026-03-26 22:48:14 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 627821ca-29b1-5fd9-bb5c-154f2a67d644 with identifier: 1986125 to the API
2026-03-26 22:48:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:48:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:48:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cv/1cc5f6dea6384b9a96afbbf4da863a38/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'PEARL WHITE MULTI',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'electric',
 'id': '627821ca-29b1-5fd9-bb5c-154f2a67d644',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'TESLA',
 'model': 'MODEL 3',
 'odometer': 89447,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_627821ca-29b1-5fd9-bb5c-154f2a67d644/627821ca-29b1-5fd9-bb5c-154f2a67d644_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 192602,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/1cc5f6dea6384b9a96afbbf4da863a38/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_627821ca-29b1-5fd9-bb5c-154f2a67d644/627821ca-29b1-5fd9-bb5c-154f2a67d644_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 176439,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/1cc5f6dea6384b9a96afbbf4da863a38/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_627821ca-29b1-5fd9-bb5c-154f2a67d644/627821ca-29b1-5fd9-bb5c-154f2a67d644_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 198398,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/1cc5f6dea6384b9a96afbbf4da863a38/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_627821ca-29b1-5fd9-bb5c-154f2a67d644/627821ca-29b1-5fd9-bb5c-154f2a67d644_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 194215,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/1cc5f6dea6384b9a96afbbf4da863a38/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_627821ca-29b1-5fd9-bb5c-154f2a67d644/627821ca-29b1-5fd9-bb5c-154f2a67d644_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 261764,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/1cc5f6dea6384b9a96afbbf4da863a38/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_627821ca-29b1-5fd9-bb5c-154f2a67d644/627821ca-29b1-5fd9-bb5c-154f2a67d644_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 240553,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/1cc5f6dea6384b9a96afbbf4da863a38/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_627821ca-29b1-5fd9-bb5c-154f2a67d644/627821ca-29b1-5fd9-bb5c-154f2a67d644_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 216131,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/1cc5f6dea6384b9a96afbbf4da863a38/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_627821ca-29b1-5fd9-bb5c-154f2a67d644/627821ca-29b1-5fd9-bb5c-154f2a67d644_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 239320,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/1cc5f6dea6384b9a96afbbf4da863a38/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_627821ca-29b1-5fd9-bb5c-154f2a67d644/627821ca-29b1-5fd9-bb5c-154f2a67d644_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 296968,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/1cc5f6dea6384b9a96afbbf4da863a38/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_627821ca-29b1-5fd9-bb5c-154f2a67d644/627821ca-29b1-5fd9-bb5c-154f2a67d644_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 192142,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/1cc5f6dea6384b9a96afbbf4da863a38/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TESLA MODEL 3 BEV 50KWH STANDARD RWD PLUS AUTO',
 'transmission': 'automatic',
 'trim': 'BEV 50KWH STANDARD RWD PLUS AUTO',
 'vin': None,
 'year': 2022}
2026-03-26 22:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986125%27 HTTP/1.1" 200 None
2026-03-26 22:48:14 [ayvens.be] INFO: Saving data for 1986125: {'created_time': 1774565294.975803, 'last_price_update_time': 1774565294.975814, 'auction_closing_time': 1775028600.0}
2026-03-26 22:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986125') HTTP/1.1" 204 0
2026-03-26 22:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aw%252Fb0d62c15ffa743549d37a36b235079de%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aw/b0d62c15ffa743549d37a36b235079de/images/large/10.jpg not downloaded yet
2026-03-26 22:48:15 [ayvens.be] INFO: Found listing with ID: 1986127
2026-03-26 22:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986127%27 HTTP/1.1" 200 None
2026-03-26 22:48:15 [ayvens.be] INFO: Scrape type for 1986127: 1
2026-03-26 22:48:15 [ayvens.be] INFO: Extracting data for car ID: 1986127
2026-03-26 22:48:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee0d89dd-63fb-5dfb-8528-680fc89783a4 with identifier: 1986127
2026-03-26 22:48:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee0d89dd-63fb-5dfb-8528-680fc89783a4 with scrape type 1
2026-03-26 22:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ee0d89dd-63fb-5dfb-8528-680fc89783a4
2026-03-26 22:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xn%252Fd211ea10511442aa8477d6a5aa5c0c16%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xn/d211ea10511442aa8477d6a5aa5c0c16/images/large/1.jpg not downloaded yet
2026-03-26 22:48:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aw/b0d62c15ffa743549d37a36b235079de/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xn%252Fd211ea10511442aa8477d6a5aa5c0c16%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xn/d211ea10511442aa8477d6a5aa5c0c16/images/large/2.jpg not downloaded yet
2026-03-26 22:48:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aw/b0d62c15ffa743549d37a36b235079de/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aw/b0d62c15ffa743549d37a36b235079de/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xn%252Fd211ea10511442aa8477d6a5aa5c0c16%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xn/d211ea10511442aa8477d6a5aa5c0c16/images/large/3.jpg not downloaded yet
2026-03-26 22:48:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aw/b0d62c15ffa743549d37a36b235079de/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aw/b0d62c15ffa743549d37a36b235079de/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xn%252Fd211ea10511442aa8477d6a5aa5c0c16%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xn/d211ea10511442aa8477d6a5aa5c0c16/images/large/4.jpg not downloaded yet
2026-03-26 22:48:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aw/b0d62c15ffa743549d37a36b235079de/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aw/b0d62c15ffa743549d37a36b235079de/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xn%252Fd211ea10511442aa8477d6a5aa5c0c16%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xn/d211ea10511442aa8477d6a5aa5c0c16/images/large/5.jpg not downloaded yet
2026-03-26 22:48:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7413d50>
2026-03-26 22:48:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a58a0a4-49a0-521b-ae92-ee9919a76463/9a58a0a4-49a0-521b-ae92-ee9919a76463_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aw%252Fb0d62c15ffa743549d37a36b235079de%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aw/b0d62c15ffa743549d37a36b235079de/images/large/5.jpg saved to cache
2026-03-26 22:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9a58a0a4-49a0-521b-ae92-ee9919a76463
2026-03-26 22:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xn%252Fd211ea10511442aa8477d6a5aa5c0c16%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xn/d211ea10511442aa8477d6a5aa5c0c16/images/large/6.jpg not downloaded yet
2026-03-26 22:48:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aw/b0d62c15ffa743549d37a36b235079de/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xn%252Fd211ea10511442aa8477d6a5aa5c0c16%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xn/d211ea10511442aa8477d6a5aa5c0c16/images/large/7.jpg not downloaded yet
2026-03-26 22:48:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aw/b0d62c15ffa743549d37a36b235079de/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b741e3d0>
2026-03-26 22:48:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a58a0a4-49a0-521b-ae92-ee9919a76463/9a58a0a4-49a0-521b-ae92-ee9919a76463_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aw%252Fb0d62c15ffa743549d37a36b235079de%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aw/b0d62c15ffa743549d37a36b235079de/images/large/2.jpg saved to cache
2026-03-26 22:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9a58a0a4-49a0-521b-ae92-ee9919a76463
2026-03-26 22:48:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79d67d0>
2026-03-26 22:48:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a58a0a4-49a0-521b-ae92-ee9919a76463/9a58a0a4-49a0-521b-ae92-ee9919a76463_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aw%252Fb0d62c15ffa743549d37a36b235079de%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aw/b0d62c15ffa743549d37a36b235079de/images/large/1.jpg saved to cache
2026-03-26 22:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9a58a0a4-49a0-521b-ae92-ee9919a76463
2026-03-26 22:48:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b768bad0>
2026-03-26 22:48:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a58a0a4-49a0-521b-ae92-ee9919a76463/9a58a0a4-49a0-521b-ae92-ee9919a76463_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aw%252Fb0d62c15ffa743549d37a36b235079de%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aw/b0d62c15ffa743549d37a36b235079de/images/large/3.jpg saved to cache
2026-03-26 22:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9a58a0a4-49a0-521b-ae92-ee9919a76463
2026-03-26 22:48:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7585490>
2026-03-26 22:48:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a58a0a4-49a0-521b-ae92-ee9919a76463/9a58a0a4-49a0-521b-ae92-ee9919a76463_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aw%252Fb0d62c15ffa743549d37a36b235079de%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aw/b0d62c15ffa743549d37a36b235079de/images/large/4.jpg saved to cache
2026-03-26 22:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9a58a0a4-49a0-521b-ae92-ee9919a76463
2026-03-26 22:48:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cc8ad0>
2026-03-26 22:48:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a58a0a4-49a0-521b-ae92-ee9919a76463/9a58a0a4-49a0-521b-ae92-ee9919a76463_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aw%252Fb0d62c15ffa743549d37a36b235079de%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aw/b0d62c15ffa743549d37a36b235079de/images/large/6.jpg saved to cache
2026-03-26 22:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9a58a0a4-49a0-521b-ae92-ee9919a76463
2026-03-26 22:48:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b768b8d0>
2026-03-26 22:48:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a58a0a4-49a0-521b-ae92-ee9919a76463/9a58a0a4-49a0-521b-ae92-ee9919a76463_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aw%252Fb0d62c15ffa743549d37a36b235079de%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aw/b0d62c15ffa743549d37a36b235079de/images/large/7.jpg saved to cache
2026-03-26 22:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9a58a0a4-49a0-521b-ae92-ee9919a76463
2026-03-26 22:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xn%252Fd211ea10511442aa8477d6a5aa5c0c16%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xn/d211ea10511442aa8477d6a5aa5c0c16/images/large/8.jpg not downloaded yet
2026-03-26 22:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xn%252Fd211ea10511442aa8477d6a5aa5c0c16%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xn/d211ea10511442aa8477d6a5aa5c0c16/images/large/9.jpg not downloaded yet
2026-03-26 22:48:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd0d2c10>
2026-03-26 22:48:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a58a0a4-49a0-521b-ae92-ee9919a76463/9a58a0a4-49a0-521b-ae92-ee9919a76463_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aw%252Fb0d62c15ffa743549d37a36b235079de%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aw/b0d62c15ffa743549d37a36b235079de/images/large/8.jpg saved to cache
2026-03-26 22:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9a58a0a4-49a0-521b-ae92-ee9919a76463
2026-03-26 22:48:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7475690>
2026-03-26 22:48:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a58a0a4-49a0-521b-ae92-ee9919a76463/9a58a0a4-49a0-521b-ae92-ee9919a76463_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aw%252Fb0d62c15ffa743549d37a36b235079de%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aw/b0d62c15ffa743549d37a36b235079de/images/large/9.jpg saved to cache
2026-03-26 22:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9a58a0a4-49a0-521b-ae92-ee9919a76463
2026-03-26 22:48:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aw/b0d62c15ffa743549d37a36b235079de/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xn%252Fd211ea10511442aa8477d6a5aa5c0c16%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xn/d211ea10511442aa8477d6a5aa5c0c16/images/large/10.jpg not downloaded yet
2026-03-26 22:48:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xn/d211ea10511442aa8477d6a5aa5c0c16/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:16 [ayvens.be] INFO: Found listing with ID: 1986128
2026-03-26 22:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986128%27 HTTP/1.1" 200 None
2026-03-26 22:48:16 [ayvens.be] INFO: Scrape type for 1986128: 1
2026-03-26 22:48:16 [ayvens.be] INFO: Extracting data for car ID: 1986128
2026-03-26 22:48:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c954d54d-3795-5008-8a99-2f623d405a16 with identifier: 1986128
2026-03-26 22:48:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c954d54d-3795-5008-8a99-2f623d405a16 with scrape type 1
2026-03-26 22:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c954d54d-3795-5008-8a99-2f623d405a16
2026-03-26 22:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fe865581792604122b9f602c538dd2633%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/e865581792604122b9f602c538dd2633/images/large/1.jpg not downloaded yet
2026-03-26 22:48:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xn/d211ea10511442aa8477d6a5aa5c0c16/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xn/d211ea10511442aa8477d6a5aa5c0c16/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fe865581792604122b9f602c538dd2633%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/e865581792604122b9f602c538dd2633/images/large/2.jpg not downloaded yet
2026-03-26 22:48:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xn/d211ea10511442aa8477d6a5aa5c0c16/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xn/d211ea10511442aa8477d6a5aa5c0c16/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fe865581792604122b9f602c538dd2633%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/e865581792604122b9f602c538dd2633/images/large/3.jpg not downloaded yet
2026-03-26 22:48:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b75a72d0>
2026-03-26 22:48:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a58a0a4-49a0-521b-ae92-ee9919a76463/9a58a0a4-49a0-521b-ae92-ee9919a76463_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aw%252Fb0d62c15ffa743549d37a36b235079de%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aw/b0d62c15ffa743549d37a36b235079de/images/large/10.jpg saved to cache
2026-03-26 22:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9a58a0a4-49a0-521b-ae92-ee9919a76463
2026-03-26 22:48:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9a58a0a4-49a0-521b-ae92-ee9919a76463, skipping ID generation
2026-03-26 22:48:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a58a0a4-49a0-521b-ae92-ee9919a76463 with scrape type 1
2026-03-26 22:48:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9a58a0a4-49a0-521b-ae92-ee9919a76463 sending to next pipeline
2026-03-26 22:48:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 9a58a0a4-49a0-521b-ae92-ee9919a76463, identifier: 1986126
2026-03-26 22:48:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7688c10>
2026-03-26 22:48:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee0d89dd-63fb-5dfb-8528-680fc89783a4/ee0d89dd-63fb-5dfb-8528-680fc89783a4_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xn%252Fd211ea10511442aa8477d6a5aa5c0c16%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xn/d211ea10511442aa8477d6a5aa5c0c16/images/large/2.jpg saved to cache
2026-03-26 22:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ee0d89dd-63fb-5dfb-8528-680fc89783a4
2026-03-26 22:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fe865581792604122b9f602c538dd2633%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/e865581792604122b9f602c538dd2633/images/large/4.jpg not downloaded yet
2026-03-26 22:48:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 9a58a0a4-49a0-521b-ae92-ee9919a76463 with identifier: 1986126
2026-03-26 22:48:16 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 22:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 22:48:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 9a58a0a4-49a0-521b-ae92-ee9919a76463 with identifier: 1986126
2026-03-26 22:48:16 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 9a58a0a4-49a0-521b-ae92-ee9919a76463 with identifier: 1986126 to the API
2026-03-26 22:48:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:48:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:48:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2aw/b0d62c15ffa743549d37a36b235079de/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 192,
 'color': 'AGATE BLACK MICA',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '9a58a0a4-49a0-521b-ae92-ee9919a76463',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT CUSTOM',
 'odometer': 173518,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a58a0a4-49a0-521b-ae92-ee9919a76463/9a58a0a4-49a0-521b-ae92-ee9919a76463_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 651077,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aw/b0d62c15ffa743549d37a36b235079de/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a58a0a4-49a0-521b-ae92-ee9919a76463/9a58a0a4-49a0-521b-ae92-ee9919a76463_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 653320,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aw/b0d62c15ffa743549d37a36b235079de/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a58a0a4-49a0-521b-ae92-ee9919a76463/9a58a0a4-49a0-521b-ae92-ee9919a76463_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 676048,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aw/b0d62c15ffa743549d37a36b235079de/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a58a0a4-49a0-521b-ae92-ee9919a76463/9a58a0a4-49a0-521b-ae92-ee9919a76463_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 663444,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aw/b0d62c15ffa743549d37a36b235079de/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a58a0a4-49a0-521b-ae92-ee9919a76463/9a58a0a4-49a0-521b-ae92-ee9919a76463_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 488137,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aw/b0d62c15ffa743549d37a36b235079de/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a58a0a4-49a0-521b-ae92-ee9919a76463/9a58a0a4-49a0-521b-ae92-ee9919a76463_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 628657,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aw/b0d62c15ffa743549d37a36b235079de/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a58a0a4-49a0-521b-ae92-ee9919a76463/9a58a0a4-49a0-521b-ae92-ee9919a76463_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 626173,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aw/b0d62c15ffa743549d37a36b235079de/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a58a0a4-49a0-521b-ae92-ee9919a76463/9a58a0a4-49a0-521b-ae92-ee9919a76463_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 589508,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aw/b0d62c15ffa743549d37a36b235079de/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a58a0a4-49a0-521b-ae92-ee9919a76463/9a58a0a4-49a0-521b-ae92-ee9919a76463_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 511685,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aw/b0d62c15ffa743549d37a36b235079de/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a58a0a4-49a0-521b-ae92-ee9919a76463/9a58a0a4-49a0-521b-ae92-ee9919a76463_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 586014,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aw/b0d62c15ffa743549d37a36b235079de/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-23',
 'seats_number': 6,
 'seller_name': None,
 'title': 'FORD TRANSIT CUSTOM 2.0TD 170PS LIMITED FWD 320 DC LWB AUTO',
 'transmission': 'automatic',
 'trim': '2.0TD 170PS LIMITED FWD 320 DC LWB AUTO',
 'vin': None,
 'year': 2021}
2026-03-26 22:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986126%27 HTTP/1.1" 200 None
2026-03-26 22:48:17 [ayvens.be] INFO: Saving data for 1986126: {'created_time': 1774565297.12054, 'last_price_update_time': 1774565297.12055, 'auction_closing_time': 1775028600.0}
2026-03-26 22:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986126') HTTP/1.1" 204 0
2026-03-26 22:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fe865581792604122b9f602c538dd2633%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/e865581792604122b9f602c538dd2633/images/large/5.jpg not downloaded yet
2026-03-26 22:48:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b777a590>
2026-03-26 22:48:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee0d89dd-63fb-5dfb-8528-680fc89783a4/ee0d89dd-63fb-5dfb-8528-680fc89783a4_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xn%252Fd211ea10511442aa8477d6a5aa5c0c16%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xn/d211ea10511442aa8477d6a5aa5c0c16/images/large/3.jpg saved to cache
2026-03-26 22:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ee0d89dd-63fb-5dfb-8528-680fc89783a4
2026-03-26 22:48:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74b7710>
2026-03-26 22:48:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee0d89dd-63fb-5dfb-8528-680fc89783a4/ee0d89dd-63fb-5dfb-8528-680fc89783a4_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xn%252Fd211ea10511442aa8477d6a5aa5c0c16%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xn/d211ea10511442aa8477d6a5aa5c0c16/images/large/1.jpg saved to cache
2026-03-26 22:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ee0d89dd-63fb-5dfb-8528-680fc89783a4
2026-03-26 22:48:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e476d0>
2026-03-26 22:48:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee0d89dd-63fb-5dfb-8528-680fc89783a4/ee0d89dd-63fb-5dfb-8528-680fc89783a4_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xn%252Fd211ea10511442aa8477d6a5aa5c0c16%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xn/d211ea10511442aa8477d6a5aa5c0c16/images/large/4.jpg saved to cache
2026-03-26 22:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ee0d89dd-63fb-5dfb-8528-680fc89783a4
2026-03-26 22:48:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74b7710>
2026-03-26 22:48:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee0d89dd-63fb-5dfb-8528-680fc89783a4/ee0d89dd-63fb-5dfb-8528-680fc89783a4_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xn%252Fd211ea10511442aa8477d6a5aa5c0c16%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xn/d211ea10511442aa8477d6a5aa5c0c16/images/large/5.jpg saved to cache
2026-03-26 22:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ee0d89dd-63fb-5dfb-8528-680fc89783a4
2026-03-26 22:48:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xn/d211ea10511442aa8477d6a5aa5c0c16/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fe865581792604122b9f602c538dd2633%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/e865581792604122b9f602c538dd2633/images/large/6.jpg not downloaded yet
2026-03-26 22:48:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xn/d211ea10511442aa8477d6a5aa5c0c16/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xn/d211ea10511442aa8477d6a5aa5c0c16/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fe865581792604122b9f602c538dd2633%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/e865581792604122b9f602c538dd2633/images/large/7.jpg not downloaded yet
2026-03-26 22:48:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xn/d211ea10511442aa8477d6a5aa5c0c16/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fe865581792604122b9f602c538dd2633%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/e865581792604122b9f602c538dd2633/images/large/8.jpg not downloaded yet
2026-03-26 22:48:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yh/e865581792604122b9f602c538dd2633/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xn/d211ea10511442aa8477d6a5aa5c0c16/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fe865581792604122b9f602c538dd2633%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/e865581792604122b9f602c538dd2633/images/large/9.jpg not downloaded yet
2026-03-26 22:48:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b726b7d0>
2026-03-26 22:48:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee0d89dd-63fb-5dfb-8528-680fc89783a4/ee0d89dd-63fb-5dfb-8528-680fc89783a4_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xn%252Fd211ea10511442aa8477d6a5aa5c0c16%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xn/d211ea10511442aa8477d6a5aa5c0c16/images/large/8.jpg saved to cache
2026-03-26 22:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ee0d89dd-63fb-5dfb-8528-680fc89783a4
2026-03-26 22:48:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yh/e865581792604122b9f602c538dd2633/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yh/e865581792604122b9f602c538dd2633/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fe865581792604122b9f602c538dd2633%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/e865581792604122b9f602c538dd2633/images/large/10.jpg not downloaded yet
2026-03-26 22:48:17 [ayvens.be] INFO: Found listing with ID: 1986129
2026-03-26 22:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986129%27 HTTP/1.1" 200 None
2026-03-26 22:48:17 [ayvens.be] INFO: Scrape type for 1986129: 1
2026-03-26 22:48:17 [ayvens.be] INFO: Extracting data for car ID: 1986129
2026-03-26 22:48:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 61d6703d-3f5e-5bb0-880a-7bf9c26dd021 with identifier: 1986129
2026-03-26 22:48:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61d6703d-3f5e-5bb0-880a-7bf9c26dd021 with scrape type 1
2026-03-26 22:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 61d6703d-3f5e-5bb0-880a-7bf9c26dd021
2026-03-26 22:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wp%252Fe9dec367b5904e7a8437ec7faf85d7ce%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wp/e9dec367b5904e7a8437ec7faf85d7ce/images/large/1.jpg not downloaded yet
2026-03-26 22:48:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e17ad0>
2026-03-26 22:48:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee0d89dd-63fb-5dfb-8528-680fc89783a4/ee0d89dd-63fb-5dfb-8528-680fc89783a4_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xn%252Fd211ea10511442aa8477d6a5aa5c0c16%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xn/d211ea10511442aa8477d6a5aa5c0c16/images/large/6.jpg saved to cache
2026-03-26 22:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ee0d89dd-63fb-5dfb-8528-680fc89783a4
2026-03-26 22:48:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77734d0>
2026-03-26 22:48:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee0d89dd-63fb-5dfb-8528-680fc89783a4/ee0d89dd-63fb-5dfb-8528-680fc89783a4_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xn%252Fd211ea10511442aa8477d6a5aa5c0c16%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xn/d211ea10511442aa8477d6a5aa5c0c16/images/large/7.jpg saved to cache
2026-03-26 22:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ee0d89dd-63fb-5dfb-8528-680fc89783a4
2026-03-26 22:48:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76484d0>
2026-03-26 22:48:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee0d89dd-63fb-5dfb-8528-680fc89783a4/ee0d89dd-63fb-5dfb-8528-680fc89783a4_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xn%252Fd211ea10511442aa8477d6a5aa5c0c16%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xn/d211ea10511442aa8477d6a5aa5c0c16/images/large/9.jpg saved to cache
2026-03-26 22:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ee0d89dd-63fb-5dfb-8528-680fc89783a4
2026-03-26 22:48:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cc1150>
2026-03-26 22:48:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c954d54d-3795-5008-8a99-2f623d405a16/c954d54d-3795-5008-8a99-2f623d405a16_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fe865581792604122b9f602c538dd2633%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/e865581792604122b9f602c538dd2633/images/large/1.jpg saved to cache
2026-03-26 22:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c954d54d-3795-5008-8a99-2f623d405a16
2026-03-26 22:48:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b78c1f10>
2026-03-26 22:48:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee0d89dd-63fb-5dfb-8528-680fc89783a4/ee0d89dd-63fb-5dfb-8528-680fc89783a4_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xn%252Fd211ea10511442aa8477d6a5aa5c0c16%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xn/d211ea10511442aa8477d6a5aa5c0c16/images/large/10.jpg saved to cache
2026-03-26 22:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ee0d89dd-63fb-5dfb-8528-680fc89783a4
2026-03-26 22:48:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ee0d89dd-63fb-5dfb-8528-680fc89783a4, skipping ID generation
2026-03-26 22:48:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee0d89dd-63fb-5dfb-8528-680fc89783a4 with scrape type 1
2026-03-26 22:48:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ee0d89dd-63fb-5dfb-8528-680fc89783a4 sending to next pipeline
2026-03-26 22:48:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: ee0d89dd-63fb-5dfb-8528-680fc89783a4, identifier: 1986127
2026-03-26 22:48:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: ee0d89dd-63fb-5dfb-8528-680fc89783a4 with identifier: 1986127
2026-03-26 22:48:18 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 22:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 22:48:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: ee0d89dd-63fb-5dfb-8528-680fc89783a4 with identifier: 1986127
2026-03-26 22:48:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: ee0d89dd-63fb-5dfb-8528-680fc89783a4 with identifier: 1986127 to the API
2026-03-26 22:48:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:48:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:48:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1xn/d211ea10511442aa8477d6a5aa5c0c16/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 185,
 'color': 'FROZEN WHITE',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'ee0d89dd-63fb-5dfb-8528-680fc89783a4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT 2T 350L FOU LWB HR DSL',
 'odometer': 90411,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee0d89dd-63fb-5dfb-8528-680fc89783a4/ee0d89dd-63fb-5dfb-8528-680fc89783a4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 598230,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xn/d211ea10511442aa8477d6a5aa5c0c16/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee0d89dd-63fb-5dfb-8528-680fc89783a4/ee0d89dd-63fb-5dfb-8528-680fc89783a4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 560928,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xn/d211ea10511442aa8477d6a5aa5c0c16/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee0d89dd-63fb-5dfb-8528-680fc89783a4/ee0d89dd-63fb-5dfb-8528-680fc89783a4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 702388,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xn/d211ea10511442aa8477d6a5aa5c0c16/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee0d89dd-63fb-5dfb-8528-680fc89783a4/ee0d89dd-63fb-5dfb-8528-680fc89783a4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 555615,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xn/d211ea10511442aa8477d6a5aa5c0c16/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee0d89dd-63fb-5dfb-8528-680fc89783a4/ee0d89dd-63fb-5dfb-8528-680fc89783a4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 543927,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xn/d211ea10511442aa8477d6a5aa5c0c16/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee0d89dd-63fb-5dfb-8528-680fc89783a4/ee0d89dd-63fb-5dfb-8528-680fc89783a4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 629164,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xn/d211ea10511442aa8477d6a5aa5c0c16/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee0d89dd-63fb-5dfb-8528-680fc89783a4/ee0d89dd-63fb-5dfb-8528-680fc89783a4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 679171,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xn/d211ea10511442aa8477d6a5aa5c0c16/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee0d89dd-63fb-5dfb-8528-680fc89783a4/ee0d89dd-63fb-5dfb-8528-680fc89783a4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 585818,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xn/d211ea10511442aa8477d6a5aa5c0c16/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee0d89dd-63fb-5dfb-8528-680fc89783a4/ee0d89dd-63fb-5dfb-8528-680fc89783a4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 497053,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xn/d211ea10511442aa8477d6a5aa5c0c16/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee0d89dd-63fb-5dfb-8528-680fc89783a4/ee0d89dd-63fb-5dfb-8528-680fc89783a4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 645334,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xn/d211ea10511442aa8477d6a5aa5c0c16/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-21',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FORD TRANSIT 2T 350L FOU LWB HR DSL 2.0 TDCi L3H2 Trend STOCK',
 'transmission': 'manual',
 'trim': '2.0 TDCi L3H2 Trend STOCK',
 'vin': None,
 'year': 2020}
2026-03-26 22:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986127%27 HTTP/1.1" 200 None
2026-03-26 22:48:18 [ayvens.be] INFO: Saving data for 1986127: {'created_time': 1774565298.625847, 'last_price_update_time': 1774565298.625857, 'auction_closing_time': 1775028600.0}
2026-03-26 22:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986127') HTTP/1.1" 204 0
2026-03-26 22:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wp%252Fe9dec367b5904e7a8437ec7faf85d7ce%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wp/e9dec367b5904e7a8437ec7faf85d7ce/images/large/2.jpg not downloaded yet
2026-03-26 22:48:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e44f90>
2026-03-26 22:48:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c954d54d-3795-5008-8a99-2f623d405a16/c954d54d-3795-5008-8a99-2f623d405a16_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fe865581792604122b9f602c538dd2633%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/e865581792604122b9f602c538dd2633/images/large/2.jpg saved to cache
2026-03-26 22:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c954d54d-3795-5008-8a99-2f623d405a16
2026-03-26 22:48:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79ccb50>
2026-03-26 22:48:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c954d54d-3795-5008-8a99-2f623d405a16/c954d54d-3795-5008-8a99-2f623d405a16_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fe865581792604122b9f602c538dd2633%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/e865581792604122b9f602c538dd2633/images/large/3.jpg saved to cache
2026-03-26 22:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c954d54d-3795-5008-8a99-2f623d405a16
2026-03-26 22:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wp%252Fe9dec367b5904e7a8437ec7faf85d7ce%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wp/e9dec367b5904e7a8437ec7faf85d7ce/images/large/3.jpg not downloaded yet
2026-03-26 22:48:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yh/e865581792604122b9f602c538dd2633/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yh/e865581792604122b9f602c538dd2633/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wp%252Fe9dec367b5904e7a8437ec7faf85d7ce%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wp/e9dec367b5904e7a8437ec7faf85d7ce/images/large/4.jpg not downloaded yet
2026-03-26 22:48:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yh/e865581792604122b9f602c538dd2633/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wp%252Fe9dec367b5904e7a8437ec7faf85d7ce%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wp/e9dec367b5904e7a8437ec7faf85d7ce/images/large/5.jpg not downloaded yet
2026-03-26 22:48:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yh/e865581792604122b9f602c538dd2633/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yh/e865581792604122b9f602c538dd2633/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yh/e865581792604122b9f602c538dd2633/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wp%252Fe9dec367b5904e7a8437ec7faf85d7ce%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wp/e9dec367b5904e7a8437ec7faf85d7ce/images/large/6.jpg not downloaded yet
2026-03-26 22:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wp%252Fe9dec367b5904e7a8437ec7faf85d7ce%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wp/e9dec367b5904e7a8437ec7faf85d7ce/images/large/7.jpg not downloaded yet
2026-03-26 22:48:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yh/e865581792604122b9f602c538dd2633/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wp%252Fe9dec367b5904e7a8437ec7faf85d7ce%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wp/e9dec367b5904e7a8437ec7faf85d7ce/images/large/8.jpg not downloaded yet
2026-03-26 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wp%252Fe9dec367b5904e7a8437ec7faf85d7ce%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wp/e9dec367b5904e7a8437ec7faf85d7ce/images/large/9.jpg not downloaded yet
2026-03-26 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wp%252Fe9dec367b5904e7a8437ec7faf85d7ce%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wp/e9dec367b5904e7a8437ec7faf85d7ce/images/large/10.jpg not downloaded yet
2026-03-26 22:48:19 [ayvens.be] INFO: Found listing with ID: 1986130
2026-03-26 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986130%27 HTTP/1.1" 200 None
2026-03-26 22:48:19 [ayvens.be] INFO: Scrape type for 1986130: 1
2026-03-26 22:48:19 [ayvens.be] INFO: Extracting data for car ID: 1986130
2026-03-26 22:48:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36b22174-318f-5ff5-ae07-aaad5522ce26 with identifier: 1986130
2026-03-26 22:48:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36b22174-318f-5ff5-ae07-aaad5522ce26 with scrape type 1
2026-03-26 22:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 36b22174-318f-5ff5-ae07-aaad5522ce26
2026-03-26 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xe%252Fd3ef690cd5dd426f87c1b03806f752af%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xe/d3ef690cd5dd426f87c1b03806f752af/images/large/1.jpg not downloaded yet
2026-03-26 22:48:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7aa0250>
2026-03-26 22:48:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c954d54d-3795-5008-8a99-2f623d405a16/c954d54d-3795-5008-8a99-2f623d405a16_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fe865581792604122b9f602c538dd2633%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/e865581792604122b9f602c538dd2633/images/large/4.jpg saved to cache
2026-03-26 22:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c954d54d-3795-5008-8a99-2f623d405a16
2026-03-26 22:48:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7496550>
2026-03-26 22:48:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c954d54d-3795-5008-8a99-2f623d405a16/c954d54d-3795-5008-8a99-2f623d405a16_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fe865581792604122b9f602c538dd2633%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/e865581792604122b9f602c538dd2633/images/large/5.jpg saved to cache
2026-03-26 22:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c954d54d-3795-5008-8a99-2f623d405a16
2026-03-26 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xe%252Fd3ef690cd5dd426f87c1b03806f752af%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xe/d3ef690cd5dd426f87c1b03806f752af/images/large/2.jpg not downloaded yet
2026-03-26 22:48:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b764b7d0>
2026-03-26 22:48:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c954d54d-3795-5008-8a99-2f623d405a16/c954d54d-3795-5008-8a99-2f623d405a16_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fe865581792604122b9f602c538dd2633%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/e865581792604122b9f602c538dd2633/images/large/6.jpg saved to cache
2026-03-26 22:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c954d54d-3795-5008-8a99-2f623d405a16
2026-03-26 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xe%252Fd3ef690cd5dd426f87c1b03806f752af%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xe/d3ef690cd5dd426f87c1b03806f752af/images/large/3.jpg not downloaded yet
2026-03-26 22:48:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wp/e9dec367b5904e7a8437ec7faf85d7ce/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c6b150>
2026-03-26 22:48:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c954d54d-3795-5008-8a99-2f623d405a16/c954d54d-3795-5008-8a99-2f623d405a16_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fe865581792604122b9f602c538dd2633%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/e865581792604122b9f602c538dd2633/images/large/9.jpg saved to cache
2026-03-26 22:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c954d54d-3795-5008-8a99-2f623d405a16
2026-03-26 22:48:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80c9869a50>
2026-03-26 22:48:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c954d54d-3795-5008-8a99-2f623d405a16/c954d54d-3795-5008-8a99-2f623d405a16_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fe865581792604122b9f602c538dd2633%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/e865581792604122b9f602c538dd2633/images/large/7.jpg saved to cache
2026-03-26 22:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c954d54d-3795-5008-8a99-2f623d405a16
2026-03-26 22:48:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77c8190>
2026-03-26 22:48:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c954d54d-3795-5008-8a99-2f623d405a16/c954d54d-3795-5008-8a99-2f623d405a16_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fe865581792604122b9f602c538dd2633%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/e865581792604122b9f602c538dd2633/images/large/8.jpg saved to cache
2026-03-26 22:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c954d54d-3795-5008-8a99-2f623d405a16
2026-03-26 22:48:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74123d0>
2026-03-26 22:48:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c954d54d-3795-5008-8a99-2f623d405a16/c954d54d-3795-5008-8a99-2f623d405a16_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fe865581792604122b9f602c538dd2633%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/e865581792604122b9f602c538dd2633/images/large/10.jpg saved to cache
2026-03-26 22:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c954d54d-3795-5008-8a99-2f623d405a16
2026-03-26 22:48:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c954d54d-3795-5008-8a99-2f623d405a16, skipping ID generation
2026-03-26 22:48:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c954d54d-3795-5008-8a99-2f623d405a16 with scrape type 1
2026-03-26 22:48:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c954d54d-3795-5008-8a99-2f623d405a16 sending to next pipeline
2026-03-26 22:48:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c954d54d-3795-5008-8a99-2f623d405a16, identifier: 1986128
2026-03-26 22:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xe%252Fd3ef690cd5dd426f87c1b03806f752af%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xe/d3ef690cd5dd426f87c1b03806f752af/images/large/4.jpg not downloaded yet
2026-03-26 22:48:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c954d54d-3795-5008-8a99-2f623d405a16 with identifier: 1986128
2026-03-26 22:48:20 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 22:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 22:48:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c954d54d-3795-5008-8a99-2f623d405a16 with identifier: 1986128
2026-03-26 22:48:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c954d54d-3795-5008-8a99-2f623d405a16 with identifier: 1986128 to the API
2026-03-26 22:48:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:48:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:48:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yh/e865581792604122b9f602c538dd2633/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 211,
 'color': 'ARTIC WHITE GLOSS',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.1L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'c954d54d-3795-5008-8a99-2f623d405a16',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'SPRINTER',
 'odometer': 220790,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c954d54d-3795-5008-8a99-2f623d405a16/c954d54d-3795-5008-8a99-2f623d405a16_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 565606,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yh/e865581792604122b9f602c538dd2633/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c954d54d-3795-5008-8a99-2f623d405a16/c954d54d-3795-5008-8a99-2f623d405a16_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 564617,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yh/e865581792604122b9f602c538dd2633/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c954d54d-3795-5008-8a99-2f623d405a16/c954d54d-3795-5008-8a99-2f623d405a16_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 584093,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yh/e865581792604122b9f602c538dd2633/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c954d54d-3795-5008-8a99-2f623d405a16/c954d54d-3795-5008-8a99-2f623d405a16_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 638610,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yh/e865581792604122b9f602c538dd2633/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c954d54d-3795-5008-8a99-2f623d405a16/c954d54d-3795-5008-8a99-2f623d405a16_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 486928,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yh/e865581792604122b9f602c538dd2633/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c954d54d-3795-5008-8a99-2f623d405a16/c954d54d-3795-5008-8a99-2f623d405a16_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 638979,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yh/e865581792604122b9f602c538dd2633/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c954d54d-3795-5008-8a99-2f623d405a16/c954d54d-3795-5008-8a99-2f623d405a16_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 540662,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yh/e865581792604122b9f602c538dd2633/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c954d54d-3795-5008-8a99-2f623d405a16/c954d54d-3795-5008-8a99-2f623d405a16_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 534008,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yh/e865581792604122b9f602c538dd2633/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c954d54d-3795-5008-8a99-2f623d405a16/c954d54d-3795-5008-8a99-2f623d405a16_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 548908,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yh/e865581792604122b9f602c538dd2633/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c954d54d-3795-5008-8a99-2f623d405a16/c954d54d-3795-5008-8a99-2f623d405a16_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 488079,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yh/e865581792604122b9f602c538dd2633/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-04',
 'seats_number': 7,
 'seller_name': None,
 'title': 'MERCEDES-BENZ SPRINTER 2.1CDI 120KW 516 L3 DC AUTO 3.5T',
 'transmission': 'automatic',
 'trim': '2.1CDI 120KW 516 L3 DC AUTO 3.5T',
 'vin': None,
 'year': 2020}
2026-03-26 22:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986128%27 HTTP/1.1" 200 None
2026-03-26 22:48:20 [ayvens.be] INFO: Saving data for 1986128: {'created_time': 1774565300.663053, 'last_price_update_time': 1774565300.663062, 'auction_closing_time': 1775028600.0}
2026-03-26 22:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986128') HTTP/1.1" 204 0
2026-03-26 22:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xe%252Fd3ef690cd5dd426f87c1b03806f752af%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xe/d3ef690cd5dd426f87c1b03806f752af/images/large/5.jpg not downloaded yet
2026-03-26 22:48:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b75a6cd0>
2026-03-26 22:48:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61d6703d-3f5e-5bb0-880a-7bf9c26dd021/61d6703d-3f5e-5bb0-880a-7bf9c26dd021_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wp%252Fe9dec367b5904e7a8437ec7faf85d7ce%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wp/e9dec367b5904e7a8437ec7faf85d7ce/images/large/1.jpg saved to cache
2026-03-26 22:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 61d6703d-3f5e-5bb0-880a-7bf9c26dd021
2026-03-26 22:48:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wp/e9dec367b5904e7a8437ec7faf85d7ce/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wp/e9dec367b5904e7a8437ec7faf85d7ce/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xe%252Fd3ef690cd5dd426f87c1b03806f752af%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xe/d3ef690cd5dd426f87c1b03806f752af/images/large/6.jpg not downloaded yet
2026-03-26 22:48:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wp/e9dec367b5904e7a8437ec7faf85d7ce/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wp/e9dec367b5904e7a8437ec7faf85d7ce/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wp/e9dec367b5904e7a8437ec7faf85d7ce/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wp/e9dec367b5904e7a8437ec7faf85d7ce/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xe%252Fd3ef690cd5dd426f87c1b03806f752af%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xe/d3ef690cd5dd426f87c1b03806f752af/images/large/7.jpg not downloaded yet
2026-03-26 22:48:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wp/e9dec367b5904e7a8437ec7faf85d7ce/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xe%252Fd3ef690cd5dd426f87c1b03806f752af%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xe/d3ef690cd5dd426f87c1b03806f752af/images/large/8.jpg not downloaded yet
2026-03-26 22:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xe%252Fd3ef690cd5dd426f87c1b03806f752af%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xe/d3ef690cd5dd426f87c1b03806f752af/images/large/9.jpg not downloaded yet
2026-03-26 22:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xe%252Fd3ef690cd5dd426f87c1b03806f752af%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xe/d3ef690cd5dd426f87c1b03806f752af/images/large/10.jpg not downloaded yet
2026-03-26 22:48:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wp/e9dec367b5904e7a8437ec7faf85d7ce/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:20 [ayvens.be] INFO: Found listing with ID: 1986131
2026-03-26 22:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986131%27 HTTP/1.1" 200 None
2026-03-26 22:48:20 [ayvens.be] INFO: Scrape type for 1986131: 1
2026-03-26 22:48:20 [ayvens.be] INFO: Extracting data for car ID: 1986131
2026-03-26 22:48:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 271890e8-17ea-5c62-a5dc-2d293ad8ffeb with identifier: 1986131
2026-03-26 22:48:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 271890e8-17ea-5c62-a5dc-2d293ad8ffeb with scrape type 1
2026-03-26 22:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 271890e8-17ea-5c62-a5dc-2d293ad8ffeb
2026-03-26 22:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1tt%252F462629a4264b4f6c90df740f1a8c9469%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1tt/462629a4264b4f6c90df740f1a8c9469/images/large/1.jpg not downloaded yet
2026-03-26 22:48:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7818350>
2026-03-26 22:48:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61d6703d-3f5e-5bb0-880a-7bf9c26dd021/61d6703d-3f5e-5bb0-880a-7bf9c26dd021_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wp%252Fe9dec367b5904e7a8437ec7faf85d7ce%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wp/e9dec367b5904e7a8437ec7faf85d7ce/images/large/4.jpg saved to cache
2026-03-26 22:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 61d6703d-3f5e-5bb0-880a-7bf9c26dd021
2026-03-26 22:48:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7429590>
2026-03-26 22:48:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61d6703d-3f5e-5bb0-880a-7bf9c26dd021/61d6703d-3f5e-5bb0-880a-7bf9c26dd021_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wp%252Fe9dec367b5904e7a8437ec7faf85d7ce%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wp/e9dec367b5904e7a8437ec7faf85d7ce/images/large/7.jpg saved to cache
2026-03-26 22:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 61d6703d-3f5e-5bb0-880a-7bf9c26dd021
2026-03-26 22:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1tt%252F462629a4264b4f6c90df740f1a8c9469%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1tt/462629a4264b4f6c90df740f1a8c9469/images/large/2.jpg not downloaded yet
2026-03-26 22:48:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77aec90>
2026-03-26 22:48:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61d6703d-3f5e-5bb0-880a-7bf9c26dd021/61d6703d-3f5e-5bb0-880a-7bf9c26dd021_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wp%252Fe9dec367b5904e7a8437ec7faf85d7ce%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wp/e9dec367b5904e7a8437ec7faf85d7ce/images/large/2.jpg saved to cache
2026-03-26 22:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 61d6703d-3f5e-5bb0-880a-7bf9c26dd021
2026-03-26 22:48:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5ca7110>
2026-03-26 22:48:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61d6703d-3f5e-5bb0-880a-7bf9c26dd021/61d6703d-3f5e-5bb0-880a-7bf9c26dd021_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wp%252Fe9dec367b5904e7a8437ec7faf85d7ce%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wp/e9dec367b5904e7a8437ec7faf85d7ce/images/large/3.jpg saved to cache
2026-03-26 22:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 61d6703d-3f5e-5bb0-880a-7bf9c26dd021
2026-03-26 22:48:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b729ca10>
2026-03-26 22:48:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61d6703d-3f5e-5bb0-880a-7bf9c26dd021/61d6703d-3f5e-5bb0-880a-7bf9c26dd021_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wp%252Fe9dec367b5904e7a8437ec7faf85d7ce%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wp/e9dec367b5904e7a8437ec7faf85d7ce/images/large/5.jpg saved to cache
2026-03-26 22:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 61d6703d-3f5e-5bb0-880a-7bf9c26dd021
2026-03-26 22:48:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76c7490>
2026-03-26 22:48:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61d6703d-3f5e-5bb0-880a-7bf9c26dd021/61d6703d-3f5e-5bb0-880a-7bf9c26dd021_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wp%252Fe9dec367b5904e7a8437ec7faf85d7ce%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wp/e9dec367b5904e7a8437ec7faf85d7ce/images/large/6.jpg saved to cache
2026-03-26 22:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 61d6703d-3f5e-5bb0-880a-7bf9c26dd021
2026-03-26 22:48:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7590d90>
2026-03-26 22:48:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61d6703d-3f5e-5bb0-880a-7bf9c26dd021/61d6703d-3f5e-5bb0-880a-7bf9c26dd021_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wp%252Fe9dec367b5904e7a8437ec7faf85d7ce%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wp/e9dec367b5904e7a8437ec7faf85d7ce/images/large/8.jpg saved to cache
2026-03-26 22:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 61d6703d-3f5e-5bb0-880a-7bf9c26dd021
2026-03-26 22:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1tt%252F462629a4264b4f6c90df740f1a8c9469%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1tt/462629a4264b4f6c90df740f1a8c9469/images/large/3.jpg not downloaded yet
2026-03-26 22:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1tt%252F462629a4264b4f6c90df740f1a8c9469%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1tt/462629a4264b4f6c90df740f1a8c9469/images/large/4.jpg not downloaded yet
2026-03-26 22:48:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7442b10>
2026-03-26 22:48:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61d6703d-3f5e-5bb0-880a-7bf9c26dd021/61d6703d-3f5e-5bb0-880a-7bf9c26dd021_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wp%252Fe9dec367b5904e7a8437ec7faf85d7ce%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wp/e9dec367b5904e7a8437ec7faf85d7ce/images/large/9.jpg saved to cache
2026-03-26 22:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 61d6703d-3f5e-5bb0-880a-7bf9c26dd021
2026-03-26 22:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1tt%252F462629a4264b4f6c90df740f1a8c9469%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1tt/462629a4264b4f6c90df740f1a8c9469/images/large/5.jpg not downloaded yet
2026-03-26 22:48:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xe/d3ef690cd5dd426f87c1b03806f752af/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xe/d3ef690cd5dd426f87c1b03806f752af/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1tt%252F462629a4264b4f6c90df740f1a8c9469%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1tt/462629a4264b4f6c90df740f1a8c9469/images/large/6.jpg not downloaded yet
2026-03-26 22:48:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xe/d3ef690cd5dd426f87c1b03806f752af/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xe/d3ef690cd5dd426f87c1b03806f752af/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xe/d3ef690cd5dd426f87c1b03806f752af/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1tt%252F462629a4264b4f6c90df740f1a8c9469%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1tt/462629a4264b4f6c90df740f1a8c9469/images/large/7.jpg not downloaded yet
2026-03-26 22:48:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wp/e9dec367b5904e7a8437ec7faf85d7ce/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xe/d3ef690cd5dd426f87c1b03806f752af/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xe/d3ef690cd5dd426f87c1b03806f752af/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1tt%252F462629a4264b4f6c90df740f1a8c9469%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1tt/462629a4264b4f6c90df740f1a8c9469/images/large/8.jpg not downloaded yet
2026-03-26 22:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1tt%252F462629a4264b4f6c90df740f1a8c9469%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1tt/462629a4264b4f6c90df740f1a8c9469/images/large/9.jpg not downloaded yet
2026-03-26 22:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1tt%252F462629a4264b4f6c90df740f1a8c9469%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1tt/462629a4264b4f6c90df740f1a8c9469/images/large/10.jpg not downloaded yet
2026-03-26 22:48:21 [ayvens.be] INFO: Found listing with ID: 1986132
2026-03-26 22:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986132%27 HTTP/1.1" 200 None
2026-03-26 22:48:21 [ayvens.be] INFO: Scrape type for 1986132: 1
2026-03-26 22:48:21 [ayvens.be] INFO: Extracting data for car ID: 1986132
2026-03-26 22:48:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb8dcd5c-2ea5-528d-ab64-790d668bac9b with identifier: 1986132
2026-03-26 22:48:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb8dcd5c-2ea5-528d-ab64-790d668bac9b with scrape type 1
2026-03-26 22:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item eb8dcd5c-2ea5-528d-ab64-790d668bac9b
2026-03-26 22:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fcbd98fd642194fd58338497fea8f9875%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/cbd98fd642194fd58338497fea8f9875/images/large/1.jpg not downloaded yet
2026-03-26 22:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fcbd98fd642194fd58338497fea8f9875%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/cbd98fd642194fd58338497fea8f9875/images/large/2.jpg not downloaded yet
2026-03-26 22:48:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c74050>
2026-03-26 22:48:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36b22174-318f-5ff5-ae07-aaad5522ce26/36b22174-318f-5ff5-ae07-aaad5522ce26_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xe%252Fd3ef690cd5dd426f87c1b03806f752af%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xe/d3ef690cd5dd426f87c1b03806f752af/images/large/3.jpg saved to cache
2026-03-26 22:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 36b22174-318f-5ff5-ae07-aaad5522ce26
2026-03-26 22:48:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b777a850>
2026-03-26 22:48:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36b22174-318f-5ff5-ae07-aaad5522ce26/36b22174-318f-5ff5-ae07-aaad5522ce26_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xe%252Fd3ef690cd5dd426f87c1b03806f752af%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xe/d3ef690cd5dd426f87c1b03806f752af/images/large/2.jpg saved to cache
2026-03-26 22:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 36b22174-318f-5ff5-ae07-aaad5522ce26
2026-03-26 22:48:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7278910>
2026-03-26 22:48:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36b22174-318f-5ff5-ae07-aaad5522ce26/36b22174-318f-5ff5-ae07-aaad5522ce26_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xe%252Fd3ef690cd5dd426f87c1b03806f752af%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xe/d3ef690cd5dd426f87c1b03806f752af/images/large/1.jpg saved to cache
2026-03-26 22:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 36b22174-318f-5ff5-ae07-aaad5522ce26
2026-03-26 22:48:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7585850>
2026-03-26 22:48:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36b22174-318f-5ff5-ae07-aaad5522ce26/36b22174-318f-5ff5-ae07-aaad5522ce26_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xe%252Fd3ef690cd5dd426f87c1b03806f752af%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xe/d3ef690cd5dd426f87c1b03806f752af/images/large/5.jpg saved to cache
2026-03-26 22:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 36b22174-318f-5ff5-ae07-aaad5522ce26
2026-03-26 22:48:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b727a8d0>
2026-03-26 22:48:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36b22174-318f-5ff5-ae07-aaad5522ce26/36b22174-318f-5ff5-ae07-aaad5522ce26_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xe%252Fd3ef690cd5dd426f87c1b03806f752af%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xe/d3ef690cd5dd426f87c1b03806f752af/images/large/6.jpg saved to cache
2026-03-26 22:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 36b22174-318f-5ff5-ae07-aaad5522ce26
2026-03-26 22:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fcbd98fd642194fd58338497fea8f9875%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/cbd98fd642194fd58338497fea8f9875/images/large/3.jpg not downloaded yet
2026-03-26 22:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fcbd98fd642194fd58338497fea8f9875%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/cbd98fd642194fd58338497fea8f9875/images/large/4.jpg not downloaded yet
2026-03-26 22:48:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79cd550>
2026-03-26 22:48:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61d6703d-3f5e-5bb0-880a-7bf9c26dd021/61d6703d-3f5e-5bb0-880a-7bf9c26dd021_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wp%252Fe9dec367b5904e7a8437ec7faf85d7ce%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wp/e9dec367b5904e7a8437ec7faf85d7ce/images/large/10.jpg saved to cache
2026-03-26 22:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 61d6703d-3f5e-5bb0-880a-7bf9c26dd021
2026-03-26 22:48:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 61d6703d-3f5e-5bb0-880a-7bf9c26dd021, skipping ID generation
2026-03-26 22:48:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61d6703d-3f5e-5bb0-880a-7bf9c26dd021 with scrape type 1
2026-03-26 22:48:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 61d6703d-3f5e-5bb0-880a-7bf9c26dd021 sending to next pipeline
2026-03-26 22:48:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 61d6703d-3f5e-5bb0-880a-7bf9c26dd021, identifier: 1986129
2026-03-26 22:48:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd9a83d0>
2026-03-26 22:48:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36b22174-318f-5ff5-ae07-aaad5522ce26/36b22174-318f-5ff5-ae07-aaad5522ce26_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xe%252Fd3ef690cd5dd426f87c1b03806f752af%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xe/d3ef690cd5dd426f87c1b03806f752af/images/large/4.jpg saved to cache
2026-03-26 22:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 36b22174-318f-5ff5-ae07-aaad5522ce26
2026-03-26 22:48:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e37250>
2026-03-26 22:48:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36b22174-318f-5ff5-ae07-aaad5522ce26/36b22174-318f-5ff5-ae07-aaad5522ce26_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xe%252Fd3ef690cd5dd426f87c1b03806f752af%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xe/d3ef690cd5dd426f87c1b03806f752af/images/large/7.jpg saved to cache
2026-03-26 22:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 36b22174-318f-5ff5-ae07-aaad5522ce26
2026-03-26 22:48:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 61d6703d-3f5e-5bb0-880a-7bf9c26dd021 with identifier: 1986129
2026-03-26 22:48:23 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 22:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 22:48:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 61d6703d-3f5e-5bb0-880a-7bf9c26dd021 with identifier: 1986129
2026-03-26 22:48:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 61d6703d-3f5e-5bb0-880a-7bf9c26dd021 with identifier: 1986129 to the API
2026-03-26 22:48:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:48:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:48:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1wp/e9dec367b5904e7a8437ec7faf85d7ce/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 189,
 'color': 'BLANC',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.3L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '61d6703d-3f5e-5bb0-880a-7bf9c26dd021',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'MASTER 35 LWB DSL - 2014',
 'odometer': 78351,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61d6703d-3f5e-5bb0-880a-7bf9c26dd021/61d6703d-3f5e-5bb0-880a-7bf9c26dd021_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 599810,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wp/e9dec367b5904e7a8437ec7faf85d7ce/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61d6703d-3f5e-5bb0-880a-7bf9c26dd021/61d6703d-3f5e-5bb0-880a-7bf9c26dd021_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 616540,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wp/e9dec367b5904e7a8437ec7faf85d7ce/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61d6703d-3f5e-5bb0-880a-7bf9c26dd021/61d6703d-3f5e-5bb0-880a-7bf9c26dd021_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 644211,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wp/e9dec367b5904e7a8437ec7faf85d7ce/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61d6703d-3f5e-5bb0-880a-7bf9c26dd021/61d6703d-3f5e-5bb0-880a-7bf9c26dd021_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 653437,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wp/e9dec367b5904e7a8437ec7faf85d7ce/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61d6703d-3f5e-5bb0-880a-7bf9c26dd021/61d6703d-3f5e-5bb0-880a-7bf9c26dd021_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 657107,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wp/e9dec367b5904e7a8437ec7faf85d7ce/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61d6703d-3f5e-5bb0-880a-7bf9c26dd021/61d6703d-3f5e-5bb0-880a-7bf9c26dd021_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 710089,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wp/e9dec367b5904e7a8437ec7faf85d7ce/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61d6703d-3f5e-5bb0-880a-7bf9c26dd021/61d6703d-3f5e-5bb0-880a-7bf9c26dd021_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 582949,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wp/e9dec367b5904e7a8437ec7faf85d7ce/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61d6703d-3f5e-5bb0-880a-7bf9c26dd021/61d6703d-3f5e-5bb0-880a-7bf9c26dd021_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 743821,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wp/e9dec367b5904e7a8437ec7faf85d7ce/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61d6703d-3f5e-5bb0-880a-7bf9c26dd021/61d6703d-3f5e-5bb0-880a-7bf9c26dd021_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 813072,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wp/e9dec367b5904e7a8437ec7faf85d7ce/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61d6703d-3f5e-5bb0-880a-7bf9c26dd021/61d6703d-3f5e-5bb0-880a-7bf9c26dd021_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 767764,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wp/e9dec367b5904e7a8437ec7faf85d7ce/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-30',
 'seats_number': 7,
 'seller_name': None,
 'title': 'RENAULT MASTER 35 LWB DSL - 2014 2.3 dCi 35 L3H1 Energy Twin Turbo '
          'STOCK',
 'transmission': 'manual',
 'trim': '2.3 dCi 35 L3H1 Energy Twin Turbo STOCK',
 'vin': None,
 'year': 2019}
2026-03-26 22:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986129%27 HTTP/1.1" 200 None
2026-03-26 22:48:23 [ayvens.be] INFO: Saving data for 1986129: {'created_time': 1774565303.422766, 'last_price_update_time': 1774565303.422777, 'auction_closing_time': 1775028600.0}
2026-03-26 22:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986129') HTTP/1.1" 204 0
2026-03-26 22:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fcbd98fd642194fd58338497fea8f9875%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/cbd98fd642194fd58338497fea8f9875/images/large/5.jpg not downloaded yet
2026-03-26 22:48:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1tt/462629a4264b4f6c90df740f1a8c9469/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1tt/462629a4264b4f6c90df740f1a8c9469/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fcbd98fd642194fd58338497fea8f9875%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/cbd98fd642194fd58338497fea8f9875/images/large/6.jpg not downloaded yet
2026-03-26 22:48:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1tt/462629a4264b4f6c90df740f1a8c9469/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1tt/462629a4264b4f6c90df740f1a8c9469/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1tt/462629a4264b4f6c90df740f1a8c9469/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fcbd98fd642194fd58338497fea8f9875%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/cbd98fd642194fd58338497fea8f9875/images/large/7.jpg not downloaded yet
2026-03-26 22:48:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xe/d3ef690cd5dd426f87c1b03806f752af/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fcbd98fd642194fd58338497fea8f9875%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/cbd98fd642194fd58338497fea8f9875/images/large/8.jpg not downloaded yet
2026-03-26 22:48:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xe/d3ef690cd5dd426f87c1b03806f752af/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xe/d3ef690cd5dd426f87c1b03806f752af/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fcbd98fd642194fd58338497fea8f9875%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/cbd98fd642194fd58338497fea8f9875/images/large/9.jpg not downloaded yet
2026-03-26 22:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fcbd98fd642194fd58338497fea8f9875%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/cbd98fd642194fd58338497fea8f9875/images/large/10.jpg not downloaded yet
2026-03-26 22:48:23 [ayvens.be] INFO: Found listing with ID: 1986133
2026-03-26 22:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986133%27 HTTP/1.1" 200 None
2026-03-26 22:48:23 [ayvens.be] INFO: Scrape type for 1986133: 1
2026-03-26 22:48:23 [ayvens.be] INFO: Extracting data for car ID: 1986133
2026-03-26 22:48:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e533decd-6a4b-5ad4-9de8-abc906ee4a8a with identifier: 1986133
2026-03-26 22:48:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e533decd-6a4b-5ad4-9de8-abc906ee4a8a with scrape type 1
2026-03-26 22:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e533decd-6a4b-5ad4-9de8-abc906ee4a8a
2026-03-26 22:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F611f76604b33404a830343985c612bcd%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/611f76604b33404a830343985c612bcd/images/large/1.jpg not downloaded yet
2026-03-26 22:48:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7429790>
2026-03-26 22:48:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_271890e8-17ea-5c62-a5dc-2d293ad8ffeb/271890e8-17ea-5c62-a5dc-2d293ad8ffeb_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1tt%252F462629a4264b4f6c90df740f1a8c9469%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1tt/462629a4264b4f6c90df740f1a8c9469/images/large/1.jpg saved to cache
2026-03-26 22:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 271890e8-17ea-5c62-a5dc-2d293ad8ffeb
2026-03-26 22:48:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74a7890>
2026-03-26 22:48:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_271890e8-17ea-5c62-a5dc-2d293ad8ffeb/271890e8-17ea-5c62-a5dc-2d293ad8ffeb_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1tt%252F462629a4264b4f6c90df740f1a8c9469%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1tt/462629a4264b4f6c90df740f1a8c9469/images/large/2.jpg saved to cache
2026-03-26 22:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 271890e8-17ea-5c62-a5dc-2d293ad8ffeb
2026-03-26 22:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F611f76604b33404a830343985c612bcd%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/611f76604b33404a830343985c612bcd/images/large/2.jpg not downloaded yet
2026-03-26 22:48:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b727e1d0>
2026-03-26 22:48:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_271890e8-17ea-5c62-a5dc-2d293ad8ffeb/271890e8-17ea-5c62-a5dc-2d293ad8ffeb_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1tt%252F462629a4264b4f6c90df740f1a8c9469%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1tt/462629a4264b4f6c90df740f1a8c9469/images/large/3.jpg saved to cache
2026-03-26 22:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 271890e8-17ea-5c62-a5dc-2d293ad8ffeb
2026-03-26 22:48:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7592750>
2026-03-26 22:48:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_271890e8-17ea-5c62-a5dc-2d293ad8ffeb/271890e8-17ea-5c62-a5dc-2d293ad8ffeb_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1tt%252F462629a4264b4f6c90df740f1a8c9469%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1tt/462629a4264b4f6c90df740f1a8c9469/images/large/4.jpg saved to cache
2026-03-26 22:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 271890e8-17ea-5c62-a5dc-2d293ad8ffeb
2026-03-26 22:48:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7269bd0>
2026-03-26 22:48:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_271890e8-17ea-5c62-a5dc-2d293ad8ffeb/271890e8-17ea-5c62-a5dc-2d293ad8ffeb_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1tt%252F462629a4264b4f6c90df740f1a8c9469%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1tt/462629a4264b4f6c90df740f1a8c9469/images/large/5.jpg saved to cache
2026-03-26 22:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 271890e8-17ea-5c62-a5dc-2d293ad8ffeb
2026-03-26 22:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F611f76604b33404a830343985c612bcd%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/611f76604b33404a830343985c612bcd/images/large/3.jpg not downloaded yet
2026-03-26 22:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F611f76604b33404a830343985c612bcd%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/611f76604b33404a830343985c612bcd/images/large/4.jpg not downloaded yet
2026-03-26 22:48:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74aefd0>
2026-03-26 22:48:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36b22174-318f-5ff5-ae07-aaad5522ce26/36b22174-318f-5ff5-ae07-aaad5522ce26_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xe%252Fd3ef690cd5dd426f87c1b03806f752af%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xe/d3ef690cd5dd426f87c1b03806f752af/images/large/9.jpg saved to cache
2026-03-26 22:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 36b22174-318f-5ff5-ae07-aaad5522ce26
2026-03-26 22:48:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c6a7d0>
2026-03-26 22:48:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36b22174-318f-5ff5-ae07-aaad5522ce26/36b22174-318f-5ff5-ae07-aaad5522ce26_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xe%252Fd3ef690cd5dd426f87c1b03806f752af%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xe/d3ef690cd5dd426f87c1b03806f752af/images/large/10.jpg saved to cache
2026-03-26 22:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 36b22174-318f-5ff5-ae07-aaad5522ce26
2026-03-26 22:48:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b78778d0>
2026-03-26 22:48:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36b22174-318f-5ff5-ae07-aaad5522ce26/36b22174-318f-5ff5-ae07-aaad5522ce26_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xe%252Fd3ef690cd5dd426f87c1b03806f752af%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xe/d3ef690cd5dd426f87c1b03806f752af/images/large/8.jpg saved to cache
2026-03-26 22:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 36b22174-318f-5ff5-ae07-aaad5522ce26
2026-03-26 22:48:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 36b22174-318f-5ff5-ae07-aaad5522ce26, skipping ID generation
2026-03-26 22:48:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36b22174-318f-5ff5-ae07-aaad5522ce26 with scrape type 1
2026-03-26 22:48:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 36b22174-318f-5ff5-ae07-aaad5522ce26 sending to next pipeline
2026-03-26 22:48:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 36b22174-318f-5ff5-ae07-aaad5522ce26, identifier: 1986130
2026-03-26 22:48:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 36b22174-318f-5ff5-ae07-aaad5522ce26 with identifier: 1986130
2026-03-26 22:48:24 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 22:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 22:48:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 36b22174-318f-5ff5-ae07-aaad5522ce26 with identifier: 1986130
2026-03-26 22:48:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 36b22174-318f-5ff5-ae07-aaad5522ce26 with identifier: 1986130 to the API
2026-03-26 22:48:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:48:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:48:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1xe/d3ef690cd5dd426f87c1b03806f752af/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 43,
 'color': 'SAVILE GREY',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '36b22174-318f-5ff5-ae07-aaad5522ce26',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'V90 - 2016',
 'odometer': 123931,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36b22174-318f-5ff5-ae07-aaad5522ce26/36b22174-318f-5ff5-ae07-aaad5522ce26_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 696616,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xe/d3ef690cd5dd426f87c1b03806f752af/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36b22174-318f-5ff5-ae07-aaad5522ce26/36b22174-318f-5ff5-ae07-aaad5522ce26_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 681435,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xe/d3ef690cd5dd426f87c1b03806f752af/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36b22174-318f-5ff5-ae07-aaad5522ce26/36b22174-318f-5ff5-ae07-aaad5522ce26_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 707794,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xe/d3ef690cd5dd426f87c1b03806f752af/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36b22174-318f-5ff5-ae07-aaad5522ce26/36b22174-318f-5ff5-ae07-aaad5522ce26_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 721394,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xe/d3ef690cd5dd426f87c1b03806f752af/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36b22174-318f-5ff5-ae07-aaad5522ce26/36b22174-318f-5ff5-ae07-aaad5522ce26_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 720351,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xe/d3ef690cd5dd426f87c1b03806f752af/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36b22174-318f-5ff5-ae07-aaad5522ce26/36b22174-318f-5ff5-ae07-aaad5522ce26_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 654519,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xe/d3ef690cd5dd426f87c1b03806f752af/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36b22174-318f-5ff5-ae07-aaad5522ce26/36b22174-318f-5ff5-ae07-aaad5522ce26_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 632137,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xe/d3ef690cd5dd426f87c1b03806f752af/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36b22174-318f-5ff5-ae07-aaad5522ce26/36b22174-318f-5ff5-ae07-aaad5522ce26_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 881429,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xe/d3ef690cd5dd426f87c1b03806f752af/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36b22174-318f-5ff5-ae07-aaad5522ce26/36b22174-318f-5ff5-ae07-aaad5522ce26_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 867167,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xe/d3ef690cd5dd426f87c1b03806f752af/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36b22174-318f-5ff5-ae07-aaad5522ce26/36b22174-318f-5ff5-ae07-aaad5522ce26_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 896866,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xe/d3ef690cd5dd426f87c1b03806f752af/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO V90 - 2016 2.0 T8 TE AWD PHEV Inscrip. Ge.(EU6d-T.) STOCK',
 'transmission': 'automatic',
 'trim': '2.0 T8 TE AWD PHEV Inscrip. Ge.(EU6d-T.) STOCK',
 'vin': None,
 'year': 2019}
2026-03-26 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986130%27 HTTP/1.1" 200 None
2026-03-26 22:48:25 [ayvens.be] INFO: Saving data for 1986130: {'created_time': 1774565305.053076, 'last_price_update_time': 1774565305.053088, 'auction_closing_time': 1775028600.0}
2026-03-26 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986130') HTTP/1.1" 204 0
2026-03-26 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F611f76604b33404a830343985c612bcd%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/611f76604b33404a830343985c612bcd/images/large/5.jpg not downloaded yet
2026-03-26 22:48:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/cbd98fd642194fd58338497fea8f9875/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1tt/462629a4264b4f6c90df740f1a8c9469/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/cbd98fd642194fd58338497fea8f9875/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F611f76604b33404a830343985c612bcd%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/611f76604b33404a830343985c612bcd/images/large/6.jpg not downloaded yet
2026-03-26 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F611f76604b33404a830343985c612bcd%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/611f76604b33404a830343985c612bcd/images/large/7.jpg not downloaded yet
2026-03-26 22:48:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1tt/462629a4264b4f6c90df740f1a8c9469/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/cbd98fd642194fd58338497fea8f9875/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F611f76604b33404a830343985c612bcd%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/611f76604b33404a830343985c612bcd/images/large/8.jpg not downloaded yet
2026-03-26 22:48:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1tt/462629a4264b4f6c90df740f1a8c9469/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1tt/462629a4264b4f6c90df740f1a8c9469/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1tt/462629a4264b4f6c90df740f1a8c9469/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F611f76604b33404a830343985c612bcd%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/611f76604b33404a830343985c612bcd/images/large/9.jpg not downloaded yet
2026-03-26 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F611f76604b33404a830343985c612bcd%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/611f76604b33404a830343985c612bcd/images/large/10.jpg not downloaded yet
2026-03-26 22:48:25 [ayvens.be] INFO: Found listing with ID: 1986134
2026-03-26 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986134%27 HTTP/1.1" 200 None
2026-03-26 22:48:25 [ayvens.be] INFO: Scrape type for 1986134: 1
2026-03-26 22:48:25 [ayvens.be] INFO: Extracting data for car ID: 1986134
2026-03-26 22:48:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ddff47d6-5050-544d-ad30-948e8dfbc96a with identifier: 1986134
2026-03-26 22:48:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ddff47d6-5050-544d-ad30-948e8dfbc96a with scrape type 1
2026-03-26 22:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ddff47d6-5050-544d-ad30-948e8dfbc96a
2026-03-26 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252Fa5c038273a7246ba90cd96a477fe03a1%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/a5c038273a7246ba90cd96a477fe03a1/images/large/1.jpg not downloaded yet
2026-03-26 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252Fa5c038273a7246ba90cd96a477fe03a1%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/a5c038273a7246ba90cd96a477fe03a1/images/large/2.jpg not downloaded yet
2026-03-26 22:48:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b748b4d0>
2026-03-26 22:48:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb8dcd5c-2ea5-528d-ab64-790d668bac9b/eb8dcd5c-2ea5-528d-ab64-790d668bac9b_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fcbd98fd642194fd58338497fea8f9875%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/cbd98fd642194fd58338497fea8f9875/images/large/3.jpg saved to cache
2026-03-26 22:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item eb8dcd5c-2ea5-528d-ab64-790d668bac9b
2026-03-26 22:48:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6d833d0>
2026-03-26 22:48:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_271890e8-17ea-5c62-a5dc-2d293ad8ffeb/271890e8-17ea-5c62-a5dc-2d293ad8ffeb_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1tt%252F462629a4264b4f6c90df740f1a8c9469%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1tt/462629a4264b4f6c90df740f1a8c9469/images/large/7.jpg saved to cache
2026-03-26 22:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 271890e8-17ea-5c62-a5dc-2d293ad8ffeb
2026-03-26 22:48:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76c4410>
2026-03-26 22:48:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb8dcd5c-2ea5-528d-ab64-790d668bac9b/eb8dcd5c-2ea5-528d-ab64-790d668bac9b_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fcbd98fd642194fd58338497fea8f9875%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/cbd98fd642194fd58338497fea8f9875/images/large/2.jpg saved to cache
2026-03-26 22:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item eb8dcd5c-2ea5-528d-ab64-790d668bac9b
2026-03-26 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252Fa5c038273a7246ba90cd96a477fe03a1%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/a5c038273a7246ba90cd96a477fe03a1/images/large/3.jpg not downloaded yet
2026-03-26 22:48:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b741f690>
2026-03-26 22:48:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_271890e8-17ea-5c62-a5dc-2d293ad8ffeb/271890e8-17ea-5c62-a5dc-2d293ad8ffeb_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1tt%252F462629a4264b4f6c90df740f1a8c9469%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1tt/462629a4264b4f6c90df740f1a8c9469/images/large/6.jpg saved to cache
2026-03-26 22:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 271890e8-17ea-5c62-a5dc-2d293ad8ffeb
2026-03-26 22:48:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e475d0>
2026-03-26 22:48:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb8dcd5c-2ea5-528d-ab64-790d668bac9b/eb8dcd5c-2ea5-528d-ab64-790d668bac9b_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fcbd98fd642194fd58338497fea8f9875%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/cbd98fd642194fd58338497fea8f9875/images/large/1.jpg saved to cache
2026-03-26 22:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item eb8dcd5c-2ea5-528d-ab64-790d668bac9b
2026-03-26 22:48:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/cbd98fd642194fd58338497fea8f9875/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252Fa5c038273a7246ba90cd96a477fe03a1%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/a5c038273a7246ba90cd96a477fe03a1/images/large/4.jpg not downloaded yet
2026-03-26 22:48:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/cbd98fd642194fd58338497fea8f9875/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/cbd98fd642194fd58338497fea8f9875/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252Fa5c038273a7246ba90cd96a477fe03a1%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/a5c038273a7246ba90cd96a477fe03a1/images/large/5.jpg not downloaded yet
2026-03-26 22:48:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74383d0>
2026-03-26 22:48:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_271890e8-17ea-5c62-a5dc-2d293ad8ffeb/271890e8-17ea-5c62-a5dc-2d293ad8ffeb_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1tt%252F462629a4264b4f6c90df740f1a8c9469%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1tt/462629a4264b4f6c90df740f1a8c9469/images/large/10.jpg saved to cache
2026-03-26 22:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 271890e8-17ea-5c62-a5dc-2d293ad8ffeb
2026-03-26 22:48:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b782c210>
2026-03-26 22:48:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_271890e8-17ea-5c62-a5dc-2d293ad8ffeb/271890e8-17ea-5c62-a5dc-2d293ad8ffeb_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1tt%252F462629a4264b4f6c90df740f1a8c9469%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1tt/462629a4264b4f6c90df740f1a8c9469/images/large/8.jpg saved to cache
2026-03-26 22:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 271890e8-17ea-5c62-a5dc-2d293ad8ffeb
2026-03-26 22:48:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c5cb50>
2026-03-26 22:48:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_271890e8-17ea-5c62-a5dc-2d293ad8ffeb/271890e8-17ea-5c62-a5dc-2d293ad8ffeb_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1tt%252F462629a4264b4f6c90df740f1a8c9469%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1tt/462629a4264b4f6c90df740f1a8c9469/images/large/9.jpg saved to cache
2026-03-26 22:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 271890e8-17ea-5c62-a5dc-2d293ad8ffeb
2026-03-26 22:48:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 271890e8-17ea-5c62-a5dc-2d293ad8ffeb, skipping ID generation
2026-03-26 22:48:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 271890e8-17ea-5c62-a5dc-2d293ad8ffeb with scrape type 1
2026-03-26 22:48:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 271890e8-17ea-5c62-a5dc-2d293ad8ffeb sending to next pipeline
2026-03-26 22:48:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 271890e8-17ea-5c62-a5dc-2d293ad8ffeb, identifier: 1986131
2026-03-26 22:48:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/cbd98fd642194fd58338497fea8f9875/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 271890e8-17ea-5c62-a5dc-2d293ad8ffeb with identifier: 1986131
2026-03-26 22:48:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 271890e8-17ea-5c62-a5dc-2d293ad8ffeb with identifier: 1986131
2026-03-26 22:48:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 271890e8-17ea-5c62-a5dc-2d293ad8ffeb with identifier: 1986131 to the API
2026-03-26 22:48:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:48:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:48:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1tt/462629a4264b4f6c90df740f1a8c9469/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.8L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '271890e8-17ea-5c62-a5dc-2d293ad8ffeb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'LAND CRUISER LWB DIESEL - 2013',
 'odometer': 195815,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_271890e8-17ea-5c62-a5dc-2d293ad8ffeb/271890e8-17ea-5c62-a5dc-2d293ad8ffeb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 591951,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1tt/462629a4264b4f6c90df740f1a8c9469/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_271890e8-17ea-5c62-a5dc-2d293ad8ffeb/271890e8-17ea-5c62-a5dc-2d293ad8ffeb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 589875,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1tt/462629a4264b4f6c90df740f1a8c9469/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_271890e8-17ea-5c62-a5dc-2d293ad8ffeb/271890e8-17ea-5c62-a5dc-2d293ad8ffeb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 604587,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1tt/462629a4264b4f6c90df740f1a8c9469/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_271890e8-17ea-5c62-a5dc-2d293ad8ffeb/271890e8-17ea-5c62-a5dc-2d293ad8ffeb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 602545,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1tt/462629a4264b4f6c90df740f1a8c9469/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_271890e8-17ea-5c62-a5dc-2d293ad8ffeb/271890e8-17ea-5c62-a5dc-2d293ad8ffeb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 595208,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1tt/462629a4264b4f6c90df740f1a8c9469/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_271890e8-17ea-5c62-a5dc-2d293ad8ffeb/271890e8-17ea-5c62-a5dc-2d293ad8ffeb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 726149,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1tt/462629a4264b4f6c90df740f1a8c9469/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_271890e8-17ea-5c62-a5dc-2d293ad8ffeb/271890e8-17ea-5c62-a5dc-2d293ad8ffeb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 556862,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1tt/462629a4264b4f6c90df740f1a8c9469/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_271890e8-17ea-5c62-a5dc-2d293ad8ffeb/271890e8-17ea-5c62-a5dc-2d293ad8ffeb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 913211,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1tt/462629a4264b4f6c90df740f1a8c9469/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_271890e8-17ea-5c62-a5dc-2d293ad8ffeb/271890e8-17ea-5c62-a5dc-2d293ad8ffeb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 880031,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1tt/462629a4264b4f6c90df740f1a8c9469/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_271890e8-17ea-5c62-a5dc-2d293ad8ffeb/271890e8-17ea-5c62-a5dc-2d293ad8ffeb_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 848832,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1tt/462629a4264b4f6c90df740f1a8c9469/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA LAND CRUISER LWB DIESEL - 2013 2.8 D-4D Active Van',
 'transmission': 'manual',
 'trim': '2.8 D-4D Active Van',
 'vin': None,
 'year': 2018}
2026-03-26 22:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986131%27 HTTP/1.1" 200 None
2026-03-26 22:48:26 [ayvens.be] INFO: Saving data for 1986131: {'created_time': 1774565306.517604, 'last_price_update_time': 1774565306.517616, 'auction_closing_time': 1775028600.0}
2026-03-26 22:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986131') HTTP/1.1" 204 0
2026-03-26 22:48:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/cbd98fd642194fd58338497fea8f9875/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/cbd98fd642194fd58338497fea8f9875/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252Fa5c038273a7246ba90cd96a477fe03a1%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/a5c038273a7246ba90cd96a477fe03a1/images/large/6.jpg not downloaded yet
2026-03-26 22:48:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/611f76604b33404a830343985c612bcd/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252Fa5c038273a7246ba90cd96a477fe03a1%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/a5c038273a7246ba90cd96a477fe03a1/images/large/7.jpg not downloaded yet
2026-03-26 22:48:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cbc610>
2026-03-26 22:48:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb8dcd5c-2ea5-528d-ab64-790d668bac9b/eb8dcd5c-2ea5-528d-ab64-790d668bac9b_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fcbd98fd642194fd58338497fea8f9875%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/cbd98fd642194fd58338497fea8f9875/images/large/7.jpg saved to cache
2026-03-26 22:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item eb8dcd5c-2ea5-528d-ab64-790d668bac9b
2026-03-26 22:48:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7407c90>
2026-03-26 22:48:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb8dcd5c-2ea5-528d-ab64-790d668bac9b/eb8dcd5c-2ea5-528d-ab64-790d668bac9b_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fcbd98fd642194fd58338497fea8f9875%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/cbd98fd642194fd58338497fea8f9875/images/large/4.jpg saved to cache
2026-03-26 22:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item eb8dcd5c-2ea5-528d-ab64-790d668bac9b
2026-03-26 22:48:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74ac890>
2026-03-26 22:48:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb8dcd5c-2ea5-528d-ab64-790d668bac9b/eb8dcd5c-2ea5-528d-ab64-790d668bac9b_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fcbd98fd642194fd58338497fea8f9875%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/cbd98fd642194fd58338497fea8f9875/images/large/5.jpg saved to cache
2026-03-26 22:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item eb8dcd5c-2ea5-528d-ab64-790d668bac9b
2026-03-26 22:48:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76481d0>
2026-03-26 22:48:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb8dcd5c-2ea5-528d-ab64-790d668bac9b/eb8dcd5c-2ea5-528d-ab64-790d668bac9b_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fcbd98fd642194fd58338497fea8f9875%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/cbd98fd642194fd58338497fea8f9875/images/large/6.jpg saved to cache
2026-03-26 22:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item eb8dcd5c-2ea5-528d-ab64-790d668bac9b
2026-03-26 22:48:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/611f76604b33404a830343985c612bcd/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252Fa5c038273a7246ba90cd96a477fe03a1%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/a5c038273a7246ba90cd96a477fe03a1/images/large/8.jpg not downloaded yet
2026-03-26 22:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252Fa5c038273a7246ba90cd96a477fe03a1%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/a5c038273a7246ba90cd96a477fe03a1/images/large/9.jpg not downloaded yet
2026-03-26 22:48:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7725910>
2026-03-26 22:48:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb8dcd5c-2ea5-528d-ab64-790d668bac9b/eb8dcd5c-2ea5-528d-ab64-790d668bac9b_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fcbd98fd642194fd58338497fea8f9875%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/cbd98fd642194fd58338497fea8f9875/images/large/9.jpg saved to cache
2026-03-26 22:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item eb8dcd5c-2ea5-528d-ab64-790d668bac9b
2026-03-26 22:48:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76a7f50>
2026-03-26 22:48:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb8dcd5c-2ea5-528d-ab64-790d668bac9b/eb8dcd5c-2ea5-528d-ab64-790d668bac9b_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fcbd98fd642194fd58338497fea8f9875%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/cbd98fd642194fd58338497fea8f9875/images/large/10.jpg saved to cache
2026-03-26 22:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item eb8dcd5c-2ea5-528d-ab64-790d668bac9b
2026-03-26 22:48:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74bfcd0>
2026-03-26 22:48:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e533decd-6a4b-5ad4-9de8-abc906ee4a8a/e533decd-6a4b-5ad4-9de8-abc906ee4a8a_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F611f76604b33404a830343985c612bcd%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/611f76604b33404a830343985c612bcd/images/large/2.jpg saved to cache
2026-03-26 22:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e533decd-6a4b-5ad4-9de8-abc906ee4a8a
2026-03-26 22:48:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/611f76604b33404a830343985c612bcd/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252Fa5c038273a7246ba90cd96a477fe03a1%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/a5c038273a7246ba90cd96a477fe03a1/images/large/10.jpg not downloaded yet
2026-03-26 22:48:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/611f76604b33404a830343985c612bcd/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/611f76604b33404a830343985c612bcd/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/cbd98fd642194fd58338497fea8f9875/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:27 [ayvens.be] INFO: Found listing with ID: 1986135
2026-03-26 22:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986135%27 HTTP/1.1" 200 None
2026-03-26 22:48:27 [ayvens.be] INFO: Scrape type for 1986135: 1
2026-03-26 22:48:27 [ayvens.be] INFO: Extracting data for car ID: 1986135
2026-03-26 22:48:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d0061d6-9db7-5a3a-8d11-0e874fdca899 with identifier: 1986135
2026-03-26 22:48:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d0061d6-9db7-5a3a-8d11-0e874fdca899 with scrape type 1
2026-03-26 22:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9d0061d6-9db7-5a3a-8d11-0e874fdca899
2026-03-26 22:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ex%252F192d907613794bda9091173ab1e4234a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ex/192d907613794bda9091173ab1e4234a/images/large/1.jpg not downloaded yet
2026-03-26 22:48:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b744a090>
2026-03-26 22:48:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e533decd-6a4b-5ad4-9de8-abc906ee4a8a/e533decd-6a4b-5ad4-9de8-abc906ee4a8a_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F611f76604b33404a830343985c612bcd%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/611f76604b33404a830343985c612bcd/images/large/1.jpg saved to cache
2026-03-26 22:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e533decd-6a4b-5ad4-9de8-abc906ee4a8a
2026-03-26 22:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ex%252F192d907613794bda9091173ab1e4234a%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ex/192d907613794bda9091173ab1e4234a/images/large/2.jpg not downloaded yet
2026-03-26 22:48:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aa/a5c038273a7246ba90cd96a477fe03a1/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74f82d0>
2026-03-26 22:48:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e533decd-6a4b-5ad4-9de8-abc906ee4a8a/e533decd-6a4b-5ad4-9de8-abc906ee4a8a_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F611f76604b33404a830343985c612bcd%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/611f76604b33404a830343985c612bcd/images/large/5.jpg saved to cache
2026-03-26 22:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e533decd-6a4b-5ad4-9de8-abc906ee4a8a
2026-03-26 22:48:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7876a10>
2026-03-26 22:48:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e533decd-6a4b-5ad4-9de8-abc906ee4a8a/e533decd-6a4b-5ad4-9de8-abc906ee4a8a_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F611f76604b33404a830343985c612bcd%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/611f76604b33404a830343985c612bcd/images/large/3.jpg saved to cache
2026-03-26 22:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e533decd-6a4b-5ad4-9de8-abc906ee4a8a
2026-03-26 22:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ex%252F192d907613794bda9091173ab1e4234a%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ex/192d907613794bda9091173ab1e4234a/images/large/3.jpg not downloaded yet
2026-03-26 22:48:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/611f76604b33404a830343985c612bcd/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/611f76604b33404a830343985c612bcd/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ex%252F192d907613794bda9091173ab1e4234a%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ex/192d907613794bda9091173ab1e4234a/images/large/4.jpg not downloaded yet
2026-03-26 22:48:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79ccfd0>
2026-03-26 22:48:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e533decd-6a4b-5ad4-9de8-abc906ee4a8a/e533decd-6a4b-5ad4-9de8-abc906ee4a8a_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F611f76604b33404a830343985c612bcd%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/611f76604b33404a830343985c612bcd/images/large/4.jpg saved to cache
2026-03-26 22:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e533decd-6a4b-5ad4-9de8-abc906ee4a8a
2026-03-26 22:48:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd844590>
2026-03-26 22:48:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb8dcd5c-2ea5-528d-ab64-790d668bac9b/eb8dcd5c-2ea5-528d-ab64-790d668bac9b_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fcbd98fd642194fd58338497fea8f9875%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/cbd98fd642194fd58338497fea8f9875/images/large/8.jpg saved to cache
2026-03-26 22:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item eb8dcd5c-2ea5-528d-ab64-790d668bac9b
2026-03-26 22:48:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: eb8dcd5c-2ea5-528d-ab64-790d668bac9b, skipping ID generation
2026-03-26 22:48:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb8dcd5c-2ea5-528d-ab64-790d668bac9b with scrape type 1
2026-03-26 22:48:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item eb8dcd5c-2ea5-528d-ab64-790d668bac9b sending to next pipeline
2026-03-26 22:48:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: eb8dcd5c-2ea5-528d-ab64-790d668bac9b, identifier: 1986132
2026-03-26 22:48:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c5c290>
2026-03-26 22:48:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ddff47d6-5050-544d-ad30-948e8dfbc96a/ddff47d6-5050-544d-ad30-948e8dfbc96a_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252Fa5c038273a7246ba90cd96a477fe03a1%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/a5c038273a7246ba90cd96a477fe03a1/images/large/3.jpg saved to cache
2026-03-26 22:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ddff47d6-5050-544d-ad30-948e8dfbc96a
2026-03-26 22:48:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: eb8dcd5c-2ea5-528d-ab64-790d668bac9b with identifier: 1986132
2026-03-26 22:48:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: eb8dcd5c-2ea5-528d-ab64-790d668bac9b with identifier: 1986132
2026-03-26 22:48:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: eb8dcd5c-2ea5-528d-ab64-790d668bac9b with identifier: 1986132 to the API
2026-03-26 22:48:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:48:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:48:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bl/cbd98fd642194fd58338497fea8f9875/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'eb8dcd5c-2ea5-528d-ab64-790d668bac9b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'IBIZA 5D',
 'odometer': 29944,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb8dcd5c-2ea5-528d-ab64-790d668bac9b/eb8dcd5c-2ea5-528d-ab64-790d668bac9b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 684070,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/cbd98fd642194fd58338497fea8f9875/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb8dcd5c-2ea5-528d-ab64-790d668bac9b/eb8dcd5c-2ea5-528d-ab64-790d668bac9b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 495634,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/cbd98fd642194fd58338497fea8f9875/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb8dcd5c-2ea5-528d-ab64-790d668bac9b/eb8dcd5c-2ea5-528d-ab64-790d668bac9b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 562828,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/cbd98fd642194fd58338497fea8f9875/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb8dcd5c-2ea5-528d-ab64-790d668bac9b/eb8dcd5c-2ea5-528d-ab64-790d668bac9b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 488945,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/cbd98fd642194fd58338497fea8f9875/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb8dcd5c-2ea5-528d-ab64-790d668bac9b/eb8dcd5c-2ea5-528d-ab64-790d668bac9b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 311590,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/cbd98fd642194fd58338497fea8f9875/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb8dcd5c-2ea5-528d-ab64-790d668bac9b/eb8dcd5c-2ea5-528d-ab64-790d668bac9b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 270019,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/cbd98fd642194fd58338497fea8f9875/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb8dcd5c-2ea5-528d-ab64-790d668bac9b/eb8dcd5c-2ea5-528d-ab64-790d668bac9b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 309223,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/cbd98fd642194fd58338497fea8f9875/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb8dcd5c-2ea5-528d-ab64-790d668bac9b/eb8dcd5c-2ea5-528d-ab64-790d668bac9b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 384600,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/cbd98fd642194fd58338497fea8f9875/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb8dcd5c-2ea5-528d-ab64-790d668bac9b/eb8dcd5c-2ea5-528d-ab64-790d668bac9b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 361930,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/cbd98fd642194fd58338497fea8f9875/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb8dcd5c-2ea5-528d-ab64-790d668bac9b/eb8dcd5c-2ea5-528d-ab64-790d668bac9b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 383198,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/cbd98fd642194fd58338497fea8f9875/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT IBIZA 5D 1.0 TSI 70KW S-S STYLE',
 'transmission': 'manual',
 'trim': '1.0 TSI 70KW S-S STYLE',
 'vin': None,
 'year': 2022}
2026-03-26 22:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986132%27 HTTP/1.1" 200 None
2026-03-26 22:48:28 [ayvens.be] INFO: Saving data for 1986132: {'created_time': 1774565308.366409, 'last_price_update_time': 1774565308.366419, 'auction_closing_time': 1775028600.0}
2026-03-26 22:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986132') HTTP/1.1" 204 0
2026-03-26 22:48:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aa/a5c038273a7246ba90cd96a477fe03a1/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ex%252F192d907613794bda9091173ab1e4234a%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ex/192d907613794bda9091173ab1e4234a/images/large/5.jpg not downloaded yet
2026-03-26 22:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ex%252F192d907613794bda9091173ab1e4234a%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ex/192d907613794bda9091173ab1e4234a/images/large/6.jpg not downloaded yet
2026-03-26 22:48:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aa/a5c038273a7246ba90cd96a477fe03a1/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd0c4850>
2026-03-26 22:48:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e533decd-6a4b-5ad4-9de8-abc906ee4a8a/e533decd-6a4b-5ad4-9de8-abc906ee4a8a_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F611f76604b33404a830343985c612bcd%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/611f76604b33404a830343985c612bcd/images/large/6.jpg saved to cache
2026-03-26 22:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e533decd-6a4b-5ad4-9de8-abc906ee4a8a
2026-03-26 22:48:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b35210>
2026-03-26 22:48:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e533decd-6a4b-5ad4-9de8-abc906ee4a8a/e533decd-6a4b-5ad4-9de8-abc906ee4a8a_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F611f76604b33404a830343985c612bcd%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/611f76604b33404a830343985c612bcd/images/large/7.jpg saved to cache
2026-03-26 22:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e533decd-6a4b-5ad4-9de8-abc906ee4a8a
2026-03-26 22:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ex%252F192d907613794bda9091173ab1e4234a%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ex/192d907613794bda9091173ab1e4234a/images/large/7.jpg not downloaded yet
2026-03-26 22:48:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aa/a5c038273a7246ba90cd96a477fe03a1/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aa/a5c038273a7246ba90cd96a477fe03a1/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ex%252F192d907613794bda9091173ab1e4234a%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ex/192d907613794bda9091173ab1e4234a/images/large/8.jpg not downloaded yet
2026-03-26 22:48:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74e5610>
2026-03-26 22:48:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ddff47d6-5050-544d-ad30-948e8dfbc96a/ddff47d6-5050-544d-ad30-948e8dfbc96a_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252Fa5c038273a7246ba90cd96a477fe03a1%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/a5c038273a7246ba90cd96a477fe03a1/images/large/2.jpg saved to cache
2026-03-26 22:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ddff47d6-5050-544d-ad30-948e8dfbc96a
2026-03-26 22:48:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7944d50>
2026-03-26 22:48:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ddff47d6-5050-544d-ad30-948e8dfbc96a/ddff47d6-5050-544d-ad30-948e8dfbc96a_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252Fa5c038273a7246ba90cd96a477fe03a1%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/a5c038273a7246ba90cd96a477fe03a1/images/large/1.jpg saved to cache
2026-03-26 22:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ddff47d6-5050-544d-ad30-948e8dfbc96a
2026-03-26 22:48:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/611f76604b33404a830343985c612bcd/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ex%252F192d907613794bda9091173ab1e4234a%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ex/192d907613794bda9091173ab1e4234a/images/large/9.jpg not downloaded yet
2026-03-26 22:48:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aa/a5c038273a7246ba90cd96a477fe03a1/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ex%252F192d907613794bda9091173ab1e4234a%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ex/192d907613794bda9091173ab1e4234a/images/large/10.jpg not downloaded yet
2026-03-26 22:48:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c6bc90>
2026-03-26 22:48:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ddff47d6-5050-544d-ad30-948e8dfbc96a/ddff47d6-5050-544d-ad30-948e8dfbc96a_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252Fa5c038273a7246ba90cd96a477fe03a1%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/a5c038273a7246ba90cd96a477fe03a1/images/large/4.jpg saved to cache
2026-03-26 22:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ddff47d6-5050-544d-ad30-948e8dfbc96a
2026-03-26 22:48:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76a5910>
2026-03-26 22:48:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ddff47d6-5050-544d-ad30-948e8dfbc96a/ddff47d6-5050-544d-ad30-948e8dfbc96a_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252Fa5c038273a7246ba90cd96a477fe03a1%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/a5c038273a7246ba90cd96a477fe03a1/images/large/5.jpg saved to cache
2026-03-26 22:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ddff47d6-5050-544d-ad30-948e8dfbc96a
2026-03-26 22:48:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/611f76604b33404a830343985c612bcd/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:29 [ayvens.be] INFO: Found listing with ID: 1986136
2026-03-26 22:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986136%27 HTTP/1.1" 200 None
2026-03-26 22:48:29 [ayvens.be] INFO: Scrape type for 1986136: 1
2026-03-26 22:48:29 [ayvens.be] INFO: Extracting data for car ID: 1986136
2026-03-26 22:48:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96c1c752-3a76-5b5d-a2bb-987e8e789495 with identifier: 1986136
2026-03-26 22:48:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96c1c752-3a76-5b5d-a2bb-987e8e789495 with scrape type 1
2026-03-26 22:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 96c1c752-3a76-5b5d-a2bb-987e8e789495
2026-03-26 22:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fcc87341be7f0471aa8d7bbe638d37f82%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/cc87341be7f0471aa8d7bbe638d37f82/images/large/1.jpg not downloaded yet
2026-03-26 22:48:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/611f76604b33404a830343985c612bcd/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fcc87341be7f0471aa8d7bbe638d37f82%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/cc87341be7f0471aa8d7bbe638d37f82/images/large/2.jpg not downloaded yet
2026-03-26 22:48:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aa/a5c038273a7246ba90cd96a477fe03a1/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aa/a5c038273a7246ba90cd96a477fe03a1/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fcc87341be7f0471aa8d7bbe638d37f82%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/cc87341be7f0471aa8d7bbe638d37f82/images/large/3.jpg not downloaded yet
2026-03-26 22:48:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7435190>
2026-03-26 22:48:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e533decd-6a4b-5ad4-9de8-abc906ee4a8a/e533decd-6a4b-5ad4-9de8-abc906ee4a8a_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F611f76604b33404a830343985c612bcd%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/611f76604b33404a830343985c612bcd/images/large/10.jpg saved to cache
2026-03-26 22:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e533decd-6a4b-5ad4-9de8-abc906ee4a8a
2026-03-26 22:48:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7875510>
2026-03-26 22:48:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ddff47d6-5050-544d-ad30-948e8dfbc96a/ddff47d6-5050-544d-ad30-948e8dfbc96a_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252Fa5c038273a7246ba90cd96a477fe03a1%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/a5c038273a7246ba90cd96a477fe03a1/images/large/6.jpg saved to cache
2026-03-26 22:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ddff47d6-5050-544d-ad30-948e8dfbc96a
2026-03-26 22:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fcc87341be7f0471aa8d7bbe638d37f82%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/cc87341be7f0471aa8d7bbe638d37f82/images/large/4.jpg not downloaded yet
2026-03-26 22:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fcc87341be7f0471aa8d7bbe638d37f82%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/cc87341be7f0471aa8d7bbe638d37f82/images/large/5.jpg not downloaded yet
2026-03-26 22:48:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aa/a5c038273a7246ba90cd96a477fe03a1/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7660f90>
2026-03-26 22:48:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e533decd-6a4b-5ad4-9de8-abc906ee4a8a/e533decd-6a4b-5ad4-9de8-abc906ee4a8a_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F611f76604b33404a830343985c612bcd%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/611f76604b33404a830343985c612bcd/images/large/9.jpg saved to cache
2026-03-26 22:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e533decd-6a4b-5ad4-9de8-abc906ee4a8a
2026-03-26 22:48:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6dda650>
2026-03-26 22:48:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e533decd-6a4b-5ad4-9de8-abc906ee4a8a/e533decd-6a4b-5ad4-9de8-abc906ee4a8a_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F611f76604b33404a830343985c612bcd%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/611f76604b33404a830343985c612bcd/images/large/8.jpg saved to cache
2026-03-26 22:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e533decd-6a4b-5ad4-9de8-abc906ee4a8a
2026-03-26 22:48:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e533decd-6a4b-5ad4-9de8-abc906ee4a8a, skipping ID generation
2026-03-26 22:48:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e533decd-6a4b-5ad4-9de8-abc906ee4a8a with scrape type 1
2026-03-26 22:48:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e533decd-6a4b-5ad4-9de8-abc906ee4a8a sending to next pipeline
2026-03-26 22:48:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e533decd-6a4b-5ad4-9de8-abc906ee4a8a, identifier: 1986133
2026-03-26 22:48:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c94390>
2026-03-26 22:48:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ddff47d6-5050-544d-ad30-948e8dfbc96a/ddff47d6-5050-544d-ad30-948e8dfbc96a_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252Fa5c038273a7246ba90cd96a477fe03a1%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/a5c038273a7246ba90cd96a477fe03a1/images/large/7.jpg saved to cache
2026-03-26 22:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ddff47d6-5050-544d-ad30-948e8dfbc96a
2026-03-26 22:48:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b764a0d0>
2026-03-26 22:48:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ddff47d6-5050-544d-ad30-948e8dfbc96a/ddff47d6-5050-544d-ad30-948e8dfbc96a_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252Fa5c038273a7246ba90cd96a477fe03a1%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/a5c038273a7246ba90cd96a477fe03a1/images/large/9.jpg saved to cache
2026-03-26 22:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ddff47d6-5050-544d-ad30-948e8dfbc96a
2026-03-26 22:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fcc87341be7f0471aa8d7bbe638d37f82%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/cc87341be7f0471aa8d7bbe638d37f82/images/large/6.jpg not downloaded yet
2026-03-26 22:48:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e533decd-6a4b-5ad4-9de8-abc906ee4a8a with identifier: 1986133
2026-03-26 22:48:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e533decd-6a4b-5ad4-9de8-abc906ee4a8a with identifier: 1986133
2026-03-26 22:48:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e533decd-6a4b-5ad4-9de8-abc906ee4a8a with identifier: 1986133 to the API
2026-03-26 22:48:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:48:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:48:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2an/611f76604b33404a830343985c612bcd/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.3L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'e533decd-6a4b-5ad4-9de8-abc906ee4a8a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'Master',
 'odometer': 131976,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e533decd-6a4b-5ad4-9de8-abc906ee4a8a/e533decd-6a4b-5ad4-9de8-abc906ee4a8a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 609808,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/611f76604b33404a830343985c612bcd/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e533decd-6a4b-5ad4-9de8-abc906ee4a8a/e533decd-6a4b-5ad4-9de8-abc906ee4a8a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 628263,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/611f76604b33404a830343985c612bcd/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e533decd-6a4b-5ad4-9de8-abc906ee4a8a/e533decd-6a4b-5ad4-9de8-abc906ee4a8a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 572480,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/611f76604b33404a830343985c612bcd/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e533decd-6a4b-5ad4-9de8-abc906ee4a8a/e533decd-6a4b-5ad4-9de8-abc906ee4a8a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 636486,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/611f76604b33404a830343985c612bcd/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e533decd-6a4b-5ad4-9de8-abc906ee4a8a/e533decd-6a4b-5ad4-9de8-abc906ee4a8a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 566681,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/611f76604b33404a830343985c612bcd/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e533decd-6a4b-5ad4-9de8-abc906ee4a8a/e533decd-6a4b-5ad4-9de8-abc906ee4a8a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 704138,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/611f76604b33404a830343985c612bcd/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e533decd-6a4b-5ad4-9de8-abc906ee4a8a/e533decd-6a4b-5ad4-9de8-abc906ee4a8a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 659781,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/611f76604b33404a830343985c612bcd/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e533decd-6a4b-5ad4-9de8-abc906ee4a8a/e533decd-6a4b-5ad4-9de8-abc906ee4a8a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 865101,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/611f76604b33404a830343985c612bcd/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e533decd-6a4b-5ad4-9de8-abc906ee4a8a/e533decd-6a4b-5ad4-9de8-abc906ee4a8a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 816968,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/611f76604b33404a830343985c612bcd/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e533decd-6a4b-5ad4-9de8-abc906ee4a8a/e533decd-6a4b-5ad4-9de8-abc906ee4a8a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 779288,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/611f76604b33404a830343985c612bcd/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-21',
 'seats_number': 3,
 'seller_name': None,
 'title': 'RENAULT Master 2.3 DCI 135 BLUE G CONFORT L1H1 33',
 'transmission': 'manual',
 'trim': '2.3 DCI 135 BLUE G CONFORT L1H1 33',
 'vin': None,
 'year': 2021}
2026-03-26 22:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986133%27 HTTP/1.1" 200 None
2026-03-26 22:48:30 [ayvens.be] INFO: Saving data for 1986133: {'created_time': 1774565310.639666, 'last_price_update_time': 1774565310.639675, 'auction_closing_time': 1775028600.0}
2026-03-26 22:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986133') HTTP/1.1" 204 0
2026-03-26 22:48:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ex/192d907613794bda9091173ab1e4234a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aa/a5c038273a7246ba90cd96a477fe03a1/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ex/192d907613794bda9091173ab1e4234a/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fcc87341be7f0471aa8d7bbe638d37f82%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/cc87341be7f0471aa8d7bbe638d37f82/images/large/7.jpg not downloaded yet
2026-03-26 22:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fcc87341be7f0471aa8d7bbe638d37f82%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/cc87341be7f0471aa8d7bbe638d37f82/images/large/8.jpg not downloaded yet
2026-03-26 22:48:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74931d0>
2026-03-26 22:48:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ddff47d6-5050-544d-ad30-948e8dfbc96a/ddff47d6-5050-544d-ad30-948e8dfbc96a_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252Fa5c038273a7246ba90cd96a477fe03a1%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/a5c038273a7246ba90cd96a477fe03a1/images/large/10.jpg saved to cache
2026-03-26 22:48:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ddff47d6-5050-544d-ad30-948e8dfbc96a
2026-03-26 22:48:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ex/192d907613794bda9091173ab1e4234a/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ex/192d907613794bda9091173ab1e4234a/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fcc87341be7f0471aa8d7bbe638d37f82%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/cc87341be7f0471aa8d7bbe638d37f82/images/large/9.jpg not downloaded yet
2026-03-26 22:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fcc87341be7f0471aa8d7bbe638d37f82%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/cc87341be7f0471aa8d7bbe638d37f82/images/large/10.jpg not downloaded yet
2026-03-26 22:48:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7403750>
2026-03-26 22:48:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d0061d6-9db7-5a3a-8d11-0e874fdca899/9d0061d6-9db7-5a3a-8d11-0e874fdca899_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ex%252F192d907613794bda9091173ab1e4234a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ex/192d907613794bda9091173ab1e4234a/images/large/1.jpg saved to cache
2026-03-26 22:48:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9d0061d6-9db7-5a3a-8d11-0e874fdca899
2026-03-26 22:48:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b741da90>
2026-03-26 22:48:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ddff47d6-5050-544d-ad30-948e8dfbc96a/ddff47d6-5050-544d-ad30-948e8dfbc96a_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252Fa5c038273a7246ba90cd96a477fe03a1%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/a5c038273a7246ba90cd96a477fe03a1/images/large/8.jpg saved to cache
2026-03-26 22:48:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ddff47d6-5050-544d-ad30-948e8dfbc96a
2026-03-26 22:48:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ddff47d6-5050-544d-ad30-948e8dfbc96a, skipping ID generation
2026-03-26 22:48:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ddff47d6-5050-544d-ad30-948e8dfbc96a with scrape type 1
2026-03-26 22:48:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ddff47d6-5050-544d-ad30-948e8dfbc96a sending to next pipeline
2026-03-26 22:48:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: ddff47d6-5050-544d-ad30-948e8dfbc96a, identifier: 1986134
2026-03-26 22:48:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b72ee990>
2026-03-26 22:48:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d0061d6-9db7-5a3a-8d11-0e874fdca899/9d0061d6-9db7-5a3a-8d11-0e874fdca899_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ex%252F192d907613794bda9091173ab1e4234a%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ex/192d907613794bda9091173ab1e4234a/images/large/2.jpg saved to cache
2026-03-26 22:48:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9d0061d6-9db7-5a3a-8d11-0e874fdca899
2026-03-26 22:48:31 [ayvens.be] INFO: Found listing with ID: 1986137
2026-03-26 22:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986137%27 HTTP/1.1" 200 None
2026-03-26 22:48:31 [ayvens.be] INFO: Scrape type for 1986137: 1
2026-03-26 22:48:31 [ayvens.be] INFO: Extracting data for car ID: 1986137
2026-03-26 22:48:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9bab4716-979a-5109-af4a-c59a4b3a7c60 with identifier: 1986137
2026-03-26 22:48:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9bab4716-979a-5109-af4a-c59a4b3a7c60 with scrape type 1
2026-03-26 22:48:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9bab4716-979a-5109-af4a-c59a4b3a7c60
2026-03-26 22:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F0302e89491a44a56bea8c9af7253d403%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/0302e89491a44a56bea8c9af7253d403/images/large/1.jpg not downloaded yet
2026-03-26 22:48:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: ddff47d6-5050-544d-ad30-948e8dfbc96a with identifier: 1986134
2026-03-26 22:48:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: ddff47d6-5050-544d-ad30-948e8dfbc96a with identifier: 1986134
2026-03-26 22:48:31 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: ddff47d6-5050-544d-ad30-948e8dfbc96a with identifier: 1986134 to the API
2026-03-26 22:48:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:48:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:48:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2aa/a5c038273a7246ba90cd96a477fe03a1/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'ddff47d6-5050-544d-ad30-948e8dfbc96a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '5008',
 'odometer': 134297,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddff47d6-5050-544d-ad30-948e8dfbc96a/ddff47d6-5050-544d-ad30-948e8dfbc96a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 662437,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aa/a5c038273a7246ba90cd96a477fe03a1/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddff47d6-5050-544d-ad30-948e8dfbc96a/ddff47d6-5050-544d-ad30-948e8dfbc96a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 673398,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aa/a5c038273a7246ba90cd96a477fe03a1/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddff47d6-5050-544d-ad30-948e8dfbc96a/ddff47d6-5050-544d-ad30-948e8dfbc96a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 549474,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aa/a5c038273a7246ba90cd96a477fe03a1/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddff47d6-5050-544d-ad30-948e8dfbc96a/ddff47d6-5050-544d-ad30-948e8dfbc96a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 695820,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aa/a5c038273a7246ba90cd96a477fe03a1/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddff47d6-5050-544d-ad30-948e8dfbc96a/ddff47d6-5050-544d-ad30-948e8dfbc96a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 586838,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aa/a5c038273a7246ba90cd96a477fe03a1/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddff47d6-5050-544d-ad30-948e8dfbc96a/ddff47d6-5050-544d-ad30-948e8dfbc96a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 558500,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aa/a5c038273a7246ba90cd96a477fe03a1/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddff47d6-5050-544d-ad30-948e8dfbc96a/ddff47d6-5050-544d-ad30-948e8dfbc96a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 664509,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aa/a5c038273a7246ba90cd96a477fe03a1/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddff47d6-5050-544d-ad30-948e8dfbc96a/ddff47d6-5050-544d-ad30-948e8dfbc96a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 704368,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aa/a5c038273a7246ba90cd96a477fe03a1/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddff47d6-5050-544d-ad30-948e8dfbc96a/ddff47d6-5050-544d-ad30-948e8dfbc96a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 490094,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aa/a5c038273a7246ba90cd96a477fe03a1/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddff47d6-5050-544d-ad30-948e8dfbc96a/ddff47d6-5050-544d-ad30-948e8dfbc96a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 581740,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aa/a5c038273a7246ba90cd96a477fe03a1/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-27',
 'seats_number': 7,
 'seller_name': None,
 'title': 'PEUGEOT 5008 1.2 PURETECH 130 AUTO ACTIVE PACK',
 'transmission': 'automatic',
 'trim': '1.2 PURETECH 130 AUTO ACTIVE PACK',
 'vin': None,
 'year': 2021}
2026-03-26 22:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986134%27 HTTP/1.1" 200 None
2026-03-26 22:48:31 [ayvens.be] INFO: Saving data for 1986134: {'created_time': 1774565311.938708, 'last_price_update_time': 1774565311.938717, 'auction_closing_time': 1775028600.0}
2026-03-26 22:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986134') HTTP/1.1" 204 0
2026-03-26 22:48:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ex/192d907613794bda9091173ab1e4234a/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ex/192d907613794bda9091173ab1e4234a/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ex/192d907613794bda9091173ab1e4234a/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F0302e89491a44a56bea8c9af7253d403%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/0302e89491a44a56bea8c9af7253d403/images/large/2.jpg not downloaded yet
2026-03-26 22:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F0302e89491a44a56bea8c9af7253d403%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/0302e89491a44a56bea8c9af7253d403/images/large/3.jpg not downloaded yet
2026-03-26 22:48:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6deffd0>
2026-03-26 22:48:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d0061d6-9db7-5a3a-8d11-0e874fdca899/9d0061d6-9db7-5a3a-8d11-0e874fdca899_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ex%252F192d907613794bda9091173ab1e4234a%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ex/192d907613794bda9091173ab1e4234a/images/large/4.jpg saved to cache
2026-03-26 22:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9d0061d6-9db7-5a3a-8d11-0e874fdca899
2026-03-26 22:48:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b72fda10>
2026-03-26 22:48:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d0061d6-9db7-5a3a-8d11-0e874fdca899/9d0061d6-9db7-5a3a-8d11-0e874fdca899_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ex%252F192d907613794bda9091173ab1e4234a%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ex/192d907613794bda9091173ab1e4234a/images/large/3.jpg saved to cache
2026-03-26 22:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9d0061d6-9db7-5a3a-8d11-0e874fdca899
2026-03-26 22:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F0302e89491a44a56bea8c9af7253d403%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/0302e89491a44a56bea8c9af7253d403/images/large/4.jpg not downloaded yet
2026-03-26 22:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F0302e89491a44a56bea8c9af7253d403%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/0302e89491a44a56bea8c9af7253d403/images/large/5.jpg not downloaded yet
2026-03-26 22:48:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ex/192d907613794bda9091173ab1e4234a/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ex/192d907613794bda9091173ab1e4234a/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74069d0>
2026-03-26 22:48:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d0061d6-9db7-5a3a-8d11-0e874fdca899/9d0061d6-9db7-5a3a-8d11-0e874fdca899_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ex%252F192d907613794bda9091173ab1e4234a%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ex/192d907613794bda9091173ab1e4234a/images/large/5.jpg saved to cache
2026-03-26 22:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9d0061d6-9db7-5a3a-8d11-0e874fdca899
2026-03-26 22:48:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cc8a10>
2026-03-26 22:48:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d0061d6-9db7-5a3a-8d11-0e874fdca899/9d0061d6-9db7-5a3a-8d11-0e874fdca899_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ex%252F192d907613794bda9091173ab1e4234a%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ex/192d907613794bda9091173ab1e4234a/images/large/7.jpg saved to cache
2026-03-26 22:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9d0061d6-9db7-5a3a-8d11-0e874fdca899
2026-03-26 22:48:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b78a9dd0>
2026-03-26 22:48:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d0061d6-9db7-5a3a-8d11-0e874fdca899/9d0061d6-9db7-5a3a-8d11-0e874fdca899_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ex%252F192d907613794bda9091173ab1e4234a%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ex/192d907613794bda9091173ab1e4234a/images/large/6.jpg saved to cache
2026-03-26 22:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9d0061d6-9db7-5a3a-8d11-0e874fdca899
2026-03-26 22:48:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/cc87341be7f0471aa8d7bbe638d37f82/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/cc87341be7f0471aa8d7bbe638d37f82/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F0302e89491a44a56bea8c9af7253d403%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/0302e89491a44a56bea8c9af7253d403/images/large/6.jpg not downloaded yet
2026-03-26 22:48:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ex/192d907613794bda9091173ab1e4234a/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F0302e89491a44a56bea8c9af7253d403%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/0302e89491a44a56bea8c9af7253d403/images/large/7.jpg not downloaded yet
2026-03-26 22:48:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/cc87341be7f0471aa8d7bbe638d37f82/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F0302e89491a44a56bea8c9af7253d403%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/0302e89491a44a56bea8c9af7253d403/images/large/8.jpg not downloaded yet
2026-03-26 22:48:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cc8590>
2026-03-26 22:48:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d0061d6-9db7-5a3a-8d11-0e874fdca899/9d0061d6-9db7-5a3a-8d11-0e874fdca899_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ex%252F192d907613794bda9091173ab1e4234a%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ex/192d907613794bda9091173ab1e4234a/images/large/8.jpg saved to cache
2026-03-26 22:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9d0061d6-9db7-5a3a-8d11-0e874fdca899
2026-03-26 22:48:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79d7f10>
2026-03-26 22:48:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d0061d6-9db7-5a3a-8d11-0e874fdca899/9d0061d6-9db7-5a3a-8d11-0e874fdca899_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ex%252F192d907613794bda9091173ab1e4234a%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ex/192d907613794bda9091173ab1e4234a/images/large/9.jpg saved to cache
2026-03-26 22:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9d0061d6-9db7-5a3a-8d11-0e874fdca899
2026-03-26 22:48:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/cc87341be7f0471aa8d7bbe638d37f82/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/cc87341be7f0471aa8d7bbe638d37f82/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F0302e89491a44a56bea8c9af7253d403%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/0302e89491a44a56bea8c9af7253d403/images/large/9.jpg not downloaded yet
2026-03-26 22:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F0302e89491a44a56bea8c9af7253d403%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/0302e89491a44a56bea8c9af7253d403/images/large/10.jpg not downloaded yet
2026-03-26 22:48:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c971d0>
2026-03-26 22:48:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96c1c752-3a76-5b5d-a2bb-987e8e789495/96c1c752-3a76-5b5d-a2bb-987e8e789495_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fcc87341be7f0471aa8d7bbe638d37f82%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/cc87341be7f0471aa8d7bbe638d37f82/images/large/2.jpg saved to cache
2026-03-26 22:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 96c1c752-3a76-5b5d-a2bb-987e8e789495
2026-03-26 22:48:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7877b90>
2026-03-26 22:48:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96c1c752-3a76-5b5d-a2bb-987e8e789495/96c1c752-3a76-5b5d-a2bb-987e8e789495_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fcc87341be7f0471aa8d7bbe638d37f82%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/cc87341be7f0471aa8d7bbe638d37f82/images/large/1.jpg saved to cache
2026-03-26 22:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 96c1c752-3a76-5b5d-a2bb-987e8e789495
2026-03-26 22:48:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7660a10>
2026-03-26 22:48:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d0061d6-9db7-5a3a-8d11-0e874fdca899/9d0061d6-9db7-5a3a-8d11-0e874fdca899_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ex%252F192d907613794bda9091173ab1e4234a%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ex/192d907613794bda9091173ab1e4234a/images/large/10.jpg saved to cache
2026-03-26 22:48:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9d0061d6-9db7-5a3a-8d11-0e874fdca899
2026-03-26 22:48:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9d0061d6-9db7-5a3a-8d11-0e874fdca899, skipping ID generation
2026-03-26 22:48:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d0061d6-9db7-5a3a-8d11-0e874fdca899 with scrape type 1
2026-03-26 22:48:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9d0061d6-9db7-5a3a-8d11-0e874fdca899 sending to next pipeline
2026-03-26 22:48:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 9d0061d6-9db7-5a3a-8d11-0e874fdca899, identifier: 1986135
2026-03-26 22:48:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74e5190>
2026-03-26 22:48:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96c1c752-3a76-5b5d-a2bb-987e8e789495/96c1c752-3a76-5b5d-a2bb-987e8e789495_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fcc87341be7f0471aa8d7bbe638d37f82%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/cc87341be7f0471aa8d7bbe638d37f82/images/large/6.jpg saved to cache
2026-03-26 22:48:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 96c1c752-3a76-5b5d-a2bb-987e8e789495
2026-03-26 22:48:33 [ayvens.be] INFO: Found listing with ID: 1986138
2026-03-26 22:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986138%27 HTTP/1.1" 200 None
2026-03-26 22:48:33 [ayvens.be] INFO: Scrape type for 1986138: 1
2026-03-26 22:48:33 [ayvens.be] INFO: Extracting data for car ID: 1986138
2026-03-26 22:48:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f45ec6cc-abd5-5d95-88a5-82e3ee205a1c with identifier: 1986138
2026-03-26 22:48:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f45ec6cc-abd5-5d95-88a5-82e3ee205a1c with scrape type 1
2026-03-26 22:48:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f45ec6cc-abd5-5d95-88a5-82e3ee205a1c
2026-03-26 22:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F146e11c744584b6eb706d6bf9256fa40%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/146e11c744584b6eb706d6bf9256fa40/images/large/1.jpg not downloaded yet
2026-03-26 22:48:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 9d0061d6-9db7-5a3a-8d11-0e874fdca899 with identifier: 1986135
2026-03-26 22:48:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 9d0061d6-9db7-5a3a-8d11-0e874fdca899 with identifier: 1986135
2026-03-26 22:48:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 9d0061d6-9db7-5a3a-8d11-0e874fdca899 with identifier: 1986135 to the API
2026-03-26 22:48:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:48:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:48:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ex/192d907613794bda9091173ab1e4234a/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '9d0061d6-9db7-5a3a-8d11-0e874fdca899',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 26773,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d0061d6-9db7-5a3a-8d11-0e874fdca899/9d0061d6-9db7-5a3a-8d11-0e874fdca899_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 690533,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ex/192d907613794bda9091173ab1e4234a/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d0061d6-9db7-5a3a-8d11-0e874fdca899/9d0061d6-9db7-5a3a-8d11-0e874fdca899_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 670564,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ex/192d907613794bda9091173ab1e4234a/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d0061d6-9db7-5a3a-8d11-0e874fdca899/9d0061d6-9db7-5a3a-8d11-0e874fdca899_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 695680,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ex/192d907613794bda9091173ab1e4234a/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d0061d6-9db7-5a3a-8d11-0e874fdca899/9d0061d6-9db7-5a3a-8d11-0e874fdca899_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 701940,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ex/192d907613794bda9091173ab1e4234a/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d0061d6-9db7-5a3a-8d11-0e874fdca899/9d0061d6-9db7-5a3a-8d11-0e874fdca899_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 668202,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ex/192d907613794bda9091173ab1e4234a/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d0061d6-9db7-5a3a-8d11-0e874fdca899/9d0061d6-9db7-5a3a-8d11-0e874fdca899_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 760491,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ex/192d907613794bda9091173ab1e4234a/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d0061d6-9db7-5a3a-8d11-0e874fdca899/9d0061d6-9db7-5a3a-8d11-0e874fdca899_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 617195,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ex/192d907613794bda9091173ab1e4234a/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d0061d6-9db7-5a3a-8d11-0e874fdca899/9d0061d6-9db7-5a3a-8d11-0e874fdca899_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 862435,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ex/192d907613794bda9091173ab1e4234a/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d0061d6-9db7-5a3a-8d11-0e874fdca899/9d0061d6-9db7-5a3a-8d11-0e874fdca899_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 860241,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ex/192d907613794bda9091173ab1e4234a/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d0061d6-9db7-5a3a-8d11-0e874fdca899/9d0061d6-9db7-5a3a-8d11-0e874fdca899_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 741221,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ex/192d907613794bda9091173ab1e4234a/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-03-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T2 PLUS LIMITED EDITION AUTO',
 'transmission': 'automatic',
 'trim': '1.5 T2 PLUS LIMITED EDITION AUTO',
 'vin': None,
 'year': 2024}
2026-03-26 22:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986135%27 HTTP/1.1" 200 None
2026-03-26 22:48:33 [ayvens.be] INFO: Saving data for 1986135: {'created_time': 1774565313.661698, 'last_price_update_time': 1774565313.661707, 'auction_closing_time': 1775028600.0}
2026-03-26 22:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986135') HTTP/1.1" 204 0
2026-03-26 22:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F146e11c744584b6eb706d6bf9256fa40%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/146e11c744584b6eb706d6bf9256fa40/images/large/2.jpg not downloaded yet
2026-03-26 22:48:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/cc87341be7f0471aa8d7bbe638d37f82/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/cc87341be7f0471aa8d7bbe638d37f82/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/cc87341be7f0471aa8d7bbe638d37f82/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F146e11c744584b6eb706d6bf9256fa40%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/146e11c744584b6eb706d6bf9256fa40/images/large/3.jpg not downloaded yet
2026-03-26 22:48:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e3fb10>
2026-03-26 22:48:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96c1c752-3a76-5b5d-a2bb-987e8e789495/96c1c752-3a76-5b5d-a2bb-987e8e789495_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fcc87341be7f0471aa8d7bbe638d37f82%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/cc87341be7f0471aa8d7bbe638d37f82/images/large/3.jpg saved to cache
2026-03-26 22:48:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 96c1c752-3a76-5b5d-a2bb-987e8e789495
2026-03-26 22:48:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74b7850>
2026-03-26 22:48:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96c1c752-3a76-5b5d-a2bb-987e8e789495/96c1c752-3a76-5b5d-a2bb-987e8e789495_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fcc87341be7f0471aa8d7bbe638d37f82%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/cc87341be7f0471aa8d7bbe638d37f82/images/large/4.jpg saved to cache
2026-03-26 22:48:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 96c1c752-3a76-5b5d-a2bb-987e8e789495
2026-03-26 22:48:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/cc87341be7f0471aa8d7bbe638d37f82/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/cc87341be7f0471aa8d7bbe638d37f82/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F146e11c744584b6eb706d6bf9256fa40%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/146e11c744584b6eb706d6bf9256fa40/images/large/4.jpg not downloaded yet
2026-03-26 22:48:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/0302e89491a44a56bea8c9af7253d403/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F146e11c744584b6eb706d6bf9256fa40%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/146e11c744584b6eb706d6bf9256fa40/images/large/5.jpg not downloaded yet
2026-03-26 22:48:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/0302e89491a44a56bea8c9af7253d403/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/0302e89491a44a56bea8c9af7253d403/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7428d50>
2026-03-26 22:48:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96c1c752-3a76-5b5d-a2bb-987e8e789495/96c1c752-3a76-5b5d-a2bb-987e8e789495_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fcc87341be7f0471aa8d7bbe638d37f82%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/cc87341be7f0471aa8d7bbe638d37f82/images/large/9.jpg saved to cache
2026-03-26 22:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 96c1c752-3a76-5b5d-a2bb-987e8e789495
2026-03-26 22:48:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77d4ad0>
2026-03-26 22:48:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96c1c752-3a76-5b5d-a2bb-987e8e789495/96c1c752-3a76-5b5d-a2bb-987e8e789495_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fcc87341be7f0471aa8d7bbe638d37f82%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/cc87341be7f0471aa8d7bbe638d37f82/images/large/5.jpg saved to cache
2026-03-26 22:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 96c1c752-3a76-5b5d-a2bb-987e8e789495
2026-03-26 22:48:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74e4a50>
2026-03-26 22:48:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96c1c752-3a76-5b5d-a2bb-987e8e789495/96c1c752-3a76-5b5d-a2bb-987e8e789495_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fcc87341be7f0471aa8d7bbe638d37f82%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/cc87341be7f0471aa8d7bbe638d37f82/images/large/10.jpg saved to cache
2026-03-26 22:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 96c1c752-3a76-5b5d-a2bb-987e8e789495
2026-03-26 22:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F146e11c744584b6eb706d6bf9256fa40%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/146e11c744584b6eb706d6bf9256fa40/images/large/6.jpg not downloaded yet
2026-03-26 22:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F146e11c744584b6eb706d6bf9256fa40%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/146e11c744584b6eb706d6bf9256fa40/images/large/7.jpg not downloaded yet
2026-03-26 22:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F146e11c744584b6eb706d6bf9256fa40%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/146e11c744584b6eb706d6bf9256fa40/images/large/8.jpg not downloaded yet
2026-03-26 22:48:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74390d0>
2026-03-26 22:48:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96c1c752-3a76-5b5d-a2bb-987e8e789495/96c1c752-3a76-5b5d-a2bb-987e8e789495_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fcc87341be7f0471aa8d7bbe638d37f82%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/cc87341be7f0471aa8d7bbe638d37f82/images/large/7.jpg saved to cache
2026-03-26 22:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 96c1c752-3a76-5b5d-a2bb-987e8e789495
2026-03-26 22:48:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7585f10>
2026-03-26 22:48:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96c1c752-3a76-5b5d-a2bb-987e8e789495/96c1c752-3a76-5b5d-a2bb-987e8e789495_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fcc87341be7f0471aa8d7bbe638d37f82%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/cc87341be7f0471aa8d7bbe638d37f82/images/large/8.jpg saved to cache
2026-03-26 22:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 96c1c752-3a76-5b5d-a2bb-987e8e789495
2026-03-26 22:48:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 96c1c752-3a76-5b5d-a2bb-987e8e789495, skipping ID generation
2026-03-26 22:48:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96c1c752-3a76-5b5d-a2bb-987e8e789495 with scrape type 1
2026-03-26 22:48:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 96c1c752-3a76-5b5d-a2bb-987e8e789495 sending to next pipeline
2026-03-26 22:48:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 96c1c752-3a76-5b5d-a2bb-987e8e789495, identifier: 1986136
2026-03-26 22:48:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76c6910>
2026-03-26 22:48:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bab4716-979a-5109-af4a-c59a4b3a7c60/9bab4716-979a-5109-af4a-c59a4b3a7c60_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F0302e89491a44a56bea8c9af7253d403%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/0302e89491a44a56bea8c9af7253d403/images/large/3.jpg saved to cache
2026-03-26 22:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9bab4716-979a-5109-af4a-c59a4b3a7c60
2026-03-26 22:48:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74b7350>
2026-03-26 22:48:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bab4716-979a-5109-af4a-c59a4b3a7c60/9bab4716-979a-5109-af4a-c59a4b3a7c60_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F0302e89491a44a56bea8c9af7253d403%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/0302e89491a44a56bea8c9af7253d403/images/large/1.jpg saved to cache
2026-03-26 22:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9bab4716-979a-5109-af4a-c59a4b3a7c60
2026-03-26 22:48:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7688690>
2026-03-26 22:48:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bab4716-979a-5109-af4a-c59a4b3a7c60/9bab4716-979a-5109-af4a-c59a4b3a7c60_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F0302e89491a44a56bea8c9af7253d403%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/0302e89491a44a56bea8c9af7253d403/images/large/2.jpg saved to cache
2026-03-26 22:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9bab4716-979a-5109-af4a-c59a4b3a7c60
2026-03-26 22:48:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/0302e89491a44a56bea8c9af7253d403/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 96c1c752-3a76-5b5d-a2bb-987e8e789495 with identifier: 1986136
2026-03-26 22:48:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 96c1c752-3a76-5b5d-a2bb-987e8e789495 with identifier: 1986136
2026-03-26 22:48:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 96c1c752-3a76-5b5d-a2bb-987e8e789495 with identifier: 1986136 to the API
2026-03-26 22:48:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:48:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:48:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bq/cc87341be7f0471aa8d7bbe638d37f82/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '96c1c752-3a76-5b5d-a2bb-987e8e789495',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A3 SPORTBACK',
 'odometer': 103732,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96c1c752-3a76-5b5d-a2bb-987e8e789495/96c1c752-3a76-5b5d-a2bb-987e8e789495_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 611828,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/cc87341be7f0471aa8d7bbe638d37f82/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96c1c752-3a76-5b5d-a2bb-987e8e789495/96c1c752-3a76-5b5d-a2bb-987e8e789495_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 627255,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/cc87341be7f0471aa8d7bbe638d37f82/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96c1c752-3a76-5b5d-a2bb-987e8e789495/96c1c752-3a76-5b5d-a2bb-987e8e789495_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 594307,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/cc87341be7f0471aa8d7bbe638d37f82/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96c1c752-3a76-5b5d-a2bb-987e8e789495/96c1c752-3a76-5b5d-a2bb-987e8e789495_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 698496,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/cc87341be7f0471aa8d7bbe638d37f82/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96c1c752-3a76-5b5d-a2bb-987e8e789495/96c1c752-3a76-5b5d-a2bb-987e8e789495_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 560443,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/cc87341be7f0471aa8d7bbe638d37f82/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96c1c752-3a76-5b5d-a2bb-987e8e789495/96c1c752-3a76-5b5d-a2bb-987e8e789495_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 580702,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/cc87341be7f0471aa8d7bbe638d37f82/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96c1c752-3a76-5b5d-a2bb-987e8e789495/96c1c752-3a76-5b5d-a2bb-987e8e789495_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 637926,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/cc87341be7f0471aa8d7bbe638d37f82/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96c1c752-3a76-5b5d-a2bb-987e8e789495/96c1c752-3a76-5b5d-a2bb-987e8e789495_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 701532,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/cc87341be7f0471aa8d7bbe638d37f82/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96c1c752-3a76-5b5d-a2bb-987e8e789495/96c1c752-3a76-5b5d-a2bb-987e8e789495_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 471307,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/cc87341be7f0471aa8d7bbe638d37f82/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96c1c752-3a76-5b5d-a2bb-987e8e789495/96c1c752-3a76-5b5d-a2bb-987e8e789495_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 553429,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/cc87341be7f0471aa8d7bbe638d37f82/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A3 SPORTBACK 1.0 30 TFSI 81KW S TRONIC S LINE BUS. ED',
 'transmission': 'automatic',
 'trim': '1.0 30 TFSI 81KW S TRONIC S LINE BUS. ED',
 'vin': None,
 'year': 2022}
2026-03-26 22:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986136%27 HTTP/1.1" 200 None
2026-03-26 22:48:35 [ayvens.be] INFO: Saving data for 1986136: {'created_time': 1774565315.218728, 'last_price_update_time': 1774565315.218738, 'auction_closing_time': 1775028600.0}
2026-03-26 22:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986136') HTTP/1.1" 204 0
2026-03-26 22:48:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/0302e89491a44a56bea8c9af7253d403/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/0302e89491a44a56bea8c9af7253d403/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F146e11c744584b6eb706d6bf9256fa40%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/146e11c744584b6eb706d6bf9256fa40/images/large/9.jpg not downloaded yet
2026-03-26 22:48:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/0302e89491a44a56bea8c9af7253d403/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F146e11c744584b6eb706d6bf9256fa40%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/146e11c744584b6eb706d6bf9256fa40/images/large/10.jpg not downloaded yet
2026-03-26 22:48:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/0302e89491a44a56bea8c9af7253d403/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/146e11c744584b6eb706d6bf9256fa40/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7458390>
2026-03-26 22:48:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bab4716-979a-5109-af4a-c59a4b3a7c60/9bab4716-979a-5109-af4a-c59a4b3a7c60_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F0302e89491a44a56bea8c9af7253d403%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/0302e89491a44a56bea8c9af7253d403/images/large/6.jpg saved to cache
2026-03-26 22:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9bab4716-979a-5109-af4a-c59a4b3a7c60
2026-03-26 22:48:35 [ayvens.be] INFO: Found listing with ID: 1986139
2026-03-26 22:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986139%27 HTTP/1.1" 200 None
2026-03-26 22:48:35 [ayvens.be] INFO: Scrape type for 1986139: 1
2026-03-26 22:48:35 [ayvens.be] INFO: Extracting data for car ID: 1986139
2026-03-26 22:48:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 66f2381e-79cd-5692-83e0-61e55f83ca28 with identifier: 1986139
2026-03-26 22:48:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66f2381e-79cd-5692-83e0-61e55f83ca28 with scrape type 1
2026-03-26 22:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 66f2381e-79cd-5692-83e0-61e55f83ca28
2026-03-26 22:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Ff735fa9ebfa840e3a3766bb8dd378b95%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/f735fa9ebfa840e3a3766bb8dd378b95/images/large/1.jpg not downloaded yet
2026-03-26 22:48:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/0302e89491a44a56bea8c9af7253d403/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/0302e89491a44a56bea8c9af7253d403/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Ff735fa9ebfa840e3a3766bb8dd378b95%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/f735fa9ebfa840e3a3766bb8dd378b95/images/large/2.jpg not downloaded yet
2026-03-26 22:48:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cca950>
2026-03-26 22:48:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bab4716-979a-5109-af4a-c59a4b3a7c60/9bab4716-979a-5109-af4a-c59a4b3a7c60_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F0302e89491a44a56bea8c9af7253d403%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/0302e89491a44a56bea8c9af7253d403/images/large/8.jpg saved to cache
2026-03-26 22:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9bab4716-979a-5109-af4a-c59a4b3a7c60
2026-03-26 22:48:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6d81cd0>
2026-03-26 22:48:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bab4716-979a-5109-af4a-c59a4b3a7c60/9bab4716-979a-5109-af4a-c59a4b3a7c60_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F0302e89491a44a56bea8c9af7253d403%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/0302e89491a44a56bea8c9af7253d403/images/large/7.jpg saved to cache
2026-03-26 22:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9bab4716-979a-5109-af4a-c59a4b3a7c60
2026-03-26 22:48:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/146e11c744584b6eb706d6bf9256fa40/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/146e11c744584b6eb706d6bf9256fa40/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/146e11c744584b6eb706d6bf9256fa40/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Ff735fa9ebfa840e3a3766bb8dd378b95%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/f735fa9ebfa840e3a3766bb8dd378b95/images/large/3.jpg not downloaded yet
2026-03-26 22:48:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7495850>
2026-03-26 22:48:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bab4716-979a-5109-af4a-c59a4b3a7c60/9bab4716-979a-5109-af4a-c59a4b3a7c60_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F0302e89491a44a56bea8c9af7253d403%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/0302e89491a44a56bea8c9af7253d403/images/large/5.jpg saved to cache
2026-03-26 22:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9bab4716-979a-5109-af4a-c59a4b3a7c60
2026-03-26 22:48:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77e9dd0>
2026-03-26 22:48:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bab4716-979a-5109-af4a-c59a4b3a7c60/9bab4716-979a-5109-af4a-c59a4b3a7c60_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F0302e89491a44a56bea8c9af7253d403%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/0302e89491a44a56bea8c9af7253d403/images/large/4.jpg saved to cache
2026-03-26 22:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9bab4716-979a-5109-af4a-c59a4b3a7c60
2026-03-26 22:48:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7268850>
2026-03-26 22:48:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f45ec6cc-abd5-5d95-88a5-82e3ee205a1c/f45ec6cc-abd5-5d95-88a5-82e3ee205a1c_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F146e11c744584b6eb706d6bf9256fa40%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/146e11c744584b6eb706d6bf9256fa40/images/large/1.jpg saved to cache
2026-03-26 22:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f45ec6cc-abd5-5d95-88a5-82e3ee205a1c
2026-03-26 22:48:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/146e11c744584b6eb706d6bf9256fa40/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Ff735fa9ebfa840e3a3766bb8dd378b95%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/f735fa9ebfa840e3a3766bb8dd378b95/images/large/4.jpg not downloaded yet
2026-03-26 22:48:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b741d990>
2026-03-26 22:48:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bab4716-979a-5109-af4a-c59a4b3a7c60/9bab4716-979a-5109-af4a-c59a4b3a7c60_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F0302e89491a44a56bea8c9af7253d403%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/0302e89491a44a56bea8c9af7253d403/images/large/9.jpg saved to cache
2026-03-26 22:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9bab4716-979a-5109-af4a-c59a4b3a7c60
2026-03-26 22:48:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c5ed90>
2026-03-26 22:48:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bab4716-979a-5109-af4a-c59a4b3a7c60/9bab4716-979a-5109-af4a-c59a4b3a7c60_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F0302e89491a44a56bea8c9af7253d403%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/0302e89491a44a56bea8c9af7253d403/images/large/10.jpg saved to cache
2026-03-26 22:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9bab4716-979a-5109-af4a-c59a4b3a7c60
2026-03-26 22:48:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9bab4716-979a-5109-af4a-c59a4b3a7c60, skipping ID generation
2026-03-26 22:48:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9bab4716-979a-5109-af4a-c59a4b3a7c60 with scrape type 1
2026-03-26 22:48:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9bab4716-979a-5109-af4a-c59a4b3a7c60 sending to next pipeline
2026-03-26 22:48:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 9bab4716-979a-5109-af4a-c59a4b3a7c60, identifier: 1986137
2026-03-26 22:48:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7874390>
2026-03-26 22:48:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f45ec6cc-abd5-5d95-88a5-82e3ee205a1c/f45ec6cc-abd5-5d95-88a5-82e3ee205a1c_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F146e11c744584b6eb706d6bf9256fa40%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/146e11c744584b6eb706d6bf9256fa40/images/large/2.jpg saved to cache
2026-03-26 22:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f45ec6cc-abd5-5d95-88a5-82e3ee205a1c
2026-03-26 22:48:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74acf90>
2026-03-26 22:48:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f45ec6cc-abd5-5d95-88a5-82e3ee205a1c/f45ec6cc-abd5-5d95-88a5-82e3ee205a1c_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F146e11c744584b6eb706d6bf9256fa40%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/146e11c744584b6eb706d6bf9256fa40/images/large/3.jpg saved to cache
2026-03-26 22:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f45ec6cc-abd5-5d95-88a5-82e3ee205a1c
2026-03-26 22:48:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6ded550>
2026-03-26 22:48:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f45ec6cc-abd5-5d95-88a5-82e3ee205a1c/f45ec6cc-abd5-5d95-88a5-82e3ee205a1c_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F146e11c744584b6eb706d6bf9256fa40%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/146e11c744584b6eb706d6bf9256fa40/images/large/4.jpg saved to cache
2026-03-26 22:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f45ec6cc-abd5-5d95-88a5-82e3ee205a1c
2026-03-26 22:48:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/146e11c744584b6eb706d6bf9256fa40/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/146e11c744584b6eb706d6bf9256fa40/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Ff735fa9ebfa840e3a3766bb8dd378b95%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/f735fa9ebfa840e3a3766bb8dd378b95/images/large/5.jpg not downloaded yet
2026-03-26 22:48:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 9bab4716-979a-5109-af4a-c59a4b3a7c60 with identifier: 1986137
2026-03-26 22:48:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 9bab4716-979a-5109-af4a-c59a4b3a7c60 with identifier: 1986137
2026-03-26 22:48:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 9bab4716-979a-5109-af4a-c59a4b3a7c60 with identifier: 1986137 to the API
2026-03-26 22:48:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:48:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:48:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bp/0302e89491a44a56bea8c9af7253d403/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '9bab4716-979a-5109-af4a-c59a4b3a7c60',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 120500,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bab4716-979a-5109-af4a-c59a4b3a7c60/9bab4716-979a-5109-af4a-c59a4b3a7c60_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 543073,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/0302e89491a44a56bea8c9af7253d403/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bab4716-979a-5109-af4a-c59a4b3a7c60/9bab4716-979a-5109-af4a-c59a4b3a7c60_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 533048,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/0302e89491a44a56bea8c9af7253d403/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bab4716-979a-5109-af4a-c59a4b3a7c60/9bab4716-979a-5109-af4a-c59a4b3a7c60_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 490263,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/0302e89491a44a56bea8c9af7253d403/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bab4716-979a-5109-af4a-c59a4b3a7c60/9bab4716-979a-5109-af4a-c59a4b3a7c60_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 541889,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/0302e89491a44a56bea8c9af7253d403/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bab4716-979a-5109-af4a-c59a4b3a7c60/9bab4716-979a-5109-af4a-c59a4b3a7c60_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 415169,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/0302e89491a44a56bea8c9af7253d403/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bab4716-979a-5109-af4a-c59a4b3a7c60/9bab4716-979a-5109-af4a-c59a4b3a7c60_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 310969,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/0302e89491a44a56bea8c9af7253d403/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bab4716-979a-5109-af4a-c59a4b3a7c60/9bab4716-979a-5109-af4a-c59a4b3a7c60_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 344478,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/0302e89491a44a56bea8c9af7253d403/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bab4716-979a-5109-af4a-c59a4b3a7c60/9bab4716-979a-5109-af4a-c59a4b3a7c60_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 356178,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/0302e89491a44a56bea8c9af7253d403/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bab4716-979a-5109-af4a-c59a4b3a7c60/9bab4716-979a-5109-af4a-c59a4b3a7c60_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 356976,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/0302e89491a44a56bea8c9af7253d403/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bab4716-979a-5109-af4a-c59a4b3a7c60/9bab4716-979a-5109-af4a-c59a4b3a7c60_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 343094,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/0302e89491a44a56bea8c9af7253d403/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 1.5 BLUEHDI S&S EAT8 ACTIVE PACK',
 'transmission': 'automatic',
 'trim': '1.5 BLUEHDI S&S EAT8 ACTIVE PACK',
 'vin': None,
 'year': 2022}
2026-03-26 22:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986137%27 HTTP/1.1" 200 None
2026-03-26 22:48:36 [ayvens.be] INFO: Saving data for 1986137: {'created_time': 1774565316.673343, 'last_price_update_time': 1774565316.673352, 'auction_closing_time': 1775028600.0}
2026-03-26 22:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986137') HTTP/1.1" 204 0
2026-03-26 22:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Ff735fa9ebfa840e3a3766bb8dd378b95%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/f735fa9ebfa840e3a3766bb8dd378b95/images/large/6.jpg not downloaded yet
2026-03-26 22:48:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c80490>
2026-03-26 22:48:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f45ec6cc-abd5-5d95-88a5-82e3ee205a1c/f45ec6cc-abd5-5d95-88a5-82e3ee205a1c_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F146e11c744584b6eb706d6bf9256fa40%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/146e11c744584b6eb706d6bf9256fa40/images/large/5.jpg saved to cache
2026-03-26 22:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f45ec6cc-abd5-5d95-88a5-82e3ee205a1c
2026-03-26 22:48:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/146e11c744584b6eb706d6bf9256fa40/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/146e11c744584b6eb706d6bf9256fa40/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79d6c90>
2026-03-26 22:48:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f45ec6cc-abd5-5d95-88a5-82e3ee205a1c/f45ec6cc-abd5-5d95-88a5-82e3ee205a1c_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F146e11c744584b6eb706d6bf9256fa40%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/146e11c744584b6eb706d6bf9256fa40/images/large/7.jpg saved to cache
2026-03-26 22:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f45ec6cc-abd5-5d95-88a5-82e3ee205a1c
2026-03-26 22:48:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c95f50>
2026-03-26 22:48:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f45ec6cc-abd5-5d95-88a5-82e3ee205a1c/f45ec6cc-abd5-5d95-88a5-82e3ee205a1c_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F146e11c744584b6eb706d6bf9256fa40%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/146e11c744584b6eb706d6bf9256fa40/images/large/6.jpg saved to cache
2026-03-26 22:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f45ec6cc-abd5-5d95-88a5-82e3ee205a1c
2026-03-26 22:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Ff735fa9ebfa840e3a3766bb8dd378b95%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/f735fa9ebfa840e3a3766bb8dd378b95/images/large/7.jpg not downloaded yet
2026-03-26 22:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Ff735fa9ebfa840e3a3766bb8dd378b95%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/f735fa9ebfa840e3a3766bb8dd378b95/images/large/8.jpg not downloaded yet
2026-03-26 22:48:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77c8410>
2026-03-26 22:48:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f45ec6cc-abd5-5d95-88a5-82e3ee205a1c/f45ec6cc-abd5-5d95-88a5-82e3ee205a1c_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F146e11c744584b6eb706d6bf9256fa40%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/146e11c744584b6eb706d6bf9256fa40/images/large/9.jpg saved to cache
2026-03-26 22:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f45ec6cc-abd5-5d95-88a5-82e3ee205a1c
2026-03-26 22:48:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b741d1d0>
2026-03-26 22:48:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f45ec6cc-abd5-5d95-88a5-82e3ee205a1c/f45ec6cc-abd5-5d95-88a5-82e3ee205a1c_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F146e11c744584b6eb706d6bf9256fa40%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/146e11c744584b6eb706d6bf9256fa40/images/large/8.jpg saved to cache
2026-03-26 22:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f45ec6cc-abd5-5d95-88a5-82e3ee205a1c
2026-03-26 22:48:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/146e11c744584b6eb706d6bf9256fa40/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Ff735fa9ebfa840e3a3766bb8dd378b95%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/f735fa9ebfa840e3a3766bb8dd378b95/images/large/9.jpg not downloaded yet
2026-03-26 22:48:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/f735fa9ebfa840e3a3766bb8dd378b95/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/f735fa9ebfa840e3a3766bb8dd378b95/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Ff735fa9ebfa840e3a3766bb8dd378b95%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/f735fa9ebfa840e3a3766bb8dd378b95/images/large/10.jpg not downloaded yet
2026-03-26 22:48:37 [ayvens.be] INFO: Found listing with ID: 1986140
2026-03-26 22:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986140%27 HTTP/1.1" 200 None
2026-03-26 22:48:37 [ayvens.be] INFO: Scrape type for 1986140: 1
2026-03-26 22:48:37 [ayvens.be] INFO: Extracting data for car ID: 1986140
2026-03-26 22:48:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1c9015f-5470-5609-9213-15ee159e682e with identifier: 1986140
2026-03-26 22:48:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1c9015f-5470-5609-9213-15ee159e682e with scrape type 1
2026-03-26 22:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d1c9015f-5470-5609-9213-15ee159e682e
2026-03-26 22:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F8078a2473ce24e478d0a69f8b24cbb3d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/8078a2473ce24e478d0a69f8b24cbb3d/images/large/1.jpg not downloaded yet
2026-03-26 22:48:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/f735fa9ebfa840e3a3766bb8dd378b95/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/f735fa9ebfa840e3a3766bb8dd378b95/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/f735fa9ebfa840e3a3766bb8dd378b95/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F8078a2473ce24e478d0a69f8b24cbb3d%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/8078a2473ce24e478d0a69f8b24cbb3d/images/large/2.jpg not downloaded yet
2026-03-26 22:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F8078a2473ce24e478d0a69f8b24cbb3d%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/8078a2473ce24e478d0a69f8b24cbb3d/images/large/3.jpg not downloaded yet
2026-03-26 22:48:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/f735fa9ebfa840e3a3766bb8dd378b95/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F8078a2473ce24e478d0a69f8b24cbb3d%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/8078a2473ce24e478d0a69f8b24cbb3d/images/large/4.jpg not downloaded yet
2026-03-26 22:48:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/f735fa9ebfa840e3a3766bb8dd378b95/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79f9090>
2026-03-26 22:48:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f45ec6cc-abd5-5d95-88a5-82e3ee205a1c/f45ec6cc-abd5-5d95-88a5-82e3ee205a1c_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F146e11c744584b6eb706d6bf9256fa40%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/146e11c744584b6eb706d6bf9256fa40/images/large/10.jpg saved to cache
2026-03-26 22:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f45ec6cc-abd5-5d95-88a5-82e3ee205a1c
2026-03-26 22:48:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f45ec6cc-abd5-5d95-88a5-82e3ee205a1c, skipping ID generation
2026-03-26 22:48:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f45ec6cc-abd5-5d95-88a5-82e3ee205a1c with scrape type 1
2026-03-26 22:48:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f45ec6cc-abd5-5d95-88a5-82e3ee205a1c sending to next pipeline
2026-03-26 22:48:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f45ec6cc-abd5-5d95-88a5-82e3ee205a1c, identifier: 1986138
2026-03-26 22:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F8078a2473ce24e478d0a69f8b24cbb3d%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/8078a2473ce24e478d0a69f8b24cbb3d/images/large/5.jpg not downloaded yet
2026-03-26 22:48:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f45ec6cc-abd5-5d95-88a5-82e3ee205a1c with identifier: 1986138
2026-03-26 22:48:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f45ec6cc-abd5-5d95-88a5-82e3ee205a1c with identifier: 1986138
2026-03-26 22:48:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f45ec6cc-abd5-5d95-88a5-82e3ee205a1c with identifier: 1986138 to the API
2026-03-26 22:48:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:48:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:48:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bm/146e11c744584b6eb706d6bf9256fa40/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.9L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'f45ec6cc-abd5-5d95-88a5-82e3ee205a1c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLA',
 'odometer': 44358,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f45ec6cc-abd5-5d95-88a5-82e3ee205a1c/f45ec6cc-abd5-5d95-88a5-82e3ee205a1c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 246067,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/146e11c744584b6eb706d6bf9256fa40/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f45ec6cc-abd5-5d95-88a5-82e3ee205a1c/f45ec6cc-abd5-5d95-88a5-82e3ee205a1c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 234587,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/146e11c744584b6eb706d6bf9256fa40/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f45ec6cc-abd5-5d95-88a5-82e3ee205a1c/f45ec6cc-abd5-5d95-88a5-82e3ee205a1c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 225671,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/146e11c744584b6eb706d6bf9256fa40/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f45ec6cc-abd5-5d95-88a5-82e3ee205a1c/f45ec6cc-abd5-5d95-88a5-82e3ee205a1c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 232689,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/146e11c744584b6eb706d6bf9256fa40/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f45ec6cc-abd5-5d95-88a5-82e3ee205a1c/f45ec6cc-abd5-5d95-88a5-82e3ee205a1c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 325863,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/146e11c744584b6eb706d6bf9256fa40/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f45ec6cc-abd5-5d95-88a5-82e3ee205a1c/f45ec6cc-abd5-5d95-88a5-82e3ee205a1c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 270609,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/146e11c744584b6eb706d6bf9256fa40/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f45ec6cc-abd5-5d95-88a5-82e3ee205a1c/f45ec6cc-abd5-5d95-88a5-82e3ee205a1c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 282476,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/146e11c744584b6eb706d6bf9256fa40/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f45ec6cc-abd5-5d95-88a5-82e3ee205a1c/f45ec6cc-abd5-5d95-88a5-82e3ee205a1c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 347479,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/146e11c744584b6eb706d6bf9256fa40/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f45ec6cc-abd5-5d95-88a5-82e3ee205a1c/f45ec6cc-abd5-5d95-88a5-82e3ee205a1c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 351133,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/146e11c744584b6eb706d6bf9256fa40/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f45ec6cc-abd5-5d95-88a5-82e3ee205a1c/f45ec6cc-abd5-5d95-88a5-82e3ee205a1c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 488234,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/146e11c744584b6eb706d6bf9256fa40/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLA 2.0 CLA 180 D BUS SOLUTION ESSENTIAL',
 'transmission': 'manual',
 'trim': '2.0 CLA 180 D BUS SOLUTION ESSENTIAL',
 'vin': None,
 'year': 2022}
2026-03-26 22:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986138%27 HTTP/1.1" 200 None
2026-03-26 22:48:37 [ayvens.be] INFO: Saving data for 1986138: {'created_time': 1774565317.83562, 'last_price_update_time': 1774565317.83563, 'auction_closing_time': 1775028600.0}
2026-03-26 22:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986138') HTTP/1.1" 204 0
2026-03-26 22:48:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77adf10>
2026-03-26 22:48:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66f2381e-79cd-5692-83e0-61e55f83ca28/66f2381e-79cd-5692-83e0-61e55f83ca28_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Ff735fa9ebfa840e3a3766bb8dd378b95%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/f735fa9ebfa840e3a3766bb8dd378b95/images/large/2.jpg saved to cache
2026-03-26 22:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 66f2381e-79cd-5692-83e0-61e55f83ca28
2026-03-26 22:48:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7416210>
2026-03-26 22:48:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66f2381e-79cd-5692-83e0-61e55f83ca28/66f2381e-79cd-5692-83e0-61e55f83ca28_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Ff735fa9ebfa840e3a3766bb8dd378b95%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/f735fa9ebfa840e3a3766bb8dd378b95/images/large/1.jpg saved to cache
2026-03-26 22:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 66f2381e-79cd-5692-83e0-61e55f83ca28
2026-03-26 22:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F8078a2473ce24e478d0a69f8b24cbb3d%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/8078a2473ce24e478d0a69f8b24cbb3d/images/large/6.jpg not downloaded yet
2026-03-26 22:48:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/f735fa9ebfa840e3a3766bb8dd378b95/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7407f50>
2026-03-26 22:48:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66f2381e-79cd-5692-83e0-61e55f83ca28/66f2381e-79cd-5692-83e0-61e55f83ca28_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Ff735fa9ebfa840e3a3766bb8dd378b95%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/f735fa9ebfa840e3a3766bb8dd378b95/images/large/3.jpg saved to cache
2026-03-26 22:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 66f2381e-79cd-5692-83e0-61e55f83ca28
2026-03-26 22:48:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7877490>
2026-03-26 22:48:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66f2381e-79cd-5692-83e0-61e55f83ca28/66f2381e-79cd-5692-83e0-61e55f83ca28_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Ff735fa9ebfa840e3a3766bb8dd378b95%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/f735fa9ebfa840e3a3766bb8dd378b95/images/large/5.jpg saved to cache
2026-03-26 22:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 66f2381e-79cd-5692-83e0-61e55f83ca28
2026-03-26 22:48:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b792c710>
2026-03-26 22:48:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66f2381e-79cd-5692-83e0-61e55f83ca28/66f2381e-79cd-5692-83e0-61e55f83ca28_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Ff735fa9ebfa840e3a3766bb8dd378b95%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/f735fa9ebfa840e3a3766bb8dd378b95/images/large/6.jpg saved to cache
2026-03-26 22:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 66f2381e-79cd-5692-83e0-61e55f83ca28
2026-03-26 22:48:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77697d0>
2026-03-26 22:48:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66f2381e-79cd-5692-83e0-61e55f83ca28/66f2381e-79cd-5692-83e0-61e55f83ca28_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Ff735fa9ebfa840e3a3766bb8dd378b95%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/f735fa9ebfa840e3a3766bb8dd378b95/images/large/4.jpg saved to cache
2026-03-26 22:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 66f2381e-79cd-5692-83e0-61e55f83ca28
2026-03-26 22:48:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b741ded0>
2026-03-26 22:48:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66f2381e-79cd-5692-83e0-61e55f83ca28/66f2381e-79cd-5692-83e0-61e55f83ca28_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Ff735fa9ebfa840e3a3766bb8dd378b95%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/f735fa9ebfa840e3a3766bb8dd378b95/images/large/7.jpg saved to cache
2026-03-26 22:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 66f2381e-79cd-5692-83e0-61e55f83ca28
2026-03-26 22:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F8078a2473ce24e478d0a69f8b24cbb3d%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/8078a2473ce24e478d0a69f8b24cbb3d/images/large/7.jpg not downloaded yet
2026-03-26 22:48:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/f735fa9ebfa840e3a3766bb8dd378b95/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F8078a2473ce24e478d0a69f8b24cbb3d%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/8078a2473ce24e478d0a69f8b24cbb3d/images/large/8.jpg not downloaded yet
2026-03-26 22:48:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79cd450>
2026-03-26 22:48:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66f2381e-79cd-5692-83e0-61e55f83ca28/66f2381e-79cd-5692-83e0-61e55f83ca28_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Ff735fa9ebfa840e3a3766bb8dd378b95%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/f735fa9ebfa840e3a3766bb8dd378b95/images/large/8.jpg saved to cache
2026-03-26 22:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 66f2381e-79cd-5692-83e0-61e55f83ca28
2026-03-26 22:48:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/f735fa9ebfa840e3a3766bb8dd378b95/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F8078a2473ce24e478d0a69f8b24cbb3d%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/8078a2473ce24e478d0a69f8b24cbb3d/images/large/9.jpg not downloaded yet
2026-03-26 22:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F8078a2473ce24e478d0a69f8b24cbb3d%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/8078a2473ce24e478d0a69f8b24cbb3d/images/large/10.jpg not downloaded yet
2026-03-26 22:48:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/8078a2473ce24e478d0a69f8b24cbb3d/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/8078a2473ce24e478d0a69f8b24cbb3d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/8078a2473ce24e478d0a69f8b24cbb3d/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:38 [ayvens.be] INFO: Found listing with ID: 1986141
2026-03-26 22:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986141%27 HTTP/1.1" 200 None
2026-03-26 22:48:38 [ayvens.be] INFO: Scrape type for 1986141: 1
2026-03-26 22:48:38 [ayvens.be] INFO: Extracting data for car ID: 1986141
2026-03-26 22:48:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ae910bb-e2b2-52f6-a7e1-0a9ef3bceb8a with identifier: 1986141
2026-03-26 22:48:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ae910bb-e2b2-52f6-a7e1-0a9ef3bceb8a with scrape type 1
2026-03-26 22:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9ae910bb-e2b2-52f6-a7e1-0a9ef3bceb8a
2026-03-26 22:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F53edc88422914c69970622cfa144f780%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/53edc88422914c69970622cfa144f780/images/large/1.jpg not downloaded yet
2026-03-26 22:48:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7402590>
2026-03-26 22:48:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66f2381e-79cd-5692-83e0-61e55f83ca28/66f2381e-79cd-5692-83e0-61e55f83ca28_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Ff735fa9ebfa840e3a3766bb8dd378b95%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/f735fa9ebfa840e3a3766bb8dd378b95/images/large/9.jpg saved to cache
2026-03-26 22:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 66f2381e-79cd-5692-83e0-61e55f83ca28
2026-03-26 22:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F53edc88422914c69970622cfa144f780%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/53edc88422914c69970622cfa144f780/images/large/2.jpg not downloaded yet
2026-03-26 22:48:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7437010>
2026-03-26 22:48:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66f2381e-79cd-5692-83e0-61e55f83ca28/66f2381e-79cd-5692-83e0-61e55f83ca28_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Ff735fa9ebfa840e3a3766bb8dd378b95%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/f735fa9ebfa840e3a3766bb8dd378b95/images/large/10.jpg saved to cache
2026-03-26 22:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 66f2381e-79cd-5692-83e0-61e55f83ca28
2026-03-26 22:48:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 66f2381e-79cd-5692-83e0-61e55f83ca28, skipping ID generation
2026-03-26 22:48:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66f2381e-79cd-5692-83e0-61e55f83ca28 with scrape type 1
2026-03-26 22:48:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 66f2381e-79cd-5692-83e0-61e55f83ca28 sending to next pipeline
2026-03-26 22:48:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 66f2381e-79cd-5692-83e0-61e55f83ca28, identifier: 1986139
2026-03-26 22:48:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/8078a2473ce24e478d0a69f8b24cbb3d/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F53edc88422914c69970622cfa144f780%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/53edc88422914c69970622cfa144f780/images/large/3.jpg not downloaded yet
2026-03-26 22:48:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 66f2381e-79cd-5692-83e0-61e55f83ca28 with identifier: 1986139
2026-03-26 22:48:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 66f2381e-79cd-5692-83e0-61e55f83ca28 with identifier: 1986139
2026-03-26 22:48:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 66f2381e-79cd-5692-83e0-61e55f83ca28 with identifier: 1986139 to the API
2026-03-26 22:48:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:48:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:48:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bp/f735fa9ebfa840e3a3766bb8dd378b95/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '66f2381e-79cd-5692-83e0-61e55f83ca28',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 53360,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66f2381e-79cd-5692-83e0-61e55f83ca28/66f2381e-79cd-5692-83e0-61e55f83ca28_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 523538,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/f735fa9ebfa840e3a3766bb8dd378b95/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66f2381e-79cd-5692-83e0-61e55f83ca28/66f2381e-79cd-5692-83e0-61e55f83ca28_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 570855,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/f735fa9ebfa840e3a3766bb8dd378b95/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66f2381e-79cd-5692-83e0-61e55f83ca28/66f2381e-79cd-5692-83e0-61e55f83ca28_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 473327,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/f735fa9ebfa840e3a3766bb8dd378b95/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66f2381e-79cd-5692-83e0-61e55f83ca28/66f2381e-79cd-5692-83e0-61e55f83ca28_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 534250,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/f735fa9ebfa840e3a3766bb8dd378b95/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66f2381e-79cd-5692-83e0-61e55f83ca28/66f2381e-79cd-5692-83e0-61e55f83ca28_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 342173,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/f735fa9ebfa840e3a3766bb8dd378b95/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66f2381e-79cd-5692-83e0-61e55f83ca28/66f2381e-79cd-5692-83e0-61e55f83ca28_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 339516,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/f735fa9ebfa840e3a3766bb8dd378b95/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66f2381e-79cd-5692-83e0-61e55f83ca28/66f2381e-79cd-5692-83e0-61e55f83ca28_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 348091,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/f735fa9ebfa840e3a3766bb8dd378b95/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66f2381e-79cd-5692-83e0-61e55f83ca28/66f2381e-79cd-5692-83e0-61e55f83ca28_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 410851,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/f735fa9ebfa840e3a3766bb8dd378b95/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66f2381e-79cd-5692-83e0-61e55f83ca28/66f2381e-79cd-5692-83e0-61e55f83ca28_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 287102,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/f735fa9ebfa840e3a3766bb8dd378b95/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66f2381e-79cd-5692-83e0-61e55f83ca28/66f2381e-79cd-5692-83e0-61e55f83ca28_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 474640,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/f735fa9ebfa840e3a3766bb8dd378b95/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 1.6 PHEV 225 E-AUTO8 GT PACK',
 'transmission': 'automatic',
 'trim': '1.6 PHEV 225 E-AUTO8 GT PACK',
 'vin': None,
 'year': 2022}
2026-03-26 22:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986139%27 HTTP/1.1" 200 None
2026-03-26 22:48:39 [ayvens.be] INFO: Saving data for 1986139: {'created_time': 1774565319.198519, 'last_price_update_time': 1774565319.198529, 'auction_closing_time': 1775028600.0}
2026-03-26 22:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986139') HTTP/1.1" 204 0
2026-03-26 22:48:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76ecb90>
2026-03-26 22:48:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1c9015f-5470-5609-9213-15ee159e682e/d1c9015f-5470-5609-9213-15ee159e682e_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F8078a2473ce24e478d0a69f8b24cbb3d%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/8078a2473ce24e478d0a69f8b24cbb3d/images/large/2.jpg saved to cache
2026-03-26 22:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d1c9015f-5470-5609-9213-15ee159e682e
2026-03-26 22:48:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b764b0d0>
2026-03-26 22:48:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1c9015f-5470-5609-9213-15ee159e682e/d1c9015f-5470-5609-9213-15ee159e682e_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F8078a2473ce24e478d0a69f8b24cbb3d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/8078a2473ce24e478d0a69f8b24cbb3d/images/large/1.jpg saved to cache
2026-03-26 22:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d1c9015f-5470-5609-9213-15ee159e682e
2026-03-26 22:48:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b787ea50>
2026-03-26 22:48:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1c9015f-5470-5609-9213-15ee159e682e/d1c9015f-5470-5609-9213-15ee159e682e_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F8078a2473ce24e478d0a69f8b24cbb3d%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/8078a2473ce24e478d0a69f8b24cbb3d/images/large/3.jpg saved to cache
2026-03-26 22:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d1c9015f-5470-5609-9213-15ee159e682e
2026-03-26 22:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F53edc88422914c69970622cfa144f780%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/53edc88422914c69970622cfa144f780/images/large/4.jpg not downloaded yet
2026-03-26 22:48:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7497b90>
2026-03-26 22:48:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1c9015f-5470-5609-9213-15ee159e682e/d1c9015f-5470-5609-9213-15ee159e682e_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F8078a2473ce24e478d0a69f8b24cbb3d%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/8078a2473ce24e478d0a69f8b24cbb3d/images/large/4.jpg saved to cache
2026-03-26 22:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d1c9015f-5470-5609-9213-15ee159e682e
2026-03-26 22:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F53edc88422914c69970622cfa144f780%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/53edc88422914c69970622cfa144f780/images/large/5.jpg not downloaded yet
2026-03-26 22:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F53edc88422914c69970622cfa144f780%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/53edc88422914c69970622cfa144f780/images/large/6.jpg not downloaded yet
2026-03-26 22:48:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/8078a2473ce24e478d0a69f8b24cbb3d/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/8078a2473ce24e478d0a69f8b24cbb3d/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F53edc88422914c69970622cfa144f780%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/53edc88422914c69970622cfa144f780/images/large/7.jpg not downloaded yet
2026-03-26 22:48:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/8078a2473ce24e478d0a69f8b24cbb3d/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F53edc88422914c69970622cfa144f780%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/53edc88422914c69970622cfa144f780/images/large/8.jpg not downloaded yet
2026-03-26 22:48:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/8078a2473ce24e478d0a69f8b24cbb3d/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F53edc88422914c69970622cfa144f780%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/53edc88422914c69970622cfa144f780/images/large/9.jpg not downloaded yet
2026-03-26 22:48:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/8078a2473ce24e478d0a69f8b24cbb3d/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/8078a2473ce24e478d0a69f8b24cbb3d/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/53edc88422914c69970622cfa144f780/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F53edc88422914c69970622cfa144f780%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/53edc88422914c69970622cfa144f780/images/large/10.jpg not downloaded yet
2026-03-26 22:48:39 [ayvens.be] INFO: Found listing with ID: 1986142
2026-03-26 22:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986142%27 HTTP/1.1" 200 None
2026-03-26 22:48:39 [ayvens.be] INFO: Scrape type for 1986142: 1
2026-03-26 22:48:39 [ayvens.be] INFO: Extracting data for car ID: 1986142
2026-03-26 22:48:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e65c056-1282-55f7-8325-6f8c8c3e02ea with identifier: 1986142
2026-03-26 22:48:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e65c056-1282-55f7-8325-6f8c8c3e02ea with scrape type 1
2026-03-26 22:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5e65c056-1282-55f7-8325-6f8c8c3e02ea
2026-03-26 22:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xf%252F92775a9b3a7e4722bffc6d5799773daa%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xf/92775a9b3a7e4722bffc6d5799773daa/images/large/1.jpg not downloaded yet
2026-03-26 22:48:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/53edc88422914c69970622cfa144f780/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xf%252F92775a9b3a7e4722bffc6d5799773daa%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xf/92775a9b3a7e4722bffc6d5799773daa/images/large/2.jpg not downloaded yet
2026-03-26 22:48:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c5d850>
2026-03-26 22:48:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1c9015f-5470-5609-9213-15ee159e682e/d1c9015f-5470-5609-9213-15ee159e682e_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F8078a2473ce24e478d0a69f8b24cbb3d%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/8078a2473ce24e478d0a69f8b24cbb3d/images/large/5.jpg saved to cache
2026-03-26 22:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d1c9015f-5470-5609-9213-15ee159e682e
2026-03-26 22:48:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7726a90>
2026-03-26 22:48:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1c9015f-5470-5609-9213-15ee159e682e/d1c9015f-5470-5609-9213-15ee159e682e_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F8078a2473ce24e478d0a69f8b24cbb3d%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/8078a2473ce24e478d0a69f8b24cbb3d/images/large/7.jpg saved to cache
2026-03-26 22:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d1c9015f-5470-5609-9213-15ee159e682e
2026-03-26 22:48:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80cad3d110>
2026-03-26 22:48:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1c9015f-5470-5609-9213-15ee159e682e/d1c9015f-5470-5609-9213-15ee159e682e_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F8078a2473ce24e478d0a69f8b24cbb3d%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/8078a2473ce24e478d0a69f8b24cbb3d/images/large/6.jpg saved to cache
2026-03-26 22:48:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d1c9015f-5470-5609-9213-15ee159e682e
2026-03-26 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xf%252F92775a9b3a7e4722bffc6d5799773daa%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xf/92775a9b3a7e4722bffc6d5799773daa/images/large/3.jpg not downloaded yet
2026-03-26 22:48:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7724dd0>
2026-03-26 22:48:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1c9015f-5470-5609-9213-15ee159e682e/d1c9015f-5470-5609-9213-15ee159e682e_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F8078a2473ce24e478d0a69f8b24cbb3d%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/8078a2473ce24e478d0a69f8b24cbb3d/images/large/10.jpg saved to cache
2026-03-26 22:48:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d1c9015f-5470-5609-9213-15ee159e682e
2026-03-26 22:48:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b78c32d0>
2026-03-26 22:48:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1c9015f-5470-5609-9213-15ee159e682e/d1c9015f-5470-5609-9213-15ee159e682e_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F8078a2473ce24e478d0a69f8b24cbb3d%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/8078a2473ce24e478d0a69f8b24cbb3d/images/large/8.jpg saved to cache
2026-03-26 22:48:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d1c9015f-5470-5609-9213-15ee159e682e
2026-03-26 22:48:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b742af50>
2026-03-26 22:48:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1c9015f-5470-5609-9213-15ee159e682e/d1c9015f-5470-5609-9213-15ee159e682e_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F8078a2473ce24e478d0a69f8b24cbb3d%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/8078a2473ce24e478d0a69f8b24cbb3d/images/large/9.jpg saved to cache
2026-03-26 22:48:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d1c9015f-5470-5609-9213-15ee159e682e
2026-03-26 22:48:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d1c9015f-5470-5609-9213-15ee159e682e, skipping ID generation
2026-03-26 22:48:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1c9015f-5470-5609-9213-15ee159e682e with scrape type 1
2026-03-26 22:48:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d1c9015f-5470-5609-9213-15ee159e682e sending to next pipeline
2026-03-26 22:48:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d1c9015f-5470-5609-9213-15ee159e682e, identifier: 1986140
2026-03-26 22:48:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b764b390>
2026-03-26 22:48:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ae910bb-e2b2-52f6-a7e1-0a9ef3bceb8a/9ae910bb-e2b2-52f6-a7e1-0a9ef3bceb8a_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F53edc88422914c69970622cfa144f780%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/53edc88422914c69970622cfa144f780/images/large/1.jpg saved to cache
2026-03-26 22:48:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9ae910bb-e2b2-52f6-a7e1-0a9ef3bceb8a
2026-03-26 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xf%252F92775a9b3a7e4722bffc6d5799773daa%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xf/92775a9b3a7e4722bffc6d5799773daa/images/large/4.jpg not downloaded yet
2026-03-26 22:48:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d1c9015f-5470-5609-9213-15ee159e682e with identifier: 1986140
2026-03-26 22:48:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d1c9015f-5470-5609-9213-15ee159e682e with identifier: 1986140
2026-03-26 22:48:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d1c9015f-5470-5609-9213-15ee159e682e with identifier: 1986140 to the API
2026-03-26 22:48:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:48:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:48:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bp/8078a2473ce24e478d0a69f8b24cbb3d/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'd1c9015f-5470-5609-9213-15ee159e682e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'ARKANA',
 'odometer': 142459,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1c9015f-5470-5609-9213-15ee159e682e/d1c9015f-5470-5609-9213-15ee159e682e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 732455,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/8078a2473ce24e478d0a69f8b24cbb3d/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1c9015f-5470-5609-9213-15ee159e682e/d1c9015f-5470-5609-9213-15ee159e682e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 736926,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/8078a2473ce24e478d0a69f8b24cbb3d/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1c9015f-5470-5609-9213-15ee159e682e/d1c9015f-5470-5609-9213-15ee159e682e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 713897,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/8078a2473ce24e478d0a69f8b24cbb3d/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1c9015f-5470-5609-9213-15ee159e682e/d1c9015f-5470-5609-9213-15ee159e682e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 738626,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/8078a2473ce24e478d0a69f8b24cbb3d/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1c9015f-5470-5609-9213-15ee159e682e/d1c9015f-5470-5609-9213-15ee159e682e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 741313,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/8078a2473ce24e478d0a69f8b24cbb3d/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1c9015f-5470-5609-9213-15ee159e682e/d1c9015f-5470-5609-9213-15ee159e682e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 776887,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/8078a2473ce24e478d0a69f8b24cbb3d/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1c9015f-5470-5609-9213-15ee159e682e/d1c9015f-5470-5609-9213-15ee159e682e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 632592,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/8078a2473ce24e478d0a69f8b24cbb3d/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1c9015f-5470-5609-9213-15ee159e682e/d1c9015f-5470-5609-9213-15ee159e682e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 784529,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/8078a2473ce24e478d0a69f8b24cbb3d/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1c9015f-5470-5609-9213-15ee159e682e/d1c9015f-5470-5609-9213-15ee159e682e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 806382,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/8078a2473ce24e478d0a69f8b24cbb3d/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1c9015f-5470-5609-9213-15ee159e682e/d1c9015f-5470-5609-9213-15ee159e682e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 773312,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/8078a2473ce24e478d0a69f8b24cbb3d/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT ARKANA 1.6 E-TECH 145 INTENS',
 'transmission': 'automatic',
 'trim': '1.6 E-TECH 145 INTENS',
 'vin': None,
 'year': 2022}
2026-03-26 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986140%27 HTTP/1.1" 200 None
2026-03-26 22:48:40 [ayvens.be] INFO: Saving data for 1986140: {'created_time': 1774565320.95289, 'last_price_update_time': 1774565320.9529, 'auction_closing_time': 1775028600.0}
2026-03-26 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986140') HTTP/1.1" 204 0
2026-03-26 22:48:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76e3f90>
2026-03-26 22:48:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ae910bb-e2b2-52f6-a7e1-0a9ef3bceb8a/9ae910bb-e2b2-52f6-a7e1-0a9ef3bceb8a_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F53edc88422914c69970622cfa144f780%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/53edc88422914c69970622cfa144f780/images/large/2.jpg saved to cache
2026-03-26 22:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9ae910bb-e2b2-52f6-a7e1-0a9ef3bceb8a
2026-03-26 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xf%252F92775a9b3a7e4722bffc6d5799773daa%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xf/92775a9b3a7e4722bffc6d5799773daa/images/large/5.jpg not downloaded yet
2026-03-26 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xf%252F92775a9b3a7e4722bffc6d5799773daa%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xf/92775a9b3a7e4722bffc6d5799773daa/images/large/6.jpg not downloaded yet
2026-03-26 22:48:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/53edc88422914c69970622cfa144f780/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/53edc88422914c69970622cfa144f780/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/53edc88422914c69970622cfa144f780/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/53edc88422914c69970622cfa144f780/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xf%252F92775a9b3a7e4722bffc6d5799773daa%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xf/92775a9b3a7e4722bffc6d5799773daa/images/large/7.jpg not downloaded yet
2026-03-26 22:48:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/53edc88422914c69970622cfa144f780/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/53edc88422914c69970622cfa144f780/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xf%252F92775a9b3a7e4722bffc6d5799773daa%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xf/92775a9b3a7e4722bffc6d5799773daa/images/large/8.jpg not downloaded yet
2026-03-26 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xf%252F92775a9b3a7e4722bffc6d5799773daa%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xf/92775a9b3a7e4722bffc6d5799773daa/images/large/9.jpg not downloaded yet
2026-03-26 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xf%252F92775a9b3a7e4722bffc6d5799773daa%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xf/92775a9b3a7e4722bffc6d5799773daa/images/large/10.jpg not downloaded yet
2026-03-26 22:48:41 [ayvens.be] INFO: Found listing with ID: 1986143
2026-03-26 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986143%27 HTTP/1.1" 200 None
2026-03-26 22:48:41 [ayvens.be] INFO: Scrape type for 1986143: 1
2026-03-26 22:48:41 [ayvens.be] INFO: Extracting data for car ID: 1986143
2026-03-26 22:48:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b7435c1-7f64-5601-9a51-3e9d97336ce1 with identifier: 1986143
2026-03-26 22:48:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b7435c1-7f64-5601-9a51-3e9d97336ce1 with scrape type 1
2026-03-26 22:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5b7435c1-7f64-5601-9a51-3e9d97336ce1
2026-03-26 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fd277857b65b4406293608682a34c203f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/d277857b65b4406293608682a34c203f/images/large/1.jpg not downloaded yet
2026-03-26 22:48:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xf/92775a9b3a7e4722bffc6d5799773daa/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fd277857b65b4406293608682a34c203f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/d277857b65b4406293608682a34c203f/images/large/2.jpg not downloaded yet
2026-03-26 22:48:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7452050>
2026-03-26 22:48:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ae910bb-e2b2-52f6-a7e1-0a9ef3bceb8a/9ae910bb-e2b2-52f6-a7e1-0a9ef3bceb8a_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F53edc88422914c69970622cfa144f780%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/53edc88422914c69970622cfa144f780/images/large/5.jpg saved to cache
2026-03-26 22:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9ae910bb-e2b2-52f6-a7e1-0a9ef3bceb8a
2026-03-26 22:48:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c69590>
2026-03-26 22:48:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ae910bb-e2b2-52f6-a7e1-0a9ef3bceb8a/9ae910bb-e2b2-52f6-a7e1-0a9ef3bceb8a_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F53edc88422914c69970622cfa144f780%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/53edc88422914c69970622cfa144f780/images/large/6.jpg saved to cache
2026-03-26 22:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9ae910bb-e2b2-52f6-a7e1-0a9ef3bceb8a
2026-03-26 22:48:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79460d0>
2026-03-26 22:48:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ae910bb-e2b2-52f6-a7e1-0a9ef3bceb8a/9ae910bb-e2b2-52f6-a7e1-0a9ef3bceb8a_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F53edc88422914c69970622cfa144f780%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/53edc88422914c69970622cfa144f780/images/large/3.jpg saved to cache
2026-03-26 22:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9ae910bb-e2b2-52f6-a7e1-0a9ef3bceb8a
2026-03-26 22:48:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6d73e90>
2026-03-26 22:48:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ae910bb-e2b2-52f6-a7e1-0a9ef3bceb8a/9ae910bb-e2b2-52f6-a7e1-0a9ef3bceb8a_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F53edc88422914c69970622cfa144f780%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/53edc88422914c69970622cfa144f780/images/large/7.jpg saved to cache
2026-03-26 22:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9ae910bb-e2b2-52f6-a7e1-0a9ef3bceb8a
2026-03-26 22:48:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c5f0d0>
2026-03-26 22:48:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ae910bb-e2b2-52f6-a7e1-0a9ef3bceb8a/9ae910bb-e2b2-52f6-a7e1-0a9ef3bceb8a_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F53edc88422914c69970622cfa144f780%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/53edc88422914c69970622cfa144f780/images/large/4.jpg saved to cache
2026-03-26 22:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9ae910bb-e2b2-52f6-a7e1-0a9ef3bceb8a
2026-03-26 22:48:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c5eed0>
2026-03-26 22:48:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ae910bb-e2b2-52f6-a7e1-0a9ef3bceb8a/9ae910bb-e2b2-52f6-a7e1-0a9ef3bceb8a_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F53edc88422914c69970622cfa144f780%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/53edc88422914c69970622cfa144f780/images/large/8.jpg saved to cache
2026-03-26 22:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9ae910bb-e2b2-52f6-a7e1-0a9ef3bceb8a
2026-03-26 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fd277857b65b4406293608682a34c203f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/d277857b65b4406293608682a34c203f/images/large/3.jpg not downloaded yet
2026-03-26 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fd277857b65b4406293608682a34c203f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/d277857b65b4406293608682a34c203f/images/large/4.jpg not downloaded yet
2026-03-26 22:48:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/53edc88422914c69970622cfa144f780/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/53edc88422914c69970622cfa144f780/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fd277857b65b4406293608682a34c203f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/d277857b65b4406293608682a34c203f/images/large/5.jpg not downloaded yet
2026-03-26 22:48:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b727d510>
2026-03-26 22:48:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e65c056-1282-55f7-8325-6f8c8c3e02ea/5e65c056-1282-55f7-8325-6f8c8c3e02ea_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xf%252F92775a9b3a7e4722bffc6d5799773daa%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xf/92775a9b3a7e4722bffc6d5799773daa/images/large/3.jpg saved to cache
2026-03-26 22:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5e65c056-1282-55f7-8325-6f8c8c3e02ea
2026-03-26 22:48:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xf/92775a9b3a7e4722bffc6d5799773daa/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fd277857b65b4406293608682a34c203f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/d277857b65b4406293608682a34c203f/images/large/6.jpg not downloaded yet
2026-03-26 22:48:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xf/92775a9b3a7e4722bffc6d5799773daa/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xf/92775a9b3a7e4722bffc6d5799773daa/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xf/92775a9b3a7e4722bffc6d5799773daa/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fd277857b65b4406293608682a34c203f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/d277857b65b4406293608682a34c203f/images/large/7.jpg not downloaded yet
2026-03-26 22:48:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xf/92775a9b3a7e4722bffc6d5799773daa/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74bf190>
2026-03-26 22:48:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ae910bb-e2b2-52f6-a7e1-0a9ef3bceb8a/9ae910bb-e2b2-52f6-a7e1-0a9ef3bceb8a_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F53edc88422914c69970622cfa144f780%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/53edc88422914c69970622cfa144f780/images/large/9.jpg saved to cache
2026-03-26 22:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9ae910bb-e2b2-52f6-a7e1-0a9ef3bceb8a
2026-03-26 22:48:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c82410>
2026-03-26 22:48:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ae910bb-e2b2-52f6-a7e1-0a9ef3bceb8a/9ae910bb-e2b2-52f6-a7e1-0a9ef3bceb8a_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F53edc88422914c69970622cfa144f780%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/53edc88422914c69970622cfa144f780/images/large/10.jpg saved to cache
2026-03-26 22:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9ae910bb-e2b2-52f6-a7e1-0a9ef3bceb8a
2026-03-26 22:48:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9ae910bb-e2b2-52f6-a7e1-0a9ef3bceb8a, skipping ID generation
2026-03-26 22:48:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ae910bb-e2b2-52f6-a7e1-0a9ef3bceb8a with scrape type 1
2026-03-26 22:48:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9ae910bb-e2b2-52f6-a7e1-0a9ef3bceb8a sending to next pipeline
2026-03-26 22:48:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 9ae910bb-e2b2-52f6-a7e1-0a9ef3bceb8a, identifier: 1986141
2026-03-26 22:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fd277857b65b4406293608682a34c203f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/d277857b65b4406293608682a34c203f/images/large/8.jpg not downloaded yet
2026-03-26 22:48:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 9ae910bb-e2b2-52f6-a7e1-0a9ef3bceb8a with identifier: 1986141
2026-03-26 22:48:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 9ae910bb-e2b2-52f6-a7e1-0a9ef3bceb8a with identifier: 1986141
2026-03-26 22:48:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 9ae910bb-e2b2-52f6-a7e1-0a9ef3bceb8a with identifier: 1986141 to the API
2026-03-26 22:48:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:48:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:48:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bh/53edc88422914c69970622cfa144f780/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '9ae910bb-e2b2-52f6-a7e1-0a9ef3bceb8a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 87463,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ae910bb-e2b2-52f6-a7e1-0a9ef3bceb8a/9ae910bb-e2b2-52f6-a7e1-0a9ef3bceb8a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 756379,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/53edc88422914c69970622cfa144f780/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ae910bb-e2b2-52f6-a7e1-0a9ef3bceb8a/9ae910bb-e2b2-52f6-a7e1-0a9ef3bceb8a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 781407,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/53edc88422914c69970622cfa144f780/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ae910bb-e2b2-52f6-a7e1-0a9ef3bceb8a/9ae910bb-e2b2-52f6-a7e1-0a9ef3bceb8a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 692731,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/53edc88422914c69970622cfa144f780/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ae910bb-e2b2-52f6-a7e1-0a9ef3bceb8a/9ae910bb-e2b2-52f6-a7e1-0a9ef3bceb8a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 782620,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/53edc88422914c69970622cfa144f780/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ae910bb-e2b2-52f6-a7e1-0a9ef3bceb8a/9ae910bb-e2b2-52f6-a7e1-0a9ef3bceb8a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 650144,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/53edc88422914c69970622cfa144f780/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ae910bb-e2b2-52f6-a7e1-0a9ef3bceb8a/9ae910bb-e2b2-52f6-a7e1-0a9ef3bceb8a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 545378,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/53edc88422914c69970622cfa144f780/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ae910bb-e2b2-52f6-a7e1-0a9ef3bceb8a/9ae910bb-e2b2-52f6-a7e1-0a9ef3bceb8a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 655564,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/53edc88422914c69970622cfa144f780/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ae910bb-e2b2-52f6-a7e1-0a9ef3bceb8a/9ae910bb-e2b2-52f6-a7e1-0a9ef3bceb8a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 773788,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/53edc88422914c69970622cfa144f780/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ae910bb-e2b2-52f6-a7e1-0a9ef3bceb8a/9ae910bb-e2b2-52f6-a7e1-0a9ef3bceb8a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 369211,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/53edc88422914c69970622cfa144f780/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ae910bb-e2b2-52f6-a7e1-0a9ef3bceb8a/9ae910bb-e2b2-52f6-a7e1-0a9ef3bceb8a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 289347,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/53edc88422914c69970622cfa144f780/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T3 R-DESIGN AUTO',
 'transmission': 'automatic',
 'trim': '1.5 T3 R-DESIGN AUTO',
 'vin': None,
 'year': 2021}
2026-03-26 22:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986141%27 HTTP/1.1" 200 None
2026-03-26 22:48:42 [ayvens.be] INFO: Saving data for 1986141: {'created_time': 1774565322.685231, 'last_price_update_time': 1774565322.685241, 'auction_closing_time': 1775028600.0}
2026-03-26 22:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986141') HTTP/1.1" 204 0
2026-03-26 22:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fd277857b65b4406293608682a34c203f%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/d277857b65b4406293608682a34c203f/images/large/9.jpg not downloaded yet
2026-03-26 22:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fd277857b65b4406293608682a34c203f%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/d277857b65b4406293608682a34c203f/images/large/10.jpg not downloaded yet
2026-03-26 22:48:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7649150>
2026-03-26 22:48:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e65c056-1282-55f7-8325-6f8c8c3e02ea/5e65c056-1282-55f7-8325-6f8c8c3e02ea_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xf%252F92775a9b3a7e4722bffc6d5799773daa%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xf/92775a9b3a7e4722bffc6d5799773daa/images/large/5.jpg saved to cache
2026-03-26 22:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5e65c056-1282-55f7-8325-6f8c8c3e02ea
2026-03-26 22:48:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e01810>
2026-03-26 22:48:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e65c056-1282-55f7-8325-6f8c8c3e02ea/5e65c056-1282-55f7-8325-6f8c8c3e02ea_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xf%252F92775a9b3a7e4722bffc6d5799773daa%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xf/92775a9b3a7e4722bffc6d5799773daa/images/large/6.jpg saved to cache
2026-03-26 22:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5e65c056-1282-55f7-8325-6f8c8c3e02ea
2026-03-26 22:48:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b78c1290>
2026-03-26 22:48:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e65c056-1282-55f7-8325-6f8c8c3e02ea/5e65c056-1282-55f7-8325-6f8c8c3e02ea_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xf%252F92775a9b3a7e4722bffc6d5799773daa%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xf/92775a9b3a7e4722bffc6d5799773daa/images/large/1.jpg saved to cache
2026-03-26 22:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5e65c056-1282-55f7-8325-6f8c8c3e02ea
2026-03-26 22:48:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e02710>
2026-03-26 22:48:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e65c056-1282-55f7-8325-6f8c8c3e02ea/5e65c056-1282-55f7-8325-6f8c8c3e02ea_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xf%252F92775a9b3a7e4722bffc6d5799773daa%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xf/92775a9b3a7e4722bffc6d5799773daa/images/large/2.jpg saved to cache
2026-03-26 22:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5e65c056-1282-55f7-8325-6f8c8c3e02ea
2026-03-26 22:48:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e45350>
2026-03-26 22:48:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e65c056-1282-55f7-8325-6f8c8c3e02ea/5e65c056-1282-55f7-8325-6f8c8c3e02ea_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xf%252F92775a9b3a7e4722bffc6d5799773daa%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xf/92775a9b3a7e4722bffc6d5799773daa/images/large/4.jpg saved to cache
2026-03-26 22:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5e65c056-1282-55f7-8325-6f8c8c3e02ea
2026-03-26 22:48:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xf/92775a9b3a7e4722bffc6d5799773daa/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/d277857b65b4406293608682a34c203f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:43 [ayvens.be] INFO: Found listing with ID: 1986144
2026-03-26 22:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986144%27 HTTP/1.1" 200 None
2026-03-26 22:48:43 [ayvens.be] INFO: Scrape type for 1986144: 1
2026-03-26 22:48:43 [ayvens.be] INFO: Extracting data for car ID: 1986144
2026-03-26 22:48:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b834dd5-7b94-506e-b4eb-02906db770f6 with identifier: 1986144
2026-03-26 22:48:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b834dd5-7b94-506e-b4eb-02906db770f6 with scrape type 1
2026-03-26 22:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3b834dd5-7b94-506e-b4eb-02906db770f6
2026-03-26 22:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gg%252Fec6df0a2fc804206a12cfb25fdcd34c3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gg/ec6df0a2fc804206a12cfb25fdcd34c3/images/large/1.jpg not downloaded yet
2026-03-26 22:48:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xf/92775a9b3a7e4722bffc6d5799773daa/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/d277857b65b4406293608682a34c203f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gg%252Fec6df0a2fc804206a12cfb25fdcd34c3%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gg/ec6df0a2fc804206a12cfb25fdcd34c3/images/large/2.jpg not downloaded yet
2026-03-26 22:48:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/d277857b65b4406293608682a34c203f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/d277857b65b4406293608682a34c203f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xf/92775a9b3a7e4722bffc6d5799773daa/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gg%252Fec6df0a2fc804206a12cfb25fdcd34c3%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gg/ec6df0a2fc804206a12cfb25fdcd34c3/images/large/3.jpg not downloaded yet
2026-03-26 22:48:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xf/92775a9b3a7e4722bffc6d5799773daa/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gg%252Fec6df0a2fc804206a12cfb25fdcd34c3%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gg/ec6df0a2fc804206a12cfb25fdcd34c3/images/large/4.jpg not downloaded yet
2026-03-26 22:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gg%252Fec6df0a2fc804206a12cfb25fdcd34c3%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gg/ec6df0a2fc804206a12cfb25fdcd34c3/images/large/5.jpg not downloaded yet
2026-03-26 22:48:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e00350>
2026-03-26 22:48:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e65c056-1282-55f7-8325-6f8c8c3e02ea/5e65c056-1282-55f7-8325-6f8c8c3e02ea_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xf%252F92775a9b3a7e4722bffc6d5799773daa%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xf/92775a9b3a7e4722bffc6d5799773daa/images/large/9.jpg saved to cache
2026-03-26 22:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5e65c056-1282-55f7-8325-6f8c8c3e02ea
2026-03-26 22:48:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cbc4d0>
2026-03-26 22:48:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b7435c1-7f64-5601-9a51-3e9d97336ce1/5b7435c1-7f64-5601-9a51-3e9d97336ce1_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fd277857b65b4406293608682a34c203f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/d277857b65b4406293608682a34c203f/images/large/1.jpg saved to cache
2026-03-26 22:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5b7435c1-7f64-5601-9a51-3e9d97336ce1
2026-03-26 22:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gg%252Fec6df0a2fc804206a12cfb25fdcd34c3%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gg/ec6df0a2fc804206a12cfb25fdcd34c3/images/large/6.jpg not downloaded yet
2026-03-26 22:48:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b728c390>
2026-03-26 22:48:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e65c056-1282-55f7-8325-6f8c8c3e02ea/5e65c056-1282-55f7-8325-6f8c8c3e02ea_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xf%252F92775a9b3a7e4722bffc6d5799773daa%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xf/92775a9b3a7e4722bffc6d5799773daa/images/large/10.jpg saved to cache
2026-03-26 22:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5e65c056-1282-55f7-8325-6f8c8c3e02ea
2026-03-26 22:48:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b745b090>
2026-03-26 22:48:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b7435c1-7f64-5601-9a51-3e9d97336ce1/5b7435c1-7f64-5601-9a51-3e9d97336ce1_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fd277857b65b4406293608682a34c203f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/d277857b65b4406293608682a34c203f/images/large/2.jpg saved to cache
2026-03-26 22:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5b7435c1-7f64-5601-9a51-3e9d97336ce1
2026-03-26 22:48:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/d277857b65b4406293608682a34c203f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gg%252Fec6df0a2fc804206a12cfb25fdcd34c3%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gg/ec6df0a2fc804206a12cfb25fdcd34c3/images/large/7.jpg not downloaded yet
2026-03-26 22:48:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gg/ec6df0a2fc804206a12cfb25fdcd34c3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gg/ec6df0a2fc804206a12cfb25fdcd34c3/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/d277857b65b4406293608682a34c203f/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gg%252Fec6df0a2fc804206a12cfb25fdcd34c3%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gg/ec6df0a2fc804206a12cfb25fdcd34c3/images/large/8.jpg not downloaded yet
2026-03-26 22:48:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7268a10>
2026-03-26 22:48:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b7435c1-7f64-5601-9a51-3e9d97336ce1/5b7435c1-7f64-5601-9a51-3e9d97336ce1_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fd277857b65b4406293608682a34c203f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/d277857b65b4406293608682a34c203f/images/large/4.jpg saved to cache
2026-03-26 22:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5b7435c1-7f64-5601-9a51-3e9d97336ce1
2026-03-26 22:48:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b744b850>
2026-03-26 22:48:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b7435c1-7f64-5601-9a51-3e9d97336ce1/5b7435c1-7f64-5601-9a51-3e9d97336ce1_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fd277857b65b4406293608682a34c203f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/d277857b65b4406293608682a34c203f/images/large/3.jpg saved to cache
2026-03-26 22:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5b7435c1-7f64-5601-9a51-3e9d97336ce1
2026-03-26 22:48:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd3ba150>
2026-03-26 22:48:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e65c056-1282-55f7-8325-6f8c8c3e02ea/5e65c056-1282-55f7-8325-6f8c8c3e02ea_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xf%252F92775a9b3a7e4722bffc6d5799773daa%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xf/92775a9b3a7e4722bffc6d5799773daa/images/large/7.jpg saved to cache
2026-03-26 22:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5e65c056-1282-55f7-8325-6f8c8c3e02ea
2026-03-26 22:48:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7448f10>
2026-03-26 22:48:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e65c056-1282-55f7-8325-6f8c8c3e02ea/5e65c056-1282-55f7-8325-6f8c8c3e02ea_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xf%252F92775a9b3a7e4722bffc6d5799773daa%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xf/92775a9b3a7e4722bffc6d5799773daa/images/large/8.jpg saved to cache
2026-03-26 22:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5e65c056-1282-55f7-8325-6f8c8c3e02ea
2026-03-26 22:48:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5e65c056-1282-55f7-8325-6f8c8c3e02ea, skipping ID generation
2026-03-26 22:48:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e65c056-1282-55f7-8325-6f8c8c3e02ea with scrape type 1
2026-03-26 22:48:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5e65c056-1282-55f7-8325-6f8c8c3e02ea sending to next pipeline
2026-03-26 22:48:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 5e65c056-1282-55f7-8325-6f8c8c3e02ea, identifier: 1986142
2026-03-26 22:48:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 5e65c056-1282-55f7-8325-6f8c8c3e02ea with identifier: 1986142
2026-03-26 22:48:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 5e65c056-1282-55f7-8325-6f8c8c3e02ea with identifier: 1986142
2026-03-26 22:48:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 5e65c056-1282-55f7-8325-6f8c8c3e02ea with identifier: 1986142 to the API
2026-03-26 22:48:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:48:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:48:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1xf/92775a9b3a7e4722bffc6d5799773daa/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '5e65c056-1282-55f7-8325-6f8c8c3e02ea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'KODIAQ',
 'odometer': 136463,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e65c056-1282-55f7-8325-6f8c8c3e02ea/5e65c056-1282-55f7-8325-6f8c8c3e02ea_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 582041,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xf/92775a9b3a7e4722bffc6d5799773daa/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e65c056-1282-55f7-8325-6f8c8c3e02ea/5e65c056-1282-55f7-8325-6f8c8c3e02ea_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 572497,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xf/92775a9b3a7e4722bffc6d5799773daa/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e65c056-1282-55f7-8325-6f8c8c3e02ea/5e65c056-1282-55f7-8325-6f8c8c3e02ea_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 540336,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xf/92775a9b3a7e4722bffc6d5799773daa/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e65c056-1282-55f7-8325-6f8c8c3e02ea/5e65c056-1282-55f7-8325-6f8c8c3e02ea_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 645605,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xf/92775a9b3a7e4722bffc6d5799773daa/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e65c056-1282-55f7-8325-6f8c8c3e02ea/5e65c056-1282-55f7-8325-6f8c8c3e02ea_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 557298,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xf/92775a9b3a7e4722bffc6d5799773daa/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e65c056-1282-55f7-8325-6f8c8c3e02ea/5e65c056-1282-55f7-8325-6f8c8c3e02ea_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 519591,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xf/92775a9b3a7e4722bffc6d5799773daa/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e65c056-1282-55f7-8325-6f8c8c3e02ea/5e65c056-1282-55f7-8325-6f8c8c3e02ea_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 624327,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xf/92775a9b3a7e4722bffc6d5799773daa/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e65c056-1282-55f7-8325-6f8c8c3e02ea/5e65c056-1282-55f7-8325-6f8c8c3e02ea_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 711549,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xf/92775a9b3a7e4722bffc6d5799773daa/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e65c056-1282-55f7-8325-6f8c8c3e02ea/5e65c056-1282-55f7-8325-6f8c8c3e02ea_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 381268,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xf/92775a9b3a7e4722bffc6d5799773daa/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e65c056-1282-55f7-8325-6f8c8c3e02ea/5e65c056-1282-55f7-8325-6f8c8c3e02ea_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 508744,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xf/92775a9b3a7e4722bffc6d5799773daa/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-12',
 'seats_number': 7,
 'seller_name': None,
 'title': 'SKODA KODIAQ 1.5 TSI ACT Ambition DSG',
 'transmission': 'automatic',
 'trim': '1.5 TSI ACT Ambition DSG',
 'vin': None,
 'year': 2019}
2026-03-26 22:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986142%27 HTTP/1.1" 200 None
2026-03-26 22:48:44 [ayvens.be] INFO: Saving data for 1986142: {'created_time': 1774565324.447227, 'last_price_update_time': 1774565324.447238, 'auction_closing_time': 1775028600.0}
2026-03-26 22:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986142') HTTP/1.1" 204 0
2026-03-26 22:48:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/d277857b65b4406293608682a34c203f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/d277857b65b4406293608682a34c203f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/d277857b65b4406293608682a34c203f/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/d277857b65b4406293608682a34c203f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gg%252Fec6df0a2fc804206a12cfb25fdcd34c3%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gg/ec6df0a2fc804206a12cfb25fdcd34c3/images/large/9.jpg not downloaded yet
2026-03-26 22:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gg%252Fec6df0a2fc804206a12cfb25fdcd34c3%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gg/ec6df0a2fc804206a12cfb25fdcd34c3/images/large/10.jpg not downloaded yet
2026-03-26 22:48:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gg/ec6df0a2fc804206a12cfb25fdcd34c3/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76a5d90>
2026-03-26 22:48:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b7435c1-7f64-5601-9a51-3e9d97336ce1/5b7435c1-7f64-5601-9a51-3e9d97336ce1_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fd277857b65b4406293608682a34c203f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/d277857b65b4406293608682a34c203f/images/large/8.jpg saved to cache
2026-03-26 22:48:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5b7435c1-7f64-5601-9a51-3e9d97336ce1
2026-03-26 22:48:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7408b90>
2026-03-26 22:48:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b834dd5-7b94-506e-b4eb-02906db770f6/3b834dd5-7b94-506e-b4eb-02906db770f6_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gg%252Fec6df0a2fc804206a12cfb25fdcd34c3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gg/ec6df0a2fc804206a12cfb25fdcd34c3/images/large/1.jpg saved to cache
2026-03-26 22:48:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3b834dd5-7b94-506e-b4eb-02906db770f6
2026-03-26 22:48:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b742a990>
2026-03-26 22:48:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b834dd5-7b94-506e-b4eb-02906db770f6/3b834dd5-7b94-506e-b4eb-02906db770f6_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gg%252Fec6df0a2fc804206a12cfb25fdcd34c3%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gg/ec6df0a2fc804206a12cfb25fdcd34c3/images/large/2.jpg saved to cache
2026-03-26 22:48:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3b834dd5-7b94-506e-b4eb-02906db770f6
2026-03-26 22:48:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6df3f10>
2026-03-26 22:48:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b7435c1-7f64-5601-9a51-3e9d97336ce1/5b7435c1-7f64-5601-9a51-3e9d97336ce1_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fd277857b65b4406293608682a34c203f%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/d277857b65b4406293608682a34c203f/images/large/10.jpg saved to cache
2026-03-26 22:48:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5b7435c1-7f64-5601-9a51-3e9d97336ce1
2026-03-26 22:48:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gg/ec6df0a2fc804206a12cfb25fdcd34c3/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:44 [ayvens.be] INFO: Found listing with ID: 1986145
2026-03-26 22:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986145%27 HTTP/1.1" 200 None
2026-03-26 22:48:44 [ayvens.be] INFO: Scrape type for 1986145: 1
2026-03-26 22:48:44 [ayvens.be] INFO: Extracting data for car ID: 1986145
2026-03-26 22:48:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 63b9ce0e-e3fe-579f-b9db-d6d7cdbe1edf with identifier: 1986145
2026-03-26 22:48:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63b9ce0e-e3fe-579f-b9db-d6d7cdbe1edf with scrape type 1
2026-03-26 22:48:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 63b9ce0e-e3fe-579f-b9db-d6d7cdbe1edf
2026-03-26 22:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F04610896946546c4b341a538485cb656%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/04610896946546c4b341a538485cb656/images/large/1.jpg not downloaded yet
2026-03-26 22:48:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gg/ec6df0a2fc804206a12cfb25fdcd34c3/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gg/ec6df0a2fc804206a12cfb25fdcd34c3/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F04610896946546c4b341a538485cb656%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/04610896946546c4b341a538485cb656/images/large/2.jpg not downloaded yet
2026-03-26 22:48:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6d81350>
2026-03-26 22:48:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b7435c1-7f64-5601-9a51-3e9d97336ce1/5b7435c1-7f64-5601-9a51-3e9d97336ce1_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fd277857b65b4406293608682a34c203f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/d277857b65b4406293608682a34c203f/images/large/7.jpg saved to cache
2026-03-26 22:48:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5b7435c1-7f64-5601-9a51-3e9d97336ce1
2026-03-26 22:48:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7492e90>
2026-03-26 22:48:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b7435c1-7f64-5601-9a51-3e9d97336ce1/5b7435c1-7f64-5601-9a51-3e9d97336ce1_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fd277857b65b4406293608682a34c203f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/d277857b65b4406293608682a34c203f/images/large/6.jpg saved to cache
2026-03-26 22:48:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5b7435c1-7f64-5601-9a51-3e9d97336ce1
2026-03-26 22:48:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7411350>
2026-03-26 22:48:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b7435c1-7f64-5601-9a51-3e9d97336ce1/5b7435c1-7f64-5601-9a51-3e9d97336ce1_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fd277857b65b4406293608682a34c203f%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/d277857b65b4406293608682a34c203f/images/large/9.jpg saved to cache
2026-03-26 22:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5b7435c1-7f64-5601-9a51-3e9d97336ce1
2026-03-26 22:48:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cca8d0>
2026-03-26 22:48:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b7435c1-7f64-5601-9a51-3e9d97336ce1/5b7435c1-7f64-5601-9a51-3e9d97336ce1_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fd277857b65b4406293608682a34c203f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/d277857b65b4406293608682a34c203f/images/large/5.jpg saved to cache
2026-03-26 22:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5b7435c1-7f64-5601-9a51-3e9d97336ce1
2026-03-26 22:48:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5b7435c1-7f64-5601-9a51-3e9d97336ce1, skipping ID generation
2026-03-26 22:48:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b7435c1-7f64-5601-9a51-3e9d97336ce1 with scrape type 1
2026-03-26 22:48:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5b7435c1-7f64-5601-9a51-3e9d97336ce1 sending to next pipeline
2026-03-26 22:48:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 5b7435c1-7f64-5601-9a51-3e9d97336ce1, identifier: 1986143
2026-03-26 22:48:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7778550>
2026-03-26 22:48:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b834dd5-7b94-506e-b4eb-02906db770f6/3b834dd5-7b94-506e-b4eb-02906db770f6_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gg%252Fec6df0a2fc804206a12cfb25fdcd34c3%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gg/ec6df0a2fc804206a12cfb25fdcd34c3/images/large/3.jpg saved to cache
2026-03-26 22:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3b834dd5-7b94-506e-b4eb-02906db770f6
2026-03-26 22:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F04610896946546c4b341a538485cb656%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/04610896946546c4b341a538485cb656/images/large/3.jpg not downloaded yet
2026-03-26 22:48:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 5b7435c1-7f64-5601-9a51-3e9d97336ce1 with identifier: 1986143
2026-03-26 22:48:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 5b7435c1-7f64-5601-9a51-3e9d97336ce1 with identifier: 1986143
2026-03-26 22:48:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 5b7435c1-7f64-5601-9a51-3e9d97336ce1 with identifier: 1986143 to the API
2026-03-26 22:48:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:48:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:48:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bj/d277857b65b4406293608682a34c203f/images/large/5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'electric',
 'id': '5b7435c1-7f64-5601-9a51-3e9d97336ce1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'IX3',
 'odometer': 101961,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b7435c1-7f64-5601-9a51-3e9d97336ce1/5b7435c1-7f64-5601-9a51-3e9d97336ce1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 389595,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/d277857b65b4406293608682a34c203f/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b7435c1-7f64-5601-9a51-3e9d97336ce1/5b7435c1-7f64-5601-9a51-3e9d97336ce1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 441693,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/d277857b65b4406293608682a34c203f/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b7435c1-7f64-5601-9a51-3e9d97336ce1/5b7435c1-7f64-5601-9a51-3e9d97336ce1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 460363,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/d277857b65b4406293608682a34c203f/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b7435c1-7f64-5601-9a51-3e9d97336ce1/5b7435c1-7f64-5601-9a51-3e9d97336ce1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 459778,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/d277857b65b4406293608682a34c203f/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b7435c1-7f64-5601-9a51-3e9d97336ce1/5b7435c1-7f64-5601-9a51-3e9d97336ce1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 340150,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/d277857b65b4406293608682a34c203f/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b7435c1-7f64-5601-9a51-3e9d97336ce1/5b7435c1-7f64-5601-9a51-3e9d97336ce1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 339390,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/d277857b65b4406293608682a34c203f/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b7435c1-7f64-5601-9a51-3e9d97336ce1/5b7435c1-7f64-5601-9a51-3e9d97336ce1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 448784,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/d277857b65b4406293608682a34c203f/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b7435c1-7f64-5601-9a51-3e9d97336ce1/5b7435c1-7f64-5601-9a51-3e9d97336ce1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 372950,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/d277857b65b4406293608682a34c203f/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b7435c1-7f64-5601-9a51-3e9d97336ce1/5b7435c1-7f64-5601-9a51-3e9d97336ce1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 337249,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/d277857b65b4406293608682a34c203f/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b7435c1-7f64-5601-9a51-3e9d97336ce1/5b7435c1-7f64-5601-9a51-3e9d97336ce1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 221266,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/d277857b65b4406293608682a34c203f/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW IX3 80KWH AUTO',
 'transmission': 'automatic',
 'trim': '80KWH AUTO',
 'vin': None,
 'year': 2021}
2026-03-26 22:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986143%27 HTTP/1.1" 200 None
2026-03-26 22:48:45 [ayvens.be] INFO: Saving data for 1986143: {'created_time': 1774565325.608648, 'last_price_update_time': 1774565325.608657, 'auction_closing_time': 1775028600.0}
2026-03-26 22:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986143') HTTP/1.1" 204 0
2026-03-26 22:48:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gg/ec6df0a2fc804206a12cfb25fdcd34c3/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gg/ec6df0a2fc804206a12cfb25fdcd34c3/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F04610896946546c4b341a538485cb656%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/04610896946546c4b341a538485cb656/images/large/4.jpg not downloaded yet
2026-03-26 22:48:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7402290>
2026-03-26 22:48:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b834dd5-7b94-506e-b4eb-02906db770f6/3b834dd5-7b94-506e-b4eb-02906db770f6_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gg%252Fec6df0a2fc804206a12cfb25fdcd34c3%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gg/ec6df0a2fc804206a12cfb25fdcd34c3/images/large/4.jpg saved to cache
2026-03-26 22:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3b834dd5-7b94-506e-b4eb-02906db770f6
2026-03-26 22:48:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77d6510>
2026-03-26 22:48:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b834dd5-7b94-506e-b4eb-02906db770f6/3b834dd5-7b94-506e-b4eb-02906db770f6_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gg%252Fec6df0a2fc804206a12cfb25fdcd34c3%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gg/ec6df0a2fc804206a12cfb25fdcd34c3/images/large/5.jpg saved to cache
2026-03-26 22:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3b834dd5-7b94-506e-b4eb-02906db770f6
2026-03-26 22:48:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7778410>
2026-03-26 22:48:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b834dd5-7b94-506e-b4eb-02906db770f6/3b834dd5-7b94-506e-b4eb-02906db770f6_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gg%252Fec6df0a2fc804206a12cfb25fdcd34c3%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gg/ec6df0a2fc804206a12cfb25fdcd34c3/images/large/6.jpg saved to cache
2026-03-26 22:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3b834dd5-7b94-506e-b4eb-02906db770f6
2026-03-26 22:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F04610896946546c4b341a538485cb656%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/04610896946546c4b341a538485cb656/images/large/5.jpg not downloaded yet
2026-03-26 22:48:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gg/ec6df0a2fc804206a12cfb25fdcd34c3/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gg/ec6df0a2fc804206a12cfb25fdcd34c3/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F04610896946546c4b341a538485cb656%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/04610896946546c4b341a538485cb656/images/large/6.jpg not downloaded yet
2026-03-26 22:48:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b777b850>
2026-03-26 22:48:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b834dd5-7b94-506e-b4eb-02906db770f6/3b834dd5-7b94-506e-b4eb-02906db770f6_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gg%252Fec6df0a2fc804206a12cfb25fdcd34c3%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gg/ec6df0a2fc804206a12cfb25fdcd34c3/images/large/7.jpg saved to cache
2026-03-26 22:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3b834dd5-7b94-506e-b4eb-02906db770f6
2026-03-26 22:48:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b72784d0>
2026-03-26 22:48:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b834dd5-7b94-506e-b4eb-02906db770f6/3b834dd5-7b94-506e-b4eb-02906db770f6_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gg%252Fec6df0a2fc804206a12cfb25fdcd34c3%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gg/ec6df0a2fc804206a12cfb25fdcd34c3/images/large/8.jpg saved to cache
2026-03-26 22:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3b834dd5-7b94-506e-b4eb-02906db770f6
2026-03-26 22:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F04610896946546c4b341a538485cb656%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/04610896946546c4b341a538485cb656/images/large/7.jpg not downloaded yet
2026-03-26 22:48:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/04610896946546c4b341a538485cb656/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/04610896946546c4b341a538485cb656/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77eb0d0>
2026-03-26 22:48:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b834dd5-7b94-506e-b4eb-02906db770f6/3b834dd5-7b94-506e-b4eb-02906db770f6_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gg%252Fec6df0a2fc804206a12cfb25fdcd34c3%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gg/ec6df0a2fc804206a12cfb25fdcd34c3/images/large/9.jpg saved to cache
2026-03-26 22:48:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3b834dd5-7b94-506e-b4eb-02906db770f6
2026-03-26 22:48:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e45c10>
2026-03-26 22:48:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b834dd5-7b94-506e-b4eb-02906db770f6/3b834dd5-7b94-506e-b4eb-02906db770f6_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gg%252Fec6df0a2fc804206a12cfb25fdcd34c3%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gg/ec6df0a2fc804206a12cfb25fdcd34c3/images/large/10.jpg saved to cache
2026-03-26 22:48:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3b834dd5-7b94-506e-b4eb-02906db770f6
2026-03-26 22:48:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3b834dd5-7b94-506e-b4eb-02906db770f6, skipping ID generation
2026-03-26 22:48:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b834dd5-7b94-506e-b4eb-02906db770f6 with scrape type 1
2026-03-26 22:48:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3b834dd5-7b94-506e-b4eb-02906db770f6 sending to next pipeline
2026-03-26 22:48:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 3b834dd5-7b94-506e-b4eb-02906db770f6, identifier: 1986144
2026-03-26 22:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F04610896946546c4b341a538485cb656%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/04610896946546c4b341a538485cb656/images/large/8.jpg not downloaded yet
2026-03-26 22:48:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 3b834dd5-7b94-506e-b4eb-02906db770f6 with identifier: 1986144
2026-03-26 22:48:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 3b834dd5-7b94-506e-b4eb-02906db770f6 with identifier: 1986144
2026-03-26 22:48:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 3b834dd5-7b94-506e-b4eb-02906db770f6 with identifier: 1986144 to the API
2026-03-26 22:48:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:48:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:48:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2gg/ec6df0a2fc804206a12cfb25fdcd34c3/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'electric',
 'id': '3b834dd5-7b94-506e-b4eb-02906db770f6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'IX2',
 'odometer': 17645,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b834dd5-7b94-506e-b4eb-02906db770f6/3b834dd5-7b94-506e-b4eb-02906db770f6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 227288,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gg/ec6df0a2fc804206a12cfb25fdcd34c3/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b834dd5-7b94-506e-b4eb-02906db770f6/3b834dd5-7b94-506e-b4eb-02906db770f6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 222228,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gg/ec6df0a2fc804206a12cfb25fdcd34c3/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b834dd5-7b94-506e-b4eb-02906db770f6/3b834dd5-7b94-506e-b4eb-02906db770f6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 221626,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gg/ec6df0a2fc804206a12cfb25fdcd34c3/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b834dd5-7b94-506e-b4eb-02906db770f6/3b834dd5-7b94-506e-b4eb-02906db770f6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 235173,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gg/ec6df0a2fc804206a12cfb25fdcd34c3/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b834dd5-7b94-506e-b4eb-02906db770f6/3b834dd5-7b94-506e-b4eb-02906db770f6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 277339,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gg/ec6df0a2fc804206a12cfb25fdcd34c3/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b834dd5-7b94-506e-b4eb-02906db770f6/3b834dd5-7b94-506e-b4eb-02906db770f6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 279557,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gg/ec6df0a2fc804206a12cfb25fdcd34c3/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b834dd5-7b94-506e-b4eb-02906db770f6/3b834dd5-7b94-506e-b4eb-02906db770f6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 263027,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gg/ec6df0a2fc804206a12cfb25fdcd34c3/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b834dd5-7b94-506e-b4eb-02906db770f6/3b834dd5-7b94-506e-b4eb-02906db770f6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 319482,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gg/ec6df0a2fc804206a12cfb25fdcd34c3/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b834dd5-7b94-506e-b4eb-02906db770f6/3b834dd5-7b94-506e-b4eb-02906db770f6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 363517,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gg/ec6df0a2fc804206a12cfb25fdcd34c3/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b834dd5-7b94-506e-b4eb-02906db770f6/3b834dd5-7b94-506e-b4eb-02906db770f6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 333306,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gg/ec6df0a2fc804206a12cfb25fdcd34c3/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-12-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW IX2 BEV 67KWH EDRIVE20 150KW',
 'transmission': 'automatic',
 'trim': 'BEV 67KWH EDRIVE20 150KW',
 'vin': None,
 'year': 2024}
2026-03-26 22:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986144%27 HTTP/1.1" 200 None
2026-03-26 22:48:46 [ayvens.be] INFO: Saving data for 1986144: {'created_time': 1774565326.683038, 'last_price_update_time': 1774565326.68305, 'auction_closing_time': 1775028600.0}
2026-03-26 22:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986144') HTTP/1.1" 204 0
2026-03-26 22:48:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/04610896946546c4b341a538485cb656/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/04610896946546c4b341a538485cb656/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F04610896946546c4b341a538485cb656%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/04610896946546c4b341a538485cb656/images/large/9.jpg not downloaded yet
2026-03-26 22:48:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7981050>
2026-03-26 22:48:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63b9ce0e-e3fe-579f-b9db-d6d7cdbe1edf/63b9ce0e-e3fe-579f-b9db-d6d7cdbe1edf_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F04610896946546c4b341a538485cb656%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/04610896946546c4b341a538485cb656/images/large/2.jpg saved to cache
2026-03-26 22:48:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 63b9ce0e-e3fe-579f-b9db-d6d7cdbe1edf
2026-03-26 22:48:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b748a810>
2026-03-26 22:48:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63b9ce0e-e3fe-579f-b9db-d6d7cdbe1edf/63b9ce0e-e3fe-579f-b9db-d6d7cdbe1edf_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F04610896946546c4b341a538485cb656%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/04610896946546c4b341a538485cb656/images/large/1.jpg saved to cache
2026-03-26 22:48:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 63b9ce0e-e3fe-579f-b9db-d6d7cdbe1edf
2026-03-26 22:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F04610896946546c4b341a538485cb656%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/04610896946546c4b341a538485cb656/images/large/10.jpg not downloaded yet
2026-03-26 22:48:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77791d0>
2026-03-26 22:48:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63b9ce0e-e3fe-579f-b9db-d6d7cdbe1edf/63b9ce0e-e3fe-579f-b9db-d6d7cdbe1edf_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F04610896946546c4b341a538485cb656%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/04610896946546c4b341a538485cb656/images/large/3.jpg saved to cache
2026-03-26 22:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 63b9ce0e-e3fe-579f-b9db-d6d7cdbe1edf
2026-03-26 22:48:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e45790>
2026-03-26 22:48:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63b9ce0e-e3fe-579f-b9db-d6d7cdbe1edf/63b9ce0e-e3fe-579f-b9db-d6d7cdbe1edf_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F04610896946546c4b341a538485cb656%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/04610896946546c4b341a538485cb656/images/large/4.jpg saved to cache
2026-03-26 22:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 63b9ce0e-e3fe-579f-b9db-d6d7cdbe1edf
2026-03-26 22:48:47 [ayvens.be] INFO: Found listing with ID: 1986146
2026-03-26 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986146%27 HTTP/1.1" 200 None
2026-03-26 22:48:47 [ayvens.be] INFO: Scrape type for 1986146: 1
2026-03-26 22:48:47 [ayvens.be] INFO: Extracting data for car ID: 1986146
2026-03-26 22:48:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e37d7dba-48b8-5a24-b004-5fc9981c1360 with identifier: 1986146
2026-03-26 22:48:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e37d7dba-48b8-5a24-b004-5fc9981c1360 with scrape type 1
2026-03-26 22:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e37d7dba-48b8-5a24-b004-5fc9981c1360
2026-03-26 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F0991d797ce3144ee914f5e9fd3f15a34%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/0991d797ce3144ee914f5e9fd3f15a34/images/large/1.jpg not downloaded yet
2026-03-26 22:48:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/04610896946546c4b341a538485cb656/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/04610896946546c4b341a538485cb656/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F0991d797ce3144ee914f5e9fd3f15a34%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/0991d797ce3144ee914f5e9fd3f15a34/images/large/2.jpg not downloaded yet
2026-03-26 22:48:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/04610896946546c4b341a538485cb656/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F0991d797ce3144ee914f5e9fd3f15a34%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/0991d797ce3144ee914f5e9fd3f15a34/images/large/3.jpg not downloaded yet
2026-03-26 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F0991d797ce3144ee914f5e9fd3f15a34%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/0991d797ce3144ee914f5e9fd3f15a34/images/large/4.jpg not downloaded yet
2026-03-26 22:48:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/04610896946546c4b341a538485cb656/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F0991d797ce3144ee914f5e9fd3f15a34%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/0991d797ce3144ee914f5e9fd3f15a34/images/large/5.jpg not downloaded yet
2026-03-26 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F0991d797ce3144ee914f5e9fd3f15a34%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/0991d797ce3144ee914f5e9fd3f15a34/images/large/6.jpg not downloaded yet
2026-03-26 22:48:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/04610896946546c4b341a538485cb656/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F0991d797ce3144ee914f5e9fd3f15a34%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/0991d797ce3144ee914f5e9fd3f15a34/images/large/7.jpg not downloaded yet
2026-03-26 22:48:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd0d0bd0>
2026-03-26 22:48:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63b9ce0e-e3fe-579f-b9db-d6d7cdbe1edf/63b9ce0e-e3fe-579f-b9db-d6d7cdbe1edf_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F04610896946546c4b341a538485cb656%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/04610896946546c4b341a538485cb656/images/large/5.jpg saved to cache
2026-03-26 22:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 63b9ce0e-e3fe-579f-b9db-d6d7cdbe1edf
2026-03-26 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F0991d797ce3144ee914f5e9fd3f15a34%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/0991d797ce3144ee914f5e9fd3f15a34/images/large/8.jpg not downloaded yet
2026-03-26 22:48:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76c5390>
2026-03-26 22:48:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63b9ce0e-e3fe-579f-b9db-d6d7cdbe1edf/63b9ce0e-e3fe-579f-b9db-d6d7cdbe1edf_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F04610896946546c4b341a538485cb656%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/04610896946546c4b341a538485cb656/images/large/6.jpg saved to cache
2026-03-26 22:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 63b9ce0e-e3fe-579f-b9db-d6d7cdbe1edf
2026-03-26 22:48:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7495410>
2026-03-26 22:48:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63b9ce0e-e3fe-579f-b9db-d6d7cdbe1edf/63b9ce0e-e3fe-579f-b9db-d6d7cdbe1edf_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F04610896946546c4b341a538485cb656%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/04610896946546c4b341a538485cb656/images/large/7.jpg saved to cache
2026-03-26 22:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 63b9ce0e-e3fe-579f-b9db-d6d7cdbe1edf
2026-03-26 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F0991d797ce3144ee914f5e9fd3f15a34%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/0991d797ce3144ee914f5e9fd3f15a34/images/large/9.jpg not downloaded yet
2026-03-26 22:48:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e008d0>
2026-03-26 22:48:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63b9ce0e-e3fe-579f-b9db-d6d7cdbe1edf/63b9ce0e-e3fe-579f-b9db-d6d7cdbe1edf_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F04610896946546c4b341a538485cb656%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/04610896946546c4b341a538485cb656/images/large/8.jpg saved to cache
2026-03-26 22:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 63b9ce0e-e3fe-579f-b9db-d6d7cdbe1edf
2026-03-26 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F0991d797ce3144ee914f5e9fd3f15a34%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/0991d797ce3144ee914f5e9fd3f15a34/images/large/10.jpg not downloaded yet
2026-03-26 22:48:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79d4c10>
2026-03-26 22:48:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63b9ce0e-e3fe-579f-b9db-d6d7cdbe1edf/63b9ce0e-e3fe-579f-b9db-d6d7cdbe1edf_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F04610896946546c4b341a538485cb656%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/04610896946546c4b341a538485cb656/images/large/9.jpg saved to cache
2026-03-26 22:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 63b9ce0e-e3fe-579f-b9db-d6d7cdbe1edf
2026-03-26 22:48:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/04610896946546c4b341a538485cb656/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:47 [ayvens.be] INFO: Found listing with ID: 1986147
2026-03-26 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986147%27 HTTP/1.1" 200 None
2026-03-26 22:48:47 [ayvens.be] INFO: Scrape type for 1986147: 1
2026-03-26 22:48:47 [ayvens.be] INFO: Extracting data for car ID: 1986147
2026-03-26 22:48:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc55da5f-d10b-5e98-a1c4-ea4db4a25646 with identifier: 1986147
2026-03-26 22:48:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc55da5f-d10b-5e98-a1c4-ea4db4a25646 with scrape type 1
2026-03-26 22:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bc55da5f-d10b-5e98-a1c4-ea4db4a25646
2026-03-26 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F635d2d4d613846d28410eb8a5f749f2c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/635d2d4d613846d28410eb8a5f749f2c/images/large/1.jpg not downloaded yet
2026-03-26 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F635d2d4d613846d28410eb8a5f749f2c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/635d2d4d613846d28410eb8a5f749f2c/images/large/2.jpg not downloaded yet
2026-03-26 22:48:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/0991d797ce3144ee914f5e9fd3f15a34/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F635d2d4d613846d28410eb8a5f749f2c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/635d2d4d613846d28410eb8a5f749f2c/images/large/3.jpg not downloaded yet
2026-03-26 22:48:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/0991d797ce3144ee914f5e9fd3f15a34/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/0991d797ce3144ee914f5e9fd3f15a34/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/0991d797ce3144ee914f5e9fd3f15a34/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/0991d797ce3144ee914f5e9fd3f15a34/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/0991d797ce3144ee914f5e9fd3f15a34/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F635d2d4d613846d28410eb8a5f749f2c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/635d2d4d613846d28410eb8a5f749f2c/images/large/4.jpg not downloaded yet
2026-03-26 22:48:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/0991d797ce3144ee914f5e9fd3f15a34/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F635d2d4d613846d28410eb8a5f749f2c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/635d2d4d613846d28410eb8a5f749f2c/images/large/5.jpg not downloaded yet
2026-03-26 22:48:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7429ad0>
2026-03-26 22:48:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63b9ce0e-e3fe-579f-b9db-d6d7cdbe1edf/63b9ce0e-e3fe-579f-b9db-d6d7cdbe1edf_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F04610896946546c4b341a538485cb656%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/04610896946546c4b341a538485cb656/images/large/10.jpg saved to cache
2026-03-26 22:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 63b9ce0e-e3fe-579f-b9db-d6d7cdbe1edf
2026-03-26 22:48:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 63b9ce0e-e3fe-579f-b9db-d6d7cdbe1edf, skipping ID generation
2026-03-26 22:48:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63b9ce0e-e3fe-579f-b9db-d6d7cdbe1edf with scrape type 1
2026-03-26 22:48:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 63b9ce0e-e3fe-579f-b9db-d6d7cdbe1edf sending to next pipeline
2026-03-26 22:48:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 63b9ce0e-e3fe-579f-b9db-d6d7cdbe1edf, identifier: 1986145
2026-03-26 22:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F635d2d4d613846d28410eb8a5f749f2c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/635d2d4d613846d28410eb8a5f749f2c/images/large/6.jpg not downloaded yet
2026-03-26 22:48:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 63b9ce0e-e3fe-579f-b9db-d6d7cdbe1edf with identifier: 1986145
2026-03-26 22:48:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 63b9ce0e-e3fe-579f-b9db-d6d7cdbe1edf with identifier: 1986145
2026-03-26 22:48:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 63b9ce0e-e3fe-579f-b9db-d6d7cdbe1edf with identifier: 1986145 to the API
2026-03-26 22:48:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:48:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:48:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1ys/04610896946546c4b341a538485cb656/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 29,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '63b9ce0e-e3fe-579f-b9db-d6d7cdbe1edf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLASS GLE DIESEL (W167)',
 'odometer': 140549,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63b9ce0e-e3fe-579f-b9db-d6d7cdbe1edf/63b9ce0e-e3fe-579f-b9db-d6d7cdbe1edf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 272572,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/04610896946546c4b341a538485cb656/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63b9ce0e-e3fe-579f-b9db-d6d7cdbe1edf/63b9ce0e-e3fe-579f-b9db-d6d7cdbe1edf_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 283561,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/04610896946546c4b341a538485cb656/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63b9ce0e-e3fe-579f-b9db-d6d7cdbe1edf/63b9ce0e-e3fe-579f-b9db-d6d7cdbe1edf_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 312336,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/04610896946546c4b341a538485cb656/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63b9ce0e-e3fe-579f-b9db-d6d7cdbe1edf/63b9ce0e-e3fe-579f-b9db-d6d7cdbe1edf_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 299836,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/04610896946546c4b341a538485cb656/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63b9ce0e-e3fe-579f-b9db-d6d7cdbe1edf/63b9ce0e-e3fe-579f-b9db-d6d7cdbe1edf_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 399901,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/04610896946546c4b341a538485cb656/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63b9ce0e-e3fe-579f-b9db-d6d7cdbe1edf/63b9ce0e-e3fe-579f-b9db-d6d7cdbe1edf_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 316925,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/04610896946546c4b341a538485cb656/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63b9ce0e-e3fe-579f-b9db-d6d7cdbe1edf/63b9ce0e-e3fe-579f-b9db-d6d7cdbe1edf_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 346461,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/04610896946546c4b341a538485cb656/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63b9ce0e-e3fe-579f-b9db-d6d7cdbe1edf/63b9ce0e-e3fe-579f-b9db-d6d7cdbe1edf_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 431842,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/04610896946546c4b341a538485cb656/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63b9ce0e-e3fe-579f-b9db-d6d7cdbe1edf/63b9ce0e-e3fe-579f-b9db-d6d7cdbe1edf_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 440560,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/04610896946546c4b341a538485cb656/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63b9ce0e-e3fe-579f-b9db-d6d7cdbe1edf/63b9ce0e-e3fe-579f-b9db-d6d7cdbe1edf_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 447987,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/04610896946546c4b341a538485cb656/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLASS GLE DIESEL (W167) GLE 350 de 4-Matic PHEV',
 'transmission': 'automatic',
 'trim': 'GLE 350 de 4-Matic PHEV',
 'vin': None,
 'year': 2020}
2026-03-26 22:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986145%27 HTTP/1.1" 200 None
2026-03-26 22:48:48 [ayvens.be] INFO: Saving data for 1986145: {'created_time': 1774565328.465, 'last_price_update_time': 1774565328.465011, 'auction_closing_time': 1775028600.0}
2026-03-26 22:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986145') HTTP/1.1" 204 0
2026-03-26 22:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F635d2d4d613846d28410eb8a5f749f2c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/635d2d4d613846d28410eb8a5f749f2c/images/large/7.jpg not downloaded yet
2026-03-26 22:48:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7771390>
2026-03-26 22:48:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e37d7dba-48b8-5a24-b004-5fc9981c1360/e37d7dba-48b8-5a24-b004-5fc9981c1360_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F0991d797ce3144ee914f5e9fd3f15a34%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/0991d797ce3144ee914f5e9fd3f15a34/images/large/1.jpg saved to cache
2026-03-26 22:48:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e37d7dba-48b8-5a24-b004-5fc9981c1360
2026-03-26 22:48:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b746dd50>
2026-03-26 22:48:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e37d7dba-48b8-5a24-b004-5fc9981c1360/e37d7dba-48b8-5a24-b004-5fc9981c1360_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F0991d797ce3144ee914f5e9fd3f15a34%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/0991d797ce3144ee914f5e9fd3f15a34/images/large/4.jpg saved to cache
2026-03-26 22:48:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e37d7dba-48b8-5a24-b004-5fc9981c1360
2026-03-26 22:48:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74cf890>
2026-03-26 22:48:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e37d7dba-48b8-5a24-b004-5fc9981c1360/e37d7dba-48b8-5a24-b004-5fc9981c1360_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F0991d797ce3144ee914f5e9fd3f15a34%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/0991d797ce3144ee914f5e9fd3f15a34/images/large/3.jpg saved to cache
2026-03-26 22:48:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e37d7dba-48b8-5a24-b004-5fc9981c1360
2026-03-26 22:48:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd0c7410>
2026-03-26 22:48:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e37d7dba-48b8-5a24-b004-5fc9981c1360/e37d7dba-48b8-5a24-b004-5fc9981c1360_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F0991d797ce3144ee914f5e9fd3f15a34%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/0991d797ce3144ee914f5e9fd3f15a34/images/large/2.jpg saved to cache
2026-03-26 22:48:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e37d7dba-48b8-5a24-b004-5fc9981c1360
2026-03-26 22:48:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e14cd0>
2026-03-26 22:48:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e37d7dba-48b8-5a24-b004-5fc9981c1360/e37d7dba-48b8-5a24-b004-5fc9981c1360_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F0991d797ce3144ee914f5e9fd3f15a34%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/0991d797ce3144ee914f5e9fd3f15a34/images/large/5.jpg saved to cache
2026-03-26 22:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e37d7dba-48b8-5a24-b004-5fc9981c1360
2026-03-26 22:48:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cb2490>
2026-03-26 22:48:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e37d7dba-48b8-5a24-b004-5fc9981c1360/e37d7dba-48b8-5a24-b004-5fc9981c1360_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F0991d797ce3144ee914f5e9fd3f15a34%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/0991d797ce3144ee914f5e9fd3f15a34/images/large/6.jpg saved to cache
2026-03-26 22:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e37d7dba-48b8-5a24-b004-5fc9981c1360
2026-03-26 22:48:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74ccb90>
2026-03-26 22:48:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e37d7dba-48b8-5a24-b004-5fc9981c1360/e37d7dba-48b8-5a24-b004-5fc9981c1360_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F0991d797ce3144ee914f5e9fd3f15a34%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/0991d797ce3144ee914f5e9fd3f15a34/images/large/7.jpg saved to cache
2026-03-26 22:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e37d7dba-48b8-5a24-b004-5fc9981c1360
2026-03-26 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F635d2d4d613846d28410eb8a5f749f2c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/635d2d4d613846d28410eb8a5f749f2c/images/large/8.jpg not downloaded yet
2026-03-26 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F635d2d4d613846d28410eb8a5f749f2c%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/635d2d4d613846d28410eb8a5f749f2c/images/large/9.jpg not downloaded yet
2026-03-26 22:48:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/0991d797ce3144ee914f5e9fd3f15a34/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/0991d797ce3144ee914f5e9fd3f15a34/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F635d2d4d613846d28410eb8a5f749f2c%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/635d2d4d613846d28410eb8a5f749f2c/images/large/10.jpg not downloaded yet
2026-03-26 22:48:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/635d2d4d613846d28410eb8a5f749f2c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/0991d797ce3144ee914f5e9fd3f15a34/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:49 [ayvens.be] INFO: Found listing with ID: 1986148
2026-03-26 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986148%27 HTTP/1.1" 200 None
2026-03-26 22:48:49 [ayvens.be] INFO: Scrape type for 1986148: 1
2026-03-26 22:48:49 [ayvens.be] INFO: Extracting data for car ID: 1986148
2026-03-26 22:48:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17e5649b-3762-5c55-8cbe-f61d8d3ecd5b with identifier: 1986148
2026-03-26 22:48:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17e5649b-3762-5c55-8cbe-f61d8d3ecd5b with scrape type 1
2026-03-26 22:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 17e5649b-3762-5c55-8cbe-f61d8d3ecd5b
2026-03-26 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F4059722f2cff44aaa288d4667eef1651%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/4059722f2cff44aaa288d4667eef1651/images/large/1.jpg not downloaded yet
2026-03-26 22:48:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/635d2d4d613846d28410eb8a5f749f2c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/635d2d4d613846d28410eb8a5f749f2c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F4059722f2cff44aaa288d4667eef1651%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/4059722f2cff44aaa288d4667eef1651/images/large/2.jpg not downloaded yet
2026-03-26 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F4059722f2cff44aaa288d4667eef1651%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/4059722f2cff44aaa288d4667eef1651/images/large/3.jpg not downloaded yet
2026-03-26 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F4059722f2cff44aaa288d4667eef1651%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/4059722f2cff44aaa288d4667eef1651/images/large/4.jpg not downloaded yet
2026-03-26 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F4059722f2cff44aaa288d4667eef1651%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/4059722f2cff44aaa288d4667eef1651/images/large/5.jpg not downloaded yet
2026-03-26 22:48:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b746c590>
2026-03-26 22:48:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e37d7dba-48b8-5a24-b004-5fc9981c1360/e37d7dba-48b8-5a24-b004-5fc9981c1360_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F0991d797ce3144ee914f5e9fd3f15a34%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/0991d797ce3144ee914f5e9fd3f15a34/images/large/9.jpg saved to cache
2026-03-26 22:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e37d7dba-48b8-5a24-b004-5fc9981c1360
2026-03-26 22:48:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74e7250>
2026-03-26 22:48:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e37d7dba-48b8-5a24-b004-5fc9981c1360/e37d7dba-48b8-5a24-b004-5fc9981c1360_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F0991d797ce3144ee914f5e9fd3f15a34%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/0991d797ce3144ee914f5e9fd3f15a34/images/large/10.jpg saved to cache
2026-03-26 22:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e37d7dba-48b8-5a24-b004-5fc9981c1360
2026-03-26 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F4059722f2cff44aaa288d4667eef1651%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/4059722f2cff44aaa288d4667eef1651/images/large/6.jpg not downloaded yet
2026-03-26 22:48:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7571d50>
2026-03-26 22:48:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc55da5f-d10b-5e98-a1c4-ea4db4a25646/bc55da5f-d10b-5e98-a1c4-ea4db4a25646_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F635d2d4d613846d28410eb8a5f749f2c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/635d2d4d613846d28410eb8a5f749f2c/images/large/3.jpg saved to cache
2026-03-26 22:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bc55da5f-d10b-5e98-a1c4-ea4db4a25646
2026-03-26 22:48:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6dd8990>
2026-03-26 22:48:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e37d7dba-48b8-5a24-b004-5fc9981c1360/e37d7dba-48b8-5a24-b004-5fc9981c1360_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F0991d797ce3144ee914f5e9fd3f15a34%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/0991d797ce3144ee914f5e9fd3f15a34/images/large/8.jpg saved to cache
2026-03-26 22:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e37d7dba-48b8-5a24-b004-5fc9981c1360
2026-03-26 22:48:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e37d7dba-48b8-5a24-b004-5fc9981c1360, skipping ID generation
2026-03-26 22:48:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e37d7dba-48b8-5a24-b004-5fc9981c1360 with scrape type 1
2026-03-26 22:48:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e37d7dba-48b8-5a24-b004-5fc9981c1360 sending to next pipeline
2026-03-26 22:48:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e37d7dba-48b8-5a24-b004-5fc9981c1360, identifier: 1986146
2026-03-26 22:48:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e37d7dba-48b8-5a24-b004-5fc9981c1360 with identifier: 1986146
2026-03-26 22:48:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e37d7dba-48b8-5a24-b004-5fc9981c1360 with identifier: 1986146
2026-03-26 22:48:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e37d7dba-48b8-5a24-b004-5fc9981c1360 with identifier: 1986146 to the API
2026-03-26 22:48:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:48:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:48:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yr/0991d797ce3144ee914f5e9fd3f15a34/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'e37d7dba-48b8-5a24-b004-5fc9981c1360',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A4',
 'odometer': 116277,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e37d7dba-48b8-5a24-b004-5fc9981c1360/e37d7dba-48b8-5a24-b004-5fc9981c1360_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 560525,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/0991d797ce3144ee914f5e9fd3f15a34/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e37d7dba-48b8-5a24-b004-5fc9981c1360/e37d7dba-48b8-5a24-b004-5fc9981c1360_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 628880,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/0991d797ce3144ee914f5e9fd3f15a34/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e37d7dba-48b8-5a24-b004-5fc9981c1360/e37d7dba-48b8-5a24-b004-5fc9981c1360_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 634945,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/0991d797ce3144ee914f5e9fd3f15a34/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e37d7dba-48b8-5a24-b004-5fc9981c1360/e37d7dba-48b8-5a24-b004-5fc9981c1360_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 672788,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/0991d797ce3144ee914f5e9fd3f15a34/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e37d7dba-48b8-5a24-b004-5fc9981c1360/e37d7dba-48b8-5a24-b004-5fc9981c1360_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 647008,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/0991d797ce3144ee914f5e9fd3f15a34/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e37d7dba-48b8-5a24-b004-5fc9981c1360/e37d7dba-48b8-5a24-b004-5fc9981c1360_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 598913,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/0991d797ce3144ee914f5e9fd3f15a34/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e37d7dba-48b8-5a24-b004-5fc9981c1360/e37d7dba-48b8-5a24-b004-5fc9981c1360_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 661670,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/0991d797ce3144ee914f5e9fd3f15a34/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e37d7dba-48b8-5a24-b004-5fc9981c1360/e37d7dba-48b8-5a24-b004-5fc9981c1360_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 630132,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/0991d797ce3144ee914f5e9fd3f15a34/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e37d7dba-48b8-5a24-b004-5fc9981c1360/e37d7dba-48b8-5a24-b004-5fc9981c1360_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 509149,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/0991d797ce3144ee914f5e9fd3f15a34/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e37d7dba-48b8-5a24-b004-5fc9981c1360/e37d7dba-48b8-5a24-b004-5fc9981c1360_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 473844,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/0991d797ce3144ee914f5e9fd3f15a34/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A4 2.0 35 TFSI 110KW S TRONIC',
 'transmission': 'automatic',
 'trim': '2.0 35 TFSI 110KW S TRONIC',
 'vin': None,
 'year': 2020}
2026-03-26 22:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986146%27 HTTP/1.1" 200 None
2026-03-26 22:48:50 [ayvens.be] INFO: Saving data for 1986146: {'created_time': 1774565330.243157, 'last_price_update_time': 1774565330.243166, 'auction_closing_time': 1775028600.0}
2026-03-26 22:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986146') HTTP/1.1" 204 0
2026-03-26 22:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F4059722f2cff44aaa288d4667eef1651%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/4059722f2cff44aaa288d4667eef1651/images/large/7.jpg not downloaded yet
2026-03-26 22:48:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/4059722f2cff44aaa288d4667eef1651/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79f0210>
2026-03-26 22:48:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc55da5f-d10b-5e98-a1c4-ea4db4a25646/bc55da5f-d10b-5e98-a1c4-ea4db4a25646_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F635d2d4d613846d28410eb8a5f749f2c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/635d2d4d613846d28410eb8a5f749f2c/images/large/1.jpg saved to cache
2026-03-26 22:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bc55da5f-d10b-5e98-a1c4-ea4db4a25646
2026-03-26 22:48:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7aa3e10>
2026-03-26 22:48:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc55da5f-d10b-5e98-a1c4-ea4db4a25646/bc55da5f-d10b-5e98-a1c4-ea4db4a25646_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F635d2d4d613846d28410eb8a5f749f2c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/635d2d4d613846d28410eb8a5f749f2c/images/large/2.jpg saved to cache
2026-03-26 22:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bc55da5f-d10b-5e98-a1c4-ea4db4a25646
2026-03-26 22:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F4059722f2cff44aaa288d4667eef1651%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/4059722f2cff44aaa288d4667eef1651/images/large/8.jpg not downloaded yet
2026-03-26 22:48:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/635d2d4d613846d28410eb8a5f749f2c/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F4059722f2cff44aaa288d4667eef1651%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/4059722f2cff44aaa288d4667eef1651/images/large/9.jpg not downloaded yet
2026-03-26 22:48:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7407c50>
2026-03-26 22:48:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17e5649b-3762-5c55-8cbe-f61d8d3ecd5b/17e5649b-3762-5c55-8cbe-f61d8d3ecd5b_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F4059722f2cff44aaa288d4667eef1651%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/4059722f2cff44aaa288d4667eef1651/images/large/1.jpg saved to cache
2026-03-26 22:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 17e5649b-3762-5c55-8cbe-f61d8d3ecd5b
2026-03-26 22:48:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/635d2d4d613846d28410eb8a5f749f2c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/635d2d4d613846d28410eb8a5f749f2c/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F4059722f2cff44aaa288d4667eef1651%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/4059722f2cff44aaa288d4667eef1651/images/large/10.jpg not downloaded yet
2026-03-26 22:48:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/635d2d4d613846d28410eb8a5f749f2c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/635d2d4d613846d28410eb8a5f749f2c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/635d2d4d613846d28410eb8a5f749f2c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/635d2d4d613846d28410eb8a5f749f2c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:50 [ayvens.be] INFO: Found listing with ID: 1986149
2026-03-26 22:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986149%27 HTTP/1.1" 200 None
2026-03-26 22:48:50 [ayvens.be] INFO: Scrape type for 1986149: 1
2026-03-26 22:48:50 [ayvens.be] INFO: Extracting data for car ID: 1986149
2026-03-26 22:48:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b64cdfd-3eb2-5af3-bc36-4f3ac554d6ae with identifier: 1986149
2026-03-26 22:48:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b64cdfd-3eb2-5af3-bc36-4f3ac554d6ae with scrape type 1
2026-03-26 22:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9b64cdfd-3eb2-5af3-bc36-4f3ac554d6ae
2026-03-26 22:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xa%252Fc5c7df1cd7cf48eb961ca158d2e49012%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xa/c5c7df1cd7cf48eb961ca158d2e49012/images/large/1.jpg not downloaded yet
2026-03-26 22:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xa%252Fc5c7df1cd7cf48eb961ca158d2e49012%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xa/c5c7df1cd7cf48eb961ca158d2e49012/images/large/2.jpg not downloaded yet
2026-03-26 22:48:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7768b10>
2026-03-26 22:48:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc55da5f-d10b-5e98-a1c4-ea4db4a25646/bc55da5f-d10b-5e98-a1c4-ea4db4a25646_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F635d2d4d613846d28410eb8a5f749f2c%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/635d2d4d613846d28410eb8a5f749f2c/images/large/9.jpg saved to cache
2026-03-26 22:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bc55da5f-d10b-5e98-a1c4-ea4db4a25646
2026-03-26 22:48:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e105d0>
2026-03-26 22:48:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc55da5f-d10b-5e98-a1c4-ea4db4a25646/bc55da5f-d10b-5e98-a1c4-ea4db4a25646_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F635d2d4d613846d28410eb8a5f749f2c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/635d2d4d613846d28410eb8a5f749f2c/images/large/4.jpg saved to cache
2026-03-26 22:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bc55da5f-d10b-5e98-a1c4-ea4db4a25646
2026-03-26 22:48:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7927710>
2026-03-26 22:48:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc55da5f-d10b-5e98-a1c4-ea4db4a25646/bc55da5f-d10b-5e98-a1c4-ea4db4a25646_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F635d2d4d613846d28410eb8a5f749f2c%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/635d2d4d613846d28410eb8a5f749f2c/images/large/10.jpg saved to cache
2026-03-26 22:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bc55da5f-d10b-5e98-a1c4-ea4db4a25646
2026-03-26 22:48:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e138d0>
2026-03-26 22:48:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc55da5f-d10b-5e98-a1c4-ea4db4a25646/bc55da5f-d10b-5e98-a1c4-ea4db4a25646_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F635d2d4d613846d28410eb8a5f749f2c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/635d2d4d613846d28410eb8a5f749f2c/images/large/8.jpg saved to cache
2026-03-26 22:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bc55da5f-d10b-5e98-a1c4-ea4db4a25646
2026-03-26 22:48:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c5ee10>
2026-03-26 22:48:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc55da5f-d10b-5e98-a1c4-ea4db4a25646/bc55da5f-d10b-5e98-a1c4-ea4db4a25646_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F635d2d4d613846d28410eb8a5f749f2c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/635d2d4d613846d28410eb8a5f749f2c/images/large/6.jpg saved to cache
2026-03-26 22:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bc55da5f-d10b-5e98-a1c4-ea4db4a25646
2026-03-26 22:48:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e2b710>
2026-03-26 22:48:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc55da5f-d10b-5e98-a1c4-ea4db4a25646/bc55da5f-d10b-5e98-a1c4-ea4db4a25646_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F635d2d4d613846d28410eb8a5f749f2c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/635d2d4d613846d28410eb8a5f749f2c/images/large/5.jpg saved to cache
2026-03-26 22:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bc55da5f-d10b-5e98-a1c4-ea4db4a25646
2026-03-26 22:48:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c5e890>
2026-03-26 22:48:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc55da5f-d10b-5e98-a1c4-ea4db4a25646/bc55da5f-d10b-5e98-a1c4-ea4db4a25646_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F635d2d4d613846d28410eb8a5f749f2c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/635d2d4d613846d28410eb8a5f749f2c/images/large/7.jpg saved to cache
2026-03-26 22:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bc55da5f-d10b-5e98-a1c4-ea4db4a25646
2026-03-26 22:48:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bc55da5f-d10b-5e98-a1c4-ea4db4a25646, skipping ID generation
2026-03-26 22:48:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc55da5f-d10b-5e98-a1c4-ea4db4a25646 with scrape type 1
2026-03-26 22:48:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bc55da5f-d10b-5e98-a1c4-ea4db4a25646 sending to next pipeline
2026-03-26 22:48:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: bc55da5f-d10b-5e98-a1c4-ea4db4a25646, identifier: 1986147
2026-03-26 22:48:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/4059722f2cff44aaa288d4667eef1651/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xa%252Fc5c7df1cd7cf48eb961ca158d2e49012%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xa/c5c7df1cd7cf48eb961ca158d2e49012/images/large/3.jpg not downloaded yet
2026-03-26 22:48:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: bc55da5f-d10b-5e98-a1c4-ea4db4a25646 with identifier: 1986147
2026-03-26 22:48:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: bc55da5f-d10b-5e98-a1c4-ea4db4a25646 with identifier: 1986147
2026-03-26 22:48:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: bc55da5f-d10b-5e98-a1c4-ea4db4a25646 with identifier: 1986147 to the API
2026-03-26 22:48:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:48:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:48:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bh/635d2d4d613846d28410eb8a5f749f2c/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'bc55da5f-d10b-5e98-a1c4-ea4db4a25646',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'PUMA',
 'odometer': 94319,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc55da5f-d10b-5e98-a1c4-ea4db4a25646/bc55da5f-d10b-5e98-a1c4-ea4db4a25646_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 728370,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/635d2d4d613846d28410eb8a5f749f2c/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc55da5f-d10b-5e98-a1c4-ea4db4a25646/bc55da5f-d10b-5e98-a1c4-ea4db4a25646_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 730140,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/635d2d4d613846d28410eb8a5f749f2c/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc55da5f-d10b-5e98-a1c4-ea4db4a25646/bc55da5f-d10b-5e98-a1c4-ea4db4a25646_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 642210,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/635d2d4d613846d28410eb8a5f749f2c/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc55da5f-d10b-5e98-a1c4-ea4db4a25646/bc55da5f-d10b-5e98-a1c4-ea4db4a25646_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 728953,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/635d2d4d613846d28410eb8a5f749f2c/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc55da5f-d10b-5e98-a1c4-ea4db4a25646/bc55da5f-d10b-5e98-a1c4-ea4db4a25646_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 644631,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/635d2d4d613846d28410eb8a5f749f2c/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc55da5f-d10b-5e98-a1c4-ea4db4a25646/bc55da5f-d10b-5e98-a1c4-ea4db4a25646_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 589945,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/635d2d4d613846d28410eb8a5f749f2c/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc55da5f-d10b-5e98-a1c4-ea4db4a25646/bc55da5f-d10b-5e98-a1c4-ea4db4a25646_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 713850,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/635d2d4d613846d28410eb8a5f749f2c/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc55da5f-d10b-5e98-a1c4-ea4db4a25646/bc55da5f-d10b-5e98-a1c4-ea4db4a25646_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 750582,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/635d2d4d613846d28410eb8a5f749f2c/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc55da5f-d10b-5e98-a1c4-ea4db4a25646/bc55da5f-d10b-5e98-a1c4-ea4db4a25646_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 452376,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/635d2d4d613846d28410eb8a5f749f2c/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc55da5f-d10b-5e98-a1c4-ea4db4a25646/bc55da5f-d10b-5e98-a1c4-ea4db4a25646_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 494196,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/635d2d4d613846d28410eb8a5f749f2c/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD PUMA 1.0 ECOBOOST MHEV 92KW TITANIUM',
 'transmission': 'manual',
 'trim': '1.0 ECOBOOST MHEV 92KW TITANIUM',
 'vin': None,
 'year': 2021}
2026-03-26 22:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986147%27 HTTP/1.1" 200 None
2026-03-26 22:48:51 [ayvens.be] INFO: Saving data for 1986147: {'created_time': 1774565331.744738, 'last_price_update_time': 1774565331.74475, 'auction_closing_time': 1775028600.0}
2026-03-26 22:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986147') HTTP/1.1" 204 0
2026-03-26 22:48:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/4059722f2cff44aaa288d4667eef1651/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/4059722f2cff44aaa288d4667eef1651/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/4059722f2cff44aaa288d4667eef1651/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/4059722f2cff44aaa288d4667eef1651/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/4059722f2cff44aaa288d4667eef1651/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/4059722f2cff44aaa288d4667eef1651/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xa%252Fc5c7df1cd7cf48eb961ca158d2e49012%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xa/c5c7df1cd7cf48eb961ca158d2e49012/images/large/4.jpg not downloaded yet
2026-03-26 22:48:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e1e390>
2026-03-26 22:48:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17e5649b-3762-5c55-8cbe-f61d8d3ecd5b/17e5649b-3762-5c55-8cbe-f61d8d3ecd5b_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F4059722f2cff44aaa288d4667eef1651%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/4059722f2cff44aaa288d4667eef1651/images/large/2.jpg saved to cache
2026-03-26 22:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 17e5649b-3762-5c55-8cbe-f61d8d3ecd5b
2026-03-26 22:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xa%252Fc5c7df1cd7cf48eb961ca158d2e49012%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xa/c5c7df1cd7cf48eb961ca158d2e49012/images/large/5.jpg not downloaded yet
2026-03-26 22:48:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/4059722f2cff44aaa288d4667eef1651/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xa%252Fc5c7df1cd7cf48eb961ca158d2e49012%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xa/c5c7df1cd7cf48eb961ca158d2e49012/images/large/6.jpg not downloaded yet
2026-03-26 22:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xa%252Fc5c7df1cd7cf48eb961ca158d2e49012%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xa/c5c7df1cd7cf48eb961ca158d2e49012/images/large/7.jpg not downloaded yet
2026-03-26 22:48:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b75852d0>
2026-03-26 22:48:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17e5649b-3762-5c55-8cbe-f61d8d3ecd5b/17e5649b-3762-5c55-8cbe-f61d8d3ecd5b_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F4059722f2cff44aaa288d4667eef1651%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/4059722f2cff44aaa288d4667eef1651/images/large/4.jpg saved to cache
2026-03-26 22:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 17e5649b-3762-5c55-8cbe-f61d8d3ecd5b
2026-03-26 22:48:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c94090>
2026-03-26 22:48:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17e5649b-3762-5c55-8cbe-f61d8d3ecd5b/17e5649b-3762-5c55-8cbe-f61d8d3ecd5b_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F4059722f2cff44aaa288d4667eef1651%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/4059722f2cff44aaa288d4667eef1651/images/large/6.jpg saved to cache
2026-03-26 22:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 17e5649b-3762-5c55-8cbe-f61d8d3ecd5b
2026-03-26 22:48:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77c8ed0>
2026-03-26 22:48:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17e5649b-3762-5c55-8cbe-f61d8d3ecd5b/17e5649b-3762-5c55-8cbe-f61d8d3ecd5b_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F4059722f2cff44aaa288d4667eef1651%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/4059722f2cff44aaa288d4667eef1651/images/large/5.jpg saved to cache
2026-03-26 22:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 17e5649b-3762-5c55-8cbe-f61d8d3ecd5b
2026-03-26 22:48:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76ee210>
2026-03-26 22:48:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17e5649b-3762-5c55-8cbe-f61d8d3ecd5b/17e5649b-3762-5c55-8cbe-f61d8d3ecd5b_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F4059722f2cff44aaa288d4667eef1651%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/4059722f2cff44aaa288d4667eef1651/images/large/3.jpg saved to cache
2026-03-26 22:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 17e5649b-3762-5c55-8cbe-f61d8d3ecd5b
2026-03-26 22:48:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e12910>
2026-03-26 22:48:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17e5649b-3762-5c55-8cbe-f61d8d3ecd5b/17e5649b-3762-5c55-8cbe-f61d8d3ecd5b_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F4059722f2cff44aaa288d4667eef1651%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/4059722f2cff44aaa288d4667eef1651/images/large/7.jpg saved to cache
2026-03-26 22:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 17e5649b-3762-5c55-8cbe-f61d8d3ecd5b
2026-03-26 22:48:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e12510>
2026-03-26 22:48:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17e5649b-3762-5c55-8cbe-f61d8d3ecd5b/17e5649b-3762-5c55-8cbe-f61d8d3ecd5b_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F4059722f2cff44aaa288d4667eef1651%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/4059722f2cff44aaa288d4667eef1651/images/large/8.jpg saved to cache
2026-03-26 22:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 17e5649b-3762-5c55-8cbe-f61d8d3ecd5b
2026-03-26 22:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xa%252Fc5c7df1cd7cf48eb961ca158d2e49012%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xa/c5c7df1cd7cf48eb961ca158d2e49012/images/large/8.jpg not downloaded yet
2026-03-26 22:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xa%252Fc5c7df1cd7cf48eb961ca158d2e49012%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xa/c5c7df1cd7cf48eb961ca158d2e49012/images/large/9.jpg not downloaded yet
2026-03-26 22:48:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74be4d0>
2026-03-26 22:48:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17e5649b-3762-5c55-8cbe-f61d8d3ecd5b/17e5649b-3762-5c55-8cbe-f61d8d3ecd5b_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F4059722f2cff44aaa288d4667eef1651%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/4059722f2cff44aaa288d4667eef1651/images/large/9.jpg saved to cache
2026-03-26 22:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 17e5649b-3762-5c55-8cbe-f61d8d3ecd5b
2026-03-26 22:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xa%252Fc5c7df1cd7cf48eb961ca158d2e49012%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xa/c5c7df1cd7cf48eb961ca158d2e49012/images/large/10.jpg not downloaded yet
2026-03-26 22:48:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/4059722f2cff44aaa288d4667eef1651/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:52 [ayvens.be] INFO: Found listing with ID: 1986150
2026-03-26 22:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986150%27 HTTP/1.1" 200 None
2026-03-26 22:48:52 [ayvens.be] INFO: Scrape type for 1986150: 1
2026-03-26 22:48:52 [ayvens.be] INFO: Extracting data for car ID: 1986150
2026-03-26 22:48:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fcb17396-6d23-5f34-b8f7-a8c6f3dbf8cd with identifier: 1986150
2026-03-26 22:48:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fcb17396-6d23-5f34-b8f7-a8c6f3dbf8cd with scrape type 1
2026-03-26 22:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fcb17396-6d23-5f34-b8f7-a8c6f3dbf8cd
2026-03-26 22:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252Fe71d5693288a4e01bac58ff4b73c2809%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/e71d5693288a4e01bac58ff4b73c2809/images/large/1.jpg not downloaded yet
2026-03-26 22:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252Fe71d5693288a4e01bac58ff4b73c2809%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/e71d5693288a4e01bac58ff4b73c2809/images/large/2.jpg not downloaded yet
2026-03-26 22:48:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xa/c5c7df1cd7cf48eb961ca158d2e49012/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xa/c5c7df1cd7cf48eb961ca158d2e49012/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xa/c5c7df1cd7cf48eb961ca158d2e49012/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xa/c5c7df1cd7cf48eb961ca158d2e49012/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xa/c5c7df1cd7cf48eb961ca158d2e49012/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252Fe71d5693288a4e01bac58ff4b73c2809%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/e71d5693288a4e01bac58ff4b73c2809/images/large/3.jpg not downloaded yet
2026-03-26 22:48:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b748b750>
2026-03-26 22:48:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17e5649b-3762-5c55-8cbe-f61d8d3ecd5b/17e5649b-3762-5c55-8cbe-f61d8d3ecd5b_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F4059722f2cff44aaa288d4667eef1651%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/4059722f2cff44aaa288d4667eef1651/images/large/10.jpg saved to cache
2026-03-26 22:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 17e5649b-3762-5c55-8cbe-f61d8d3ecd5b
2026-03-26 22:48:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 17e5649b-3762-5c55-8cbe-f61d8d3ecd5b, skipping ID generation
2026-03-26 22:48:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17e5649b-3762-5c55-8cbe-f61d8d3ecd5b with scrape type 1
2026-03-26 22:48:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 17e5649b-3762-5c55-8cbe-f61d8d3ecd5b sending to next pipeline
2026-03-26 22:48:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 17e5649b-3762-5c55-8cbe-f61d8d3ecd5b, identifier: 1986148
2026-03-26 22:48:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 17e5649b-3762-5c55-8cbe-f61d8d3ecd5b with identifier: 1986148
2026-03-26 22:48:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 17e5649b-3762-5c55-8cbe-f61d8d3ecd5b with identifier: 1986148
2026-03-26 22:48:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 17e5649b-3762-5c55-8cbe-f61d8d3ecd5b with identifier: 1986148 to the API
2026-03-26 22:48:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:48:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:48:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bp/4059722f2cff44aaa288d4667eef1651/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '17e5649b-3762-5c55-8cbe-f61d8d3ecd5b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 40490,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17e5649b-3762-5c55-8cbe-f61d8d3ecd5b/17e5649b-3762-5c55-8cbe-f61d8d3ecd5b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 199896,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/4059722f2cff44aaa288d4667eef1651/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17e5649b-3762-5c55-8cbe-f61d8d3ecd5b/17e5649b-3762-5c55-8cbe-f61d8d3ecd5b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 193419,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/4059722f2cff44aaa288d4667eef1651/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17e5649b-3762-5c55-8cbe-f61d8d3ecd5b/17e5649b-3762-5c55-8cbe-f61d8d3ecd5b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 214440,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/4059722f2cff44aaa288d4667eef1651/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17e5649b-3762-5c55-8cbe-f61d8d3ecd5b/17e5649b-3762-5c55-8cbe-f61d8d3ecd5b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 219009,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/4059722f2cff44aaa288d4667eef1651/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17e5649b-3762-5c55-8cbe-f61d8d3ecd5b/17e5649b-3762-5c55-8cbe-f61d8d3ecd5b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 249451,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/4059722f2cff44aaa288d4667eef1651/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17e5649b-3762-5c55-8cbe-f61d8d3ecd5b/17e5649b-3762-5c55-8cbe-f61d8d3ecd5b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 242278,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/4059722f2cff44aaa288d4667eef1651/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17e5649b-3762-5c55-8cbe-f61d8d3ecd5b/17e5649b-3762-5c55-8cbe-f61d8d3ecd5b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 277135,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/4059722f2cff44aaa288d4667eef1651/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17e5649b-3762-5c55-8cbe-f61d8d3ecd5b/17e5649b-3762-5c55-8cbe-f61d8d3ecd5b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 286651,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/4059722f2cff44aaa288d4667eef1651/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17e5649b-3762-5c55-8cbe-f61d8d3ecd5b/17e5649b-3762-5c55-8cbe-f61d8d3ecd5b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 329595,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/4059722f2cff44aaa288d4667eef1651/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17e5649b-3762-5c55-8cbe-f61d8d3ecd5b/17e5649b-3762-5c55-8cbe-f61d8d3ecd5b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 261750,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/4059722f2cff44aaa288d4667eef1651/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T2 MOMENTUM PRO',
 'transmission': 'manual',
 'trim': '1.5 T2 MOMENTUM PRO',
 'vin': None,
 'year': 2022}
2026-03-26 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986148%27 HTTP/1.1" 200 None
2026-03-26 22:48:53 [ayvens.be] INFO: Saving data for 1986148: {'created_time': 1774565333.128961, 'last_price_update_time': 1774565333.12897, 'auction_closing_time': 1775028600.0}
2026-03-26 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986148') HTTP/1.1" 204 0
2026-03-26 22:48:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xa/c5c7df1cd7cf48eb961ca158d2e49012/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252Fe71d5693288a4e01bac58ff4b73c2809%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/e71d5693288a4e01bac58ff4b73c2809/images/large/4.jpg not downloaded yet
2026-03-26 22:48:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79fb310>
2026-03-26 22:48:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b64cdfd-3eb2-5af3-bc36-4f3ac554d6ae/9b64cdfd-3eb2-5af3-bc36-4f3ac554d6ae_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xa%252Fc5c7df1cd7cf48eb961ca158d2e49012%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xa/c5c7df1cd7cf48eb961ca158d2e49012/images/large/1.jpg saved to cache
2026-03-26 22:48:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9b64cdfd-3eb2-5af3-bc36-4f3ac554d6ae
2026-03-26 22:48:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e123d0>
2026-03-26 22:48:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b64cdfd-3eb2-5af3-bc36-4f3ac554d6ae/9b64cdfd-3eb2-5af3-bc36-4f3ac554d6ae_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xa%252Fc5c7df1cd7cf48eb961ca158d2e49012%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xa/c5c7df1cd7cf48eb961ca158d2e49012/images/large/3.jpg saved to cache
2026-03-26 22:48:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9b64cdfd-3eb2-5af3-bc36-4f3ac554d6ae
2026-03-26 22:48:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7428d90>
2026-03-26 22:48:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b64cdfd-3eb2-5af3-bc36-4f3ac554d6ae/9b64cdfd-3eb2-5af3-bc36-4f3ac554d6ae_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xa%252Fc5c7df1cd7cf48eb961ca158d2e49012%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xa/c5c7df1cd7cf48eb961ca158d2e49012/images/large/2.jpg saved to cache
2026-03-26 22:48:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9b64cdfd-3eb2-5af3-bc36-4f3ac554d6ae
2026-03-26 22:48:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c80e10>
2026-03-26 22:48:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b64cdfd-3eb2-5af3-bc36-4f3ac554d6ae/9b64cdfd-3eb2-5af3-bc36-4f3ac554d6ae_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xa%252Fc5c7df1cd7cf48eb961ca158d2e49012%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xa/c5c7df1cd7cf48eb961ca158d2e49012/images/large/5.jpg saved to cache
2026-03-26 22:48:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9b64cdfd-3eb2-5af3-bc36-4f3ac554d6ae
2026-03-26 22:48:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7aa0350>
2026-03-26 22:48:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b64cdfd-3eb2-5af3-bc36-4f3ac554d6ae/9b64cdfd-3eb2-5af3-bc36-4f3ac554d6ae_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xa%252Fc5c7df1cd7cf48eb961ca158d2e49012%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xa/c5c7df1cd7cf48eb961ca158d2e49012/images/large/4.jpg saved to cache
2026-03-26 22:48:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9b64cdfd-3eb2-5af3-bc36-4f3ac554d6ae
2026-03-26 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252Fe71d5693288a4e01bac58ff4b73c2809%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/e71d5693288a4e01bac58ff4b73c2809/images/large/5.jpg not downloaded yet
2026-03-26 22:48:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2at/e71d5693288a4e01bac58ff4b73c2809/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252Fe71d5693288a4e01bac58ff4b73c2809%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/e71d5693288a4e01bac58ff4b73c2809/images/large/6.jpg not downloaded yet
2026-03-26 22:48:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b72ee490>
2026-03-26 22:48:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b64cdfd-3eb2-5af3-bc36-4f3ac554d6ae/9b64cdfd-3eb2-5af3-bc36-4f3ac554d6ae_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xa%252Fc5c7df1cd7cf48eb961ca158d2e49012%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xa/c5c7df1cd7cf48eb961ca158d2e49012/images/large/6.jpg saved to cache
2026-03-26 22:48:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9b64cdfd-3eb2-5af3-bc36-4f3ac554d6ae
2026-03-26 22:48:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xa/c5c7df1cd7cf48eb961ca158d2e49012/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2at/e71d5693288a4e01bac58ff4b73c2809/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252Fe71d5693288a4e01bac58ff4b73c2809%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/e71d5693288a4e01bac58ff4b73c2809/images/large/7.jpg not downloaded yet
2026-03-26 22:48:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e4d850>
2026-03-26 22:48:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcb17396-6d23-5f34-b8f7-a8c6f3dbf8cd/fcb17396-6d23-5f34-b8f7-a8c6f3dbf8cd_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252Fe71d5693288a4e01bac58ff4b73c2809%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/e71d5693288a4e01bac58ff4b73c2809/images/large/1.jpg saved to cache
2026-03-26 22:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fcb17396-6d23-5f34-b8f7-a8c6f3dbf8cd
2026-03-26 22:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252Fe71d5693288a4e01bac58ff4b73c2809%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/e71d5693288a4e01bac58ff4b73c2809/images/large/8.jpg not downloaded yet
2026-03-26 22:48:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xa/c5c7df1cd7cf48eb961ca158d2e49012/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xa/c5c7df1cd7cf48eb961ca158d2e49012/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2at/e71d5693288a4e01bac58ff4b73c2809/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2at/e71d5693288a4e01bac58ff4b73c2809/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xa/c5c7df1cd7cf48eb961ca158d2e49012/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252Fe71d5693288a4e01bac58ff4b73c2809%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/e71d5693288a4e01bac58ff4b73c2809/images/large/9.jpg not downloaded yet
2026-03-26 22:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252Fe71d5693288a4e01bac58ff4b73c2809%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/e71d5693288a4e01bac58ff4b73c2809/images/large/10.jpg not downloaded yet
2026-03-26 22:48:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76a5290>
2026-03-26 22:48:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b64cdfd-3eb2-5af3-bc36-4f3ac554d6ae/9b64cdfd-3eb2-5af3-bc36-4f3ac554d6ae_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xa%252Fc5c7df1cd7cf48eb961ca158d2e49012%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xa/c5c7df1cd7cf48eb961ca158d2e49012/images/large/7.jpg saved to cache
2026-03-26 22:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9b64cdfd-3eb2-5af3-bc36-4f3ac554d6ae
2026-03-26 22:48:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74dd350>
2026-03-26 22:48:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcb17396-6d23-5f34-b8f7-a8c6f3dbf8cd/fcb17396-6d23-5f34-b8f7-a8c6f3dbf8cd_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252Fe71d5693288a4e01bac58ff4b73c2809%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/e71d5693288a4e01bac58ff4b73c2809/images/large/2.jpg saved to cache
2026-03-26 22:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fcb17396-6d23-5f34-b8f7-a8c6f3dbf8cd
2026-03-26 22:48:54 [ayvens.be] INFO: Found listing with ID: 1986151
2026-03-26 22:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986151%27 HTTP/1.1" 200 None
2026-03-26 22:48:54 [ayvens.be] INFO: Scrape type for 1986151: 1
2026-03-26 22:48:54 [ayvens.be] INFO: Extracting data for car ID: 1986151
2026-03-26 22:48:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5229c5e-a5ef-5efd-b602-a0f989598542 with identifier: 1986151
2026-03-26 22:48:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5229c5e-a5ef-5efd-b602-a0f989598542 with scrape type 1
2026-03-26 22:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c5229c5e-a5ef-5efd-b602-a0f989598542
2026-03-26 22:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fa6ac5b56cccb46de82ad7b826e9cb8ad%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/a6ac5b56cccb46de82ad7b826e9cb8ad/images/large/1.jpg not downloaded yet
2026-03-26 22:48:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2at/e71d5693288a4e01bac58ff4b73c2809/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fa6ac5b56cccb46de82ad7b826e9cb8ad%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/a6ac5b56cccb46de82ad7b826e9cb8ad/images/large/2.jpg not downloaded yet
2026-03-26 22:48:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79ccb50>
2026-03-26 22:48:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b64cdfd-3eb2-5af3-bc36-4f3ac554d6ae/9b64cdfd-3eb2-5af3-bc36-4f3ac554d6ae_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xa%252Fc5c7df1cd7cf48eb961ca158d2e49012%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xa/c5c7df1cd7cf48eb961ca158d2e49012/images/large/8.jpg saved to cache
2026-03-26 22:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9b64cdfd-3eb2-5af3-bc36-4f3ac554d6ae
2026-03-26 22:48:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b78a8ed0>
2026-03-26 22:48:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b64cdfd-3eb2-5af3-bc36-4f3ac554d6ae/9b64cdfd-3eb2-5af3-bc36-4f3ac554d6ae_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xa%252Fc5c7df1cd7cf48eb961ca158d2e49012%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xa/c5c7df1cd7cf48eb961ca158d2e49012/images/large/9.jpg saved to cache
2026-03-26 22:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9b64cdfd-3eb2-5af3-bc36-4f3ac554d6ae
2026-03-26 22:48:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7410c90>
2026-03-26 22:48:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcb17396-6d23-5f34-b8f7-a8c6f3dbf8cd/fcb17396-6d23-5f34-b8f7-a8c6f3dbf8cd_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252Fe71d5693288a4e01bac58ff4b73c2809%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/e71d5693288a4e01bac58ff4b73c2809/images/large/3.jpg saved to cache
2026-03-26 22:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fcb17396-6d23-5f34-b8f7-a8c6f3dbf8cd
2026-03-26 22:48:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79a4990>
2026-03-26 22:48:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcb17396-6d23-5f34-b8f7-a8c6f3dbf8cd/fcb17396-6d23-5f34-b8f7-a8c6f3dbf8cd_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252Fe71d5693288a4e01bac58ff4b73c2809%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/e71d5693288a4e01bac58ff4b73c2809/images/large/4.jpg saved to cache
2026-03-26 22:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fcb17396-6d23-5f34-b8f7-a8c6f3dbf8cd
2026-03-26 22:48:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b72ff910>
2026-03-26 22:48:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b64cdfd-3eb2-5af3-bc36-4f3ac554d6ae/9b64cdfd-3eb2-5af3-bc36-4f3ac554d6ae_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xa%252Fc5c7df1cd7cf48eb961ca158d2e49012%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xa/c5c7df1cd7cf48eb961ca158d2e49012/images/large/10.jpg saved to cache
2026-03-26 22:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9b64cdfd-3eb2-5af3-bc36-4f3ac554d6ae
2026-03-26 22:48:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9b64cdfd-3eb2-5af3-bc36-4f3ac554d6ae, skipping ID generation
2026-03-26 22:48:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b64cdfd-3eb2-5af3-bc36-4f3ac554d6ae with scrape type 1
2026-03-26 22:48:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9b64cdfd-3eb2-5af3-bc36-4f3ac554d6ae sending to next pipeline
2026-03-26 22:48:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 9b64cdfd-3eb2-5af3-bc36-4f3ac554d6ae, identifier: 1986149
2026-03-26 22:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fa6ac5b56cccb46de82ad7b826e9cb8ad%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/a6ac5b56cccb46de82ad7b826e9cb8ad/images/large/3.jpg not downloaded yet
2026-03-26 22:48:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 9b64cdfd-3eb2-5af3-bc36-4f3ac554d6ae with identifier: 1986149
2026-03-26 22:48:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 9b64cdfd-3eb2-5af3-bc36-4f3ac554d6ae with identifier: 1986149
2026-03-26 22:48:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 9b64cdfd-3eb2-5af3-bc36-4f3ac554d6ae with identifier: 1986149 to the API
2026-03-26 22:48:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:48:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:48:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1xa/c5c7df1cd7cf48eb961ca158d2e49012/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '9b64cdfd-3eb2-5af3-bc36-4f3ac554d6ae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TIGUAN ALLSPACE',
 'odometer': 150860,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b64cdfd-3eb2-5af3-bc36-4f3ac554d6ae/9b64cdfd-3eb2-5af3-bc36-4f3ac554d6ae_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 595006,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xa/c5c7df1cd7cf48eb961ca158d2e49012/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b64cdfd-3eb2-5af3-bc36-4f3ac554d6ae/9b64cdfd-3eb2-5af3-bc36-4f3ac554d6ae_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 608534,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xa/c5c7df1cd7cf48eb961ca158d2e49012/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b64cdfd-3eb2-5af3-bc36-4f3ac554d6ae/9b64cdfd-3eb2-5af3-bc36-4f3ac554d6ae_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 605803,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xa/c5c7df1cd7cf48eb961ca158d2e49012/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b64cdfd-3eb2-5af3-bc36-4f3ac554d6ae/9b64cdfd-3eb2-5af3-bc36-4f3ac554d6ae_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 647975,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xa/c5c7df1cd7cf48eb961ca158d2e49012/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b64cdfd-3eb2-5af3-bc36-4f3ac554d6ae/9b64cdfd-3eb2-5af3-bc36-4f3ac554d6ae_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 597910,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xa/c5c7df1cd7cf48eb961ca158d2e49012/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b64cdfd-3eb2-5af3-bc36-4f3ac554d6ae/9b64cdfd-3eb2-5af3-bc36-4f3ac554d6ae_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 527074,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xa/c5c7df1cd7cf48eb961ca158d2e49012/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b64cdfd-3eb2-5af3-bc36-4f3ac554d6ae/9b64cdfd-3eb2-5af3-bc36-4f3ac554d6ae_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 649260,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xa/c5c7df1cd7cf48eb961ca158d2e49012/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b64cdfd-3eb2-5af3-bc36-4f3ac554d6ae/9b64cdfd-3eb2-5af3-bc36-4f3ac554d6ae_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 646699,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xa/c5c7df1cd7cf48eb961ca158d2e49012/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b64cdfd-3eb2-5af3-bc36-4f3ac554d6ae/9b64cdfd-3eb2-5af3-bc36-4f3ac554d6ae_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 550741,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xa/c5c7df1cd7cf48eb961ca158d2e49012/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b64cdfd-3eb2-5af3-bc36-4f3ac554d6ae/9b64cdfd-3eb2-5af3-bc36-4f3ac554d6ae_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 653403,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xa/c5c7df1cd7cf48eb961ca158d2e49012/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN TIGUAN ALLSPACE 1.5 TSI ACT Comfortline OPF DSG',
 'transmission': 'automatic',
 'trim': '1.5 TSI ACT Comfortline OPF DSG',
 'vin': None,
 'year': 2019}
2026-03-26 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986149%27 HTTP/1.1" 200 None
2026-03-26 22:48:55 [ayvens.be] INFO: Saving data for 1986149: {'created_time': 1774565335.171418, 'last_price_update_time': 1774565335.171427, 'auction_closing_time': 1775028600.0}
2026-03-26 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986149') HTTP/1.1" 204 0
2026-03-26 22:48:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2at/e71d5693288a4e01bac58ff4b73c2809/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2at/e71d5693288a4e01bac58ff4b73c2809/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fa6ac5b56cccb46de82ad7b826e9cb8ad%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/a6ac5b56cccb46de82ad7b826e9cb8ad/images/large/4.jpg not downloaded yet
2026-03-26 22:48:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2at/e71d5693288a4e01bac58ff4b73c2809/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b740bdd0>
2026-03-26 22:48:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcb17396-6d23-5f34-b8f7-a8c6f3dbf8cd/fcb17396-6d23-5f34-b8f7-a8c6f3dbf8cd_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252Fe71d5693288a4e01bac58ff4b73c2809%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/e71d5693288a4e01bac58ff4b73c2809/images/large/5.jpg saved to cache
2026-03-26 22:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fcb17396-6d23-5f34-b8f7-a8c6f3dbf8cd
2026-03-26 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fa6ac5b56cccb46de82ad7b826e9cb8ad%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/a6ac5b56cccb46de82ad7b826e9cb8ad/images/large/5.jpg not downloaded yet
2026-03-26 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fa6ac5b56cccb46de82ad7b826e9cb8ad%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/a6ac5b56cccb46de82ad7b826e9cb8ad/images/large/6.jpg not downloaded yet
2026-03-26 22:48:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2at/e71d5693288a4e01bac58ff4b73c2809/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2at/e71d5693288a4e01bac58ff4b73c2809/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fa6ac5b56cccb46de82ad7b826e9cb8ad%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/a6ac5b56cccb46de82ad7b826e9cb8ad/images/large/7.jpg not downloaded yet
2026-03-26 22:48:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7745f90>
2026-03-26 22:48:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcb17396-6d23-5f34-b8f7-a8c6f3dbf8cd/fcb17396-6d23-5f34-b8f7-a8c6f3dbf8cd_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252Fe71d5693288a4e01bac58ff4b73c2809%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/e71d5693288a4e01bac58ff4b73c2809/images/large/6.jpg saved to cache
2026-03-26 22:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fcb17396-6d23-5f34-b8f7-a8c6f3dbf8cd
2026-03-26 22:48:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79f3950>
2026-03-26 22:48:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcb17396-6d23-5f34-b8f7-a8c6f3dbf8cd/fcb17396-6d23-5f34-b8f7-a8c6f3dbf8cd_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252Fe71d5693288a4e01bac58ff4b73c2809%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/e71d5693288a4e01bac58ff4b73c2809/images/large/7.jpg saved to cache
2026-03-26 22:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fcb17396-6d23-5f34-b8f7-a8c6f3dbf8cd
2026-03-26 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fa6ac5b56cccb46de82ad7b826e9cb8ad%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/a6ac5b56cccb46de82ad7b826e9cb8ad/images/large/8.jpg not downloaded yet
2026-03-26 22:48:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7585e90>
2026-03-26 22:48:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcb17396-6d23-5f34-b8f7-a8c6f3dbf8cd/fcb17396-6d23-5f34-b8f7-a8c6f3dbf8cd_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252Fe71d5693288a4e01bac58ff4b73c2809%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/e71d5693288a4e01bac58ff4b73c2809/images/large/8.jpg saved to cache
2026-03-26 22:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fcb17396-6d23-5f34-b8f7-a8c6f3dbf8cd
2026-03-26 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fa6ac5b56cccb46de82ad7b826e9cb8ad%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/a6ac5b56cccb46de82ad7b826e9cb8ad/images/large/9.jpg not downloaded yet
2026-03-26 22:48:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79f1d10>
2026-03-26 22:48:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcb17396-6d23-5f34-b8f7-a8c6f3dbf8cd/fcb17396-6d23-5f34-b8f7-a8c6f3dbf8cd_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252Fe71d5693288a4e01bac58ff4b73c2809%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/e71d5693288a4e01bac58ff4b73c2809/images/large/9.jpg saved to cache
2026-03-26 22:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fcb17396-6d23-5f34-b8f7-a8c6f3dbf8cd
2026-03-26 22:48:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74dca10>
2026-03-26 22:48:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcb17396-6d23-5f34-b8f7-a8c6f3dbf8cd/fcb17396-6d23-5f34-b8f7-a8c6f3dbf8cd_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252Fe71d5693288a4e01bac58ff4b73c2809%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/e71d5693288a4e01bac58ff4b73c2809/images/large/10.jpg saved to cache
2026-03-26 22:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fcb17396-6d23-5f34-b8f7-a8c6f3dbf8cd
2026-03-26 22:48:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fcb17396-6d23-5f34-b8f7-a8c6f3dbf8cd, skipping ID generation
2026-03-26 22:48:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fcb17396-6d23-5f34-b8f7-a8c6f3dbf8cd with scrape type 1
2026-03-26 22:48:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fcb17396-6d23-5f34-b8f7-a8c6f3dbf8cd sending to next pipeline
2026-03-26 22:48:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: fcb17396-6d23-5f34-b8f7-a8c6f3dbf8cd, identifier: 1986150
2026-03-26 22:48:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/a6ac5b56cccb46de82ad7b826e9cb8ad/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: fcb17396-6d23-5f34-b8f7-a8c6f3dbf8cd with identifier: 1986150
2026-03-26 22:48:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: fcb17396-6d23-5f34-b8f7-a8c6f3dbf8cd with identifier: 1986150
2026-03-26 22:48:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: fcb17396-6d23-5f34-b8f7-a8c6f3dbf8cd with identifier: 1986150 to the API
2026-03-26 22:48:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:48:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:48:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2at/e71d5693288a4e01bac58ff4b73c2809/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'fcb17396-6d23-5f34-b8f7-a8c6f3dbf8cd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLC COUPAu2030',
 'odometer': 96955,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcb17396-6d23-5f34-b8f7-a8c6f3dbf8cd/fcb17396-6d23-5f34-b8f7-a8c6f3dbf8cd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 246346,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2at/e71d5693288a4e01bac58ff4b73c2809/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcb17396-6d23-5f34-b8f7-a8c6f3dbf8cd/fcb17396-6d23-5f34-b8f7-a8c6f3dbf8cd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 237885,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2at/e71d5693288a4e01bac58ff4b73c2809/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcb17396-6d23-5f34-b8f7-a8c6f3dbf8cd/fcb17396-6d23-5f34-b8f7-a8c6f3dbf8cd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 241524,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2at/e71d5693288a4e01bac58ff4b73c2809/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcb17396-6d23-5f34-b8f7-a8c6f3dbf8cd/fcb17396-6d23-5f34-b8f7-a8c6f3dbf8cd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 243707,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2at/e71d5693288a4e01bac58ff4b73c2809/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcb17396-6d23-5f34-b8f7-a8c6f3dbf8cd/fcb17396-6d23-5f34-b8f7-a8c6f3dbf8cd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 363026,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2at/e71d5693288a4e01bac58ff4b73c2809/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcb17396-6d23-5f34-b8f7-a8c6f3dbf8cd/fcb17396-6d23-5f34-b8f7-a8c6f3dbf8cd_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 297581,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2at/e71d5693288a4e01bac58ff4b73c2809/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcb17396-6d23-5f34-b8f7-a8c6f3dbf8cd/fcb17396-6d23-5f34-b8f7-a8c6f3dbf8cd_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 334908,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2at/e71d5693288a4e01bac58ff4b73c2809/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcb17396-6d23-5f34-b8f7-a8c6f3dbf8cd/fcb17396-6d23-5f34-b8f7-a8c6f3dbf8cd_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 395719,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2at/e71d5693288a4e01bac58ff4b73c2809/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcb17396-6d23-5f34-b8f7-a8c6f3dbf8cd/fcb17396-6d23-5f34-b8f7-a8c6f3dbf8cd_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 435767,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2at/e71d5693288a4e01bac58ff4b73c2809/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcb17396-6d23-5f34-b8f7-a8c6f3dbf8cd/fcb17396-6d23-5f34-b8f7-a8c6f3dbf8cd_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 396298,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2at/e71d5693288a4e01bac58ff4b73c2809/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLC COUPAu2030 2.0 GLC 300 DE 4MATIC 4WD AUTO',
 'transmission': 'manual',
 'trim': '2.0 GLC 300 DE 4MATIC 4WD AUTO',
 'vin': None,
 'year': 2021}
2026-03-26 22:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986150%27 HTTP/1.1" 200 None
2026-03-26 22:48:56 [ayvens.be] INFO: Saving data for 1986150: {'created_time': 1774565336.242648, 'last_price_update_time': 1774565336.242657, 'auction_closing_time': 1775028600.0}
2026-03-26 22:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986150') HTTP/1.1" 204 0
2026-03-26 22:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fa6ac5b56cccb46de82ad7b826e9cb8ad%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/a6ac5b56cccb46de82ad7b826e9cb8ad/images/large/10.jpg not downloaded yet
2026-03-26 22:48:56 [ayvens.be] INFO: Found listing with ID: 1986152
2026-03-26 22:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986152%27 HTTP/1.1" 200 None
2026-03-26 22:48:56 [ayvens.be] INFO: Scrape type for 1986152: 1
2026-03-26 22:48:56 [ayvens.be] INFO: Extracting data for car ID: 1986152
2026-03-26 22:48:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 98b50fbd-2b43-55b4-afb3-d71d9cfc47c9 with identifier: 1986152
2026-03-26 22:48:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98b50fbd-2b43-55b4-afb3-d71d9cfc47c9 with scrape type 1
2026-03-26 22:48:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 98b50fbd-2b43-55b4-afb3-d71d9cfc47c9
2026-03-26 22:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F0c8f51b3df2d44c3bd9981433276d545%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/0c8f51b3df2d44c3bd9981433276d545/images/large/1.jpg not downloaded yet
2026-03-26 22:48:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76ef190>
2026-03-26 22:48:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5229c5e-a5ef-5efd-b602-a0f989598542/c5229c5e-a5ef-5efd-b602-a0f989598542_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fa6ac5b56cccb46de82ad7b826e9cb8ad%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/a6ac5b56cccb46de82ad7b826e9cb8ad/images/large/1.jpg saved to cache
2026-03-26 22:48:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c5229c5e-a5ef-5efd-b602-a0f989598542
2026-03-26 22:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F0c8f51b3df2d44c3bd9981433276d545%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/0c8f51b3df2d44c3bd9981433276d545/images/large/2.jpg not downloaded yet
2026-03-26 22:48:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/a6ac5b56cccb46de82ad7b826e9cb8ad/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F0c8f51b3df2d44c3bd9981433276d545%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/0c8f51b3df2d44c3bd9981433276d545/images/large/3.jpg not downloaded yet
2026-03-26 22:48:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/a6ac5b56cccb46de82ad7b826e9cb8ad/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/a6ac5b56cccb46de82ad7b826e9cb8ad/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/a6ac5b56cccb46de82ad7b826e9cb8ad/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F0c8f51b3df2d44c3bd9981433276d545%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/0c8f51b3df2d44c3bd9981433276d545/images/large/4.jpg not downloaded yet
2026-03-26 22:48:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/a6ac5b56cccb46de82ad7b826e9cb8ad/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F0c8f51b3df2d44c3bd9981433276d545%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/0c8f51b3df2d44c3bd9981433276d545/images/large/5.jpg not downloaded yet
2026-03-26 22:48:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/a6ac5b56cccb46de82ad7b826e9cb8ad/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F0c8f51b3df2d44c3bd9981433276d545%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/0c8f51b3df2d44c3bd9981433276d545/images/large/6.jpg not downloaded yet
2026-03-26 22:48:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/a6ac5b56cccb46de82ad7b826e9cb8ad/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F0c8f51b3df2d44c3bd9981433276d545%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/0c8f51b3df2d44c3bd9981433276d545/images/large/7.jpg not downloaded yet
2026-03-26 22:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F0c8f51b3df2d44c3bd9981433276d545%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/0c8f51b3df2d44c3bd9981433276d545/images/large/8.jpg not downloaded yet
2026-03-26 22:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F0c8f51b3df2d44c3bd9981433276d545%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/0c8f51b3df2d44c3bd9981433276d545/images/large/9.jpg not downloaded yet
2026-03-26 22:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F0c8f51b3df2d44c3bd9981433276d545%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/0c8f51b3df2d44c3bd9981433276d545/images/large/10.jpg not downloaded yet
2026-03-26 22:48:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6dc1810>
2026-03-26 22:48:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5229c5e-a5ef-5efd-b602-a0f989598542/c5229c5e-a5ef-5efd-b602-a0f989598542_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fa6ac5b56cccb46de82ad7b826e9cb8ad%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/a6ac5b56cccb46de82ad7b826e9cb8ad/images/large/2.jpg saved to cache
2026-03-26 22:48:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c5229c5e-a5ef-5efd-b602-a0f989598542
2026-03-26 22:48:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/a6ac5b56cccb46de82ad7b826e9cb8ad/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:56 [ayvens.be] INFO: Found listing with ID: 1986153
2026-03-26 22:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986153%27 HTTP/1.1" 200 None
2026-03-26 22:48:56 [ayvens.be] INFO: Scrape type for 1986153: 1
2026-03-26 22:48:56 [ayvens.be] INFO: Extracting data for car ID: 1986153
2026-03-26 22:48:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99ec590c-0586-55a1-90df-b2f32e99d033 with identifier: 1986153
2026-03-26 22:48:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99ec590c-0586-55a1-90df-b2f32e99d033 with scrape type 1
2026-03-26 22:48:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 99ec590c-0586-55a1-90df-b2f32e99d033
2026-03-26 22:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yk%252F9ab1a0f6ef0f4c1ba837800e05c797cf%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yk/9ab1a0f6ef0f4c1ba837800e05c797cf/images/large/1.jpg not downloaded yet
2026-03-26 22:48:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b78ab8d0>
2026-03-26 22:48:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5229c5e-a5ef-5efd-b602-a0f989598542/c5229c5e-a5ef-5efd-b602-a0f989598542_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fa6ac5b56cccb46de82ad7b826e9cb8ad%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/a6ac5b56cccb46de82ad7b826e9cb8ad/images/large/5.jpg saved to cache
2026-03-26 22:48:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c5229c5e-a5ef-5efd-b602-a0f989598542
2026-03-26 22:48:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79f2cd0>
2026-03-26 22:48:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5229c5e-a5ef-5efd-b602-a0f989598542/c5229c5e-a5ef-5efd-b602-a0f989598542_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fa6ac5b56cccb46de82ad7b826e9cb8ad%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/a6ac5b56cccb46de82ad7b826e9cb8ad/images/large/3.jpg saved to cache
2026-03-26 22:48:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c5229c5e-a5ef-5efd-b602-a0f989598542
2026-03-26 22:48:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b745af90>
2026-03-26 22:48:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5229c5e-a5ef-5efd-b602-a0f989598542/c5229c5e-a5ef-5efd-b602-a0f989598542_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fa6ac5b56cccb46de82ad7b826e9cb8ad%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/a6ac5b56cccb46de82ad7b826e9cb8ad/images/large/4.jpg saved to cache
2026-03-26 22:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c5229c5e-a5ef-5efd-b602-a0f989598542
2026-03-26 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yk%252F9ab1a0f6ef0f4c1ba837800e05c797cf%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yk/9ab1a0f6ef0f4c1ba837800e05c797cf/images/large/2.jpg not downloaded yet
2026-03-26 22:48:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7586c90>
2026-03-26 22:48:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5229c5e-a5ef-5efd-b602-a0f989598542/c5229c5e-a5ef-5efd-b602-a0f989598542_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fa6ac5b56cccb46de82ad7b826e9cb8ad%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/a6ac5b56cccb46de82ad7b826e9cb8ad/images/large/6.jpg saved to cache
2026-03-26 22:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c5229c5e-a5ef-5efd-b602-a0f989598542
2026-03-26 22:48:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e10410>
2026-03-26 22:48:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5229c5e-a5ef-5efd-b602-a0f989598542/c5229c5e-a5ef-5efd-b602-a0f989598542_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fa6ac5b56cccb46de82ad7b826e9cb8ad%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/a6ac5b56cccb46de82ad7b826e9cb8ad/images/large/7.jpg saved to cache
2026-03-26 22:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c5229c5e-a5ef-5efd-b602-a0f989598542
2026-03-26 22:48:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74a60d0>
2026-03-26 22:48:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5229c5e-a5ef-5efd-b602-a0f989598542/c5229c5e-a5ef-5efd-b602-a0f989598542_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fa6ac5b56cccb46de82ad7b826e9cb8ad%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/a6ac5b56cccb46de82ad7b826e9cb8ad/images/large/9.jpg saved to cache
2026-03-26 22:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c5229c5e-a5ef-5efd-b602-a0f989598542
2026-03-26 22:48:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/0c8f51b3df2d44c3bd9981433276d545/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/0c8f51b3df2d44c3bd9981433276d545/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6d80810>
2026-03-26 22:48:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5229c5e-a5ef-5efd-b602-a0f989598542/c5229c5e-a5ef-5efd-b602-a0f989598542_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fa6ac5b56cccb46de82ad7b826e9cb8ad%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/a6ac5b56cccb46de82ad7b826e9cb8ad/images/large/8.jpg saved to cache
2026-03-26 22:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c5229c5e-a5ef-5efd-b602-a0f989598542
2026-03-26 22:48:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/0c8f51b3df2d44c3bd9981433276d545/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yk%252F9ab1a0f6ef0f4c1ba837800e05c797cf%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yk/9ab1a0f6ef0f4c1ba837800e05c797cf/images/large/3.jpg not downloaded yet
2026-03-26 22:48:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/0c8f51b3df2d44c3bd9981433276d545/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yk%252F9ab1a0f6ef0f4c1ba837800e05c797cf%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yk/9ab1a0f6ef0f4c1ba837800e05c797cf/images/large/4.jpg not downloaded yet
2026-03-26 22:48:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/0c8f51b3df2d44c3bd9981433276d545/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/a6ac5b56cccb46de82ad7b826e9cb8ad/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yk%252F9ab1a0f6ef0f4c1ba837800e05c797cf%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yk/9ab1a0f6ef0f4c1ba837800e05c797cf/images/large/5.jpg not downloaded yet
2026-03-26 22:48:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7592e90>
2026-03-26 22:48:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98b50fbd-2b43-55b4-afb3-d71d9cfc47c9/98b50fbd-2b43-55b4-afb3-d71d9cfc47c9_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F0c8f51b3df2d44c3bd9981433276d545%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/0c8f51b3df2d44c3bd9981433276d545/images/large/1.jpg saved to cache
2026-03-26 22:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 98b50fbd-2b43-55b4-afb3-d71d9cfc47c9
2026-03-26 22:48:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b792f3d0>
2026-03-26 22:48:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98b50fbd-2b43-55b4-afb3-d71d9cfc47c9/98b50fbd-2b43-55b4-afb3-d71d9cfc47c9_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F0c8f51b3df2d44c3bd9981433276d545%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/0c8f51b3df2d44c3bd9981433276d545/images/large/5.jpg saved to cache
2026-03-26 22:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 98b50fbd-2b43-55b4-afb3-d71d9cfc47c9
2026-03-26 22:48:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/0c8f51b3df2d44c3bd9981433276d545/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/0c8f51b3df2d44c3bd9981433276d545/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yk%252F9ab1a0f6ef0f4c1ba837800e05c797cf%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yk/9ab1a0f6ef0f4c1ba837800e05c797cf/images/large/6.jpg not downloaded yet
2026-03-26 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yk%252F9ab1a0f6ef0f4c1ba837800e05c797cf%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yk/9ab1a0f6ef0f4c1ba837800e05c797cf/images/large/7.jpg not downloaded yet
2026-03-26 22:48:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yk/9ab1a0f6ef0f4c1ba837800e05c797cf/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7773810>
2026-03-26 22:48:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98b50fbd-2b43-55b4-afb3-d71d9cfc47c9/98b50fbd-2b43-55b4-afb3-d71d9cfc47c9_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F0c8f51b3df2d44c3bd9981433276d545%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/0c8f51b3df2d44c3bd9981433276d545/images/large/3.jpg saved to cache
2026-03-26 22:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 98b50fbd-2b43-55b4-afb3-d71d9cfc47c9
2026-03-26 22:48:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74a4b50>
2026-03-26 22:48:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98b50fbd-2b43-55b4-afb3-d71d9cfc47c9/98b50fbd-2b43-55b4-afb3-d71d9cfc47c9_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F0c8f51b3df2d44c3bd9981433276d545%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/0c8f51b3df2d44c3bd9981433276d545/images/large/6.jpg saved to cache
2026-03-26 22:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 98b50fbd-2b43-55b4-afb3-d71d9cfc47c9
2026-03-26 22:48:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77d46d0>
2026-03-26 22:48:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98b50fbd-2b43-55b4-afb3-d71d9cfc47c9/98b50fbd-2b43-55b4-afb3-d71d9cfc47c9_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F0c8f51b3df2d44c3bd9981433276d545%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/0c8f51b3df2d44c3bd9981433276d545/images/large/7.jpg saved to cache
2026-03-26 22:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 98b50fbd-2b43-55b4-afb3-d71d9cfc47c9
2026-03-26 22:48:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7aa32d0>
2026-03-26 22:48:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5229c5e-a5ef-5efd-b602-a0f989598542/c5229c5e-a5ef-5efd-b602-a0f989598542_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fa6ac5b56cccb46de82ad7b826e9cb8ad%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/a6ac5b56cccb46de82ad7b826e9cb8ad/images/large/10.jpg saved to cache
2026-03-26 22:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c5229c5e-a5ef-5efd-b602-a0f989598542
2026-03-26 22:48:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c5229c5e-a5ef-5efd-b602-a0f989598542, skipping ID generation
2026-03-26 22:48:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5229c5e-a5ef-5efd-b602-a0f989598542 with scrape type 1
2026-03-26 22:48:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c5229c5e-a5ef-5efd-b602-a0f989598542 sending to next pipeline
2026-03-26 22:48:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c5229c5e-a5ef-5efd-b602-a0f989598542, identifier: 1986151
2026-03-26 22:48:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/0c8f51b3df2d44c3bd9981433276d545/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/0c8f51b3df2d44c3bd9981433276d545/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yk%252F9ab1a0f6ef0f4c1ba837800e05c797cf%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yk/9ab1a0f6ef0f4c1ba837800e05c797cf/images/large/8.jpg not downloaded yet
2026-03-26 22:48:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c5229c5e-a5ef-5efd-b602-a0f989598542 with identifier: 1986151
2026-03-26 22:48:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c5229c5e-a5ef-5efd-b602-a0f989598542 with identifier: 1986151
2026-03-26 22:48:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c5229c5e-a5ef-5efd-b602-a0f989598542 with identifier: 1986151 to the API
2026-03-26 22:48:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:48:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:48:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yw/a6ac5b56cccb46de82ad7b826e9cb8ad/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'c5229c5e-a5ef-5efd-b602-a0f989598542',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'V90 - 2020',
 'odometer': 125307,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5229c5e-a5ef-5efd-b602-a0f989598542/c5229c5e-a5ef-5efd-b602-a0f989598542_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 722165,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/a6ac5b56cccb46de82ad7b826e9cb8ad/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5229c5e-a5ef-5efd-b602-a0f989598542/c5229c5e-a5ef-5efd-b602-a0f989598542_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 696984,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/a6ac5b56cccb46de82ad7b826e9cb8ad/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5229c5e-a5ef-5efd-b602-a0f989598542/c5229c5e-a5ef-5efd-b602-a0f989598542_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 720506,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/a6ac5b56cccb46de82ad7b826e9cb8ad/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5229c5e-a5ef-5efd-b602-a0f989598542/c5229c5e-a5ef-5efd-b602-a0f989598542_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 733679,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/a6ac5b56cccb46de82ad7b826e9cb8ad/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5229c5e-a5ef-5efd-b602-a0f989598542/c5229c5e-a5ef-5efd-b602-a0f989598542_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 672853,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/a6ac5b56cccb46de82ad7b826e9cb8ad/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5229c5e-a5ef-5efd-b602-a0f989598542/c5229c5e-a5ef-5efd-b602-a0f989598542_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 600844,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/a6ac5b56cccb46de82ad7b826e9cb8ad/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5229c5e-a5ef-5efd-b602-a0f989598542/c5229c5e-a5ef-5efd-b602-a0f989598542_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 743921,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/a6ac5b56cccb46de82ad7b826e9cb8ad/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5229c5e-a5ef-5efd-b602-a0f989598542/c5229c5e-a5ef-5efd-b602-a0f989598542_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 735523,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/a6ac5b56cccb46de82ad7b826e9cb8ad/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5229c5e-a5ef-5efd-b602-a0f989598542/c5229c5e-a5ef-5efd-b602-a0f989598542_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 474348,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/a6ac5b56cccb46de82ad7b826e9cb8ad/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5229c5e-a5ef-5efd-b602-a0f989598542/c5229c5e-a5ef-5efd-b602-a0f989598542_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 586751,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/a6ac5b56cccb46de82ad7b826e9cb8ad/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO V90 - 2020 2.0 T6 AWD PHEV Inscription Expression G',
 'transmission': 'automatic',
 'trim': '2.0 T6 AWD PHEV Inscription Expression G',
 'vin': None,
 'year': 2021}
2026-03-26 22:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986151%27 HTTP/1.1" 200 None
2026-03-26 22:48:58 [ayvens.be] INFO: Saving data for 1986151: {'created_time': 1774565338.538969, 'last_price_update_time': 1774565338.538978, 'auction_closing_time': 1775028600.0}
2026-03-26 22:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986151') HTTP/1.1" 204 0
2026-03-26 22:48:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/0c8f51b3df2d44c3bd9981433276d545/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yk%252F9ab1a0f6ef0f4c1ba837800e05c797cf%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yk/9ab1a0f6ef0f4c1ba837800e05c797cf/images/large/9.jpg not downloaded yet
2026-03-26 22:48:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd3ba9d0>
2026-03-26 22:48:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98b50fbd-2b43-55b4-afb3-d71d9cfc47c9/98b50fbd-2b43-55b4-afb3-d71d9cfc47c9_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F0c8f51b3df2d44c3bd9981433276d545%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/0c8f51b3df2d44c3bd9981433276d545/images/large/4.jpg saved to cache
2026-03-26 22:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 98b50fbd-2b43-55b4-afb3-d71d9cfc47c9
2026-03-26 22:48:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5ca62d0>
2026-03-26 22:48:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98b50fbd-2b43-55b4-afb3-d71d9cfc47c9/98b50fbd-2b43-55b4-afb3-d71d9cfc47c9_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F0c8f51b3df2d44c3bd9981433276d545%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/0c8f51b3df2d44c3bd9981433276d545/images/large/2.jpg saved to cache
2026-03-26 22:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 98b50fbd-2b43-55b4-afb3-d71d9cfc47c9
2026-03-26 22:48:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76ec4d0>
2026-03-26 22:48:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99ec590c-0586-55a1-90df-b2f32e99d033/99ec590c-0586-55a1-90df-b2f32e99d033_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yk%252F9ab1a0f6ef0f4c1ba837800e05c797cf%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yk/9ab1a0f6ef0f4c1ba837800e05c797cf/images/large/1.jpg saved to cache
2026-03-26 22:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 99ec590c-0586-55a1-90df-b2f32e99d033
2026-03-26 22:48:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74cd9d0>
2026-03-26 22:48:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98b50fbd-2b43-55b4-afb3-d71d9cfc47c9/98b50fbd-2b43-55b4-afb3-d71d9cfc47c9_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F0c8f51b3df2d44c3bd9981433276d545%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/0c8f51b3df2d44c3bd9981433276d545/images/large/9.jpg saved to cache
2026-03-26 22:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 98b50fbd-2b43-55b4-afb3-d71d9cfc47c9
2026-03-26 22:48:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76630d0>
2026-03-26 22:48:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98b50fbd-2b43-55b4-afb3-d71d9cfc47c9/98b50fbd-2b43-55b4-afb3-d71d9cfc47c9_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F0c8f51b3df2d44c3bd9981433276d545%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/0c8f51b3df2d44c3bd9981433276d545/images/large/10.jpg saved to cache
2026-03-26 22:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 98b50fbd-2b43-55b4-afb3-d71d9cfc47c9
2026-03-26 22:48:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yk/9ab1a0f6ef0f4c1ba837800e05c797cf/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yk/9ab1a0f6ef0f4c1ba837800e05c797cf/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yk/9ab1a0f6ef0f4c1ba837800e05c797cf/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yk%252F9ab1a0f6ef0f4c1ba837800e05c797cf%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:48:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yk/9ab1a0f6ef0f4c1ba837800e05c797cf/images/large/10.jpg not downloaded yet
2026-03-26 22:48:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:48:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7408e10>
2026-03-26 22:48:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:48:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:48:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:48:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98b50fbd-2b43-55b4-afb3-d71d9cfc47c9/98b50fbd-2b43-55b4-afb3-d71d9cfc47c9_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F0c8f51b3df2d44c3bd9981433276d545%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:48:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/0c8f51b3df2d44c3bd9981433276d545/images/large/8.jpg saved to cache
2026-03-26 22:48:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 98b50fbd-2b43-55b4-afb3-d71d9cfc47c9
2026-03-26 22:48:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 98b50fbd-2b43-55b4-afb3-d71d9cfc47c9, skipping ID generation
2026-03-26 22:48:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98b50fbd-2b43-55b4-afb3-d71d9cfc47c9 with scrape type 1
2026-03-26 22:48:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 98b50fbd-2b43-55b4-afb3-d71d9cfc47c9 sending to next pipeline
2026-03-26 22:48:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 98b50fbd-2b43-55b4-afb3-d71d9cfc47c9, identifier: 1986152
2026-03-26 22:48:59 [ayvens.be] INFO: Found listing with ID: 1983710
2026-03-26 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983710%27 HTTP/1.1" 200 None
2026-03-26 22:48:59 [ayvens.be] INFO: Scrape type for 1983710: 0
2026-03-26 22:48:59 [ayvens.be] INFO: Found listing with ID: 1983711
2026-03-26 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983711%27 HTTP/1.1" 200 None
2026-03-26 22:48:59 [ayvens.be] INFO: Scrape type for 1983711: 0
2026-03-26 22:48:59 [ayvens.be] INFO: Found listing with ID: 1983712
2026-03-26 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983712%27 HTTP/1.1" 200 None
2026-03-26 22:48:59 [ayvens.be] INFO: Scrape type for 1983712: 0
2026-03-26 22:48:59 [ayvens.be] INFO: Found listing with ID: 1983713
2026-03-26 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983713%27 HTTP/1.1" 200 None
2026-03-26 22:48:59 [ayvens.be] INFO: Scrape type for 1983713: 0
2026-03-26 22:48:59 [ayvens.be] INFO: Found listing with ID: 1983714
2026-03-26 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983714%27 HTTP/1.1" 200 None
2026-03-26 22:48:59 [ayvens.be] INFO: Scrape type for 1983714: 0
2026-03-26 22:48:59 [ayvens.be] INFO: Found listing with ID: 1983715
2026-03-26 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983715%27 HTTP/1.1" 200 None
2026-03-26 22:48:59 [ayvens.be] INFO: Scrape type for 1983715: 0
2026-03-26 22:48:59 [ayvens.be] INFO: Found listing with ID: 1983716
2026-03-26 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983716%27 HTTP/1.1" 200 None
2026-03-26 22:48:59 [ayvens.be] INFO: Scrape type for 1983716: 0
2026-03-26 22:48:59 [ayvens.be] INFO: Found listing with ID: 1983717
2026-03-26 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983717%27 HTTP/1.1" 200 None
2026-03-26 22:48:59 [ayvens.be] INFO: Scrape type for 1983717: 0
2026-03-26 22:48:59 [ayvens.be] INFO: Found listing with ID: 1983718
2026-03-26 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983718%27 HTTP/1.1" 200 None
2026-03-26 22:48:59 [ayvens.be] INFO: Scrape type for 1983718: 0
2026-03-26 22:48:59 [ayvens.be] INFO: Found listing with ID: 1983719
2026-03-26 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983719%27 HTTP/1.1" 200 None
2026-03-26 22:48:59 [ayvens.be] INFO: Scrape type for 1983719: 0
2026-03-26 22:48:59 [ayvens.be] INFO: Found listing with ID: 1983720
2026-03-26 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983720%27 HTTP/1.1" 200 None
2026-03-26 22:48:59 [ayvens.be] INFO: Scrape type for 1983720: 0
2026-03-26 22:48:59 [ayvens.be] INFO: Found listing with ID: 1983721
2026-03-26 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983721%27 HTTP/1.1" 200 None
2026-03-26 22:48:59 [ayvens.be] INFO: Scrape type for 1983721: 0
2026-03-26 22:48:59 [ayvens.be] INFO: Found listing with ID: 1983722
2026-03-26 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983722%27 HTTP/1.1" 200 None
2026-03-26 22:48:59 [ayvens.be] INFO: Scrape type for 1983722: 0
2026-03-26 22:48:59 [ayvens.be] INFO: Found listing with ID: 1983723
2026-03-26 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983723%27 HTTP/1.1" 200 None
2026-03-26 22:48:59 [ayvens.be] INFO: Scrape type for 1983723: 0
2026-03-26 22:48:59 [ayvens.be] INFO: Found listing with ID: 1983724
2026-03-26 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983724%27 HTTP/1.1" 200 None
2026-03-26 22:48:59 [ayvens.be] INFO: Scrape type for 1983724: 0
2026-03-26 22:48:59 [ayvens.be] INFO: Found listing with ID: 1983725
2026-03-26 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983725%27 HTTP/1.1" 200 None
2026-03-26 22:48:59 [ayvens.be] INFO: Scrape type for 1983725: 0
2026-03-26 22:48:59 [ayvens.be] INFO: Found listing with ID: 1983726
2026-03-26 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983726%27 HTTP/1.1" 200 None
2026-03-26 22:48:59 [ayvens.be] INFO: Scrape type for 1983726: 0
2026-03-26 22:48:59 [ayvens.be] INFO: Found listing with ID: 1983727
2026-03-26 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983727%27 HTTP/1.1" 200 None
2026-03-26 22:48:59 [ayvens.be] INFO: Scrape type for 1983727: 0
2026-03-26 22:48:59 [ayvens.be] INFO: Found listing with ID: 1983728
2026-03-26 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983728%27 HTTP/1.1" 200 None
2026-03-26 22:48:59 [ayvens.be] INFO: Scrape type for 1983728: 0
2026-03-26 22:48:59 [ayvens.be] INFO: Found listing with ID: 1983729
2026-03-26 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983729%27 HTTP/1.1" 200 None
2026-03-26 22:48:59 [ayvens.be] INFO: Scrape type for 1983729: 0
2026-03-26 22:48:59 [ayvens.be] INFO: Found listing with ID: 1983730
2026-03-26 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983730%27 HTTP/1.1" 200 None
2026-03-26 22:48:59 [ayvens.be] INFO: Scrape type for 1983730: 0
2026-03-26 22:48:59 [ayvens.be] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 200
2026-03-26 22:48:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 98b50fbd-2b43-55b4-afb3-d71d9cfc47c9 with identifier: 1986152
2026-03-26 22:48:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 98b50fbd-2b43-55b4-afb3-d71d9cfc47c9 with identifier: 1986152
2026-03-26 22:48:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 98b50fbd-2b43-55b4-afb3-d71d9cfc47c9 with identifier: 1986152 to the API
2026-03-26 22:48:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:48:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:48:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bq/0c8f51b3df2d44c3bd9981433276d545/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'electric',
 'id': '98b50fbd-2b43-55b4-afb3-d71d9cfc47c9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q4 E-TRON',
 'odometer': 44498,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98b50fbd-2b43-55b4-afb3-d71d9cfc47c9/98b50fbd-2b43-55b4-afb3-d71d9cfc47c9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 431715,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/0c8f51b3df2d44c3bd9981433276d545/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98b50fbd-2b43-55b4-afb3-d71d9cfc47c9/98b50fbd-2b43-55b4-afb3-d71d9cfc47c9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 492971,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/0c8f51b3df2d44c3bd9981433276d545/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98b50fbd-2b43-55b4-afb3-d71d9cfc47c9/98b50fbd-2b43-55b4-afb3-d71d9cfc47c9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 433485,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/0c8f51b3df2d44c3bd9981433276d545/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98b50fbd-2b43-55b4-afb3-d71d9cfc47c9/98b50fbd-2b43-55b4-afb3-d71d9cfc47c9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 501437,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/0c8f51b3df2d44c3bd9981433276d545/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98b50fbd-2b43-55b4-afb3-d71d9cfc47c9/98b50fbd-2b43-55b4-afb3-d71d9cfc47c9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 264485,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/0c8f51b3df2d44c3bd9981433276d545/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98b50fbd-2b43-55b4-afb3-d71d9cfc47c9/98b50fbd-2b43-55b4-afb3-d71d9cfc47c9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 353191,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/0c8f51b3df2d44c3bd9981433276d545/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98b50fbd-2b43-55b4-afb3-d71d9cfc47c9/98b50fbd-2b43-55b4-afb3-d71d9cfc47c9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 215637,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/0c8f51b3df2d44c3bd9981433276d545/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98b50fbd-2b43-55b4-afb3-d71d9cfc47c9/98b50fbd-2b43-55b4-afb3-d71d9cfc47c9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 424810,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/0c8f51b3df2d44c3bd9981433276d545/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98b50fbd-2b43-55b4-afb3-d71d9cfc47c9/98b50fbd-2b43-55b4-afb3-d71d9cfc47c9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 321006,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/0c8f51b3df2d44c3bd9981433276d545/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98b50fbd-2b43-55b4-afb3-d71d9cfc47c9/98b50fbd-2b43-55b4-afb3-d71d9cfc47c9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 270836,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/0c8f51b3df2d44c3bd9981433276d545/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q4 E-TRON BEV 82KWH 50 S LINE AUTO 4WD',
 'transmission': 'automatic',
 'trim': 'BEV 82KWH 50 S LINE AUTO 4WD',
 'vin': None,
 'year': 2022}
2026-03-26 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986152%27 HTTP/1.1" 200 None
2026-03-26 22:48:59 [ayvens.be] INFO: Saving data for 1986152: {'created_time': 1774565339.899838, 'last_price_update_time': 1774565339.899849, 'auction_closing_time': 1775028600.0}
2026-03-26 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986152') HTTP/1.1" 204 0
2026-03-26 22:49:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yk/9ab1a0f6ef0f4c1ba837800e05c797cf/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yk/9ab1a0f6ef0f4c1ba837800e05c797cf/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yk/9ab1a0f6ef0f4c1ba837800e05c797cf/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-26 22:49:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b740a690>
2026-03-26 22:49:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99ec590c-0586-55a1-90df-b2f32e99d033/99ec590c-0586-55a1-90df-b2f32e99d033_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yk%252F9ab1a0f6ef0f4c1ba837800e05c797cf%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yk/9ab1a0f6ef0f4c1ba837800e05c797cf/images/large/2.jpg saved to cache
2026-03-26 22:49:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 99ec590c-0586-55a1-90df-b2f32e99d033
2026-03-26 22:49:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7409990>
2026-03-26 22:49:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99ec590c-0586-55a1-90df-b2f32e99d033/99ec590c-0586-55a1-90df-b2f32e99d033_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yk%252F9ab1a0f6ef0f4c1ba837800e05c797cf%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yk/9ab1a0f6ef0f4c1ba837800e05c797cf/images/large/3.jpg saved to cache
2026-03-26 22:49:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 99ec590c-0586-55a1-90df-b2f32e99d033
2026-03-26 22:49:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7590050>
2026-03-26 22:49:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99ec590c-0586-55a1-90df-b2f32e99d033/99ec590c-0586-55a1-90df-b2f32e99d033_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yk%252F9ab1a0f6ef0f4c1ba837800e05c797cf%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yk/9ab1a0f6ef0f4c1ba837800e05c797cf/images/large/4.jpg saved to cache
2026-03-26 22:49:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 99ec590c-0586-55a1-90df-b2f32e99d033
2026-03-26 22:49:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yk/9ab1a0f6ef0f4c1ba837800e05c797cf/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yk/9ab1a0f6ef0f4c1ba837800e05c797cf/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77d58d0>
2026-03-26 22:49:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99ec590c-0586-55a1-90df-b2f32e99d033/99ec590c-0586-55a1-90df-b2f32e99d033_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yk%252F9ab1a0f6ef0f4c1ba837800e05c797cf%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yk/9ab1a0f6ef0f4c1ba837800e05c797cf/images/large/5.jpg saved to cache
2026-03-26 22:49:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 99ec590c-0586-55a1-90df-b2f32e99d033
2026-03-26 22:49:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74398d0>
2026-03-26 22:49:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99ec590c-0586-55a1-90df-b2f32e99d033/99ec590c-0586-55a1-90df-b2f32e99d033_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yk%252F9ab1a0f6ef0f4c1ba837800e05c797cf%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yk/9ab1a0f6ef0f4c1ba837800e05c797cf/images/large/6.jpg saved to cache
2026-03-26 22:49:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 99ec590c-0586-55a1-90df-b2f32e99d033
2026-03-26 22:49:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cc3190>
2026-03-26 22:49:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99ec590c-0586-55a1-90df-b2f32e99d033/99ec590c-0586-55a1-90df-b2f32e99d033_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yk%252F9ab1a0f6ef0f4c1ba837800e05c797cf%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yk/9ab1a0f6ef0f4c1ba837800e05c797cf/images/large/7.jpg saved to cache
2026-03-26 22:49:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 99ec590c-0586-55a1-90df-b2f32e99d033
2026-03-26 22:49:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76a7910>
2026-03-26 22:49:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99ec590c-0586-55a1-90df-b2f32e99d033/99ec590c-0586-55a1-90df-b2f32e99d033_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yk%252F9ab1a0f6ef0f4c1ba837800e05c797cf%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yk/9ab1a0f6ef0f4c1ba837800e05c797cf/images/large/8.jpg saved to cache
2026-03-26 22:49:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 99ec590c-0586-55a1-90df-b2f32e99d033
2026-03-26 22:49:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b727ba90>
2026-03-26 22:49:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99ec590c-0586-55a1-90df-b2f32e99d033/99ec590c-0586-55a1-90df-b2f32e99d033_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yk%252F9ab1a0f6ef0f4c1ba837800e05c797cf%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yk/9ab1a0f6ef0f4c1ba837800e05c797cf/images/large/9.jpg saved to cache
2026-03-26 22:49:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 99ec590c-0586-55a1-90df-b2f32e99d033
2026-03-26 22:49:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yk/9ab1a0f6ef0f4c1ba837800e05c797cf/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74fa9d0>
2026-03-26 22:49:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99ec590c-0586-55a1-90df-b2f32e99d033/99ec590c-0586-55a1-90df-b2f32e99d033_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yk%252F9ab1a0f6ef0f4c1ba837800e05c797cf%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yk/9ab1a0f6ef0f4c1ba837800e05c797cf/images/large/10.jpg saved to cache
2026-03-26 22:49:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 99ec590c-0586-55a1-90df-b2f32e99d033
2026-03-26 22:49:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 99ec590c-0586-55a1-90df-b2f32e99d033, skipping ID generation
2026-03-26 22:49:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99ec590c-0586-55a1-90df-b2f32e99d033 with scrape type 1
2026-03-26 22:49:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 99ec590c-0586-55a1-90df-b2f32e99d033 sending to next pipeline
2026-03-26 22:49:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 99ec590c-0586-55a1-90df-b2f32e99d033, identifier: 1986153
2026-03-26 22:49:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 99ec590c-0586-55a1-90df-b2f32e99d033 with identifier: 1986153
2026-03-26 22:49:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 99ec590c-0586-55a1-90df-b2f32e99d033 with identifier: 1986153
2026-03-26 22:49:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 99ec590c-0586-55a1-90df-b2f32e99d033 with identifier: 1986153 to the API
2026-03-26 22:49:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:49:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:49:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yk/9ab1a0f6ef0f4c1ba837800e05c797cf/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 154,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-04-01T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '99ec590c-0586-55a1-90df-b2f32e99d033',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41073',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X3 DIESEL - 2018',
 'odometer': 73440,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99ec590c-0586-55a1-90df-b2f32e99d033/99ec590c-0586-55a1-90df-b2f32e99d033_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 235197,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yk/9ab1a0f6ef0f4c1ba837800e05c797cf/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99ec590c-0586-55a1-90df-b2f32e99d033/99ec590c-0586-55a1-90df-b2f32e99d033_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 229043,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yk/9ab1a0f6ef0f4c1ba837800e05c797cf/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99ec590c-0586-55a1-90df-b2f32e99d033/99ec590c-0586-55a1-90df-b2f32e99d033_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 246886,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yk/9ab1a0f6ef0f4c1ba837800e05c797cf/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99ec590c-0586-55a1-90df-b2f32e99d033/99ec590c-0586-55a1-90df-b2f32e99d033_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 246199,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yk/9ab1a0f6ef0f4c1ba837800e05c797cf/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99ec590c-0586-55a1-90df-b2f32e99d033/99ec590c-0586-55a1-90df-b2f32e99d033_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 440093,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yk/9ab1a0f6ef0f4c1ba837800e05c797cf/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99ec590c-0586-55a1-90df-b2f32e99d033/99ec590c-0586-55a1-90df-b2f32e99d033_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 242677,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yk/9ab1a0f6ef0f4c1ba837800e05c797cf/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99ec590c-0586-55a1-90df-b2f32e99d033/99ec590c-0586-55a1-90df-b2f32e99d033_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 230769,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yk/9ab1a0f6ef0f4c1ba837800e05c797cf/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99ec590c-0586-55a1-90df-b2f32e99d033/99ec590c-0586-55a1-90df-b2f32e99d033_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 227236,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yk/9ab1a0f6ef0f4c1ba837800e05c797cf/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99ec590c-0586-55a1-90df-b2f32e99d033/99ec590c-0586-55a1-90df-b2f32e99d033_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 294853,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yk/9ab1a0f6ef0f4c1ba837800e05c797cf/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99ec590c-0586-55a1-90df-b2f32e99d033/99ec590c-0586-55a1-90df-b2f32e99d033_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 395128,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yk/9ab1a0f6ef0f4c1ba837800e05c797cf/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X3 DIESEL - 2018 2.0 dA sDrive18 AdBlue',
 'transmission': 'automatic',
 'trim': '2.0 dA sDrive18 AdBlue',
 'vin': None,
 'year': 2020}
2026-03-26 22:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271986153%27 HTTP/1.1" 200 None
2026-03-26 22:49:01 [ayvens.be] INFO: Saving data for 1986153: {'created_time': 1774565341.08939, 'last_price_update_time': 1774565341.089399, 'auction_closing_time': 1775028600.0}
2026-03-26 22:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1986153') HTTP/1.1" 204 0
2026-03-26 22:49:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-03-26 22:49:03 [ayvens.be] INFO: Found listing with ID: 1983731
2026-03-26 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983731%27 HTTP/1.1" 200 None
2026-03-26 22:49:03 [ayvens.be] INFO: Scrape type for 1983731: 0
2026-03-26 22:49:03 [ayvens.be] INFO: Found listing with ID: 1983732
2026-03-26 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983732%27 HTTP/1.1" 200 None
2026-03-26 22:49:03 [ayvens.be] INFO: Scrape type for 1983732: 0
2026-03-26 22:49:03 [ayvens.be] INFO: Found listing with ID: 1983733
2026-03-26 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983733%27 HTTP/1.1" 200 None
2026-03-26 22:49:03 [ayvens.be] INFO: Scrape type for 1983733: 0
2026-03-26 22:49:03 [ayvens.be] INFO: Found listing with ID: 1983734
2026-03-26 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983734%27 HTTP/1.1" 200 None
2026-03-26 22:49:03 [ayvens.be] INFO: Scrape type for 1983734: 0
2026-03-26 22:49:03 [ayvens.be] INFO: Found listing with ID: 1983735
2026-03-26 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983735%27 HTTP/1.1" 200 None
2026-03-26 22:49:03 [ayvens.be] INFO: Scrape type for 1983735: 0
2026-03-26 22:49:03 [ayvens.be] INFO: Found listing with ID: 1983736
2026-03-26 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983736%27 HTTP/1.1" 200 None
2026-03-26 22:49:03 [ayvens.be] INFO: Scrape type for 1983736: 0
2026-03-26 22:49:03 [ayvens.be] INFO: Found listing with ID: 1983737
2026-03-26 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983737%27 HTTP/1.1" 200 None
2026-03-26 22:49:03 [ayvens.be] INFO: Scrape type for 1983737: 0
2026-03-26 22:49:03 [ayvens.be] INFO: Found listing with ID: 1983738
2026-03-26 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983738%27 HTTP/1.1" 200 None
2026-03-26 22:49:03 [ayvens.be] INFO: Scrape type for 1983738: 0
2026-03-26 22:49:03 [ayvens.be] INFO: Found listing with ID: 1983739
2026-03-26 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983739%27 HTTP/1.1" 200 None
2026-03-26 22:49:03 [ayvens.be] INFO: Scrape type for 1983739: 0
2026-03-26 22:49:03 [ayvens.be] INFO: Found listing with ID: 1983740
2026-03-26 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983740%27 HTTP/1.1" 200 None
2026-03-26 22:49:03 [ayvens.be] INFO: Scrape type for 1983740: 0
2026-03-26 22:49:03 [ayvens.be] INFO: Found listing with ID: 1983741
2026-03-26 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983741%27 HTTP/1.1" 200 None
2026-03-26 22:49:03 [ayvens.be] INFO: Scrape type for 1983741: 0
2026-03-26 22:49:03 [ayvens.be] INFO: Found listing with ID: 1983742
2026-03-26 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983742%27 HTTP/1.1" 200 None
2026-03-26 22:49:03 [ayvens.be] INFO: Scrape type for 1983742: 0
2026-03-26 22:49:03 [ayvens.be] INFO: Found listing with ID: 1983743
2026-03-26 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983743%27 HTTP/1.1" 200 None
2026-03-26 22:49:03 [ayvens.be] INFO: Scrape type for 1983743: 0
2026-03-26 22:49:03 [ayvens.be] INFO: Found listing with ID: 1983744
2026-03-26 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983744%27 HTTP/1.1" 200 None
2026-03-26 22:49:03 [ayvens.be] INFO: Scrape type for 1983744: 0
2026-03-26 22:49:03 [ayvens.be] INFO: Found listing with ID: 1983745
2026-03-26 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983745%27 HTTP/1.1" 200 None
2026-03-26 22:49:03 [ayvens.be] INFO: Scrape type for 1983745: 0
2026-03-26 22:49:03 [ayvens.be] INFO: Found listing with ID: 1983746
2026-03-26 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983746%27 HTTP/1.1" 200 None
2026-03-26 22:49:03 [ayvens.be] INFO: Scrape type for 1983746: 0
2026-03-26 22:49:03 [ayvens.be] INFO: Found listing with ID: 1983747
2026-03-26 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983747%27 HTTP/1.1" 200 None
2026-03-26 22:49:03 [ayvens.be] INFO: Scrape type for 1983747: 0
2026-03-26 22:49:03 [ayvens.be] INFO: Found listing with ID: 1983748
2026-03-26 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983748%27 HTTP/1.1" 200 None
2026-03-26 22:49:03 [ayvens.be] INFO: Scrape type for 1983748: 0
2026-03-26 22:49:03 [ayvens.be] INFO: Found listing with ID: 1983749
2026-03-26 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983749%27 HTTP/1.1" 200 None
2026-03-26 22:49:03 [ayvens.be] INFO: Scrape type for 1983749: 0
2026-03-26 22:49:03 [ayvens.be] INFO: Found listing with ID: 1983750
2026-03-26 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983750%27 HTTP/1.1" 200 None
2026-03-26 22:49:03 [ayvens.be] INFO: Scrape type for 1983750: 0
2026-03-26 22:49:03 [ayvens.be] INFO: Found listing with ID: 1983751
2026-03-26 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983751%27 HTTP/1.1" 200 None
2026-03-26 22:49:03 [ayvens.be] INFO: Scrape type for 1983751: 0
2026-03-26 22:49:03 [ayvens.be] INFO: Found listing with ID: 1983752
2026-03-26 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983752%27 HTTP/1.1" 200 None
2026-03-26 22:49:03 [ayvens.be] INFO: Scrape type for 1983752: 0
2026-03-26 22:49:03 [ayvens.be] INFO: Found listing with ID: 1983753
2026-03-26 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983753%27 HTTP/1.1" 200 None
2026-03-26 22:49:03 [ayvens.be] INFO: Scrape type for 1983753: 0
2026-03-26 22:49:03 [ayvens.be] INFO: Found listing with ID: 1983754
2026-03-26 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983754%27 HTTP/1.1" 200 None
2026-03-26 22:49:03 [ayvens.be] INFO: Scrape type for 1983754: 0
2026-03-26 22:49:03 [ayvens.be] INFO: Found listing with ID: 1983755
2026-03-26 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983755%27 HTTP/1.1" 200 None
2026-03-26 22:49:03 [ayvens.be] INFO: Scrape type for 1983755: 0
2026-03-26 22:49:03 [ayvens.be] INFO: Found listing with ID: 1983756
2026-03-26 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983756%27 HTTP/1.1" 200 None
2026-03-26 22:49:03 [ayvens.be] INFO: Scrape type for 1983756: 0
2026-03-26 22:49:03 [ayvens.be] INFO: Found listing with ID: 1983757
2026-03-26 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983757%27 HTTP/1.1" 200 None
2026-03-26 22:49:03 [ayvens.be] INFO: Scrape type for 1983757: 0
2026-03-26 22:49:03 [ayvens.be] INFO: Found listing with ID: 1983758
2026-03-26 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983758%27 HTTP/1.1" 200 None
2026-03-26 22:49:03 [ayvens.be] INFO: Scrape type for 1983758: 0
2026-03-26 22:49:03 [ayvens.be] INFO: Found listing with ID: 1983759
2026-03-26 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983759%27 HTTP/1.1" 200 None
2026-03-26 22:49:03 [ayvens.be] INFO: Scrape type for 1983759: 0
2026-03-26 22:49:03 [ayvens.be] INFO: Found listing with ID: 1983760
2026-03-26 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983760%27 HTTP/1.1" 200 None
2026-03-26 22:49:03 [ayvens.be] INFO: Scrape type for 1983760: 0
2026-03-26 22:49:03 [ayvens.be] INFO: Found listing with ID: 1983761
2026-03-26 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983761%27 HTTP/1.1" 200 None
2026-03-26 22:49:03 [ayvens.be] INFO: Scrape type for 1983761: 0
2026-03-26 22:49:03 [ayvens.be] INFO: Found listing with ID: 1983762
2026-03-26 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983762%27 HTTP/1.1" 200 None
2026-03-26 22:49:04 [ayvens.be] INFO: Scrape type for 1983762: 0
2026-03-26 22:49:04 [ayvens.be] INFO: Found listing with ID: 1983763
2026-03-26 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983763%27 HTTP/1.1" 200 None
2026-03-26 22:49:04 [ayvens.be] INFO: Scrape type for 1983763: 0
2026-03-26 22:49:04 [ayvens.be] INFO: Found listing with ID: 1983764
2026-03-26 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983764%27 HTTP/1.1" 200 None
2026-03-26 22:49:04 [ayvens.be] INFO: Scrape type for 1983764: 0
2026-03-26 22:49:04 [ayvens.be] INFO: Found listing with ID: 1983765
2026-03-26 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983765%27 HTTP/1.1" 200 None
2026-03-26 22:49:04 [ayvens.be] INFO: Scrape type for 1983765: 0
2026-03-26 22:49:04 [ayvens.be] INFO: Found listing with ID: 1983766
2026-03-26 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983766%27 HTTP/1.1" 200 None
2026-03-26 22:49:04 [ayvens.be] INFO: Scrape type for 1983766: 0
2026-03-26 22:49:04 [ayvens.be] INFO: Found listing with ID: 1983767
2026-03-26 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983767%27 HTTP/1.1" 200 None
2026-03-26 22:49:04 [ayvens.be] INFO: Scrape type for 1983767: 0
2026-03-26 22:49:04 [ayvens.be] INFO: Found listing with ID: 1983768
2026-03-26 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983768%27 HTTP/1.1" 200 None
2026-03-26 22:49:04 [ayvens.be] INFO: Scrape type for 1983768: 0
2026-03-26 22:49:04 [ayvens.be] INFO: Found listing with ID: 1983769
2026-03-26 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983769%27 HTTP/1.1" 200 None
2026-03-26 22:49:04 [ayvens.be] INFO: Scrape type for 1983769: 0
2026-03-26 22:49:04 [ayvens.be] INFO: Found listing with ID: 1983770
2026-03-26 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983770%27 HTTP/1.1" 200 None
2026-03-26 22:49:04 [ayvens.be] INFO: Scrape type for 1983770: 0
2026-03-26 22:49:04 [ayvens.be] INFO: Found listing with ID: 1983771
2026-03-26 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983771%27 HTTP/1.1" 200 None
2026-03-26 22:49:04 [ayvens.be] INFO: Scrape type for 1983771: 0
2026-03-26 22:49:04 [ayvens.be] INFO: Found listing with ID: 1983772
2026-03-26 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983772%27 HTTP/1.1" 200 None
2026-03-26 22:49:04 [ayvens.be] INFO: Scrape type for 1983772: 0
2026-03-26 22:49:04 [ayvens.be] INFO: Found listing with ID: 1983773
2026-03-26 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983773%27 HTTP/1.1" 200 None
2026-03-26 22:49:04 [ayvens.be] INFO: Scrape type for 1983773: 0
2026-03-26 22:49:04 [ayvens.be] INFO: Found listing with ID: 1983774
2026-03-26 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983774%27 HTTP/1.1" 200 None
2026-03-26 22:49:04 [ayvens.be] INFO: Scrape type for 1983774: 0
2026-03-26 22:49:04 [ayvens.be] INFO: Found listing with ID: 1983775
2026-03-26 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983775%27 HTTP/1.1" 200 None
2026-03-26 22:49:04 [ayvens.be] INFO: Scrape type for 1983775: 0
2026-03-26 22:49:04 [ayvens.be] INFO: Found listing with ID: 1983776
2026-03-26 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983776%27 HTTP/1.1" 200 None
2026-03-26 22:49:04 [ayvens.be] INFO: Scrape type for 1983776: 0
2026-03-26 22:49:04 [ayvens.be] INFO: Found listing with ID: 1983777
2026-03-26 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983777%27 HTTP/1.1" 200 None
2026-03-26 22:49:04 [ayvens.be] INFO: Scrape type for 1983777: 0
2026-03-26 22:49:04 [ayvens.be] INFO: Found listing with ID: 1983778
2026-03-26 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983778%27 HTTP/1.1" 200 None
2026-03-26 22:49:04 [ayvens.be] INFO: Scrape type for 1983778: 0
2026-03-26 22:49:04 [ayvens.be] INFO: Found listing with ID: 1983779
2026-03-26 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983779%27 HTTP/1.1" 200 None
2026-03-26 22:49:04 [ayvens.be] INFO: Scrape type for 1983779: 0
2026-03-26 22:49:04 [ayvens.be] INFO: Found listing with ID: 1983780
2026-03-26 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271983780%27 HTTP/1.1" 200 None
2026-03-26 22:49:04 [ayvens.be] INFO: Scrape type for 1983780: 0
2026-03-26 22:49:04 [ayvens.be] INFO: Found listing with ID: 1985345
2026-03-26 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985345%27 HTTP/1.1" 200 None
2026-03-26 22:49:04 [ayvens.be] INFO: Scrape type for 1985345: 1
2026-03-26 22:49:04 [ayvens.be] INFO: Extracting data for car ID: 1985345
2026-03-26 22:49:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 593c4467-f8bf-57aa-b5f8-b38822117ae8 with identifier: 1985345
2026-03-26 22:49:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 593c4467-f8bf-57aa-b5f8-b38822117ae8 with scrape type 1
2026-03-26 22:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 593c4467-f8bf-57aa-b5f8-b38822117ae8
2026-03-26 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wp%252F2389ed23d8c34955aad8c7d6d13a6c2b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wp/2389ed23d8c34955aad8c7d6d13a6c2b/images/large/1.jpg not downloaded yet
2026-03-26 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wp%252F2389ed23d8c34955aad8c7d6d13a6c2b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wp/2389ed23d8c34955aad8c7d6d13a6c2b/images/large/2.jpg not downloaded yet
2026-03-26 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wp%252F2389ed23d8c34955aad8c7d6d13a6c2b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wp/2389ed23d8c34955aad8c7d6d13a6c2b/images/large/3.jpg not downloaded yet
2026-03-26 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wp%252F2389ed23d8c34955aad8c7d6d13a6c2b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wp/2389ed23d8c34955aad8c7d6d13a6c2b/images/large/4.jpg not downloaded yet
2026-03-26 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wp%252F2389ed23d8c34955aad8c7d6d13a6c2b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wp/2389ed23d8c34955aad8c7d6d13a6c2b/images/large/5.jpg not downloaded yet
2026-03-26 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wp%252F2389ed23d8c34955aad8c7d6d13a6c2b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wp/2389ed23d8c34955aad8c7d6d13a6c2b/images/large/6.jpg not downloaded yet
2026-03-26 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wp%252F2389ed23d8c34955aad8c7d6d13a6c2b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wp/2389ed23d8c34955aad8c7d6d13a6c2b/images/large/7.jpg not downloaded yet
2026-03-26 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wp%252F2389ed23d8c34955aad8c7d6d13a6c2b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wp/2389ed23d8c34955aad8c7d6d13a6c2b/images/large/8.jpg not downloaded yet
2026-03-26 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wp%252F2389ed23d8c34955aad8c7d6d13a6c2b%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wp/2389ed23d8c34955aad8c7d6d13a6c2b/images/large/9.jpg not downloaded yet
2026-03-26 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wp%252F2389ed23d8c34955aad8c7d6d13a6c2b%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wp/2389ed23d8c34955aad8c7d6d13a6c2b/images/large/10.jpg not downloaded yet
2026-03-26 22:49:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wp/2389ed23d8c34955aad8c7d6d13a6c2b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:04 [ayvens.be] INFO: Found listing with ID: 1985346
2026-03-26 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985346%27 HTTP/1.1" 200 None
2026-03-26 22:49:04 [ayvens.be] INFO: Scrape type for 1985346: 1
2026-03-26 22:49:04 [ayvens.be] INFO: Extracting data for car ID: 1985346
2026-03-26 22:49:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c63b6144-fe9f-5a8c-b9ff-d3f8ac386a0b with identifier: 1985346
2026-03-26 22:49:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c63b6144-fe9f-5a8c-b9ff-d3f8ac386a0b with scrape type 1
2026-03-26 22:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c63b6144-fe9f-5a8c-b9ff-d3f8ac386a0b
2026-03-26 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wv%252F5f506c0e2a5f40bd881232d47080faef%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wv/5f506c0e2a5f40bd881232d47080faef/images/large/1.jpg not downloaded yet
2026-03-26 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wv%252F5f506c0e2a5f40bd881232d47080faef%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wv/5f506c0e2a5f40bd881232d47080faef/images/large/2.jpg not downloaded yet
2026-03-26 22:49:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wp/2389ed23d8c34955aad8c7d6d13a6c2b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wp/2389ed23d8c34955aad8c7d6d13a6c2b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wv%252F5f506c0e2a5f40bd881232d47080faef%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wv/5f506c0e2a5f40bd881232d47080faef/images/large/3.jpg not downloaded yet
2026-03-26 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wv%252F5f506c0e2a5f40bd881232d47080faef%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wv/5f506c0e2a5f40bd881232d47080faef/images/large/4.jpg not downloaded yet
2026-03-26 22:49:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wp/2389ed23d8c34955aad8c7d6d13a6c2b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wv%252F5f506c0e2a5f40bd881232d47080faef%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wv/5f506c0e2a5f40bd881232d47080faef/images/large/5.jpg not downloaded yet
2026-03-26 22:49:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wp/2389ed23d8c34955aad8c7d6d13a6c2b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76a6310>
2026-03-26 22:49:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_593c4467-f8bf-57aa-b5f8-b38822117ae8/593c4467-f8bf-57aa-b5f8-b38822117ae8_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wp%252F2389ed23d8c34955aad8c7d6d13a6c2b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wp/2389ed23d8c34955aad8c7d6d13a6c2b/images/large/1.jpg saved to cache
2026-03-26 22:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 593c4467-f8bf-57aa-b5f8-b38822117ae8
2026-03-26 22:49:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wp/2389ed23d8c34955aad8c7d6d13a6c2b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wv%252F5f506c0e2a5f40bd881232d47080faef%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wv/5f506c0e2a5f40bd881232d47080faef/images/large/6.jpg not downloaded yet
2026-03-26 22:49:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wp/2389ed23d8c34955aad8c7d6d13a6c2b/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wv%252F5f506c0e2a5f40bd881232d47080faef%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wv/5f506c0e2a5f40bd881232d47080faef/images/large/7.jpg not downloaded yet
2026-03-26 22:49:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wp/2389ed23d8c34955aad8c7d6d13a6c2b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wv%252F5f506c0e2a5f40bd881232d47080faef%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wv/5f506c0e2a5f40bd881232d47080faef/images/large/8.jpg not downloaded yet
2026-03-26 22:49:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7778bd0>
2026-03-26 22:49:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_593c4467-f8bf-57aa-b5f8-b38822117ae8/593c4467-f8bf-57aa-b5f8-b38822117ae8_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wp%252F2389ed23d8c34955aad8c7d6d13a6c2b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wp/2389ed23d8c34955aad8c7d6d13a6c2b/images/large/4.jpg saved to cache
2026-03-26 22:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 593c4467-f8bf-57aa-b5f8-b38822117ae8
2026-03-26 22:49:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c7ff10>
2026-03-26 22:49:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_593c4467-f8bf-57aa-b5f8-b38822117ae8/593c4467-f8bf-57aa-b5f8-b38822117ae8_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wp%252F2389ed23d8c34955aad8c7d6d13a6c2b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wp/2389ed23d8c34955aad8c7d6d13a6c2b/images/large/3.jpg saved to cache
2026-03-26 22:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 593c4467-f8bf-57aa-b5f8-b38822117ae8
2026-03-26 22:49:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wv/5f506c0e2a5f40bd881232d47080faef/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wp/2389ed23d8c34955aad8c7d6d13a6c2b/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wv/5f506c0e2a5f40bd881232d47080faef/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wv%252F5f506c0e2a5f40bd881232d47080faef%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wv/5f506c0e2a5f40bd881232d47080faef/images/large/9.jpg not downloaded yet
2026-03-26 22:49:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cca410>
2026-03-26 22:49:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_593c4467-f8bf-57aa-b5f8-b38822117ae8/593c4467-f8bf-57aa-b5f8-b38822117ae8_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wp%252F2389ed23d8c34955aad8c7d6d13a6c2b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wp/2389ed23d8c34955aad8c7d6d13a6c2b/images/large/7.jpg saved to cache
2026-03-26 22:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 593c4467-f8bf-57aa-b5f8-b38822117ae8
2026-03-26 22:49:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wp/2389ed23d8c34955aad8c7d6d13a6c2b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wv%252F5f506c0e2a5f40bd881232d47080faef%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wv/5f506c0e2a5f40bd881232d47080faef/images/large/10.jpg not downloaded yet
2026-03-26 22:49:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e15490>
2026-03-26 22:49:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_593c4467-f8bf-57aa-b5f8-b38822117ae8/593c4467-f8bf-57aa-b5f8-b38822117ae8_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wp%252F2389ed23d8c34955aad8c7d6d13a6c2b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wp/2389ed23d8c34955aad8c7d6d13a6c2b/images/large/5.jpg saved to cache
2026-03-26 22:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 593c4467-f8bf-57aa-b5f8-b38822117ae8
2026-03-26 22:49:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e16fd0>
2026-03-26 22:49:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_593c4467-f8bf-57aa-b5f8-b38822117ae8/593c4467-f8bf-57aa-b5f8-b38822117ae8_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wp%252F2389ed23d8c34955aad8c7d6d13a6c2b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wp/2389ed23d8c34955aad8c7d6d13a6c2b/images/large/2.jpg saved to cache
2026-03-26 22:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 593c4467-f8bf-57aa-b5f8-b38822117ae8
2026-03-26 22:49:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b748add0>
2026-03-26 22:49:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_593c4467-f8bf-57aa-b5f8-b38822117ae8/593c4467-f8bf-57aa-b5f8-b38822117ae8_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wp%252F2389ed23d8c34955aad8c7d6d13a6c2b%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wp/2389ed23d8c34955aad8c7d6d13a6c2b/images/large/9.jpg saved to cache
2026-03-26 22:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 593c4467-f8bf-57aa-b5f8-b38822117ae8
2026-03-26 22:49:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7661310>
2026-03-26 22:49:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_593c4467-f8bf-57aa-b5f8-b38822117ae8/593c4467-f8bf-57aa-b5f8-b38822117ae8_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wp%252F2389ed23d8c34955aad8c7d6d13a6c2b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wp/2389ed23d8c34955aad8c7d6d13a6c2b/images/large/6.jpg saved to cache
2026-03-26 22:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 593c4467-f8bf-57aa-b5f8-b38822117ae8
2026-03-26 22:49:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wv/5f506c0e2a5f40bd881232d47080faef/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wv/5f506c0e2a5f40bd881232d47080faef/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:05 [ayvens.be] INFO: Found listing with ID: 1985347
2026-03-26 22:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985347%27 HTTP/1.1" 200 None
2026-03-26 22:49:05 [ayvens.be] INFO: Scrape type for 1985347: 1
2026-03-26 22:49:05 [ayvens.be] INFO: Extracting data for car ID: 1985347
2026-03-26 22:49:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b60a75c9-f1ff-5ee0-bf2c-7fb6bf2ff6e5 with identifier: 1985347
2026-03-26 22:49:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b60a75c9-f1ff-5ee0-bf2c-7fb6bf2ff6e5 with scrape type 1
2026-03-26 22:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b60a75c9-f1ff-5ee0-bf2c-7fb6bf2ff6e5
2026-03-26 22:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cd%252F192ed645d7074062a7f7221887ced77f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cd/192ed645d7074062a7f7221887ced77f/images/large/1.jpg not downloaded yet
2026-03-26 22:49:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wv/5f506c0e2a5f40bd881232d47080faef/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cd%252F192ed645d7074062a7f7221887ced77f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cd/192ed645d7074062a7f7221887ced77f/images/large/2.jpg not downloaded yet
2026-03-26 22:49:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7450090>
2026-03-26 22:49:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c63b6144-fe9f-5a8c-b9ff-d3f8ac386a0b/c63b6144-fe9f-5a8c-b9ff-d3f8ac386a0b_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wv%252F5f506c0e2a5f40bd881232d47080faef%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wv/5f506c0e2a5f40bd881232d47080faef/images/large/1.jpg saved to cache
2026-03-26 22:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c63b6144-fe9f-5a8c-b9ff-d3f8ac386a0b
2026-03-26 22:49:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7453950>
2026-03-26 22:49:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_593c4467-f8bf-57aa-b5f8-b38822117ae8/593c4467-f8bf-57aa-b5f8-b38822117ae8_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wp%252F2389ed23d8c34955aad8c7d6d13a6c2b%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wp/2389ed23d8c34955aad8c7d6d13a6c2b/images/large/10.jpg saved to cache
2026-03-26 22:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 593c4467-f8bf-57aa-b5f8-b38822117ae8
2026-03-26 22:49:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cb39d0>
2026-03-26 22:49:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c63b6144-fe9f-5a8c-b9ff-d3f8ac386a0b/c63b6144-fe9f-5a8c-b9ff-d3f8ac386a0b_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wv%252F5f506c0e2a5f40bd881232d47080faef%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wv/5f506c0e2a5f40bd881232d47080faef/images/large/2.jpg saved to cache
2026-03-26 22:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c63b6144-fe9f-5a8c-b9ff-d3f8ac386a0b
2026-03-26 22:49:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74285d0>
2026-03-26 22:49:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_593c4467-f8bf-57aa-b5f8-b38822117ae8/593c4467-f8bf-57aa-b5f8-b38822117ae8_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wp%252F2389ed23d8c34955aad8c7d6d13a6c2b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wp/2389ed23d8c34955aad8c7d6d13a6c2b/images/large/8.jpg saved to cache
2026-03-26 22:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 593c4467-f8bf-57aa-b5f8-b38822117ae8
2026-03-26 22:49:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 593c4467-f8bf-57aa-b5f8-b38822117ae8, skipping ID generation
2026-03-26 22:49:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 593c4467-f8bf-57aa-b5f8-b38822117ae8 with scrape type 1
2026-03-26 22:49:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 593c4467-f8bf-57aa-b5f8-b38822117ae8 sending to next pipeline
2026-03-26 22:49:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 593c4467-f8bf-57aa-b5f8-b38822117ae8, identifier: 1985345
2026-03-26 22:49:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 593c4467-f8bf-57aa-b5f8-b38822117ae8 with identifier: 1985345
2026-03-26 22:49:05 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 22:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 22:49:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 593c4467-f8bf-57aa-b5f8-b38822117ae8 with identifier: 1985345
2026-03-26 22:49:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 593c4467-f8bf-57aa-b5f8-b38822117ae8 with identifier: 1985345 to the API
2026-03-26 22:49:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:49:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:49:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1wp/2389ed23d8c34955aad8c7d6d13a6c2b/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'color': 'PYRIT SILVER METALLIC',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '593c4467-f8bf-57aa-b5f8-b38822117ae8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TIGUAN ALLSPACE DIESEL',
 'odometer': 158856,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_593c4467-f8bf-57aa-b5f8-b38822117ae8/593c4467-f8bf-57aa-b5f8-b38822117ae8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 232292,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wp/2389ed23d8c34955aad8c7d6d13a6c2b/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_593c4467-f8bf-57aa-b5f8-b38822117ae8/593c4467-f8bf-57aa-b5f8-b38822117ae8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 262829,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wp/2389ed23d8c34955aad8c7d6d13a6c2b/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_593c4467-f8bf-57aa-b5f8-b38822117ae8/593c4467-f8bf-57aa-b5f8-b38822117ae8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 271392,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wp/2389ed23d8c34955aad8c7d6d13a6c2b/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_593c4467-f8bf-57aa-b5f8-b38822117ae8/593c4467-f8bf-57aa-b5f8-b38822117ae8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 247502,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wp/2389ed23d8c34955aad8c7d6d13a6c2b/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_593c4467-f8bf-57aa-b5f8-b38822117ae8/593c4467-f8bf-57aa-b5f8-b38822117ae8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 504822,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wp/2389ed23d8c34955aad8c7d6d13a6c2b/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_593c4467-f8bf-57aa-b5f8-b38822117ae8/593c4467-f8bf-57aa-b5f8-b38822117ae8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 284921,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wp/2389ed23d8c34955aad8c7d6d13a6c2b/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_593c4467-f8bf-57aa-b5f8-b38822117ae8/593c4467-f8bf-57aa-b5f8-b38822117ae8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 247673,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wp/2389ed23d8c34955aad8c7d6d13a6c2b/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_593c4467-f8bf-57aa-b5f8-b38822117ae8/593c4467-f8bf-57aa-b5f8-b38822117ae8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 306985,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wp/2389ed23d8c34955aad8c7d6d13a6c2b/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_593c4467-f8bf-57aa-b5f8-b38822117ae8/593c4467-f8bf-57aa-b5f8-b38822117ae8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 273666,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wp/2389ed23d8c34955aad8c7d6d13a6c2b/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_593c4467-f8bf-57aa-b5f8-b38822117ae8/593c4467-f8bf-57aa-b5f8-b38822117ae8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 308017,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wp/2389ed23d8c34955aad8c7d6d13a6c2b/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-01',
 'seats_number': 7,
 'seller_name': None,
 'title': 'VOLKSWAGEN TIGUAN ALLSPACE DIESEL 2.0 TDi SCR Platinum DSG',
 'transmission': 'automatic',
 'trim': '2.0 TDi SCR Platinum DSG',
 'vin': None,
 'year': 2019}
2026-03-26 22:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985345%27 HTTP/1.1" 200 None
2026-03-26 22:49:06 [ayvens.be] INFO: Saving data for 1985345: {'created_time': 1774565346.308257, 'last_price_update_time': 1774565346.308267, 'auction_closing_time': 1774958400.0}
2026-03-26 22:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985345') HTTP/1.1" 204 0
2026-03-26 22:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cd%252F192ed645d7074062a7f7221887ced77f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cd/192ed645d7074062a7f7221887ced77f/images/large/3.jpg not downloaded yet
2026-03-26 22:49:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wv/5f506c0e2a5f40bd881232d47080faef/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b741ced0>
2026-03-26 22:49:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c63b6144-fe9f-5a8c-b9ff-d3f8ac386a0b/c63b6144-fe9f-5a8c-b9ff-d3f8ac386a0b_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wv%252F5f506c0e2a5f40bd881232d47080faef%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wv/5f506c0e2a5f40bd881232d47080faef/images/large/3.jpg saved to cache
2026-03-26 22:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c63b6144-fe9f-5a8c-b9ff-d3f8ac386a0b
2026-03-26 22:49:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74df190>
2026-03-26 22:49:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c63b6144-fe9f-5a8c-b9ff-d3f8ac386a0b/c63b6144-fe9f-5a8c-b9ff-d3f8ac386a0b_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wv%252F5f506c0e2a5f40bd881232d47080faef%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wv/5f506c0e2a5f40bd881232d47080faef/images/large/4.jpg saved to cache
2026-03-26 22:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c63b6144-fe9f-5a8c-b9ff-d3f8ac386a0b
2026-03-26 22:49:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7410e10>
2026-03-26 22:49:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c63b6144-fe9f-5a8c-b9ff-d3f8ac386a0b/c63b6144-fe9f-5a8c-b9ff-d3f8ac386a0b_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wv%252F5f506c0e2a5f40bd881232d47080faef%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wv/5f506c0e2a5f40bd881232d47080faef/images/large/6.jpg saved to cache
2026-03-26 22:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c63b6144-fe9f-5a8c-b9ff-d3f8ac386a0b
2026-03-26 22:49:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wv/5f506c0e2a5f40bd881232d47080faef/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cd%252F192ed645d7074062a7f7221887ced77f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cd/192ed645d7074062a7f7221887ced77f/images/large/4.jpg not downloaded yet
2026-03-26 22:49:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wv/5f506c0e2a5f40bd881232d47080faef/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cd%252F192ed645d7074062a7f7221887ced77f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cd/192ed645d7074062a7f7221887ced77f/images/large/5.jpg not downloaded yet
2026-03-26 22:49:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b16090>
2026-03-26 22:49:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c63b6144-fe9f-5a8c-b9ff-d3f8ac386a0b/c63b6144-fe9f-5a8c-b9ff-d3f8ac386a0b_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wv%252F5f506c0e2a5f40bd881232d47080faef%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wv/5f506c0e2a5f40bd881232d47080faef/images/large/7.jpg saved to cache
2026-03-26 22:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c63b6144-fe9f-5a8c-b9ff-d3f8ac386a0b
2026-03-26 22:49:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wv/5f506c0e2a5f40bd881232d47080faef/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wv/5f506c0e2a5f40bd881232d47080faef/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cd%252F192ed645d7074062a7f7221887ced77f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cd/192ed645d7074062a7f7221887ced77f/images/large/6.jpg not downloaded yet
2026-03-26 22:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cd%252F192ed645d7074062a7f7221887ced77f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cd/192ed645d7074062a7f7221887ced77f/images/large/7.jpg not downloaded yet
2026-03-26 22:49:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7926b10>
2026-03-26 22:49:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c63b6144-fe9f-5a8c-b9ff-d3f8ac386a0b/c63b6144-fe9f-5a8c-b9ff-d3f8ac386a0b_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wv%252F5f506c0e2a5f40bd881232d47080faef%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wv/5f506c0e2a5f40bd881232d47080faef/images/large/8.jpg saved to cache
2026-03-26 22:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c63b6144-fe9f-5a8c-b9ff-d3f8ac386a0b
2026-03-26 22:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cd%252F192ed645d7074062a7f7221887ced77f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cd/192ed645d7074062a7f7221887ced77f/images/large/8.jpg not downloaded yet
2026-03-26 22:49:06 [scrapy.extensions.logstats] INFO: Crawled 7 pages (at 2 pages/min), scraped 126 items (at 35 items/min)
2026-03-26 22:49:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 181MiB
2026-03-26 22:49:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b727d850>
2026-03-26 22:49:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c63b6144-fe9f-5a8c-b9ff-d3f8ac386a0b/c63b6144-fe9f-5a8c-b9ff-d3f8ac386a0b_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wv%252F5f506c0e2a5f40bd881232d47080faef%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wv/5f506c0e2a5f40bd881232d47080faef/images/large/5.jpg saved to cache
2026-03-26 22:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c63b6144-fe9f-5a8c-b9ff-d3f8ac386a0b
2026-03-26 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cd%252F192ed645d7074062a7f7221887ced77f%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cd/192ed645d7074062a7f7221887ced77f/images/large/9.jpg not downloaded yet
2026-03-26 22:49:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cd/192ed645d7074062a7f7221887ced77f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c81d50>
2026-03-26 22:49:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c63b6144-fe9f-5a8c-b9ff-d3f8ac386a0b/c63b6144-fe9f-5a8c-b9ff-d3f8ac386a0b_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wv%252F5f506c0e2a5f40bd881232d47080faef%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wv/5f506c0e2a5f40bd881232d47080faef/images/large/10.jpg saved to cache
2026-03-26 22:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c63b6144-fe9f-5a8c-b9ff-d3f8ac386a0b
2026-03-26 22:49:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cc9310>
2026-03-26 22:49:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c63b6144-fe9f-5a8c-b9ff-d3f8ac386a0b/c63b6144-fe9f-5a8c-b9ff-d3f8ac386a0b_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wv%252F5f506c0e2a5f40bd881232d47080faef%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wv/5f506c0e2a5f40bd881232d47080faef/images/large/9.jpg saved to cache
2026-03-26 22:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c63b6144-fe9f-5a8c-b9ff-d3f8ac386a0b
2026-03-26 22:49:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c63b6144-fe9f-5a8c-b9ff-d3f8ac386a0b, skipping ID generation
2026-03-26 22:49:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c63b6144-fe9f-5a8c-b9ff-d3f8ac386a0b with scrape type 1
2026-03-26 22:49:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c63b6144-fe9f-5a8c-b9ff-d3f8ac386a0b sending to next pipeline
2026-03-26 22:49:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c63b6144-fe9f-5a8c-b9ff-d3f8ac386a0b, identifier: 1985346
2026-03-26 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cd%252F192ed645d7074062a7f7221887ced77f%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cd/192ed645d7074062a7f7221887ced77f/images/large/10.jpg not downloaded yet
2026-03-26 22:49:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c63b6144-fe9f-5a8c-b9ff-d3f8ac386a0b with identifier: 1985346
2026-03-26 22:49:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c63b6144-fe9f-5a8c-b9ff-d3f8ac386a0b with identifier: 1985346
2026-03-26 22:49:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c63b6144-fe9f-5a8c-b9ff-d3f8ac386a0b with identifier: 1985346 to the API
2026-03-26 22:49:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:49:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:49:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1wv/5f506c0e2a5f40bd881232d47080faef/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 43,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'c63b6144-fe9f-5a8c-b9ff-d3f8ac386a0b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'MINI',
 'model': 'MINI COUNTRYMAN - 2017',
 'odometer': 107928,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c63b6144-fe9f-5a8c-b9ff-d3f8ac386a0b/c63b6144-fe9f-5a8c-b9ff-d3f8ac386a0b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 312749,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wv/5f506c0e2a5f40bd881232d47080faef/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c63b6144-fe9f-5a8c-b9ff-d3f8ac386a0b/c63b6144-fe9f-5a8c-b9ff-d3f8ac386a0b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 303637,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wv/5f506c0e2a5f40bd881232d47080faef/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c63b6144-fe9f-5a8c-b9ff-d3f8ac386a0b/c63b6144-fe9f-5a8c-b9ff-d3f8ac386a0b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 305856,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wv/5f506c0e2a5f40bd881232d47080faef/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c63b6144-fe9f-5a8c-b9ff-d3f8ac386a0b/c63b6144-fe9f-5a8c-b9ff-d3f8ac386a0b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 308479,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wv/5f506c0e2a5f40bd881232d47080faef/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c63b6144-fe9f-5a8c-b9ff-d3f8ac386a0b/c63b6144-fe9f-5a8c-b9ff-d3f8ac386a0b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 554550,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wv/5f506c0e2a5f40bd881232d47080faef/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c63b6144-fe9f-5a8c-b9ff-d3f8ac386a0b/c63b6144-fe9f-5a8c-b9ff-d3f8ac386a0b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 321820,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wv/5f506c0e2a5f40bd881232d47080faef/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c63b6144-fe9f-5a8c-b9ff-d3f8ac386a0b/c63b6144-fe9f-5a8c-b9ff-d3f8ac386a0b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 284325,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wv/5f506c0e2a5f40bd881232d47080faef/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c63b6144-fe9f-5a8c-b9ff-d3f8ac386a0b/c63b6144-fe9f-5a8c-b9ff-d3f8ac386a0b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 348346,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wv/5f506c0e2a5f40bd881232d47080faef/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c63b6144-fe9f-5a8c-b9ff-d3f8ac386a0b/c63b6144-fe9f-5a8c-b9ff-d3f8ac386a0b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 385297,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wv/5f506c0e2a5f40bd881232d47080faef/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c63b6144-fe9f-5a8c-b9ff-d3f8ac386a0b/c63b6144-fe9f-5a8c-b9ff-d3f8ac386a0b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 343776,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wv/5f506c0e2a5f40bd881232d47080faef/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI MINI COUNTRYMAN - 2017 1.5A Cooper S E ALL4 Plug-In '
          'H.(EU6d-T.)',
 'transmission': 'automatic',
 'trim': '1.5A Cooper S E ALL4 Plug-In H.(EU6d-T.)',
 'vin': None,
 'year': 2019}
2026-03-26 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985346%27 HTTP/1.1" 200 None
2026-03-26 22:49:07 [ayvens.be] INFO: Saving data for 1985346: {'created_time': 1774565347.660882, 'last_price_update_time': 1774565347.660891, 'auction_closing_time': 1774958400.0}
2026-03-26 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985346') HTTP/1.1" 204 0
2026-03-26 22:49:07 [ayvens.be] INFO: Found listing with ID: 1985348
2026-03-26 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985348%27 HTTP/1.1" 200 None
2026-03-26 22:49:07 [ayvens.be] INFO: Scrape type for 1985348: 1
2026-03-26 22:49:07 [ayvens.be] INFO: Extracting data for car ID: 1985348
2026-03-26 22:49:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2bb4396-a70a-5221-884b-42a7e82f7a79 with identifier: 1985348
2026-03-26 22:49:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2bb4396-a70a-5221-884b-42a7e82f7a79 with scrape type 1
2026-03-26 22:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e2bb4396-a70a-5221-884b-42a7e82f7a79
2026-03-26 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cj%252Fc40fe50cd702402fadecbb2b2e31f4e3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cj/c40fe50cd702402fadecbb2b2e31f4e3/images/large/1.jpg not downloaded yet
2026-03-26 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cj%252Fc40fe50cd702402fadecbb2b2e31f4e3%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cj/c40fe50cd702402fadecbb2b2e31f4e3/images/large/2.jpg not downloaded yet
2026-03-26 22:49:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79f8190>
2026-03-26 22:49:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b60a75c9-f1ff-5ee0-bf2c-7fb6bf2ff6e5/b60a75c9-f1ff-5ee0-bf2c-7fb6bf2ff6e5_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cd%252F192ed645d7074062a7f7221887ced77f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cd/192ed645d7074062a7f7221887ced77f/images/large/1.jpg saved to cache
2026-03-26 22:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b60a75c9-f1ff-5ee0-bf2c-7fb6bf2ff6e5
2026-03-26 22:49:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cd/192ed645d7074062a7f7221887ced77f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cj%252Fc40fe50cd702402fadecbb2b2e31f4e3%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cj/c40fe50cd702402fadecbb2b2e31f4e3/images/large/3.jpg not downloaded yet
2026-03-26 22:49:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cd/192ed645d7074062a7f7221887ced77f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cd/192ed645d7074062a7f7221887ced77f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cd/192ed645d7074062a7f7221887ced77f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cj%252Fc40fe50cd702402fadecbb2b2e31f4e3%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cj/c40fe50cd702402fadecbb2b2e31f4e3/images/large/4.jpg not downloaded yet
2026-03-26 22:49:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cd/192ed645d7074062a7f7221887ced77f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cj%252Fc40fe50cd702402fadecbb2b2e31f4e3%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cj/c40fe50cd702402fadecbb2b2e31f4e3/images/large/5.jpg not downloaded yet
2026-03-26 22:49:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cd/192ed645d7074062a7f7221887ced77f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cj%252Fc40fe50cd702402fadecbb2b2e31f4e3%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cj/c40fe50cd702402fadecbb2b2e31f4e3/images/large/6.jpg not downloaded yet
2026-03-26 22:49:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cd/192ed645d7074062a7f7221887ced77f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cj%252Fc40fe50cd702402fadecbb2b2e31f4e3%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cj/c40fe50cd702402fadecbb2b2e31f4e3/images/large/7.jpg not downloaded yet
2026-03-26 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cj%252Fc40fe50cd702402fadecbb2b2e31f4e3%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cj/c40fe50cd702402fadecbb2b2e31f4e3/images/large/8.jpg not downloaded yet
2026-03-26 22:49:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cd/192ed645d7074062a7f7221887ced77f/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cj%252Fc40fe50cd702402fadecbb2b2e31f4e3%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cj/c40fe50cd702402fadecbb2b2e31f4e3/images/large/9.jpg not downloaded yet
2026-03-26 22:49:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b78c04d0>
2026-03-26 22:49:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b60a75c9-f1ff-5ee0-bf2c-7fb6bf2ff6e5/b60a75c9-f1ff-5ee0-bf2c-7fb6bf2ff6e5_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cd%252F192ed645d7074062a7f7221887ced77f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cd/192ed645d7074062a7f7221887ced77f/images/large/3.jpg saved to cache
2026-03-26 22:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b60a75c9-f1ff-5ee0-bf2c-7fb6bf2ff6e5
2026-03-26 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cj%252Fc40fe50cd702402fadecbb2b2e31f4e3%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cj/c40fe50cd702402fadecbb2b2e31f4e3/images/large/10.jpg not downloaded yet
2026-03-26 22:49:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b741cc50>
2026-03-26 22:49:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b60a75c9-f1ff-5ee0-bf2c-7fb6bf2ff6e5/b60a75c9-f1ff-5ee0-bf2c-7fb6bf2ff6e5_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cd%252F192ed645d7074062a7f7221887ced77f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cd/192ed645d7074062a7f7221887ced77f/images/large/5.jpg saved to cache
2026-03-26 22:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b60a75c9-f1ff-5ee0-bf2c-7fb6bf2ff6e5
2026-03-26 22:49:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b72a4890>
2026-03-26 22:49:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b60a75c9-f1ff-5ee0-bf2c-7fb6bf2ff6e5/b60a75c9-f1ff-5ee0-bf2c-7fb6bf2ff6e5_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cd%252F192ed645d7074062a7f7221887ced77f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cd/192ed645d7074062a7f7221887ced77f/images/large/4.jpg saved to cache
2026-03-26 22:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b60a75c9-f1ff-5ee0-bf2c-7fb6bf2ff6e5
2026-03-26 22:49:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7401bd0>
2026-03-26 22:49:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b60a75c9-f1ff-5ee0-bf2c-7fb6bf2ff6e5/b60a75c9-f1ff-5ee0-bf2c-7fb6bf2ff6e5_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cd%252F192ed645d7074062a7f7221887ced77f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cd/192ed645d7074062a7f7221887ced77f/images/large/2.jpg saved to cache
2026-03-26 22:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b60a75c9-f1ff-5ee0-bf2c-7fb6bf2ff6e5
2026-03-26 22:49:08 [ayvens.be] INFO: Found listing with ID: 1985349
2026-03-26 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985349%27 HTTP/1.1" 200 None
2026-03-26 22:49:08 [ayvens.be] INFO: Scrape type for 1985349: 1
2026-03-26 22:49:08 [ayvens.be] INFO: Extracting data for car ID: 1985349
2026-03-26 22:49:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f9f5dcc-c1c5-5742-9c6a-1cae9cd29d65 with identifier: 1985349
2026-03-26 22:49:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f9f5dcc-c1c5-5742-9c6a-1cae9cd29d65 with scrape type 1
2026-03-26 22:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0f9f5dcc-c1c5-5742-9c6a-1cae9cd29d65
2026-03-26 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F2d6685c45b7e46e3bed4e2037c0423bc%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/2d6685c45b7e46e3bed4e2037c0423bc/images/large/1.jpg not downloaded yet
2026-03-26 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F2d6685c45b7e46e3bed4e2037c0423bc%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/2d6685c45b7e46e3bed4e2037c0423bc/images/large/2.jpg not downloaded yet
2026-03-26 22:49:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7409710>
2026-03-26 22:49:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b60a75c9-f1ff-5ee0-bf2c-7fb6bf2ff6e5/b60a75c9-f1ff-5ee0-bf2c-7fb6bf2ff6e5_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cd%252F192ed645d7074062a7f7221887ced77f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cd/192ed645d7074062a7f7221887ced77f/images/large/6.jpg saved to cache
2026-03-26 22:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b60a75c9-f1ff-5ee0-bf2c-7fb6bf2ff6e5
2026-03-26 22:49:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74a5850>
2026-03-26 22:49:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b60a75c9-f1ff-5ee0-bf2c-7fb6bf2ff6e5/b60a75c9-f1ff-5ee0-bf2c-7fb6bf2ff6e5_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cd%252F192ed645d7074062a7f7221887ced77f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cd/192ed645d7074062a7f7221887ced77f/images/large/7.jpg saved to cache
2026-03-26 22:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b60a75c9-f1ff-5ee0-bf2c-7fb6bf2ff6e5
2026-03-26 22:49:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6d81950>
2026-03-26 22:49:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b60a75c9-f1ff-5ee0-bf2c-7fb6bf2ff6e5/b60a75c9-f1ff-5ee0-bf2c-7fb6bf2ff6e5_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cd%252F192ed645d7074062a7f7221887ced77f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cd/192ed645d7074062a7f7221887ced77f/images/large/8.jpg saved to cache
2026-03-26 22:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b60a75c9-f1ff-5ee0-bf2c-7fb6bf2ff6e5
2026-03-26 22:49:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79a4890>
2026-03-26 22:49:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b60a75c9-f1ff-5ee0-bf2c-7fb6bf2ff6e5/b60a75c9-f1ff-5ee0-bf2c-7fb6bf2ff6e5_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cd%252F192ed645d7074062a7f7221887ced77f%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cd/192ed645d7074062a7f7221887ced77f/images/large/9.jpg saved to cache
2026-03-26 22:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b60a75c9-f1ff-5ee0-bf2c-7fb6bf2ff6e5
2026-03-26 22:49:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cj/c40fe50cd702402fadecbb2b2e31f4e3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F2d6685c45b7e46e3bed4e2037c0423bc%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/2d6685c45b7e46e3bed4e2037c0423bc/images/large/3.jpg not downloaded yet
2026-03-26 22:49:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cd/192ed645d7074062a7f7221887ced77f/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F2d6685c45b7e46e3bed4e2037c0423bc%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/2d6685c45b7e46e3bed4e2037c0423bc/images/large/4.jpg not downloaded yet
2026-03-26 22:49:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cj/c40fe50cd702402fadecbb2b2e31f4e3/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F2d6685c45b7e46e3bed4e2037c0423bc%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/2d6685c45b7e46e3bed4e2037c0423bc/images/large/5.jpg not downloaded yet
2026-03-26 22:49:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cj/c40fe50cd702402fadecbb2b2e31f4e3/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cj/c40fe50cd702402fadecbb2b2e31f4e3/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F2d6685c45b7e46e3bed4e2037c0423bc%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/2d6685c45b7e46e3bed4e2037c0423bc/images/large/6.jpg not downloaded yet
2026-03-26 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F2d6685c45b7e46e3bed4e2037c0423bc%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/2d6685c45b7e46e3bed4e2037c0423bc/images/large/7.jpg not downloaded yet
2026-03-26 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F2d6685c45b7e46e3bed4e2037c0423bc%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/2d6685c45b7e46e3bed4e2037c0423bc/images/large/8.jpg not downloaded yet
2026-03-26 22:49:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79cdcd0>
2026-03-26 22:49:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2bb4396-a70a-5221-884b-42a7e82f7a79/e2bb4396-a70a-5221-884b-42a7e82f7a79_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cj%252Fc40fe50cd702402fadecbb2b2e31f4e3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cj/c40fe50cd702402fadecbb2b2e31f4e3/images/large/1.jpg saved to cache
2026-03-26 22:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e2bb4396-a70a-5221-884b-42a7e82f7a79
2026-03-26 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F2d6685c45b7e46e3bed4e2037c0423bc%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/2d6685c45b7e46e3bed4e2037c0423bc/images/large/9.jpg not downloaded yet
2026-03-26 22:49:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c962d0>
2026-03-26 22:49:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b60a75c9-f1ff-5ee0-bf2c-7fb6bf2ff6e5/b60a75c9-f1ff-5ee0-bf2c-7fb6bf2ff6e5_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cd%252F192ed645d7074062a7f7221887ced77f%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cd/192ed645d7074062a7f7221887ced77f/images/large/10.jpg saved to cache
2026-03-26 22:49:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b60a75c9-f1ff-5ee0-bf2c-7fb6bf2ff6e5
2026-03-26 22:49:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b60a75c9-f1ff-5ee0-bf2c-7fb6bf2ff6e5, skipping ID generation
2026-03-26 22:49:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b60a75c9-f1ff-5ee0-bf2c-7fb6bf2ff6e5 with scrape type 1
2026-03-26 22:49:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b60a75c9-f1ff-5ee0-bf2c-7fb6bf2ff6e5 sending to next pipeline
2026-03-26 22:49:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b60a75c9-f1ff-5ee0-bf2c-7fb6bf2ff6e5, identifier: 1985347
2026-03-26 22:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F2d6685c45b7e46e3bed4e2037c0423bc%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/2d6685c45b7e46e3bed4e2037c0423bc/images/large/10.jpg not downloaded yet
2026-03-26 22:49:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b60a75c9-f1ff-5ee0-bf2c-7fb6bf2ff6e5 with identifier: 1985347
2026-03-26 22:49:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b60a75c9-f1ff-5ee0-bf2c-7fb6bf2ff6e5 with identifier: 1985347
2026-03-26 22:49:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b60a75c9-f1ff-5ee0-bf2c-7fb6bf2ff6e5 with identifier: 1985347 to the API
2026-03-26 22:49:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:49:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:49:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cd/192ed645d7074062a7f7221887ced77f/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b60a75c9-f1ff-5ee0-bf2c-7fb6bf2ff6e5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'INSIGNIA SPORTS TOURER DIESEL',
 'odometer': 89653,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 20,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b60a75c9-f1ff-5ee0-bf2c-7fb6bf2ff6e5/b60a75c9-f1ff-5ee0-bf2c-7fb6bf2ff6e5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 712993,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cd/192ed645d7074062a7f7221887ced77f/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b60a75c9-f1ff-5ee0-bf2c-7fb6bf2ff6e5/b60a75c9-f1ff-5ee0-bf2c-7fb6bf2ff6e5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 726880,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cd/192ed645d7074062a7f7221887ced77f/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b60a75c9-f1ff-5ee0-bf2c-7fb6bf2ff6e5/b60a75c9-f1ff-5ee0-bf2c-7fb6bf2ff6e5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 727817,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cd/192ed645d7074062a7f7221887ced77f/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b60a75c9-f1ff-5ee0-bf2c-7fb6bf2ff6e5/b60a75c9-f1ff-5ee0-bf2c-7fb6bf2ff6e5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 757699,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cd/192ed645d7074062a7f7221887ced77f/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b60a75c9-f1ff-5ee0-bf2c-7fb6bf2ff6e5/b60a75c9-f1ff-5ee0-bf2c-7fb6bf2ff6e5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 711419,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cd/192ed645d7074062a7f7221887ced77f/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b60a75c9-f1ff-5ee0-bf2c-7fb6bf2ff6e5/b60a75c9-f1ff-5ee0-bf2c-7fb6bf2ff6e5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 692995,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cd/192ed645d7074062a7f7221887ced77f/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b60a75c9-f1ff-5ee0-bf2c-7fb6bf2ff6e5/b60a75c9-f1ff-5ee0-bf2c-7fb6bf2ff6e5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 670282,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cd/192ed645d7074062a7f7221887ced77f/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b60a75c9-f1ff-5ee0-bf2c-7fb6bf2ff6e5/b60a75c9-f1ff-5ee0-bf2c-7fb6bf2ff6e5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 728117,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cd/192ed645d7074062a7f7221887ced77f/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b60a75c9-f1ff-5ee0-bf2c-7fb6bf2ff6e5/b60a75c9-f1ff-5ee0-bf2c-7fb6bf2ff6e5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 818481,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cd/192ed645d7074062a7f7221887ced77f/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b60a75c9-f1ff-5ee0-bf2c-7fb6bf2ff6e5/b60a75c9-f1ff-5ee0-bf2c-7fb6bf2ff6e5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 617785,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cd/192ed645d7074062a7f7221887ced77f/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL INSIGNIA SPORTS TOURER DIESEL 1.5 Turbo D Ultimate',
 'transmission': 'manual',
 'trim': '1.5 Turbo D Ultimate',
 'vin': None,
 'year': 2021}
2026-03-26 22:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985347%27 HTTP/1.1" 200 None
2026-03-26 22:49:09 [ayvens.be] INFO: Saving data for 1985347: {'created_time': 1774565349.634874, 'last_price_update_time': 1774565349.634883, 'auction_closing_time': 1774958400.0}
2026-03-26 22:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985347') HTTP/1.1" 204 0
2026-03-26 22:49:09 [ayvens.be] INFO: Found listing with ID: 1985350
2026-03-26 22:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985350%27 HTTP/1.1" 200 None
2026-03-26 22:49:09 [ayvens.be] INFO: Scrape type for 1985350: 1
2026-03-26 22:49:09 [ayvens.be] INFO: Extracting data for car ID: 1985350
2026-03-26 22:49:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b27c98bc-616f-55c0-892b-d9a4b79cfc05 with identifier: 1985350
2026-03-26 22:49:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b27c98bc-616f-55c0-892b-d9a4b79cfc05 with scrape type 1
2026-03-26 22:49:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b27c98bc-616f-55c0-892b-d9a4b79cfc05
2026-03-26 22:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Fadbcf5954553420688ffd07906eebe58%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/adbcf5954553420688ffd07906eebe58/images/large/1.jpg not downloaded yet
2026-03-26 22:49:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd8d3190>
2026-03-26 22:49:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2bb4396-a70a-5221-884b-42a7e82f7a79/e2bb4396-a70a-5221-884b-42a7e82f7a79_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cj%252Fc40fe50cd702402fadecbb2b2e31f4e3%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cj/c40fe50cd702402fadecbb2b2e31f4e3/images/large/2.jpg saved to cache
2026-03-26 22:49:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e2bb4396-a70a-5221-884b-42a7e82f7a79
2026-03-26 22:49:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b764b710>
2026-03-26 22:49:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2bb4396-a70a-5221-884b-42a7e82f7a79/e2bb4396-a70a-5221-884b-42a7e82f7a79_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cj%252Fc40fe50cd702402fadecbb2b2e31f4e3%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cj/c40fe50cd702402fadecbb2b2e31f4e3/images/large/3.jpg saved to cache
2026-03-26 22:49:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e2bb4396-a70a-5221-884b-42a7e82f7a79
2026-03-26 22:49:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7876d10>
2026-03-26 22:49:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2bb4396-a70a-5221-884b-42a7e82f7a79/e2bb4396-a70a-5221-884b-42a7e82f7a79_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cj%252Fc40fe50cd702402fadecbb2b2e31f4e3%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cj/c40fe50cd702402fadecbb2b2e31f4e3/images/large/4.jpg saved to cache
2026-03-26 22:49:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e2bb4396-a70a-5221-884b-42a7e82f7a79
2026-03-26 22:49:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/2d6685c45b7e46e3bed4e2037c0423bc/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Fadbcf5954553420688ffd07906eebe58%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/adbcf5954553420688ffd07906eebe58/images/large/2.jpg not downloaded yet
2026-03-26 22:49:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cj/c40fe50cd702402fadecbb2b2e31f4e3/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cj/c40fe50cd702402fadecbb2b2e31f4e3/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Fadbcf5954553420688ffd07906eebe58%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/adbcf5954553420688ffd07906eebe58/images/large/3.jpg not downloaded yet
2026-03-26 22:49:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cj/c40fe50cd702402fadecbb2b2e31f4e3/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cj/c40fe50cd702402fadecbb2b2e31f4e3/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Fadbcf5954553420688ffd07906eebe58%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/adbcf5954553420688ffd07906eebe58/images/large/4.jpg not downloaded yet
2026-03-26 22:49:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/2d6685c45b7e46e3bed4e2037c0423bc/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cj/c40fe50cd702402fadecbb2b2e31f4e3/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Fadbcf5954553420688ffd07906eebe58%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/adbcf5954553420688ffd07906eebe58/images/large/5.jpg not downloaded yet
2026-03-26 22:49:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cj/c40fe50cd702402fadecbb2b2e31f4e3/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Fadbcf5954553420688ffd07906eebe58%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/adbcf5954553420688ffd07906eebe58/images/large/6.jpg not downloaded yet
2026-03-26 22:49:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b75a6190>
2026-03-26 22:49:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f9f5dcc-c1c5-5742-9c6a-1cae9cd29d65/0f9f5dcc-c1c5-5742-9c6a-1cae9cd29d65_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F2d6685c45b7e46e3bed4e2037c0423bc%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/2d6685c45b7e46e3bed4e2037c0423bc/images/large/1.jpg saved to cache
2026-03-26 22:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0f9f5dcc-c1c5-5742-9c6a-1cae9cd29d65
2026-03-26 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Fadbcf5954553420688ffd07906eebe58%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/adbcf5954553420688ffd07906eebe58/images/large/7.jpg not downloaded yet
2026-03-26 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Fadbcf5954553420688ffd07906eebe58%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/adbcf5954553420688ffd07906eebe58/images/large/8.jpg not downloaded yet
2026-03-26 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Fadbcf5954553420688ffd07906eebe58%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/adbcf5954553420688ffd07906eebe58/images/large/9.jpg not downloaded yet
2026-03-26 22:49:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74082d0>
2026-03-26 22:49:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2bb4396-a70a-5221-884b-42a7e82f7a79/e2bb4396-a70a-5221-884b-42a7e82f7a79_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cj%252Fc40fe50cd702402fadecbb2b2e31f4e3%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cj/c40fe50cd702402fadecbb2b2e31f4e3/images/large/9.jpg saved to cache
2026-03-26 22:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e2bb4396-a70a-5221-884b-42a7e82f7a79
2026-03-26 22:49:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c76850>
2026-03-26 22:49:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2bb4396-a70a-5221-884b-42a7e82f7a79/e2bb4396-a70a-5221-884b-42a7e82f7a79_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cj%252Fc40fe50cd702402fadecbb2b2e31f4e3%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cj/c40fe50cd702402fadecbb2b2e31f4e3/images/large/8.jpg saved to cache
2026-03-26 22:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e2bb4396-a70a-5221-884b-42a7e82f7a79
2026-03-26 22:49:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6da71d0>
2026-03-26 22:49:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2bb4396-a70a-5221-884b-42a7e82f7a79/e2bb4396-a70a-5221-884b-42a7e82f7a79_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cj%252Fc40fe50cd702402fadecbb2b2e31f4e3%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cj/c40fe50cd702402fadecbb2b2e31f4e3/images/large/6.jpg saved to cache
2026-03-26 22:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e2bb4396-a70a-5221-884b-42a7e82f7a79
2026-03-26 22:49:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7442290>
2026-03-26 22:49:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2bb4396-a70a-5221-884b-42a7e82f7a79/e2bb4396-a70a-5221-884b-42a7e82f7a79_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cj%252Fc40fe50cd702402fadecbb2b2e31f4e3%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cj/c40fe50cd702402fadecbb2b2e31f4e3/images/large/10.jpg saved to cache
2026-03-26 22:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e2bb4396-a70a-5221-884b-42a7e82f7a79
2026-03-26 22:49:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd3b9810>
2026-03-26 22:49:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f9f5dcc-c1c5-5742-9c6a-1cae9cd29d65/0f9f5dcc-c1c5-5742-9c6a-1cae9cd29d65_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F2d6685c45b7e46e3bed4e2037c0423bc%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/2d6685c45b7e46e3bed4e2037c0423bc/images/large/2.jpg saved to cache
2026-03-26 22:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0f9f5dcc-c1c5-5742-9c6a-1cae9cd29d65
2026-03-26 22:49:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7911250>
2026-03-26 22:49:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2bb4396-a70a-5221-884b-42a7e82f7a79/e2bb4396-a70a-5221-884b-42a7e82f7a79_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cj%252Fc40fe50cd702402fadecbb2b2e31f4e3%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cj/c40fe50cd702402fadecbb2b2e31f4e3/images/large/5.jpg saved to cache
2026-03-26 22:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e2bb4396-a70a-5221-884b-42a7e82f7a79
2026-03-26 22:49:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6da7fd0>
2026-03-26 22:49:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2bb4396-a70a-5221-884b-42a7e82f7a79/e2bb4396-a70a-5221-884b-42a7e82f7a79_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cj%252Fc40fe50cd702402fadecbb2b2e31f4e3%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cj/c40fe50cd702402fadecbb2b2e31f4e3/images/large/7.jpg saved to cache
2026-03-26 22:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e2bb4396-a70a-5221-884b-42a7e82f7a79
2026-03-26 22:49:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e2bb4396-a70a-5221-884b-42a7e82f7a79, skipping ID generation
2026-03-26 22:49:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2bb4396-a70a-5221-884b-42a7e82f7a79 with scrape type 1
2026-03-26 22:49:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e2bb4396-a70a-5221-884b-42a7e82f7a79 sending to next pipeline
2026-03-26 22:49:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e2bb4396-a70a-5221-884b-42a7e82f7a79, identifier: 1985348
2026-03-26 22:49:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e2bb4396-a70a-5221-884b-42a7e82f7a79 with identifier: 1985348
2026-03-26 22:49:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e2bb4396-a70a-5221-884b-42a7e82f7a79 with identifier: 1985348
2026-03-26 22:49:11 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e2bb4396-a70a-5221-884b-42a7e82f7a79 with identifier: 1985348 to the API
2026-03-26 22:49:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:49:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:49:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cj/c40fe50cd702402fadecbb2b2e31f4e3/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'e2bb4396-a70a-5221-884b-42a7e82f7a79',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X2',
 'odometer': 45610,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2bb4396-a70a-5221-884b-42a7e82f7a79/e2bb4396-a70a-5221-884b-42a7e82f7a79_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 730261,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cj/c40fe50cd702402fadecbb2b2e31f4e3/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2bb4396-a70a-5221-884b-42a7e82f7a79/e2bb4396-a70a-5221-884b-42a7e82f7a79_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 714212,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cj/c40fe50cd702402fadecbb2b2e31f4e3/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2bb4396-a70a-5221-884b-42a7e82f7a79/e2bb4396-a70a-5221-884b-42a7e82f7a79_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 633340,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cj/c40fe50cd702402fadecbb2b2e31f4e3/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2bb4396-a70a-5221-884b-42a7e82f7a79/e2bb4396-a70a-5221-884b-42a7e82f7a79_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 743332,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cj/c40fe50cd702402fadecbb2b2e31f4e3/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2bb4396-a70a-5221-884b-42a7e82f7a79/e2bb4396-a70a-5221-884b-42a7e82f7a79_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 587077,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cj/c40fe50cd702402fadecbb2b2e31f4e3/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2bb4396-a70a-5221-884b-42a7e82f7a79/e2bb4396-a70a-5221-884b-42a7e82f7a79_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 624235,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cj/c40fe50cd702402fadecbb2b2e31f4e3/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2bb4396-a70a-5221-884b-42a7e82f7a79/e2bb4396-a70a-5221-884b-42a7e82f7a79_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 690689,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cj/c40fe50cd702402fadecbb2b2e31f4e3/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2bb4396-a70a-5221-884b-42a7e82f7a79/e2bb4396-a70a-5221-884b-42a7e82f7a79_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 728262,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cj/c40fe50cd702402fadecbb2b2e31f4e3/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2bb4396-a70a-5221-884b-42a7e82f7a79/e2bb4396-a70a-5221-884b-42a7e82f7a79_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 552033,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cj/c40fe50cd702402fadecbb2b2e31f4e3/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2bb4396-a70a-5221-884b-42a7e82f7a79/e2bb4396-a70a-5221-884b-42a7e82f7a79_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 577431,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cj/c40fe50cd702402fadecbb2b2e31f4e3/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X2 1.5 XDRIVE25E PHEV 162KW)',
 'transmission': 'automatic',
 'trim': '1.5 XDRIVE25E PHEV 162KW)',
 'vin': None,
 'year': 2022}
2026-03-26 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985348%27 HTTP/1.1" 200 None
2026-03-26 22:49:11 [ayvens.be] INFO: Saving data for 1985348: {'created_time': 1774565351.440176, 'last_price_update_time': 1774565351.440185, 'auction_closing_time': 1774958400.0}
2026-03-26 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985348') HTTP/1.1" 204 0
2026-03-26 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Fadbcf5954553420688ffd07906eebe58%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/adbcf5954553420688ffd07906eebe58/images/large/10.jpg not downloaded yet
2026-03-26 22:49:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/2d6685c45b7e46e3bed4e2037c0423bc/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/2d6685c45b7e46e3bed4e2037c0423bc/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/2d6685c45b7e46e3bed4e2037c0423bc/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/2d6685c45b7e46e3bed4e2037c0423bc/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:11 [ayvens.be] INFO: Found listing with ID: 1985351
2026-03-26 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985351%27 HTTP/1.1" 200 None
2026-03-26 22:49:11 [ayvens.be] INFO: Scrape type for 1985351: 1
2026-03-26 22:49:11 [ayvens.be] INFO: Extracting data for car ID: 1985351
2026-03-26 22:49:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a8018b6c-8e7a-55a8-81ec-c9ae9c195f73 with identifier: 1985351
2026-03-26 22:49:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8018b6c-8e7a-55a8-81ec-c9ae9c195f73 with scrape type 1
2026-03-26 22:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a8018b6c-8e7a-55a8-81ec-c9ae9c195f73
2026-03-26 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F0cf8245e8660437db79b8093fae547e6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/0cf8245e8660437db79b8093fae547e6/images/large/1.jpg not downloaded yet
2026-03-26 22:49:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/2d6685c45b7e46e3bed4e2037c0423bc/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/2d6685c45b7e46e3bed4e2037c0423bc/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F0cf8245e8660437db79b8093fae547e6%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/0cf8245e8660437db79b8093fae547e6/images/large/2.jpg not downloaded yet
2026-03-26 22:49:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/2d6685c45b7e46e3bed4e2037c0423bc/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F0cf8245e8660437db79b8093fae547e6%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/0cf8245e8660437db79b8093fae547e6/images/large/3.jpg not downloaded yet
2026-03-26 22:49:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/2d6685c45b7e46e3bed4e2037c0423bc/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F0cf8245e8660437db79b8093fae547e6%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/0cf8245e8660437db79b8093fae547e6/images/large/4.jpg not downloaded yet
2026-03-26 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F0cf8245e8660437db79b8093fae547e6%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/0cf8245e8660437db79b8093fae547e6/images/large/5.jpg not downloaded yet
2026-03-26 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F0cf8245e8660437db79b8093fae547e6%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/0cf8245e8660437db79b8093fae547e6/images/large/6.jpg not downloaded yet
2026-03-26 22:49:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b746f7d0>
2026-03-26 22:49:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f9f5dcc-c1c5-5742-9c6a-1cae9cd29d65/0f9f5dcc-c1c5-5742-9c6a-1cae9cd29d65_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F2d6685c45b7e46e3bed4e2037c0423bc%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/2d6685c45b7e46e3bed4e2037c0423bc/images/large/3.jpg saved to cache
2026-03-26 22:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0f9f5dcc-c1c5-5742-9c6a-1cae9cd29d65
2026-03-26 22:49:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cc1010>
2026-03-26 22:49:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f9f5dcc-c1c5-5742-9c6a-1cae9cd29d65/0f9f5dcc-c1c5-5742-9c6a-1cae9cd29d65_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F2d6685c45b7e46e3bed4e2037c0423bc%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/2d6685c45b7e46e3bed4e2037c0423bc/images/large/5.jpg saved to cache
2026-03-26 22:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0f9f5dcc-c1c5-5742-9c6a-1cae9cd29d65
2026-03-26 22:49:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7269050>
2026-03-26 22:49:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f9f5dcc-c1c5-5742-9c6a-1cae9cd29d65/0f9f5dcc-c1c5-5742-9c6a-1cae9cd29d65_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F2d6685c45b7e46e3bed4e2037c0423bc%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/2d6685c45b7e46e3bed4e2037c0423bc/images/large/10.jpg saved to cache
2026-03-26 22:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0f9f5dcc-c1c5-5742-9c6a-1cae9cd29d65
2026-03-26 22:49:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74bee10>
2026-03-26 22:49:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f9f5dcc-c1c5-5742-9c6a-1cae9cd29d65/0f9f5dcc-c1c5-5742-9c6a-1cae9cd29d65_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F2d6685c45b7e46e3bed4e2037c0423bc%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/2d6685c45b7e46e3bed4e2037c0423bc/images/large/6.jpg saved to cache
2026-03-26 22:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0f9f5dcc-c1c5-5742-9c6a-1cae9cd29d65
2026-03-26 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F0cf8245e8660437db79b8093fae547e6%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/0cf8245e8660437db79b8093fae547e6/images/large/7.jpg not downloaded yet
2026-03-26 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F0cf8245e8660437db79b8093fae547e6%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/0cf8245e8660437db79b8093fae547e6/images/large/8.jpg not downloaded yet
2026-03-26 22:49:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/adbcf5954553420688ffd07906eebe58/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F0cf8245e8660437db79b8093fae547e6%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/0cf8245e8660437db79b8093fae547e6/images/large/9.jpg not downloaded yet
2026-03-26 22:49:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b726a810>
2026-03-26 22:49:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f9f5dcc-c1c5-5742-9c6a-1cae9cd29d65/0f9f5dcc-c1c5-5742-9c6a-1cae9cd29d65_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F2d6685c45b7e46e3bed4e2037c0423bc%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/2d6685c45b7e46e3bed4e2037c0423bc/images/large/4.jpg saved to cache
2026-03-26 22:49:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0f9f5dcc-c1c5-5742-9c6a-1cae9cd29d65
2026-03-26 22:49:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79cc990>
2026-03-26 22:49:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f9f5dcc-c1c5-5742-9c6a-1cae9cd29d65/0f9f5dcc-c1c5-5742-9c6a-1cae9cd29d65_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F2d6685c45b7e46e3bed4e2037c0423bc%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/2d6685c45b7e46e3bed4e2037c0423bc/images/large/7.jpg saved to cache
2026-03-26 22:49:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0f9f5dcc-c1c5-5742-9c6a-1cae9cd29d65
2026-03-26 22:49:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c62610>
2026-03-26 22:49:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f9f5dcc-c1c5-5742-9c6a-1cae9cd29d65/0f9f5dcc-c1c5-5742-9c6a-1cae9cd29d65_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F2d6685c45b7e46e3bed4e2037c0423bc%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/2d6685c45b7e46e3bed4e2037c0423bc/images/large/8.jpg saved to cache
2026-03-26 22:49:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0f9f5dcc-c1c5-5742-9c6a-1cae9cd29d65
2026-03-26 22:49:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79820d0>
2026-03-26 22:49:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f9f5dcc-c1c5-5742-9c6a-1cae9cd29d65/0f9f5dcc-c1c5-5742-9c6a-1cae9cd29d65_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F2d6685c45b7e46e3bed4e2037c0423bc%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/2d6685c45b7e46e3bed4e2037c0423bc/images/large/9.jpg saved to cache
2026-03-26 22:49:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0f9f5dcc-c1c5-5742-9c6a-1cae9cd29d65
2026-03-26 22:49:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0f9f5dcc-c1c5-5742-9c6a-1cae9cd29d65, skipping ID generation
2026-03-26 22:49:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f9f5dcc-c1c5-5742-9c6a-1cae9cd29d65 with scrape type 1
2026-03-26 22:49:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0f9f5dcc-c1c5-5742-9c6a-1cae9cd29d65 sending to next pipeline
2026-03-26 22:49:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 0f9f5dcc-c1c5-5742-9c6a-1cae9cd29d65, identifier: 1985349
2026-03-26 22:49:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/adbcf5954553420688ffd07906eebe58/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 0f9f5dcc-c1c5-5742-9c6a-1cae9cd29d65 with identifier: 1985349
2026-03-26 22:49:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 0f9f5dcc-c1c5-5742-9c6a-1cae9cd29d65 with identifier: 1985349
2026-03-26 22:49:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 0f9f5dcc-c1c5-5742-9c6a-1cae9cd29d65 with identifier: 1985349 to the API
2026-03-26 22:49:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:49:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:49:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bk/2d6685c45b7e46e3bed4e2037c0423bc/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '0f9f5dcc-c1c5-5742-9c6a-1cae9cd29d65',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A3 BERLINE',
 'odometer': 122437,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f9f5dcc-c1c5-5742-9c6a-1cae9cd29d65/0f9f5dcc-c1c5-5742-9c6a-1cae9cd29d65_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 678732,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/2d6685c45b7e46e3bed4e2037c0423bc/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f9f5dcc-c1c5-5742-9c6a-1cae9cd29d65/0f9f5dcc-c1c5-5742-9c6a-1cae9cd29d65_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 666449,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/2d6685c45b7e46e3bed4e2037c0423bc/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f9f5dcc-c1c5-5742-9c6a-1cae9cd29d65/0f9f5dcc-c1c5-5742-9c6a-1cae9cd29d65_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 589098,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/2d6685c45b7e46e3bed4e2037c0423bc/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f9f5dcc-c1c5-5742-9c6a-1cae9cd29d65/0f9f5dcc-c1c5-5742-9c6a-1cae9cd29d65_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 679724,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/2d6685c45b7e46e3bed4e2037c0423bc/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f9f5dcc-c1c5-5742-9c6a-1cae9cd29d65/0f9f5dcc-c1c5-5742-9c6a-1cae9cd29d65_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 566120,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/2d6685c45b7e46e3bed4e2037c0423bc/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f9f5dcc-c1c5-5742-9c6a-1cae9cd29d65/0f9f5dcc-c1c5-5742-9c6a-1cae9cd29d65_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 521057,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/2d6685c45b7e46e3bed4e2037c0423bc/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f9f5dcc-c1c5-5742-9c6a-1cae9cd29d65/0f9f5dcc-c1c5-5742-9c6a-1cae9cd29d65_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 599728,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/2d6685c45b7e46e3bed4e2037c0423bc/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f9f5dcc-c1c5-5742-9c6a-1cae9cd29d65/0f9f5dcc-c1c5-5742-9c6a-1cae9cd29d65_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 701090,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/2d6685c45b7e46e3bed4e2037c0423bc/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f9f5dcc-c1c5-5742-9c6a-1cae9cd29d65/0f9f5dcc-c1c5-5742-9c6a-1cae9cd29d65_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 596300,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/2d6685c45b7e46e3bed4e2037c0423bc/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f9f5dcc-c1c5-5742-9c6a-1cae9cd29d65/0f9f5dcc-c1c5-5742-9c6a-1cae9cd29d65_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 493452,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/2d6685c45b7e46e3bed4e2037c0423bc/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A3 BERLINE 1.0 TFSI 30 81KW S LINE',
 'transmission': 'manual',
 'trim': '1.0 TFSI 30 81KW S LINE',
 'vin': None,
 'year': 2021}
2026-03-26 22:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985349%27 HTTP/1.1" 200 None
2026-03-26 22:49:12 [ayvens.be] INFO: Saving data for 1985349: {'created_time': 1774565352.71203, 'last_price_update_time': 1774565352.712041, 'auction_closing_time': 1774958400.0}
2026-03-26 22:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985349') HTTP/1.1" 204 0
2026-03-26 22:49:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/adbcf5954553420688ffd07906eebe58/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/adbcf5954553420688ffd07906eebe58/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F0cf8245e8660437db79b8093fae547e6%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/0cf8245e8660437db79b8093fae547e6/images/large/10.jpg not downloaded yet
2026-03-26 22:49:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/adbcf5954553420688ffd07906eebe58/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/adbcf5954553420688ffd07906eebe58/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/adbcf5954553420688ffd07906eebe58/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:12 [ayvens.be] INFO: Found listing with ID: 1985352
2026-03-26 22:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985352%27 HTTP/1.1" 200 None
2026-03-26 22:49:12 [ayvens.be] INFO: Scrape type for 1985352: 1
2026-03-26 22:49:12 [ayvens.be] INFO: Extracting data for car ID: 1985352
2026-03-26 22:49:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47ce7439-f723-56a1-9135-28d7ab2700fd with identifier: 1985352
2026-03-26 22:49:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47ce7439-f723-56a1-9135-28d7ab2700fd with scrape type 1
2026-03-26 22:49:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 47ce7439-f723-56a1-9135-28d7ab2700fd
2026-03-26 22:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F83ba81ca702748868d5429187fcd8483%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/83ba81ca702748868d5429187fcd8483/images/large/1.jpg not downloaded yet
2026-03-26 22:49:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6d732d0>
2026-03-26 22:49:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b27c98bc-616f-55c0-892b-d9a4b79cfc05/b27c98bc-616f-55c0-892b-d9a4b79cfc05_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Fadbcf5954553420688ffd07906eebe58%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/adbcf5954553420688ffd07906eebe58/images/large/5.jpg saved to cache
2026-03-26 22:49:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b27c98bc-616f-55c0-892b-d9a4b79cfc05
2026-03-26 22:49:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b72798d0>
2026-03-26 22:49:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b27c98bc-616f-55c0-892b-d9a4b79cfc05/b27c98bc-616f-55c0-892b-d9a4b79cfc05_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Fadbcf5954553420688ffd07906eebe58%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/adbcf5954553420688ffd07906eebe58/images/large/6.jpg saved to cache
2026-03-26 22:49:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b27c98bc-616f-55c0-892b-d9a4b79cfc05
2026-03-26 22:49:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/adbcf5954553420688ffd07906eebe58/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/adbcf5954553420688ffd07906eebe58/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F83ba81ca702748868d5429187fcd8483%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/83ba81ca702748868d5429187fcd8483/images/large/2.jpg not downloaded yet
2026-03-26 22:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F83ba81ca702748868d5429187fcd8483%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/83ba81ca702748868d5429187fcd8483/images/large/3.jpg not downloaded yet
2026-03-26 22:49:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6dc0b50>
2026-03-26 22:49:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b27c98bc-616f-55c0-892b-d9a4b79cfc05/b27c98bc-616f-55c0-892b-d9a4b79cfc05_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Fadbcf5954553420688ffd07906eebe58%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/adbcf5954553420688ffd07906eebe58/images/large/1.jpg saved to cache
2026-03-26 22:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b27c98bc-616f-55c0-892b-d9a4b79cfc05
2026-03-26 22:49:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b788ca50>
2026-03-26 22:49:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b27c98bc-616f-55c0-892b-d9a4b79cfc05/b27c98bc-616f-55c0-892b-d9a4b79cfc05_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Fadbcf5954553420688ffd07906eebe58%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/adbcf5954553420688ffd07906eebe58/images/large/8.jpg saved to cache
2026-03-26 22:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b27c98bc-616f-55c0-892b-d9a4b79cfc05
2026-03-26 22:49:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7771110>
2026-03-26 22:49:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b27c98bc-616f-55c0-892b-d9a4b79cfc05/b27c98bc-616f-55c0-892b-d9a4b79cfc05_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Fadbcf5954553420688ffd07906eebe58%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/adbcf5954553420688ffd07906eebe58/images/large/7.jpg saved to cache
2026-03-26 22:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b27c98bc-616f-55c0-892b-d9a4b79cfc05
2026-03-26 22:49:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b788f410>
2026-03-26 22:49:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b27c98bc-616f-55c0-892b-d9a4b79cfc05/b27c98bc-616f-55c0-892b-d9a4b79cfc05_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Fadbcf5954553420688ffd07906eebe58%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/adbcf5954553420688ffd07906eebe58/images/large/4.jpg saved to cache
2026-03-26 22:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b27c98bc-616f-55c0-892b-d9a4b79cfc05
2026-03-26 22:49:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7648250>
2026-03-26 22:49:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b27c98bc-616f-55c0-892b-d9a4b79cfc05/b27c98bc-616f-55c0-892b-d9a4b79cfc05_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Fadbcf5954553420688ffd07906eebe58%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/adbcf5954553420688ffd07906eebe58/images/large/3.jpg saved to cache
2026-03-26 22:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b27c98bc-616f-55c0-892b-d9a4b79cfc05
2026-03-26 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F83ba81ca702748868d5429187fcd8483%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/83ba81ca702748868d5429187fcd8483/images/large/4.jpg not downloaded yet
2026-03-26 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F83ba81ca702748868d5429187fcd8483%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/83ba81ca702748868d5429187fcd8483/images/large/5.jpg not downloaded yet
2026-03-26 22:49:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/adbcf5954553420688ffd07906eebe58/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7982f90>
2026-03-26 22:49:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b27c98bc-616f-55c0-892b-d9a4b79cfc05/b27c98bc-616f-55c0-892b-d9a4b79cfc05_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Fadbcf5954553420688ffd07906eebe58%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/adbcf5954553420688ffd07906eebe58/images/large/2.jpg saved to cache
2026-03-26 22:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b27c98bc-616f-55c0-892b-d9a4b79cfc05
2026-03-26 22:49:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76c7c10>
2026-03-26 22:49:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b27c98bc-616f-55c0-892b-d9a4b79cfc05/b27c98bc-616f-55c0-892b-d9a4b79cfc05_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Fadbcf5954553420688ffd07906eebe58%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/adbcf5954553420688ffd07906eebe58/images/large/10.jpg saved to cache
2026-03-26 22:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b27c98bc-616f-55c0-892b-d9a4b79cfc05
2026-03-26 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F83ba81ca702748868d5429187fcd8483%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/83ba81ca702748868d5429187fcd8483/images/large/6.jpg not downloaded yet
2026-03-26 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F83ba81ca702748868d5429187fcd8483%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/83ba81ca702748868d5429187fcd8483/images/large/7.jpg not downloaded yet
2026-03-26 22:49:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/0cf8245e8660437db79b8093fae547e6/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F83ba81ca702748868d5429187fcd8483%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/83ba81ca702748868d5429187fcd8483/images/large/8.jpg not downloaded yet
2026-03-26 22:49:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e36750>
2026-03-26 22:49:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b27c98bc-616f-55c0-892b-d9a4b79cfc05/b27c98bc-616f-55c0-892b-d9a4b79cfc05_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Fadbcf5954553420688ffd07906eebe58%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/adbcf5954553420688ffd07906eebe58/images/large/9.jpg saved to cache
2026-03-26 22:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b27c98bc-616f-55c0-892b-d9a4b79cfc05
2026-03-26 22:49:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b27c98bc-616f-55c0-892b-d9a4b79cfc05, skipping ID generation
2026-03-26 22:49:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b27c98bc-616f-55c0-892b-d9a4b79cfc05 with scrape type 1
2026-03-26 22:49:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b27c98bc-616f-55c0-892b-d9a4b79cfc05 sending to next pipeline
2026-03-26 22:49:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b27c98bc-616f-55c0-892b-d9a4b79cfc05, identifier: 1985350
2026-03-26 22:49:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/0cf8245e8660437db79b8093fae547e6/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/0cf8245e8660437db79b8093fae547e6/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/0cf8245e8660437db79b8093fae547e6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b27c98bc-616f-55c0-892b-d9a4b79cfc05 with identifier: 1985350
2026-03-26 22:49:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b27c98bc-616f-55c0-892b-d9a4b79cfc05 with identifier: 1985350
2026-03-26 22:49:13 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b27c98bc-616f-55c0-892b-d9a4b79cfc05 with identifier: 1985350 to the API
2026-03-26 22:49:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:49:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:49:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yx/adbcf5954553420688ffd07906eebe58/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'electric',
 'id': 'b27c98bc-616f-55c0-892b-d9a4b79cfc05',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'POLESTAR',
 'model': 'POLESTAR 2',
 'odometer': 147043,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b27c98bc-616f-55c0-892b-d9a4b79cfc05/b27c98bc-616f-55c0-892b-d9a4b79cfc05_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 447375,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/adbcf5954553420688ffd07906eebe58/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b27c98bc-616f-55c0-892b-d9a4b79cfc05/b27c98bc-616f-55c0-892b-d9a4b79cfc05_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 641120,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/adbcf5954553420688ffd07906eebe58/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b27c98bc-616f-55c0-892b-d9a4b79cfc05/b27c98bc-616f-55c0-892b-d9a4b79cfc05_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 578324,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/adbcf5954553420688ffd07906eebe58/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b27c98bc-616f-55c0-892b-d9a4b79cfc05/b27c98bc-616f-55c0-892b-d9a4b79cfc05_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 532857,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/adbcf5954553420688ffd07906eebe58/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b27c98bc-616f-55c0-892b-d9a4b79cfc05/b27c98bc-616f-55c0-892b-d9a4b79cfc05_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 337512,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/adbcf5954553420688ffd07906eebe58/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b27c98bc-616f-55c0-892b-d9a4b79cfc05/b27c98bc-616f-55c0-892b-d9a4b79cfc05_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 306872,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/adbcf5954553420688ffd07906eebe58/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b27c98bc-616f-55c0-892b-d9a4b79cfc05/b27c98bc-616f-55c0-892b-d9a4b79cfc05_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 560472,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/adbcf5954553420688ffd07906eebe58/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b27c98bc-616f-55c0-892b-d9a4b79cfc05/b27c98bc-616f-55c0-892b-d9a4b79cfc05_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 362820,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/adbcf5954553420688ffd07906eebe58/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b27c98bc-616f-55c0-892b-d9a4b79cfc05/b27c98bc-616f-55c0-892b-d9a4b79cfc05_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 374553,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/adbcf5954553420688ffd07906eebe58/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b27c98bc-616f-55c0-892b-d9a4b79cfc05/b27c98bc-616f-55c0-892b-d9a4b79cfc05_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 254777,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/adbcf5954553420688ffd07906eebe58/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'POLESTAR POLESTAR 2 78 kWh Dual Motor Launch',
 'transmission': 'automatic',
 'trim': '78 kWh Dual Motor Launch',
 'vin': None,
 'year': 2021}
2026-03-26 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985350%27 HTTP/1.1" 200 None
2026-03-26 22:49:14 [ayvens.be] INFO: Saving data for 1985350: {'created_time': 1774565354.159675, 'last_price_update_time': 1774565354.159687, 'auction_closing_time': 1774958400.0}
2026-03-26 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985350') HTTP/1.1" 204 0
2026-03-26 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F83ba81ca702748868d5429187fcd8483%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/83ba81ca702748868d5429187fcd8483/images/large/9.jpg not downloaded yet
2026-03-26 22:49:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/0cf8245e8660437db79b8093fae547e6/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/0cf8245e8660437db79b8093fae547e6/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/0cf8245e8660437db79b8093fae547e6/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F83ba81ca702748868d5429187fcd8483%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/83ba81ca702748868d5429187fcd8483/images/large/10.jpg not downloaded yet
2026-03-26 22:49:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7488a50>
2026-03-26 22:49:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8018b6c-8e7a-55a8-81ec-c9ae9c195f73/a8018b6c-8e7a-55a8-81ec-c9ae9c195f73_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F0cf8245e8660437db79b8093fae547e6%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/0cf8245e8660437db79b8093fae547e6/images/large/2.jpg saved to cache
2026-03-26 22:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a8018b6c-8e7a-55a8-81ec-c9ae9c195f73
2026-03-26 22:49:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74cfd90>
2026-03-26 22:49:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8018b6c-8e7a-55a8-81ec-c9ae9c195f73/a8018b6c-8e7a-55a8-81ec-c9ae9c195f73_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F0cf8245e8660437db79b8093fae547e6%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/0cf8245e8660437db79b8093fae547e6/images/large/3.jpg saved to cache
2026-03-26 22:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a8018b6c-8e7a-55a8-81ec-c9ae9c195f73
2026-03-26 22:49:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cc1a50>
2026-03-26 22:49:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8018b6c-8e7a-55a8-81ec-c9ae9c195f73/a8018b6c-8e7a-55a8-81ec-c9ae9c195f73_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F0cf8245e8660437db79b8093fae547e6%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/0cf8245e8660437db79b8093fae547e6/images/large/4.jpg saved to cache
2026-03-26 22:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a8018b6c-8e7a-55a8-81ec-c9ae9c195f73
2026-03-26 22:49:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79269d0>
2026-03-26 22:49:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8018b6c-8e7a-55a8-81ec-c9ae9c195f73/a8018b6c-8e7a-55a8-81ec-c9ae9c195f73_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F0cf8245e8660437db79b8093fae547e6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/0cf8245e8660437db79b8093fae547e6/images/large/1.jpg saved to cache
2026-03-26 22:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a8018b6c-8e7a-55a8-81ec-c9ae9c195f73
2026-03-26 22:49:14 [ayvens.be] INFO: Found listing with ID: 1985353
2026-03-26 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985353%27 HTTP/1.1" 200 None
2026-03-26 22:49:14 [ayvens.be] INFO: Scrape type for 1985353: 1
2026-03-26 22:49:14 [ayvens.be] INFO: Extracting data for car ID: 1985353
2026-03-26 22:49:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 86223df2-a655-5ba1-8ef4-a3eea7e1c134 with identifier: 1985353
2026-03-26 22:49:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 86223df2-a655-5ba1-8ef4-a3eea7e1c134 with scrape type 1
2026-03-26 22:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 86223df2-a655-5ba1-8ef4-a3eea7e1c134
2026-03-26 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cs%252F852595d6f06348b59c0e502071d6719f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cs/852595d6f06348b59c0e502071d6719f/images/large/1.jpg not downloaded yet
2026-03-26 22:49:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b78c1150>
2026-03-26 22:49:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8018b6c-8e7a-55a8-81ec-c9ae9c195f73/a8018b6c-8e7a-55a8-81ec-c9ae9c195f73_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F0cf8245e8660437db79b8093fae547e6%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/0cf8245e8660437db79b8093fae547e6/images/large/6.jpg saved to cache
2026-03-26 22:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a8018b6c-8e7a-55a8-81ec-c9ae9c195f73
2026-03-26 22:49:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7584bd0>
2026-03-26 22:49:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8018b6c-8e7a-55a8-81ec-c9ae9c195f73/a8018b6c-8e7a-55a8-81ec-c9ae9c195f73_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F0cf8245e8660437db79b8093fae547e6%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/0cf8245e8660437db79b8093fae547e6/images/large/8.jpg saved to cache
2026-03-26 22:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a8018b6c-8e7a-55a8-81ec-c9ae9c195f73
2026-03-26 22:49:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e45750>
2026-03-26 22:49:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8018b6c-8e7a-55a8-81ec-c9ae9c195f73/a8018b6c-8e7a-55a8-81ec-c9ae9c195f73_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F0cf8245e8660437db79b8093fae547e6%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/0cf8245e8660437db79b8093fae547e6/images/large/5.jpg saved to cache
2026-03-26 22:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a8018b6c-8e7a-55a8-81ec-c9ae9c195f73
2026-03-26 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cs%252F852595d6f06348b59c0e502071d6719f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cs/852595d6f06348b59c0e502071d6719f/images/large/2.jpg not downloaded yet
2026-03-26 22:49:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/83ba81ca702748868d5429187fcd8483/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/83ba81ca702748868d5429187fcd8483/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cs%252F852595d6f06348b59c0e502071d6719f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cs/852595d6f06348b59c0e502071d6719f/images/large/3.jpg not downloaded yet
2026-03-26 22:49:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/0cf8245e8660437db79b8093fae547e6/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/0cf8245e8660437db79b8093fae547e6/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cs%252F852595d6f06348b59c0e502071d6719f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cs/852595d6f06348b59c0e502071d6719f/images/large/4.jpg not downloaded yet
2026-03-26 22:49:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/83ba81ca702748868d5429187fcd8483/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/83ba81ca702748868d5429187fcd8483/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/83ba81ca702748868d5429187fcd8483/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cs%252F852595d6f06348b59c0e502071d6719f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cs/852595d6f06348b59c0e502071d6719f/images/large/5.jpg not downloaded yet
2026-03-26 22:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cs%252F852595d6f06348b59c0e502071d6719f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cs/852595d6f06348b59c0e502071d6719f/images/large/6.jpg not downloaded yet
2026-03-26 22:49:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/0cf8245e8660437db79b8093fae547e6/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cs%252F852595d6f06348b59c0e502071d6719f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cs/852595d6f06348b59c0e502071d6719f/images/large/7.jpg not downloaded yet
2026-03-26 22:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cs%252F852595d6f06348b59c0e502071d6719f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cs/852595d6f06348b59c0e502071d6719f/images/large/8.jpg not downloaded yet
2026-03-26 22:49:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/83ba81ca702748868d5429187fcd8483/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cs%252F852595d6f06348b59c0e502071d6719f%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cs/852595d6f06348b59c0e502071d6719f/images/large/9.jpg not downloaded yet
2026-03-26 22:49:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7584cd0>
2026-03-26 22:49:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47ce7439-f723-56a1-9135-28d7ab2700fd/47ce7439-f723-56a1-9135-28d7ab2700fd_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F83ba81ca702748868d5429187fcd8483%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/83ba81ca702748868d5429187fcd8483/images/large/1.jpg saved to cache
2026-03-26 22:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 47ce7439-f723-56a1-9135-28d7ab2700fd
2026-03-26 22:49:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76eff50>
2026-03-26 22:49:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47ce7439-f723-56a1-9135-28d7ab2700fd/47ce7439-f723-56a1-9135-28d7ab2700fd_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F83ba81ca702748868d5429187fcd8483%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/83ba81ca702748868d5429187fcd8483/images/large/2.jpg saved to cache
2026-03-26 22:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 47ce7439-f723-56a1-9135-28d7ab2700fd
2026-03-26 22:49:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/83ba81ca702748868d5429187fcd8483/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cs%252F852595d6f06348b59c0e502071d6719f%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cs/852595d6f06348b59c0e502071d6719f/images/large/10.jpg not downloaded yet
2026-03-26 22:49:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/83ba81ca702748868d5429187fcd8483/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c94c90>
2026-03-26 22:49:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8018b6c-8e7a-55a8-81ec-c9ae9c195f73/a8018b6c-8e7a-55a8-81ec-c9ae9c195f73_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F0cf8245e8660437db79b8093fae547e6%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/0cf8245e8660437db79b8093fae547e6/images/large/9.jpg saved to cache
2026-03-26 22:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a8018b6c-8e7a-55a8-81ec-c9ae9c195f73
2026-03-26 22:49:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b776a950>
2026-03-26 22:49:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8018b6c-8e7a-55a8-81ec-c9ae9c195f73/a8018b6c-8e7a-55a8-81ec-c9ae9c195f73_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F0cf8245e8660437db79b8093fae547e6%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/0cf8245e8660437db79b8093fae547e6/images/large/7.jpg saved to cache
2026-03-26 22:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a8018b6c-8e7a-55a8-81ec-c9ae9c195f73
2026-03-26 22:49:15 [ayvens.be] INFO: Found listing with ID: 1985354
2026-03-26 22:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985354%27 HTTP/1.1" 200 None
2026-03-26 22:49:15 [ayvens.be] INFO: Scrape type for 1985354: 1
2026-03-26 22:49:15 [ayvens.be] INFO: Extracting data for car ID: 1985354
2026-03-26 22:49:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d with identifier: 1985354
2026-03-26 22:49:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d with scrape type 1
2026-03-26 22:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d
2026-03-26 22:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F3fa4b496af0d475e8d7d4423dc4f534f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/3fa4b496af0d475e8d7d4423dc4f534f/images/large/1.jpg not downloaded yet
2026-03-26 22:49:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/83ba81ca702748868d5429187fcd8483/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F3fa4b496af0d475e8d7d4423dc4f534f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/3fa4b496af0d475e8d7d4423dc4f534f/images/large/2.jpg not downloaded yet
2026-03-26 22:49:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6d739d0>
2026-03-26 22:49:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47ce7439-f723-56a1-9135-28d7ab2700fd/47ce7439-f723-56a1-9135-28d7ab2700fd_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F83ba81ca702748868d5429187fcd8483%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/83ba81ca702748868d5429187fcd8483/images/large/3.jpg saved to cache
2026-03-26 22:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 47ce7439-f723-56a1-9135-28d7ab2700fd
2026-03-26 22:49:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7ccf4d0>
2026-03-26 22:49:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47ce7439-f723-56a1-9135-28d7ab2700fd/47ce7439-f723-56a1-9135-28d7ab2700fd_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F83ba81ca702748868d5429187fcd8483%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/83ba81ca702748868d5429187fcd8483/images/large/4.jpg saved to cache
2026-03-26 22:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 47ce7439-f723-56a1-9135-28d7ab2700fd
2026-03-26 22:49:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6dc2dd0>
2026-03-26 22:49:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47ce7439-f723-56a1-9135-28d7ab2700fd/47ce7439-f723-56a1-9135-28d7ab2700fd_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F83ba81ca702748868d5429187fcd8483%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/83ba81ca702748868d5429187fcd8483/images/large/5.jpg saved to cache
2026-03-26 22:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 47ce7439-f723-56a1-9135-28d7ab2700fd
2026-03-26 22:49:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76c6090>
2026-03-26 22:49:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8018b6c-8e7a-55a8-81ec-c9ae9c195f73/a8018b6c-8e7a-55a8-81ec-c9ae9c195f73_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F0cf8245e8660437db79b8093fae547e6%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/0cf8245e8660437db79b8093fae547e6/images/large/10.jpg saved to cache
2026-03-26 22:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a8018b6c-8e7a-55a8-81ec-c9ae9c195f73
2026-03-26 22:49:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a8018b6c-8e7a-55a8-81ec-c9ae9c195f73, skipping ID generation
2026-03-26 22:49:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8018b6c-8e7a-55a8-81ec-c9ae9c195f73 with scrape type 1
2026-03-26 22:49:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a8018b6c-8e7a-55a8-81ec-c9ae9c195f73 sending to next pipeline
2026-03-26 22:49:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a8018b6c-8e7a-55a8-81ec-c9ae9c195f73, identifier: 1985351
2026-03-26 22:49:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6ddb590>
2026-03-26 22:49:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47ce7439-f723-56a1-9135-28d7ab2700fd/47ce7439-f723-56a1-9135-28d7ab2700fd_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F83ba81ca702748868d5429187fcd8483%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/83ba81ca702748868d5429187fcd8483/images/large/7.jpg saved to cache
2026-03-26 22:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 47ce7439-f723-56a1-9135-28d7ab2700fd
2026-03-26 22:49:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c5fd90>
2026-03-26 22:49:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47ce7439-f723-56a1-9135-28d7ab2700fd/47ce7439-f723-56a1-9135-28d7ab2700fd_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F83ba81ca702748868d5429187fcd8483%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/83ba81ca702748868d5429187fcd8483/images/large/9.jpg saved to cache
2026-03-26 22:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 47ce7439-f723-56a1-9135-28d7ab2700fd
2026-03-26 22:49:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76a60d0>
2026-03-26 22:49:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47ce7439-f723-56a1-9135-28d7ab2700fd/47ce7439-f723-56a1-9135-28d7ab2700fd_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F83ba81ca702748868d5429187fcd8483%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/83ba81ca702748868d5429187fcd8483/images/large/6.jpg saved to cache
2026-03-26 22:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 47ce7439-f723-56a1-9135-28d7ab2700fd
2026-03-26 22:49:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/83ba81ca702748868d5429187fcd8483/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a8018b6c-8e7a-55a8-81ec-c9ae9c195f73 with identifier: 1985351
2026-03-26 22:49:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a8018b6c-8e7a-55a8-81ec-c9ae9c195f73 with identifier: 1985351
2026-03-26 22:49:16 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a8018b6c-8e7a-55a8-81ec-c9ae9c195f73 with identifier: 1985351 to the API
2026-03-26 22:49:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:49:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:49:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yp/0cf8245e8660437db79b8093fae547e6/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'electric',
 'id': 'a8018b6c-8e7a-55a8-81ec-c9ae9c195f73',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'E-TRON',
 'odometer': 116535,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8018b6c-8e7a-55a8-81ec-c9ae9c195f73/a8018b6c-8e7a-55a8-81ec-c9ae9c195f73_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 754552,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/0cf8245e8660437db79b8093fae547e6/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8018b6c-8e7a-55a8-81ec-c9ae9c195f73/a8018b6c-8e7a-55a8-81ec-c9ae9c195f73_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 776581,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/0cf8245e8660437db79b8093fae547e6/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8018b6c-8e7a-55a8-81ec-c9ae9c195f73/a8018b6c-8e7a-55a8-81ec-c9ae9c195f73_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 818149,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/0cf8245e8660437db79b8093fae547e6/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8018b6c-8e7a-55a8-81ec-c9ae9c195f73/a8018b6c-8e7a-55a8-81ec-c9ae9c195f73_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 826593,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/0cf8245e8660437db79b8093fae547e6/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8018b6c-8e7a-55a8-81ec-c9ae9c195f73/a8018b6c-8e7a-55a8-81ec-c9ae9c195f73_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 798279,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/0cf8245e8660437db79b8093fae547e6/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8018b6c-8e7a-55a8-81ec-c9ae9c195f73/a8018b6c-8e7a-55a8-81ec-c9ae9c195f73_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 746227,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/0cf8245e8660437db79b8093fae547e6/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8018b6c-8e7a-55a8-81ec-c9ae9c195f73/a8018b6c-8e7a-55a8-81ec-c9ae9c195f73_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 606653,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/0cf8245e8660437db79b8093fae547e6/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8018b6c-8e7a-55a8-81ec-c9ae9c195f73/a8018b6c-8e7a-55a8-81ec-c9ae9c195f73_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 785609,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/0cf8245e8660437db79b8093fae547e6/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8018b6c-8e7a-55a8-81ec-c9ae9c195f73/a8018b6c-8e7a-55a8-81ec-c9ae9c195f73_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 693999,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/0cf8245e8660437db79b8093fae547e6/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8018b6c-8e7a-55a8-81ec-c9ae9c195f73/a8018b6c-8e7a-55a8-81ec-c9ae9c195f73_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 739028,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/0cf8245e8660437db79b8093fae547e6/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI E-TRON 95 kWh 55 Quattro Advanced',
 'transmission': 'automatic',
 'trim': '95 kWh 55 Quattro Advanced',
 'vin': None,
 'year': 2020}
2026-03-26 22:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985351%27 HTTP/1.1" 200 None
2026-03-26 22:49:16 [ayvens.be] INFO: Saving data for 1985351: {'created_time': 1774565356.662767, 'last_price_update_time': 1774565356.662778, 'auction_closing_time': 1774958400.0}
2026-03-26 22:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985351') HTTP/1.1" 204 0
2026-03-26 22:49:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cs/852595d6f06348b59c0e502071d6719f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F3fa4b496af0d475e8d7d4423dc4f534f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/3fa4b496af0d475e8d7d4423dc4f534f/images/large/3.jpg not downloaded yet
2026-03-26 22:49:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cs/852595d6f06348b59c0e502071d6719f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cs/852595d6f06348b59c0e502071d6719f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F3fa4b496af0d475e8d7d4423dc4f534f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/3fa4b496af0d475e8d7d4423dc4f534f/images/large/4.jpg not downloaded yet
2026-03-26 22:49:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7745710>
2026-03-26 22:49:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47ce7439-f723-56a1-9135-28d7ab2700fd/47ce7439-f723-56a1-9135-28d7ab2700fd_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F83ba81ca702748868d5429187fcd8483%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/83ba81ca702748868d5429187fcd8483/images/large/10.jpg saved to cache
2026-03-26 22:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 47ce7439-f723-56a1-9135-28d7ab2700fd
2026-03-26 22:49:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79ccc50>
2026-03-26 22:49:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47ce7439-f723-56a1-9135-28d7ab2700fd/47ce7439-f723-56a1-9135-28d7ab2700fd_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F83ba81ca702748868d5429187fcd8483%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/83ba81ca702748868d5429187fcd8483/images/large/8.jpg saved to cache
2026-03-26 22:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 47ce7439-f723-56a1-9135-28d7ab2700fd
2026-03-26 22:49:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 47ce7439-f723-56a1-9135-28d7ab2700fd, skipping ID generation
2026-03-26 22:49:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47ce7439-f723-56a1-9135-28d7ab2700fd with scrape type 1
2026-03-26 22:49:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 47ce7439-f723-56a1-9135-28d7ab2700fd sending to next pipeline
2026-03-26 22:49:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 47ce7439-f723-56a1-9135-28d7ab2700fd, identifier: 1985352
2026-03-26 22:49:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cs/852595d6f06348b59c0e502071d6719f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F3fa4b496af0d475e8d7d4423dc4f534f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/3fa4b496af0d475e8d7d4423dc4f534f/images/large/5.jpg not downloaded yet
2026-03-26 22:49:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 47ce7439-f723-56a1-9135-28d7ab2700fd with identifier: 1985352
2026-03-26 22:49:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 47ce7439-f723-56a1-9135-28d7ab2700fd with identifier: 1985352
2026-03-26 22:49:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 47ce7439-f723-56a1-9135-28d7ab2700fd with identifier: 1985352 to the API
2026-03-26 22:49:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:49:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:49:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bm/83ba81ca702748868d5429187fcd8483/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '47ce7439-f723-56a1-9135-28d7ab2700fd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '5 SERIES BERLINE',
 'odometer': 59999,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47ce7439-f723-56a1-9135-28d7ab2700fd/47ce7439-f723-56a1-9135-28d7ab2700fd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 281573,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/83ba81ca702748868d5429187fcd8483/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47ce7439-f723-56a1-9135-28d7ab2700fd/47ce7439-f723-56a1-9135-28d7ab2700fd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 278456,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/83ba81ca702748868d5429187fcd8483/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47ce7439-f723-56a1-9135-28d7ab2700fd/47ce7439-f723-56a1-9135-28d7ab2700fd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 298400,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/83ba81ca702748868d5429187fcd8483/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47ce7439-f723-56a1-9135-28d7ab2700fd/47ce7439-f723-56a1-9135-28d7ab2700fd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 276855,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/83ba81ca702748868d5429187fcd8483/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47ce7439-f723-56a1-9135-28d7ab2700fd/47ce7439-f723-56a1-9135-28d7ab2700fd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 293300,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/83ba81ca702748868d5429187fcd8483/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47ce7439-f723-56a1-9135-28d7ab2700fd/47ce7439-f723-56a1-9135-28d7ab2700fd_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 274800,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/83ba81ca702748868d5429187fcd8483/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47ce7439-f723-56a1-9135-28d7ab2700fd/47ce7439-f723-56a1-9135-28d7ab2700fd_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 288239,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/83ba81ca702748868d5429187fcd8483/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47ce7439-f723-56a1-9135-28d7ab2700fd/47ce7439-f723-56a1-9135-28d7ab2700fd_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 367609,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/83ba81ca702748868d5429187fcd8483/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47ce7439-f723-56a1-9135-28d7ab2700fd/47ce7439-f723-56a1-9135-28d7ab2700fd_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 272471,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/83ba81ca702748868d5429187fcd8483/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47ce7439-f723-56a1-9135-28d7ab2700fd/47ce7439-f723-56a1-9135-28d7ab2700fd_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 428011,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/83ba81ca702748868d5429187fcd8483/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 5 SERIES BERLINE 2.0 530E 185KW AUTO',
 'transmission': 'automatic',
 'trim': '2.0 530E 185KW AUTO',
 'vin': None,
 'year': 2022}
2026-03-26 22:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985352%27 HTTP/1.1" 200 None
2026-03-26 22:49:17 [ayvens.be] INFO: Saving data for 1985352: {'created_time': 1774565357.333348, 'last_price_update_time': 1774565357.333361, 'auction_closing_time': 1774958400.0}
2026-03-26 22:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985352') HTTP/1.1" 204 0
2026-03-26 22:49:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cs/852595d6f06348b59c0e502071d6719f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cs/852595d6f06348b59c0e502071d6719f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cs/852595d6f06348b59c0e502071d6719f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F3fa4b496af0d475e8d7d4423dc4f534f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/3fa4b496af0d475e8d7d4423dc4f534f/images/large/6.jpg not downloaded yet
2026-03-26 22:49:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7745410>
2026-03-26 22:49:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86223df2-a655-5ba1-8ef4-a3eea7e1c134/86223df2-a655-5ba1-8ef4-a3eea7e1c134_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cs%252F852595d6f06348b59c0e502071d6719f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cs/852595d6f06348b59c0e502071d6719f/images/large/2.jpg saved to cache
2026-03-26 22:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 86223df2-a655-5ba1-8ef4-a3eea7e1c134
2026-03-26 22:49:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7492450>
2026-03-26 22:49:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86223df2-a655-5ba1-8ef4-a3eea7e1c134/86223df2-a655-5ba1-8ef4-a3eea7e1c134_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cs%252F852595d6f06348b59c0e502071d6719f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cs/852595d6f06348b59c0e502071d6719f/images/large/1.jpg saved to cache
2026-03-26 22:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 86223df2-a655-5ba1-8ef4-a3eea7e1c134
2026-03-26 22:49:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7a81e50>
2026-03-26 22:49:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86223df2-a655-5ba1-8ef4-a3eea7e1c134/86223df2-a655-5ba1-8ef4-a3eea7e1c134_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cs%252F852595d6f06348b59c0e502071d6719f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cs/852595d6f06348b59c0e502071d6719f/images/large/3.jpg saved to cache
2026-03-26 22:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 86223df2-a655-5ba1-8ef4-a3eea7e1c134
2026-03-26 22:49:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7424850>
2026-03-26 22:49:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86223df2-a655-5ba1-8ef4-a3eea7e1c134/86223df2-a655-5ba1-8ef4-a3eea7e1c134_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cs%252F852595d6f06348b59c0e502071d6719f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cs/852595d6f06348b59c0e502071d6719f/images/large/6.jpg saved to cache
2026-03-26 22:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 86223df2-a655-5ba1-8ef4-a3eea7e1c134
2026-03-26 22:49:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cs/852595d6f06348b59c0e502071d6719f/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F3fa4b496af0d475e8d7d4423dc4f534f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/3fa4b496af0d475e8d7d4423dc4f534f/images/large/7.jpg not downloaded yet
2026-03-26 22:49:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7aeb3d0>
2026-03-26 22:49:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86223df2-a655-5ba1-8ef4-a3eea7e1c134/86223df2-a655-5ba1-8ef4-a3eea7e1c134_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cs%252F852595d6f06348b59c0e502071d6719f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cs/852595d6f06348b59c0e502071d6719f/images/large/4.jpg saved to cache
2026-03-26 22:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 86223df2-a655-5ba1-8ef4-a3eea7e1c134
2026-03-26 22:49:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77bdad0>
2026-03-26 22:49:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86223df2-a655-5ba1-8ef4-a3eea7e1c134/86223df2-a655-5ba1-8ef4-a3eea7e1c134_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cs%252F852595d6f06348b59c0e502071d6719f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cs/852595d6f06348b59c0e502071d6719f/images/large/5.jpg saved to cache
2026-03-26 22:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 86223df2-a655-5ba1-8ef4-a3eea7e1c134
2026-03-26 22:49:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b99810>
2026-03-26 22:49:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86223df2-a655-5ba1-8ef4-a3eea7e1c134/86223df2-a655-5ba1-8ef4-a3eea7e1c134_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cs%252F852595d6f06348b59c0e502071d6719f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cs/852595d6f06348b59c0e502071d6719f/images/large/7.jpg saved to cache
2026-03-26 22:49:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 86223df2-a655-5ba1-8ef4-a3eea7e1c134
2026-03-26 22:49:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cs/852595d6f06348b59c0e502071d6719f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cs/852595d6f06348b59c0e502071d6719f/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F3fa4b496af0d475e8d7d4423dc4f534f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/3fa4b496af0d475e8d7d4423dc4f534f/images/large/8.jpg not downloaded yet
2026-03-26 22:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F3fa4b496af0d475e8d7d4423dc4f534f%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/3fa4b496af0d475e8d7d4423dc4f534f/images/large/9.jpg not downloaded yet
2026-03-26 22:49:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b98250>
2026-03-26 22:49:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86223df2-a655-5ba1-8ef4-a3eea7e1c134/86223df2-a655-5ba1-8ef4-a3eea7e1c134_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cs%252F852595d6f06348b59c0e502071d6719f%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cs/852595d6f06348b59c0e502071d6719f/images/large/10.jpg saved to cache
2026-03-26 22:49:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 86223df2-a655-5ba1-8ef4-a3eea7e1c134
2026-03-26 22:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F3fa4b496af0d475e8d7d4423dc4f534f%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/3fa4b496af0d475e8d7d4423dc4f534f/images/large/10.jpg not downloaded yet
2026-03-26 22:49:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/3fa4b496af0d475e8d7d4423dc4f534f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:18 [ayvens.be] INFO: Found listing with ID: 1985355
2026-03-26 22:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985355%27 HTTP/1.1" 200 None
2026-03-26 22:49:18 [ayvens.be] INFO: Scrape type for 1985355: 1
2026-03-26 22:49:18 [ayvens.be] INFO: Extracting data for car ID: 1985355
2026-03-26 22:49:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df095015-0ccb-5f99-b189-ce5e41de1ee3 with identifier: 1985355
2026-03-26 22:49:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df095015-0ccb-5f99-b189-ce5e41de1ee3 with scrape type 1
2026-03-26 22:49:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item df095015-0ccb-5f99-b189-ce5e41de1ee3
2026-03-26 22:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F48f49582962345ccbafaf81952a42dbf%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/48f49582962345ccbafaf81952a42dbf/images/large/1.jpg not downloaded yet
2026-03-26 22:49:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/3fa4b496af0d475e8d7d4423dc4f534f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/3fa4b496af0d475e8d7d4423dc4f534f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/3fa4b496af0d475e8d7d4423dc4f534f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F48f49582962345ccbafaf81952a42dbf%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/48f49582962345ccbafaf81952a42dbf/images/large/2.jpg not downloaded yet
2026-03-26 22:49:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7745c90>
2026-03-26 22:49:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86223df2-a655-5ba1-8ef4-a3eea7e1c134/86223df2-a655-5ba1-8ef4-a3eea7e1c134_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cs%252F852595d6f06348b59c0e502071d6719f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cs/852595d6f06348b59c0e502071d6719f/images/large/8.jpg saved to cache
2026-03-26 22:49:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 86223df2-a655-5ba1-8ef4-a3eea7e1c134
2026-03-26 22:49:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74ce6d0>
2026-03-26 22:49:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86223df2-a655-5ba1-8ef4-a3eea7e1c134/86223df2-a655-5ba1-8ef4-a3eea7e1c134_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cs%252F852595d6f06348b59c0e502071d6719f%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cs/852595d6f06348b59c0e502071d6719f/images/large/9.jpg saved to cache
2026-03-26 22:49:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 86223df2-a655-5ba1-8ef4-a3eea7e1c134
2026-03-26 22:49:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 86223df2-a655-5ba1-8ef4-a3eea7e1c134, skipping ID generation
2026-03-26 22:49:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 86223df2-a655-5ba1-8ef4-a3eea7e1c134 with scrape type 1
2026-03-26 22:49:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 86223df2-a655-5ba1-8ef4-a3eea7e1c134 sending to next pipeline
2026-03-26 22:49:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 86223df2-a655-5ba1-8ef4-a3eea7e1c134, identifier: 1985353
2026-03-26 22:49:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 86223df2-a655-5ba1-8ef4-a3eea7e1c134 with identifier: 1985353
2026-03-26 22:49:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 86223df2-a655-5ba1-8ef4-a3eea7e1c134 with identifier: 1985353
2026-03-26 22:49:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 86223df2-a655-5ba1-8ef4-a3eea7e1c134 with identifier: 1985353 to the API
2026-03-26 22:49:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:49:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:49:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cs/852595d6f06348b59c0e502071d6719f/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '86223df2-a655-5ba1-8ef4-a3eea7e1c134',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 214066,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86223df2-a655-5ba1-8ef4-a3eea7e1c134/86223df2-a655-5ba1-8ef4-a3eea7e1c134_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 518504,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cs/852595d6f06348b59c0e502071d6719f/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86223df2-a655-5ba1-8ef4-a3eea7e1c134/86223df2-a655-5ba1-8ef4-a3eea7e1c134_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 483760,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cs/852595d6f06348b59c0e502071d6719f/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86223df2-a655-5ba1-8ef4-a3eea7e1c134/86223df2-a655-5ba1-8ef4-a3eea7e1c134_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 527567,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cs/852595d6f06348b59c0e502071d6719f/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86223df2-a655-5ba1-8ef4-a3eea7e1c134/86223df2-a655-5ba1-8ef4-a3eea7e1c134_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 544277,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cs/852595d6f06348b59c0e502071d6719f/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86223df2-a655-5ba1-8ef4-a3eea7e1c134/86223df2-a655-5ba1-8ef4-a3eea7e1c134_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 363652,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cs/852595d6f06348b59c0e502071d6719f/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86223df2-a655-5ba1-8ef4-a3eea7e1c134/86223df2-a655-5ba1-8ef4-a3eea7e1c134_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 265401,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cs/852595d6f06348b59c0e502071d6719f/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86223df2-a655-5ba1-8ef4-a3eea7e1c134/86223df2-a655-5ba1-8ef4-a3eea7e1c134_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 356893,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cs/852595d6f06348b59c0e502071d6719f/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86223df2-a655-5ba1-8ef4-a3eea7e1c134/86223df2-a655-5ba1-8ef4-a3eea7e1c134_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 384007,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cs/852595d6f06348b59c0e502071d6719f/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86223df2-a655-5ba1-8ef4-a3eea7e1c134/86223df2-a655-5ba1-8ef4-a3eea7e1c134_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 349093,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cs/852595d6f06348b59c0e502071d6719f/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86223df2-a655-5ba1-8ef4-a3eea7e1c134/86223df2-a655-5ba1-8ef4-a3eea7e1c134_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 222936,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cs/852595d6f06348b59c0e502071d6719f/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T5 PHEV PLUS BRIGHT DESIGN DCT',
 'transmission': 'automatic',
 'trim': '1.5 T5 PHEV PLUS BRIGHT DESIGN DCT',
 'vin': None,
 'year': 2022}
2026-03-26 22:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985353%27 HTTP/1.1" 200 None
2026-03-26 22:49:18 [ayvens.be] INFO: Saving data for 1985353: {'created_time': 1774565358.86386, 'last_price_update_time': 1774565358.863878, 'auction_closing_time': 1774958400.0}
2026-03-26 22:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985353') HTTP/1.1" 204 0
2026-03-26 22:49:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/3fa4b496af0d475e8d7d4423dc4f534f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F48f49582962345ccbafaf81952a42dbf%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/48f49582962345ccbafaf81952a42dbf/images/large/3.jpg not downloaded yet
2026-03-26 22:49:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5ca51d0>
2026-03-26 22:49:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d/4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F3fa4b496af0d475e8d7d4423dc4f534f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/3fa4b496af0d475e8d7d4423dc4f534f/images/large/1.jpg saved to cache
2026-03-26 22:49:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d
2026-03-26 22:49:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c681d0>
2026-03-26 22:49:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d/4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F3fa4b496af0d475e8d7d4423dc4f534f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/3fa4b496af0d475e8d7d4423dc4f534f/images/large/3.jpg saved to cache
2026-03-26 22:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d
2026-03-26 22:49:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7924950>
2026-03-26 22:49:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d/4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F3fa4b496af0d475e8d7d4423dc4f534f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/3fa4b496af0d475e8d7d4423dc4f534f/images/large/4.jpg saved to cache
2026-03-26 22:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d
2026-03-26 22:49:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c6b550>
2026-03-26 22:49:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d/4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F3fa4b496af0d475e8d7d4423dc4f534f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/3fa4b496af0d475e8d7d4423dc4f534f/images/large/2.jpg saved to cache
2026-03-26 22:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d
2026-03-26 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F48f49582962345ccbafaf81952a42dbf%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/48f49582962345ccbafaf81952a42dbf/images/large/4.jpg not downloaded yet
2026-03-26 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F48f49582962345ccbafaf81952a42dbf%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/48f49582962345ccbafaf81952a42dbf/images/large/5.jpg not downloaded yet
2026-03-26 22:49:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7481310>
2026-03-26 22:49:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d/4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F3fa4b496af0d475e8d7d4423dc4f534f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/3fa4b496af0d475e8d7d4423dc4f534f/images/large/5.jpg saved to cache
2026-03-26 22:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d
2026-03-26 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F48f49582962345ccbafaf81952a42dbf%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/48f49582962345ccbafaf81952a42dbf/images/large/6.jpg not downloaded yet
2026-03-26 22:49:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/3fa4b496af0d475e8d7d4423dc4f534f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/3fa4b496af0d475e8d7d4423dc4f534f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F48f49582962345ccbafaf81952a42dbf%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/48f49582962345ccbafaf81952a42dbf/images/large/7.jpg not downloaded yet
2026-03-26 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F48f49582962345ccbafaf81952a42dbf%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/48f49582962345ccbafaf81952a42dbf/images/large/8.jpg not downloaded yet
2026-03-26 22:49:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/3fa4b496af0d475e8d7d4423dc4f534f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F48f49582962345ccbafaf81952a42dbf%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/48f49582962345ccbafaf81952a42dbf/images/large/9.jpg not downloaded yet
2026-03-26 22:49:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/3fa4b496af0d475e8d7d4423dc4f534f/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/3fa4b496af0d475e8d7d4423dc4f534f/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/48f49582962345ccbafaf81952a42dbf/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F48f49582962345ccbafaf81952a42dbf%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/48f49582962345ccbafaf81952a42dbf/images/large/10.jpg not downloaded yet
2026-03-26 22:49:19 [ayvens.be] INFO: Found listing with ID: 1985356
2026-03-26 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985356%27 HTTP/1.1" 200 None
2026-03-26 22:49:19 [ayvens.be] INFO: Scrape type for 1985356: 1
2026-03-26 22:49:19 [ayvens.be] INFO: Extracting data for car ID: 1985356
2026-03-26 22:49:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ceb1d629-df7b-58ce-aa91-9dee573cbb0d with identifier: 1985356
2026-03-26 22:49:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ceb1d629-df7b-58ce-aa91-9dee573cbb0d with scrape type 1
2026-03-26 22:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ceb1d629-df7b-58ce-aa91-9dee573cbb0d
2026-03-26 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F5881591dfabc45018107f51a50825c88%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/5881591dfabc45018107f51a50825c88/images/large/1.jpg not downloaded yet
2026-03-26 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F5881591dfabc45018107f51a50825c88%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/5881591dfabc45018107f51a50825c88/images/large/2.jpg not downloaded yet
2026-03-26 22:49:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/48f49582962345ccbafaf81952a42dbf/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F5881591dfabc45018107f51a50825c88%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/5881591dfabc45018107f51a50825c88/images/large/3.jpg not downloaded yet
2026-03-26 22:49:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7ce8350>
2026-03-26 22:49:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d/4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F3fa4b496af0d475e8d7d4423dc4f534f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/3fa4b496af0d475e8d7d4423dc4f534f/images/large/6.jpg saved to cache
2026-03-26 22:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d
2026-03-26 22:49:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c76b90>
2026-03-26 22:49:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d/4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F3fa4b496af0d475e8d7d4423dc4f534f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/3fa4b496af0d475e8d7d4423dc4f534f/images/large/7.jpg saved to cache
2026-03-26 22:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d
2026-03-26 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F5881591dfabc45018107f51a50825c88%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/5881591dfabc45018107f51a50825c88/images/large/4.jpg not downloaded yet
2026-03-26 22:49:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b741e650>
2026-03-26 22:49:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d/4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F3fa4b496af0d475e8d7d4423dc4f534f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/3fa4b496af0d475e8d7d4423dc4f534f/images/large/8.jpg saved to cache
2026-03-26 22:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d
2026-03-26 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F5881591dfabc45018107f51a50825c88%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/5881591dfabc45018107f51a50825c88/images/large/5.jpg not downloaded yet
2026-03-26 22:49:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77be9d0>
2026-03-26 22:49:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d/4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F3fa4b496af0d475e8d7d4423dc4f534f%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/3fa4b496af0d475e8d7d4423dc4f534f/images/large/9.jpg saved to cache
2026-03-26 22:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d
2026-03-26 22:49:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74ccd10>
2026-03-26 22:49:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d/4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F3fa4b496af0d475e8d7d4423dc4f534f%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/3fa4b496af0d475e8d7d4423dc4f534f/images/large/10.jpg saved to cache
2026-03-26 22:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d
2026-03-26 22:49:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d, skipping ID generation
2026-03-26 22:49:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d with scrape type 1
2026-03-26 22:49:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d sending to next pipeline
2026-03-26 22:49:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d, identifier: 1985354
2026-03-26 22:49:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b98c90>
2026-03-26 22:49:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df095015-0ccb-5f99-b189-ce5e41de1ee3/df095015-0ccb-5f99-b189-ce5e41de1ee3_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F48f49582962345ccbafaf81952a42dbf%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/48f49582962345ccbafaf81952a42dbf/images/large/1.jpg saved to cache
2026-03-26 22:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item df095015-0ccb-5f99-b189-ce5e41de1ee3
2026-03-26 22:49:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c76210>
2026-03-26 22:49:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df095015-0ccb-5f99-b189-ce5e41de1ee3/df095015-0ccb-5f99-b189-ce5e41de1ee3_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F48f49582962345ccbafaf81952a42dbf%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/48f49582962345ccbafaf81952a42dbf/images/large/3.jpg saved to cache
2026-03-26 22:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item df095015-0ccb-5f99-b189-ce5e41de1ee3
2026-03-26 22:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F5881591dfabc45018107f51a50825c88%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/5881591dfabc45018107f51a50825c88/images/large/6.jpg not downloaded yet
2026-03-26 22:49:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d with identifier: 1985354
2026-03-26 22:49:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d with identifier: 1985354
2026-03-26 22:49:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d with identifier: 1985354 to the API
2026-03-26 22:49:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:49:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:49:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bh/3fa4b496af0d475e8d7d4423dc4f534f/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'PUMA',
 'odometer': 87175,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d/4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 707609,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/3fa4b496af0d475e8d7d4423dc4f534f/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d/4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 663854,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/3fa4b496af0d475e8d7d4423dc4f534f/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d/4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 680767,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/3fa4b496af0d475e8d7d4423dc4f534f/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d/4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 691145,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/3fa4b496af0d475e8d7d4423dc4f534f/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d/4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 645602,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/3fa4b496af0d475e8d7d4423dc4f534f/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d/4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 769466,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/3fa4b496af0d475e8d7d4423dc4f534f/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d/4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 595742,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/3fa4b496af0d475e8d7d4423dc4f534f/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d/4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 903370,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/3fa4b496af0d475e8d7d4423dc4f534f/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d/4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 868549,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/3fa4b496af0d475e8d7d4423dc4f534f/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d/4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 857182,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/3fa4b496af0d475e8d7d4423dc4f534f/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD PUMA 1.0 ECOBOOST MHEV 92KW DCT ST-LINE X',
 'transmission': 'automatic',
 'trim': '1.0 ECOBOOST MHEV 92KW DCT ST-LINE X',
 'vin': None,
 'year': 2021}
2026-03-26 22:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985354%27 HTTP/1.1" 200 None
2026-03-26 22:49:20 [ayvens.be] INFO: Saving data for 1985354: {'created_time': 1774565360.714588, 'last_price_update_time': 1774565360.714598, 'auction_closing_time': 1774958400.0}
2026-03-26 22:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985354') HTTP/1.1" 204 0
2026-03-26 22:49:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/48f49582962345ccbafaf81952a42dbf/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F5881591dfabc45018107f51a50825c88%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/5881591dfabc45018107f51a50825c88/images/large/7.jpg not downloaded yet
2026-03-26 22:49:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/48f49582962345ccbafaf81952a42dbf/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/48f49582962345ccbafaf81952a42dbf/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/48f49582962345ccbafaf81952a42dbf/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F5881591dfabc45018107f51a50825c88%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/5881591dfabc45018107f51a50825c88/images/large/8.jpg not downloaded yet
2026-03-26 22:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F5881591dfabc45018107f51a50825c88%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/5881591dfabc45018107f51a50825c88/images/large/9.jpg not downloaded yet
2026-03-26 22:49:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/48f49582962345ccbafaf81952a42dbf/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/48f49582962345ccbafaf81952a42dbf/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/48f49582962345ccbafaf81952a42dbf/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F5881591dfabc45018107f51a50825c88%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/5881591dfabc45018107f51a50825c88/images/large/10.jpg not downloaded yet
2026-03-26 22:49:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/48f49582962345ccbafaf81952a42dbf/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:20 [ayvens.be] INFO: Found listing with ID: 1985357
2026-03-26 22:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985357%27 HTTP/1.1" 200 None
2026-03-26 22:49:20 [ayvens.be] INFO: Scrape type for 1985357: 1
2026-03-26 22:49:20 [ayvens.be] INFO: Extracting data for car ID: 1985357
2026-03-26 22:49:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d509a2bd-3224-5aa1-a4e3-43f55bb7adc4 with identifier: 1985357
2026-03-26 22:49:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d509a2bd-3224-5aa1-a4e3-43f55bb7adc4 with scrape type 1
2026-03-26 22:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d509a2bd-3224-5aa1-a4e3-43f55bb7adc4
2026-03-26 22:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252Fcdf591cb7e5b47fe815fc67dec7d6701%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/cdf591cb7e5b47fe815fc67dec7d6701/images/large/1.jpg not downloaded yet
2026-03-26 22:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252Fcdf591cb7e5b47fe815fc67dec7d6701%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/cdf591cb7e5b47fe815fc67dec7d6701/images/large/2.jpg not downloaded yet
2026-03-26 22:49:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7aa28d0>
2026-03-26 22:49:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df095015-0ccb-5f99-b189-ce5e41de1ee3/df095015-0ccb-5f99-b189-ce5e41de1ee3_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F48f49582962345ccbafaf81952a42dbf%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/48f49582962345ccbafaf81952a42dbf/images/large/2.jpg saved to cache
2026-03-26 22:49:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item df095015-0ccb-5f99-b189-ce5e41de1ee3
2026-03-26 22:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252Fcdf591cb7e5b47fe815fc67dec7d6701%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/cdf591cb7e5b47fe815fc67dec7d6701/images/large/3.jpg not downloaded yet
2026-03-26 22:49:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7aa24d0>
2026-03-26 22:49:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df095015-0ccb-5f99-b189-ce5e41de1ee3/df095015-0ccb-5f99-b189-ce5e41de1ee3_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F48f49582962345ccbafaf81952a42dbf%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/48f49582962345ccbafaf81952a42dbf/images/large/4.jpg saved to cache
2026-03-26 22:49:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item df095015-0ccb-5f99-b189-ce5e41de1ee3
2026-03-26 22:49:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e15550>
2026-03-26 22:49:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df095015-0ccb-5f99-b189-ce5e41de1ee3/df095015-0ccb-5f99-b189-ce5e41de1ee3_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F48f49582962345ccbafaf81952a42dbf%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/48f49582962345ccbafaf81952a42dbf/images/large/7.jpg saved to cache
2026-03-26 22:49:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item df095015-0ccb-5f99-b189-ce5e41de1ee3
2026-03-26 22:49:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7a616d0>
2026-03-26 22:49:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df095015-0ccb-5f99-b189-ce5e41de1ee3/df095015-0ccb-5f99-b189-ce5e41de1ee3_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F48f49582962345ccbafaf81952a42dbf%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/48f49582962345ccbafaf81952a42dbf/images/large/5.jpg saved to cache
2026-03-26 22:49:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item df095015-0ccb-5f99-b189-ce5e41de1ee3
2026-03-26 22:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252Fcdf591cb7e5b47fe815fc67dec7d6701%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/cdf591cb7e5b47fe815fc67dec7d6701/images/large/4.jpg not downloaded yet
2026-03-26 22:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252Fcdf591cb7e5b47fe815fc67dec7d6701%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/cdf591cb7e5b47fe815fc67dec7d6701/images/large/5.jpg not downloaded yet
2026-03-26 22:49:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c81290>
2026-03-26 22:49:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df095015-0ccb-5f99-b189-ce5e41de1ee3/df095015-0ccb-5f99-b189-ce5e41de1ee3_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F48f49582962345ccbafaf81952a42dbf%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/48f49582962345ccbafaf81952a42dbf/images/large/6.jpg saved to cache
2026-03-26 22:49:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item df095015-0ccb-5f99-b189-ce5e41de1ee3
2026-03-26 22:49:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74973d0>
2026-03-26 22:49:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df095015-0ccb-5f99-b189-ce5e41de1ee3/df095015-0ccb-5f99-b189-ce5e41de1ee3_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F48f49582962345ccbafaf81952a42dbf%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/48f49582962345ccbafaf81952a42dbf/images/large/8.jpg saved to cache
2026-03-26 22:49:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item df095015-0ccb-5f99-b189-ce5e41de1ee3
2026-03-26 22:49:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b787cc50>
2026-03-26 22:49:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df095015-0ccb-5f99-b189-ce5e41de1ee3/df095015-0ccb-5f99-b189-ce5e41de1ee3_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F48f49582962345ccbafaf81952a42dbf%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/48f49582962345ccbafaf81952a42dbf/images/large/9.jpg saved to cache
2026-03-26 22:49:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item df095015-0ccb-5f99-b189-ce5e41de1ee3
2026-03-26 22:49:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7a83fd0>
2026-03-26 22:49:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df095015-0ccb-5f99-b189-ce5e41de1ee3/df095015-0ccb-5f99-b189-ce5e41de1ee3_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F48f49582962345ccbafaf81952a42dbf%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/48f49582962345ccbafaf81952a42dbf/images/large/10.jpg saved to cache
2026-03-26 22:49:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item df095015-0ccb-5f99-b189-ce5e41de1ee3
2026-03-26 22:49:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: df095015-0ccb-5f99-b189-ce5e41de1ee3, skipping ID generation
2026-03-26 22:49:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df095015-0ccb-5f99-b189-ce5e41de1ee3 with scrape type 1
2026-03-26 22:49:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item df095015-0ccb-5f99-b189-ce5e41de1ee3 sending to next pipeline
2026-03-26 22:49:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: df095015-0ccb-5f99-b189-ce5e41de1ee3, identifier: 1985355
2026-03-26 22:49:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: df095015-0ccb-5f99-b189-ce5e41de1ee3 with identifier: 1985355
2026-03-26 22:49:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: df095015-0ccb-5f99-b189-ce5e41de1ee3 with identifier: 1985355
2026-03-26 22:49:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: df095015-0ccb-5f99-b189-ce5e41de1ee3 with identifier: 1985355 to the API
2026-03-26 22:49:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:49:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:49:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bq/48f49582962345ccbafaf81952a42dbf/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'df095015-0ccb-5f99-b189-ce5e41de1ee3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'PASSAT VARIANT GTE - 2020',
 'odometer': 92656,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df095015-0ccb-5f99-b189-ce5e41de1ee3/df095015-0ccb-5f99-b189-ce5e41de1ee3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 773050,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/48f49582962345ccbafaf81952a42dbf/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df095015-0ccb-5f99-b189-ce5e41de1ee3/df095015-0ccb-5f99-b189-ce5e41de1ee3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 762710,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/48f49582962345ccbafaf81952a42dbf/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df095015-0ccb-5f99-b189-ce5e41de1ee3/df095015-0ccb-5f99-b189-ce5e41de1ee3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 781843,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/48f49582962345ccbafaf81952a42dbf/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df095015-0ccb-5f99-b189-ce5e41de1ee3/df095015-0ccb-5f99-b189-ce5e41de1ee3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 790056,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/48f49582962345ccbafaf81952a42dbf/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df095015-0ccb-5f99-b189-ce5e41de1ee3/df095015-0ccb-5f99-b189-ce5e41de1ee3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 811334,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/48f49582962345ccbafaf81952a42dbf/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df095015-0ccb-5f99-b189-ce5e41de1ee3/df095015-0ccb-5f99-b189-ce5e41de1ee3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 811116,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/48f49582962345ccbafaf81952a42dbf/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df095015-0ccb-5f99-b189-ce5e41de1ee3/df095015-0ccb-5f99-b189-ce5e41de1ee3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 631430,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/48f49582962345ccbafaf81952a42dbf/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df095015-0ccb-5f99-b189-ce5e41de1ee3/df095015-0ccb-5f99-b189-ce5e41de1ee3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 846656,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/48f49582962345ccbafaf81952a42dbf/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df095015-0ccb-5f99-b189-ce5e41de1ee3/df095015-0ccb-5f99-b189-ce5e41de1ee3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 805943,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/48f49582962345ccbafaf81952a42dbf/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df095015-0ccb-5f99-b189-ce5e41de1ee3/df095015-0ccb-5f99-b189-ce5e41de1ee3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 779383,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/48f49582962345ccbafaf81952a42dbf/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN PASSAT VARIANT GTE - 2020 1.4 TSI PHEV GTE Business DSG',
 'transmission': 'automatic',
 'trim': '1.4 TSI PHEV GTE Business DSG',
 'vin': None,
 'year': 2022}
2026-03-26 22:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985355%27 HTTP/1.1" 200 None
2026-03-26 22:49:22 [ayvens.be] INFO: Saving data for 1985355: {'created_time': 1774565362.221628, 'last_price_update_time': 1774565362.221638, 'auction_closing_time': 1774958400.0}
2026-03-26 22:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985355') HTTP/1.1" 204 0
2026-03-26 22:49:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/5881591dfabc45018107f51a50825c88/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252Fcdf591cb7e5b47fe815fc67dec7d6701%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/cdf591cb7e5b47fe815fc67dec7d6701/images/large/6.jpg not downloaded yet
2026-03-26 22:49:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/5881591dfabc45018107f51a50825c88/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/5881591dfabc45018107f51a50825c88/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252Fcdf591cb7e5b47fe815fc67dec7d6701%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/cdf591cb7e5b47fe815fc67dec7d6701/images/large/7.jpg not downloaded yet
2026-03-26 22:49:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/5881591dfabc45018107f51a50825c88/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/5881591dfabc45018107f51a50825c88/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/5881591dfabc45018107f51a50825c88/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/5881591dfabc45018107f51a50825c88/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252Fcdf591cb7e5b47fe815fc67dec7d6701%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/cdf591cb7e5b47fe815fc67dec7d6701/images/large/8.jpg not downloaded yet
2026-03-26 22:49:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/5881591dfabc45018107f51a50825c88/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252Fcdf591cb7e5b47fe815fc67dec7d6701%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/cdf591cb7e5b47fe815fc67dec7d6701/images/large/9.jpg not downloaded yet
2026-03-26 22:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252Fcdf591cb7e5b47fe815fc67dec7d6701%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/cdf591cb7e5b47fe815fc67dec7d6701/images/large/10.jpg not downloaded yet
2026-03-26 22:49:22 [ayvens.be] INFO: Found listing with ID: 1985358
2026-03-26 22:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985358%27 HTTP/1.1" 200 None
2026-03-26 22:49:22 [ayvens.be] INFO: Scrape type for 1985358: 1
2026-03-26 22:49:22 [ayvens.be] INFO: Extracting data for car ID: 1985358
2026-03-26 22:49:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 183a01eb-ba00-5b6a-8f49-a0247b53e1f1 with identifier: 1985358
2026-03-26 22:49:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 183a01eb-ba00-5b6a-8f49-a0247b53e1f1 with scrape type 1
2026-03-26 22:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 183a01eb-ba00-5b6a-8f49-a0247b53e1f1
2026-03-26 22:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F035aa93c963d41e5b04c615c548ea61d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/035aa93c963d41e5b04c615c548ea61d/images/large/1.jpg not downloaded yet
2026-03-26 22:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F035aa93c963d41e5b04c615c548ea61d%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/035aa93c963d41e5b04c615c548ea61d/images/large/2.jpg not downloaded yet
2026-03-26 22:49:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77e8c10>
2026-03-26 22:49:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ceb1d629-df7b-58ce-aa91-9dee573cbb0d/ceb1d629-df7b-58ce-aa91-9dee573cbb0d_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F5881591dfabc45018107f51a50825c88%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/5881591dfabc45018107f51a50825c88/images/large/1.jpg saved to cache
2026-03-26 22:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ceb1d629-df7b-58ce-aa91-9dee573cbb0d
2026-03-26 22:49:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74a53d0>
2026-03-26 22:49:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ceb1d629-df7b-58ce-aa91-9dee573cbb0d/ceb1d629-df7b-58ce-aa91-9dee573cbb0d_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F5881591dfabc45018107f51a50825c88%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/5881591dfabc45018107f51a50825c88/images/large/2.jpg saved to cache
2026-03-26 22:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ceb1d629-df7b-58ce-aa91-9dee573cbb0d
2026-03-26 22:49:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7438bd0>
2026-03-26 22:49:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ceb1d629-df7b-58ce-aa91-9dee573cbb0d/ceb1d629-df7b-58ce-aa91-9dee573cbb0d_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F5881591dfabc45018107f51a50825c88%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/5881591dfabc45018107f51a50825c88/images/large/4.jpg saved to cache
2026-03-26 22:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ceb1d629-df7b-58ce-aa91-9dee573cbb0d
2026-03-26 22:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F035aa93c963d41e5b04c615c548ea61d%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/035aa93c963d41e5b04c615c548ea61d/images/large/3.jpg not downloaded yet
2026-03-26 22:49:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b9a510>
2026-03-26 22:49:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ceb1d629-df7b-58ce-aa91-9dee573cbb0d/ceb1d629-df7b-58ce-aa91-9dee573cbb0d_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F5881591dfabc45018107f51a50825c88%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/5881591dfabc45018107f51a50825c88/images/large/5.jpg saved to cache
2026-03-26 22:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ceb1d629-df7b-58ce-aa91-9dee573cbb0d
2026-03-26 22:49:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b9a5d0>
2026-03-26 22:49:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ceb1d629-df7b-58ce-aa91-9dee573cbb0d/ceb1d629-df7b-58ce-aa91-9dee573cbb0d_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F5881591dfabc45018107f51a50825c88%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/5881591dfabc45018107f51a50825c88/images/large/8.jpg saved to cache
2026-03-26 22:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ceb1d629-df7b-58ce-aa91-9dee573cbb0d
2026-03-26 22:49:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7745c10>
2026-03-26 22:49:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ceb1d629-df7b-58ce-aa91-9dee573cbb0d/ceb1d629-df7b-58ce-aa91-9dee573cbb0d_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F5881591dfabc45018107f51a50825c88%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/5881591dfabc45018107f51a50825c88/images/large/6.jpg saved to cache
2026-03-26 22:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ceb1d629-df7b-58ce-aa91-9dee573cbb0d
2026-03-26 22:49:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd3bb3d0>
2026-03-26 22:49:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ceb1d629-df7b-58ce-aa91-9dee573cbb0d/ceb1d629-df7b-58ce-aa91-9dee573cbb0d_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F5881591dfabc45018107f51a50825c88%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/5881591dfabc45018107f51a50825c88/images/large/3.jpg saved to cache
2026-03-26 22:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ceb1d629-df7b-58ce-aa91-9dee573cbb0d
2026-03-26 22:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F035aa93c963d41e5b04c615c548ea61d%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/035aa93c963d41e5b04c615c548ea61d/images/large/4.jpg not downloaded yet
2026-03-26 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F035aa93c963d41e5b04c615c548ea61d%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/035aa93c963d41e5b04c615c548ea61d/images/large/5.jpg not downloaded yet
2026-03-26 22:49:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7401590>
2026-03-26 22:49:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ceb1d629-df7b-58ce-aa91-9dee573cbb0d/ceb1d629-df7b-58ce-aa91-9dee573cbb0d_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F5881591dfabc45018107f51a50825c88%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/5881591dfabc45018107f51a50825c88/images/large/7.jpg saved to cache
2026-03-26 22:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ceb1d629-df7b-58ce-aa91-9dee573cbb0d
2026-03-26 22:49:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/cdf591cb7e5b47fe815fc67dec7d6701/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F035aa93c963d41e5b04c615c548ea61d%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/035aa93c963d41e5b04c615c548ea61d/images/large/6.jpg not downloaded yet
2026-03-26 22:49:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/cdf591cb7e5b47fe815fc67dec7d6701/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F035aa93c963d41e5b04c615c548ea61d%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/035aa93c963d41e5b04c615c548ea61d/images/large/7.jpg not downloaded yet
2026-03-26 22:49:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/5881591dfabc45018107f51a50825c88/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/cdf591cb7e5b47fe815fc67dec7d6701/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/5881591dfabc45018107f51a50825c88/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/cdf591cb7e5b47fe815fc67dec7d6701/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/cdf591cb7e5b47fe815fc67dec7d6701/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F035aa93c963d41e5b04c615c548ea61d%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/035aa93c963d41e5b04c615c548ea61d/images/large/8.jpg not downloaded yet
2026-03-26 22:49:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/cdf591cb7e5b47fe815fc67dec7d6701/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F035aa93c963d41e5b04c615c548ea61d%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/035aa93c963d41e5b04c615c548ea61d/images/large/9.jpg not downloaded yet
2026-03-26 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F035aa93c963d41e5b04c615c548ea61d%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/035aa93c963d41e5b04c615c548ea61d/images/large/10.jpg not downloaded yet
2026-03-26 22:49:23 [ayvens.be] INFO: Found listing with ID: 1985359
2026-03-26 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985359%27 HTTP/1.1" 200 None
2026-03-26 22:49:23 [ayvens.be] INFO: Scrape type for 1985359: 1
2026-03-26 22:49:23 [ayvens.be] INFO: Extracting data for car ID: 1985359
2026-03-26 22:49:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f5f974a-0766-52a4-afdb-ae60ea21c7a8 with identifier: 1985359
2026-03-26 22:49:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f5f974a-0766-52a4-afdb-ae60ea21c7a8 with scrape type 1
2026-03-26 22:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0f5f974a-0766-52a4-afdb-ae60ea21c7a8
2026-03-26 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F12f7b1211d13400f973d3fd5a72436de%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/12f7b1211d13400f973d3fd5a72436de/images/large/1.jpg not downloaded yet
2026-03-26 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F12f7b1211d13400f973d3fd5a72436de%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/12f7b1211d13400f973d3fd5a72436de/images/large/2.jpg not downloaded yet
2026-03-26 22:49:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e3f690>
2026-03-26 22:49:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d509a2bd-3224-5aa1-a4e3-43f55bb7adc4/d509a2bd-3224-5aa1-a4e3-43f55bb7adc4_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252Fcdf591cb7e5b47fe815fc67dec7d6701%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/cdf591cb7e5b47fe815fc67dec7d6701/images/large/3.jpg saved to cache
2026-03-26 22:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d509a2bd-3224-5aa1-a4e3-43f55bb7adc4
2026-03-26 22:49:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74ad510>
2026-03-26 22:49:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d509a2bd-3224-5aa1-a4e3-43f55bb7adc4/d509a2bd-3224-5aa1-a4e3-43f55bb7adc4_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252Fcdf591cb7e5b47fe815fc67dec7d6701%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/cdf591cb7e5b47fe815fc67dec7d6701/images/large/2.jpg saved to cache
2026-03-26 22:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d509a2bd-3224-5aa1-a4e3-43f55bb7adc4
2026-03-26 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F12f7b1211d13400f973d3fd5a72436de%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/12f7b1211d13400f973d3fd5a72436de/images/large/3.jpg not downloaded yet
2026-03-26 22:49:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7ccdf50>
2026-03-26 22:49:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ceb1d629-df7b-58ce-aa91-9dee573cbb0d/ceb1d629-df7b-58ce-aa91-9dee573cbb0d_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F5881591dfabc45018107f51a50825c88%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/5881591dfabc45018107f51a50825c88/images/large/9.jpg saved to cache
2026-03-26 22:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ceb1d629-df7b-58ce-aa91-9dee573cbb0d
2026-03-26 22:49:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e34690>
2026-03-26 22:49:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d509a2bd-3224-5aa1-a4e3-43f55bb7adc4/d509a2bd-3224-5aa1-a4e3-43f55bb7adc4_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252Fcdf591cb7e5b47fe815fc67dec7d6701%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/cdf591cb7e5b47fe815fc67dec7d6701/images/large/4.jpg saved to cache
2026-03-26 22:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d509a2bd-3224-5aa1-a4e3-43f55bb7adc4
2026-03-26 22:49:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74cc8d0>
2026-03-26 22:49:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ceb1d629-df7b-58ce-aa91-9dee573cbb0d/ceb1d629-df7b-58ce-aa91-9dee573cbb0d_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F5881591dfabc45018107f51a50825c88%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/5881591dfabc45018107f51a50825c88/images/large/10.jpg saved to cache
2026-03-26 22:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ceb1d629-df7b-58ce-aa91-9dee573cbb0d
2026-03-26 22:49:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ceb1d629-df7b-58ce-aa91-9dee573cbb0d, skipping ID generation
2026-03-26 22:49:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ceb1d629-df7b-58ce-aa91-9dee573cbb0d with scrape type 1
2026-03-26 22:49:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ceb1d629-df7b-58ce-aa91-9dee573cbb0d sending to next pipeline
2026-03-26 22:49:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: ceb1d629-df7b-58ce-aa91-9dee573cbb0d, identifier: 1985356
2026-03-26 22:49:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c750d0>
2026-03-26 22:49:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d509a2bd-3224-5aa1-a4e3-43f55bb7adc4/d509a2bd-3224-5aa1-a4e3-43f55bb7adc4_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252Fcdf591cb7e5b47fe815fc67dec7d6701%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/cdf591cb7e5b47fe815fc67dec7d6701/images/large/6.jpg saved to cache
2026-03-26 22:49:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d509a2bd-3224-5aa1-a4e3-43f55bb7adc4
2026-03-26 22:49:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6dd9650>
2026-03-26 22:49:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d509a2bd-3224-5aa1-a4e3-43f55bb7adc4/d509a2bd-3224-5aa1-a4e3-43f55bb7adc4_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252Fcdf591cb7e5b47fe815fc67dec7d6701%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/cdf591cb7e5b47fe815fc67dec7d6701/images/large/5.jpg saved to cache
2026-03-26 22:49:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d509a2bd-3224-5aa1-a4e3-43f55bb7adc4
2026-03-26 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F12f7b1211d13400f973d3fd5a72436de%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/12f7b1211d13400f973d3fd5a72436de/images/large/4.jpg not downloaded yet
2026-03-26 22:49:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: ceb1d629-df7b-58ce-aa91-9dee573cbb0d with identifier: 1985356
2026-03-26 22:49:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: ceb1d629-df7b-58ce-aa91-9dee573cbb0d with identifier: 1985356
2026-03-26 22:49:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: ceb1d629-df7b-58ce-aa91-9dee573cbb0d with identifier: 1985356 to the API
2026-03-26 22:49:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:49:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:49:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bk/5881591dfabc45018107f51a50825c88/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'ceb1d629-df7b-58ce-aa91-9dee573cbb0d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLASS A (W177)',
 'odometer': 82333,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 19,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ceb1d629-df7b-58ce-aa91-9dee573cbb0d/ceb1d629-df7b-58ce-aa91-9dee573cbb0d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 605512,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/5881591dfabc45018107f51a50825c88/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ceb1d629-df7b-58ce-aa91-9dee573cbb0d/ceb1d629-df7b-58ce-aa91-9dee573cbb0d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 580538,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/5881591dfabc45018107f51a50825c88/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ceb1d629-df7b-58ce-aa91-9dee573cbb0d/ceb1d629-df7b-58ce-aa91-9dee573cbb0d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 649613,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/5881591dfabc45018107f51a50825c88/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ceb1d629-df7b-58ce-aa91-9dee573cbb0d/ceb1d629-df7b-58ce-aa91-9dee573cbb0d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 608134,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/5881591dfabc45018107f51a50825c88/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ceb1d629-df7b-58ce-aa91-9dee573cbb0d/ceb1d629-df7b-58ce-aa91-9dee573cbb0d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 614244,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/5881591dfabc45018107f51a50825c88/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ceb1d629-df7b-58ce-aa91-9dee573cbb0d/ceb1d629-df7b-58ce-aa91-9dee573cbb0d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 641201,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/5881591dfabc45018107f51a50825c88/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ceb1d629-df7b-58ce-aa91-9dee573cbb0d/ceb1d629-df7b-58ce-aa91-9dee573cbb0d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 689330,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/5881591dfabc45018107f51a50825c88/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ceb1d629-df7b-58ce-aa91-9dee573cbb0d/ceb1d629-df7b-58ce-aa91-9dee573cbb0d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 580354,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/5881591dfabc45018107f51a50825c88/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ceb1d629-df7b-58ce-aa91-9dee573cbb0d/ceb1d629-df7b-58ce-aa91-9dee573cbb0d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 695855,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/5881591dfabc45018107f51a50825c88/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ceb1d629-df7b-58ce-aa91-9dee573cbb0d/ceb1d629-df7b-58ce-aa91-9dee573cbb0d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 585817,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/5881591dfabc45018107f51a50825c88/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLASS A (W177) A 250 e PHEV Business Solution',
 'transmission': 'automatic',
 'trim': 'A 250 e PHEV Business Solution',
 'vin': None,
 'year': 2021}
2026-03-26 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985356%27 HTTP/1.1" 200 None
2026-03-26 22:49:24 [ayvens.be] INFO: Saving data for 1985356: {'created_time': 1774565364.541285, 'last_price_update_time': 1774565364.541295, 'auction_closing_time': 1774958400.0}
2026-03-26 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985356') HTTP/1.1" 204 0
2026-03-26 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F12f7b1211d13400f973d3fd5a72436de%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/12f7b1211d13400f973d3fd5a72436de/images/large/5.jpg not downloaded yet
2026-03-26 22:49:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77d4410>
2026-03-26 22:49:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d509a2bd-3224-5aa1-a4e3-43f55bb7adc4/d509a2bd-3224-5aa1-a4e3-43f55bb7adc4_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252Fcdf591cb7e5b47fe815fc67dec7d6701%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/cdf591cb7e5b47fe815fc67dec7d6701/images/large/1.jpg saved to cache
2026-03-26 22:49:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d509a2bd-3224-5aa1-a4e3-43f55bb7adc4
2026-03-26 22:49:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/cdf591cb7e5b47fe815fc67dec7d6701/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/cdf591cb7e5b47fe815fc67dec7d6701/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F12f7b1211d13400f973d3fd5a72436de%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/12f7b1211d13400f973d3fd5a72436de/images/large/6.jpg not downloaded yet
2026-03-26 22:49:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/035aa93c963d41e5b04c615c548ea61d/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F12f7b1211d13400f973d3fd5a72436de%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/12f7b1211d13400f973d3fd5a72436de/images/large/7.jpg not downloaded yet
2026-03-26 22:49:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/cdf591cb7e5b47fe815fc67dec7d6701/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/035aa93c963d41e5b04c615c548ea61d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/035aa93c963d41e5b04c615c548ea61d/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F12f7b1211d13400f973d3fd5a72436de%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/12f7b1211d13400f973d3fd5a72436de/images/large/8.jpg not downloaded yet
2026-03-26 22:49:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/035aa93c963d41e5b04c615c548ea61d/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/cdf591cb7e5b47fe815fc67dec7d6701/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F12f7b1211d13400f973d3fd5a72436de%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/12f7b1211d13400f973d3fd5a72436de/images/large/9.jpg not downloaded yet
2026-03-26 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F12f7b1211d13400f973d3fd5a72436de%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/12f7b1211d13400f973d3fd5a72436de/images/large/10.jpg not downloaded yet
2026-03-26 22:49:24 [ayvens.be] INFO: Found listing with ID: 1985360
2026-03-26 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985360%27 HTTP/1.1" 200 None
2026-03-26 22:49:24 [ayvens.be] INFO: Scrape type for 1985360: 1
2026-03-26 22:49:24 [ayvens.be] INFO: Extracting data for car ID: 1985360
2026-03-26 22:49:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 76552fd3-b338-580f-b2a5-4128d2e47df3 with identifier: 1985360
2026-03-26 22:49:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76552fd3-b338-580f-b2a5-4128d2e47df3 with scrape type 1
2026-03-26 22:49:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 76552fd3-b338-580f-b2a5-4128d2e47df3
2026-03-26 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fa0473f3c80ca44afb7f9166e291890fc%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/a0473f3c80ca44afb7f9166e291890fc/images/large/1.jpg not downloaded yet
2026-03-26 22:49:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7caa610>
2026-03-26 22:49:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d509a2bd-3224-5aa1-a4e3-43f55bb7adc4/d509a2bd-3224-5aa1-a4e3-43f55bb7adc4_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252Fcdf591cb7e5b47fe815fc67dec7d6701%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/cdf591cb7e5b47fe815fc67dec7d6701/images/large/9.jpg saved to cache
2026-03-26 22:49:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d509a2bd-3224-5aa1-a4e3-43f55bb7adc4
2026-03-26 22:49:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79dd2d0>
2026-03-26 22:49:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d509a2bd-3224-5aa1-a4e3-43f55bb7adc4/d509a2bd-3224-5aa1-a4e3-43f55bb7adc4_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252Fcdf591cb7e5b47fe815fc67dec7d6701%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/cdf591cb7e5b47fe815fc67dec7d6701/images/large/10.jpg saved to cache
2026-03-26 22:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d509a2bd-3224-5aa1-a4e3-43f55bb7adc4
2026-03-26 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fa0473f3c80ca44afb7f9166e291890fc%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/a0473f3c80ca44afb7f9166e291890fc/images/large/2.jpg not downloaded yet
2026-03-26 22:49:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b781bb10>
2026-03-26 22:49:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_183a01eb-ba00-5b6a-8f49-a0247b53e1f1/183a01eb-ba00-5b6a-8f49-a0247b53e1f1_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F035aa93c963d41e5b04c615c548ea61d%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/035aa93c963d41e5b04c615c548ea61d/images/large/3.jpg saved to cache
2026-03-26 22:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 183a01eb-ba00-5b6a-8f49-a0247b53e1f1
2026-03-26 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fa0473f3c80ca44afb7f9166e291890fc%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/a0473f3c80ca44afb7f9166e291890fc/images/large/3.jpg not downloaded yet
2026-03-26 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fa0473f3c80ca44afb7f9166e291890fc%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/a0473f3c80ca44afb7f9166e291890fc/images/large/4.jpg not downloaded yet
2026-03-26 22:49:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76a6e10>
2026-03-26 22:49:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d509a2bd-3224-5aa1-a4e3-43f55bb7adc4/d509a2bd-3224-5aa1-a4e3-43f55bb7adc4_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252Fcdf591cb7e5b47fe815fc67dec7d6701%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/cdf591cb7e5b47fe815fc67dec7d6701/images/large/7.jpg saved to cache
2026-03-26 22:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d509a2bd-3224-5aa1-a4e3-43f55bb7adc4
2026-03-26 22:49:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79dc750>
2026-03-26 22:49:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_183a01eb-ba00-5b6a-8f49-a0247b53e1f1/183a01eb-ba00-5b6a-8f49-a0247b53e1f1_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F035aa93c963d41e5b04c615c548ea61d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/035aa93c963d41e5b04c615c548ea61d/images/large/1.jpg saved to cache
2026-03-26 22:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 183a01eb-ba00-5b6a-8f49-a0247b53e1f1
2026-03-26 22:49:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6d811d0>
2026-03-26 22:49:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_183a01eb-ba00-5b6a-8f49-a0247b53e1f1/183a01eb-ba00-5b6a-8f49-a0247b53e1f1_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F035aa93c963d41e5b04c615c548ea61d%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/035aa93c963d41e5b04c615c548ea61d/images/large/4.jpg saved to cache
2026-03-26 22:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 183a01eb-ba00-5b6a-8f49-a0247b53e1f1
2026-03-26 22:49:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74ce750>
2026-03-26 22:49:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_183a01eb-ba00-5b6a-8f49-a0247b53e1f1/183a01eb-ba00-5b6a-8f49-a0247b53e1f1_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F035aa93c963d41e5b04c615c548ea61d%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/035aa93c963d41e5b04c615c548ea61d/images/large/2.jpg saved to cache
2026-03-26 22:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 183a01eb-ba00-5b6a-8f49-a0247b53e1f1
2026-03-26 22:49:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7570a90>
2026-03-26 22:49:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d509a2bd-3224-5aa1-a4e3-43f55bb7adc4/d509a2bd-3224-5aa1-a4e3-43f55bb7adc4_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252Fcdf591cb7e5b47fe815fc67dec7d6701%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/cdf591cb7e5b47fe815fc67dec7d6701/images/large/8.jpg saved to cache
2026-03-26 22:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d509a2bd-3224-5aa1-a4e3-43f55bb7adc4
2026-03-26 22:49:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d509a2bd-3224-5aa1-a4e3-43f55bb7adc4, skipping ID generation
2026-03-26 22:49:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d509a2bd-3224-5aa1-a4e3-43f55bb7adc4 with scrape type 1
2026-03-26 22:49:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d509a2bd-3224-5aa1-a4e3-43f55bb7adc4 sending to next pipeline
2026-03-26 22:49:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d509a2bd-3224-5aa1-a4e3-43f55bb7adc4, identifier: 1985357
2026-03-26 22:49:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d509a2bd-3224-5aa1-a4e3-43f55bb7adc4 with identifier: 1985357
2026-03-26 22:49:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d509a2bd-3224-5aa1-a4e3-43f55bb7adc4 with identifier: 1985357
2026-03-26 22:49:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d509a2bd-3224-5aa1-a4e3-43f55bb7adc4 with identifier: 1985357 to the API
2026-03-26 22:49:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:49:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:49:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2da/cdf591cb7e5b47fe815fc67dec7d6701/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd509a2bd-3224-5aa1-a4e3-43f55bb7adc4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '3 SERIES TOURING',
 'odometer': 150951,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d509a2bd-3224-5aa1-a4e3-43f55bb7adc4/d509a2bd-3224-5aa1-a4e3-43f55bb7adc4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 712358,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/cdf591cb7e5b47fe815fc67dec7d6701/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d509a2bd-3224-5aa1-a4e3-43f55bb7adc4/d509a2bd-3224-5aa1-a4e3-43f55bb7adc4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 688048,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/cdf591cb7e5b47fe815fc67dec7d6701/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d509a2bd-3224-5aa1-a4e3-43f55bb7adc4/d509a2bd-3224-5aa1-a4e3-43f55bb7adc4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 676909,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/cdf591cb7e5b47fe815fc67dec7d6701/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d509a2bd-3224-5aa1-a4e3-43f55bb7adc4/d509a2bd-3224-5aa1-a4e3-43f55bb7adc4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 729263,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/cdf591cb7e5b47fe815fc67dec7d6701/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d509a2bd-3224-5aa1-a4e3-43f55bb7adc4/d509a2bd-3224-5aa1-a4e3-43f55bb7adc4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 643589,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/cdf591cb7e5b47fe815fc67dec7d6701/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d509a2bd-3224-5aa1-a4e3-43f55bb7adc4/d509a2bd-3224-5aa1-a4e3-43f55bb7adc4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 606527,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/cdf591cb7e5b47fe815fc67dec7d6701/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d509a2bd-3224-5aa1-a4e3-43f55bb7adc4/d509a2bd-3224-5aa1-a4e3-43f55bb7adc4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 679725,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/cdf591cb7e5b47fe815fc67dec7d6701/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d509a2bd-3224-5aa1-a4e3-43f55bb7adc4/d509a2bd-3224-5aa1-a4e3-43f55bb7adc4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 719039,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/cdf591cb7e5b47fe815fc67dec7d6701/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d509a2bd-3224-5aa1-a4e3-43f55bb7adc4/d509a2bd-3224-5aa1-a4e3-43f55bb7adc4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 507416,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/cdf591cb7e5b47fe815fc67dec7d6701/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d509a2bd-3224-5aa1-a4e3-43f55bb7adc4/d509a2bd-3224-5aa1-a4e3-43f55bb7adc4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 368696,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/cdf591cb7e5b47fe815fc67dec7d6701/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3 SERIES TOURING 2.0 318D (100KW) TOURING',
 'transmission': 'automatic',
 'trim': '2.0 318D (100KW) TOURING',
 'vin': None,
 'year': 2023}
2026-03-26 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985357%27 HTTP/1.1" 200 None
2026-03-26 22:49:26 [ayvens.be] INFO: Saving data for 1985357: {'created_time': 1774565366.031621, 'last_price_update_time': 1774565366.03163, 'auction_closing_time': 1774958400.0}
2026-03-26 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985357') HTTP/1.1" 204 0
2026-03-26 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fa0473f3c80ca44afb7f9166e291890fc%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/a0473f3c80ca44afb7f9166e291890fc/images/large/5.jpg not downloaded yet
2026-03-26 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fa0473f3c80ca44afb7f9166e291890fc%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/a0473f3c80ca44afb7f9166e291890fc/images/large/6.jpg not downloaded yet
2026-03-26 22:49:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/12f7b1211d13400f973d3fd5a72436de/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/12f7b1211d13400f973d3fd5a72436de/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/12f7b1211d13400f973d3fd5a72436de/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fa0473f3c80ca44afb7f9166e291890fc%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/a0473f3c80ca44afb7f9166e291890fc/images/large/7.jpg not downloaded yet
2026-03-26 22:49:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/035aa93c963d41e5b04c615c548ea61d/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/035aa93c963d41e5b04c615c548ea61d/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/035aa93c963d41e5b04c615c548ea61d/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fa0473f3c80ca44afb7f9166e291890fc%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/a0473f3c80ca44afb7f9166e291890fc/images/large/8.jpg not downloaded yet
2026-03-26 22:49:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/035aa93c963d41e5b04c615c548ea61d/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/035aa93c963d41e5b04c615c548ea61d/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fa0473f3c80ca44afb7f9166e291890fc%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/a0473f3c80ca44afb7f9166e291890fc/images/large/9.jpg not downloaded yet
2026-03-26 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fa0473f3c80ca44afb7f9166e291890fc%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/a0473f3c80ca44afb7f9166e291890fc/images/large/10.jpg not downloaded yet
2026-03-26 22:49:26 [ayvens.be] INFO: Found listing with ID: 1985361
2026-03-26 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985361%27 HTTP/1.1" 200 None
2026-03-26 22:49:26 [ayvens.be] INFO: Scrape type for 1985361: 1
2026-03-26 22:49:26 [ayvens.be] INFO: Extracting data for car ID: 1985361
2026-03-26 22:49:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aac99e38-7861-5476-8a42-9368ec6b38bb with identifier: 1985361
2026-03-26 22:49:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aac99e38-7861-5476-8a42-9368ec6b38bb with scrape type 1
2026-03-26 22:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item aac99e38-7861-5476-8a42-9368ec6b38bb
2026-03-26 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F4db8fc92ecf640539502d435f09d3920%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/4db8fc92ecf640539502d435f09d3920/images/large/1.jpg not downloaded yet
2026-03-26 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F4db8fc92ecf640539502d435f09d3920%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/4db8fc92ecf640539502d435f09d3920/images/large/2.jpg not downloaded yet
2026-03-26 22:49:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79a1890>
2026-03-26 22:49:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f5f974a-0766-52a4-afdb-ae60ea21c7a8/0f5f974a-0766-52a4-afdb-ae60ea21c7a8_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F12f7b1211d13400f973d3fd5a72436de%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/12f7b1211d13400f973d3fd5a72436de/images/large/3.jpg saved to cache
2026-03-26 22:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0f5f974a-0766-52a4-afdb-ae60ea21c7a8
2026-03-26 22:49:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd0c4f10>
2026-03-26 22:49:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f5f974a-0766-52a4-afdb-ae60ea21c7a8/0f5f974a-0766-52a4-afdb-ae60ea21c7a8_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F12f7b1211d13400f973d3fd5a72436de%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/12f7b1211d13400f973d3fd5a72436de/images/large/2.jpg saved to cache
2026-03-26 22:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0f5f974a-0766-52a4-afdb-ae60ea21c7a8
2026-03-26 22:49:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cbd690>
2026-03-26 22:49:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f5f974a-0766-52a4-afdb-ae60ea21c7a8/0f5f974a-0766-52a4-afdb-ae60ea21c7a8_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F12f7b1211d13400f973d3fd5a72436de%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/12f7b1211d13400f973d3fd5a72436de/images/large/1.jpg saved to cache
2026-03-26 22:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0f5f974a-0766-52a4-afdb-ae60ea21c7a8
2026-03-26 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F4db8fc92ecf640539502d435f09d3920%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/4db8fc92ecf640539502d435f09d3920/images/large/3.jpg not downloaded yet
2026-03-26 22:49:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7490ed0>
2026-03-26 22:49:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_183a01eb-ba00-5b6a-8f49-a0247b53e1f1/183a01eb-ba00-5b6a-8f49-a0247b53e1f1_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F035aa93c963d41e5b04c615c548ea61d%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/035aa93c963d41e5b04c615c548ea61d/images/large/5.jpg saved to cache
2026-03-26 22:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 183a01eb-ba00-5b6a-8f49-a0247b53e1f1
2026-03-26 22:49:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c77950>
2026-03-26 22:49:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_183a01eb-ba00-5b6a-8f49-a0247b53e1f1/183a01eb-ba00-5b6a-8f49-a0247b53e1f1_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F035aa93c963d41e5b04c615c548ea61d%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/035aa93c963d41e5b04c615c548ea61d/images/large/7.jpg saved to cache
2026-03-26 22:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 183a01eb-ba00-5b6a-8f49-a0247b53e1f1
2026-03-26 22:49:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e4eb90>
2026-03-26 22:49:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_183a01eb-ba00-5b6a-8f49-a0247b53e1f1/183a01eb-ba00-5b6a-8f49-a0247b53e1f1_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F035aa93c963d41e5b04c615c548ea61d%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/035aa93c963d41e5b04c615c548ea61d/images/large/6.jpg saved to cache
2026-03-26 22:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 183a01eb-ba00-5b6a-8f49-a0247b53e1f1
2026-03-26 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F4db8fc92ecf640539502d435f09d3920%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/4db8fc92ecf640539502d435f09d3920/images/large/4.jpg not downloaded yet
2026-03-26 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F4db8fc92ecf640539502d435f09d3920%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/4db8fc92ecf640539502d435f09d3920/images/large/5.jpg not downloaded yet
2026-03-26 22:49:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c75490>
2026-03-26 22:49:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_183a01eb-ba00-5b6a-8f49-a0247b53e1f1/183a01eb-ba00-5b6a-8f49-a0247b53e1f1_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F035aa93c963d41e5b04c615c548ea61d%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/035aa93c963d41e5b04c615c548ea61d/images/large/9.jpg saved to cache
2026-03-26 22:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 183a01eb-ba00-5b6a-8f49-a0247b53e1f1
2026-03-26 22:49:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c69b50>
2026-03-26 22:49:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_183a01eb-ba00-5b6a-8f49-a0247b53e1f1/183a01eb-ba00-5b6a-8f49-a0247b53e1f1_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F035aa93c963d41e5b04c615c548ea61d%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/035aa93c963d41e5b04c615c548ea61d/images/large/10.jpg saved to cache
2026-03-26 22:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 183a01eb-ba00-5b6a-8f49-a0247b53e1f1
2026-03-26 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F4db8fc92ecf640539502d435f09d3920%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/4db8fc92ecf640539502d435f09d3920/images/large/6.jpg not downloaded yet
2026-03-26 22:49:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/12f7b1211d13400f973d3fd5a72436de/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/12f7b1211d13400f973d3fd5a72436de/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F4db8fc92ecf640539502d435f09d3920%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/4db8fc92ecf640539502d435f09d3920/images/large/7.jpg not downloaded yet
2026-03-26 22:49:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/a0473f3c80ca44afb7f9166e291890fc/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/a0473f3c80ca44afb7f9166e291890fc/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/12f7b1211d13400f973d3fd5a72436de/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/12f7b1211d13400f973d3fd5a72436de/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F4db8fc92ecf640539502d435f09d3920%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/4db8fc92ecf640539502d435f09d3920/images/large/8.jpg not downloaded yet
2026-03-26 22:49:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/12f7b1211d13400f973d3fd5a72436de/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F4db8fc92ecf640539502d435f09d3920%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/4db8fc92ecf640539502d435f09d3920/images/large/9.jpg not downloaded yet
2026-03-26 22:49:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/035aa93c963d41e5b04c615c548ea61d/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F4db8fc92ecf640539502d435f09d3920%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/4db8fc92ecf640539502d435f09d3920/images/large/10.jpg not downloaded yet
2026-03-26 22:49:27 [ayvens.be] INFO: Found listing with ID: 1985362
2026-03-26 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985362%27 HTTP/1.1" 200 None
2026-03-26 22:49:27 [ayvens.be] INFO: Scrape type for 1985362: 1
2026-03-26 22:49:27 [ayvens.be] INFO: Extracting data for car ID: 1985362
2026-03-26 22:49:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0360f333-f9a9-58e4-b8ab-91c3bc796021 with identifier: 1985362
2026-03-26 22:49:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0360f333-f9a9-58e4-b8ab-91c3bc796021 with scrape type 1
2026-03-26 22:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0360f333-f9a9-58e4-b8ab-91c3bc796021
2026-03-26 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dq%252F5b972144fc264097a9d702323e151826%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dq/5b972144fc264097a9d702323e151826/images/large/1.jpg not downloaded yet
2026-03-26 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dq%252F5b972144fc264097a9d702323e151826%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dq/5b972144fc264097a9d702323e151826/images/large/2.jpg not downloaded yet
2026-03-26 22:49:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b729ca90>
2026-03-26 22:49:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f5f974a-0766-52a4-afdb-ae60ea21c7a8/0f5f974a-0766-52a4-afdb-ae60ea21c7a8_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F12f7b1211d13400f973d3fd5a72436de%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/12f7b1211d13400f973d3fd5a72436de/images/large/4.jpg saved to cache
2026-03-26 22:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0f5f974a-0766-52a4-afdb-ae60ea21c7a8
2026-03-26 22:49:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7aa3410>
2026-03-26 22:49:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f5f974a-0766-52a4-afdb-ae60ea21c7a8/0f5f974a-0766-52a4-afdb-ae60ea21c7a8_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F12f7b1211d13400f973d3fd5a72436de%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/12f7b1211d13400f973d3fd5a72436de/images/large/5.jpg saved to cache
2026-03-26 22:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0f5f974a-0766-52a4-afdb-ae60ea21c7a8
2026-03-26 22:49:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b742a050>
2026-03-26 22:49:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76552fd3-b338-580f-b2a5-4128d2e47df3/76552fd3-b338-580f-b2a5-4128d2e47df3_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fa0473f3c80ca44afb7f9166e291890fc%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/a0473f3c80ca44afb7f9166e291890fc/images/large/1.jpg saved to cache
2026-03-26 22:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 76552fd3-b338-580f-b2a5-4128d2e47df3
2026-03-26 22:49:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7cce5d0>
2026-03-26 22:49:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76552fd3-b338-580f-b2a5-4128d2e47df3/76552fd3-b338-580f-b2a5-4128d2e47df3_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fa0473f3c80ca44afb7f9166e291890fc%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/a0473f3c80ca44afb7f9166e291890fc/images/large/2.jpg saved to cache
2026-03-26 22:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 76552fd3-b338-580f-b2a5-4128d2e47df3
2026-03-26 22:49:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7407390>
2026-03-26 22:49:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f5f974a-0766-52a4-afdb-ae60ea21c7a8/0f5f974a-0766-52a4-afdb-ae60ea21c7a8_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F12f7b1211d13400f973d3fd5a72436de%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/12f7b1211d13400f973d3fd5a72436de/images/large/6.jpg saved to cache
2026-03-26 22:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0f5f974a-0766-52a4-afdb-ae60ea21c7a8
2026-03-26 22:49:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cc1890>
2026-03-26 22:49:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f5f974a-0766-52a4-afdb-ae60ea21c7a8/0f5f974a-0766-52a4-afdb-ae60ea21c7a8_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F12f7b1211d13400f973d3fd5a72436de%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/12f7b1211d13400f973d3fd5a72436de/images/large/7.jpg saved to cache
2026-03-26 22:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0f5f974a-0766-52a4-afdb-ae60ea21c7a8
2026-03-26 22:49:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b776bfd0>
2026-03-26 22:49:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f5f974a-0766-52a4-afdb-ae60ea21c7a8/0f5f974a-0766-52a4-afdb-ae60ea21c7a8_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F12f7b1211d13400f973d3fd5a72436de%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/12f7b1211d13400f973d3fd5a72436de/images/large/10.jpg saved to cache
2026-03-26 22:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0f5f974a-0766-52a4-afdb-ae60ea21c7a8
2026-03-26 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dq%252F5b972144fc264097a9d702323e151826%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dq/5b972144fc264097a9d702323e151826/images/large/3.jpg not downloaded yet
2026-03-26 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dq%252F5b972144fc264097a9d702323e151826%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dq/5b972144fc264097a9d702323e151826/images/large/4.jpg not downloaded yet
2026-03-26 22:49:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b78c3690>
2026-03-26 22:49:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_183a01eb-ba00-5b6a-8f49-a0247b53e1f1/183a01eb-ba00-5b6a-8f49-a0247b53e1f1_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F035aa93c963d41e5b04c615c548ea61d%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/035aa93c963d41e5b04c615c548ea61d/images/large/8.jpg saved to cache
2026-03-26 22:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 183a01eb-ba00-5b6a-8f49-a0247b53e1f1
2026-03-26 22:49:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 183a01eb-ba00-5b6a-8f49-a0247b53e1f1, skipping ID generation
2026-03-26 22:49:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 183a01eb-ba00-5b6a-8f49-a0247b53e1f1 with scrape type 1
2026-03-26 22:49:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 183a01eb-ba00-5b6a-8f49-a0247b53e1f1 sending to next pipeline
2026-03-26 22:49:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 183a01eb-ba00-5b6a-8f49-a0247b53e1f1, identifier: 1985358
2026-03-26 22:49:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 183a01eb-ba00-5b6a-8f49-a0247b53e1f1 with identifier: 1985358
2026-03-26 22:49:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 183a01eb-ba00-5b6a-8f49-a0247b53e1f1 with identifier: 1985358
2026-03-26 22:49:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 183a01eb-ba00-5b6a-8f49-a0247b53e1f1 with identifier: 1985358 to the API
2026-03-26 22:49:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:49:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:49:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ce/035aa93c963d41e5b04c615c548ea61d/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '183a01eb-ba00-5b6a-8f49-a0247b53e1f1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'XCEED',
 'odometer': 76834,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_183a01eb-ba00-5b6a-8f49-a0247b53e1f1/183a01eb-ba00-5b6a-8f49-a0247b53e1f1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 672703,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/035aa93c963d41e5b04c615c548ea61d/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_183a01eb-ba00-5b6a-8f49-a0247b53e1f1/183a01eb-ba00-5b6a-8f49-a0247b53e1f1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 677129,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/035aa93c963d41e5b04c615c548ea61d/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_183a01eb-ba00-5b6a-8f49-a0247b53e1f1/183a01eb-ba00-5b6a-8f49-a0247b53e1f1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 690952,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/035aa93c963d41e5b04c615c548ea61d/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_183a01eb-ba00-5b6a-8f49-a0247b53e1f1/183a01eb-ba00-5b6a-8f49-a0247b53e1f1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 732226,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/035aa93c963d41e5b04c615c548ea61d/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_183a01eb-ba00-5b6a-8f49-a0247b53e1f1/183a01eb-ba00-5b6a-8f49-a0247b53e1f1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 672186,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/035aa93c963d41e5b04c615c548ea61d/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_183a01eb-ba00-5b6a-8f49-a0247b53e1f1/183a01eb-ba00-5b6a-8f49-a0247b53e1f1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 709180,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/035aa93c963d41e5b04c615c548ea61d/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_183a01eb-ba00-5b6a-8f49-a0247b53e1f1/183a01eb-ba00-5b6a-8f49-a0247b53e1f1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 656028,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/035aa93c963d41e5b04c615c548ea61d/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_183a01eb-ba00-5b6a-8f49-a0247b53e1f1/183a01eb-ba00-5b6a-8f49-a0247b53e1f1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 886726,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/035aa93c963d41e5b04c615c548ea61d/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_183a01eb-ba00-5b6a-8f49-a0247b53e1f1/183a01eb-ba00-5b6a-8f49-a0247b53e1f1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 831212,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/035aa93c963d41e5b04c615c548ea61d/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_183a01eb-ba00-5b6a-8f49-a0247b53e1f1/183a01eb-ba00-5b6a-8f49-a0247b53e1f1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 799145,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/035aa93c963d41e5b04c615c548ea61d/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA XCEED 1.6 GDI PHEV DCT BUSINESS LINE',
 'transmission': 'automatic',
 'trim': '1.6 GDI PHEV DCT BUSINESS LINE',
 'vin': None,
 'year': 2022}
2026-03-26 22:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985358%27 HTTP/1.1" 200 None
2026-03-26 22:49:28 [ayvens.be] INFO: Saving data for 1985358: {'created_time': 1774565368.755878, 'last_price_update_time': 1774565368.755887, 'auction_closing_time': 1774958400.0}
2026-03-26 22:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985358') HTTP/1.1" 204 0
2026-03-26 22:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dq%252F5b972144fc264097a9d702323e151826%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dq/5b972144fc264097a9d702323e151826/images/large/5.jpg not downloaded yet
2026-03-26 22:49:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/a0473f3c80ca44afb7f9166e291890fc/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dq%252F5b972144fc264097a9d702323e151826%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dq/5b972144fc264097a9d702323e151826/images/large/6.jpg not downloaded yet
2026-03-26 22:49:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/a0473f3c80ca44afb7f9166e291890fc/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/a0473f3c80ca44afb7f9166e291890fc/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dq%252F5b972144fc264097a9d702323e151826%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dq/5b972144fc264097a9d702323e151826/images/large/7.jpg not downloaded yet
2026-03-26 22:49:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/12f7b1211d13400f973d3fd5a72436de/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/a0473f3c80ca44afb7f9166e291890fc/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/4db8fc92ecf640539502d435f09d3920/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/12f7b1211d13400f973d3fd5a72436de/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/4db8fc92ecf640539502d435f09d3920/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dq%252F5b972144fc264097a9d702323e151826%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dq/5b972144fc264097a9d702323e151826/images/large/8.jpg not downloaded yet
2026-03-26 22:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dq%252F5b972144fc264097a9d702323e151826%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dq/5b972144fc264097a9d702323e151826/images/large/9.jpg not downloaded yet
2026-03-26 22:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dq%252F5b972144fc264097a9d702323e151826%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dq/5b972144fc264097a9d702323e151826/images/large/10.jpg not downloaded yet
2026-03-26 22:49:28 [ayvens.be] INFO: Found listing with ID: 1985363
2026-03-26 22:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985363%27 HTTP/1.1" 200 None
2026-03-26 22:49:28 [ayvens.be] INFO: Scrape type for 1985363: 1
2026-03-26 22:49:28 [ayvens.be] INFO: Extracting data for car ID: 1985363
2026-03-26 22:49:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d550fb4-a647-5a1b-8837-81f98eace162 with identifier: 1985363
2026-03-26 22:49:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d550fb4-a647-5a1b-8837-81f98eace162 with scrape type 1
2026-03-26 22:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5d550fb4-a647-5a1b-8837-81f98eace162
2026-03-26 22:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cj%252F9e0ef4bd9e054b08a5af1916c643082f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cj/9e0ef4bd9e054b08a5af1916c643082f/images/large/1.jpg not downloaded yet
2026-03-26 22:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cj%252F9e0ef4bd9e054b08a5af1916c643082f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cj/9e0ef4bd9e054b08a5af1916c643082f/images/large/2.jpg not downloaded yet
2026-03-26 22:49:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7290dd0>
2026-03-26 22:49:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76552fd3-b338-580f-b2a5-4128d2e47df3/76552fd3-b338-580f-b2a5-4128d2e47df3_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fa0473f3c80ca44afb7f9166e291890fc%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/a0473f3c80ca44afb7f9166e291890fc/images/large/3.jpg saved to cache
2026-03-26 22:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 76552fd3-b338-580f-b2a5-4128d2e47df3
2026-03-26 22:49:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77c9e10>
2026-03-26 22:49:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76552fd3-b338-580f-b2a5-4128d2e47df3/76552fd3-b338-580f-b2a5-4128d2e47df3_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fa0473f3c80ca44afb7f9166e291890fc%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/a0473f3c80ca44afb7f9166e291890fc/images/large/4.jpg saved to cache
2026-03-26 22:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 76552fd3-b338-580f-b2a5-4128d2e47df3
2026-03-26 22:49:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e17cd0>
2026-03-26 22:49:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76552fd3-b338-580f-b2a5-4128d2e47df3/76552fd3-b338-580f-b2a5-4128d2e47df3_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fa0473f3c80ca44afb7f9166e291890fc%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/a0473f3c80ca44afb7f9166e291890fc/images/large/5.jpg saved to cache
2026-03-26 22:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 76552fd3-b338-580f-b2a5-4128d2e47df3
2026-03-26 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cj%252F9e0ef4bd9e054b08a5af1916c643082f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cj/9e0ef4bd9e054b08a5af1916c643082f/images/large/3.jpg not downloaded yet
2026-03-26 22:49:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7426710>
2026-03-26 22:49:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f5f974a-0766-52a4-afdb-ae60ea21c7a8/0f5f974a-0766-52a4-afdb-ae60ea21c7a8_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F12f7b1211d13400f973d3fd5a72436de%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/12f7b1211d13400f973d3fd5a72436de/images/large/9.jpg saved to cache
2026-03-26 22:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0f5f974a-0766-52a4-afdb-ae60ea21c7a8
2026-03-26 22:49:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b741de90>
2026-03-26 22:49:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76552fd3-b338-580f-b2a5-4128d2e47df3/76552fd3-b338-580f-b2a5-4128d2e47df3_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fa0473f3c80ca44afb7f9166e291890fc%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/a0473f3c80ca44afb7f9166e291890fc/images/large/6.jpg saved to cache
2026-03-26 22:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 76552fd3-b338-580f-b2a5-4128d2e47df3
2026-03-26 22:49:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76e37d0>
2026-03-26 22:49:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aac99e38-7861-5476-8a42-9368ec6b38bb/aac99e38-7861-5476-8a42-9368ec6b38bb_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F4db8fc92ecf640539502d435f09d3920%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/4db8fc92ecf640539502d435f09d3920/images/large/2.jpg saved to cache
2026-03-26 22:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item aac99e38-7861-5476-8a42-9368ec6b38bb
2026-03-26 22:49:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7402750>
2026-03-26 22:49:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f5f974a-0766-52a4-afdb-ae60ea21c7a8/0f5f974a-0766-52a4-afdb-ae60ea21c7a8_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F12f7b1211d13400f973d3fd5a72436de%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/12f7b1211d13400f973d3fd5a72436de/images/large/8.jpg saved to cache
2026-03-26 22:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0f5f974a-0766-52a4-afdb-ae60ea21c7a8
2026-03-26 22:49:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0f5f974a-0766-52a4-afdb-ae60ea21c7a8, skipping ID generation
2026-03-26 22:49:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f5f974a-0766-52a4-afdb-ae60ea21c7a8 with scrape type 1
2026-03-26 22:49:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0f5f974a-0766-52a4-afdb-ae60ea21c7a8 sending to next pipeline
2026-03-26 22:49:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 0f5f974a-0766-52a4-afdb-ae60ea21c7a8, identifier: 1985359
2026-03-26 22:49:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd3d6c50>
2026-03-26 22:49:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aac99e38-7861-5476-8a42-9368ec6b38bb/aac99e38-7861-5476-8a42-9368ec6b38bb_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F4db8fc92ecf640539502d435f09d3920%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/4db8fc92ecf640539502d435f09d3920/images/large/3.jpg saved to cache
2026-03-26 22:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item aac99e38-7861-5476-8a42-9368ec6b38bb
2026-03-26 22:49:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dq/5b972144fc264097a9d702323e151826/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cj%252F9e0ef4bd9e054b08a5af1916c643082f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cj/9e0ef4bd9e054b08a5af1916c643082f/images/large/4.jpg not downloaded yet
2026-03-26 22:49:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 0f5f974a-0766-52a4-afdb-ae60ea21c7a8 with identifier: 1985359
2026-03-26 22:49:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 0f5f974a-0766-52a4-afdb-ae60ea21c7a8 with identifier: 1985359
2026-03-26 22:49:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 0f5f974a-0766-52a4-afdb-ae60ea21c7a8 with identifier: 1985359 to the API
2026-03-26 22:49:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:49:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:49:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cp/12f7b1211d13400f973d3fd5a72436de/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '0f5f974a-0766-52a4-afdb-ae60ea21c7a8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'CUPRA',
 'model': 'LEON ST',
 'odometer': 97512,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f5f974a-0766-52a4-afdb-ae60ea21c7a8/0f5f974a-0766-52a4-afdb-ae60ea21c7a8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 700698,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/12f7b1211d13400f973d3fd5a72436de/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f5f974a-0766-52a4-afdb-ae60ea21c7a8/0f5f974a-0766-52a4-afdb-ae60ea21c7a8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 713734,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/12f7b1211d13400f973d3fd5a72436de/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f5f974a-0766-52a4-afdb-ae60ea21c7a8/0f5f974a-0766-52a4-afdb-ae60ea21c7a8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 676977,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/12f7b1211d13400f973d3fd5a72436de/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f5f974a-0766-52a4-afdb-ae60ea21c7a8/0f5f974a-0766-52a4-afdb-ae60ea21c7a8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 693485,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/12f7b1211d13400f973d3fd5a72436de/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f5f974a-0766-52a4-afdb-ae60ea21c7a8/0f5f974a-0766-52a4-afdb-ae60ea21c7a8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 669310,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/12f7b1211d13400f973d3fd5a72436de/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f5f974a-0766-52a4-afdb-ae60ea21c7a8/0f5f974a-0766-52a4-afdb-ae60ea21c7a8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 791809,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/12f7b1211d13400f973d3fd5a72436de/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f5f974a-0766-52a4-afdb-ae60ea21c7a8/0f5f974a-0766-52a4-afdb-ae60ea21c7a8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 647885,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/12f7b1211d13400f973d3fd5a72436de/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f5f974a-0766-52a4-afdb-ae60ea21c7a8/0f5f974a-0766-52a4-afdb-ae60ea21c7a8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 803311,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/12f7b1211d13400f973d3fd5a72436de/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f5f974a-0766-52a4-afdb-ae60ea21c7a8/0f5f974a-0766-52a4-afdb-ae60ea21c7a8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 736052,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/12f7b1211d13400f973d3fd5a72436de/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f5f974a-0766-52a4-afdb-ae60ea21c7a8/0f5f974a-0766-52a4-afdb-ae60ea21c7a8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 778701,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/12f7b1211d13400f973d3fd5a72436de/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CUPRA LEON ST 1.4 PHEV E-HYBRID 150KW DSG SP',
 'transmission': 'automatic',
 'trim': '1.4 PHEV E-HYBRID 150KW DSG SP',
 'vin': None,
 'year': 2022}
2026-03-26 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985359%27 HTTP/1.1" 200 None
2026-03-26 22:49:30 [ayvens.be] INFO: Saving data for 1985359: {'created_time': 1774565370.180377, 'last_price_update_time': 1774565370.180387, 'auction_closing_time': 1774958400.0}
2026-03-26 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985359') HTTP/1.1" 204 0
2026-03-26 22:49:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dq/5b972144fc264097a9d702323e151826/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dq/5b972144fc264097a9d702323e151826/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cj%252F9e0ef4bd9e054b08a5af1916c643082f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cj/9e0ef4bd9e054b08a5af1916c643082f/images/large/5.jpg not downloaded yet
2026-03-26 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cj%252F9e0ef4bd9e054b08a5af1916c643082f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cj/9e0ef4bd9e054b08a5af1916c643082f/images/large/6.jpg not downloaded yet
2026-03-26 22:49:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79a6cd0>
2026-03-26 22:49:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0360f333-f9a9-58e4-b8ab-91c3bc796021/0360f333-f9a9-58e4-b8ab-91c3bc796021_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dq%252F5b972144fc264097a9d702323e151826%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dq/5b972144fc264097a9d702323e151826/images/large/1.jpg saved to cache
2026-03-26 22:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0360f333-f9a9-58e4-b8ab-91c3bc796021
2026-03-26 22:49:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/4db8fc92ecf640539502d435f09d3920/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/4db8fc92ecf640539502d435f09d3920/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cj%252F9e0ef4bd9e054b08a5af1916c643082f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cj/9e0ef4bd9e054b08a5af1916c643082f/images/large/7.jpg not downloaded yet
2026-03-26 22:49:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/4db8fc92ecf640539502d435f09d3920/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/4db8fc92ecf640539502d435f09d3920/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cj%252F9e0ef4bd9e054b08a5af1916c643082f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cj/9e0ef4bd9e054b08a5af1916c643082f/images/large/8.jpg not downloaded yet
2026-03-26 22:49:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/4db8fc92ecf640539502d435f09d3920/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dq/5b972144fc264097a9d702323e151826/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cj%252F9e0ef4bd9e054b08a5af1916c643082f%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cj/9e0ef4bd9e054b08a5af1916c643082f/images/large/9.jpg not downloaded yet
2026-03-26 22:49:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79a5e90>
2026-03-26 22:49:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0360f333-f9a9-58e4-b8ab-91c3bc796021/0360f333-f9a9-58e4-b8ab-91c3bc796021_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dq%252F5b972144fc264097a9d702323e151826%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dq/5b972144fc264097a9d702323e151826/images/large/2.jpg saved to cache
2026-03-26 22:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0360f333-f9a9-58e4-b8ab-91c3bc796021
2026-03-26 22:49:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd0c4890>
2026-03-26 22:49:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0360f333-f9a9-58e4-b8ab-91c3bc796021/0360f333-f9a9-58e4-b8ab-91c3bc796021_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dq%252F5b972144fc264097a9d702323e151826%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dq/5b972144fc264097a9d702323e151826/images/large/3.jpg saved to cache
2026-03-26 22:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0360f333-f9a9-58e4-b8ab-91c3bc796021
2026-03-26 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cj%252F9e0ef4bd9e054b08a5af1916c643082f%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cj/9e0ef4bd9e054b08a5af1916c643082f/images/large/10.jpg not downloaded yet
2026-03-26 22:49:30 [ayvens.be] INFO: Found listing with ID: 1985364
2026-03-26 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985364%27 HTTP/1.1" 200 None
2026-03-26 22:49:30 [ayvens.be] INFO: Scrape type for 1985364: 1
2026-03-26 22:49:30 [ayvens.be] INFO: Extracting data for car ID: 1985364
2026-03-26 22:49:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 572fb211-c34a-540b-b492-e638d580713e with identifier: 1985364
2026-03-26 22:49:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 572fb211-c34a-540b-b492-e638d580713e with scrape type 1
2026-03-26 22:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 572fb211-c34a-540b-b492-e638d580713e
2026-03-26 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fe82efa31474242da96748466170068ba%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/e82efa31474242da96748466170068ba/images/large/1.jpg not downloaded yet
2026-03-26 22:49:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6df2590>
2026-03-26 22:49:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aac99e38-7861-5476-8a42-9368ec6b38bb/aac99e38-7861-5476-8a42-9368ec6b38bb_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F4db8fc92ecf640539502d435f09d3920%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/4db8fc92ecf640539502d435f09d3920/images/large/6.jpg saved to cache
2026-03-26 22:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item aac99e38-7861-5476-8a42-9368ec6b38bb
2026-03-26 22:49:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7268f10>
2026-03-26 22:49:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aac99e38-7861-5476-8a42-9368ec6b38bb/aac99e38-7861-5476-8a42-9368ec6b38bb_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F4db8fc92ecf640539502d435f09d3920%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/4db8fc92ecf640539502d435f09d3920/images/large/4.jpg saved to cache
2026-03-26 22:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item aac99e38-7861-5476-8a42-9368ec6b38bb
2026-03-26 22:49:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77cb190>
2026-03-26 22:49:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aac99e38-7861-5476-8a42-9368ec6b38bb/aac99e38-7861-5476-8a42-9368ec6b38bb_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F4db8fc92ecf640539502d435f09d3920%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/4db8fc92ecf640539502d435f09d3920/images/large/5.jpg saved to cache
2026-03-26 22:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item aac99e38-7861-5476-8a42-9368ec6b38bb
2026-03-26 22:49:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7268dd0>
2026-03-26 22:49:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aac99e38-7861-5476-8a42-9368ec6b38bb/aac99e38-7861-5476-8a42-9368ec6b38bb_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F4db8fc92ecf640539502d435f09d3920%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/4db8fc92ecf640539502d435f09d3920/images/large/1.jpg saved to cache
2026-03-26 22:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item aac99e38-7861-5476-8a42-9368ec6b38bb
2026-03-26 22:49:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7770f90>
2026-03-26 22:49:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aac99e38-7861-5476-8a42-9368ec6b38bb/aac99e38-7861-5476-8a42-9368ec6b38bb_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F4db8fc92ecf640539502d435f09d3920%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/4db8fc92ecf640539502d435f09d3920/images/large/10.jpg saved to cache
2026-03-26 22:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item aac99e38-7861-5476-8a42-9368ec6b38bb
2026-03-26 22:49:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b726b090>
2026-03-26 22:49:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0360f333-f9a9-58e4-b8ab-91c3bc796021/0360f333-f9a9-58e4-b8ab-91c3bc796021_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dq%252F5b972144fc264097a9d702323e151826%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dq/5b972144fc264097a9d702323e151826/images/large/5.jpg saved to cache
2026-03-26 22:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0360f333-f9a9-58e4-b8ab-91c3bc796021
2026-03-26 22:49:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dq/5b972144fc264097a9d702323e151826/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dq/5b972144fc264097a9d702323e151826/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fe82efa31474242da96748466170068ba%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/e82efa31474242da96748466170068ba/images/large/2.jpg not downloaded yet
2026-03-26 22:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fe82efa31474242da96748466170068ba%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/e82efa31474242da96748466170068ba/images/large/3.jpg not downloaded yet
2026-03-26 22:49:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dq/5b972144fc264097a9d702323e151826/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fe82efa31474242da96748466170068ba%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/e82efa31474242da96748466170068ba/images/large/4.jpg not downloaded yet
2026-03-26 22:49:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dq/5b972144fc264097a9d702323e151826/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cj/9e0ef4bd9e054b08a5af1916c643082f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cj/9e0ef4bd9e054b08a5af1916c643082f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cj/9e0ef4bd9e054b08a5af1916c643082f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fe82efa31474242da96748466170068ba%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/e82efa31474242da96748466170068ba/images/large/5.jpg not downloaded yet
2026-03-26 22:49:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/4db8fc92ecf640539502d435f09d3920/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fe82efa31474242da96748466170068ba%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/e82efa31474242da96748466170068ba/images/large/6.jpg not downloaded yet
2026-03-26 22:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fe82efa31474242da96748466170068ba%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/e82efa31474242da96748466170068ba/images/large/7.jpg not downloaded yet
2026-03-26 22:49:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dq/5b972144fc264097a9d702323e151826/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7caa010>
2026-03-26 22:49:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0360f333-f9a9-58e4-b8ab-91c3bc796021/0360f333-f9a9-58e4-b8ab-91c3bc796021_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dq%252F5b972144fc264097a9d702323e151826%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dq/5b972144fc264097a9d702323e151826/images/large/4.jpg saved to cache
2026-03-26 22:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0360f333-f9a9-58e4-b8ab-91c3bc796021
2026-03-26 22:49:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7458090>
2026-03-26 22:49:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0360f333-f9a9-58e4-b8ab-91c3bc796021/0360f333-f9a9-58e4-b8ab-91c3bc796021_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dq%252F5b972144fc264097a9d702323e151826%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dq/5b972144fc264097a9d702323e151826/images/large/10.jpg saved to cache
2026-03-26 22:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0360f333-f9a9-58e4-b8ab-91c3bc796021
2026-03-26 22:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fe82efa31474242da96748466170068ba%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/e82efa31474242da96748466170068ba/images/large/8.jpg not downloaded yet
2026-03-26 22:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fe82efa31474242da96748466170068ba%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/e82efa31474242da96748466170068ba/images/large/9.jpg not downloaded yet
2026-03-26 22:49:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dq/5b972144fc264097a9d702323e151826/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fe82efa31474242da96748466170068ba%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/e82efa31474242da96748466170068ba/images/large/10.jpg not downloaded yet
2026-03-26 22:49:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77e8350>
2026-03-26 22:49:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0360f333-f9a9-58e4-b8ab-91c3bc796021/0360f333-f9a9-58e4-b8ab-91c3bc796021_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dq%252F5b972144fc264097a9d702323e151826%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dq/5b972144fc264097a9d702323e151826/images/large/9.jpg saved to cache
2026-03-26 22:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0360f333-f9a9-58e4-b8ab-91c3bc796021
2026-03-26 22:49:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77ea050>
2026-03-26 22:49:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0360f333-f9a9-58e4-b8ab-91c3bc796021/0360f333-f9a9-58e4-b8ab-91c3bc796021_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dq%252F5b972144fc264097a9d702323e151826%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dq/5b972144fc264097a9d702323e151826/images/large/8.jpg saved to cache
2026-03-26 22:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0360f333-f9a9-58e4-b8ab-91c3bc796021
2026-03-26 22:49:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e37250>
2026-03-26 22:49:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d550fb4-a647-5a1b-8837-81f98eace162/5d550fb4-a647-5a1b-8837-81f98eace162_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cj%252F9e0ef4bd9e054b08a5af1916c643082f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cj/9e0ef4bd9e054b08a5af1916c643082f/images/large/1.jpg saved to cache
2026-03-26 22:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5d550fb4-a647-5a1b-8837-81f98eace162
2026-03-26 22:49:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7913710>
2026-03-26 22:49:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d550fb4-a647-5a1b-8837-81f98eace162/5d550fb4-a647-5a1b-8837-81f98eace162_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cj%252F9e0ef4bd9e054b08a5af1916c643082f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cj/9e0ef4bd9e054b08a5af1916c643082f/images/large/2.jpg saved to cache
2026-03-26 22:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5d550fb4-a647-5a1b-8837-81f98eace162
2026-03-26 22:49:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80be057b10>
2026-03-26 22:49:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d550fb4-a647-5a1b-8837-81f98eace162/5d550fb4-a647-5a1b-8837-81f98eace162_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cj%252F9e0ef4bd9e054b08a5af1916c643082f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cj/9e0ef4bd9e054b08a5af1916c643082f/images/large/3.jpg saved to cache
2026-03-26 22:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5d550fb4-a647-5a1b-8837-81f98eace162
2026-03-26 22:49:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e16850>
2026-03-26 22:49:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aac99e38-7861-5476-8a42-9368ec6b38bb/aac99e38-7861-5476-8a42-9368ec6b38bb_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F4db8fc92ecf640539502d435f09d3920%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/4db8fc92ecf640539502d435f09d3920/images/large/9.jpg saved to cache
2026-03-26 22:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item aac99e38-7861-5476-8a42-9368ec6b38bb
2026-03-26 22:49:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b776ba10>
2026-03-26 22:49:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0360f333-f9a9-58e4-b8ab-91c3bc796021/0360f333-f9a9-58e4-b8ab-91c3bc796021_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dq%252F5b972144fc264097a9d702323e151826%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dq/5b972144fc264097a9d702323e151826/images/large/7.jpg saved to cache
2026-03-26 22:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0360f333-f9a9-58e4-b8ab-91c3bc796021
2026-03-26 22:49:31 [ayvens.be] INFO: Found listing with ID: 1985365
2026-03-26 22:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985365%27 HTTP/1.1" 200 None
2026-03-26 22:49:32 [ayvens.be] INFO: Scrape type for 1985365: 1
2026-03-26 22:49:32 [ayvens.be] INFO: Extracting data for car ID: 1985365
2026-03-26 22:49:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f18e9342-4f12-553c-b02c-5645e403a20a with identifier: 1985365
2026-03-26 22:49:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f18e9342-4f12-553c-b02c-5645e403a20a with scrape type 1
2026-03-26 22:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f18e9342-4f12-553c-b02c-5645e403a20a
2026-03-26 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dw%252F5c52afb6c58a4671aa6fffda8ecaabb7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dw/5c52afb6c58a4671aa6fffda8ecaabb7/images/large/1.jpg not downloaded yet
2026-03-26 22:49:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cj/9e0ef4bd9e054b08a5af1916c643082f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dw%252F5c52afb6c58a4671aa6fffda8ecaabb7%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dw/5c52afb6c58a4671aa6fffda8ecaabb7/images/large/2.jpg not downloaded yet
2026-03-26 22:49:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cj/9e0ef4bd9e054b08a5af1916c643082f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/e82efa31474242da96748466170068ba/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7aeabd0>
2026-03-26 22:49:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0360f333-f9a9-58e4-b8ab-91c3bc796021/0360f333-f9a9-58e4-b8ab-91c3bc796021_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dq%252F5b972144fc264097a9d702323e151826%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dq/5b972144fc264097a9d702323e151826/images/large/6.jpg saved to cache
2026-03-26 22:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0360f333-f9a9-58e4-b8ab-91c3bc796021
2026-03-26 22:49:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0360f333-f9a9-58e4-b8ab-91c3bc796021, skipping ID generation
2026-03-26 22:49:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0360f333-f9a9-58e4-b8ab-91c3bc796021 with scrape type 1
2026-03-26 22:49:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0360f333-f9a9-58e4-b8ab-91c3bc796021 sending to next pipeline
2026-03-26 22:49:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 0360f333-f9a9-58e4-b8ab-91c3bc796021, identifier: 1985362
2026-03-26 22:49:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cj/9e0ef4bd9e054b08a5af1916c643082f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dw%252F5c52afb6c58a4671aa6fffda8ecaabb7%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dw/5c52afb6c58a4671aa6fffda8ecaabb7/images/large/3.jpg not downloaded yet
2026-03-26 22:49:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 0360f333-f9a9-58e4-b8ab-91c3bc796021 with identifier: 1985362
2026-03-26 22:49:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 0360f333-f9a9-58e4-b8ab-91c3bc796021 with identifier: 1985362
2026-03-26 22:49:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 0360f333-f9a9-58e4-b8ab-91c3bc796021 with identifier: 1985362 to the API
2026-03-26 22:49:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:49:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:49:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2dq/5b972144fc264097a9d702323e151826/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '0360f333-f9a9-58e4-b8ab-91c3bc796021',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '2 SERIES GRAN COUPAu2030',
 'odometer': 77791,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0360f333-f9a9-58e4-b8ab-91c3bc796021/0360f333-f9a9-58e4-b8ab-91c3bc796021_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 285943,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dq/5b972144fc264097a9d702323e151826/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0360f333-f9a9-58e4-b8ab-91c3bc796021/0360f333-f9a9-58e4-b8ab-91c3bc796021_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 289361,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dq/5b972144fc264097a9d702323e151826/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0360f333-f9a9-58e4-b8ab-91c3bc796021/0360f333-f9a9-58e4-b8ab-91c3bc796021_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 301006,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dq/5b972144fc264097a9d702323e151826/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0360f333-f9a9-58e4-b8ab-91c3bc796021/0360f333-f9a9-58e4-b8ab-91c3bc796021_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 305661,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dq/5b972144fc264097a9d702323e151826/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0360f333-f9a9-58e4-b8ab-91c3bc796021/0360f333-f9a9-58e4-b8ab-91c3bc796021_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 288975,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dq/5b972144fc264097a9d702323e151826/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0360f333-f9a9-58e4-b8ab-91c3bc796021/0360f333-f9a9-58e4-b8ab-91c3bc796021_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 254701,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dq/5b972144fc264097a9d702323e151826/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0360f333-f9a9-58e4-b8ab-91c3bc796021/0360f333-f9a9-58e4-b8ab-91c3bc796021_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 259619,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dq/5b972144fc264097a9d702323e151826/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0360f333-f9a9-58e4-b8ab-91c3bc796021/0360f333-f9a9-58e4-b8ab-91c3bc796021_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 408216,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dq/5b972144fc264097a9d702323e151826/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0360f333-f9a9-58e4-b8ab-91c3bc796021/0360f333-f9a9-58e4-b8ab-91c3bc796021_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 324717,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dq/5b972144fc264097a9d702323e151826/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0360f333-f9a9-58e4-b8ab-91c3bc796021/0360f333-f9a9-58e4-b8ab-91c3bc796021_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 288545,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dq/5b972144fc264097a9d702323e151826/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-05-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 2 SERIES GRAN COUPAu2030 1.5 218IA GRAN COUPE',
 'transmission': 'automatic',
 'trim': '1.5 218IA GRAN COUPE',
 'vin': None,
 'year': 2023}
2026-03-26 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985362%27 HTTP/1.1" 200 None
2026-03-26 22:49:32 [ayvens.be] INFO: Saving data for 1985362: {'created_time': 1774565372.734699, 'last_price_update_time': 1774565372.734708, 'auction_closing_time': 1774958400.0}
2026-03-26 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985362') HTTP/1.1" 204 0
2026-03-26 22:49:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cj/9e0ef4bd9e054b08a5af1916c643082f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cj/9e0ef4bd9e054b08a5af1916c643082f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dw%252F5c52afb6c58a4671aa6fffda8ecaabb7%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dw/5c52afb6c58a4671aa6fffda8ecaabb7/images/large/4.jpg not downloaded yet
2026-03-26 22:49:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7493fd0>
2026-03-26 22:49:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d550fb4-a647-5a1b-8837-81f98eace162/5d550fb4-a647-5a1b-8837-81f98eace162_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cj%252F9e0ef4bd9e054b08a5af1916c643082f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cj/9e0ef4bd9e054b08a5af1916c643082f/images/large/4.jpg saved to cache
2026-03-26 22:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5d550fb4-a647-5a1b-8837-81f98eace162
2026-03-26 22:49:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74ccdd0>
2026-03-26 22:49:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d550fb4-a647-5a1b-8837-81f98eace162/5d550fb4-a647-5a1b-8837-81f98eace162_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cj%252F9e0ef4bd9e054b08a5af1916c643082f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cj/9e0ef4bd9e054b08a5af1916c643082f/images/large/6.jpg saved to cache
2026-03-26 22:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5d550fb4-a647-5a1b-8837-81f98eace162
2026-03-26 22:49:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77afa90>
2026-03-26 22:49:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_572fb211-c34a-540b-b492-e638d580713e/572fb211-c34a-540b-b492-e638d580713e_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fe82efa31474242da96748466170068ba%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/e82efa31474242da96748466170068ba/images/large/1.jpg saved to cache
2026-03-26 22:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 572fb211-c34a-540b-b492-e638d580713e
2026-03-26 22:49:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74510d0>
2026-03-26 22:49:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d550fb4-a647-5a1b-8837-81f98eace162/5d550fb4-a647-5a1b-8837-81f98eace162_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cj%252F9e0ef4bd9e054b08a5af1916c643082f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cj/9e0ef4bd9e054b08a5af1916c643082f/images/large/5.jpg saved to cache
2026-03-26 22:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5d550fb4-a647-5a1b-8837-81f98eace162
2026-03-26 22:49:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/4db8fc92ecf640539502d435f09d3920/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dw%252F5c52afb6c58a4671aa6fffda8ecaabb7%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dw/5c52afb6c58a4671aa6fffda8ecaabb7/images/large/5.jpg not downloaded yet
2026-03-26 22:49:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/e82efa31474242da96748466170068ba/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/e82efa31474242da96748466170068ba/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/e82efa31474242da96748466170068ba/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cj/9e0ef4bd9e054b08a5af1916c643082f/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dw%252F5c52afb6c58a4671aa6fffda8ecaabb7%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dw/5c52afb6c58a4671aa6fffda8ecaabb7/images/large/6.jpg not downloaded yet
2026-03-26 22:49:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7405290>
2026-03-26 22:49:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d550fb4-a647-5a1b-8837-81f98eace162/5d550fb4-a647-5a1b-8837-81f98eace162_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cj%252F9e0ef4bd9e054b08a5af1916c643082f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cj/9e0ef4bd9e054b08a5af1916c643082f/images/large/7.jpg saved to cache
2026-03-26 22:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5d550fb4-a647-5a1b-8837-81f98eace162
2026-03-26 22:49:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7746e10>
2026-03-26 22:49:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d550fb4-a647-5a1b-8837-81f98eace162/5d550fb4-a647-5a1b-8837-81f98eace162_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cj%252F9e0ef4bd9e054b08a5af1916c643082f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cj/9e0ef4bd9e054b08a5af1916c643082f/images/large/8.jpg saved to cache
2026-03-26 22:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5d550fb4-a647-5a1b-8837-81f98eace162
2026-03-26 22:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dw%252F5c52afb6c58a4671aa6fffda8ecaabb7%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dw/5c52afb6c58a4671aa6fffda8ecaabb7/images/large/7.jpg not downloaded yet
2026-03-26 22:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dw%252F5c52afb6c58a4671aa6fffda8ecaabb7%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dw/5c52afb6c58a4671aa6fffda8ecaabb7/images/large/8.jpg not downloaded yet
2026-03-26 22:49:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7a83c10>
2026-03-26 22:49:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aac99e38-7861-5476-8a42-9368ec6b38bb/aac99e38-7861-5476-8a42-9368ec6b38bb_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F4db8fc92ecf640539502d435f09d3920%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/4db8fc92ecf640539502d435f09d3920/images/large/8.jpg saved to cache
2026-03-26 22:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item aac99e38-7861-5476-8a42-9368ec6b38bb
2026-03-26 22:49:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79f3ed0>
2026-03-26 22:49:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_572fb211-c34a-540b-b492-e638d580713e/572fb211-c34a-540b-b492-e638d580713e_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fe82efa31474242da96748466170068ba%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/e82efa31474242da96748466170068ba/images/large/4.jpg saved to cache
2026-03-26 22:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 572fb211-c34a-540b-b492-e638d580713e
2026-03-26 22:49:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7495610>
2026-03-26 22:49:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_572fb211-c34a-540b-b492-e638d580713e/572fb211-c34a-540b-b492-e638d580713e_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fe82efa31474242da96748466170068ba%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/e82efa31474242da96748466170068ba/images/large/2.jpg saved to cache
2026-03-26 22:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 572fb211-c34a-540b-b492-e638d580713e
2026-03-26 22:49:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b781bf10>
2026-03-26 22:49:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_572fb211-c34a-540b-b492-e638d580713e/572fb211-c34a-540b-b492-e638d580713e_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fe82efa31474242da96748466170068ba%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/e82efa31474242da96748466170068ba/images/large/3.jpg saved to cache
2026-03-26 22:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 572fb211-c34a-540b-b492-e638d580713e
2026-03-26 22:49:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7648610>
2026-03-26 22:49:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d550fb4-a647-5a1b-8837-81f98eace162/5d550fb4-a647-5a1b-8837-81f98eace162_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cj%252F9e0ef4bd9e054b08a5af1916c643082f%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cj/9e0ef4bd9e054b08a5af1916c643082f/images/large/10.jpg saved to cache
2026-03-26 22:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5d550fb4-a647-5a1b-8837-81f98eace162
2026-03-26 22:49:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/e82efa31474242da96748466170068ba/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/e82efa31474242da96748466170068ba/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dw%252F5c52afb6c58a4671aa6fffda8ecaabb7%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dw/5c52afb6c58a4671aa6fffda8ecaabb7/images/large/9.jpg not downloaded yet
2026-03-26 22:49:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cj/9e0ef4bd9e054b08a5af1916c643082f/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dw%252F5c52afb6c58a4671aa6fffda8ecaabb7%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dw/5c52afb6c58a4671aa6fffda8ecaabb7/images/large/10.jpg not downloaded yet
2026-03-26 22:49:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/4db8fc92ecf640539502d435f09d3920/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:33 [ayvens.be] INFO: Found listing with ID: 1985366
2026-03-26 22:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985366%27 HTTP/1.1" 200 None
2026-03-26 22:49:33 [ayvens.be] INFO: Scrape type for 1985366: 1
2026-03-26 22:49:33 [ayvens.be] INFO: Extracting data for car ID: 1985366
2026-03-26 22:49:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b548f02-98e7-5a1f-81a8-5a1c0ec365ed with identifier: 1985366
2026-03-26 22:49:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b548f02-98e7-5a1f-81a8-5a1c0ec365ed with scrape type 1
2026-03-26 22:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1b548f02-98e7-5a1f-81a8-5a1c0ec365ed
2026-03-26 22:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fe04969132c254641b899da29b3ac804b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/e04969132c254641b899da29b3ac804b/images/large/1.jpg not downloaded yet
2026-03-26 22:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fe04969132c254641b899da29b3ac804b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/e04969132c254641b899da29b3ac804b/images/large/2.jpg not downloaded yet
2026-03-26 22:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fe04969132c254641b899da29b3ac804b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/e04969132c254641b899da29b3ac804b/images/large/3.jpg not downloaded yet
2026-03-26 22:49:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77d6910>
2026-03-26 22:49:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_572fb211-c34a-540b-b492-e638d580713e/572fb211-c34a-540b-b492-e638d580713e_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fe82efa31474242da96748466170068ba%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/e82efa31474242da96748466170068ba/images/large/5.jpg saved to cache
2026-03-26 22:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 572fb211-c34a-540b-b492-e638d580713e
2026-03-26 22:49:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77ad6d0>
2026-03-26 22:49:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_572fb211-c34a-540b-b492-e638d580713e/572fb211-c34a-540b-b492-e638d580713e_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fe82efa31474242da96748466170068ba%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/e82efa31474242da96748466170068ba/images/large/6.jpg saved to cache
2026-03-26 22:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 572fb211-c34a-540b-b492-e638d580713e
2026-03-26 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fe04969132c254641b899da29b3ac804b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/e04969132c254641b899da29b3ac804b/images/large/4.jpg not downloaded yet
2026-03-26 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fe04969132c254641b899da29b3ac804b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/e04969132c254641b899da29b3ac804b/images/large/5.jpg not downloaded yet
2026-03-26 22:49:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/e82efa31474242da96748466170068ba/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fe04969132c254641b899da29b3ac804b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/e04969132c254641b899da29b3ac804b/images/large/6.jpg not downloaded yet
2026-03-26 22:49:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b788dd90>
2026-03-26 22:49:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d550fb4-a647-5a1b-8837-81f98eace162/5d550fb4-a647-5a1b-8837-81f98eace162_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cj%252F9e0ef4bd9e054b08a5af1916c643082f%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cj/9e0ef4bd9e054b08a5af1916c643082f/images/large/9.jpg saved to cache
2026-03-26 22:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5d550fb4-a647-5a1b-8837-81f98eace162
2026-03-26 22:49:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5d550fb4-a647-5a1b-8837-81f98eace162, skipping ID generation
2026-03-26 22:49:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d550fb4-a647-5a1b-8837-81f98eace162 with scrape type 1
2026-03-26 22:49:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5d550fb4-a647-5a1b-8837-81f98eace162 sending to next pipeline
2026-03-26 22:49:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 5d550fb4-a647-5a1b-8837-81f98eace162, identifier: 1985363
2026-03-26 22:49:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7434f90>
2026-03-26 22:49:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aac99e38-7861-5476-8a42-9368ec6b38bb/aac99e38-7861-5476-8a42-9368ec6b38bb_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F4db8fc92ecf640539502d435f09d3920%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/4db8fc92ecf640539502d435f09d3920/images/large/7.jpg saved to cache
2026-03-26 22:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item aac99e38-7861-5476-8a42-9368ec6b38bb
2026-03-26 22:49:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: aac99e38-7861-5476-8a42-9368ec6b38bb, skipping ID generation
2026-03-26 22:49:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aac99e38-7861-5476-8a42-9368ec6b38bb with scrape type 1
2026-03-26 22:49:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item aac99e38-7861-5476-8a42-9368ec6b38bb sending to next pipeline
2026-03-26 22:49:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: aac99e38-7861-5476-8a42-9368ec6b38bb, identifier: 1985361
2026-03-26 22:49:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 5d550fb4-a647-5a1b-8837-81f98eace162 with identifier: 1985363
2026-03-26 22:49:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 5d550fb4-a647-5a1b-8837-81f98eace162 with identifier: 1985363
2026-03-26 22:49:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 5d550fb4-a647-5a1b-8837-81f98eace162 with identifier: 1985363 to the API
2026-03-26 22:49:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:49:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:49:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cj/9e0ef4bd9e054b08a5af1916c643082f/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '5d550fb4-a647-5a1b-8837-81f98eace162',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 74198,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d550fb4-a647-5a1b-8837-81f98eace162/5d550fb4-a647-5a1b-8837-81f98eace162_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 671201,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cj/9e0ef4bd9e054b08a5af1916c643082f/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d550fb4-a647-5a1b-8837-81f98eace162/5d550fb4-a647-5a1b-8837-81f98eace162_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 678518,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cj/9e0ef4bd9e054b08a5af1916c643082f/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d550fb4-a647-5a1b-8837-81f98eace162/5d550fb4-a647-5a1b-8837-81f98eace162_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 688989,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cj/9e0ef4bd9e054b08a5af1916c643082f/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d550fb4-a647-5a1b-8837-81f98eace162/5d550fb4-a647-5a1b-8837-81f98eace162_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 727835,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cj/9e0ef4bd9e054b08a5af1916c643082f/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d550fb4-a647-5a1b-8837-81f98eace162/5d550fb4-a647-5a1b-8837-81f98eace162_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 613230,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cj/9e0ef4bd9e054b08a5af1916c643082f/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d550fb4-a647-5a1b-8837-81f98eace162/5d550fb4-a647-5a1b-8837-81f98eace162_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 621750,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cj/9e0ef4bd9e054b08a5af1916c643082f/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d550fb4-a647-5a1b-8837-81f98eace162/5d550fb4-a647-5a1b-8837-81f98eace162_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 697823,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cj/9e0ef4bd9e054b08a5af1916c643082f/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d550fb4-a647-5a1b-8837-81f98eace162/5d550fb4-a647-5a1b-8837-81f98eace162_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 720357,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cj/9e0ef4bd9e054b08a5af1916c643082f/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d550fb4-a647-5a1b-8837-81f98eace162/5d550fb4-a647-5a1b-8837-81f98eace162_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 600423,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cj/9e0ef4bd9e054b08a5af1916c643082f/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d550fb4-a647-5a1b-8837-81f98eace162/5d550fb4-a647-5a1b-8837-81f98eace162_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 418290,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cj/9e0ef4bd9e054b08a5af1916c643082f/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 1.6 PHEV 225 E-AUTO8 ALLURE PACK',
 'transmission': 'automatic',
 'trim': '1.6 PHEV 225 E-AUTO8 ALLURE PACK',
 'vin': None,
 'year': 2021}
2026-03-26 22:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985363%27 HTTP/1.1" 200 None
2026-03-26 22:49:35 [ayvens.be] INFO: Saving data for 1985363: {'created_time': 1774565375.138358, 'last_price_update_time': 1774565375.138369, 'auction_closing_time': 1774958400.0}
2026-03-26 22:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985363') HTTP/1.1" 204 0
2026-03-26 22:49:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: aac99e38-7861-5476-8a42-9368ec6b38bb with identifier: 1985361
2026-03-26 22:49:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: aac99e38-7861-5476-8a42-9368ec6b38bb with identifier: 1985361
2026-03-26 22:49:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: aac99e38-7861-5476-8a42-9368ec6b38bb with identifier: 1985361 to the API
2026-03-26 22:49:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:49:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:49:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cq/4db8fc92ecf640539502d435f09d3920/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'aac99e38-7861-5476-8a42-9368ec6b38bb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '5 SERIES TOURING',
 'odometer': 66887,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aac99e38-7861-5476-8a42-9368ec6b38bb/aac99e38-7861-5476-8a42-9368ec6b38bb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 681720,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/4db8fc92ecf640539502d435f09d3920/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aac99e38-7861-5476-8a42-9368ec6b38bb/aac99e38-7861-5476-8a42-9368ec6b38bb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 756162,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/4db8fc92ecf640539502d435f09d3920/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aac99e38-7861-5476-8a42-9368ec6b38bb/aac99e38-7861-5476-8a42-9368ec6b38bb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 731110,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/4db8fc92ecf640539502d435f09d3920/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aac99e38-7861-5476-8a42-9368ec6b38bb/aac99e38-7861-5476-8a42-9368ec6b38bb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 747398,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/4db8fc92ecf640539502d435f09d3920/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aac99e38-7861-5476-8a42-9368ec6b38bb/aac99e38-7861-5476-8a42-9368ec6b38bb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 768213,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/4db8fc92ecf640539502d435f09d3920/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aac99e38-7861-5476-8a42-9368ec6b38bb/aac99e38-7861-5476-8a42-9368ec6b38bb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 713513,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/4db8fc92ecf640539502d435f09d3920/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aac99e38-7861-5476-8a42-9368ec6b38bb/aac99e38-7861-5476-8a42-9368ec6b38bb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 685275,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/4db8fc92ecf640539502d435f09d3920/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aac99e38-7861-5476-8a42-9368ec6b38bb/aac99e38-7861-5476-8a42-9368ec6b38bb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 866888,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/4db8fc92ecf640539502d435f09d3920/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aac99e38-7861-5476-8a42-9368ec6b38bb/aac99e38-7861-5476-8a42-9368ec6b38bb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 812711,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/4db8fc92ecf640539502d435f09d3920/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aac99e38-7861-5476-8a42-9368ec6b38bb/aac99e38-7861-5476-8a42-9368ec6b38bb_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 699112,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/4db8fc92ecf640539502d435f09d3920/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 5 SERIES TOURING 2.0 520D 120KW TOURING AUTO',
 'transmission': 'automatic',
 'trim': '2.0 520D 120KW TOURING AUTO',
 'vin': None,
 'year': 2022}
2026-03-26 22:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985361%27 HTTP/1.1" 200 None
2026-03-26 22:49:35 [ayvens.be] INFO: Saving data for 1985361: {'created_time': 1774565375.469568, 'last_price_update_time': 1774565375.469577, 'auction_closing_time': 1774958400.0}
2026-03-26 22:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985361') HTTP/1.1" 204 0
2026-03-26 22:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fe04969132c254641b899da29b3ac804b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/e04969132c254641b899da29b3ac804b/images/large/7.jpg not downloaded yet
2026-03-26 22:49:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/e82efa31474242da96748466170068ba/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fe04969132c254641b899da29b3ac804b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/e04969132c254641b899da29b3ac804b/images/large/8.jpg not downloaded yet
2026-03-26 22:49:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74af150>
2026-03-26 22:49:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_572fb211-c34a-540b-b492-e638d580713e/572fb211-c34a-540b-b492-e638d580713e_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fe82efa31474242da96748466170068ba%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/e82efa31474242da96748466170068ba/images/large/7.jpg saved to cache
2026-03-26 22:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 572fb211-c34a-540b-b492-e638d580713e
2026-03-26 22:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fe04969132c254641b899da29b3ac804b%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/e04969132c254641b899da29b3ac804b/images/large/9.jpg not downloaded yet
2026-03-26 22:49:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/e82efa31474242da96748466170068ba/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fe04969132c254641b899da29b3ac804b%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/e04969132c254641b899da29b3ac804b/images/large/10.jpg not downloaded yet
2026-03-26 22:49:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7877510>
2026-03-26 22:49:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_572fb211-c34a-540b-b492-e638d580713e/572fb211-c34a-540b-b492-e638d580713e_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fe82efa31474242da96748466170068ba%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/e82efa31474242da96748466170068ba/images/large/8.jpg saved to cache
2026-03-26 22:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 572fb211-c34a-540b-b492-e638d580713e
2026-03-26 22:49:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/e82efa31474242da96748466170068ba/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:35 [ayvens.be] INFO: Found listing with ID: 1985367
2026-03-26 22:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985367%27 HTTP/1.1" 200 None
2026-03-26 22:49:35 [ayvens.be] INFO: Scrape type for 1985367: 1
2026-03-26 22:49:35 [ayvens.be] INFO: Extracting data for car ID: 1985367
2026-03-26 22:49:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a6db055-8436-5ac6-ad95-391afd5bbc80 with identifier: 1985367
2026-03-26 22:49:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a6db055-8436-5ac6-ad95-391afd5bbc80 with scrape type 1
2026-03-26 22:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4a6db055-8436-5ac6-ad95-391afd5bbc80
2026-03-26 22:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252F6f810d92f3c748fb8fc82b4c17c802a2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/6f810d92f3c748fb8fc82b4c17c802a2/images/large/1.jpg not downloaded yet
2026-03-26 22:49:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dw/5c52afb6c58a4671aa6fffda8ecaabb7/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252F6f810d92f3c748fb8fc82b4c17c802a2%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/6f810d92f3c748fb8fc82b4c17c802a2/images/large/2.jpg not downloaded yet
2026-03-26 22:49:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77bf290>
2026-03-26 22:49:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_572fb211-c34a-540b-b492-e638d580713e/572fb211-c34a-540b-b492-e638d580713e_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fe82efa31474242da96748466170068ba%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/e82efa31474242da96748466170068ba/images/large/10.jpg saved to cache
2026-03-26 22:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 572fb211-c34a-540b-b492-e638d580713e
2026-03-26 22:49:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dw/5c52afb6c58a4671aa6fffda8ecaabb7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252F6f810d92f3c748fb8fc82b4c17c802a2%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/6f810d92f3c748fb8fc82b4c17c802a2/images/large/3.jpg not downloaded yet
2026-03-26 22:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252F6f810d92f3c748fb8fc82b4c17c802a2%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/6f810d92f3c748fb8fc82b4c17c802a2/images/large/4.jpg not downloaded yet
2026-03-26 22:49:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dw/5c52afb6c58a4671aa6fffda8ecaabb7/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252F6f810d92f3c748fb8fc82b4c17c802a2%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/6f810d92f3c748fb8fc82b4c17c802a2/images/large/5.jpg not downloaded yet
2026-03-26 22:49:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79cf3d0>
2026-03-26 22:49:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_572fb211-c34a-540b-b492-e638d580713e/572fb211-c34a-540b-b492-e638d580713e_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fe82efa31474242da96748466170068ba%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/e82efa31474242da96748466170068ba/images/large/9.jpg saved to cache
2026-03-26 22:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 572fb211-c34a-540b-b492-e638d580713e
2026-03-26 22:49:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 572fb211-c34a-540b-b492-e638d580713e, skipping ID generation
2026-03-26 22:49:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 572fb211-c34a-540b-b492-e638d580713e with scrape type 1
2026-03-26 22:49:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 572fb211-c34a-540b-b492-e638d580713e sending to next pipeline
2026-03-26 22:49:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 572fb211-c34a-540b-b492-e638d580713e, identifier: 1985364
2026-03-26 22:49:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74fa390>
2026-03-26 22:49:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f18e9342-4f12-553c-b02c-5645e403a20a/f18e9342-4f12-553c-b02c-5645e403a20a_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dw%252F5c52afb6c58a4671aa6fffda8ecaabb7%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dw/5c52afb6c58a4671aa6fffda8ecaabb7/images/large/5.jpg saved to cache
2026-03-26 22:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f18e9342-4f12-553c-b02c-5645e403a20a
2026-03-26 22:49:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 572fb211-c34a-540b-b492-e638d580713e with identifier: 1985364
2026-03-26 22:49:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 572fb211-c34a-540b-b492-e638d580713e with identifier: 1985364
2026-03-26 22:49:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 572fb211-c34a-540b-b492-e638d580713e with identifier: 1985364 to the API
2026-03-26 22:49:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:49:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:49:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bp/e82efa31474242da96748466170068ba/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '572fb211-c34a-540b-b492-e638d580713e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q5 Sportback',
 'odometer': 112798,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_572fb211-c34a-540b-b492-e638d580713e/572fb211-c34a-540b-b492-e638d580713e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 244515,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/e82efa31474242da96748466170068ba/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_572fb211-c34a-540b-b492-e638d580713e/572fb211-c34a-540b-b492-e638d580713e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 236475,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/e82efa31474242da96748466170068ba/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_572fb211-c34a-540b-b492-e638d580713e/572fb211-c34a-540b-b492-e638d580713e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 257258,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/e82efa31474242da96748466170068ba/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_572fb211-c34a-540b-b492-e638d580713e/572fb211-c34a-540b-b492-e638d580713e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 259864,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/e82efa31474242da96748466170068ba/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_572fb211-c34a-540b-b492-e638d580713e/572fb211-c34a-540b-b492-e638d580713e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 285252,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/e82efa31474242da96748466170068ba/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_572fb211-c34a-540b-b492-e638d580713e/572fb211-c34a-540b-b492-e638d580713e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 288664,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/e82efa31474242da96748466170068ba/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_572fb211-c34a-540b-b492-e638d580713e/572fb211-c34a-540b-b492-e638d580713e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 260104,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/e82efa31474242da96748466170068ba/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_572fb211-c34a-540b-b492-e638d580713e/572fb211-c34a-540b-b492-e638d580713e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 324223,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/e82efa31474242da96748466170068ba/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_572fb211-c34a-540b-b492-e638d580713e/572fb211-c34a-540b-b492-e638d580713e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 360658,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/e82efa31474242da96748466170068ba/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_572fb211-c34a-540b-b492-e638d580713e/572fb211-c34a-540b-b492-e638d580713e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 273066,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/e82efa31474242da96748466170068ba/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q5 Sportback 2.0 50 TFSI E S TRONIC QUATTRO S LINE',
 'transmission': 'automatic',
 'trim': '2.0 50 TFSI E S TRONIC QUATTRO S LINE',
 'vin': None,
 'year': 2022}
2026-03-26 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985364%27 HTTP/1.1" 200 None
2026-03-26 22:49:36 [ayvens.be] INFO: Saving data for 1985364: {'created_time': 1774565376.525079, 'last_price_update_time': 1774565376.525092, 'auction_closing_time': 1774958400.0}
2026-03-26 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985364') HTTP/1.1" 204 0
2026-03-26 22:49:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dw/5c52afb6c58a4671aa6fffda8ecaabb7/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252F6f810d92f3c748fb8fc82b4c17c802a2%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/6f810d92f3c748fb8fc82b4c17c802a2/images/large/6.jpg not downloaded yet
2026-03-26 22:49:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/a0473f3c80ca44afb7f9166e291890fc/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dw/5c52afb6c58a4671aa6fffda8ecaabb7/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252F6f810d92f3c748fb8fc82b4c17c802a2%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/6f810d92f3c748fb8fc82b4c17c802a2/images/large/7.jpg not downloaded yet
2026-03-26 22:49:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c83690>
2026-03-26 22:49:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f18e9342-4f12-553c-b02c-5645e403a20a/f18e9342-4f12-553c-b02c-5645e403a20a_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dw%252F5c52afb6c58a4671aa6fffda8ecaabb7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dw/5c52afb6c58a4671aa6fffda8ecaabb7/images/large/1.jpg saved to cache
2026-03-26 22:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f18e9342-4f12-553c-b02c-5645e403a20a
2026-03-26 22:49:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e1e0d0>
2026-03-26 22:49:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f18e9342-4f12-553c-b02c-5645e403a20a/f18e9342-4f12-553c-b02c-5645e403a20a_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dw%252F5c52afb6c58a4671aa6fffda8ecaabb7%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dw/5c52afb6c58a4671aa6fffda8ecaabb7/images/large/2.jpg saved to cache
2026-03-26 22:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f18e9342-4f12-553c-b02c-5645e403a20a
2026-03-26 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252F6f810d92f3c748fb8fc82b4c17c802a2%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/6f810d92f3c748fb8fc82b4c17c802a2/images/large/8.jpg not downloaded yet
2026-03-26 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252F6f810d92f3c748fb8fc82b4c17c802a2%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/6f810d92f3c748fb8fc82b4c17c802a2/images/large/9.jpg not downloaded yet
2026-03-26 22:49:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77ac590>
2026-03-26 22:49:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f18e9342-4f12-553c-b02c-5645e403a20a/f18e9342-4f12-553c-b02c-5645e403a20a_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dw%252F5c52afb6c58a4671aa6fffda8ecaabb7%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dw/5c52afb6c58a4671aa6fffda8ecaabb7/images/large/3.jpg saved to cache
2026-03-26 22:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f18e9342-4f12-553c-b02c-5645e403a20a
2026-03-26 22:49:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd3bab10>
2026-03-26 22:49:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76552fd3-b338-580f-b2a5-4128d2e47df3/76552fd3-b338-580f-b2a5-4128d2e47df3_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fa0473f3c80ca44afb7f9166e291890fc%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/a0473f3c80ca44afb7f9166e291890fc/images/large/10.jpg saved to cache
2026-03-26 22:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 76552fd3-b338-580f-b2a5-4128d2e47df3
2026-03-26 22:49:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c60410>
2026-03-26 22:49:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f18e9342-4f12-553c-b02c-5645e403a20a/f18e9342-4f12-553c-b02c-5645e403a20a_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dw%252F5c52afb6c58a4671aa6fffda8ecaabb7%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dw/5c52afb6c58a4671aa6fffda8ecaabb7/images/large/4.jpg saved to cache
2026-03-26 22:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f18e9342-4f12-553c-b02c-5645e403a20a
2026-03-26 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252F6f810d92f3c748fb8fc82b4c17c802a2%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/6f810d92f3c748fb8fc82b4c17c802a2/images/large/10.jpg not downloaded yet
2026-03-26 22:49:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/a0473f3c80ca44afb7f9166e291890fc/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dw/5c52afb6c58a4671aa6fffda8ecaabb7/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dw/5c52afb6c58a4671aa6fffda8ecaabb7/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/a0473f3c80ca44afb7f9166e291890fc/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dw/5c52afb6c58a4671aa6fffda8ecaabb7/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:37 [ayvens.be] INFO: Found listing with ID: 1985368
2026-03-26 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985368%27 HTTP/1.1" 200 None
2026-03-26 22:49:37 [ayvens.be] INFO: Scrape type for 1985368: 1
2026-03-26 22:49:37 [ayvens.be] INFO: Extracting data for car ID: 1985368
2026-03-26 22:49:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9123352f-f020-520c-8c81-3f437f438310 with identifier: 1985368
2026-03-26 22:49:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9123352f-f020-520c-8c81-3f437f438310 with scrape type 1
2026-03-26 22:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9123352f-f020-520c-8c81-3f437f438310
2026-03-26 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252Fa8719782db134ca2bf94534d2eeccc7b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/a8719782db134ca2bf94534d2eeccc7b/images/large/1.jpg not downloaded yet
2026-03-26 22:49:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/e04969132c254641b899da29b3ac804b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/e04969132c254641b899da29b3ac804b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252Fa8719782db134ca2bf94534d2eeccc7b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/a8719782db134ca2bf94534d2eeccc7b/images/large/2.jpg not downloaded yet
2026-03-26 22:49:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dw/5c52afb6c58a4671aa6fffda8ecaabb7/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252Fa8719782db134ca2bf94534d2eeccc7b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/a8719782db134ca2bf94534d2eeccc7b/images/large/3.jpg not downloaded yet
2026-03-26 22:49:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/e04969132c254641b899da29b3ac804b/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252Fa8719782db134ca2bf94534d2eeccc7b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/a8719782db134ca2bf94534d2eeccc7b/images/large/4.jpg not downloaded yet
2026-03-26 22:49:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/e04969132c254641b899da29b3ac804b/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b782e890>
2026-03-26 22:49:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76552fd3-b338-580f-b2a5-4128d2e47df3/76552fd3-b338-580f-b2a5-4128d2e47df3_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fa0473f3c80ca44afb7f9166e291890fc%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/a0473f3c80ca44afb7f9166e291890fc/images/large/8.jpg saved to cache
2026-03-26 22:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 76552fd3-b338-580f-b2a5-4128d2e47df3
2026-03-26 22:49:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cc8350>
2026-03-26 22:49:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f18e9342-4f12-553c-b02c-5645e403a20a/f18e9342-4f12-553c-b02c-5645e403a20a_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dw%252F5c52afb6c58a4671aa6fffda8ecaabb7%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dw/5c52afb6c58a4671aa6fffda8ecaabb7/images/large/8.jpg saved to cache
2026-03-26 22:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f18e9342-4f12-553c-b02c-5645e403a20a
2026-03-26 22:49:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7483b50>
2026-03-26 22:49:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f18e9342-4f12-553c-b02c-5645e403a20a/f18e9342-4f12-553c-b02c-5645e403a20a_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dw%252F5c52afb6c58a4671aa6fffda8ecaabb7%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dw/5c52afb6c58a4671aa6fffda8ecaabb7/images/large/7.jpg saved to cache
2026-03-26 22:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f18e9342-4f12-553c-b02c-5645e403a20a
2026-03-26 22:49:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7483850>
2026-03-26 22:49:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76552fd3-b338-580f-b2a5-4128d2e47df3/76552fd3-b338-580f-b2a5-4128d2e47df3_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fa0473f3c80ca44afb7f9166e291890fc%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/a0473f3c80ca44afb7f9166e291890fc/images/large/9.jpg saved to cache
2026-03-26 22:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 76552fd3-b338-580f-b2a5-4128d2e47df3
2026-03-26 22:49:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79a1150>
2026-03-26 22:49:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f18e9342-4f12-553c-b02c-5645e403a20a/f18e9342-4f12-553c-b02c-5645e403a20a_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dw%252F5c52afb6c58a4671aa6fffda8ecaabb7%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dw/5c52afb6c58a4671aa6fffda8ecaabb7/images/large/9.jpg saved to cache
2026-03-26 22:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f18e9342-4f12-553c-b02c-5645e403a20a
2026-03-26 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252Fa8719782db134ca2bf94534d2eeccc7b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/a8719782db134ca2bf94534d2eeccc7b/images/large/5.jpg not downloaded yet
2026-03-26 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252Fa8719782db134ca2bf94534d2eeccc7b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/a8719782db134ca2bf94534d2eeccc7b/images/large/6.jpg not downloaded yet
2026-03-26 22:49:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ck/6f810d92f3c748fb8fc82b4c17c802a2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252Fa8719782db134ca2bf94534d2eeccc7b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/a8719782db134ca2bf94534d2eeccc7b/images/large/7.jpg not downloaded yet
2026-03-26 22:49:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77d7290>
2026-03-26 22:49:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b548f02-98e7-5a1f-81a8-5a1c0ec365ed/1b548f02-98e7-5a1f-81a8-5a1c0ec365ed_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fe04969132c254641b899da29b3ac804b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/e04969132c254641b899da29b3ac804b/images/large/5.jpg saved to cache
2026-03-26 22:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1b548f02-98e7-5a1f-81a8-5a1c0ec365ed
2026-03-26 22:49:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79f0c90>
2026-03-26 22:49:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b548f02-98e7-5a1f-81a8-5a1c0ec365ed/1b548f02-98e7-5a1f-81a8-5a1c0ec365ed_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fe04969132c254641b899da29b3ac804b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/e04969132c254641b899da29b3ac804b/images/large/7.jpg saved to cache
2026-03-26 22:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1b548f02-98e7-5a1f-81a8-5a1c0ec365ed
2026-03-26 22:49:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b746e910>
2026-03-26 22:49:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f18e9342-4f12-553c-b02c-5645e403a20a/f18e9342-4f12-553c-b02c-5645e403a20a_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dw%252F5c52afb6c58a4671aa6fffda8ecaabb7%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dw/5c52afb6c58a4671aa6fffda8ecaabb7/images/large/10.jpg saved to cache
2026-03-26 22:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f18e9342-4f12-553c-b02c-5645e403a20a
2026-03-26 22:49:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7747210>
2026-03-26 22:49:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b548f02-98e7-5a1f-81a8-5a1c0ec365ed/1b548f02-98e7-5a1f-81a8-5a1c0ec365ed_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fe04969132c254641b899da29b3ac804b%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/e04969132c254641b899da29b3ac804b/images/large/9.jpg saved to cache
2026-03-26 22:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1b548f02-98e7-5a1f-81a8-5a1c0ec365ed
2026-03-26 22:49:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd3bab10>
2026-03-26 22:49:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b548f02-98e7-5a1f-81a8-5a1c0ec365ed/1b548f02-98e7-5a1f-81a8-5a1c0ec365ed_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fe04969132c254641b899da29b3ac804b%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/e04969132c254641b899da29b3ac804b/images/large/10.jpg saved to cache
2026-03-26 22:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1b548f02-98e7-5a1f-81a8-5a1c0ec365ed
2026-03-26 22:49:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ck/6f810d92f3c748fb8fc82b4c17c802a2/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ck/6f810d92f3c748fb8fc82b4c17c802a2/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252Fa8719782db134ca2bf94534d2eeccc7b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/a8719782db134ca2bf94534d2eeccc7b/images/large/8.jpg not downloaded yet
2026-03-26 22:49:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ck/6f810d92f3c748fb8fc82b4c17c802a2/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252Fa8719782db134ca2bf94534d2eeccc7b%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/a8719782db134ca2bf94534d2eeccc7b/images/large/9.jpg not downloaded yet
2026-03-26 22:49:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ck/6f810d92f3c748fb8fc82b4c17c802a2/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7ccf210>
2026-03-26 22:49:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a6db055-8436-5ac6-ad95-391afd5bbc80/4a6db055-8436-5ac6-ad95-391afd5bbc80_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252F6f810d92f3c748fb8fc82b4c17c802a2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/6f810d92f3c748fb8fc82b4c17c802a2/images/large/1.jpg saved to cache
2026-03-26 22:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4a6db055-8436-5ac6-ad95-391afd5bbc80
2026-03-26 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252Fa8719782db134ca2bf94534d2eeccc7b%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/a8719782db134ca2bf94534d2eeccc7b/images/large/10.jpg not downloaded yet
2026-03-26 22:49:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ck/6f810d92f3c748fb8fc82b4c17c802a2/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:38 [ayvens.be] INFO: Found listing with ID: 1985369
2026-03-26 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985369%27 HTTP/1.1" 200 None
2026-03-26 22:49:38 [ayvens.be] INFO: Scrape type for 1985369: 1
2026-03-26 22:49:38 [ayvens.be] INFO: Extracting data for car ID: 1985369
2026-03-26 22:49:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f59e1dc1-9407-5451-af2c-f810e89334ef with identifier: 1985369
2026-03-26 22:49:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f59e1dc1-9407-5451-af2c-f810e89334ef with scrape type 1
2026-03-26 22:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f59e1dc1-9407-5451-af2c-f810e89334ef
2026-03-26 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fd0687add2e9d492c905251dbae34fd52%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/d0687add2e9d492c905251dbae34fd52/images/large/1.jpg not downloaded yet
2026-03-26 22:49:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ck/6f810d92f3c748fb8fc82b4c17c802a2/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fd0687add2e9d492c905251dbae34fd52%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/d0687add2e9d492c905251dbae34fd52/images/large/2.jpg not downloaded yet
2026-03-26 22:49:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7496050>
2026-03-26 22:49:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a6db055-8436-5ac6-ad95-391afd5bbc80/4a6db055-8436-5ac6-ad95-391afd5bbc80_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252F6f810d92f3c748fb8fc82b4c17c802a2%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/6f810d92f3c748fb8fc82b4c17c802a2/images/large/6.jpg saved to cache
2026-03-26 22:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4a6db055-8436-5ac6-ad95-391afd5bbc80
2026-03-26 22:49:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79ce450>
2026-03-26 22:49:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a6db055-8436-5ac6-ad95-391afd5bbc80/4a6db055-8436-5ac6-ad95-391afd5bbc80_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252F6f810d92f3c748fb8fc82b4c17c802a2%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/6f810d92f3c748fb8fc82b4c17c802a2/images/large/5.jpg saved to cache
2026-03-26 22:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4a6db055-8436-5ac6-ad95-391afd5bbc80
2026-03-26 22:49:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76c7310>
2026-03-26 22:49:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a6db055-8436-5ac6-ad95-391afd5bbc80/4a6db055-8436-5ac6-ad95-391afd5bbc80_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252F6f810d92f3c748fb8fc82b4c17c802a2%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/6f810d92f3c748fb8fc82b4c17c802a2/images/large/4.jpg saved to cache
2026-03-26 22:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4a6db055-8436-5ac6-ad95-391afd5bbc80
2026-03-26 22:49:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7436f90>
2026-03-26 22:49:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a6db055-8436-5ac6-ad95-391afd5bbc80/4a6db055-8436-5ac6-ad95-391afd5bbc80_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252F6f810d92f3c748fb8fc82b4c17c802a2%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/6f810d92f3c748fb8fc82b4c17c802a2/images/large/2.jpg saved to cache
2026-03-26 22:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4a6db055-8436-5ac6-ad95-391afd5bbc80
2026-03-26 22:49:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ck/6f810d92f3c748fb8fc82b4c17c802a2/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fd0687add2e9d492c905251dbae34fd52%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/d0687add2e9d492c905251dbae34fd52/images/large/3.jpg not downloaded yet
2026-03-26 22:49:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/e04969132c254641b899da29b3ac804b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/e04969132c254641b899da29b3ac804b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/e04969132c254641b899da29b3ac804b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ck/6f810d92f3c748fb8fc82b4c17c802a2/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fd0687add2e9d492c905251dbae34fd52%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/d0687add2e9d492c905251dbae34fd52/images/large/4.jpg not downloaded yet
2026-03-26 22:49:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ck/6f810d92f3c748fb8fc82b4c17c802a2/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c61490>
2026-03-26 22:49:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a6db055-8436-5ac6-ad95-391afd5bbc80/4a6db055-8436-5ac6-ad95-391afd5bbc80_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252F6f810d92f3c748fb8fc82b4c17c802a2%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/6f810d92f3c748fb8fc82b4c17c802a2/images/large/3.jpg saved to cache
2026-03-26 22:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4a6db055-8436-5ac6-ad95-391afd5bbc80
2026-03-26 22:49:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74bdf10>
2026-03-26 22:49:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a6db055-8436-5ac6-ad95-391afd5bbc80/4a6db055-8436-5ac6-ad95-391afd5bbc80_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252F6f810d92f3c748fb8fc82b4c17c802a2%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/6f810d92f3c748fb8fc82b4c17c802a2/images/large/9.jpg saved to cache
2026-03-26 22:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4a6db055-8436-5ac6-ad95-391afd5bbc80
2026-03-26 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fd0687add2e9d492c905251dbae34fd52%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/d0687add2e9d492c905251dbae34fd52/images/large/5.jpg not downloaded yet
2026-03-26 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fd0687add2e9d492c905251dbae34fd52%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/d0687add2e9d492c905251dbae34fd52/images/large/6.jpg not downloaded yet
2026-03-26 22:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fd0687add2e9d492c905251dbae34fd52%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/d0687add2e9d492c905251dbae34fd52/images/large/7.jpg not downloaded yet
2026-03-26 22:49:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b746f610>
2026-03-26 22:49:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a6db055-8436-5ac6-ad95-391afd5bbc80/4a6db055-8436-5ac6-ad95-391afd5bbc80_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252F6f810d92f3c748fb8fc82b4c17c802a2%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/6f810d92f3c748fb8fc82b4c17c802a2/images/large/8.jpg saved to cache
2026-03-26 22:49:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4a6db055-8436-5ac6-ad95-391afd5bbc80
2026-03-26 22:49:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b72efe10>
2026-03-26 22:49:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b548f02-98e7-5a1f-81a8-5a1c0ec365ed/1b548f02-98e7-5a1f-81a8-5a1c0ec365ed_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fe04969132c254641b899da29b3ac804b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/e04969132c254641b899da29b3ac804b/images/large/8.jpg saved to cache
2026-03-26 22:49:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1b548f02-98e7-5a1f-81a8-5a1c0ec365ed
2026-03-26 22:49:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c6be90>
2026-03-26 22:49:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b548f02-98e7-5a1f-81a8-5a1c0ec365ed/1b548f02-98e7-5a1f-81a8-5a1c0ec365ed_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fe04969132c254641b899da29b3ac804b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/e04969132c254641b899da29b3ac804b/images/large/4.jpg saved to cache
2026-03-26 22:49:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1b548f02-98e7-5a1f-81a8-5a1c0ec365ed
2026-03-26 22:49:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74433d0>
2026-03-26 22:49:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b548f02-98e7-5a1f-81a8-5a1c0ec365ed/1b548f02-98e7-5a1f-81a8-5a1c0ec365ed_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fe04969132c254641b899da29b3ac804b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/e04969132c254641b899da29b3ac804b/images/large/6.jpg saved to cache
2026-03-26 22:49:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1b548f02-98e7-5a1f-81a8-5a1c0ec365ed
2026-03-26 22:49:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c6b1d0>
2026-03-26 22:49:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a6db055-8436-5ac6-ad95-391afd5bbc80/4a6db055-8436-5ac6-ad95-391afd5bbc80_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252F6f810d92f3c748fb8fc82b4c17c802a2%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/6f810d92f3c748fb8fc82b4c17c802a2/images/large/10.jpg saved to cache
2026-03-26 22:49:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4a6db055-8436-5ac6-ad95-391afd5bbc80
2026-03-26 22:49:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7726b90>
2026-03-26 22:49:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a6db055-8436-5ac6-ad95-391afd5bbc80/4a6db055-8436-5ac6-ad95-391afd5bbc80_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252F6f810d92f3c748fb8fc82b4c17c802a2%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/6f810d92f3c748fb8fc82b4c17c802a2/images/large/7.jpg saved to cache
2026-03-26 22:49:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4a6db055-8436-5ac6-ad95-391afd5bbc80
2026-03-26 22:49:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4a6db055-8436-5ac6-ad95-391afd5bbc80, skipping ID generation
2026-03-26 22:49:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a6db055-8436-5ac6-ad95-391afd5bbc80 with scrape type 1
2026-03-26 22:49:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4a6db055-8436-5ac6-ad95-391afd5bbc80 sending to next pipeline
2026-03-26 22:49:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 4a6db055-8436-5ac6-ad95-391afd5bbc80, identifier: 1985367
2026-03-26 22:49:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 4a6db055-8436-5ac6-ad95-391afd5bbc80 with identifier: 1985367
2026-03-26 22:49:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 4a6db055-8436-5ac6-ad95-391afd5bbc80 with identifier: 1985367
2026-03-26 22:49:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 4a6db055-8436-5ac6-ad95-391afd5bbc80 with identifier: 1985367 to the API
2026-03-26 22:49:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:49:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:49:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ck/6f810d92f3c748fb8fc82b4c17c802a2/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '4a6db055-8436-5ac6-ad95-391afd5bbc80',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X2',
 'odometer': 53093,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a6db055-8436-5ac6-ad95-391afd5bbc80/4a6db055-8436-5ac6-ad95-391afd5bbc80_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 659289,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ck/6f810d92f3c748fb8fc82b4c17c802a2/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a6db055-8436-5ac6-ad95-391afd5bbc80/4a6db055-8436-5ac6-ad95-391afd5bbc80_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 648506,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ck/6f810d92f3c748fb8fc82b4c17c802a2/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a6db055-8436-5ac6-ad95-391afd5bbc80/4a6db055-8436-5ac6-ad95-391afd5bbc80_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 720351,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ck/6f810d92f3c748fb8fc82b4c17c802a2/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a6db055-8436-5ac6-ad95-391afd5bbc80/4a6db055-8436-5ac6-ad95-391afd5bbc80_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 711223,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ck/6f810d92f3c748fb8fc82b4c17c802a2/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a6db055-8436-5ac6-ad95-391afd5bbc80/4a6db055-8436-5ac6-ad95-391afd5bbc80_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 549133,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ck/6f810d92f3c748fb8fc82b4c17c802a2/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a6db055-8436-5ac6-ad95-391afd5bbc80/4a6db055-8436-5ac6-ad95-391afd5bbc80_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 537572,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ck/6f810d92f3c748fb8fc82b4c17c802a2/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a6db055-8436-5ac6-ad95-391afd5bbc80/4a6db055-8436-5ac6-ad95-391afd5bbc80_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 620785,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ck/6f810d92f3c748fb8fc82b4c17c802a2/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a6db055-8436-5ac6-ad95-391afd5bbc80/4a6db055-8436-5ac6-ad95-391afd5bbc80_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 642672,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ck/6f810d92f3c748fb8fc82b4c17c802a2/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a6db055-8436-5ac6-ad95-391afd5bbc80/4a6db055-8436-5ac6-ad95-391afd5bbc80_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 612771,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ck/6f810d92f3c748fb8fc82b4c17c802a2/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a6db055-8436-5ac6-ad95-391afd5bbc80/4a6db055-8436-5ac6-ad95-391afd5bbc80_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 473470,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ck/6f810d92f3c748fb8fc82b4c17c802a2/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X2 1.5 XDRIVE25E PHEV 162KW)',
 'transmission': 'automatic',
 'trim': '1.5 XDRIVE25E PHEV 162KW)',
 'vin': None,
 'year': 2022}
2026-03-26 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985367%27 HTTP/1.1" 200 None
2026-03-26 22:49:40 [ayvens.be] INFO: Saving data for 1985367: {'created_time': 1774565380.490741, 'last_price_update_time': 1774565380.49075, 'auction_closing_time': 1774958400.0}
2026-03-26 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985367') HTTP/1.1" 204 0
2026-03-26 22:49:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/a8719782db134ca2bf94534d2eeccc7b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fd0687add2e9d492c905251dbae34fd52%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/d0687add2e9d492c905251dbae34fd52/images/large/8.jpg not downloaded yet
2026-03-26 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fd0687add2e9d492c905251dbae34fd52%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/d0687add2e9d492c905251dbae34fd52/images/large/9.jpg not downloaded yet
2026-03-26 22:49:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/a8719782db134ca2bf94534d2eeccc7b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/a8719782db134ca2bf94534d2eeccc7b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fd0687add2e9d492c905251dbae34fd52%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/d0687add2e9d492c905251dbae34fd52/images/large/10.jpg not downloaded yet
2026-03-26 22:49:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/a8719782db134ca2bf94534d2eeccc7b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/a8719782db134ca2bf94534d2eeccc7b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/a8719782db134ca2bf94534d2eeccc7b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:40 [ayvens.be] INFO: Found listing with ID: 1985370
2026-03-26 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985370%27 HTTP/1.1" 200 None
2026-03-26 22:49:40 [ayvens.be] INFO: Scrape type for 1985370: 1
2026-03-26 22:49:40 [ayvens.be] INFO: Extracting data for car ID: 1985370
2026-03-26 22:49:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc62ded9-a378-5b04-aa3f-1ff811f2e715 with identifier: 1985370
2026-03-26 22:49:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc62ded9-a378-5b04-aa3f-1ff811f2e715 with scrape type 1
2026-03-26 22:49:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bc62ded9-a378-5b04-aa3f-1ff811f2e715
2026-03-26 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F69a50597df894c0fa4afd76723909e0c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/69a50597df894c0fa4afd76723909e0c/images/large/1.jpg not downloaded yet
2026-03-26 22:49:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/a8719782db134ca2bf94534d2eeccc7b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/a8719782db134ca2bf94534d2eeccc7b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F69a50597df894c0fa4afd76723909e0c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/69a50597df894c0fa4afd76723909e0c/images/large/2.jpg not downloaded yet
2026-03-26 22:49:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c6b990>
2026-03-26 22:49:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9123352f-f020-520c-8c81-3f437f438310/9123352f-f020-520c-8c81-3f437f438310_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252Fa8719782db134ca2bf94534d2eeccc7b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/a8719782db134ca2bf94534d2eeccc7b/images/large/1.jpg saved to cache
2026-03-26 22:49:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9123352f-f020-520c-8c81-3f437f438310
2026-03-26 22:49:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6d83850>
2026-03-26 22:49:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9123352f-f020-520c-8c81-3f437f438310/9123352f-f020-520c-8c81-3f437f438310_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252Fa8719782db134ca2bf94534d2eeccc7b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/a8719782db134ca2bf94534d2eeccc7b/images/large/5.jpg saved to cache
2026-03-26 22:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9123352f-f020-520c-8c81-3f437f438310
2026-03-26 22:49:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7586a10>
2026-03-26 22:49:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9123352f-f020-520c-8c81-3f437f438310/9123352f-f020-520c-8c81-3f437f438310_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252Fa8719782db134ca2bf94534d2eeccc7b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/a8719782db134ca2bf94534d2eeccc7b/images/large/6.jpg saved to cache
2026-03-26 22:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9123352f-f020-520c-8c81-3f437f438310
2026-03-26 22:49:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6d81a10>
2026-03-26 22:49:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9123352f-f020-520c-8c81-3f437f438310/9123352f-f020-520c-8c81-3f437f438310_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252Fa8719782db134ca2bf94534d2eeccc7b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/a8719782db134ca2bf94534d2eeccc7b/images/large/3.jpg saved to cache
2026-03-26 22:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9123352f-f020-520c-8c81-3f437f438310
2026-03-26 22:49:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7412f50>
2026-03-26 22:49:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9123352f-f020-520c-8c81-3f437f438310/9123352f-f020-520c-8c81-3f437f438310_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252Fa8719782db134ca2bf94534d2eeccc7b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/a8719782db134ca2bf94534d2eeccc7b/images/large/4.jpg saved to cache
2026-03-26 22:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9123352f-f020-520c-8c81-3f437f438310
2026-03-26 22:49:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7818d90>
2026-03-26 22:49:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9123352f-f020-520c-8c81-3f437f438310/9123352f-f020-520c-8c81-3f437f438310_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252Fa8719782db134ca2bf94534d2eeccc7b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/a8719782db134ca2bf94534d2eeccc7b/images/large/7.jpg saved to cache
2026-03-26 22:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9123352f-f020-520c-8c81-3f437f438310
2026-03-26 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F69a50597df894c0fa4afd76723909e0c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/69a50597df894c0fa4afd76723909e0c/images/large/3.jpg not downloaded yet
2026-03-26 22:49:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/e04969132c254641b899da29b3ac804b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/d0687add2e9d492c905251dbae34fd52/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/d0687add2e9d492c905251dbae34fd52/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/e04969132c254641b899da29b3ac804b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F69a50597df894c0fa4afd76723909e0c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/69a50597df894c0fa4afd76723909e0c/images/large/4.jpg not downloaded yet
2026-03-26 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F69a50597df894c0fa4afd76723909e0c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/69a50597df894c0fa4afd76723909e0c/images/large/5.jpg not downloaded yet
2026-03-26 22:49:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b17750>
2026-03-26 22:49:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9123352f-f020-520c-8c81-3f437f438310/9123352f-f020-520c-8c81-3f437f438310_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252Fa8719782db134ca2bf94534d2eeccc7b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/a8719782db134ca2bf94534d2eeccc7b/images/large/2.jpg saved to cache
2026-03-26 22:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9123352f-f020-520c-8c81-3f437f438310
2026-03-26 22:49:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7688310>
2026-03-26 22:49:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9123352f-f020-520c-8c81-3f437f438310/9123352f-f020-520c-8c81-3f437f438310_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252Fa8719782db134ca2bf94534d2eeccc7b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/a8719782db134ca2bf94534d2eeccc7b/images/large/8.jpg saved to cache
2026-03-26 22:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9123352f-f020-520c-8c81-3f437f438310
2026-03-26 22:49:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/d0687add2e9d492c905251dbae34fd52/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/a8719782db134ca2bf94534d2eeccc7b/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F69a50597df894c0fa4afd76723909e0c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/69a50597df894c0fa4afd76723909e0c/images/large/6.jpg not downloaded yet
2026-03-26 22:49:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/a8719782db134ca2bf94534d2eeccc7b/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F69a50597df894c0fa4afd76723909e0c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/69a50597df894c0fa4afd76723909e0c/images/large/7.jpg not downloaded yet
2026-03-26 22:49:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/e04969132c254641b899da29b3ac804b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76cdf10>
2026-03-26 22:49:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b548f02-98e7-5a1f-81a8-5a1c0ec365ed/1b548f02-98e7-5a1f-81a8-5a1c0ec365ed_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fe04969132c254641b899da29b3ac804b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/e04969132c254641b899da29b3ac804b/images/large/2.jpg saved to cache
2026-03-26 22:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1b548f02-98e7-5a1f-81a8-5a1c0ec365ed
2026-03-26 22:49:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b746ec90>
2026-03-26 22:49:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f59e1dc1-9407-5451-af2c-f810e89334ef/f59e1dc1-9407-5451-af2c-f810e89334ef_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fd0687add2e9d492c905251dbae34fd52%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/d0687add2e9d492c905251dbae34fd52/images/large/2.jpg saved to cache
2026-03-26 22:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f59e1dc1-9407-5451-af2c-f810e89334ef
2026-03-26 22:49:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7746990>
2026-03-26 22:49:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f59e1dc1-9407-5451-af2c-f810e89334ef/f59e1dc1-9407-5451-af2c-f810e89334ef_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fd0687add2e9d492c905251dbae34fd52%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/d0687add2e9d492c905251dbae34fd52/images/large/1.jpg saved to cache
2026-03-26 22:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f59e1dc1-9407-5451-af2c-f810e89334ef
2026-03-26 22:49:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b788c610>
2026-03-26 22:49:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b548f02-98e7-5a1f-81a8-5a1c0ec365ed/1b548f02-98e7-5a1f-81a8-5a1c0ec365ed_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fe04969132c254641b899da29b3ac804b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/e04969132c254641b899da29b3ac804b/images/large/3.jpg saved to cache
2026-03-26 22:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1b548f02-98e7-5a1f-81a8-5a1c0ec365ed
2026-03-26 22:49:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/d0687add2e9d492c905251dbae34fd52/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/d0687add2e9d492c905251dbae34fd52/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F69a50597df894c0fa4afd76723909e0c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/69a50597df894c0fa4afd76723909e0c/images/large/8.jpg not downloaded yet
2026-03-26 22:49:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/d0687add2e9d492c905251dbae34fd52/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/d0687add2e9d492c905251dbae34fd52/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F69a50597df894c0fa4afd76723909e0c%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/69a50597df894c0fa4afd76723909e0c/images/large/9.jpg not downloaded yet
2026-03-26 22:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F69a50597df894c0fa4afd76723909e0c%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/69a50597df894c0fa4afd76723909e0c/images/large/10.jpg not downloaded yet
2026-03-26 22:49:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79a3810>
2026-03-26 22:49:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f59e1dc1-9407-5451-af2c-f810e89334ef/f59e1dc1-9407-5451-af2c-f810e89334ef_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fd0687add2e9d492c905251dbae34fd52%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/d0687add2e9d492c905251dbae34fd52/images/large/3.jpg saved to cache
2026-03-26 22:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f59e1dc1-9407-5451-af2c-f810e89334ef
2026-03-26 22:49:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7a56c50>
2026-03-26 22:49:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9123352f-f020-520c-8c81-3f437f438310/9123352f-f020-520c-8c81-3f437f438310_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252Fa8719782db134ca2bf94534d2eeccc7b%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/a8719782db134ca2bf94534d2eeccc7b/images/large/9.jpg saved to cache
2026-03-26 22:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9123352f-f020-520c-8c81-3f437f438310
2026-03-26 22:49:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c684d0>
2026-03-26 22:49:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9123352f-f020-520c-8c81-3f437f438310/9123352f-f020-520c-8c81-3f437f438310_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252Fa8719782db134ca2bf94534d2eeccc7b%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/a8719782db134ca2bf94534d2eeccc7b/images/large/10.jpg saved to cache
2026-03-26 22:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9123352f-f020-520c-8c81-3f437f438310
2026-03-26 22:49:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9123352f-f020-520c-8c81-3f437f438310, skipping ID generation
2026-03-26 22:49:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9123352f-f020-520c-8c81-3f437f438310 with scrape type 1
2026-03-26 22:49:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9123352f-f020-520c-8c81-3f437f438310 sending to next pipeline
2026-03-26 22:49:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 9123352f-f020-520c-8c81-3f437f438310, identifier: 1985368
2026-03-26 22:49:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7448c10>
2026-03-26 22:49:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b548f02-98e7-5a1f-81a8-5a1c0ec365ed/1b548f02-98e7-5a1f-81a8-5a1c0ec365ed_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fe04969132c254641b899da29b3ac804b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/e04969132c254641b899da29b3ac804b/images/large/1.jpg saved to cache
2026-03-26 22:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1b548f02-98e7-5a1f-81a8-5a1c0ec365ed
2026-03-26 22:49:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1b548f02-98e7-5a1f-81a8-5a1c0ec365ed, skipping ID generation
2026-03-26 22:49:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b548f02-98e7-5a1f-81a8-5a1c0ec365ed with scrape type 1
2026-03-26 22:49:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1b548f02-98e7-5a1f-81a8-5a1c0ec365ed sending to next pipeline
2026-03-26 22:49:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 1b548f02-98e7-5a1f-81a8-5a1c0ec365ed, identifier: 1985366
2026-03-26 22:49:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/d0687add2e9d492c905251dbae34fd52/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/d0687add2e9d492c905251dbae34fd52/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/d0687add2e9d492c905251dbae34fd52/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 9123352f-f020-520c-8c81-3f437f438310 with identifier: 1985368
2026-03-26 22:49:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 9123352f-f020-520c-8c81-3f437f438310 with identifier: 1985368
2026-03-26 22:49:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 9123352f-f020-520c-8c81-3f437f438310 with identifier: 1985368 to the API
2026-03-26 22:49:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:49:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:49:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bb/a8719782db134ca2bf94534d2eeccc7b/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '9123352f-f020-520c-8c81-3f437f438310',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'MINI',
 'model': 'COUNTRYMAN',
 'odometer': 130264,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 20,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9123352f-f020-520c-8c81-3f437f438310/9123352f-f020-520c-8c81-3f437f438310_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 691970,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/a8719782db134ca2bf94534d2eeccc7b/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9123352f-f020-520c-8c81-3f437f438310/9123352f-f020-520c-8c81-3f437f438310_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 646026,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/a8719782db134ca2bf94534d2eeccc7b/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9123352f-f020-520c-8c81-3f437f438310/9123352f-f020-520c-8c81-3f437f438310_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 655394,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/a8719782db134ca2bf94534d2eeccc7b/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9123352f-f020-520c-8c81-3f437f438310/9123352f-f020-520c-8c81-3f437f438310_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 680785,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/a8719782db134ca2bf94534d2eeccc7b/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9123352f-f020-520c-8c81-3f437f438310/9123352f-f020-520c-8c81-3f437f438310_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 617872,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/a8719782db134ca2bf94534d2eeccc7b/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9123352f-f020-520c-8c81-3f437f438310/9123352f-f020-520c-8c81-3f437f438310_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 560187,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/a8719782db134ca2bf94534d2eeccc7b/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9123352f-f020-520c-8c81-3f437f438310/9123352f-f020-520c-8c81-3f437f438310_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 687094,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/a8719782db134ca2bf94534d2eeccc7b/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9123352f-f020-520c-8c81-3f437f438310/9123352f-f020-520c-8c81-3f437f438310_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 686168,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/a8719782db134ca2bf94534d2eeccc7b/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9123352f-f020-520c-8c81-3f437f438310/9123352f-f020-520c-8c81-3f437f438310_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 572493,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/a8719782db134ca2bf94534d2eeccc7b/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9123352f-f020-520c-8c81-3f437f438310/9123352f-f020-520c-8c81-3f437f438310_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 644673,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/a8719782db134ca2bf94534d2eeccc7b/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI COUNTRYMAN 1.5 COOPER S E 4WD AUTO',
 'transmission': 'automatic',
 'trim': '1.5 COOPER S E 4WD AUTO',
 'vin': None,
 'year': 2021}
2026-03-26 22:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985368%27 HTTP/1.1" 200 None
2026-03-26 22:49:43 [ayvens.be] INFO: Saving data for 1985368: {'created_time': 1774565383.184616, 'last_price_update_time': 1774565383.184627, 'auction_closing_time': 1774958400.0}
2026-03-26 22:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985368') HTTP/1.1" 204 0
2026-03-26 22:49:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 1b548f02-98e7-5a1f-81a8-5a1c0ec365ed with identifier: 1985366
2026-03-26 22:49:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 1b548f02-98e7-5a1f-81a8-5a1c0ec365ed with identifier: 1985366
2026-03-26 22:49:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 1b548f02-98e7-5a1f-81a8-5a1c0ec365ed with identifier: 1985366 to the API
2026-03-26 22:49:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:49:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:49:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cv/e04969132c254641b899da29b3ac804b/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '1b548f02-98e7-5a1f-81a8-5a1c0ec365ed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '308 SW',
 'odometer': 84231,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b548f02-98e7-5a1f-81a8-5a1c0ec365ed/1b548f02-98e7-5a1f-81a8-5a1c0ec365ed_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 250504,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/e04969132c254641b899da29b3ac804b/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b548f02-98e7-5a1f-81a8-5a1c0ec365ed/1b548f02-98e7-5a1f-81a8-5a1c0ec365ed_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 238485,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/e04969132c254641b899da29b3ac804b/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b548f02-98e7-5a1f-81a8-5a1c0ec365ed/1b548f02-98e7-5a1f-81a8-5a1c0ec365ed_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 280121,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/e04969132c254641b899da29b3ac804b/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b548f02-98e7-5a1f-81a8-5a1c0ec365ed/1b548f02-98e7-5a1f-81a8-5a1c0ec365ed_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 259419,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/e04969132c254641b899da29b3ac804b/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b548f02-98e7-5a1f-81a8-5a1c0ec365ed/1b548f02-98e7-5a1f-81a8-5a1c0ec365ed_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 247829,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/e04969132c254641b899da29b3ac804b/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b548f02-98e7-5a1f-81a8-5a1c0ec365ed/1b548f02-98e7-5a1f-81a8-5a1c0ec365ed_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 217980,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/e04969132c254641b899da29b3ac804b/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b548f02-98e7-5a1f-81a8-5a1c0ec365ed/1b548f02-98e7-5a1f-81a8-5a1c0ec365ed_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 242295,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/e04969132c254641b899da29b3ac804b/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b548f02-98e7-5a1f-81a8-5a1c0ec365ed/1b548f02-98e7-5a1f-81a8-5a1c0ec365ed_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 394351,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/e04969132c254641b899da29b3ac804b/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b548f02-98e7-5a1f-81a8-5a1c0ec365ed/1b548f02-98e7-5a1f-81a8-5a1c0ec365ed_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 302552,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/e04969132c254641b899da29b3ac804b/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b548f02-98e7-5a1f-81a8-5a1c0ec365ed/1b548f02-98e7-5a1f-81a8-5a1c0ec365ed_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 266641,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/e04969132c254641b899da29b3ac804b/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 308 SW 1.2 PURETECH 81KW S-S ACTIVE PACK',
 'transmission': 'manual',
 'trim': '1.2 PURETECH 81KW S-S ACTIVE PACK',
 'vin': None,
 'year': 2022}
2026-03-26 22:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985366%27 HTTP/1.1" 200 None
2026-03-26 22:49:43 [ayvens.be] INFO: Saving data for 1985366: {'created_time': 1774565383.680601, 'last_price_update_time': 1774565383.680611, 'auction_closing_time': 1774958400.0}
2026-03-26 22:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985366') HTTP/1.1" 204 0
2026-03-26 22:49:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cu/69a50597df894c0fa4afd76723909e0c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:43 [ayvens.be] INFO: Found listing with ID: 1985371
2026-03-26 22:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985371%27 HTTP/1.1" 200 None
2026-03-26 22:49:43 [ayvens.be] INFO: Scrape type for 1985371: 1
2026-03-26 22:49:43 [ayvens.be] INFO: Extracting data for car ID: 1985371
2026-03-26 22:49:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 68726777-665d-5bfe-8065-2c689b768477 with identifier: 1985371
2026-03-26 22:49:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68726777-665d-5bfe-8065-2c689b768477 with scrape type 1
2026-03-26 22:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 68726777-665d-5bfe-8065-2c689b768477
2026-03-26 22:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fec001b79662948e88030ab734ef46c32%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/ec001b79662948e88030ab734ef46c32/images/large/1.jpg not downloaded yet
2026-03-26 22:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fec001b79662948e88030ab734ef46c32%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/ec001b79662948e88030ab734ef46c32/images/large/2.jpg not downloaded yet
2026-03-26 22:49:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c61710>
2026-03-26 22:49:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f59e1dc1-9407-5451-af2c-f810e89334ef/f59e1dc1-9407-5451-af2c-f810e89334ef_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fd0687add2e9d492c905251dbae34fd52%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/d0687add2e9d492c905251dbae34fd52/images/large/7.jpg saved to cache
2026-03-26 22:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f59e1dc1-9407-5451-af2c-f810e89334ef
2026-03-26 22:49:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74092d0>
2026-03-26 22:49:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f59e1dc1-9407-5451-af2c-f810e89334ef/f59e1dc1-9407-5451-af2c-f810e89334ef_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fd0687add2e9d492c905251dbae34fd52%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/d0687add2e9d492c905251dbae34fd52/images/large/6.jpg saved to cache
2026-03-26 22:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f59e1dc1-9407-5451-af2c-f810e89334ef
2026-03-26 22:49:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5ca6f50>
2026-03-26 22:49:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f59e1dc1-9407-5451-af2c-f810e89334ef/f59e1dc1-9407-5451-af2c-f810e89334ef_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fd0687add2e9d492c905251dbae34fd52%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/d0687add2e9d492c905251dbae34fd52/images/large/8.jpg saved to cache
2026-03-26 22:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f59e1dc1-9407-5451-af2c-f810e89334ef
2026-03-26 22:49:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77af290>
2026-03-26 22:49:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f59e1dc1-9407-5451-af2c-f810e89334ef/f59e1dc1-9407-5451-af2c-f810e89334ef_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fd0687add2e9d492c905251dbae34fd52%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/d0687add2e9d492c905251dbae34fd52/images/large/9.jpg saved to cache
2026-03-26 22:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f59e1dc1-9407-5451-af2c-f810e89334ef
2026-03-26 22:49:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79d5610>
2026-03-26 22:49:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f59e1dc1-9407-5451-af2c-f810e89334ef/f59e1dc1-9407-5451-af2c-f810e89334ef_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fd0687add2e9d492c905251dbae34fd52%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/d0687add2e9d492c905251dbae34fd52/images/large/5.jpg saved to cache
2026-03-26 22:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f59e1dc1-9407-5451-af2c-f810e89334ef
2026-03-26 22:49:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77cbb50>
2026-03-26 22:49:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f59e1dc1-9407-5451-af2c-f810e89334ef/f59e1dc1-9407-5451-af2c-f810e89334ef_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fd0687add2e9d492c905251dbae34fd52%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/d0687add2e9d492c905251dbae34fd52/images/large/4.jpg saved to cache
2026-03-26 22:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f59e1dc1-9407-5451-af2c-f810e89334ef
2026-03-26 22:49:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77ac290>
2026-03-26 22:49:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f59e1dc1-9407-5451-af2c-f810e89334ef/f59e1dc1-9407-5451-af2c-f810e89334ef_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fd0687add2e9d492c905251dbae34fd52%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/d0687add2e9d492c905251dbae34fd52/images/large/10.jpg saved to cache
2026-03-26 22:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f59e1dc1-9407-5451-af2c-f810e89334ef
2026-03-26 22:49:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f59e1dc1-9407-5451-af2c-f810e89334ef, skipping ID generation
2026-03-26 22:49:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f59e1dc1-9407-5451-af2c-f810e89334ef with scrape type 1
2026-03-26 22:49:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f59e1dc1-9407-5451-af2c-f810e89334ef sending to next pipeline
2026-03-26 22:49:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f59e1dc1-9407-5451-af2c-f810e89334ef, identifier: 1985369
2026-03-26 22:49:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cu/69a50597df894c0fa4afd76723909e0c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cu/69a50597df894c0fa4afd76723909e0c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fec001b79662948e88030ab734ef46c32%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/ec001b79662948e88030ab734ef46c32/images/large/3.jpg not downloaded yet
2026-03-26 22:49:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f59e1dc1-9407-5451-af2c-f810e89334ef with identifier: 1985369
2026-03-26 22:49:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f59e1dc1-9407-5451-af2c-f810e89334ef with identifier: 1985369
2026-03-26 22:49:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f59e1dc1-9407-5451-af2c-f810e89334ef with identifier: 1985369 to the API
2026-03-26 22:49:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:49:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:49:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bg/d0687add2e9d492c905251dbae34fd52/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 33,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'f59e1dc1-9407-5451-af2c-f810e89334ef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3 Sportback',
 'odometer': 44031,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f59e1dc1-9407-5451-af2c-f810e89334ef/f59e1dc1-9407-5451-af2c-f810e89334ef_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 287342,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/d0687add2e9d492c905251dbae34fd52/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f59e1dc1-9407-5451-af2c-f810e89334ef/f59e1dc1-9407-5451-af2c-f810e89334ef_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 277411,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/d0687add2e9d492c905251dbae34fd52/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f59e1dc1-9407-5451-af2c-f810e89334ef/f59e1dc1-9407-5451-af2c-f810e89334ef_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 295339,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/d0687add2e9d492c905251dbae34fd52/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f59e1dc1-9407-5451-af2c-f810e89334ef/f59e1dc1-9407-5451-af2c-f810e89334ef_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 292634,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/d0687add2e9d492c905251dbae34fd52/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f59e1dc1-9407-5451-af2c-f810e89334ef/f59e1dc1-9407-5451-af2c-f810e89334ef_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 306933,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/d0687add2e9d492c905251dbae34fd52/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f59e1dc1-9407-5451-af2c-f810e89334ef/f59e1dc1-9407-5451-af2c-f810e89334ef_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 317297,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/d0687add2e9d492c905251dbae34fd52/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f59e1dc1-9407-5451-af2c-f810e89334ef/f59e1dc1-9407-5451-af2c-f810e89334ef_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 292790,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/d0687add2e9d492c905251dbae34fd52/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f59e1dc1-9407-5451-af2c-f810e89334ef/f59e1dc1-9407-5451-af2c-f810e89334ef_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 364968,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/d0687add2e9d492c905251dbae34fd52/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f59e1dc1-9407-5451-af2c-f810e89334ef/f59e1dc1-9407-5451-af2c-f810e89334ef_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 352219,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/d0687add2e9d492c905251dbae34fd52/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f59e1dc1-9407-5451-af2c-f810e89334ef/f59e1dc1-9407-5451-af2c-f810e89334ef_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 309909,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/d0687add2e9d492c905251dbae34fd52/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 Sportback 1.4 45 TFSI E S TRONIC',
 'transmission': 'automatic',
 'trim': '1.4 45 TFSI E S TRONIC',
 'vin': None,
 'year': 2021}
2026-03-26 22:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985369%27 HTTP/1.1" 200 None
2026-03-26 22:49:44 [ayvens.be] INFO: Saving data for 1985369: {'created_time': 1774565384.747387, 'last_price_update_time': 1774565384.747397, 'auction_closing_time': 1774958400.0}
2026-03-26 22:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985369') HTTP/1.1" 204 0
2026-03-26 22:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fec001b79662948e88030ab734ef46c32%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/ec001b79662948e88030ab734ef46c32/images/large/4.jpg not downloaded yet
2026-03-26 22:49:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b728dcd0>
2026-03-26 22:49:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc62ded9-a378-5b04-aa3f-1ff811f2e715/bc62ded9-a378-5b04-aa3f-1ff811f2e715_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F69a50597df894c0fa4afd76723909e0c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/69a50597df894c0fa4afd76723909e0c/images/large/3.jpg saved to cache
2026-03-26 22:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bc62ded9-a378-5b04-aa3f-1ff811f2e715
2026-03-26 22:49:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dw/5c52afb6c58a4671aa6fffda8ecaabb7/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fec001b79662948e88030ab734ef46c32%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/ec001b79662948e88030ab734ef46c32/images/large/5.jpg not downloaded yet
2026-03-26 22:49:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b728f290>
2026-03-26 22:49:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc62ded9-a378-5b04-aa3f-1ff811f2e715/bc62ded9-a378-5b04-aa3f-1ff811f2e715_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F69a50597df894c0fa4afd76723909e0c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/69a50597df894c0fa4afd76723909e0c/images/large/2.jpg saved to cache
2026-03-26 22:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bc62ded9-a378-5b04-aa3f-1ff811f2e715
2026-03-26 22:49:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79d6a10>
2026-03-26 22:49:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc62ded9-a378-5b04-aa3f-1ff811f2e715/bc62ded9-a378-5b04-aa3f-1ff811f2e715_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F69a50597df894c0fa4afd76723909e0c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/69a50597df894c0fa4afd76723909e0c/images/large/1.jpg saved to cache
2026-03-26 22:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bc62ded9-a378-5b04-aa3f-1ff811f2e715
2026-03-26 22:49:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cu/69a50597df894c0fa4afd76723909e0c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cu/69a50597df894c0fa4afd76723909e0c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cu/69a50597df894c0fa4afd76723909e0c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cu/69a50597df894c0fa4afd76723909e0c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/a0473f3c80ca44afb7f9166e291890fc/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fec001b79662948e88030ab734ef46c32%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/ec001b79662948e88030ab734ef46c32/images/large/6.jpg not downloaded yet
2026-03-26 22:49:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74b56d0>
2026-03-26 22:49:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f18e9342-4f12-553c-b02c-5645e403a20a/f18e9342-4f12-553c-b02c-5645e403a20a_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dw%252F5c52afb6c58a4671aa6fffda8ecaabb7%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dw/5c52afb6c58a4671aa6fffda8ecaabb7/images/large/6.jpg saved to cache
2026-03-26 22:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f18e9342-4f12-553c-b02c-5645e403a20a
2026-03-26 22:49:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f18e9342-4f12-553c-b02c-5645e403a20a, skipping ID generation
2026-03-26 22:49:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f18e9342-4f12-553c-b02c-5645e403a20a with scrape type 1
2026-03-26 22:49:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f18e9342-4f12-553c-b02c-5645e403a20a sending to next pipeline
2026-03-26 22:49:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f18e9342-4f12-553c-b02c-5645e403a20a, identifier: 1985365
2026-03-26 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fec001b79662948e88030ab734ef46c32%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/ec001b79662948e88030ab734ef46c32/images/large/7.jpg not downloaded yet
2026-03-26 22:49:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f18e9342-4f12-553c-b02c-5645e403a20a with identifier: 1985365
2026-03-26 22:49:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f18e9342-4f12-553c-b02c-5645e403a20a with identifier: 1985365
2026-03-26 22:49:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f18e9342-4f12-553c-b02c-5645e403a20a with identifier: 1985365 to the API
2026-03-26 22:49:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:49:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:49:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2dw/5c52afb6c58a4671aa6fffda8ecaabb7/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'f18e9342-4f12-553c-b02c-5645e403a20a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF VIII',
 'odometer': 83319,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f18e9342-4f12-553c-b02c-5645e403a20a/f18e9342-4f12-553c-b02c-5645e403a20a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 635888,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dw/5c52afb6c58a4671aa6fffda8ecaabb7/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f18e9342-4f12-553c-b02c-5645e403a20a/f18e9342-4f12-553c-b02c-5645e403a20a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 649755,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dw/5c52afb6c58a4671aa6fffda8ecaabb7/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f18e9342-4f12-553c-b02c-5645e403a20a/f18e9342-4f12-553c-b02c-5645e403a20a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 717930,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dw/5c52afb6c58a4671aa6fffda8ecaabb7/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f18e9342-4f12-553c-b02c-5645e403a20a/f18e9342-4f12-553c-b02c-5645e403a20a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 649553,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dw/5c52afb6c58a4671aa6fffda8ecaabb7/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f18e9342-4f12-553c-b02c-5645e403a20a/f18e9342-4f12-553c-b02c-5645e403a20a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 609697,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dw/5c52afb6c58a4671aa6fffda8ecaabb7/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f18e9342-4f12-553c-b02c-5645e403a20a/f18e9342-4f12-553c-b02c-5645e403a20a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 573722,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dw/5c52afb6c58a4671aa6fffda8ecaabb7/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f18e9342-4f12-553c-b02c-5645e403a20a/f18e9342-4f12-553c-b02c-5645e403a20a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 630755,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dw/5c52afb6c58a4671aa6fffda8ecaabb7/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f18e9342-4f12-553c-b02c-5645e403a20a/f18e9342-4f12-553c-b02c-5645e403a20a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 619274,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dw/5c52afb6c58a4671aa6fffda8ecaabb7/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f18e9342-4f12-553c-b02c-5645e403a20a/f18e9342-4f12-553c-b02c-5645e403a20a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 621306,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dw/5c52afb6c58a4671aa6fffda8ecaabb7/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f18e9342-4f12-553c-b02c-5645e403a20a/f18e9342-4f12-553c-b02c-5645e403a20a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 553635,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dw/5c52afb6c58a4671aa6fffda8ecaabb7/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF VIII 1.4 EHYBRID STYLE BUSINESS DSG',
 'transmission': 'automatic',
 'trim': '1.4 EHYBRID STYLE BUSINESS DSG',
 'vin': None,
 'year': 2023}
2026-03-26 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985365%27 HTTP/1.1" 200 None
2026-03-26 22:49:45 [ayvens.be] INFO: Saving data for 1985365: {'created_time': 1774565385.547872, 'last_price_update_time': 1774565385.547883, 'auction_closing_time': 1774958400.0}
2026-03-26 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985365') HTTP/1.1" 204 0
2026-03-26 22:49:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cu/69a50597df894c0fa4afd76723909e0c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cu/69a50597df894c0fa4afd76723909e0c/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fec001b79662948e88030ab734ef46c32%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/ec001b79662948e88030ab734ef46c32/images/large/8.jpg not downloaded yet
2026-03-26 22:49:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e4cb50>
2026-03-26 22:49:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc62ded9-a378-5b04-aa3f-1ff811f2e715/bc62ded9-a378-5b04-aa3f-1ff811f2e715_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F69a50597df894c0fa4afd76723909e0c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/69a50597df894c0fa4afd76723909e0c/images/large/4.jpg saved to cache
2026-03-26 22:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bc62ded9-a378-5b04-aa3f-1ff811f2e715
2026-03-26 22:49:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7573290>
2026-03-26 22:49:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc62ded9-a378-5b04-aa3f-1ff811f2e715/bc62ded9-a378-5b04-aa3f-1ff811f2e715_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F69a50597df894c0fa4afd76723909e0c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/69a50597df894c0fa4afd76723909e0c/images/large/5.jpg saved to cache
2026-03-26 22:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bc62ded9-a378-5b04-aa3f-1ff811f2e715
2026-03-26 22:49:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77ac0d0>
2026-03-26 22:49:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc62ded9-a378-5b04-aa3f-1ff811f2e715/bc62ded9-a378-5b04-aa3f-1ff811f2e715_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F69a50597df894c0fa4afd76723909e0c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/69a50597df894c0fa4afd76723909e0c/images/large/7.jpg saved to cache
2026-03-26 22:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bc62ded9-a378-5b04-aa3f-1ff811f2e715
2026-03-26 22:49:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd0cf990>
2026-03-26 22:49:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc62ded9-a378-5b04-aa3f-1ff811f2e715/bc62ded9-a378-5b04-aa3f-1ff811f2e715_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F69a50597df894c0fa4afd76723909e0c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/69a50597df894c0fa4afd76723909e0c/images/large/6.jpg saved to cache
2026-03-26 22:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bc62ded9-a378-5b04-aa3f-1ff811f2e715
2026-03-26 22:49:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7413550>
2026-03-26 22:49:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76552fd3-b338-580f-b2a5-4128d2e47df3/76552fd3-b338-580f-b2a5-4128d2e47df3_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fa0473f3c80ca44afb7f9166e291890fc%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/a0473f3c80ca44afb7f9166e291890fc/images/large/7.jpg saved to cache
2026-03-26 22:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 76552fd3-b338-580f-b2a5-4128d2e47df3
2026-03-26 22:49:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 76552fd3-b338-580f-b2a5-4128d2e47df3, skipping ID generation
2026-03-26 22:49:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76552fd3-b338-580f-b2a5-4128d2e47df3 with scrape type 1
2026-03-26 22:49:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 76552fd3-b338-580f-b2a5-4128d2e47df3 sending to next pipeline
2026-03-26 22:49:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 76552fd3-b338-580f-b2a5-4128d2e47df3, identifier: 1985360
2026-03-26 22:49:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 76552fd3-b338-580f-b2a5-4128d2e47df3 with identifier: 1985360
2026-03-26 22:49:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 76552fd3-b338-580f-b2a5-4128d2e47df3 with identifier: 1985360
2026-03-26 22:49:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 76552fd3-b338-580f-b2a5-4128d2e47df3 with identifier: 1985360 to the API
2026-03-26 22:49:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:49:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:49:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bm/a0473f3c80ca44afb7f9166e291890fc/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '76552fd3-b338-580f-b2a5-4128d2e47df3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 92640,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76552fd3-b338-580f-b2a5-4128d2e47df3/76552fd3-b338-580f-b2a5-4128d2e47df3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 621165,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/a0473f3c80ca44afb7f9166e291890fc/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76552fd3-b338-580f-b2a5-4128d2e47df3/76552fd3-b338-580f-b2a5-4128d2e47df3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 653185,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/a0473f3c80ca44afb7f9166e291890fc/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76552fd3-b338-580f-b2a5-4128d2e47df3/76552fd3-b338-580f-b2a5-4128d2e47df3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 613188,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/a0473f3c80ca44afb7f9166e291890fc/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76552fd3-b338-580f-b2a5-4128d2e47df3/76552fd3-b338-580f-b2a5-4128d2e47df3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 643023,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/a0473f3c80ca44afb7f9166e291890fc/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76552fd3-b338-580f-b2a5-4128d2e47df3/76552fd3-b338-580f-b2a5-4128d2e47df3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 638062,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/a0473f3c80ca44afb7f9166e291890fc/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76552fd3-b338-580f-b2a5-4128d2e47df3/76552fd3-b338-580f-b2a5-4128d2e47df3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 723148,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/a0473f3c80ca44afb7f9166e291890fc/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76552fd3-b338-580f-b2a5-4128d2e47df3/76552fd3-b338-580f-b2a5-4128d2e47df3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 700378,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/a0473f3c80ca44afb7f9166e291890fc/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76552fd3-b338-580f-b2a5-4128d2e47df3/76552fd3-b338-580f-b2a5-4128d2e47df3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 835695,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/a0473f3c80ca44afb7f9166e291890fc/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76552fd3-b338-580f-b2a5-4128d2e47df3/76552fd3-b338-580f-b2a5-4128d2e47df3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 804739,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/a0473f3c80ca44afb7f9166e291890fc/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76552fd3-b338-580f-b2a5-4128d2e47df3/76552fd3-b338-580f-b2a5-4128d2e47df3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 818372,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/a0473f3c80ca44afb7f9166e291890fc/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 2008 1.5 BLUEHDI 81KW S-S STYLE',
 'transmission': 'manual',
 'trim': '1.5 BLUEHDI 81KW S-S STYLE',
 'vin': None,
 'year': 2022}
2026-03-26 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985360%27 HTTP/1.1" 200 None
2026-03-26 22:49:46 [ayvens.be] INFO: Saving data for 1985360: {'created_time': 1774565386.427301, 'last_price_update_time': 1774565386.427311, 'auction_closing_time': 1774958400.0}
2026-03-26 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985360') HTTP/1.1" 204 0
2026-03-26 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fec001b79662948e88030ab734ef46c32%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/ec001b79662948e88030ab734ef46c32/images/large/9.jpg not downloaded yet
2026-03-26 22:49:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7435310>
2026-03-26 22:49:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc62ded9-a378-5b04-aa3f-1ff811f2e715/bc62ded9-a378-5b04-aa3f-1ff811f2e715_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F69a50597df894c0fa4afd76723909e0c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/69a50597df894c0fa4afd76723909e0c/images/large/8.jpg saved to cache
2026-03-26 22:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bc62ded9-a378-5b04-aa3f-1ff811f2e715
2026-03-26 22:49:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74937d0>
2026-03-26 22:49:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc62ded9-a378-5b04-aa3f-1ff811f2e715/bc62ded9-a378-5b04-aa3f-1ff811f2e715_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F69a50597df894c0fa4afd76723909e0c%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/69a50597df894c0fa4afd76723909e0c/images/large/9.jpg saved to cache
2026-03-26 22:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bc62ded9-a378-5b04-aa3f-1ff811f2e715
2026-03-26 22:49:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cu/69a50597df894c0fa4afd76723909e0c/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fec001b79662948e88030ab734ef46c32%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/ec001b79662948e88030ab734ef46c32/images/large/10.jpg not downloaded yet
2026-03-26 22:49:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/ec001b79662948e88030ab734ef46c32/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/ec001b79662948e88030ab734ef46c32/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/ec001b79662948e88030ab734ef46c32/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/ec001b79662948e88030ab734ef46c32/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:46 [ayvens.be] INFO: Found listing with ID: 1985372
2026-03-26 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985372%27 HTTP/1.1" 200 None
2026-03-26 22:49:46 [ayvens.be] INFO: Scrape type for 1985372: 1
2026-03-26 22:49:46 [ayvens.be] INFO: Extracting data for car ID: 1985372
2026-03-26 22:49:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b4a4a85-7e3f-53c3-a306-36048b1efecf with identifier: 1985372
2026-03-26 22:49:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b4a4a85-7e3f-53c3-a306-36048b1efecf with scrape type 1
2026-03-26 22:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9b4a4a85-7e3f-53c3-a306-36048b1efecf
2026-03-26 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dn%252Fda511df0c4614ccda19cfb55f83aa9ff%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dn/da511df0c4614ccda19cfb55f83aa9ff/images/large/1.jpg not downloaded yet
2026-03-26 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dn%252Fda511df0c4614ccda19cfb55f83aa9ff%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dn/da511df0c4614ccda19cfb55f83aa9ff/images/large/2.jpg not downloaded yet
2026-03-26 22:49:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/ec001b79662948e88030ab734ef46c32/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7a63690>
2026-03-26 22:49:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc62ded9-a378-5b04-aa3f-1ff811f2e715/bc62ded9-a378-5b04-aa3f-1ff811f2e715_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F69a50597df894c0fa4afd76723909e0c%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/69a50597df894c0fa4afd76723909e0c/images/large/10.jpg saved to cache
2026-03-26 22:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bc62ded9-a378-5b04-aa3f-1ff811f2e715
2026-03-26 22:49:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bc62ded9-a378-5b04-aa3f-1ff811f2e715, skipping ID generation
2026-03-26 22:49:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc62ded9-a378-5b04-aa3f-1ff811f2e715 with scrape type 1
2026-03-26 22:49:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bc62ded9-a378-5b04-aa3f-1ff811f2e715 sending to next pipeline
2026-03-26 22:49:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: bc62ded9-a378-5b04-aa3f-1ff811f2e715, identifier: 1985370
2026-03-26 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dn%252Fda511df0c4614ccda19cfb55f83aa9ff%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dn/da511df0c4614ccda19cfb55f83aa9ff/images/large/3.jpg not downloaded yet
2026-03-26 22:49:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: bc62ded9-a378-5b04-aa3f-1ff811f2e715 with identifier: 1985370
2026-03-26 22:49:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: bc62ded9-a378-5b04-aa3f-1ff811f2e715 with identifier: 1985370
2026-03-26 22:49:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: bc62ded9-a378-5b04-aa3f-1ff811f2e715 with identifier: 1985370 to the API
2026-03-26 22:49:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:49:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:49:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cu/69a50597df894c0fa4afd76723909e0c/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 35,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'bc62ded9-a378-5b04-aa3f-1ff811f2e715',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'DS AUTOMOBILES',
 'model': 'DS 7 CROSSBACK',
 'odometer': 148610,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc62ded9-a378-5b04-aa3f-1ff811f2e715/bc62ded9-a378-5b04-aa3f-1ff811f2e715_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 261998,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cu/69a50597df894c0fa4afd76723909e0c/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc62ded9-a378-5b04-aa3f-1ff811f2e715/bc62ded9-a378-5b04-aa3f-1ff811f2e715_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 267498,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cu/69a50597df894c0fa4afd76723909e0c/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc62ded9-a378-5b04-aa3f-1ff811f2e715/bc62ded9-a378-5b04-aa3f-1ff811f2e715_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 293435,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cu/69a50597df894c0fa4afd76723909e0c/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc62ded9-a378-5b04-aa3f-1ff811f2e715/bc62ded9-a378-5b04-aa3f-1ff811f2e715_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 279040,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cu/69a50597df894c0fa4afd76723909e0c/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc62ded9-a378-5b04-aa3f-1ff811f2e715/bc62ded9-a378-5b04-aa3f-1ff811f2e715_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 291120,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cu/69a50597df894c0fa4afd76723909e0c/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc62ded9-a378-5b04-aa3f-1ff811f2e715/bc62ded9-a378-5b04-aa3f-1ff811f2e715_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 266208,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cu/69a50597df894c0fa4afd76723909e0c/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc62ded9-a378-5b04-aa3f-1ff811f2e715/bc62ded9-a378-5b04-aa3f-1ff811f2e715_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 277816,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cu/69a50597df894c0fa4afd76723909e0c/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc62ded9-a378-5b04-aa3f-1ff811f2e715/bc62ded9-a378-5b04-aa3f-1ff811f2e715_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 365896,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cu/69a50597df894c0fa4afd76723909e0c/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc62ded9-a378-5b04-aa3f-1ff811f2e715/bc62ded9-a378-5b04-aa3f-1ff811f2e715_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 363018,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cu/69a50597df894c0fa4afd76723909e0c/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc62ded9-a378-5b04-aa3f-1ff811f2e715/bc62ded9-a378-5b04-aa3f-1ff811f2e715_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 354759,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cu/69a50597df894c0fa4afd76723909e0c/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DS AUTOMOBILES DS 7 CROSSBACK 1.6 PHEV 225 BASTILLE + AUTO',
 'transmission': 'automatic',
 'trim': '1.6 PHEV 225 BASTILLE + AUTO',
 'vin': None,
 'year': 2022}
2026-03-26 22:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985370%27 HTTP/1.1" 200 None
2026-03-26 22:49:47 [ayvens.be] INFO: Saving data for 1985370: {'created_time': 1774565387.364909, 'last_price_update_time': 1774565387.36492, 'auction_closing_time': 1774958400.0}
2026-03-26 22:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985370') HTTP/1.1" 204 0
2026-03-26 22:49:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7434cd0>
2026-03-26 22:49:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68726777-665d-5bfe-8065-2c689b768477/68726777-665d-5bfe-8065-2c689b768477_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fec001b79662948e88030ab734ef46c32%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/ec001b79662948e88030ab734ef46c32/images/large/2.jpg saved to cache
2026-03-26 22:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 68726777-665d-5bfe-8065-2c689b768477
2026-03-26 22:49:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e3cd10>
2026-03-26 22:49:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68726777-665d-5bfe-8065-2c689b768477/68726777-665d-5bfe-8065-2c689b768477_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fec001b79662948e88030ab734ef46c32%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/ec001b79662948e88030ab734ef46c32/images/large/3.jpg saved to cache
2026-03-26 22:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 68726777-665d-5bfe-8065-2c689b768477
2026-03-26 22:49:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76c4e90>
2026-03-26 22:49:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68726777-665d-5bfe-8065-2c689b768477/68726777-665d-5bfe-8065-2c689b768477_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fec001b79662948e88030ab734ef46c32%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/ec001b79662948e88030ab734ef46c32/images/large/1.jpg saved to cache
2026-03-26 22:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 68726777-665d-5bfe-8065-2c689b768477
2026-03-26 22:49:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd0cf3d0>
2026-03-26 22:49:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68726777-665d-5bfe-8065-2c689b768477/68726777-665d-5bfe-8065-2c689b768477_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fec001b79662948e88030ab734ef46c32%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/ec001b79662948e88030ab734ef46c32/images/large/4.jpg saved to cache
2026-03-26 22:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 68726777-665d-5bfe-8065-2c689b768477
2026-03-26 22:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dn%252Fda511df0c4614ccda19cfb55f83aa9ff%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dn/da511df0c4614ccda19cfb55f83aa9ff/images/large/4.jpg not downloaded yet
2026-03-26 22:49:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd0aff90>
2026-03-26 22:49:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68726777-665d-5bfe-8065-2c689b768477/68726777-665d-5bfe-8065-2c689b768477_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fec001b79662948e88030ab734ef46c32%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/ec001b79662948e88030ab734ef46c32/images/large/5.jpg saved to cache
2026-03-26 22:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 68726777-665d-5bfe-8065-2c689b768477
2026-03-26 22:49:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/ec001b79662948e88030ab734ef46c32/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/ec001b79662948e88030ab734ef46c32/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dn%252Fda511df0c4614ccda19cfb55f83aa9ff%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dn/da511df0c4614ccda19cfb55f83aa9ff/images/large/5.jpg not downloaded yet
2026-03-26 22:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dn%252Fda511df0c4614ccda19cfb55f83aa9ff%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dn/da511df0c4614ccda19cfb55f83aa9ff/images/large/6.jpg not downloaded yet
2026-03-26 22:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dn%252Fda511df0c4614ccda19cfb55f83aa9ff%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dn/da511df0c4614ccda19cfb55f83aa9ff/images/large/7.jpg not downloaded yet
2026-03-26 22:49:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/ec001b79662948e88030ab734ef46c32/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dn%252Fda511df0c4614ccda19cfb55f83aa9ff%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dn/da511df0c4614ccda19cfb55f83aa9ff/images/large/8.jpg not downloaded yet
2026-03-26 22:49:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/ec001b79662948e88030ab734ef46c32/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/ec001b79662948e88030ab734ef46c32/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dn/da511df0c4614ccda19cfb55f83aa9ff/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dn%252Fda511df0c4614ccda19cfb55f83aa9ff%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dn/da511df0c4614ccda19cfb55f83aa9ff/images/large/9.jpg not downloaded yet
2026-03-26 22:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dn%252Fda511df0c4614ccda19cfb55f83aa9ff%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dn/da511df0c4614ccda19cfb55f83aa9ff/images/large/10.jpg not downloaded yet
2026-03-26 22:49:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7412650>
2026-03-26 22:49:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68726777-665d-5bfe-8065-2c689b768477/68726777-665d-5bfe-8065-2c689b768477_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fec001b79662948e88030ab734ef46c32%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/ec001b79662948e88030ab734ef46c32/images/large/6.jpg saved to cache
2026-03-26 22:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 68726777-665d-5bfe-8065-2c689b768477
2026-03-26 22:49:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dn/da511df0c4614ccda19cfb55f83aa9ff/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:48 [ayvens.be] INFO: Found listing with ID: 1985373
2026-03-26 22:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985373%27 HTTP/1.1" 200 None
2026-03-26 22:49:48 [ayvens.be] INFO: Scrape type for 1985373: 1
2026-03-26 22:49:48 [ayvens.be] INFO: Extracting data for car ID: 1985373
2026-03-26 22:49:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18979b1a-ad2b-58fb-9f7b-baea2c3543a8 with identifier: 1985373
2026-03-26 22:49:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18979b1a-ad2b-58fb-9f7b-baea2c3543a8 with scrape type 1
2026-03-26 22:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 18979b1a-ad2b-58fb-9f7b-baea2c3543a8
2026-03-26 22:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fab215018495748f2b144fb4aadddb6f9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/ab215018495748f2b144fb4aadddb6f9/images/large/1.jpg not downloaded yet
2026-03-26 22:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fab215018495748f2b144fb4aadddb6f9%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/ab215018495748f2b144fb4aadddb6f9/images/large/2.jpg not downloaded yet
2026-03-26 22:49:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cc2550>
2026-03-26 22:49:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68726777-665d-5bfe-8065-2c689b768477/68726777-665d-5bfe-8065-2c689b768477_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fec001b79662948e88030ab734ef46c32%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/ec001b79662948e88030ab734ef46c32/images/large/7.jpg saved to cache
2026-03-26 22:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 68726777-665d-5bfe-8065-2c689b768477
2026-03-26 22:49:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7771b90>
2026-03-26 22:49:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68726777-665d-5bfe-8065-2c689b768477/68726777-665d-5bfe-8065-2c689b768477_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fec001b79662948e88030ab734ef46c32%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/ec001b79662948e88030ab734ef46c32/images/large/8.jpg saved to cache
2026-03-26 22:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 68726777-665d-5bfe-8065-2c689b768477
2026-03-26 22:49:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c6be10>
2026-03-26 22:49:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68726777-665d-5bfe-8065-2c689b768477/68726777-665d-5bfe-8065-2c689b768477_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fec001b79662948e88030ab734ef46c32%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/ec001b79662948e88030ab734ef46c32/images/large/10.jpg saved to cache
2026-03-26 22:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 68726777-665d-5bfe-8065-2c689b768477
2026-03-26 22:49:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7a622d0>
2026-03-26 22:49:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68726777-665d-5bfe-8065-2c689b768477/68726777-665d-5bfe-8065-2c689b768477_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fec001b79662948e88030ab734ef46c32%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/ec001b79662948e88030ab734ef46c32/images/large/9.jpg saved to cache
2026-03-26 22:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 68726777-665d-5bfe-8065-2c689b768477
2026-03-26 22:49:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 68726777-665d-5bfe-8065-2c689b768477, skipping ID generation
2026-03-26 22:49:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68726777-665d-5bfe-8065-2c689b768477 with scrape type 1
2026-03-26 22:49:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 68726777-665d-5bfe-8065-2c689b768477 sending to next pipeline
2026-03-26 22:49:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 68726777-665d-5bfe-8065-2c689b768477, identifier: 1985371
2026-03-26 22:49:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6ddaf90>
2026-03-26 22:49:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b4a4a85-7e3f-53c3-a306-36048b1efecf/9b4a4a85-7e3f-53c3-a306-36048b1efecf_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dn%252Fda511df0c4614ccda19cfb55f83aa9ff%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dn/da511df0c4614ccda19cfb55f83aa9ff/images/large/1.jpg saved to cache
2026-03-26 22:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9b4a4a85-7e3f-53c3-a306-36048b1efecf
2026-03-26 22:49:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 68726777-665d-5bfe-8065-2c689b768477 with identifier: 1985371
2026-03-26 22:49:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 68726777-665d-5bfe-8065-2c689b768477 with identifier: 1985371
2026-03-26 22:49:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 68726777-665d-5bfe-8065-2c689b768477 with identifier: 1985371 to the API
2026-03-26 22:49:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:49:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:49:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bf/ec001b79662948e88030ab734ef46c32/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 30,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '68726777-665d-5bfe-8065-2c689b768477',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'ARTEON',
 'odometer': 112884,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 20,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68726777-665d-5bfe-8065-2c689b768477/68726777-665d-5bfe-8065-2c689b768477_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 507783,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/ec001b79662948e88030ab734ef46c32/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68726777-665d-5bfe-8065-2c689b768477/68726777-665d-5bfe-8065-2c689b768477_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 471770,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/ec001b79662948e88030ab734ef46c32/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68726777-665d-5bfe-8065-2c689b768477/68726777-665d-5bfe-8065-2c689b768477_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 495040,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/ec001b79662948e88030ab734ef46c32/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68726777-665d-5bfe-8065-2c689b768477/68726777-665d-5bfe-8065-2c689b768477_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 500732,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/ec001b79662948e88030ab734ef46c32/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68726777-665d-5bfe-8065-2c689b768477/68726777-665d-5bfe-8065-2c689b768477_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 500315,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/ec001b79662948e88030ab734ef46c32/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68726777-665d-5bfe-8065-2c689b768477/68726777-665d-5bfe-8065-2c689b768477_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 740818,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/ec001b79662948e88030ab734ef46c32/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68726777-665d-5bfe-8065-2c689b768477/68726777-665d-5bfe-8065-2c689b768477_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 619445,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/ec001b79662948e88030ab734ef46c32/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68726777-665d-5bfe-8065-2c689b768477/68726777-665d-5bfe-8065-2c689b768477_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 752031,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/ec001b79662948e88030ab734ef46c32/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68726777-665d-5bfe-8065-2c689b768477/68726777-665d-5bfe-8065-2c689b768477_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 762635,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/ec001b79662948e88030ab734ef46c32/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68726777-665d-5bfe-8065-2c689b768477/68726777-665d-5bfe-8065-2c689b768477_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 678590,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/ec001b79662948e88030ab734ef46c32/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN ARTEON 1.4 EHYBRID DSG R-LINE',
 'transmission': 'automatic',
 'trim': '1.4 EHYBRID DSG R-LINE',
 'vin': None,
 'year': 2021}
2026-03-26 22:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985371%27 HTTP/1.1" 200 None
2026-03-26 22:49:49 [ayvens.be] INFO: Saving data for 1985371: {'created_time': 1774565389.211242, 'last_price_update_time': 1774565389.211252, 'auction_closing_time': 1774958400.0}
2026-03-26 22:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985371') HTTP/1.1" 204 0
2026-03-26 22:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fab215018495748f2b144fb4aadddb6f9%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/ab215018495748f2b144fb4aadddb6f9/images/large/3.jpg not downloaded yet
2026-03-26 22:49:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c75610>
2026-03-26 22:49:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b4a4a85-7e3f-53c3-a306-36048b1efecf/9b4a4a85-7e3f-53c3-a306-36048b1efecf_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dn%252Fda511df0c4614ccda19cfb55f83aa9ff%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dn/da511df0c4614ccda19cfb55f83aa9ff/images/large/2.jpg saved to cache
2026-03-26 22:49:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9b4a4a85-7e3f-53c3-a306-36048b1efecf
2026-03-26 22:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fab215018495748f2b144fb4aadddb6f9%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/ab215018495748f2b144fb4aadddb6f9/images/large/4.jpg not downloaded yet
2026-03-26 22:49:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dn/da511df0c4614ccda19cfb55f83aa9ff/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dn/da511df0c4614ccda19cfb55f83aa9ff/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fab215018495748f2b144fb4aadddb6f9%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/ab215018495748f2b144fb4aadddb6f9/images/large/5.jpg not downloaded yet
2026-03-26 22:49:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dn/da511df0c4614ccda19cfb55f83aa9ff/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dn/da511df0c4614ccda19cfb55f83aa9ff/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fab215018495748f2b144fb4aadddb6f9%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/ab215018495748f2b144fb4aadddb6f9/images/large/6.jpg not downloaded yet
2026-03-26 22:49:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dn/da511df0c4614ccda19cfb55f83aa9ff/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dn/da511df0c4614ccda19cfb55f83aa9ff/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fab215018495748f2b144fb4aadddb6f9%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/ab215018495748f2b144fb4aadddb6f9/images/large/7.jpg not downloaded yet
2026-03-26 22:49:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dn/da511df0c4614ccda19cfb55f83aa9ff/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/ab215018495748f2b144fb4aadddb6f9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fab215018495748f2b144fb4aadddb6f9%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/ab215018495748f2b144fb4aadddb6f9/images/large/8.jpg not downloaded yet
2026-03-26 22:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fab215018495748f2b144fb4aadddb6f9%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/ab215018495748f2b144fb4aadddb6f9/images/large/9.jpg not downloaded yet
2026-03-26 22:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fab215018495748f2b144fb4aadddb6f9%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/ab215018495748f2b144fb4aadddb6f9/images/large/10.jpg not downloaded yet
2026-03-26 22:49:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e1e250>
2026-03-26 22:49:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b4a4a85-7e3f-53c3-a306-36048b1efecf/9b4a4a85-7e3f-53c3-a306-36048b1efecf_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dn%252Fda511df0c4614ccda19cfb55f83aa9ff%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dn/da511df0c4614ccda19cfb55f83aa9ff/images/large/4.jpg saved to cache
2026-03-26 22:49:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9b4a4a85-7e3f-53c3-a306-36048b1efecf
2026-03-26 22:49:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77ade90>
2026-03-26 22:49:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b4a4a85-7e3f-53c3-a306-36048b1efecf/9b4a4a85-7e3f-53c3-a306-36048b1efecf_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dn%252Fda511df0c4614ccda19cfb55f83aa9ff%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dn/da511df0c4614ccda19cfb55f83aa9ff/images/large/3.jpg saved to cache
2026-03-26 22:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9b4a4a85-7e3f-53c3-a306-36048b1efecf
2026-03-26 22:49:50 [ayvens.be] INFO: Found listing with ID: 1985374
2026-03-26 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985374%27 HTTP/1.1" 200 None
2026-03-26 22:49:50 [ayvens.be] INFO: Scrape type for 1985374: 1
2026-03-26 22:49:50 [ayvens.be] INFO: Extracting data for car ID: 1985374
2026-03-26 22:49:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0 with identifier: 1985374
2026-03-26 22:49:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0 with scrape type 1
2026-03-26 22:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0
2026-03-26 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F1388a3b859ed4109830c56362c06a1c0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/1388a3b859ed4109830c56362c06a1c0/images/large/1.jpg not downloaded yet
2026-03-26 22:49:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b764ad90>
2026-03-26 22:49:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b4a4a85-7e3f-53c3-a306-36048b1efecf/9b4a4a85-7e3f-53c3-a306-36048b1efecf_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dn%252Fda511df0c4614ccda19cfb55f83aa9ff%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dn/da511df0c4614ccda19cfb55f83aa9ff/images/large/7.jpg saved to cache
2026-03-26 22:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9b4a4a85-7e3f-53c3-a306-36048b1efecf
2026-03-26 22:49:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74064d0>
2026-03-26 22:49:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b4a4a85-7e3f-53c3-a306-36048b1efecf/9b4a4a85-7e3f-53c3-a306-36048b1efecf_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dn%252Fda511df0c4614ccda19cfb55f83aa9ff%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dn/da511df0c4614ccda19cfb55f83aa9ff/images/large/8.jpg saved to cache
2026-03-26 22:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9b4a4a85-7e3f-53c3-a306-36048b1efecf
2026-03-26 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F1388a3b859ed4109830c56362c06a1c0%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/1388a3b859ed4109830c56362c06a1c0/images/large/2.jpg not downloaded yet
2026-03-26 22:49:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b72eca50>
2026-03-26 22:49:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b4a4a85-7e3f-53c3-a306-36048b1efecf/9b4a4a85-7e3f-53c3-a306-36048b1efecf_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dn%252Fda511df0c4614ccda19cfb55f83aa9ff%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dn/da511df0c4614ccda19cfb55f83aa9ff/images/large/5.jpg saved to cache
2026-03-26 22:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9b4a4a85-7e3f-53c3-a306-36048b1efecf
2026-03-26 22:49:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c94dd0>
2026-03-26 22:49:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b4a4a85-7e3f-53c3-a306-36048b1efecf/9b4a4a85-7e3f-53c3-a306-36048b1efecf_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dn%252Fda511df0c4614ccda19cfb55f83aa9ff%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dn/da511df0c4614ccda19cfb55f83aa9ff/images/large/6.jpg saved to cache
2026-03-26 22:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9b4a4a85-7e3f-53c3-a306-36048b1efecf
2026-03-26 22:49:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5ca4950>
2026-03-26 22:49:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b4a4a85-7e3f-53c3-a306-36048b1efecf/9b4a4a85-7e3f-53c3-a306-36048b1efecf_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dn%252Fda511df0c4614ccda19cfb55f83aa9ff%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dn/da511df0c4614ccda19cfb55f83aa9ff/images/large/9.jpg saved to cache
2026-03-26 22:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9b4a4a85-7e3f-53c3-a306-36048b1efecf
2026-03-26 22:49:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6d72f90>
2026-03-26 22:49:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18979b1a-ad2b-58fb-9f7b-baea2c3543a8/18979b1a-ad2b-58fb-9f7b-baea2c3543a8_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fab215018495748f2b144fb4aadddb6f9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/ab215018495748f2b144fb4aadddb6f9/images/large/1.jpg saved to cache
2026-03-26 22:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 18979b1a-ad2b-58fb-9f7b-baea2c3543a8
2026-03-26 22:49:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/ab215018495748f2b144fb4aadddb6f9/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/ab215018495748f2b144fb4aadddb6f9/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F1388a3b859ed4109830c56362c06a1c0%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/1388a3b859ed4109830c56362c06a1c0/images/large/3.jpg not downloaded yet
2026-03-26 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F1388a3b859ed4109830c56362c06a1c0%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/1388a3b859ed4109830c56362c06a1c0/images/large/4.jpg not downloaded yet
2026-03-26 22:49:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/ab215018495748f2b144fb4aadddb6f9/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F1388a3b859ed4109830c56362c06a1c0%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/1388a3b859ed4109830c56362c06a1c0/images/large/5.jpg not downloaded yet
2026-03-26 22:49:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dn/da511df0c4614ccda19cfb55f83aa9ff/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/ab215018495748f2b144fb4aadddb6f9/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/ab215018495748f2b144fb4aadddb6f9/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F1388a3b859ed4109830c56362c06a1c0%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/1388a3b859ed4109830c56362c06a1c0/images/large/6.jpg not downloaded yet
2026-03-26 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F1388a3b859ed4109830c56362c06a1c0%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/1388a3b859ed4109830c56362c06a1c0/images/large/7.jpg not downloaded yet
2026-03-26 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F1388a3b859ed4109830c56362c06a1c0%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/1388a3b859ed4109830c56362c06a1c0/images/large/8.jpg not downloaded yet
2026-03-26 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F1388a3b859ed4109830c56362c06a1c0%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/1388a3b859ed4109830c56362c06a1c0/images/large/9.jpg not downloaded yet
2026-03-26 22:49:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/1388a3b859ed4109830c56362c06a1c0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c962d0>
2026-03-26 22:49:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18979b1a-ad2b-58fb-9f7b-baea2c3543a8/18979b1a-ad2b-58fb-9f7b-baea2c3543a8_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fab215018495748f2b144fb4aadddb6f9%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/ab215018495748f2b144fb4aadddb6f9/images/large/6.jpg saved to cache
2026-03-26 22:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 18979b1a-ad2b-58fb-9f7b-baea2c3543a8
2026-03-26 22:49:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6d82250>
2026-03-26 22:49:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18979b1a-ad2b-58fb-9f7b-baea2c3543a8/18979b1a-ad2b-58fb-9f7b-baea2c3543a8_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fab215018495748f2b144fb4aadddb6f9%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/ab215018495748f2b144fb4aadddb6f9/images/large/5.jpg saved to cache
2026-03-26 22:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 18979b1a-ad2b-58fb-9f7b-baea2c3543a8
2026-03-26 22:49:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/ab215018495748f2b144fb4aadddb6f9/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F1388a3b859ed4109830c56362c06a1c0%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/1388a3b859ed4109830c56362c06a1c0/images/large/10.jpg not downloaded yet
2026-03-26 22:49:51 [ayvens.be] INFO: Found listing with ID: 1985375
2026-03-26 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985375%27 HTTP/1.1" 200 None
2026-03-26 22:49:51 [ayvens.be] INFO: Scrape type for 1985375: 1
2026-03-26 22:49:51 [ayvens.be] INFO: Extracting data for car ID: 1985375
2026-03-26 22:49:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 010c1aea-c107-5cbc-ab3b-b1ae80957cb9 with identifier: 1985375
2026-03-26 22:49:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 010c1aea-c107-5cbc-ab3b-b1ae80957cb9 with scrape type 1
2026-03-26 22:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 010c1aea-c107-5cbc-ab3b-b1ae80957cb9
2026-03-26 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gv%252F7de9c739e4f94dd4977fe7af589b7a70%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gv/7de9c739e4f94dd4977fe7af589b7a70/images/large/1.jpg not downloaded yet
2026-03-26 22:49:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e02050>
2026-03-26 22:49:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18979b1a-ad2b-58fb-9f7b-baea2c3543a8/18979b1a-ad2b-58fb-9f7b-baea2c3543a8_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fab215018495748f2b144fb4aadddb6f9%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/ab215018495748f2b144fb4aadddb6f9/images/large/2.jpg saved to cache
2026-03-26 22:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 18979b1a-ad2b-58fb-9f7b-baea2c3543a8
2026-03-26 22:49:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c95dd0>
2026-03-26 22:49:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b4a4a85-7e3f-53c3-a306-36048b1efecf/9b4a4a85-7e3f-53c3-a306-36048b1efecf_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dn%252Fda511df0c4614ccda19cfb55f83aa9ff%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dn/da511df0c4614ccda19cfb55f83aa9ff/images/large/10.jpg saved to cache
2026-03-26 22:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9b4a4a85-7e3f-53c3-a306-36048b1efecf
2026-03-26 22:49:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9b4a4a85-7e3f-53c3-a306-36048b1efecf, skipping ID generation
2026-03-26 22:49:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b4a4a85-7e3f-53c3-a306-36048b1efecf with scrape type 1
2026-03-26 22:49:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9b4a4a85-7e3f-53c3-a306-36048b1efecf sending to next pipeline
2026-03-26 22:49:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 9b4a4a85-7e3f-53c3-a306-36048b1efecf, identifier: 1985372
2026-03-26 22:49:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e29350>
2026-03-26 22:49:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18979b1a-ad2b-58fb-9f7b-baea2c3543a8/18979b1a-ad2b-58fb-9f7b-baea2c3543a8_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fab215018495748f2b144fb4aadddb6f9%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/ab215018495748f2b144fb4aadddb6f9/images/large/4.jpg saved to cache
2026-03-26 22:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 18979b1a-ad2b-58fb-9f7b-baea2c3543a8
2026-03-26 22:49:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e4dbd0>
2026-03-26 22:49:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18979b1a-ad2b-58fb-9f7b-baea2c3543a8/18979b1a-ad2b-58fb-9f7b-baea2c3543a8_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fab215018495748f2b144fb4aadddb6f9%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/ab215018495748f2b144fb4aadddb6f9/images/large/3.jpg saved to cache
2026-03-26 22:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 18979b1a-ad2b-58fb-9f7b-baea2c3543a8
2026-03-26 22:49:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c62510>
2026-03-26 22:49:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0/5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F1388a3b859ed4109830c56362c06a1c0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/1388a3b859ed4109830c56362c06a1c0/images/large/1.jpg saved to cache
2026-03-26 22:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0
2026-03-26 22:49:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 9b4a4a85-7e3f-53c3-a306-36048b1efecf with identifier: 1985372
2026-03-26 22:49:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 9b4a4a85-7e3f-53c3-a306-36048b1efecf with identifier: 1985372
2026-03-26 22:49:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 9b4a4a85-7e3f-53c3-a306-36048b1efecf with identifier: 1985372 to the API
2026-03-26 22:49:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:49:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:49:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2dn/da511df0c4614ccda19cfb55f83aa9ff/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '9b4a4a85-7e3f-53c3-a306-36048b1efecf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X2',
 'odometer': 68892,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b4a4a85-7e3f-53c3-a306-36048b1efecf/9b4a4a85-7e3f-53c3-a306-36048b1efecf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 633746,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dn/da511df0c4614ccda19cfb55f83aa9ff/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b4a4a85-7e3f-53c3-a306-36048b1efecf/9b4a4a85-7e3f-53c3-a306-36048b1efecf_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 684675,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dn/da511df0c4614ccda19cfb55f83aa9ff/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b4a4a85-7e3f-53c3-a306-36048b1efecf/9b4a4a85-7e3f-53c3-a306-36048b1efecf_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 619236,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dn/da511df0c4614ccda19cfb55f83aa9ff/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b4a4a85-7e3f-53c3-a306-36048b1efecf/9b4a4a85-7e3f-53c3-a306-36048b1efecf_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 654058,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dn/da511df0c4614ccda19cfb55f83aa9ff/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b4a4a85-7e3f-53c3-a306-36048b1efecf/9b4a4a85-7e3f-53c3-a306-36048b1efecf_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 684699,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dn/da511df0c4614ccda19cfb55f83aa9ff/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b4a4a85-7e3f-53c3-a306-36048b1efecf/9b4a4a85-7e3f-53c3-a306-36048b1efecf_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 761686,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dn/da511df0c4614ccda19cfb55f83aa9ff/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b4a4a85-7e3f-53c3-a306-36048b1efecf/9b4a4a85-7e3f-53c3-a306-36048b1efecf_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 600887,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dn/da511df0c4614ccda19cfb55f83aa9ff/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b4a4a85-7e3f-53c3-a306-36048b1efecf/9b4a4a85-7e3f-53c3-a306-36048b1efecf_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 637969,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dn/da511df0c4614ccda19cfb55f83aa9ff/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b4a4a85-7e3f-53c3-a306-36048b1efecf/9b4a4a85-7e3f-53c3-a306-36048b1efecf_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 687293,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dn/da511df0c4614ccda19cfb55f83aa9ff/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b4a4a85-7e3f-53c3-a306-36048b1efecf/9b4a4a85-7e3f-53c3-a306-36048b1efecf_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 780775,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dn/da511df0c4614ccda19cfb55f83aa9ff/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-05-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X2 1.5 XDRIVE25E PHEV 162KW',
 'transmission': 'automatic',
 'trim': '1.5 XDRIVE25E PHEV 162KW',
 'vin': None,
 'year': 2023}
2026-03-26 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985372%27 HTTP/1.1" 200 None
2026-03-26 22:49:52 [ayvens.be] INFO: Saving data for 1985372: {'created_time': 1774565392.016887, 'last_price_update_time': 1774565392.016899, 'auction_closing_time': 1774958400.0}
2026-03-26 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985372') HTTP/1.1" 204 0
2026-03-26 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gv%252F7de9c739e4f94dd4977fe7af589b7a70%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gv/7de9c739e4f94dd4977fe7af589b7a70/images/large/2.jpg not downloaded yet
2026-03-26 22:49:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/ab215018495748f2b144fb4aadddb6f9/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/ab215018495748f2b144fb4aadddb6f9/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gv%252F7de9c739e4f94dd4977fe7af589b7a70%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gv/7de9c739e4f94dd4977fe7af589b7a70/images/large/3.jpg not downloaded yet
2026-03-26 22:49:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c60a90>
2026-03-26 22:49:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18979b1a-ad2b-58fb-9f7b-baea2c3543a8/18979b1a-ad2b-58fb-9f7b-baea2c3543a8_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fab215018495748f2b144fb4aadddb6f9%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/ab215018495748f2b144fb4aadddb6f9/images/large/9.jpg saved to cache
2026-03-26 22:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 18979b1a-ad2b-58fb-9f7b-baea2c3543a8
2026-03-26 22:49:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/1388a3b859ed4109830c56362c06a1c0/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/ab215018495748f2b144fb4aadddb6f9/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/1388a3b859ed4109830c56362c06a1c0/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gv%252F7de9c739e4f94dd4977fe7af589b7a70%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gv/7de9c739e4f94dd4977fe7af589b7a70/images/large/4.jpg not downloaded yet
2026-03-26 22:49:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/1388a3b859ed4109830c56362c06a1c0/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/1388a3b859ed4109830c56362c06a1c0/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/1388a3b859ed4109830c56362c06a1c0/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gv%252F7de9c739e4f94dd4977fe7af589b7a70%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gv/7de9c739e4f94dd4977fe7af589b7a70/images/large/5.jpg not downloaded yet
2026-03-26 22:49:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7819190>
2026-03-26 22:49:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18979b1a-ad2b-58fb-9f7b-baea2c3543a8/18979b1a-ad2b-58fb-9f7b-baea2c3543a8_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fab215018495748f2b144fb4aadddb6f9%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/ab215018495748f2b144fb4aadddb6f9/images/large/8.jpg saved to cache
2026-03-26 22:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 18979b1a-ad2b-58fb-9f7b-baea2c3543a8
2026-03-26 22:49:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74128d0>
2026-03-26 22:49:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18979b1a-ad2b-58fb-9f7b-baea2c3543a8/18979b1a-ad2b-58fb-9f7b-baea2c3543a8_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fab215018495748f2b144fb4aadddb6f9%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/ab215018495748f2b144fb4aadddb6f9/images/large/10.jpg saved to cache
2026-03-26 22:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 18979b1a-ad2b-58fb-9f7b-baea2c3543a8
2026-03-26 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gv%252F7de9c739e4f94dd4977fe7af589b7a70%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gv/7de9c739e4f94dd4977fe7af589b7a70/images/large/6.jpg not downloaded yet
2026-03-26 22:49:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7944b50>
2026-03-26 22:49:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0/5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F1388a3b859ed4109830c56362c06a1c0%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/1388a3b859ed4109830c56362c06a1c0/images/large/3.jpg saved to cache
2026-03-26 22:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0
2026-03-26 22:49:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79a6190>
2026-03-26 22:49:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18979b1a-ad2b-58fb-9f7b-baea2c3543a8/18979b1a-ad2b-58fb-9f7b-baea2c3543a8_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fab215018495748f2b144fb4aadddb6f9%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/ab215018495748f2b144fb4aadddb6f9/images/large/7.jpg saved to cache
2026-03-26 22:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 18979b1a-ad2b-58fb-9f7b-baea2c3543a8
2026-03-26 22:49:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 18979b1a-ad2b-58fb-9f7b-baea2c3543a8, skipping ID generation
2026-03-26 22:49:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18979b1a-ad2b-58fb-9f7b-baea2c3543a8 with scrape type 1
2026-03-26 22:49:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 18979b1a-ad2b-58fb-9f7b-baea2c3543a8 sending to next pipeline
2026-03-26 22:49:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 18979b1a-ad2b-58fb-9f7b-baea2c3543a8, identifier: 1985373
2026-03-26 22:49:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74cefd0>
2026-03-26 22:49:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0/5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F1388a3b859ed4109830c56362c06a1c0%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/1388a3b859ed4109830c56362c06a1c0/images/large/2.jpg saved to cache
2026-03-26 22:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0
2026-03-26 22:49:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7584a90>
2026-03-26 22:49:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0/5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F1388a3b859ed4109830c56362c06a1c0%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/1388a3b859ed4109830c56362c06a1c0/images/large/4.jpg saved to cache
2026-03-26 22:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0
2026-03-26 22:49:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7746390>
2026-03-26 22:49:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0/5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F1388a3b859ed4109830c56362c06a1c0%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/1388a3b859ed4109830c56362c06a1c0/images/large/5.jpg saved to cache
2026-03-26 22:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0
2026-03-26 22:49:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7587250>
2026-03-26 22:49:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0/5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F1388a3b859ed4109830c56362c06a1c0%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/1388a3b859ed4109830c56362c06a1c0/images/large/6.jpg saved to cache
2026-03-26 22:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0
2026-03-26 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gv%252F7de9c739e4f94dd4977fe7af589b7a70%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gv/7de9c739e4f94dd4977fe7af589b7a70/images/large/7.jpg not downloaded yet
2026-03-26 22:49:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 18979b1a-ad2b-58fb-9f7b-baea2c3543a8 with identifier: 1985373
2026-03-26 22:49:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 18979b1a-ad2b-58fb-9f7b-baea2c3543a8 with identifier: 1985373
2026-03-26 22:49:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 18979b1a-ad2b-58fb-9f7b-baea2c3543a8 with identifier: 1985373 to the API
2026-03-26 22:49:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:49:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:49:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bd/ab215018495748f2b144fb4aadddb6f9/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.3L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '18979b1a-ad2b-58fb-9f7b-baea2c3543a8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A-CLASS LIMOUSINE',
 'odometer': 83182,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18979b1a-ad2b-58fb-9f7b-baea2c3543a8/18979b1a-ad2b-58fb-9f7b-baea2c3543a8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 462932,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/ab215018495748f2b144fb4aadddb6f9/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18979b1a-ad2b-58fb-9f7b-baea2c3543a8/18979b1a-ad2b-58fb-9f7b-baea2c3543a8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 643594,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/ab215018495748f2b144fb4aadddb6f9/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18979b1a-ad2b-58fb-9f7b-baea2c3543a8/18979b1a-ad2b-58fb-9f7b-baea2c3543a8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 615649,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/ab215018495748f2b144fb4aadddb6f9/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18979b1a-ad2b-58fb-9f7b-baea2c3543a8/18979b1a-ad2b-58fb-9f7b-baea2c3543a8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 607475,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/ab215018495748f2b144fb4aadddb6f9/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18979b1a-ad2b-58fb-9f7b-baea2c3543a8/18979b1a-ad2b-58fb-9f7b-baea2c3543a8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 322478,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/ab215018495748f2b144fb4aadddb6f9/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18979b1a-ad2b-58fb-9f7b-baea2c3543a8/18979b1a-ad2b-58fb-9f7b-baea2c3543a8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 328236,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/ab215018495748f2b144fb4aadddb6f9/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18979b1a-ad2b-58fb-9f7b-baea2c3543a8/18979b1a-ad2b-58fb-9f7b-baea2c3543a8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 532086,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/ab215018495748f2b144fb4aadddb6f9/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18979b1a-ad2b-58fb-9f7b-baea2c3543a8/18979b1a-ad2b-58fb-9f7b-baea2c3543a8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 470809,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/ab215018495748f2b144fb4aadddb6f9/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18979b1a-ad2b-58fb-9f7b-baea2c3543a8/18979b1a-ad2b-58fb-9f7b-baea2c3543a8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 409126,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/ab215018495748f2b144fb4aadddb6f9/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18979b1a-ad2b-58fb-9f7b-baea2c3543a8/18979b1a-ad2b-58fb-9f7b-baea2c3543a8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 488853,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/ab215018495748f2b144fb4aadddb6f9/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ A-CLASS LIMOUSINE 1.3 A 250 E BUSINESS SOLUTION DCT',
 'transmission': 'automatic',
 'trim': '1.3 A 250 E BUSINESS SOLUTION DCT',
 'vin': None,
 'year': 2021}
2026-03-26 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985373%27 HTTP/1.1" 200 None
2026-03-26 22:49:53 [ayvens.be] INFO: Saving data for 1985373: {'created_time': 1774565393.484384, 'last_price_update_time': 1774565393.484394, 'auction_closing_time': 1774958400.0}
2026-03-26 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985373') HTTP/1.1" 204 0
2026-03-26 22:49:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/1388a3b859ed4109830c56362c06a1c0/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gv%252F7de9c739e4f94dd4977fe7af589b7a70%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gv/7de9c739e4f94dd4977fe7af589b7a70/images/large/8.jpg not downloaded yet
2026-03-26 22:49:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/1388a3b859ed4109830c56362c06a1c0/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/1388a3b859ed4109830c56362c06a1c0/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gv%252F7de9c739e4f94dd4977fe7af589b7a70%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gv/7de9c739e4f94dd4977fe7af589b7a70/images/large/9.jpg not downloaded yet
2026-03-26 22:49:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/1388a3b859ed4109830c56362c06a1c0/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gv%252F7de9c739e4f94dd4977fe7af589b7a70%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gv/7de9c739e4f94dd4977fe7af589b7a70/images/large/10.jpg not downloaded yet
2026-03-26 22:49:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gv/7de9c739e4f94dd4977fe7af589b7a70/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:53 [ayvens.be] INFO: Found listing with ID: 1985376
2026-03-26 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985376%27 HTTP/1.1" 200 None
2026-03-26 22:49:53 [ayvens.be] INFO: Scrape type for 1985376: 1
2026-03-26 22:49:53 [ayvens.be] INFO: Extracting data for car ID: 1985376
2026-03-26 22:49:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f513ab40-e80d-5508-9312-ecf3faf2e7c3 with identifier: 1985376
2026-03-26 22:49:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f513ab40-e80d-5508-9312-ecf3faf2e7c3 with scrape type 1
2026-03-26 22:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f513ab40-e80d-5508-9312-ecf3faf2e7c3
2026-03-26 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F14f3e8f6d77942fb914beb281ace98a3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/14f3e8f6d77942fb914beb281ace98a3/images/large/1.jpg not downloaded yet
2026-03-26 22:49:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gv/7de9c739e4f94dd4977fe7af589b7a70/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gv/7de9c739e4f94dd4977fe7af589b7a70/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F14f3e8f6d77942fb914beb281ace98a3%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/14f3e8f6d77942fb914beb281ace98a3/images/large/2.jpg not downloaded yet
2026-03-26 22:49:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gv/7de9c739e4f94dd4977fe7af589b7a70/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7649cd0>
2026-03-26 22:49:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0/5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F1388a3b859ed4109830c56362c06a1c0%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/1388a3b859ed4109830c56362c06a1c0/images/large/10.jpg saved to cache
2026-03-26 22:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0
2026-03-26 22:49:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80be1b65d0>
2026-03-26 22:49:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0/5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F1388a3b859ed4109830c56362c06a1c0%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/1388a3b859ed4109830c56362c06a1c0/images/large/9.jpg saved to cache
2026-03-26 22:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0
2026-03-26 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F14f3e8f6d77942fb914beb281ace98a3%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/14f3e8f6d77942fb914beb281ace98a3/images/large/3.jpg not downloaded yet
2026-03-26 22:49:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cb3150>
2026-03-26 22:49:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0/5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F1388a3b859ed4109830c56362c06a1c0%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/1388a3b859ed4109830c56362c06a1c0/images/large/8.jpg saved to cache
2026-03-26 22:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0
2026-03-26 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F14f3e8f6d77942fb914beb281ace98a3%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/14f3e8f6d77942fb914beb281ace98a3/images/large/4.jpg not downloaded yet
2026-03-26 22:49:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7403a90>
2026-03-26 22:49:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0/5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F1388a3b859ed4109830c56362c06a1c0%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/1388a3b859ed4109830c56362c06a1c0/images/large/7.jpg saved to cache
2026-03-26 22:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0
2026-03-26 22:49:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0, skipping ID generation
2026-03-26 22:49:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0 with scrape type 1
2026-03-26 22:49:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0 sending to next pipeline
2026-03-26 22:49:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0, identifier: 1985374
2026-03-26 22:49:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b743a810>
2026-03-26 22:49:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_010c1aea-c107-5cbc-ab3b-b1ae80957cb9/010c1aea-c107-5cbc-ab3b-b1ae80957cb9_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gv%252F7de9c739e4f94dd4977fe7af589b7a70%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gv/7de9c739e4f94dd4977fe7af589b7a70/images/large/1.jpg saved to cache
2026-03-26 22:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 010c1aea-c107-5cbc-ab3b-b1ae80957cb9
2026-03-26 22:49:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79a7210>
2026-03-26 22:49:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_010c1aea-c107-5cbc-ab3b-b1ae80957cb9/010c1aea-c107-5cbc-ab3b-b1ae80957cb9_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gv%252F7de9c739e4f94dd4977fe7af589b7a70%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gv/7de9c739e4f94dd4977fe7af589b7a70/images/large/2.jpg saved to cache
2026-03-26 22:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 010c1aea-c107-5cbc-ab3b-b1ae80957cb9
2026-03-26 22:49:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7aa3a50>
2026-03-26 22:49:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_010c1aea-c107-5cbc-ab3b-b1ae80957cb9/010c1aea-c107-5cbc-ab3b-b1ae80957cb9_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gv%252F7de9c739e4f94dd4977fe7af589b7a70%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gv/7de9c739e4f94dd4977fe7af589b7a70/images/large/3.jpg saved to cache
2026-03-26 22:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 010c1aea-c107-5cbc-ab3b-b1ae80957cb9
2026-03-26 22:49:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7ca8190>
2026-03-26 22:49:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_010c1aea-c107-5cbc-ab3b-b1ae80957cb9/010c1aea-c107-5cbc-ab3b-b1ae80957cb9_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gv%252F7de9c739e4f94dd4977fe7af589b7a70%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gv/7de9c739e4f94dd4977fe7af589b7a70/images/large/4.jpg saved to cache
2026-03-26 22:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 010c1aea-c107-5cbc-ab3b-b1ae80957cb9
2026-03-26 22:49:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0 with identifier: 1985374
2026-03-26 22:49:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0 with identifier: 1985374
2026-03-26 22:49:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0 with identifier: 1985374 to the API
2026-03-26 22:49:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:49:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:49:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bm/1388a3b859ed4109830c56362c06a1c0/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'KUGA',
 'odometer': 157391,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0/5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 535999,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/1388a3b859ed4109830c56362c06a1c0/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0/5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 550357,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/1388a3b859ed4109830c56362c06a1c0/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0/5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 630023,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/1388a3b859ed4109830c56362c06a1c0/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0/5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 674116,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/1388a3b859ed4109830c56362c06a1c0/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0/5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 379177,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/1388a3b859ed4109830c56362c06a1c0/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0/5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 351904,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/1388a3b859ed4109830c56362c06a1c0/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0/5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 531357,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/1388a3b859ed4109830c56362c06a1c0/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0/5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 396866,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/1388a3b859ed4109830c56362c06a1c0/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0/5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 382578,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/1388a3b859ed4109830c56362c06a1c0/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0/5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 217453,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/1388a3b859ed4109830c56362c06a1c0/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD KUGA 1.5 ECOBLUE 88KW TITANIUM',
 'transmission': 'manual',
 'trim': '1.5 ECOBLUE 88KW TITANIUM',
 'vin': None,
 'year': 2022}
2026-03-26 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985374%27 HTTP/1.1" 200 None
2026-03-26 22:49:55 [ayvens.be] INFO: Saving data for 1985374: {'created_time': 1774565395.103573, 'last_price_update_time': 1774565395.103584, 'auction_closing_time': 1774958400.0}
2026-03-26 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985374') HTTP/1.1" 204 0
2026-03-26 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F14f3e8f6d77942fb914beb281ace98a3%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/14f3e8f6d77942fb914beb281ace98a3/images/large/5.jpg not downloaded yet
2026-03-26 22:49:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gv/7de9c739e4f94dd4977fe7af589b7a70/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F14f3e8f6d77942fb914beb281ace98a3%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/14f3e8f6d77942fb914beb281ace98a3/images/large/6.jpg not downloaded yet
2026-03-26 22:49:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gv/7de9c739e4f94dd4977fe7af589b7a70/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gv/7de9c739e4f94dd4977fe7af589b7a70/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F14f3e8f6d77942fb914beb281ace98a3%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/14f3e8f6d77942fb914beb281ace98a3/images/large/7.jpg not downloaded yet
2026-03-26 22:49:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gv/7de9c739e4f94dd4977fe7af589b7a70/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gv/7de9c739e4f94dd4977fe7af589b7a70/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gv/7de9c739e4f94dd4977fe7af589b7a70/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F14f3e8f6d77942fb914beb281ace98a3%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/14f3e8f6d77942fb914beb281ace98a3/images/large/8.jpg not downloaded yet
2026-03-26 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F14f3e8f6d77942fb914beb281ace98a3%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/14f3e8f6d77942fb914beb281ace98a3/images/large/9.jpg not downloaded yet
2026-03-26 22:49:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/14f3e8f6d77942fb914beb281ace98a3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/14f3e8f6d77942fb914beb281ace98a3/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F14f3e8f6d77942fb914beb281ace98a3%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/14f3e8f6d77942fb914beb281ace98a3/images/large/10.jpg not downloaded yet
2026-03-26 22:49:55 [ayvens.be] INFO: Found listing with ID: 1985377
2026-03-26 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985377%27 HTTP/1.1" 200 None
2026-03-26 22:49:55 [ayvens.be] INFO: Scrape type for 1985377: 1
2026-03-26 22:49:55 [ayvens.be] INFO: Extracting data for car ID: 1985377
2026-03-26 22:49:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c7b5d90a-9f2f-5747-9d5b-37a0f833ddec with identifier: 1985377
2026-03-26 22:49:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7b5d90a-9f2f-5747-9d5b-37a0f833ddec with scrape type 1
2026-03-26 22:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c7b5d90a-9f2f-5747-9d5b-37a0f833ddec
2026-03-26 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fb%252F922979ba338440e296efb057bf8f2c49%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fb/922979ba338440e296efb057bf8f2c49/images/large/1.jpg not downloaded yet
2026-03-26 22:49:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7495010>
2026-03-26 22:49:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_010c1aea-c107-5cbc-ab3b-b1ae80957cb9/010c1aea-c107-5cbc-ab3b-b1ae80957cb9_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gv%252F7de9c739e4f94dd4977fe7af589b7a70%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gv/7de9c739e4f94dd4977fe7af589b7a70/images/large/6.jpg saved to cache
2026-03-26 22:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 010c1aea-c107-5cbc-ab3b-b1ae80957cb9
2026-03-26 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fb%252F922979ba338440e296efb057bf8f2c49%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fb/922979ba338440e296efb057bf8f2c49/images/large/2.jpg not downloaded yet
2026-03-26 22:49:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79dcc90>
2026-03-26 22:49:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_010c1aea-c107-5cbc-ab3b-b1ae80957cb9/010c1aea-c107-5cbc-ab3b-b1ae80957cb9_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gv%252F7de9c739e4f94dd4977fe7af589b7a70%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gv/7de9c739e4f94dd4977fe7af589b7a70/images/large/7.jpg saved to cache
2026-03-26 22:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 010c1aea-c107-5cbc-ab3b-b1ae80957cb9
2026-03-26 22:49:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7438b90>
2026-03-26 22:49:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_010c1aea-c107-5cbc-ab3b-b1ae80957cb9/010c1aea-c107-5cbc-ab3b-b1ae80957cb9_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gv%252F7de9c739e4f94dd4977fe7af589b7a70%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gv/7de9c739e4f94dd4977fe7af589b7a70/images/large/9.jpg saved to cache
2026-03-26 22:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 010c1aea-c107-5cbc-ab3b-b1ae80957cb9
2026-03-26 22:49:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c756d0>
2026-03-26 22:49:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_010c1aea-c107-5cbc-ab3b-b1ae80957cb9/010c1aea-c107-5cbc-ab3b-b1ae80957cb9_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gv%252F7de9c739e4f94dd4977fe7af589b7a70%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gv/7de9c739e4f94dd4977fe7af589b7a70/images/large/8.jpg saved to cache
2026-03-26 22:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 010c1aea-c107-5cbc-ab3b-b1ae80957cb9
2026-03-26 22:49:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b743ae50>
2026-03-26 22:49:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_010c1aea-c107-5cbc-ab3b-b1ae80957cb9/010c1aea-c107-5cbc-ab3b-b1ae80957cb9_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gv%252F7de9c739e4f94dd4977fe7af589b7a70%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gv/7de9c739e4f94dd4977fe7af589b7a70/images/large/5.jpg saved to cache
2026-03-26 22:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 010c1aea-c107-5cbc-ab3b-b1ae80957cb9
2026-03-26 22:49:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b78ab4d0>
2026-03-26 22:49:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_010c1aea-c107-5cbc-ab3b-b1ae80957cb9/010c1aea-c107-5cbc-ab3b-b1ae80957cb9_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gv%252F7de9c739e4f94dd4977fe7af589b7a70%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gv/7de9c739e4f94dd4977fe7af589b7a70/images/large/10.jpg saved to cache
2026-03-26 22:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 010c1aea-c107-5cbc-ab3b-b1ae80957cb9
2026-03-26 22:49:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 010c1aea-c107-5cbc-ab3b-b1ae80957cb9, skipping ID generation
2026-03-26 22:49:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 010c1aea-c107-5cbc-ab3b-b1ae80957cb9 with scrape type 1
2026-03-26 22:49:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 010c1aea-c107-5cbc-ab3b-b1ae80957cb9 sending to next pipeline
2026-03-26 22:49:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 010c1aea-c107-5cbc-ab3b-b1ae80957cb9, identifier: 1985375
2026-03-26 22:49:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7ae9ad0>
2026-03-26 22:49:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f513ab40-e80d-5508-9312-ecf3faf2e7c3/f513ab40-e80d-5508-9312-ecf3faf2e7c3_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F14f3e8f6d77942fb914beb281ace98a3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/14f3e8f6d77942fb914beb281ace98a3/images/large/1.jpg saved to cache
2026-03-26 22:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f513ab40-e80d-5508-9312-ecf3faf2e7c3
2026-03-26 22:49:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7427350>
2026-03-26 22:49:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f513ab40-e80d-5508-9312-ecf3faf2e7c3/f513ab40-e80d-5508-9312-ecf3faf2e7c3_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F14f3e8f6d77942fb914beb281ace98a3%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/14f3e8f6d77942fb914beb281ace98a3/images/large/2.jpg saved to cache
2026-03-26 22:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f513ab40-e80d-5508-9312-ecf3faf2e7c3
2026-03-26 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fb%252F922979ba338440e296efb057bf8f2c49%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fb/922979ba338440e296efb057bf8f2c49/images/large/3.jpg not downloaded yet
2026-03-26 22:49:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 010c1aea-c107-5cbc-ab3b-b1ae80957cb9 with identifier: 1985375
2026-03-26 22:49:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 010c1aea-c107-5cbc-ab3b-b1ae80957cb9 with identifier: 1985375
2026-03-26 22:49:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 010c1aea-c107-5cbc-ab3b-b1ae80957cb9 with identifier: 1985375 to the API
2026-03-26 22:49:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:49:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:49:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2gv/7de9c739e4f94dd4977fe7af589b7a70/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'electric',
 'id': '010c1aea-c107-5cbc-ab3b-b1ae80957cb9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'IX2',
 'odometer': 7987,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_010c1aea-c107-5cbc-ab3b-b1ae80957cb9/010c1aea-c107-5cbc-ab3b-b1ae80957cb9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 714062,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gv/7de9c739e4f94dd4977fe7af589b7a70/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_010c1aea-c107-5cbc-ab3b-b1ae80957cb9/010c1aea-c107-5cbc-ab3b-b1ae80957cb9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 713014,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gv/7de9c739e4f94dd4977fe7af589b7a70/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_010c1aea-c107-5cbc-ab3b-b1ae80957cb9/010c1aea-c107-5cbc-ab3b-b1ae80957cb9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 654174,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gv/7de9c739e4f94dd4977fe7af589b7a70/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_010c1aea-c107-5cbc-ab3b-b1ae80957cb9/010c1aea-c107-5cbc-ab3b-b1ae80957cb9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 729456,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gv/7de9c739e4f94dd4977fe7af589b7a70/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_010c1aea-c107-5cbc-ab3b-b1ae80957cb9/010c1aea-c107-5cbc-ab3b-b1ae80957cb9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 648573,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gv/7de9c739e4f94dd4977fe7af589b7a70/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_010c1aea-c107-5cbc-ab3b-b1ae80957cb9/010c1aea-c107-5cbc-ab3b-b1ae80957cb9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 533836,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gv/7de9c739e4f94dd4977fe7af589b7a70/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_010c1aea-c107-5cbc-ab3b-b1ae80957cb9/010c1aea-c107-5cbc-ab3b-b1ae80957cb9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 627754,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gv/7de9c739e4f94dd4977fe7af589b7a70/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_010c1aea-c107-5cbc-ab3b-b1ae80957cb9/010c1aea-c107-5cbc-ab3b-b1ae80957cb9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 733420,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gv/7de9c739e4f94dd4977fe7af589b7a70/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_010c1aea-c107-5cbc-ab3b-b1ae80957cb9/010c1aea-c107-5cbc-ab3b-b1ae80957cb9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 449317,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gv/7de9c739e4f94dd4977fe7af589b7a70/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_010c1aea-c107-5cbc-ab3b-b1ae80957cb9/010c1aea-c107-5cbc-ab3b-b1ae80957cb9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 511494,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gv/7de9c739e4f94dd4977fe7af589b7a70/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-04-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW IX2 BEV 67KWH EDRIVE20 150KW',
 'transmission': 'automatic',
 'trim': 'BEV 67KWH EDRIVE20 150KW',
 'vin': None,
 'year': 2025}
2026-03-26 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985375%27 HTTP/1.1" 200 None
2026-03-26 22:49:56 [ayvens.be] INFO: Saving data for 1985375: {'created_time': 1774565396.517354, 'last_price_update_time': 1774565396.517364, 'auction_closing_time': 1774958400.0}
2026-03-26 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985375') HTTP/1.1" 204 0
2026-03-26 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fb%252F922979ba338440e296efb057bf8f2c49%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fb/922979ba338440e296efb057bf8f2c49/images/large/4.jpg not downloaded yet
2026-03-26 22:49:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/14f3e8f6d77942fb914beb281ace98a3/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fb%252F922979ba338440e296efb057bf8f2c49%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fb/922979ba338440e296efb057bf8f2c49/images/large/5.jpg not downloaded yet
2026-03-26 22:49:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/14f3e8f6d77942fb914beb281ace98a3/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/14f3e8f6d77942fb914beb281ace98a3/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fb%252F922979ba338440e296efb057bf8f2c49%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fb/922979ba338440e296efb057bf8f2c49/images/large/6.jpg not downloaded yet
2026-03-26 22:49:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/14f3e8f6d77942fb914beb281ace98a3/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/14f3e8f6d77942fb914beb281ace98a3/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/14f3e8f6d77942fb914beb281ace98a3/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fb%252F922979ba338440e296efb057bf8f2c49%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fb/922979ba338440e296efb057bf8f2c49/images/large/7.jpg not downloaded yet
2026-03-26 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fb%252F922979ba338440e296efb057bf8f2c49%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fb/922979ba338440e296efb057bf8f2c49/images/large/8.jpg not downloaded yet
2026-03-26 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fb%252F922979ba338440e296efb057bf8f2c49%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fb/922979ba338440e296efb057bf8f2c49/images/large/9.jpg not downloaded yet
2026-03-26 22:49:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fb/922979ba338440e296efb057bf8f2c49/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fb/922979ba338440e296efb057bf8f2c49/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fb%252F922979ba338440e296efb057bf8f2c49%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fb/922979ba338440e296efb057bf8f2c49/images/large/10.jpg not downloaded yet
2026-03-26 22:49:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6dda210>
2026-03-26 22:49:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f513ab40-e80d-5508-9312-ecf3faf2e7c3/f513ab40-e80d-5508-9312-ecf3faf2e7c3_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F14f3e8f6d77942fb914beb281ace98a3%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/14f3e8f6d77942fb914beb281ace98a3/images/large/3.jpg saved to cache
2026-03-26 22:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f513ab40-e80d-5508-9312-ecf3faf2e7c3
2026-03-26 22:49:56 [ayvens.be] INFO: Found listing with ID: 1985378
2026-03-26 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985378%27 HTTP/1.1" 200 None
2026-03-26 22:49:56 [ayvens.be] INFO: Scrape type for 1985378: 1
2026-03-26 22:49:56 [ayvens.be] INFO: Extracting data for car ID: 1985378
2026-03-26 22:49:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 55582b44-2a1a-55ba-8550-803dbcef7bd5 with identifier: 1985378
2026-03-26 22:49:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55582b44-2a1a-55ba-8550-803dbcef7bd5 with scrape type 1
2026-03-26 22:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 55582b44-2a1a-55ba-8550-803dbcef7bd5
2026-03-26 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252Fed5703d901a64da696a2be83c5c9ec67%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/ed5703d901a64da696a2be83c5c9ec67/images/large/1.jpg not downloaded yet
2026-03-26 22:49:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b792c790>
2026-03-26 22:49:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f513ab40-e80d-5508-9312-ecf3faf2e7c3/f513ab40-e80d-5508-9312-ecf3faf2e7c3_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F14f3e8f6d77942fb914beb281ace98a3%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/14f3e8f6d77942fb914beb281ace98a3/images/large/5.jpg saved to cache
2026-03-26 22:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f513ab40-e80d-5508-9312-ecf3faf2e7c3
2026-03-26 22:49:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74b4b50>
2026-03-26 22:49:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f513ab40-e80d-5508-9312-ecf3faf2e7c3/f513ab40-e80d-5508-9312-ecf3faf2e7c3_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F14f3e8f6d77942fb914beb281ace98a3%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/14f3e8f6d77942fb914beb281ace98a3/images/large/4.jpg saved to cache
2026-03-26 22:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f513ab40-e80d-5508-9312-ecf3faf2e7c3
2026-03-26 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252Fed5703d901a64da696a2be83c5c9ec67%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/ed5703d901a64da696a2be83c5c9ec67/images/large/2.jpg not downloaded yet
2026-03-26 22:49:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/14f3e8f6d77942fb914beb281ace98a3/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fb/922979ba338440e296efb057bf8f2c49/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fb/922979ba338440e296efb057bf8f2c49/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76ed650>
2026-03-26 22:49:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f513ab40-e80d-5508-9312-ecf3faf2e7c3/f513ab40-e80d-5508-9312-ecf3faf2e7c3_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F14f3e8f6d77942fb914beb281ace98a3%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/14f3e8f6d77942fb914beb281ace98a3/images/large/6.jpg saved to cache
2026-03-26 22:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f513ab40-e80d-5508-9312-ecf3faf2e7c3
2026-03-26 22:49:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7688350>
2026-03-26 22:49:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f513ab40-e80d-5508-9312-ecf3faf2e7c3/f513ab40-e80d-5508-9312-ecf3faf2e7c3_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F14f3e8f6d77942fb914beb281ace98a3%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/14f3e8f6d77942fb914beb281ace98a3/images/large/7.jpg saved to cache
2026-03-26 22:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f513ab40-e80d-5508-9312-ecf3faf2e7c3
2026-03-26 22:49:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7483cd0>
2026-03-26 22:49:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f513ab40-e80d-5508-9312-ecf3faf2e7c3/f513ab40-e80d-5508-9312-ecf3faf2e7c3_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F14f3e8f6d77942fb914beb281ace98a3%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/14f3e8f6d77942fb914beb281ace98a3/images/large/8.jpg saved to cache
2026-03-26 22:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f513ab40-e80d-5508-9312-ecf3faf2e7c3
2026-03-26 22:49:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7482150>
2026-03-26 22:49:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7b5d90a-9f2f-5747-9d5b-37a0f833ddec/c7b5d90a-9f2f-5747-9d5b-37a0f833ddec_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fb%252F922979ba338440e296efb057bf8f2c49%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fb/922979ba338440e296efb057bf8f2c49/images/large/1.jpg saved to cache
2026-03-26 22:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c7b5d90a-9f2f-5747-9d5b-37a0f833ddec
2026-03-26 22:49:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b727ca90>
2026-03-26 22:49:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7b5d90a-9f2f-5747-9d5b-37a0f833ddec/c7b5d90a-9f2f-5747-9d5b-37a0f833ddec_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fb%252F922979ba338440e296efb057bf8f2c49%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fb/922979ba338440e296efb057bf8f2c49/images/large/2.jpg saved to cache
2026-03-26 22:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c7b5d90a-9f2f-5747-9d5b-37a0f833ddec
2026-03-26 22:49:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fb/922979ba338440e296efb057bf8f2c49/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fb/922979ba338440e296efb057bf8f2c49/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252Fed5703d901a64da696a2be83c5c9ec67%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/ed5703d901a64da696a2be83c5c9ec67/images/large/3.jpg not downloaded yet
2026-03-26 22:49:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/14f3e8f6d77942fb914beb281ace98a3/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fb/922979ba338440e296efb057bf8f2c49/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252Fed5703d901a64da696a2be83c5c9ec67%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/ed5703d901a64da696a2be83c5c9ec67/images/large/4.jpg not downloaded yet
2026-03-26 22:49:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b75a7cd0>
2026-03-26 22:49:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f513ab40-e80d-5508-9312-ecf3faf2e7c3/f513ab40-e80d-5508-9312-ecf3faf2e7c3_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F14f3e8f6d77942fb914beb281ace98a3%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/14f3e8f6d77942fb914beb281ace98a3/images/large/10.jpg saved to cache
2026-03-26 22:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f513ab40-e80d-5508-9312-ecf3faf2e7c3
2026-03-26 22:49:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74019d0>
2026-03-26 22:49:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7b5d90a-9f2f-5747-9d5b-37a0f833ddec/c7b5d90a-9f2f-5747-9d5b-37a0f833ddec_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fb%252F922979ba338440e296efb057bf8f2c49%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fb/922979ba338440e296efb057bf8f2c49/images/large/3.jpg saved to cache
2026-03-26 22:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c7b5d90a-9f2f-5747-9d5b-37a0f833ddec
2026-03-26 22:49:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b17c50>
2026-03-26 22:49:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7b5d90a-9f2f-5747-9d5b-37a0f833ddec/c7b5d90a-9f2f-5747-9d5b-37a0f833ddec_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fb%252F922979ba338440e296efb057bf8f2c49%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fb/922979ba338440e296efb057bf8f2c49/images/large/4.jpg saved to cache
2026-03-26 22:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c7b5d90a-9f2f-5747-9d5b-37a0f833ddec
2026-03-26 22:49:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fb/922979ba338440e296efb057bf8f2c49/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252Fed5703d901a64da696a2be83c5c9ec67%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/ed5703d901a64da696a2be83c5c9ec67/images/large/5.jpg not downloaded yet
2026-03-26 22:49:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7410d50>
2026-03-26 22:49:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7b5d90a-9f2f-5747-9d5b-37a0f833ddec/c7b5d90a-9f2f-5747-9d5b-37a0f833ddec_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fb%252F922979ba338440e296efb057bf8f2c49%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fb/922979ba338440e296efb057bf8f2c49/images/large/5.jpg saved to cache
2026-03-26 22:49:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c7b5d90a-9f2f-5747-9d5b-37a0f833ddec
2026-03-26 22:49:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76ef750>
2026-03-26 22:49:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7b5d90a-9f2f-5747-9d5b-37a0f833ddec/c7b5d90a-9f2f-5747-9d5b-37a0f833ddec_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fb%252F922979ba338440e296efb057bf8f2c49%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fb/922979ba338440e296efb057bf8f2c49/images/large/6.jpg saved to cache
2026-03-26 22:49:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c7b5d90a-9f2f-5747-9d5b-37a0f833ddec
2026-03-26 22:49:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7910cd0>
2026-03-26 22:49:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f513ab40-e80d-5508-9312-ecf3faf2e7c3/f513ab40-e80d-5508-9312-ecf3faf2e7c3_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F14f3e8f6d77942fb914beb281ace98a3%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/14f3e8f6d77942fb914beb281ace98a3/images/large/9.jpg saved to cache
2026-03-26 22:49:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f513ab40-e80d-5508-9312-ecf3faf2e7c3
2026-03-26 22:49:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f513ab40-e80d-5508-9312-ecf3faf2e7c3, skipping ID generation
2026-03-26 22:49:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f513ab40-e80d-5508-9312-ecf3faf2e7c3 with scrape type 1
2026-03-26 22:49:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f513ab40-e80d-5508-9312-ecf3faf2e7c3 sending to next pipeline
2026-03-26 22:49:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f513ab40-e80d-5508-9312-ecf3faf2e7c3, identifier: 1985376
2026-03-26 22:49:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80c9881b50>
2026-03-26 22:49:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7b5d90a-9f2f-5747-9d5b-37a0f833ddec/c7b5d90a-9f2f-5747-9d5b-37a0f833ddec_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fb%252F922979ba338440e296efb057bf8f2c49%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fb/922979ba338440e296efb057bf8f2c49/images/large/8.jpg saved to cache
2026-03-26 22:49:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c7b5d90a-9f2f-5747-9d5b-37a0f833ddec
2026-03-26 22:49:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cu/ed5703d901a64da696a2be83c5c9ec67/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252Fed5703d901a64da696a2be83c5c9ec67%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/ed5703d901a64da696a2be83c5c9ec67/images/large/6.jpg not downloaded yet
2026-03-26 22:49:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f513ab40-e80d-5508-9312-ecf3faf2e7c3 with identifier: 1985376
2026-03-26 22:49:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f513ab40-e80d-5508-9312-ecf3faf2e7c3 with identifier: 1985376
2026-03-26 22:49:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f513ab40-e80d-5508-9312-ecf3faf2e7c3 with identifier: 1985376 to the API
2026-03-26 22:49:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:49:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:49:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bs/14f3e8f6d77942fb914beb281ace98a3/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'f513ab40-e80d-5508-9312-ecf3faf2e7c3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A3',
 'odometer': 114644,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f513ab40-e80d-5508-9312-ecf3faf2e7c3/f513ab40-e80d-5508-9312-ecf3faf2e7c3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 661597,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/14f3e8f6d77942fb914beb281ace98a3/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f513ab40-e80d-5508-9312-ecf3faf2e7c3/f513ab40-e80d-5508-9312-ecf3faf2e7c3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 676854,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/14f3e8f6d77942fb914beb281ace98a3/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f513ab40-e80d-5508-9312-ecf3faf2e7c3/f513ab40-e80d-5508-9312-ecf3faf2e7c3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 643970,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/14f3e8f6d77942fb914beb281ace98a3/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f513ab40-e80d-5508-9312-ecf3faf2e7c3/f513ab40-e80d-5508-9312-ecf3faf2e7c3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 690672,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/14f3e8f6d77942fb914beb281ace98a3/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f513ab40-e80d-5508-9312-ecf3faf2e7c3/f513ab40-e80d-5508-9312-ecf3faf2e7c3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 582423,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/14f3e8f6d77942fb914beb281ace98a3/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f513ab40-e80d-5508-9312-ecf3faf2e7c3/f513ab40-e80d-5508-9312-ecf3faf2e7c3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 623701,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/14f3e8f6d77942fb914beb281ace98a3/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f513ab40-e80d-5508-9312-ecf3faf2e7c3/f513ab40-e80d-5508-9312-ecf3faf2e7c3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 627768,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/14f3e8f6d77942fb914beb281ace98a3/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f513ab40-e80d-5508-9312-ecf3faf2e7c3/f513ab40-e80d-5508-9312-ecf3faf2e7c3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 669768,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/14f3e8f6d77942fb914beb281ace98a3/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f513ab40-e80d-5508-9312-ecf3faf2e7c3/f513ab40-e80d-5508-9312-ecf3faf2e7c3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 567636,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/14f3e8f6d77942fb914beb281ace98a3/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f513ab40-e80d-5508-9312-ecf3faf2e7c3/f513ab40-e80d-5508-9312-ecf3faf2e7c3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 519282,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/14f3e8f6d77942fb914beb281ace98a3/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A3 1.4 40 TFSI E S TRON. ADVANCED SPORTBACK',
 'transmission': 'automatic',
 'trim': '1.4 40 TFSI E S TRON. ADVANCED SPORTBACK',
 'vin': None,
 'year': 2022}
2026-03-26 22:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985376%27 HTTP/1.1" 200 None
2026-03-26 22:49:58 [ayvens.be] INFO: Saving data for 1985376: {'created_time': 1774565398.781483, 'last_price_update_time': 1774565398.781494, 'auction_closing_time': 1774958400.0}
2026-03-26 22:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985376') HTTP/1.1" 204 0
2026-03-26 22:49:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cu/ed5703d901a64da696a2be83c5c9ec67/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fb/922979ba338440e296efb057bf8f2c49/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fb/922979ba338440e296efb057bf8f2c49/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252Fed5703d901a64da696a2be83c5c9ec67%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/ed5703d901a64da696a2be83c5c9ec67/images/large/7.jpg not downloaded yet
2026-03-26 22:49:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c5d910>
2026-03-26 22:49:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7b5d90a-9f2f-5747-9d5b-37a0f833ddec/c7b5d90a-9f2f-5747-9d5b-37a0f833ddec_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fb%252F922979ba338440e296efb057bf8f2c49%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fb/922979ba338440e296efb057bf8f2c49/images/large/7.jpg saved to cache
2026-03-26 22:49:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c7b5d90a-9f2f-5747-9d5b-37a0f833ddec
2026-03-26 22:49:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79d6450>
2026-03-26 22:49:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55582b44-2a1a-55ba-8550-803dbcef7bd5/55582b44-2a1a-55ba-8550-803dbcef7bd5_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252Fed5703d901a64da696a2be83c5c9ec67%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/ed5703d901a64da696a2be83c5c9ec67/images/large/1.jpg saved to cache
2026-03-26 22:49:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 55582b44-2a1a-55ba-8550-803dbcef7bd5
2026-03-26 22:49:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cu/ed5703d901a64da696a2be83c5c9ec67/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252Fed5703d901a64da696a2be83c5c9ec67%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/ed5703d901a64da696a2be83c5c9ec67/images/large/8.jpg not downloaded yet
2026-03-26 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252Fed5703d901a64da696a2be83c5c9ec67%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/ed5703d901a64da696a2be83c5c9ec67/images/large/9.jpg not downloaded yet
2026-03-26 22:49:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b781b710>
2026-03-26 22:49:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55582b44-2a1a-55ba-8550-803dbcef7bd5/55582b44-2a1a-55ba-8550-803dbcef7bd5_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252Fed5703d901a64da696a2be83c5c9ec67%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/ed5703d901a64da696a2be83c5c9ec67/images/large/2.jpg saved to cache
2026-03-26 22:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 55582b44-2a1a-55ba-8550-803dbcef7bd5
2026-03-26 22:49:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79f2610>
2026-03-26 22:49:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7b5d90a-9f2f-5747-9d5b-37a0f833ddec/c7b5d90a-9f2f-5747-9d5b-37a0f833ddec_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fb%252F922979ba338440e296efb057bf8f2c49%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fb/922979ba338440e296efb057bf8f2c49/images/large/10.jpg saved to cache
2026-03-26 22:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c7b5d90a-9f2f-5747-9d5b-37a0f833ddec
2026-03-26 22:49:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7403f50>
2026-03-26 22:49:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7b5d90a-9f2f-5747-9d5b-37a0f833ddec/c7b5d90a-9f2f-5747-9d5b-37a0f833ddec_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fb%252F922979ba338440e296efb057bf8f2c49%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fb/922979ba338440e296efb057bf8f2c49/images/large/9.jpg saved to cache
2026-03-26 22:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c7b5d90a-9f2f-5747-9d5b-37a0f833ddec
2026-03-26 22:49:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c7b5d90a-9f2f-5747-9d5b-37a0f833ddec, skipping ID generation
2026-03-26 22:49:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7b5d90a-9f2f-5747-9d5b-37a0f833ddec with scrape type 1
2026-03-26 22:49:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c7b5d90a-9f2f-5747-9d5b-37a0f833ddec sending to next pipeline
2026-03-26 22:49:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c7b5d90a-9f2f-5747-9d5b-37a0f833ddec, identifier: 1985377
2026-03-26 22:49:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c7b5d90a-9f2f-5747-9d5b-37a0f833ddec with identifier: 1985377
2026-03-26 22:49:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c7b5d90a-9f2f-5747-9d5b-37a0f833ddec with identifier: 1985377
2026-03-26 22:49:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c7b5d90a-9f2f-5747-9d5b-37a0f833ddec with identifier: 1985377 to the API
2026-03-26 22:49:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:49:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:49:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2fb/922979ba338440e296efb057bf8f2c49/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'c7b5d90a-9f2f-5747-9d5b-37a0f833ddec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF VIII',
 'odometer': 38605,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7b5d90a-9f2f-5747-9d5b-37a0f833ddec/c7b5d90a-9f2f-5747-9d5b-37a0f833ddec_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 264341,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fb/922979ba338440e296efb057bf8f2c49/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7b5d90a-9f2f-5747-9d5b-37a0f833ddec/c7b5d90a-9f2f-5747-9d5b-37a0f833ddec_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 271524,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fb/922979ba338440e296efb057bf8f2c49/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7b5d90a-9f2f-5747-9d5b-37a0f833ddec/c7b5d90a-9f2f-5747-9d5b-37a0f833ddec_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 291024,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fb/922979ba338440e296efb057bf8f2c49/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7b5d90a-9f2f-5747-9d5b-37a0f833ddec/c7b5d90a-9f2f-5747-9d5b-37a0f833ddec_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 301753,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fb/922979ba338440e296efb057bf8f2c49/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7b5d90a-9f2f-5747-9d5b-37a0f833ddec/c7b5d90a-9f2f-5747-9d5b-37a0f833ddec_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 281223,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fb/922979ba338440e296efb057bf8f2c49/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7b5d90a-9f2f-5747-9d5b-37a0f833ddec/c7b5d90a-9f2f-5747-9d5b-37a0f833ddec_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 284320,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fb/922979ba338440e296efb057bf8f2c49/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7b5d90a-9f2f-5747-9d5b-37a0f833ddec/c7b5d90a-9f2f-5747-9d5b-37a0f833ddec_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 283718,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fb/922979ba338440e296efb057bf8f2c49/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7b5d90a-9f2f-5747-9d5b-37a0f833ddec/c7b5d90a-9f2f-5747-9d5b-37a0f833ddec_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 312158,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fb/922979ba338440e296efb057bf8f2c49/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7b5d90a-9f2f-5747-9d5b-37a0f833ddec/c7b5d90a-9f2f-5747-9d5b-37a0f833ddec_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 295513,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fb/922979ba338440e296efb057bf8f2c49/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7b5d90a-9f2f-5747-9d5b-37a0f833ddec/c7b5d90a-9f2f-5747-9d5b-37a0f833ddec_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 316734,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fb/922979ba338440e296efb057bf8f2c49/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-03-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF VIII 1.0 TSI 81KW LIFE BUSINESS',
 'transmission': 'manual',
 'trim': '1.0 TSI 81KW LIFE BUSINESS',
 'vin': None,
 'year': 2024}
2026-03-26 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985377%27 HTTP/1.1" 200 None
2026-03-26 22:49:59 [ayvens.be] INFO: Saving data for 1985377: {'created_time': 1774565399.728773, 'last_price_update_time': 1774565399.728785, 'auction_closing_time': 1774958400.0}
2026-03-26 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985377') HTTP/1.1" 204 0
2026-03-26 22:49:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cu/ed5703d901a64da696a2be83c5c9ec67/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252Fed5703d901a64da696a2be83c5c9ec67%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/ed5703d901a64da696a2be83c5c9ec67/images/large/10.jpg not downloaded yet
2026-03-26 22:49:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74a6ad0>
2026-03-26 22:49:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55582b44-2a1a-55ba-8550-803dbcef7bd5/55582b44-2a1a-55ba-8550-803dbcef7bd5_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252Fed5703d901a64da696a2be83c5c9ec67%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/ed5703d901a64da696a2be83c5c9ec67/images/large/3.jpg saved to cache
2026-03-26 22:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 55582b44-2a1a-55ba-8550-803dbcef7bd5
2026-03-26 22:49:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cu/ed5703d901a64da696a2be83c5c9ec67/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:59 [ayvens.be] INFO: Found listing with ID: 1985379
2026-03-26 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985379%27 HTTP/1.1" 200 None
2026-03-26 22:49:59 [ayvens.be] INFO: Scrape type for 1985379: 1
2026-03-26 22:49:59 [ayvens.be] INFO: Extracting data for car ID: 1985379
2026-03-26 22:49:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41f97a93-de3c-5513-bb76-4e8deedf18cb with identifier: 1985379
2026-03-26 22:49:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41f97a93-de3c-5513-bb76-4e8deedf18cb with scrape type 1
2026-03-26 22:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 41f97a93-de3c-5513-bb76-4e8deedf18cb
2026-03-26 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F8c3360aed8184195bd380e24c4451312%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/8c3360aed8184195bd380e24c4451312/images/large/1.jpg not downloaded yet
2026-03-26 22:49:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cu/ed5703d901a64da696a2be83c5c9ec67/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cu/ed5703d901a64da696a2be83c5c9ec67/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F8c3360aed8184195bd380e24c4451312%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/8c3360aed8184195bd380e24c4451312/images/large/2.jpg not downloaded yet
2026-03-26 22:49:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:49:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd0cfdd0>
2026-03-26 22:49:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:49:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:49:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:49:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55582b44-2a1a-55ba-8550-803dbcef7bd5/55582b44-2a1a-55ba-8550-803dbcef7bd5_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252Fed5703d901a64da696a2be83c5c9ec67%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/ed5703d901a64da696a2be83c5c9ec67/images/large/4.jpg saved to cache
2026-03-26 22:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 55582b44-2a1a-55ba-8550-803dbcef7bd5
2026-03-26 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F8c3360aed8184195bd380e24c4451312%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/8c3360aed8184195bd380e24c4451312/images/large/3.jpg not downloaded yet
2026-03-26 22:49:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cu/ed5703d901a64da696a2be83c5c9ec67/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F8c3360aed8184195bd380e24c4451312%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/8c3360aed8184195bd380e24c4451312/images/large/4.jpg not downloaded yet
2026-03-26 22:50:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77af6d0>
2026-03-26 22:50:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55582b44-2a1a-55ba-8550-803dbcef7bd5/55582b44-2a1a-55ba-8550-803dbcef7bd5_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252Fed5703d901a64da696a2be83c5c9ec67%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/ed5703d901a64da696a2be83c5c9ec67/images/large/5.jpg saved to cache
2026-03-26 22:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 55582b44-2a1a-55ba-8550-803dbcef7bd5
2026-03-26 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F8c3360aed8184195bd380e24c4451312%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/8c3360aed8184195bd380e24c4451312/images/large/5.jpg not downloaded yet
2026-03-26 22:50:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7459e10>
2026-03-26 22:50:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55582b44-2a1a-55ba-8550-803dbcef7bd5/55582b44-2a1a-55ba-8550-803dbcef7bd5_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252Fed5703d901a64da696a2be83c5c9ec67%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/ed5703d901a64da696a2be83c5c9ec67/images/large/6.jpg saved to cache
2026-03-26 22:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 55582b44-2a1a-55ba-8550-803dbcef7bd5
2026-03-26 22:50:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7a54b50>
2026-03-26 22:50:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55582b44-2a1a-55ba-8550-803dbcef7bd5/55582b44-2a1a-55ba-8550-803dbcef7bd5_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252Fed5703d901a64da696a2be83c5c9ec67%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/ed5703d901a64da696a2be83c5c9ec67/images/large/7.jpg saved to cache
2026-03-26 22:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 55582b44-2a1a-55ba-8550-803dbcef7bd5
2026-03-26 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F8c3360aed8184195bd380e24c4451312%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/8c3360aed8184195bd380e24c4451312/images/large/6.jpg not downloaded yet
2026-03-26 22:50:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cu/ed5703d901a64da696a2be83c5c9ec67/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6da4c10>
2026-03-26 22:50:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55582b44-2a1a-55ba-8550-803dbcef7bd5/55582b44-2a1a-55ba-8550-803dbcef7bd5_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252Fed5703d901a64da696a2be83c5c9ec67%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/ed5703d901a64da696a2be83c5c9ec67/images/large/8.jpg saved to cache
2026-03-26 22:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 55582b44-2a1a-55ba-8550-803dbcef7bd5
2026-03-26 22:50:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cu/ed5703d901a64da696a2be83c5c9ec67/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F8c3360aed8184195bd380e24c4451312%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/8c3360aed8184195bd380e24c4451312/images/large/7.jpg not downloaded yet
2026-03-26 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F8c3360aed8184195bd380e24c4451312%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/8c3360aed8184195bd380e24c4451312/images/large/8.jpg not downloaded yet
2026-03-26 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F8c3360aed8184195bd380e24c4451312%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/8c3360aed8184195bd380e24c4451312/images/large/9.jpg not downloaded yet
2026-03-26 22:50:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/8c3360aed8184195bd380e24c4451312/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F8c3360aed8184195bd380e24c4451312%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/8c3360aed8184195bd380e24c4451312/images/large/10.jpg not downloaded yet
2026-03-26 22:50:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6da5850>
2026-03-26 22:50:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55582b44-2a1a-55ba-8550-803dbcef7bd5/55582b44-2a1a-55ba-8550-803dbcef7bd5_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252Fed5703d901a64da696a2be83c5c9ec67%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/ed5703d901a64da696a2be83c5c9ec67/images/large/9.jpg saved to cache
2026-03-26 22:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 55582b44-2a1a-55ba-8550-803dbcef7bd5
2026-03-26 22:50:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/8c3360aed8184195bd380e24c4451312/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/8c3360aed8184195bd380e24c4451312/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:00 [ayvens.be] INFO: Found listing with ID: 1985380
2026-03-26 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985380%27 HTTP/1.1" 200 None
2026-03-26 22:50:00 [ayvens.be] INFO: Scrape type for 1985380: 1
2026-03-26 22:50:00 [ayvens.be] INFO: Extracting data for car ID: 1985380
2026-03-26 22:50:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 335e1b92-8dec-5058-af43-5393f02dbe77 with identifier: 1985380
2026-03-26 22:50:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 335e1b92-8dec-5058-af43-5393f02dbe77 with scrape type 1
2026-03-26 22:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 335e1b92-8dec-5058-af43-5393f02dbe77
2026-03-26 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252Fb0724084526d472bafc8388bbb5fdfd5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/b0724084526d472bafc8388bbb5fdfd5/images/large/1.jpg not downloaded yet
2026-03-26 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252Fb0724084526d472bafc8388bbb5fdfd5%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/b0724084526d472bafc8388bbb5fdfd5/images/large/2.jpg not downloaded yet
2026-03-26 22:50:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76eef90>
2026-03-26 22:50:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55582b44-2a1a-55ba-8550-803dbcef7bd5/55582b44-2a1a-55ba-8550-803dbcef7bd5_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252Fed5703d901a64da696a2be83c5c9ec67%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/ed5703d901a64da696a2be83c5c9ec67/images/large/10.jpg saved to cache
2026-03-26 22:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 55582b44-2a1a-55ba-8550-803dbcef7bd5
2026-03-26 22:50:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 55582b44-2a1a-55ba-8550-803dbcef7bd5, skipping ID generation
2026-03-26 22:50:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55582b44-2a1a-55ba-8550-803dbcef7bd5 with scrape type 1
2026-03-26 22:50:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 55582b44-2a1a-55ba-8550-803dbcef7bd5 sending to next pipeline
2026-03-26 22:50:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 55582b44-2a1a-55ba-8550-803dbcef7bd5, identifier: 1985378
2026-03-26 22:50:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd0d3ed0>
2026-03-26 22:50:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41f97a93-de3c-5513-bb76-4e8deedf18cb/41f97a93-de3c-5513-bb76-4e8deedf18cb_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F8c3360aed8184195bd380e24c4451312%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/8c3360aed8184195bd380e24c4451312/images/large/1.jpg saved to cache
2026-03-26 22:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 41f97a93-de3c-5513-bb76-4e8deedf18cb
2026-03-26 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252Fb0724084526d472bafc8388bbb5fdfd5%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/b0724084526d472bafc8388bbb5fdfd5/images/large/3.jpg not downloaded yet
2026-03-26 22:50:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 55582b44-2a1a-55ba-8550-803dbcef7bd5 with identifier: 1985378
2026-03-26 22:50:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 55582b44-2a1a-55ba-8550-803dbcef7bd5 with identifier: 1985378
2026-03-26 22:50:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 55582b44-2a1a-55ba-8550-803dbcef7bd5 with identifier: 1985378 to the API
2026-03-26 22:50:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:50:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:50:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cu/ed5703d901a64da696a2be83c5c9ec67/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'electric',
 'id': '55582b44-2a1a-55ba-8550-803dbcef7bd5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'C40',
 'odometer': 72990,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55582b44-2a1a-55ba-8550-803dbcef7bd5/55582b44-2a1a-55ba-8550-803dbcef7bd5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 190982,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cu/ed5703d901a64da696a2be83c5c9ec67/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55582b44-2a1a-55ba-8550-803dbcef7bd5/55582b44-2a1a-55ba-8550-803dbcef7bd5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 197425,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cu/ed5703d901a64da696a2be83c5c9ec67/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55582b44-2a1a-55ba-8550-803dbcef7bd5/55582b44-2a1a-55ba-8550-803dbcef7bd5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 215434,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cu/ed5703d901a64da696a2be83c5c9ec67/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55582b44-2a1a-55ba-8550-803dbcef7bd5/55582b44-2a1a-55ba-8550-803dbcef7bd5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 214340,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cu/ed5703d901a64da696a2be83c5c9ec67/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55582b44-2a1a-55ba-8550-803dbcef7bd5/55582b44-2a1a-55ba-8550-803dbcef7bd5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 239176,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cu/ed5703d901a64da696a2be83c5c9ec67/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55582b44-2a1a-55ba-8550-803dbcef7bd5/55582b44-2a1a-55ba-8550-803dbcef7bd5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 218865,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cu/ed5703d901a64da696a2be83c5c9ec67/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55582b44-2a1a-55ba-8550-803dbcef7bd5/55582b44-2a1a-55ba-8550-803dbcef7bd5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 281190,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cu/ed5703d901a64da696a2be83c5c9ec67/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55582b44-2a1a-55ba-8550-803dbcef7bd5/55582b44-2a1a-55ba-8550-803dbcef7bd5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 284164,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cu/ed5703d901a64da696a2be83c5c9ec67/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55582b44-2a1a-55ba-8550-803dbcef7bd5/55582b44-2a1a-55ba-8550-803dbcef7bd5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 353270,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cu/ed5703d901a64da696a2be83c5c9ec67/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55582b44-2a1a-55ba-8550-803dbcef7bd5/55582b44-2a1a-55ba-8550-803dbcef7bd5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 279835,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cu/ed5703d901a64da696a2be83c5c9ec67/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO C40 BEV 69KWH RECHARGE PLUS',
 'transmission': 'automatic',
 'trim': 'BEV 69KWH RECHARGE PLUS',
 'vin': None,
 'year': 2022}
2026-03-26 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985378%27 HTTP/1.1" 200 None
2026-03-26 22:50:01 [ayvens.be] INFO: Saving data for 1985378: {'created_time': 1774565401.131829, 'last_price_update_time': 1774565401.131841, 'auction_closing_time': 1774958400.0}
2026-03-26 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985378') HTTP/1.1" 204 0
2026-03-26 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252Fb0724084526d472bafc8388bbb5fdfd5%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/b0724084526d472bafc8388bbb5fdfd5/images/large/4.jpg not downloaded yet
2026-03-26 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252Fb0724084526d472bafc8388bbb5fdfd5%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/b0724084526d472bafc8388bbb5fdfd5/images/large/5.jpg not downloaded yet
2026-03-26 22:50:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd267a50>
2026-03-26 22:50:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41f97a93-de3c-5513-bb76-4e8deedf18cb/41f97a93-de3c-5513-bb76-4e8deedf18cb_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F8c3360aed8184195bd380e24c4451312%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/8c3360aed8184195bd380e24c4451312/images/large/3.jpg saved to cache
2026-03-26 22:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 41f97a93-de3c-5513-bb76-4e8deedf18cb
2026-03-26 22:50:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79a0810>
2026-03-26 22:50:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41f97a93-de3c-5513-bb76-4e8deedf18cb/41f97a93-de3c-5513-bb76-4e8deedf18cb_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F8c3360aed8184195bd380e24c4451312%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/8c3360aed8184195bd380e24c4451312/images/large/2.jpg saved to cache
2026-03-26 22:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 41f97a93-de3c-5513-bb76-4e8deedf18cb
2026-03-26 22:50:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/8c3360aed8184195bd380e24c4451312/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/8c3360aed8184195bd380e24c4451312/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/8c3360aed8184195bd380e24c4451312/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/8c3360aed8184195bd380e24c4451312/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252Fb0724084526d472bafc8388bbb5fdfd5%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/b0724084526d472bafc8388bbb5fdfd5/images/large/6.jpg not downloaded yet
2026-03-26 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252Fb0724084526d472bafc8388bbb5fdfd5%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/b0724084526d472bafc8388bbb5fdfd5/images/large/7.jpg not downloaded yet
2026-03-26 22:50:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/8c3360aed8184195bd380e24c4451312/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252Fb0724084526d472bafc8388bbb5fdfd5%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/b0724084526d472bafc8388bbb5fdfd5/images/large/8.jpg not downloaded yet
2026-03-26 22:50:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/8c3360aed8184195bd380e24c4451312/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/8c3360aed8184195bd380e24c4451312/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/b0724084526d472bafc8388bbb5fdfd5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252Fb0724084526d472bafc8388bbb5fdfd5%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/b0724084526d472bafc8388bbb5fdfd5/images/large/9.jpg not downloaded yet
2026-03-26 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252Fb0724084526d472bafc8388bbb5fdfd5%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/b0724084526d472bafc8388bbb5fdfd5/images/large/10.jpg not downloaded yet
2026-03-26 22:50:01 [ayvens.be] INFO: Found listing with ID: 1985381
2026-03-26 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985381%27 HTTP/1.1" 200 None
2026-03-26 22:50:01 [ayvens.be] INFO: Scrape type for 1985381: 1
2026-03-26 22:50:01 [ayvens.be] INFO: Extracting data for car ID: 1985381
2026-03-26 22:50:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0935e4d3-aba0-574f-a79e-8f1945954b6d with identifier: 1985381
2026-03-26 22:50:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0935e4d3-aba0-574f-a79e-8f1945954b6d with scrape type 1
2026-03-26 22:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0935e4d3-aba0-574f-a79e-8f1945954b6d
2026-03-26 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F568c90adf94d444fb78c3d7587fd4337%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/568c90adf94d444fb78c3d7587fd4337/images/large/1.jpg not downloaded yet
2026-03-26 22:50:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b768aed0>
2026-03-26 22:50:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41f97a93-de3c-5513-bb76-4e8deedf18cb/41f97a93-de3c-5513-bb76-4e8deedf18cb_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F8c3360aed8184195bd380e24c4451312%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/8c3360aed8184195bd380e24c4451312/images/large/4.jpg saved to cache
2026-03-26 22:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 41f97a93-de3c-5513-bb76-4e8deedf18cb
2026-03-26 22:50:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c75110>
2026-03-26 22:50:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41f97a93-de3c-5513-bb76-4e8deedf18cb/41f97a93-de3c-5513-bb76-4e8deedf18cb_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F8c3360aed8184195bd380e24c4451312%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/8c3360aed8184195bd380e24c4451312/images/large/5.jpg saved to cache
2026-03-26 22:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 41f97a93-de3c-5513-bb76-4e8deedf18cb
2026-03-26 22:50:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c7c950>
2026-03-26 22:50:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41f97a93-de3c-5513-bb76-4e8deedf18cb/41f97a93-de3c-5513-bb76-4e8deedf18cb_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F8c3360aed8184195bd380e24c4451312%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/8c3360aed8184195bd380e24c4451312/images/large/7.jpg saved to cache
2026-03-26 22:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 41f97a93-de3c-5513-bb76-4e8deedf18cb
2026-03-26 22:50:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b748b550>
2026-03-26 22:50:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41f97a93-de3c-5513-bb76-4e8deedf18cb/41f97a93-de3c-5513-bb76-4e8deedf18cb_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F8c3360aed8184195bd380e24c4451312%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/8c3360aed8184195bd380e24c4451312/images/large/6.jpg saved to cache
2026-03-26 22:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 41f97a93-de3c-5513-bb76-4e8deedf18cb
2026-03-26 22:50:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c7d310>
2026-03-26 22:50:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41f97a93-de3c-5513-bb76-4e8deedf18cb/41f97a93-de3c-5513-bb76-4e8deedf18cb_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F8c3360aed8184195bd380e24c4451312%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/8c3360aed8184195bd380e24c4451312/images/large/9.jpg saved to cache
2026-03-26 22:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 41f97a93-de3c-5513-bb76-4e8deedf18cb
2026-03-26 22:50:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b782c590>
2026-03-26 22:50:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41f97a93-de3c-5513-bb76-4e8deedf18cb/41f97a93-de3c-5513-bb76-4e8deedf18cb_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F8c3360aed8184195bd380e24c4451312%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/8c3360aed8184195bd380e24c4451312/images/large/8.jpg saved to cache
2026-03-26 22:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 41f97a93-de3c-5513-bb76-4e8deedf18cb
2026-03-26 22:50:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c7c310>
2026-03-26 22:50:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41f97a93-de3c-5513-bb76-4e8deedf18cb/41f97a93-de3c-5513-bb76-4e8deedf18cb_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F8c3360aed8184195bd380e24c4451312%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/8c3360aed8184195bd380e24c4451312/images/large/10.jpg saved to cache
2026-03-26 22:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 41f97a93-de3c-5513-bb76-4e8deedf18cb
2026-03-26 22:50:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 41f97a93-de3c-5513-bb76-4e8deedf18cb, skipping ID generation
2026-03-26 22:50:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41f97a93-de3c-5513-bb76-4e8deedf18cb with scrape type 1
2026-03-26 22:50:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 41f97a93-de3c-5513-bb76-4e8deedf18cb sending to next pipeline
2026-03-26 22:50:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 41f97a93-de3c-5513-bb76-4e8deedf18cb, identifier: 1985379
2026-03-26 22:50:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd3b8e50>
2026-03-26 22:50:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_335e1b92-8dec-5058-af43-5393f02dbe77/335e1b92-8dec-5058-af43-5393f02dbe77_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252Fb0724084526d472bafc8388bbb5fdfd5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/b0724084526d472bafc8388bbb5fdfd5/images/large/1.jpg saved to cache
2026-03-26 22:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 335e1b92-8dec-5058-af43-5393f02dbe77
2026-03-26 22:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F568c90adf94d444fb78c3d7587fd4337%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/568c90adf94d444fb78c3d7587fd4337/images/large/2.jpg not downloaded yet
2026-03-26 22:50:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 41f97a93-de3c-5513-bb76-4e8deedf18cb with identifier: 1985379
2026-03-26 22:50:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 41f97a93-de3c-5513-bb76-4e8deedf18cb with identifier: 1985379
2026-03-26 22:50:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 41f97a93-de3c-5513-bb76-4e8deedf18cb with identifier: 1985379 to the API
2026-03-26 22:50:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:50:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:50:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bl/8c3360aed8184195bd380e24c4451312/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '41f97a93-de3c-5513-bb76-4e8deedf18cb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A-Klasse',
 'odometer': 195502,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41f97a93-de3c-5513-bb76-4e8deedf18cb/41f97a93-de3c-5513-bb76-4e8deedf18cb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 671312,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/8c3360aed8184195bd380e24c4451312/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41f97a93-de3c-5513-bb76-4e8deedf18cb/41f97a93-de3c-5513-bb76-4e8deedf18cb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 645065,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/8c3360aed8184195bd380e24c4451312/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41f97a93-de3c-5513-bb76-4e8deedf18cb/41f97a93-de3c-5513-bb76-4e8deedf18cb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 648082,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/8c3360aed8184195bd380e24c4451312/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41f97a93-de3c-5513-bb76-4e8deedf18cb/41f97a93-de3c-5513-bb76-4e8deedf18cb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 664571,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/8c3360aed8184195bd380e24c4451312/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41f97a93-de3c-5513-bb76-4e8deedf18cb/41f97a93-de3c-5513-bb76-4e8deedf18cb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 640036,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/8c3360aed8184195bd380e24c4451312/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41f97a93-de3c-5513-bb76-4e8deedf18cb/41f97a93-de3c-5513-bb76-4e8deedf18cb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 681167,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/8c3360aed8184195bd380e24c4451312/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41f97a93-de3c-5513-bb76-4e8deedf18cb/41f97a93-de3c-5513-bb76-4e8deedf18cb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 673134,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/8c3360aed8184195bd380e24c4451312/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41f97a93-de3c-5513-bb76-4e8deedf18cb/41f97a93-de3c-5513-bb76-4e8deedf18cb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 892754,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/8c3360aed8184195bd380e24c4451312/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41f97a93-de3c-5513-bb76-4e8deedf18cb/41f97a93-de3c-5513-bb76-4e8deedf18cb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 844889,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/8c3360aed8184195bd380e24c4451312/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41f97a93-de3c-5513-bb76-4e8deedf18cb/41f97a93-de3c-5513-bb76-4e8deedf18cb_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 688742,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/8c3360aed8184195bd380e24c4451312/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ A-Klasse 1.5 A 180 D BUSINESS SOLUTION',
 'transmission': 'manual',
 'trim': '1.5 A 180 D BUSINESS SOLUTION',
 'vin': None,
 'year': 2022}
2026-03-26 22:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985379%27 HTTP/1.1" 200 None
2026-03-26 22:50:02 [ayvens.be] INFO: Saving data for 1985379: {'created_time': 1774565402.950517, 'last_price_update_time': 1774565402.950526, 'auction_closing_time': 1774958400.0}
2026-03-26 22:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985379') HTTP/1.1" 204 0
2026-03-26 22:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F568c90adf94d444fb78c3d7587fd4337%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/568c90adf94d444fb78c3d7587fd4337/images/large/3.jpg not downloaded yet
2026-03-26 22:50:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/b0724084526d472bafc8388bbb5fdfd5/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/b0724084526d472bafc8388bbb5fdfd5/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F568c90adf94d444fb78c3d7587fd4337%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/568c90adf94d444fb78c3d7587fd4337/images/large/4.jpg not downloaded yet
2026-03-26 22:50:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/b0724084526d472bafc8388bbb5fdfd5/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F568c90adf94d444fb78c3d7587fd4337%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/568c90adf94d444fb78c3d7587fd4337/images/large/5.jpg not downloaded yet
2026-03-26 22:50:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/b0724084526d472bafc8388bbb5fdfd5/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/b0724084526d472bafc8388bbb5fdfd5/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F568c90adf94d444fb78c3d7587fd4337%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/568c90adf94d444fb78c3d7587fd4337/images/large/6.jpg not downloaded yet
2026-03-26 22:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F568c90adf94d444fb78c3d7587fd4337%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/568c90adf94d444fb78c3d7587fd4337/images/large/7.jpg not downloaded yet
2026-03-26 22:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F568c90adf94d444fb78c3d7587fd4337%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/568c90adf94d444fb78c3d7587fd4337/images/large/8.jpg not downloaded yet
2026-03-26 22:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F568c90adf94d444fb78c3d7587fd4337%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/568c90adf94d444fb78c3d7587fd4337/images/large/9.jpg not downloaded yet
2026-03-26 22:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F568c90adf94d444fb78c3d7587fd4337%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/568c90adf94d444fb78c3d7587fd4337/images/large/10.jpg not downloaded yet
2026-03-26 22:50:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/568c90adf94d444fb78c3d7587fd4337/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6deec50>
2026-03-26 22:50:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_335e1b92-8dec-5058-af43-5393f02dbe77/335e1b92-8dec-5058-af43-5393f02dbe77_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252Fb0724084526d472bafc8388bbb5fdfd5%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/b0724084526d472bafc8388bbb5fdfd5/images/large/3.jpg saved to cache
2026-03-26 22:50:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 335e1b92-8dec-5058-af43-5393f02dbe77
2026-03-26 22:50:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7572b90>
2026-03-26 22:50:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_335e1b92-8dec-5058-af43-5393f02dbe77/335e1b92-8dec-5058-af43-5393f02dbe77_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252Fb0724084526d472bafc8388bbb5fdfd5%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/b0724084526d472bafc8388bbb5fdfd5/images/large/4.jpg saved to cache
2026-03-26 22:50:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 335e1b92-8dec-5058-af43-5393f02dbe77
2026-03-26 22:50:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/568c90adf94d444fb78c3d7587fd4337/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:03 [ayvens.be] INFO: Found listing with ID: 1985382
2026-03-26 22:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985382%27 HTTP/1.1" 200 None
2026-03-26 22:50:03 [ayvens.be] INFO: Scrape type for 1985382: 1
2026-03-26 22:50:03 [ayvens.be] INFO: Extracting data for car ID: 1985382
2026-03-26 22:50:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 959ab10b-8f5d-572c-96e3-29bf3d30a140 with identifier: 1985382
2026-03-26 22:50:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 959ab10b-8f5d-572c-96e3-29bf3d30a140 with scrape type 1
2026-03-26 22:50:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 959ab10b-8f5d-572c-96e3-29bf3d30a140
2026-03-26 22:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F2015eea44a114e40a6c5fec767cf2d76%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/2015eea44a114e40a6c5fec767cf2d76/images/large/1.jpg not downloaded yet
2026-03-26 22:50:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b167d0>
2026-03-26 22:50:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_335e1b92-8dec-5058-af43-5393f02dbe77/335e1b92-8dec-5058-af43-5393f02dbe77_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252Fb0724084526d472bafc8388bbb5fdfd5%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/b0724084526d472bafc8388bbb5fdfd5/images/large/2.jpg saved to cache
2026-03-26 22:50:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 335e1b92-8dec-5058-af43-5393f02dbe77
2026-03-26 22:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F2015eea44a114e40a6c5fec767cf2d76%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/2015eea44a114e40a6c5fec767cf2d76/images/large/2.jpg not downloaded yet
2026-03-26 22:50:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/568c90adf94d444fb78c3d7587fd4337/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/568c90adf94d444fb78c3d7587fd4337/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F2015eea44a114e40a6c5fec767cf2d76%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/2015eea44a114e40a6c5fec767cf2d76/images/large/3.jpg not downloaded yet
2026-03-26 22:50:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c62950>
2026-03-26 22:50:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_335e1b92-8dec-5058-af43-5393f02dbe77/335e1b92-8dec-5058-af43-5393f02dbe77_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252Fb0724084526d472bafc8388bbb5fdfd5%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/b0724084526d472bafc8388bbb5fdfd5/images/large/5.jpg saved to cache
2026-03-26 22:50:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 335e1b92-8dec-5058-af43-5393f02dbe77
2026-03-26 22:50:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6def9d0>
2026-03-26 22:50:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_335e1b92-8dec-5058-af43-5393f02dbe77/335e1b92-8dec-5058-af43-5393f02dbe77_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252Fb0724084526d472bafc8388bbb5fdfd5%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/b0724084526d472bafc8388bbb5fdfd5/images/large/6.jpg saved to cache
2026-03-26 22:50:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 335e1b92-8dec-5058-af43-5393f02dbe77
2026-03-26 22:50:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b72934d0>
2026-03-26 22:50:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0935e4d3-aba0-574f-a79e-8f1945954b6d/0935e4d3-aba0-574f-a79e-8f1945954b6d_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F568c90adf94d444fb78c3d7587fd4337%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/568c90adf94d444fb78c3d7587fd4337/images/large/2.jpg saved to cache
2026-03-26 22:50:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0935e4d3-aba0-574f-a79e-8f1945954b6d
2026-03-26 22:50:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7874c10>
2026-03-26 22:50:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0935e4d3-aba0-574f-a79e-8f1945954b6d/0935e4d3-aba0-574f-a79e-8f1945954b6d_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F568c90adf94d444fb78c3d7587fd4337%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/568c90adf94d444fb78c3d7587fd4337/images/large/1.jpg saved to cache
2026-03-26 22:50:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0935e4d3-aba0-574f-a79e-8f1945954b6d
2026-03-26 22:50:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/b0724084526d472bafc8388bbb5fdfd5/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/b0724084526d472bafc8388bbb5fdfd5/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/b0724084526d472bafc8388bbb5fdfd5/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/568c90adf94d444fb78c3d7587fd4337/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F2015eea44a114e40a6c5fec767cf2d76%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/2015eea44a114e40a6c5fec767cf2d76/images/large/4.jpg not downloaded yet
2026-03-26 22:50:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/b0724084526d472bafc8388bbb5fdfd5/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F2015eea44a114e40a6c5fec767cf2d76%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/2015eea44a114e40a6c5fec767cf2d76/images/large/5.jpg not downloaded yet
2026-03-26 22:50:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74cfa10>
2026-03-26 22:50:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0935e4d3-aba0-574f-a79e-8f1945954b6d/0935e4d3-aba0-574f-a79e-8f1945954b6d_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F568c90adf94d444fb78c3d7587fd4337%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/568c90adf94d444fb78c3d7587fd4337/images/large/4.jpg saved to cache
2026-03-26 22:50:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0935e4d3-aba0-574f-a79e-8f1945954b6d
2026-03-26 22:50:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c80710>
2026-03-26 22:50:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0935e4d3-aba0-574f-a79e-8f1945954b6d/0935e4d3-aba0-574f-a79e-8f1945954b6d_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F568c90adf94d444fb78c3d7587fd4337%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/568c90adf94d444fb78c3d7587fd4337/images/large/3.jpg saved to cache
2026-03-26 22:50:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0935e4d3-aba0-574f-a79e-8f1945954b6d
2026-03-26 22:50:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/568c90adf94d444fb78c3d7587fd4337/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F2015eea44a114e40a6c5fec767cf2d76%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/2015eea44a114e40a6c5fec767cf2d76/images/large/6.jpg not downloaded yet
2026-03-26 22:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F2015eea44a114e40a6c5fec767cf2d76%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/2015eea44a114e40a6c5fec767cf2d76/images/large/7.jpg not downloaded yet
2026-03-26 22:50:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/568c90adf94d444fb78c3d7587fd4337/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/568c90adf94d444fb78c3d7587fd4337/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/2015eea44a114e40a6c5fec767cf2d76/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/2015eea44a114e40a6c5fec767cf2d76/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F2015eea44a114e40a6c5fec767cf2d76%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/2015eea44a114e40a6c5fec767cf2d76/images/large/8.jpg not downloaded yet
2026-03-26 22:50:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c5d750>
2026-03-26 22:50:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_335e1b92-8dec-5058-af43-5393f02dbe77/335e1b92-8dec-5058-af43-5393f02dbe77_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252Fb0724084526d472bafc8388bbb5fdfd5%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/b0724084526d472bafc8388bbb5fdfd5/images/large/9.jpg saved to cache
2026-03-26 22:50:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 335e1b92-8dec-5058-af43-5393f02dbe77
2026-03-26 22:50:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7435110>
2026-03-26 22:50:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_335e1b92-8dec-5058-af43-5393f02dbe77/335e1b92-8dec-5058-af43-5393f02dbe77_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252Fb0724084526d472bafc8388bbb5fdfd5%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/b0724084526d472bafc8388bbb5fdfd5/images/large/10.jpg saved to cache
2026-03-26 22:50:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 335e1b92-8dec-5058-af43-5393f02dbe77
2026-03-26 22:50:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76eee10>
2026-03-26 22:50:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_335e1b92-8dec-5058-af43-5393f02dbe77/335e1b92-8dec-5058-af43-5393f02dbe77_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252Fb0724084526d472bafc8388bbb5fdfd5%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/b0724084526d472bafc8388bbb5fdfd5/images/large/8.jpg saved to cache
2026-03-26 22:50:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 335e1b92-8dec-5058-af43-5393f02dbe77
2026-03-26 22:50:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b764ad50>
2026-03-26 22:50:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0935e4d3-aba0-574f-a79e-8f1945954b6d/0935e4d3-aba0-574f-a79e-8f1945954b6d_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F568c90adf94d444fb78c3d7587fd4337%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/568c90adf94d444fb78c3d7587fd4337/images/large/5.jpg saved to cache
2026-03-26 22:50:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0935e4d3-aba0-574f-a79e-8f1945954b6d
2026-03-26 22:50:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76ef010>
2026-03-26 22:50:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_335e1b92-8dec-5058-af43-5393f02dbe77/335e1b92-8dec-5058-af43-5393f02dbe77_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252Fb0724084526d472bafc8388bbb5fdfd5%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/b0724084526d472bafc8388bbb5fdfd5/images/large/7.jpg saved to cache
2026-03-26 22:50:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 335e1b92-8dec-5058-af43-5393f02dbe77
2026-03-26 22:50:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 335e1b92-8dec-5058-af43-5393f02dbe77, skipping ID generation
2026-03-26 22:50:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 335e1b92-8dec-5058-af43-5393f02dbe77 with scrape type 1
2026-03-26 22:50:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 335e1b92-8dec-5058-af43-5393f02dbe77 sending to next pipeline
2026-03-26 22:50:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 335e1b92-8dec-5058-af43-5393f02dbe77, identifier: 1985380
2026-03-26 22:50:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/568c90adf94d444fb78c3d7587fd4337/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 335e1b92-8dec-5058-af43-5393f02dbe77 with identifier: 1985380
2026-03-26 22:50:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 335e1b92-8dec-5058-af43-5393f02dbe77 with identifier: 1985380
2026-03-26 22:50:05 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 335e1b92-8dec-5058-af43-5393f02dbe77 with identifier: 1985380 to the API
2026-03-26 22:50:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:50:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:50:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2av/b0724084526d472bafc8388bbb5fdfd5/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '335e1b92-8dec-5058-af43-5393f02dbe77',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1 - 2019',
 'odometer': 103020,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_335e1b92-8dec-5058-af43-5393f02dbe77/335e1b92-8dec-5058-af43-5393f02dbe77_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 678773,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/b0724084526d472bafc8388bbb5fdfd5/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_335e1b92-8dec-5058-af43-5393f02dbe77/335e1b92-8dec-5058-af43-5393f02dbe77_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 670570,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/b0724084526d472bafc8388bbb5fdfd5/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_335e1b92-8dec-5058-af43-5393f02dbe77/335e1b92-8dec-5058-af43-5393f02dbe77_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 620222,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/b0724084526d472bafc8388bbb5fdfd5/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_335e1b92-8dec-5058-af43-5393f02dbe77/335e1b92-8dec-5058-af43-5393f02dbe77_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 687491,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/b0724084526d472bafc8388bbb5fdfd5/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_335e1b92-8dec-5058-af43-5393f02dbe77/335e1b92-8dec-5058-af43-5393f02dbe77_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 687491,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/b0724084526d472bafc8388bbb5fdfd5/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_335e1b92-8dec-5058-af43-5393f02dbe77/335e1b92-8dec-5058-af43-5393f02dbe77_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 696894,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/b0724084526d472bafc8388bbb5fdfd5/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_335e1b92-8dec-5058-af43-5393f02dbe77/335e1b92-8dec-5058-af43-5393f02dbe77_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 774076,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/b0724084526d472bafc8388bbb5fdfd5/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_335e1b92-8dec-5058-af43-5393f02dbe77/335e1b92-8dec-5058-af43-5393f02dbe77_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 570709,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/b0724084526d472bafc8388bbb5fdfd5/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_335e1b92-8dec-5058-af43-5393f02dbe77/335e1b92-8dec-5058-af43-5393f02dbe77_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 735025,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/b0724084526d472bafc8388bbb5fdfd5/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_335e1b92-8dec-5058-af43-5393f02dbe77/335e1b92-8dec-5058-af43-5393f02dbe77_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 720116,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/b0724084526d472bafc8388bbb5fdfd5/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 - 2019 1.5iA xDrive25e PHEV OPF',
 'transmission': 'automatic',
 'trim': '1.5iA xDrive25e PHEV OPF',
 'vin': None,
 'year': 2021}
2026-03-26 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985380%27 HTTP/1.1" 200 None
2026-03-26 22:50:05 [ayvens.be] INFO: Saving data for 1985380: {'created_time': 1774565405.333434, 'last_price_update_time': 1774565405.333442, 'auction_closing_time': 1774958400.0}
2026-03-26 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985380') HTTP/1.1" 204 0
2026-03-26 22:50:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/568c90adf94d444fb78c3d7587fd4337/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F2015eea44a114e40a6c5fec767cf2d76%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/2015eea44a114e40a6c5fec767cf2d76/images/large/9.jpg not downloaded yet
2026-03-26 22:50:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/2015eea44a114e40a6c5fec767cf2d76/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b746d010>
2026-03-26 22:50:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0935e4d3-aba0-574f-a79e-8f1945954b6d/0935e4d3-aba0-574f-a79e-8f1945954b6d_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F568c90adf94d444fb78c3d7587fd4337%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/568c90adf94d444fb78c3d7587fd4337/images/large/6.jpg saved to cache
2026-03-26 22:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0935e4d3-aba0-574f-a79e-8f1945954b6d
2026-03-26 22:50:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b171d0>
2026-03-26 22:50:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0935e4d3-aba0-574f-a79e-8f1945954b6d/0935e4d3-aba0-574f-a79e-8f1945954b6d_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F568c90adf94d444fb78c3d7587fd4337%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/568c90adf94d444fb78c3d7587fd4337/images/large/7.jpg saved to cache
2026-03-26 22:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0935e4d3-aba0-574f-a79e-8f1945954b6d
2026-03-26 22:50:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b15dd0>
2026-03-26 22:50:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0935e4d3-aba0-574f-a79e-8f1945954b6d/0935e4d3-aba0-574f-a79e-8f1945954b6d_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F568c90adf94d444fb78c3d7587fd4337%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/568c90adf94d444fb78c3d7587fd4337/images/large/8.jpg saved to cache
2026-03-26 22:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0935e4d3-aba0-574f-a79e-8f1945954b6d
2026-03-26 22:50:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b727c510>
2026-03-26 22:50:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_959ab10b-8f5d-572c-96e3-29bf3d30a140/959ab10b-8f5d-572c-96e3-29bf3d30a140_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F2015eea44a114e40a6c5fec767cf2d76%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/2015eea44a114e40a6c5fec767cf2d76/images/large/2.jpg saved to cache
2026-03-26 22:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 959ab10b-8f5d-572c-96e3-29bf3d30a140
2026-03-26 22:50:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74cd5d0>
2026-03-26 22:50:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_959ab10b-8f5d-572c-96e3-29bf3d30a140/959ab10b-8f5d-572c-96e3-29bf3d30a140_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F2015eea44a114e40a6c5fec767cf2d76%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/2015eea44a114e40a6c5fec767cf2d76/images/large/1.jpg saved to cache
2026-03-26 22:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 959ab10b-8f5d-572c-96e3-29bf3d30a140
2026-03-26 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F2015eea44a114e40a6c5fec767cf2d76%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/2015eea44a114e40a6c5fec767cf2d76/images/large/10.jpg not downloaded yet
2026-03-26 22:50:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/2015eea44a114e40a6c5fec767cf2d76/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79cf410>
2026-03-26 22:50:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0935e4d3-aba0-574f-a79e-8f1945954b6d/0935e4d3-aba0-574f-a79e-8f1945954b6d_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F568c90adf94d444fb78c3d7587fd4337%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/568c90adf94d444fb78c3d7587fd4337/images/large/9.jpg saved to cache
2026-03-26 22:50:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0935e4d3-aba0-574f-a79e-8f1945954b6d
2026-03-26 22:50:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/2015eea44a114e40a6c5fec767cf2d76/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:06 [ayvens.be] INFO: Found listing with ID: 1985383
2026-03-26 22:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985383%27 HTTP/1.1" 200 None
2026-03-26 22:50:06 [ayvens.be] INFO: Scrape type for 1985383: 1
2026-03-26 22:50:06 [ayvens.be] INFO: Extracting data for car ID: 1985383
2026-03-26 22:50:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c93adac2-ee3a-5713-82d6-2c1a80d6ee8e with identifier: 1985383
2026-03-26 22:50:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c93adac2-ee3a-5713-82d6-2c1a80d6ee8e with scrape type 1
2026-03-26 22:50:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c93adac2-ee3a-5713-82d6-2c1a80d6ee8e
2026-03-26 22:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F3349db9f23424767b3a038623ba0777b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/3349db9f23424767b3a038623ba0777b/images/large/1.jpg not downloaded yet
2026-03-26 22:50:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b72ef810>
2026-03-26 22:50:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0935e4d3-aba0-574f-a79e-8f1945954b6d/0935e4d3-aba0-574f-a79e-8f1945954b6d_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F568c90adf94d444fb78c3d7587fd4337%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/568c90adf94d444fb78c3d7587fd4337/images/large/10.jpg saved to cache
2026-03-26 22:50:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0935e4d3-aba0-574f-a79e-8f1945954b6d
2026-03-26 22:50:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0935e4d3-aba0-574f-a79e-8f1945954b6d, skipping ID generation
2026-03-26 22:50:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0935e4d3-aba0-574f-a79e-8f1945954b6d with scrape type 1
2026-03-26 22:50:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0935e4d3-aba0-574f-a79e-8f1945954b6d sending to next pipeline
2026-03-26 22:50:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 0935e4d3-aba0-574f-a79e-8f1945954b6d, identifier: 1985381
2026-03-26 22:50:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7924fd0>
2026-03-26 22:50:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_959ab10b-8f5d-572c-96e3-29bf3d30a140/959ab10b-8f5d-572c-96e3-29bf3d30a140_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F2015eea44a114e40a6c5fec767cf2d76%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/2015eea44a114e40a6c5fec767cf2d76/images/large/3.jpg saved to cache
2026-03-26 22:50:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 959ab10b-8f5d-572c-96e3-29bf3d30a140
2026-03-26 22:50:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/2015eea44a114e40a6c5fec767cf2d76/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 0935e4d3-aba0-574f-a79e-8f1945954b6d with identifier: 1985381
2026-03-26 22:50:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 0935e4d3-aba0-574f-a79e-8f1945954b6d with identifier: 1985381
2026-03-26 22:50:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 0935e4d3-aba0-574f-a79e-8f1945954b6d with identifier: 1985381 to the API
2026-03-26 22:50:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:50:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:50:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bx/568c90adf94d444fb78c3d7587fd4337/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '0935e4d3-aba0-574f-a79e-8f1945954b6d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'T-CROSS',
 'odometer': 127120,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0935e4d3-aba0-574f-a79e-8f1945954b6d/0935e4d3-aba0-574f-a79e-8f1945954b6d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 328422,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/568c90adf94d444fb78c3d7587fd4337/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0935e4d3-aba0-574f-a79e-8f1945954b6d/0935e4d3-aba0-574f-a79e-8f1945954b6d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 327440,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/568c90adf94d444fb78c3d7587fd4337/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0935e4d3-aba0-574f-a79e-8f1945954b6d/0935e4d3-aba0-574f-a79e-8f1945954b6d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 354821,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/568c90adf94d444fb78c3d7587fd4337/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0935e4d3-aba0-574f-a79e-8f1945954b6d/0935e4d3-aba0-574f-a79e-8f1945954b6d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 345447,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/568c90adf94d444fb78c3d7587fd4337/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0935e4d3-aba0-574f-a79e-8f1945954b6d/0935e4d3-aba0-574f-a79e-8f1945954b6d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 305741,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/568c90adf94d444fb78c3d7587fd4337/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0935e4d3-aba0-574f-a79e-8f1945954b6d/0935e4d3-aba0-574f-a79e-8f1945954b6d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 276842,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/568c90adf94d444fb78c3d7587fd4337/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0935e4d3-aba0-574f-a79e-8f1945954b6d/0935e4d3-aba0-574f-a79e-8f1945954b6d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 352561,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/568c90adf94d444fb78c3d7587fd4337/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0935e4d3-aba0-574f-a79e-8f1945954b6d/0935e4d3-aba0-574f-a79e-8f1945954b6d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 263495,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/568c90adf94d444fb78c3d7587fd4337/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0935e4d3-aba0-574f-a79e-8f1945954b6d/0935e4d3-aba0-574f-a79e-8f1945954b6d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 271776,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/568c90adf94d444fb78c3d7587fd4337/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0935e4d3-aba0-574f-a79e-8f1945954b6d/0935e4d3-aba0-574f-a79e-8f1945954b6d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 373783,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/568c90adf94d444fb78c3d7587fd4337/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN T-CROSS 1.0 TSI 81KW DSG ACTIVE',
 'transmission': 'automatic',
 'trim': '1.0 TSI 81KW DSG ACTIVE',
 'vin': None,
 'year': 2022}
2026-03-26 22:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985381%27 HTTP/1.1" 200 None
2026-03-26 22:50:06 [ayvens.be] INFO: Saving data for 1985381: {'created_time': 1774565406.651357, 'last_price_update_time': 1774565406.651368, 'auction_closing_time': 1774958400.0}
2026-03-26 22:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985381') HTTP/1.1" 204 0
2026-03-26 22:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F3349db9f23424767b3a038623ba0777b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/3349db9f23424767b3a038623ba0777b/images/large/2.jpg not downloaded yet
2026-03-26 22:50:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/2015eea44a114e40a6c5fec767cf2d76/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7415a10>
2026-03-26 22:50:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_959ab10b-8f5d-572c-96e3-29bf3d30a140/959ab10b-8f5d-572c-96e3-29bf3d30a140_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F2015eea44a114e40a6c5fec767cf2d76%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/2015eea44a114e40a6c5fec767cf2d76/images/large/4.jpg saved to cache
2026-03-26 22:50:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 959ab10b-8f5d-572c-96e3-29bf3d30a140
2026-03-26 22:50:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79cc590>
2026-03-26 22:50:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_959ab10b-8f5d-572c-96e3-29bf3d30a140/959ab10b-8f5d-572c-96e3-29bf3d30a140_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F2015eea44a114e40a6c5fec767cf2d76%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/2015eea44a114e40a6c5fec767cf2d76/images/large/6.jpg saved to cache
2026-03-26 22:50:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 959ab10b-8f5d-572c-96e3-29bf3d30a140
2026-03-26 22:50:06 [scrapy.extensions.logstats] INFO: Crawled 6 pages (at -1 pages/min), scraped 162 items (at 36 items/min)
2026-03-26 22:50:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 181MiB
2026-03-26 22:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F3349db9f23424767b3a038623ba0777b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/3349db9f23424767b3a038623ba0777b/images/large/3.jpg not downloaded yet
2026-03-26 22:50:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b741fa90>
2026-03-26 22:50:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_959ab10b-8f5d-572c-96e3-29bf3d30a140/959ab10b-8f5d-572c-96e3-29bf3d30a140_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F2015eea44a114e40a6c5fec767cf2d76%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/2015eea44a114e40a6c5fec767cf2d76/images/large/5.jpg saved to cache
2026-03-26 22:50:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 959ab10b-8f5d-572c-96e3-29bf3d30a140
2026-03-26 22:50:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/2015eea44a114e40a6c5fec767cf2d76/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F3349db9f23424767b3a038623ba0777b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/3349db9f23424767b3a038623ba0777b/images/large/4.jpg not downloaded yet
2026-03-26 22:50:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74b6950>
2026-03-26 22:50:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_959ab10b-8f5d-572c-96e3-29bf3d30a140/959ab10b-8f5d-572c-96e3-29bf3d30a140_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F2015eea44a114e40a6c5fec767cf2d76%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/2015eea44a114e40a6c5fec767cf2d76/images/large/7.jpg saved to cache
2026-03-26 22:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 959ab10b-8f5d-572c-96e3-29bf3d30a140
2026-03-26 22:50:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/2015eea44a114e40a6c5fec767cf2d76/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/2015eea44a114e40a6c5fec767cf2d76/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F3349db9f23424767b3a038623ba0777b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/3349db9f23424767b3a038623ba0777b/images/large/5.jpg not downloaded yet
2026-03-26 22:50:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd0c5ed0>
2026-03-26 22:50:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_959ab10b-8f5d-572c-96e3-29bf3d30a140/959ab10b-8f5d-572c-96e3-29bf3d30a140_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F2015eea44a114e40a6c5fec767cf2d76%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/2015eea44a114e40a6c5fec767cf2d76/images/large/9.jpg saved to cache
2026-03-26 22:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 959ab10b-8f5d-572c-96e3-29bf3d30a140
2026-03-26 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F3349db9f23424767b3a038623ba0777b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/3349db9f23424767b3a038623ba0777b/images/large/6.jpg not downloaded yet
2026-03-26 22:50:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/3349db9f23424767b3a038623ba0777b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/3349db9f23424767b3a038623ba0777b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F3349db9f23424767b3a038623ba0777b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/3349db9f23424767b3a038623ba0777b/images/large/7.jpg not downloaded yet
2026-03-26 22:50:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6d81390>
2026-03-26 22:50:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_959ab10b-8f5d-572c-96e3-29bf3d30a140/959ab10b-8f5d-572c-96e3-29bf3d30a140_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F2015eea44a114e40a6c5fec767cf2d76%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/2015eea44a114e40a6c5fec767cf2d76/images/large/8.jpg saved to cache
2026-03-26 22:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 959ab10b-8f5d-572c-96e3-29bf3d30a140
2026-03-26 22:50:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7584690>
2026-03-26 22:50:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_959ab10b-8f5d-572c-96e3-29bf3d30a140/959ab10b-8f5d-572c-96e3-29bf3d30a140_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F2015eea44a114e40a6c5fec767cf2d76%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/2015eea44a114e40a6c5fec767cf2d76/images/large/10.jpg saved to cache
2026-03-26 22:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 959ab10b-8f5d-572c-96e3-29bf3d30a140
2026-03-26 22:50:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 959ab10b-8f5d-572c-96e3-29bf3d30a140, skipping ID generation
2026-03-26 22:50:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 959ab10b-8f5d-572c-96e3-29bf3d30a140 with scrape type 1
2026-03-26 22:50:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 959ab10b-8f5d-572c-96e3-29bf3d30a140 sending to next pipeline
2026-03-26 22:50:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 959ab10b-8f5d-572c-96e3-29bf3d30a140, identifier: 1985382
2026-03-26 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F3349db9f23424767b3a038623ba0777b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/3349db9f23424767b3a038623ba0777b/images/large/8.jpg not downloaded yet
2026-03-26 22:50:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 959ab10b-8f5d-572c-96e3-29bf3d30a140 with identifier: 1985382
2026-03-26 22:50:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 959ab10b-8f5d-572c-96e3-29bf3d30a140 with identifier: 1985382
2026-03-26 22:50:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 959ab10b-8f5d-572c-96e3-29bf3d30a140 with identifier: 1985382 to the API
2026-03-26 22:50:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:50:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:50:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ae/2015eea44a114e40a6c5fec767cf2d76/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '959ab10b-8f5d-572c-96e3-29bf3d30a140',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 164549,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_959ab10b-8f5d-572c-96e3-29bf3d30a140/959ab10b-8f5d-572c-96e3-29bf3d30a140_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 256422,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/2015eea44a114e40a6c5fec767cf2d76/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_959ab10b-8f5d-572c-96e3-29bf3d30a140/959ab10b-8f5d-572c-96e3-29bf3d30a140_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 253957,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/2015eea44a114e40a6c5fec767cf2d76/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_959ab10b-8f5d-572c-96e3-29bf3d30a140/959ab10b-8f5d-572c-96e3-29bf3d30a140_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 265610,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/2015eea44a114e40a6c5fec767cf2d76/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_959ab10b-8f5d-572c-96e3-29bf3d30a140/959ab10b-8f5d-572c-96e3-29bf3d30a140_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 271748,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/2015eea44a114e40a6c5fec767cf2d76/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_959ab10b-8f5d-572c-96e3-29bf3d30a140/959ab10b-8f5d-572c-96e3-29bf3d30a140_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 278061,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/2015eea44a114e40a6c5fec767cf2d76/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_959ab10b-8f5d-572c-96e3-29bf3d30a140/959ab10b-8f5d-572c-96e3-29bf3d30a140_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 258488,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/2015eea44a114e40a6c5fec767cf2d76/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_959ab10b-8f5d-572c-96e3-29bf3d30a140/959ab10b-8f5d-572c-96e3-29bf3d30a140_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 285601,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/2015eea44a114e40a6c5fec767cf2d76/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_959ab10b-8f5d-572c-96e3-29bf3d30a140/959ab10b-8f5d-572c-96e3-29bf3d30a140_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 354445,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/2015eea44a114e40a6c5fec767cf2d76/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_959ab10b-8f5d-572c-96e3-29bf3d30a140/959ab10b-8f5d-572c-96e3-29bf3d30a140_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 305097,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/2015eea44a114e40a6c5fec767cf2d76/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_959ab10b-8f5d-572c-96e3-29bf3d30a140/959ab10b-8f5d-572c-96e3-29bf3d30a140_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 219417,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/2015eea44a114e40a6c5fec767cf2d76/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T4 RECHARGE GEARTRONIC R-DESIGN',
 'transmission': 'automatic',
 'trim': '1.5 T4 RECHARGE GEARTRONIC R-DESIGN',
 'vin': None,
 'year': 2021}
2026-03-26 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985382%27 HTTP/1.1" 200 None
2026-03-26 22:50:07 [ayvens.be] INFO: Saving data for 1985382: {'created_time': 1774565407.805325, 'last_price_update_time': 1774565407.805334, 'auction_closing_time': 1774958400.0}
2026-03-26 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985382') HTTP/1.1" 204 0
2026-03-26 22:50:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/3349db9f23424767b3a038623ba0777b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F3349db9f23424767b3a038623ba0777b%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/3349db9f23424767b3a038623ba0777b/images/large/9.jpg not downloaded yet
2026-03-26 22:50:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77c96d0>
2026-03-26 22:50:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c93adac2-ee3a-5713-82d6-2c1a80d6ee8e/c93adac2-ee3a-5713-82d6-2c1a80d6ee8e_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F3349db9f23424767b3a038623ba0777b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/3349db9f23424767b3a038623ba0777b/images/large/1.jpg saved to cache
2026-03-26 22:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c93adac2-ee3a-5713-82d6-2c1a80d6ee8e
2026-03-26 22:50:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6d83450>
2026-03-26 22:50:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c93adac2-ee3a-5713-82d6-2c1a80d6ee8e/c93adac2-ee3a-5713-82d6-2c1a80d6ee8e_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F3349db9f23424767b3a038623ba0777b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/3349db9f23424767b3a038623ba0777b/images/large/2.jpg saved to cache
2026-03-26 22:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c93adac2-ee3a-5713-82d6-2c1a80d6ee8e
2026-03-26 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F3349db9f23424767b3a038623ba0777b%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/3349db9f23424767b3a038623ba0777b/images/large/10.jpg not downloaded yet
2026-03-26 22:50:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/3349db9f23424767b3a038623ba0777b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/3349db9f23424767b3a038623ba0777b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:08 [ayvens.be] INFO: Found listing with ID: 1985384
2026-03-26 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985384%27 HTTP/1.1" 200 None
2026-03-26 22:50:08 [ayvens.be] INFO: Scrape type for 1985384: 1
2026-03-26 22:50:08 [ayvens.be] INFO: Extracting data for car ID: 1985384
2026-03-26 22:50:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a826a95-196a-50d9-9c13-656a021883c3 with identifier: 1985384
2026-03-26 22:50:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a826a95-196a-50d9-9c13-656a021883c3 with scrape type 1
2026-03-26 22:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2a826a95-196a-50d9-9c13-656a021883c3
2026-03-26 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252Ff622ac075f0d40bda6934598fa3304cc%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/f622ac075f0d40bda6934598fa3304cc/images/large/1.jpg not downloaded yet
2026-03-26 22:50:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74a5ed0>
2026-03-26 22:50:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c93adac2-ee3a-5713-82d6-2c1a80d6ee8e/c93adac2-ee3a-5713-82d6-2c1a80d6ee8e_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F3349db9f23424767b3a038623ba0777b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/3349db9f23424767b3a038623ba0777b/images/large/3.jpg saved to cache
2026-03-26 22:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c93adac2-ee3a-5713-82d6-2c1a80d6ee8e
2026-03-26 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252Ff622ac075f0d40bda6934598fa3304cc%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/f622ac075f0d40bda6934598fa3304cc/images/large/2.jpg not downloaded yet
2026-03-26 22:50:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/3349db9f23424767b3a038623ba0777b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/3349db9f23424767b3a038623ba0777b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252Ff622ac075f0d40bda6934598fa3304cc%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/f622ac075f0d40bda6934598fa3304cc/images/large/3.jpg not downloaded yet
2026-03-26 22:50:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/3349db9f23424767b3a038623ba0777b/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/3349db9f23424767b3a038623ba0777b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79cf010>
2026-03-26 22:50:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c93adac2-ee3a-5713-82d6-2c1a80d6ee8e/c93adac2-ee3a-5713-82d6-2c1a80d6ee8e_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F3349db9f23424767b3a038623ba0777b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/3349db9f23424767b3a038623ba0777b/images/large/4.jpg saved to cache
2026-03-26 22:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c93adac2-ee3a-5713-82d6-2c1a80d6ee8e
2026-03-26 22:50:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79f3210>
2026-03-26 22:50:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c93adac2-ee3a-5713-82d6-2c1a80d6ee8e/c93adac2-ee3a-5713-82d6-2c1a80d6ee8e_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F3349db9f23424767b3a038623ba0777b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/3349db9f23424767b3a038623ba0777b/images/large/5.jpg saved to cache
2026-03-26 22:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c93adac2-ee3a-5713-82d6-2c1a80d6ee8e
2026-03-26 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252Ff622ac075f0d40bda6934598fa3304cc%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/f622ac075f0d40bda6934598fa3304cc/images/large/4.jpg not downloaded yet
2026-03-26 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252Ff622ac075f0d40bda6934598fa3304cc%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/f622ac075f0d40bda6934598fa3304cc/images/large/5.jpg not downloaded yet
2026-03-26 22:50:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7aa2d50>
2026-03-26 22:50:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c93adac2-ee3a-5713-82d6-2c1a80d6ee8e/c93adac2-ee3a-5713-82d6-2c1a80d6ee8e_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F3349db9f23424767b3a038623ba0777b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/3349db9f23424767b3a038623ba0777b/images/large/6.jpg saved to cache
2026-03-26 22:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c93adac2-ee3a-5713-82d6-2c1a80d6ee8e
2026-03-26 22:50:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b727a790>
2026-03-26 22:50:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c93adac2-ee3a-5713-82d6-2c1a80d6ee8e/c93adac2-ee3a-5713-82d6-2c1a80d6ee8e_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F3349db9f23424767b3a038623ba0777b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/3349db9f23424767b3a038623ba0777b/images/large/7.jpg saved to cache
2026-03-26 22:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c93adac2-ee3a-5713-82d6-2c1a80d6ee8e
2026-03-26 22:50:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b764b950>
2026-03-26 22:50:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c93adac2-ee3a-5713-82d6-2c1a80d6ee8e/c93adac2-ee3a-5713-82d6-2c1a80d6ee8e_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F3349db9f23424767b3a038623ba0777b%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/3349db9f23424767b3a038623ba0777b/images/large/9.jpg saved to cache
2026-03-26 22:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c93adac2-ee3a-5713-82d6-2c1a80d6ee8e
2026-03-26 22:50:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b788fd10>
2026-03-26 22:50:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c93adac2-ee3a-5713-82d6-2c1a80d6ee8e/c93adac2-ee3a-5713-82d6-2c1a80d6ee8e_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F3349db9f23424767b3a038623ba0777b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/3349db9f23424767b3a038623ba0777b/images/large/8.jpg saved to cache
2026-03-26 22:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c93adac2-ee3a-5713-82d6-2c1a80d6ee8e
2026-03-26 22:50:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/3349db9f23424767b3a038623ba0777b/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252Ff622ac075f0d40bda6934598fa3304cc%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/f622ac075f0d40bda6934598fa3304cc/images/large/6.jpg not downloaded yet
2026-03-26 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252Ff622ac075f0d40bda6934598fa3304cc%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/f622ac075f0d40bda6934598fa3304cc/images/large/7.jpg not downloaded yet
2026-03-26 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252Ff622ac075f0d40bda6934598fa3304cc%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/f622ac075f0d40bda6934598fa3304cc/images/large/8.jpg not downloaded yet
2026-03-26 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252Ff622ac075f0d40bda6934598fa3304cc%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/f622ac075f0d40bda6934598fa3304cc/images/large/9.jpg not downloaded yet
2026-03-26 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252Ff622ac075f0d40bda6934598fa3304cc%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/f622ac075f0d40bda6934598fa3304cc/images/large/10.jpg not downloaded yet
2026-03-26 22:50:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/f622ac075f0d40bda6934598fa3304cc/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/f622ac075f0d40bda6934598fa3304cc/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/f622ac075f0d40bda6934598fa3304cc/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:08 [ayvens.be] INFO: Found listing with ID: 1985385
2026-03-26 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985385%27 HTTP/1.1" 200 None
2026-03-26 22:50:08 [ayvens.be] INFO: Scrape type for 1985385: 1
2026-03-26 22:50:08 [ayvens.be] INFO: Extracting data for car ID: 1985385
2026-03-26 22:50:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 204b260e-559e-573a-a182-0234b1a52c5d with identifier: 1985385
2026-03-26 22:50:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 204b260e-559e-573a-a182-0234b1a52c5d with scrape type 1
2026-03-26 22:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 204b260e-559e-573a-a182-0234b1a52c5d
2026-03-26 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F19c2623cc6fd4708b71b6f2b11f659a8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/19c2623cc6fd4708b71b6f2b11f659a8/images/large/1.jpg not downloaded yet
2026-03-26 22:50:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e13bd0>
2026-03-26 22:50:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c93adac2-ee3a-5713-82d6-2c1a80d6ee8e/c93adac2-ee3a-5713-82d6-2c1a80d6ee8e_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F3349db9f23424767b3a038623ba0777b%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/3349db9f23424767b3a038623ba0777b/images/large/10.jpg saved to cache
2026-03-26 22:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c93adac2-ee3a-5713-82d6-2c1a80d6ee8e
2026-03-26 22:50:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c93adac2-ee3a-5713-82d6-2c1a80d6ee8e, skipping ID generation
2026-03-26 22:50:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c93adac2-ee3a-5713-82d6-2c1a80d6ee8e with scrape type 1
2026-03-26 22:50:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c93adac2-ee3a-5713-82d6-2c1a80d6ee8e sending to next pipeline
2026-03-26 22:50:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c93adac2-ee3a-5713-82d6-2c1a80d6ee8e, identifier: 1985383
2026-03-26 22:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F19c2623cc6fd4708b71b6f2b11f659a8%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/19c2623cc6fd4708b71b6f2b11f659a8/images/large/2.jpg not downloaded yet
2026-03-26 22:50:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c93adac2-ee3a-5713-82d6-2c1a80d6ee8e with identifier: 1985383
2026-03-26 22:50:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c93adac2-ee3a-5713-82d6-2c1a80d6ee8e with identifier: 1985383
2026-03-26 22:50:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c93adac2-ee3a-5713-82d6-2c1a80d6ee8e with identifier: 1985383 to the API
2026-03-26 22:50:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:50:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:50:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2de/3349db9f23424767b3a038623ba0777b/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'c93adac2-ee3a-5713-82d6-2c1a80d6ee8e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '1 SERIES HATCH',
 'odometer': 67371,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c93adac2-ee3a-5713-82d6-2c1a80d6ee8e/c93adac2-ee3a-5713-82d6-2c1a80d6ee8e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 303874,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/3349db9f23424767b3a038623ba0777b/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c93adac2-ee3a-5713-82d6-2c1a80d6ee8e/c93adac2-ee3a-5713-82d6-2c1a80d6ee8e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 297191,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/3349db9f23424767b3a038623ba0777b/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c93adac2-ee3a-5713-82d6-2c1a80d6ee8e/c93adac2-ee3a-5713-82d6-2c1a80d6ee8e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 309168,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/3349db9f23424767b3a038623ba0777b/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c93adac2-ee3a-5713-82d6-2c1a80d6ee8e/c93adac2-ee3a-5713-82d6-2c1a80d6ee8e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 324194,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/3349db9f23424767b3a038623ba0777b/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c93adac2-ee3a-5713-82d6-2c1a80d6ee8e/c93adac2-ee3a-5713-82d6-2c1a80d6ee8e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 304585,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/3349db9f23424767b3a038623ba0777b/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c93adac2-ee3a-5713-82d6-2c1a80d6ee8e/c93adac2-ee3a-5713-82d6-2c1a80d6ee8e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 274784,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/3349db9f23424767b3a038623ba0777b/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c93adac2-ee3a-5713-82d6-2c1a80d6ee8e/c93adac2-ee3a-5713-82d6-2c1a80d6ee8e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 355495,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/3349db9f23424767b3a038623ba0777b/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c93adac2-ee3a-5713-82d6-2c1a80d6ee8e/c93adac2-ee3a-5713-82d6-2c1a80d6ee8e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 258422,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/3349db9f23424767b3a038623ba0777b/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c93adac2-ee3a-5713-82d6-2c1a80d6ee8e/c93adac2-ee3a-5713-82d6-2c1a80d6ee8e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 245151,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/3349db9f23424767b3a038623ba0777b/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c93adac2-ee3a-5713-82d6-2c1a80d6ee8e/c93adac2-ee3a-5713-82d6-2c1a80d6ee8e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 213665,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/3349db9f23424767b3a038623ba0777b/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1 SERIES HATCH 1.5 116IA (80KW)',
 'transmission': 'automatic',
 'trim': '1.5 116IA (80KW)',
 'vin': None,
 'year': 2023}
2026-03-26 22:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985383%27 HTTP/1.1" 200 None
2026-03-26 22:50:10 [ayvens.be] INFO: Saving data for 1985383: {'created_time': 1774565410.050982, 'last_price_update_time': 1774565410.050992, 'auction_closing_time': 1774958400.0}
2026-03-26 22:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985383') HTTP/1.1" 204 0
2026-03-26 22:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F19c2623cc6fd4708b71b6f2b11f659a8%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/19c2623cc6fd4708b71b6f2b11f659a8/images/large/3.jpg not downloaded yet
2026-03-26 22:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F19c2623cc6fd4708b71b6f2b11f659a8%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/19c2623cc6fd4708b71b6f2b11f659a8/images/large/4.jpg not downloaded yet
2026-03-26 22:50:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e139d0>
2026-03-26 22:50:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a826a95-196a-50d9-9c13-656a021883c3/2a826a95-196a-50d9-9c13-656a021883c3_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252Ff622ac075f0d40bda6934598fa3304cc%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/f622ac075f0d40bda6934598fa3304cc/images/large/1.jpg saved to cache
2026-03-26 22:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2a826a95-196a-50d9-9c13-656a021883c3
2026-03-26 22:50:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6da7190>
2026-03-26 22:50:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a826a95-196a-50d9-9c13-656a021883c3/2a826a95-196a-50d9-9c13-656a021883c3_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252Ff622ac075f0d40bda6934598fa3304cc%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/f622ac075f0d40bda6934598fa3304cc/images/large/3.jpg saved to cache
2026-03-26 22:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2a826a95-196a-50d9-9c13-656a021883c3
2026-03-26 22:50:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cc8410>
2026-03-26 22:50:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a826a95-196a-50d9-9c13-656a021883c3/2a826a95-196a-50d9-9c13-656a021883c3_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252Ff622ac075f0d40bda6934598fa3304cc%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/f622ac075f0d40bda6934598fa3304cc/images/large/2.jpg saved to cache
2026-03-26 22:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2a826a95-196a-50d9-9c13-656a021883c3
2026-03-26 22:50:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/f622ac075f0d40bda6934598fa3304cc/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F19c2623cc6fd4708b71b6f2b11f659a8%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/19c2623cc6fd4708b71b6f2b11f659a8/images/large/5.jpg not downloaded yet
2026-03-26 22:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F19c2623cc6fd4708b71b6f2b11f659a8%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/19c2623cc6fd4708b71b6f2b11f659a8/images/large/6.jpg not downloaded yet
2026-03-26 22:50:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/f622ac075f0d40bda6934598fa3304cc/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/f622ac075f0d40bda6934598fa3304cc/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F19c2623cc6fd4708b71b6f2b11f659a8%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/19c2623cc6fd4708b71b6f2b11f659a8/images/large/7.jpg not downloaded yet
2026-03-26 22:50:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/f622ac075f0d40bda6934598fa3304cc/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/19c2623cc6fd4708b71b6f2b11f659a8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F19c2623cc6fd4708b71b6f2b11f659a8%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/19c2623cc6fd4708b71b6f2b11f659a8/images/large/8.jpg not downloaded yet
2026-03-26 22:50:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/f622ac075f0d40bda6934598fa3304cc/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/f622ac075f0d40bda6934598fa3304cc/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/f622ac075f0d40bda6934598fa3304cc/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F19c2623cc6fd4708b71b6f2b11f659a8%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/19c2623cc6fd4708b71b6f2b11f659a8/images/large/9.jpg not downloaded yet
2026-03-26 22:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F19c2623cc6fd4708b71b6f2b11f659a8%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/19c2623cc6fd4708b71b6f2b11f659a8/images/large/10.jpg not downloaded yet
2026-03-26 22:50:10 [ayvens.be] INFO: Found listing with ID: 1985386
2026-03-26 22:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985386%27 HTTP/1.1" 200 None
2026-03-26 22:50:10 [ayvens.be] INFO: Scrape type for 1985386: 1
2026-03-26 22:50:10 [ayvens.be] INFO: Extracting data for car ID: 1985386
2026-03-26 22:50:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2cd1f4af-ca6c-5179-834b-195bc36a2958 with identifier: 1985386
2026-03-26 22:50:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2cd1f4af-ca6c-5179-834b-195bc36a2958 with scrape type 1
2026-03-26 22:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2cd1f4af-ca6c-5179-834b-195bc36a2958
2026-03-26 22:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F10f7ecce0bb54d5cbd9e84baf9499161%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/10f7ecce0bb54d5cbd9e84baf9499161/images/large/1.jpg not downloaded yet
2026-03-26 22:50:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74b4990>
2026-03-26 22:50:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a826a95-196a-50d9-9c13-656a021883c3/2a826a95-196a-50d9-9c13-656a021883c3_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252Ff622ac075f0d40bda6934598fa3304cc%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/f622ac075f0d40bda6934598fa3304cc/images/large/4.jpg saved to cache
2026-03-26 22:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2a826a95-196a-50d9-9c13-656a021883c3
2026-03-26 22:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F10f7ecce0bb54d5cbd9e84baf9499161%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/10f7ecce0bb54d5cbd9e84baf9499161/images/large/2.jpg not downloaded yet
2026-03-26 22:50:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/19c2623cc6fd4708b71b6f2b11f659a8/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74b6110>
2026-03-26 22:50:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a826a95-196a-50d9-9c13-656a021883c3/2a826a95-196a-50d9-9c13-656a021883c3_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252Ff622ac075f0d40bda6934598fa3304cc%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/f622ac075f0d40bda6934598fa3304cc/images/large/5.jpg saved to cache
2026-03-26 22:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2a826a95-196a-50d9-9c13-656a021883c3
2026-03-26 22:50:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7494050>
2026-03-26 22:50:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a826a95-196a-50d9-9c13-656a021883c3/2a826a95-196a-50d9-9c13-656a021883c3_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252Ff622ac075f0d40bda6934598fa3304cc%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/f622ac075f0d40bda6934598fa3304cc/images/large/7.jpg saved to cache
2026-03-26 22:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2a826a95-196a-50d9-9c13-656a021883c3
2026-03-26 22:50:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79ccf90>
2026-03-26 22:50:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a826a95-196a-50d9-9c13-656a021883c3/2a826a95-196a-50d9-9c13-656a021883c3_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252Ff622ac075f0d40bda6934598fa3304cc%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/f622ac075f0d40bda6934598fa3304cc/images/large/8.jpg saved to cache
2026-03-26 22:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2a826a95-196a-50d9-9c13-656a021883c3
2026-03-26 22:50:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7a837d0>
2026-03-26 22:50:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_204b260e-559e-573a-a182-0234b1a52c5d/204b260e-559e-573a-a182-0234b1a52c5d_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F19c2623cc6fd4708b71b6f2b11f659a8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/19c2623cc6fd4708b71b6f2b11f659a8/images/large/1.jpg saved to cache
2026-03-26 22:50:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 204b260e-559e-573a-a182-0234b1a52c5d
2026-03-26 22:50:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7944e90>
2026-03-26 22:50:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a826a95-196a-50d9-9c13-656a021883c3/2a826a95-196a-50d9-9c13-656a021883c3_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252Ff622ac075f0d40bda6934598fa3304cc%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/f622ac075f0d40bda6934598fa3304cc/images/large/9.jpg saved to cache
2026-03-26 22:50:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2a826a95-196a-50d9-9c13-656a021883c3
2026-03-26 22:50:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7495650>
2026-03-26 22:50:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a826a95-196a-50d9-9c13-656a021883c3/2a826a95-196a-50d9-9c13-656a021883c3_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252Ff622ac075f0d40bda6934598fa3304cc%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/f622ac075f0d40bda6934598fa3304cc/images/large/6.jpg saved to cache
2026-03-26 22:50:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2a826a95-196a-50d9-9c13-656a021883c3
2026-03-26 22:50:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b743a810>
2026-03-26 22:50:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a826a95-196a-50d9-9c13-656a021883c3/2a826a95-196a-50d9-9c13-656a021883c3_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252Ff622ac075f0d40bda6934598fa3304cc%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/f622ac075f0d40bda6934598fa3304cc/images/large/10.jpg saved to cache
2026-03-26 22:50:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2a826a95-196a-50d9-9c13-656a021883c3
2026-03-26 22:50:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2a826a95-196a-50d9-9c13-656a021883c3, skipping ID generation
2026-03-26 22:50:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a826a95-196a-50d9-9c13-656a021883c3 with scrape type 1
2026-03-26 22:50:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2a826a95-196a-50d9-9c13-656a021883c3 sending to next pipeline
2026-03-26 22:50:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 2a826a95-196a-50d9-9c13-656a021883c3, identifier: 1985384
2026-03-26 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F10f7ecce0bb54d5cbd9e84baf9499161%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/10f7ecce0bb54d5cbd9e84baf9499161/images/large/3.jpg not downloaded yet
2026-03-26 22:50:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 2a826a95-196a-50d9-9c13-656a021883c3 with identifier: 1985384
2026-03-26 22:50:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 2a826a95-196a-50d9-9c13-656a021883c3 with identifier: 1985384
2026-03-26 22:50:11 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 2a826a95-196a-50d9-9c13-656a021883c3 with identifier: 1985384 to the API
2026-03-26 22:50:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:50:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:50:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bw/f622ac075f0d40bda6934598fa3304cc/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '2a826a95-196a-50d9-9c13-656a021883c3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 108460,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a826a95-196a-50d9-9c13-656a021883c3/2a826a95-196a-50d9-9c13-656a021883c3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 691183,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/f622ac075f0d40bda6934598fa3304cc/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a826a95-196a-50d9-9c13-656a021883c3/2a826a95-196a-50d9-9c13-656a021883c3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 698756,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/f622ac075f0d40bda6934598fa3304cc/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a826a95-196a-50d9-9c13-656a021883c3/2a826a95-196a-50d9-9c13-656a021883c3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 637647,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/f622ac075f0d40bda6934598fa3304cc/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a826a95-196a-50d9-9c13-656a021883c3/2a826a95-196a-50d9-9c13-656a021883c3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 673724,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/f622ac075f0d40bda6934598fa3304cc/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a826a95-196a-50d9-9c13-656a021883c3/2a826a95-196a-50d9-9c13-656a021883c3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 695550,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/f622ac075f0d40bda6934598fa3304cc/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a826a95-196a-50d9-9c13-656a021883c3/2a826a95-196a-50d9-9c13-656a021883c3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 720081,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/f622ac075f0d40bda6934598fa3304cc/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a826a95-196a-50d9-9c13-656a021883c3/2a826a95-196a-50d9-9c13-656a021883c3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 636704,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/f622ac075f0d40bda6934598fa3304cc/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a826a95-196a-50d9-9c13-656a021883c3/2a826a95-196a-50d9-9c13-656a021883c3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 824512,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/f622ac075f0d40bda6934598fa3304cc/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a826a95-196a-50d9-9c13-656a021883c3/2a826a95-196a-50d9-9c13-656a021883c3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 801483,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/f622ac075f0d40bda6934598fa3304cc/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a826a95-196a-50d9-9c13-656a021883c3/2a826a95-196a-50d9-9c13-656a021883c3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 801439,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/f622ac075f0d40bda6934598fa3304cc/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 1.2 PURETECH 96KW S&S ACTIVE PACK',
 'transmission': 'manual',
 'trim': '1.2 PURETECH 96KW S&S ACTIVE PACK',
 'vin': None,
 'year': 2022}
2026-03-26 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985384%27 HTTP/1.1" 200 None
2026-03-26 22:50:11 [ayvens.be] INFO: Saving data for 1985384: {'created_time': 1774565411.714491, 'last_price_update_time': 1774565411.714502, 'auction_closing_time': 1774958400.0}
2026-03-26 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985384') HTTP/1.1" 204 0
2026-03-26 22:50:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/19c2623cc6fd4708b71b6f2b11f659a8/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/19c2623cc6fd4708b71b6f2b11f659a8/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F10f7ecce0bb54d5cbd9e84baf9499161%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/10f7ecce0bb54d5cbd9e84baf9499161/images/large/4.jpg not downloaded yet
2026-03-26 22:50:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b777ac50>
2026-03-26 22:50:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_204b260e-559e-573a-a182-0234b1a52c5d/204b260e-559e-573a-a182-0234b1a52c5d_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F19c2623cc6fd4708b71b6f2b11f659a8%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/19c2623cc6fd4708b71b6f2b11f659a8/images/large/6.jpg saved to cache
2026-03-26 22:50:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 204b260e-559e-573a-a182-0234b1a52c5d
2026-03-26 22:50:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/19c2623cc6fd4708b71b6f2b11f659a8/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/19c2623cc6fd4708b71b6f2b11f659a8/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/19c2623cc6fd4708b71b6f2b11f659a8/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F10f7ecce0bb54d5cbd9e84baf9499161%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/10f7ecce0bb54d5cbd9e84baf9499161/images/large/5.jpg not downloaded yet
2026-03-26 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F10f7ecce0bb54d5cbd9e84baf9499161%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/10f7ecce0bb54d5cbd9e84baf9499161/images/large/6.jpg not downloaded yet
2026-03-26 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F10f7ecce0bb54d5cbd9e84baf9499161%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/10f7ecce0bb54d5cbd9e84baf9499161/images/large/7.jpg not downloaded yet
2026-03-26 22:50:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74e6410>
2026-03-26 22:50:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_204b260e-559e-573a-a182-0234b1a52c5d/204b260e-559e-573a-a182-0234b1a52c5d_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F19c2623cc6fd4708b71b6f2b11f659a8%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/19c2623cc6fd4708b71b6f2b11f659a8/images/large/5.jpg saved to cache
2026-03-26 22:50:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 204b260e-559e-573a-a182-0234b1a52c5d
2026-03-26 22:50:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7ae8dd0>
2026-03-26 22:50:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_204b260e-559e-573a-a182-0234b1a52c5d/204b260e-559e-573a-a182-0234b1a52c5d_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F19c2623cc6fd4708b71b6f2b11f659a8%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/19c2623cc6fd4708b71b6f2b11f659a8/images/large/7.jpg saved to cache
2026-03-26 22:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 204b260e-559e-573a-a182-0234b1a52c5d
2026-03-26 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F10f7ecce0bb54d5cbd9e84baf9499161%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/10f7ecce0bb54d5cbd9e84baf9499161/images/large/8.jpg not downloaded yet
2026-03-26 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F10f7ecce0bb54d5cbd9e84baf9499161%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/10f7ecce0bb54d5cbd9e84baf9499161/images/large/9.jpg not downloaded yet
2026-03-26 22:50:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74a7650>
2026-03-26 22:50:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_204b260e-559e-573a-a182-0234b1a52c5d/204b260e-559e-573a-a182-0234b1a52c5d_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F19c2623cc6fd4708b71b6f2b11f659a8%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/19c2623cc6fd4708b71b6f2b11f659a8/images/large/2.jpg saved to cache
2026-03-26 22:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 204b260e-559e-573a-a182-0234b1a52c5d
2026-03-26 22:50:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76edb50>
2026-03-26 22:50:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_204b260e-559e-573a-a182-0234b1a52c5d/204b260e-559e-573a-a182-0234b1a52c5d_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F19c2623cc6fd4708b71b6f2b11f659a8%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/19c2623cc6fd4708b71b6f2b11f659a8/images/large/3.jpg saved to cache
2026-03-26 22:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 204b260e-559e-573a-a182-0234b1a52c5d
2026-03-26 22:50:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77e9d90>
2026-03-26 22:50:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_204b260e-559e-573a-a182-0234b1a52c5d/204b260e-559e-573a-a182-0234b1a52c5d_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F19c2623cc6fd4708b71b6f2b11f659a8%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/19c2623cc6fd4708b71b6f2b11f659a8/images/large/4.jpg saved to cache
2026-03-26 22:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 204b260e-559e-573a-a182-0234b1a52c5d
2026-03-26 22:50:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/19c2623cc6fd4708b71b6f2b11f659a8/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F10f7ecce0bb54d5cbd9e84baf9499161%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/10f7ecce0bb54d5cbd9e84baf9499161/images/large/10.jpg not downloaded yet
2026-03-26 22:50:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/19c2623cc6fd4708b71b6f2b11f659a8/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/19c2623cc6fd4708b71b6f2b11f659a8/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:12 [ayvens.be] INFO: Found listing with ID: 1985387
2026-03-26 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985387%27 HTTP/1.1" 200 None
2026-03-26 22:50:12 [ayvens.be] INFO: Scrape type for 1985387: 1
2026-03-26 22:50:12 [ayvens.be] INFO: Extracting data for car ID: 1985387
2026-03-26 22:50:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d435f3e0-529f-510b-bac6-ad11c65d9078 with identifier: 1985387
2026-03-26 22:50:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d435f3e0-529f-510b-bac6-ad11c65d9078 with scrape type 1
2026-03-26 22:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d435f3e0-529f-510b-bac6-ad11c65d9078
2026-03-26 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252Ffc29198af329418b8ac9271dad6ecda6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/fc29198af329418b8ac9271dad6ecda6/images/large/1.jpg not downloaded yet
2026-03-26 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252Ffc29198af329418b8ac9271dad6ecda6%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/fc29198af329418b8ac9271dad6ecda6/images/large/2.jpg not downloaded yet
2026-03-26 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252Ffc29198af329418b8ac9271dad6ecda6%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/fc29198af329418b8ac9271dad6ecda6/images/large/3.jpg not downloaded yet
2026-03-26 22:50:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b792fc10>
2026-03-26 22:50:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_204b260e-559e-573a-a182-0234b1a52c5d/204b260e-559e-573a-a182-0234b1a52c5d_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F19c2623cc6fd4708b71b6f2b11f659a8%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/19c2623cc6fd4708b71b6f2b11f659a8/images/large/10.jpg saved to cache
2026-03-26 22:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 204b260e-559e-573a-a182-0234b1a52c5d
2026-03-26 22:50:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/10f7ecce0bb54d5cbd9e84baf9499161/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/10f7ecce0bb54d5cbd9e84baf9499161/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/10f7ecce0bb54d5cbd9e84baf9499161/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252Ffc29198af329418b8ac9271dad6ecda6%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/fc29198af329418b8ac9271dad6ecda6/images/large/4.jpg not downloaded yet
2026-03-26 22:50:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/10f7ecce0bb54d5cbd9e84baf9499161/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/10f7ecce0bb54d5cbd9e84baf9499161/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b792d5d0>
2026-03-26 22:50:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_204b260e-559e-573a-a182-0234b1a52c5d/204b260e-559e-573a-a182-0234b1a52c5d_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F19c2623cc6fd4708b71b6f2b11f659a8%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/19c2623cc6fd4708b71b6f2b11f659a8/images/large/8.jpg saved to cache
2026-03-26 22:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 204b260e-559e-573a-a182-0234b1a52c5d
2026-03-26 22:50:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7a61c90>
2026-03-26 22:50:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_204b260e-559e-573a-a182-0234b1a52c5d/204b260e-559e-573a-a182-0234b1a52c5d_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F19c2623cc6fd4708b71b6f2b11f659a8%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/19c2623cc6fd4708b71b6f2b11f659a8/images/large/9.jpg saved to cache
2026-03-26 22:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 204b260e-559e-573a-a182-0234b1a52c5d
2026-03-26 22:50:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 204b260e-559e-573a-a182-0234b1a52c5d, skipping ID generation
2026-03-26 22:50:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 204b260e-559e-573a-a182-0234b1a52c5d with scrape type 1
2026-03-26 22:50:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 204b260e-559e-573a-a182-0234b1a52c5d sending to next pipeline
2026-03-26 22:50:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 204b260e-559e-573a-a182-0234b1a52c5d, identifier: 1985385
2026-03-26 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252Ffc29198af329418b8ac9271dad6ecda6%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/fc29198af329418b8ac9271dad6ecda6/images/large/5.jpg not downloaded yet
2026-03-26 22:50:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 204b260e-559e-573a-a182-0234b1a52c5d with identifier: 1985385
2026-03-26 22:50:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 204b260e-559e-573a-a182-0234b1a52c5d with identifier: 1985385
2026-03-26 22:50:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 204b260e-559e-573a-a182-0234b1a52c5d with identifier: 1985385 to the API
2026-03-26 22:50:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:50:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:50:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bh/19c2623cc6fd4708b71b6f2b11f659a8/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '204b260e-559e-573a-a182-0234b1a52c5d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 46415,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_204b260e-559e-573a-a182-0234b1a52c5d/204b260e-559e-573a-a182-0234b1a52c5d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 418455,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/19c2623cc6fd4708b71b6f2b11f659a8/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_204b260e-559e-573a-a182-0234b1a52c5d/204b260e-559e-573a-a182-0234b1a52c5d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 464694,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/19c2623cc6fd4708b71b6f2b11f659a8/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_204b260e-559e-573a-a182-0234b1a52c5d/204b260e-559e-573a-a182-0234b1a52c5d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 404684,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/19c2623cc6fd4708b71b6f2b11f659a8/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_204b260e-559e-573a-a182-0234b1a52c5d/204b260e-559e-573a-a182-0234b1a52c5d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 400347,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/19c2623cc6fd4708b71b6f2b11f659a8/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_204b260e-559e-573a-a182-0234b1a52c5d/204b260e-559e-573a-a182-0234b1a52c5d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 292037,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/19c2623cc6fd4708b71b6f2b11f659a8/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_204b260e-559e-573a-a182-0234b1a52c5d/204b260e-559e-573a-a182-0234b1a52c5d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 216304,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/19c2623cc6fd4708b71b6f2b11f659a8/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_204b260e-559e-573a-a182-0234b1a52c5d/204b260e-559e-573a-a182-0234b1a52c5d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 318563,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/19c2623cc6fd4708b71b6f2b11f659a8/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_204b260e-559e-573a-a182-0234b1a52c5d/204b260e-559e-573a-a182-0234b1a52c5d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 339546,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/19c2623cc6fd4708b71b6f2b11f659a8/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_204b260e-559e-573a-a182-0234b1a52c5d/204b260e-559e-573a-a182-0234b1a52c5d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 294755,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/19c2623cc6fd4708b71b6f2b11f659a8/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_204b260e-559e-573a-a182-0234b1a52c5d/204b260e-559e-573a-a182-0234b1a52c5d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 317268,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/19c2623cc6fd4708b71b6f2b11f659a8/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 1.6 HYBRID 225 E-AUTO8 ALLURE PACK',
 'transmission': 'automatic',
 'trim': '1.6 HYBRID 225 E-AUTO8 ALLURE PACK',
 'vin': None,
 'year': 2021}
2026-03-26 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985385%27 HTTP/1.1" 200 None
2026-03-26 22:50:13 [ayvens.be] INFO: Saving data for 1985385: {'created_time': 1774565413.096715, 'last_price_update_time': 1774565413.096725, 'auction_closing_time': 1774958400.0}
2026-03-26 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985385') HTTP/1.1" 204 0
2026-03-26 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252Ffc29198af329418b8ac9271dad6ecda6%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/fc29198af329418b8ac9271dad6ecda6/images/large/6.jpg not downloaded yet
2026-03-26 22:50:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c60290>
2026-03-26 22:50:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2cd1f4af-ca6c-5179-834b-195bc36a2958/2cd1f4af-ca6c-5179-834b-195bc36a2958_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F10f7ecce0bb54d5cbd9e84baf9499161%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/10f7ecce0bb54d5cbd9e84baf9499161/images/large/3.jpg saved to cache
2026-03-26 22:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2cd1f4af-ca6c-5179-834b-195bc36a2958
2026-03-26 22:50:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7a81d90>
2026-03-26 22:50:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2cd1f4af-ca6c-5179-834b-195bc36a2958/2cd1f4af-ca6c-5179-834b-195bc36a2958_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F10f7ecce0bb54d5cbd9e84baf9499161%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/10f7ecce0bb54d5cbd9e84baf9499161/images/large/1.jpg saved to cache
2026-03-26 22:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2cd1f4af-ca6c-5179-834b-195bc36a2958
2026-03-26 22:50:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e03a90>
2026-03-26 22:50:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2cd1f4af-ca6c-5179-834b-195bc36a2958/2cd1f4af-ca6c-5179-834b-195bc36a2958_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F10f7ecce0bb54d5cbd9e84baf9499161%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/10f7ecce0bb54d5cbd9e84baf9499161/images/large/2.jpg saved to cache
2026-03-26 22:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2cd1f4af-ca6c-5179-834b-195bc36a2958
2026-03-26 22:50:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79d46d0>
2026-03-26 22:50:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2cd1f4af-ca6c-5179-834b-195bc36a2958/2cd1f4af-ca6c-5179-834b-195bc36a2958_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F10f7ecce0bb54d5cbd9e84baf9499161%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/10f7ecce0bb54d5cbd9e84baf9499161/images/large/4.jpg saved to cache
2026-03-26 22:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2cd1f4af-ca6c-5179-834b-195bc36a2958
2026-03-26 22:50:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7490e50>
2026-03-26 22:50:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2cd1f4af-ca6c-5179-834b-195bc36a2958/2cd1f4af-ca6c-5179-834b-195bc36a2958_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F10f7ecce0bb54d5cbd9e84baf9499161%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/10f7ecce0bb54d5cbd9e84baf9499161/images/large/5.jpg saved to cache
2026-03-26 22:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2cd1f4af-ca6c-5179-834b-195bc36a2958
2026-03-26 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252Ffc29198af329418b8ac9271dad6ecda6%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/fc29198af329418b8ac9271dad6ecda6/images/large/7.jpg not downloaded yet
2026-03-26 22:50:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/10f7ecce0bb54d5cbd9e84baf9499161/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252Ffc29198af329418b8ac9271dad6ecda6%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/fc29198af329418b8ac9271dad6ecda6/images/large/8.jpg not downloaded yet
2026-03-26 22:50:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/10f7ecce0bb54d5cbd9e84baf9499161/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252Ffc29198af329418b8ac9271dad6ecda6%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/fc29198af329418b8ac9271dad6ecda6/images/large/9.jpg not downloaded yet
2026-03-26 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252Ffc29198af329418b8ac9271dad6ecda6%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/fc29198af329418b8ac9271dad6ecda6/images/large/10.jpg not downloaded yet
2026-03-26 22:50:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/10f7ecce0bb54d5cbd9e84baf9499161/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/fc29198af329418b8ac9271dad6ecda6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/fc29198af329418b8ac9271dad6ecda6/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:13 [ayvens.be] INFO: Found listing with ID: 1985388
2026-03-26 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985388%27 HTTP/1.1" 200 None
2026-03-26 22:50:13 [ayvens.be] INFO: Scrape type for 1985388: 1
2026-03-26 22:50:13 [ayvens.be] INFO: Extracting data for car ID: 1985388
2026-03-26 22:50:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd5e129c-9014-5e1f-8926-20ca8a02deb0 with identifier: 1985388
2026-03-26 22:50:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd5e129c-9014-5e1f-8926-20ca8a02deb0 with scrape type 1
2026-03-26 22:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bd5e129c-9014-5e1f-8926-20ca8a02deb0
2026-03-26 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F2316ac14056b4cb3b08091aeab3141df%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/2316ac14056b4cb3b08091aeab3141df/images/large/1.jpg not downloaded yet
2026-03-26 22:50:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/fc29198af329418b8ac9271dad6ecda6/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F2316ac14056b4cb3b08091aeab3141df%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/2316ac14056b4cb3b08091aeab3141df/images/large/2.jpg not downloaded yet
2026-03-26 22:50:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/10f7ecce0bb54d5cbd9e84baf9499161/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/10f7ecce0bb54d5cbd9e84baf9499161/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7a82c50>
2026-03-26 22:50:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2cd1f4af-ca6c-5179-834b-195bc36a2958/2cd1f4af-ca6c-5179-834b-195bc36a2958_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F10f7ecce0bb54d5cbd9e84baf9499161%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/10f7ecce0bb54d5cbd9e84baf9499161/images/large/6.jpg saved to cache
2026-03-26 22:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2cd1f4af-ca6c-5179-834b-195bc36a2958
2026-03-26 22:50:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76ed450>
2026-03-26 22:50:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2cd1f4af-ca6c-5179-834b-195bc36a2958/2cd1f4af-ca6c-5179-834b-195bc36a2958_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F10f7ecce0bb54d5cbd9e84baf9499161%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/10f7ecce0bb54d5cbd9e84baf9499161/images/large/7.jpg saved to cache
2026-03-26 22:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2cd1f4af-ca6c-5179-834b-195bc36a2958
2026-03-26 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F2316ac14056b4cb3b08091aeab3141df%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/2316ac14056b4cb3b08091aeab3141df/images/large/3.jpg not downloaded yet
2026-03-26 22:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F2316ac14056b4cb3b08091aeab3141df%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/2316ac14056b4cb3b08091aeab3141df/images/large/4.jpg not downloaded yet
2026-03-26 22:50:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e4fa50>
2026-03-26 22:50:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2cd1f4af-ca6c-5179-834b-195bc36a2958/2cd1f4af-ca6c-5179-834b-195bc36a2958_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F10f7ecce0bb54d5cbd9e84baf9499161%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/10f7ecce0bb54d5cbd9e84baf9499161/images/large/8.jpg saved to cache
2026-03-26 22:50:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2cd1f4af-ca6c-5179-834b-195bc36a2958
2026-03-26 22:50:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7ca8410>
2026-03-26 22:50:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d435f3e0-529f-510b-bac6-ad11c65d9078/d435f3e0-529f-510b-bac6-ad11c65d9078_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252Ffc29198af329418b8ac9271dad6ecda6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/fc29198af329418b8ac9271dad6ecda6/images/large/1.jpg saved to cache
2026-03-26 22:50:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d435f3e0-529f-510b-bac6-ad11c65d9078
2026-03-26 22:50:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c75490>
2026-03-26 22:50:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d435f3e0-529f-510b-bac6-ad11c65d9078/d435f3e0-529f-510b-bac6-ad11c65d9078_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252Ffc29198af329418b8ac9271dad6ecda6%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/fc29198af329418b8ac9271dad6ecda6/images/large/2.jpg saved to cache
2026-03-26 22:50:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d435f3e0-529f-510b-bac6-ad11c65d9078
2026-03-26 22:50:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b78c1450>
2026-03-26 22:50:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d435f3e0-529f-510b-bac6-ad11c65d9078/d435f3e0-529f-510b-bac6-ad11c65d9078_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252Ffc29198af329418b8ac9271dad6ecda6%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/fc29198af329418b8ac9271dad6ecda6/images/large/4.jpg saved to cache
2026-03-26 22:50:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d435f3e0-529f-510b-bac6-ad11c65d9078
2026-03-26 22:50:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c75550>
2026-03-26 22:50:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2cd1f4af-ca6c-5179-834b-195bc36a2958/2cd1f4af-ca6c-5179-834b-195bc36a2958_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F10f7ecce0bb54d5cbd9e84baf9499161%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/10f7ecce0bb54d5cbd9e84baf9499161/images/large/9.jpg saved to cache
2026-03-26 22:50:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2cd1f4af-ca6c-5179-834b-195bc36a2958
2026-03-26 22:50:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c76e90>
2026-03-26 22:50:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2cd1f4af-ca6c-5179-834b-195bc36a2958/2cd1f4af-ca6c-5179-834b-195bc36a2958_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F10f7ecce0bb54d5cbd9e84baf9499161%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/10f7ecce0bb54d5cbd9e84baf9499161/images/large/10.jpg saved to cache
2026-03-26 22:50:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2cd1f4af-ca6c-5179-834b-195bc36a2958
2026-03-26 22:50:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2cd1f4af-ca6c-5179-834b-195bc36a2958, skipping ID generation
2026-03-26 22:50:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2cd1f4af-ca6c-5179-834b-195bc36a2958 with scrape type 1
2026-03-26 22:50:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2cd1f4af-ca6c-5179-834b-195bc36a2958 sending to next pipeline
2026-03-26 22:50:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 2cd1f4af-ca6c-5179-834b-195bc36a2958, identifier: 1985386
2026-03-26 22:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F2316ac14056b4cb3b08091aeab3141df%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/2316ac14056b4cb3b08091aeab3141df/images/large/5.jpg not downloaded yet
2026-03-26 22:50:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 2cd1f4af-ca6c-5179-834b-195bc36a2958 with identifier: 1985386
2026-03-26 22:50:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 2cd1f4af-ca6c-5179-834b-195bc36a2958 with identifier: 1985386
2026-03-26 22:50:15 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 2cd1f4af-ca6c-5179-834b-195bc36a2958 with identifier: 1985386 to the API
2026-03-26 22:50:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:50:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:50:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bw/10f7ecce0bb54d5cbd9e84baf9499161/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '2cd1f4af-ca6c-5179-834b-195bc36a2958',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'OCTAVIA COMBI',
 'odometer': 107677,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cd1f4af-ca6c-5179-834b-195bc36a2958/2cd1f4af-ca6c-5179-834b-195bc36a2958_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 778259,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/10f7ecce0bb54d5cbd9e84baf9499161/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cd1f4af-ca6c-5179-834b-195bc36a2958/2cd1f4af-ca6c-5179-834b-195bc36a2958_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 767452,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/10f7ecce0bb54d5cbd9e84baf9499161/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cd1f4af-ca6c-5179-834b-195bc36a2958/2cd1f4af-ca6c-5179-834b-195bc36a2958_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 790391,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/10f7ecce0bb54d5cbd9e84baf9499161/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cd1f4af-ca6c-5179-834b-195bc36a2958/2cd1f4af-ca6c-5179-834b-195bc36a2958_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 800297,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/10f7ecce0bb54d5cbd9e84baf9499161/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cd1f4af-ca6c-5179-834b-195bc36a2958/2cd1f4af-ca6c-5179-834b-195bc36a2958_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 796064,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/10f7ecce0bb54d5cbd9e84baf9499161/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cd1f4af-ca6c-5179-834b-195bc36a2958/2cd1f4af-ca6c-5179-834b-195bc36a2958_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 739899,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/10f7ecce0bb54d5cbd9e84baf9499161/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cd1f4af-ca6c-5179-834b-195bc36a2958/2cd1f4af-ca6c-5179-834b-195bc36a2958_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 662004,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/10f7ecce0bb54d5cbd9e84baf9499161/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cd1f4af-ca6c-5179-834b-195bc36a2958/2cd1f4af-ca6c-5179-834b-195bc36a2958_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 918076,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/10f7ecce0bb54d5cbd9e84baf9499161/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cd1f4af-ca6c-5179-834b-195bc36a2958/2cd1f4af-ca6c-5179-834b-195bc36a2958_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 879129,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/10f7ecce0bb54d5cbd9e84baf9499161/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cd1f4af-ca6c-5179-834b-195bc36a2958/2cd1f4af-ca6c-5179-834b-195bc36a2958_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 896162,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/10f7ecce0bb54d5cbd9e84baf9499161/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA OCTAVIA COMBI 2.0 CRTDI 110KW CLEVER+',
 'transmission': 'manual',
 'trim': '2.0 CRTDI 110KW CLEVER+',
 'vin': None,
 'year': 2022}
2026-03-26 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985386%27 HTTP/1.1" 200 None
2026-03-26 22:50:15 [ayvens.be] INFO: Saving data for 1985386: {'created_time': 1774565415.225347, 'last_price_update_time': 1774565415.225356, 'auction_closing_time': 1774958400.0}
2026-03-26 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985386') HTTP/1.1" 204 0
2026-03-26 22:50:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/fc29198af329418b8ac9271dad6ecda6/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/fc29198af329418b8ac9271dad6ecda6/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F2316ac14056b4cb3b08091aeab3141df%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/2316ac14056b4cb3b08091aeab3141df/images/large/6.jpg not downloaded yet
2026-03-26 22:50:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/fc29198af329418b8ac9271dad6ecda6/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F2316ac14056b4cb3b08091aeab3141df%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/2316ac14056b4cb3b08091aeab3141df/images/large/7.jpg not downloaded yet
2026-03-26 22:50:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dd/2316ac14056b4cb3b08091aeab3141df/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/fc29198af329418b8ac9271dad6ecda6/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F2316ac14056b4cb3b08091aeab3141df%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/2316ac14056b4cb3b08091aeab3141df/images/large/8.jpg not downloaded yet
2026-03-26 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F2316ac14056b4cb3b08091aeab3141df%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/2316ac14056b4cb3b08091aeab3141df/images/large/9.jpg not downloaded yet
2026-03-26 22:50:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/fc29198af329418b8ac9271dad6ecda6/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F2316ac14056b4cb3b08091aeab3141df%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/2316ac14056b4cb3b08091aeab3141df/images/large/10.jpg not downloaded yet
2026-03-26 22:50:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/fc29198af329418b8ac9271dad6ecda6/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/fc29198af329418b8ac9271dad6ecda6/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:15 [ayvens.be] INFO: Found listing with ID: 1985389
2026-03-26 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985389%27 HTTP/1.1" 200 None
2026-03-26 22:50:15 [ayvens.be] INFO: Scrape type for 1985389: 1
2026-03-26 22:50:15 [ayvens.be] INFO: Extracting data for car ID: 1985389
2026-03-26 22:50:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f848b84-78f6-5388-b7ab-a5470e154ec1 with identifier: 1985389
2026-03-26 22:50:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f848b84-78f6-5388-b7ab-a5470e154ec1 with scrape type 1
2026-03-26 22:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9f848b84-78f6-5388-b7ab-a5470e154ec1
2026-03-26 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ec%252F70d656a4edeb4d90af456f0a00ed231f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ec/70d656a4edeb4d90af456f0a00ed231f/images/large/1.jpg not downloaded yet
2026-03-26 22:50:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7ae8410>
2026-03-26 22:50:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d435f3e0-529f-510b-bac6-ad11c65d9078/d435f3e0-529f-510b-bac6-ad11c65d9078_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252Ffc29198af329418b8ac9271dad6ecda6%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/fc29198af329418b8ac9271dad6ecda6/images/large/3.jpg saved to cache
2026-03-26 22:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d435f3e0-529f-510b-bac6-ad11c65d9078
2026-03-26 22:50:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7924250>
2026-03-26 22:50:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d435f3e0-529f-510b-bac6-ad11c65d9078/d435f3e0-529f-510b-bac6-ad11c65d9078_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252Ffc29198af329418b8ac9271dad6ecda6%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/fc29198af329418b8ac9271dad6ecda6/images/large/5.jpg saved to cache
2026-03-26 22:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d435f3e0-529f-510b-bac6-ad11c65d9078
2026-03-26 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ec%252F70d656a4edeb4d90af456f0a00ed231f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ec/70d656a4edeb4d90af456f0a00ed231f/images/large/2.jpg not downloaded yet
2026-03-26 22:50:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b726b890>
2026-03-26 22:50:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d435f3e0-529f-510b-bac6-ad11c65d9078/d435f3e0-529f-510b-bac6-ad11c65d9078_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252Ffc29198af329418b8ac9271dad6ecda6%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/fc29198af329418b8ac9271dad6ecda6/images/large/6.jpg saved to cache
2026-03-26 22:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d435f3e0-529f-510b-bac6-ad11c65d9078
2026-03-26 22:50:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76ce790>
2026-03-26 22:50:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd5e129c-9014-5e1f-8926-20ca8a02deb0/bd5e129c-9014-5e1f-8926-20ca8a02deb0_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F2316ac14056b4cb3b08091aeab3141df%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/2316ac14056b4cb3b08091aeab3141df/images/large/3.jpg saved to cache
2026-03-26 22:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bd5e129c-9014-5e1f-8926-20ca8a02deb0
2026-03-26 22:50:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dd/2316ac14056b4cb3b08091aeab3141df/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ec%252F70d656a4edeb4d90af456f0a00ed231f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ec/70d656a4edeb4d90af456f0a00ed231f/images/large/3.jpg not downloaded yet
2026-03-26 22:50:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dd/2316ac14056b4cb3b08091aeab3141df/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dd/2316ac14056b4cb3b08091aeab3141df/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dd/2316ac14056b4cb3b08091aeab3141df/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7402910>
2026-03-26 22:50:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d435f3e0-529f-510b-bac6-ad11c65d9078/d435f3e0-529f-510b-bac6-ad11c65d9078_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252Ffc29198af329418b8ac9271dad6ecda6%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/fc29198af329418b8ac9271dad6ecda6/images/large/7.jpg saved to cache
2026-03-26 22:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d435f3e0-529f-510b-bac6-ad11c65d9078
2026-03-26 22:50:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b743a890>
2026-03-26 22:50:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d435f3e0-529f-510b-bac6-ad11c65d9078/d435f3e0-529f-510b-bac6-ad11c65d9078_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252Ffc29198af329418b8ac9271dad6ecda6%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/fc29198af329418b8ac9271dad6ecda6/images/large/8.jpg saved to cache
2026-03-26 22:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d435f3e0-529f-510b-bac6-ad11c65d9078
2026-03-26 22:50:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7aa2e10>
2026-03-26 22:50:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d435f3e0-529f-510b-bac6-ad11c65d9078/d435f3e0-529f-510b-bac6-ad11c65d9078_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252Ffc29198af329418b8ac9271dad6ecda6%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/fc29198af329418b8ac9271dad6ecda6/images/large/10.jpg saved to cache
2026-03-26 22:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d435f3e0-529f-510b-bac6-ad11c65d9078
2026-03-26 22:50:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6dd82d0>
2026-03-26 22:50:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d435f3e0-529f-510b-bac6-ad11c65d9078/d435f3e0-529f-510b-bac6-ad11c65d9078_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252Ffc29198af329418b8ac9271dad6ecda6%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/fc29198af329418b8ac9271dad6ecda6/images/large/9.jpg saved to cache
2026-03-26 22:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d435f3e0-529f-510b-bac6-ad11c65d9078
2026-03-26 22:50:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d435f3e0-529f-510b-bac6-ad11c65d9078, skipping ID generation
2026-03-26 22:50:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d435f3e0-529f-510b-bac6-ad11c65d9078 with scrape type 1
2026-03-26 22:50:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d435f3e0-529f-510b-bac6-ad11c65d9078 sending to next pipeline
2026-03-26 22:50:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d435f3e0-529f-510b-bac6-ad11c65d9078, identifier: 1985387
2026-03-26 22:50:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dd/2316ac14056b4cb3b08091aeab3141df/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dd/2316ac14056b4cb3b08091aeab3141df/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ec%252F70d656a4edeb4d90af456f0a00ed231f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ec/70d656a4edeb4d90af456f0a00ed231f/images/large/4.jpg not downloaded yet
2026-03-26 22:50:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d435f3e0-529f-510b-bac6-ad11c65d9078 with identifier: 1985387
2026-03-26 22:50:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d435f3e0-529f-510b-bac6-ad11c65d9078 with identifier: 1985387
2026-03-26 22:50:16 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d435f3e0-529f-510b-bac6-ad11c65d9078 with identifier: 1985387 to the API
2026-03-26 22:50:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:50:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:50:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bb/fc29198af329418b8ac9271dad6ecda6/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'electric',
 'id': 'd435f3e0-529f-510b-bac6-ad11c65d9078',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 188744,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d435f3e0-529f-510b-bac6-ad11c65d9078/d435f3e0-529f-510b-bac6-ad11c65d9078_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 693634,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/fc29198af329418b8ac9271dad6ecda6/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d435f3e0-529f-510b-bac6-ad11c65d9078/d435f3e0-529f-510b-bac6-ad11c65d9078_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 657358,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/fc29198af329418b8ac9271dad6ecda6/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d435f3e0-529f-510b-bac6-ad11c65d9078/d435f3e0-529f-510b-bac6-ad11c65d9078_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 700698,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/fc29198af329418b8ac9271dad6ecda6/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d435f3e0-529f-510b-bac6-ad11c65d9078/d435f3e0-529f-510b-bac6-ad11c65d9078_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 713498,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/fc29198af329418b8ac9271dad6ecda6/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d435f3e0-529f-510b-bac6-ad11c65d9078/d435f3e0-529f-510b-bac6-ad11c65d9078_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 649466,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/fc29198af329418b8ac9271dad6ecda6/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d435f3e0-529f-510b-bac6-ad11c65d9078/d435f3e0-529f-510b-bac6-ad11c65d9078_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 599165,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/fc29198af329418b8ac9271dad6ecda6/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d435f3e0-529f-510b-bac6-ad11c65d9078/d435f3e0-529f-510b-bac6-ad11c65d9078_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 610197,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/fc29198af329418b8ac9271dad6ecda6/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d435f3e0-529f-510b-bac6-ad11c65d9078/d435f3e0-529f-510b-bac6-ad11c65d9078_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 863352,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/fc29198af329418b8ac9271dad6ecda6/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d435f3e0-529f-510b-bac6-ad11c65d9078/d435f3e0-529f-510b-bac6-ad11c65d9078_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 814262,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/fc29198af329418b8ac9271dad6ecda6/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d435f3e0-529f-510b-bac6-ad11c65d9078/d435f3e0-529f-510b-bac6-ad11c65d9078_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 831077,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/fc29198af329418b8ac9271dad6ecda6/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 BEV 78KWH RECHARGE TWIN PLUS',
 'transmission': 'automatic',
 'trim': 'BEV 78KWH RECHARGE TWIN PLUS',
 'vin': None,
 'year': 2021}
2026-03-26 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985387%27 HTTP/1.1" 200 None
2026-03-26 22:50:16 [ayvens.be] INFO: Saving data for 1985387: {'created_time': 1774565416.594016, 'last_price_update_time': 1774565416.594025, 'auction_closing_time': 1774958400.0}
2026-03-26 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985387') HTTP/1.1" 204 0
2026-03-26 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ec%252F70d656a4edeb4d90af456f0a00ed231f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ec/70d656a4edeb4d90af456f0a00ed231f/images/large/5.jpg not downloaded yet
2026-03-26 22:50:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dd/2316ac14056b4cb3b08091aeab3141df/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7438350>
2026-03-26 22:50:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd5e129c-9014-5e1f-8926-20ca8a02deb0/bd5e129c-9014-5e1f-8926-20ca8a02deb0_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F2316ac14056b4cb3b08091aeab3141df%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/2316ac14056b4cb3b08091aeab3141df/images/large/1.jpg saved to cache
2026-03-26 22:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bd5e129c-9014-5e1f-8926-20ca8a02deb0
2026-03-26 22:50:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e35dd0>
2026-03-26 22:50:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd5e129c-9014-5e1f-8926-20ca8a02deb0/bd5e129c-9014-5e1f-8926-20ca8a02deb0_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F2316ac14056b4cb3b08091aeab3141df%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/2316ac14056b4cb3b08091aeab3141df/images/large/5.jpg saved to cache
2026-03-26 22:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bd5e129c-9014-5e1f-8926-20ca8a02deb0
2026-03-26 22:50:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77ca290>
2026-03-26 22:50:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd5e129c-9014-5e1f-8926-20ca8a02deb0/bd5e129c-9014-5e1f-8926-20ca8a02deb0_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F2316ac14056b4cb3b08091aeab3141df%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/2316ac14056b4cb3b08091aeab3141df/images/large/6.jpg saved to cache
2026-03-26 22:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bd5e129c-9014-5e1f-8926-20ca8a02deb0
2026-03-26 22:50:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7452f10>
2026-03-26 22:50:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd5e129c-9014-5e1f-8926-20ca8a02deb0/bd5e129c-9014-5e1f-8926-20ca8a02deb0_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F2316ac14056b4cb3b08091aeab3141df%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/2316ac14056b4cb3b08091aeab3141df/images/large/7.jpg saved to cache
2026-03-26 22:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bd5e129c-9014-5e1f-8926-20ca8a02deb0
2026-03-26 22:50:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7a80c10>
2026-03-26 22:50:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd5e129c-9014-5e1f-8926-20ca8a02deb0/bd5e129c-9014-5e1f-8926-20ca8a02deb0_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F2316ac14056b4cb3b08091aeab3141df%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/2316ac14056b4cb3b08091aeab3141df/images/large/2.jpg saved to cache
2026-03-26 22:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bd5e129c-9014-5e1f-8926-20ca8a02deb0
2026-03-26 22:50:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7412410>
2026-03-26 22:50:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd5e129c-9014-5e1f-8926-20ca8a02deb0/bd5e129c-9014-5e1f-8926-20ca8a02deb0_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F2316ac14056b4cb3b08091aeab3141df%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/2316ac14056b4cb3b08091aeab3141df/images/large/4.jpg saved to cache
2026-03-26 22:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bd5e129c-9014-5e1f-8926-20ca8a02deb0
2026-03-26 22:50:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dd/2316ac14056b4cb3b08091aeab3141df/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ec%252F70d656a4edeb4d90af456f0a00ed231f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ec/70d656a4edeb4d90af456f0a00ed231f/images/large/6.jpg not downloaded yet
2026-03-26 22:50:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dd/2316ac14056b4cb3b08091aeab3141df/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ec%252F70d656a4edeb4d90af456f0a00ed231f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ec/70d656a4edeb4d90af456f0a00ed231f/images/large/7.jpg not downloaded yet
2026-03-26 22:50:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6dedf50>
2026-03-26 22:50:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd5e129c-9014-5e1f-8926-20ca8a02deb0/bd5e129c-9014-5e1f-8926-20ca8a02deb0_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F2316ac14056b4cb3b08091aeab3141df%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/2316ac14056b4cb3b08091aeab3141df/images/large/9.jpg saved to cache
2026-03-26 22:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bd5e129c-9014-5e1f-8926-20ca8a02deb0
2026-03-26 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ec%252F70d656a4edeb4d90af456f0a00ed231f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ec/70d656a4edeb4d90af456f0a00ed231f/images/large/8.jpg not downloaded yet
2026-03-26 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ec%252F70d656a4edeb4d90af456f0a00ed231f%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ec/70d656a4edeb4d90af456f0a00ed231f/images/large/9.jpg not downloaded yet
2026-03-26 22:50:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ec/70d656a4edeb4d90af456f0a00ed231f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ec/70d656a4edeb4d90af456f0a00ed231f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b744bf10>
2026-03-26 22:50:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd5e129c-9014-5e1f-8926-20ca8a02deb0/bd5e129c-9014-5e1f-8926-20ca8a02deb0_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F2316ac14056b4cb3b08091aeab3141df%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/2316ac14056b4cb3b08091aeab3141df/images/large/8.jpg saved to cache
2026-03-26 22:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bd5e129c-9014-5e1f-8926-20ca8a02deb0
2026-03-26 22:50:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7a569d0>
2026-03-26 22:50:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd5e129c-9014-5e1f-8926-20ca8a02deb0/bd5e129c-9014-5e1f-8926-20ca8a02deb0_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F2316ac14056b4cb3b08091aeab3141df%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/2316ac14056b4cb3b08091aeab3141df/images/large/10.jpg saved to cache
2026-03-26 22:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bd5e129c-9014-5e1f-8926-20ca8a02deb0
2026-03-26 22:50:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bd5e129c-9014-5e1f-8926-20ca8a02deb0, skipping ID generation
2026-03-26 22:50:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd5e129c-9014-5e1f-8926-20ca8a02deb0 with scrape type 1
2026-03-26 22:50:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bd5e129c-9014-5e1f-8926-20ca8a02deb0 sending to next pipeline
2026-03-26 22:50:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: bd5e129c-9014-5e1f-8926-20ca8a02deb0, identifier: 1985388
2026-03-26 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ec%252F70d656a4edeb4d90af456f0a00ed231f%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ec/70d656a4edeb4d90af456f0a00ed231f/images/large/10.jpg not downloaded yet
2026-03-26 22:50:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: bd5e129c-9014-5e1f-8926-20ca8a02deb0 with identifier: 1985388
2026-03-26 22:50:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: bd5e129c-9014-5e1f-8926-20ca8a02deb0 with identifier: 1985388
2026-03-26 22:50:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: bd5e129c-9014-5e1f-8926-20ca8a02deb0 with identifier: 1985388 to the API
2026-03-26 22:50:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:50:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:50:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2dd/2316ac14056b4cb3b08091aeab3141df/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'bd5e129c-9014-5e1f-8926-20ca8a02deb0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 187410,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd5e129c-9014-5e1f-8926-20ca8a02deb0/bd5e129c-9014-5e1f-8926-20ca8a02deb0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 231984,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dd/2316ac14056b4cb3b08091aeab3141df/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd5e129c-9014-5e1f-8926-20ca8a02deb0/bd5e129c-9014-5e1f-8926-20ca8a02deb0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 225798,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dd/2316ac14056b4cb3b08091aeab3141df/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd5e129c-9014-5e1f-8926-20ca8a02deb0/bd5e129c-9014-5e1f-8926-20ca8a02deb0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 240861,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dd/2316ac14056b4cb3b08091aeab3141df/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd5e129c-9014-5e1f-8926-20ca8a02deb0/bd5e129c-9014-5e1f-8926-20ca8a02deb0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 241545,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dd/2316ac14056b4cb3b08091aeab3141df/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd5e129c-9014-5e1f-8926-20ca8a02deb0/bd5e129c-9014-5e1f-8926-20ca8a02deb0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 222357,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dd/2316ac14056b4cb3b08091aeab3141df/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd5e129c-9014-5e1f-8926-20ca8a02deb0/bd5e129c-9014-5e1f-8926-20ca8a02deb0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 217130,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dd/2316ac14056b4cb3b08091aeab3141df/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd5e129c-9014-5e1f-8926-20ca8a02deb0/bd5e129c-9014-5e1f-8926-20ca8a02deb0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 257178,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dd/2316ac14056b4cb3b08091aeab3141df/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd5e129c-9014-5e1f-8926-20ca8a02deb0/bd5e129c-9014-5e1f-8926-20ca8a02deb0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 327009,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dd/2316ac14056b4cb3b08091aeab3141df/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd5e129c-9014-5e1f-8926-20ca8a02deb0/bd5e129c-9014-5e1f-8926-20ca8a02deb0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 309232,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dd/2316ac14056b4cb3b08091aeab3141df/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd5e129c-9014-5e1f-8926-20ca8a02deb0/bd5e129c-9014-5e1f-8926-20ca8a02deb0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 250962,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dd/2316ac14056b4cb3b08091aeab3141df/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T4 PHEV CORE DCT',
 'transmission': 'automatic',
 'trim': '1.5 T4 PHEV CORE DCT',
 'vin': None,
 'year': 2023}
2026-03-26 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985388%27 HTTP/1.1" 200 None
2026-03-26 22:50:17 [ayvens.be] INFO: Saving data for 1985388: {'created_time': 1774565417.651884, 'last_price_update_time': 1774565417.651895, 'auction_closing_time': 1774958400.0}
2026-03-26 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985388') HTTP/1.1" 204 0
2026-03-26 22:50:17 [ayvens.be] INFO: Found listing with ID: 1985390
2026-03-26 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985390%27 HTTP/1.1" 200 None
2026-03-26 22:50:17 [ayvens.be] INFO: Scrape type for 1985390: 1
2026-03-26 22:50:17 [ayvens.be] INFO: Extracting data for car ID: 1985390
2026-03-26 22:50:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b30eb02b-510e-5cce-8b0c-c2f43e8c5e02 with identifier: 1985390
2026-03-26 22:50:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b30eb02b-510e-5cce-8b0c-c2f43e8c5e02 with scrape type 1
2026-03-26 22:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b30eb02b-510e-5cce-8b0c-c2f43e8c5e02
2026-03-26 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fb1f10320fb234bffb28f2ab76c2c1983%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/b1f10320fb234bffb28f2ab76c2c1983/images/large/1.jpg not downloaded yet
2026-03-26 22:50:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ec/70d656a4edeb4d90af456f0a00ed231f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77bc3d0>
2026-03-26 22:50:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f848b84-78f6-5388-b7ab-a5470e154ec1/9f848b84-78f6-5388-b7ab-a5470e154ec1_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ec%252F70d656a4edeb4d90af456f0a00ed231f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ec/70d656a4edeb4d90af456f0a00ed231f/images/large/2.jpg saved to cache
2026-03-26 22:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9f848b84-78f6-5388-b7ab-a5470e154ec1
2026-03-26 22:50:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd3b8b50>
2026-03-26 22:50:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f848b84-78f6-5388-b7ab-a5470e154ec1/9f848b84-78f6-5388-b7ab-a5470e154ec1_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ec%252F70d656a4edeb4d90af456f0a00ed231f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ec/70d656a4edeb4d90af456f0a00ed231f/images/large/1.jpg saved to cache
2026-03-26 22:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9f848b84-78f6-5388-b7ab-a5470e154ec1
2026-03-26 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fb1f10320fb234bffb28f2ab76c2c1983%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/b1f10320fb234bffb28f2ab76c2c1983/images/large/2.jpg not downloaded yet
2026-03-26 22:50:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ec/70d656a4edeb4d90af456f0a00ed231f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fb1f10320fb234bffb28f2ab76c2c1983%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/b1f10320fb234bffb28f2ab76c2c1983/images/large/3.jpg not downloaded yet
2026-03-26 22:50:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ec/70d656a4edeb4d90af456f0a00ed231f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74a6290>
2026-03-26 22:50:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f848b84-78f6-5388-b7ab-a5470e154ec1/9f848b84-78f6-5388-b7ab-a5470e154ec1_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ec%252F70d656a4edeb4d90af456f0a00ed231f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ec/70d656a4edeb4d90af456f0a00ed231f/images/large/3.jpg saved to cache
2026-03-26 22:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9f848b84-78f6-5388-b7ab-a5470e154ec1
2026-03-26 22:50:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ec/70d656a4edeb4d90af456f0a00ed231f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fb1f10320fb234bffb28f2ab76c2c1983%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/b1f10320fb234bffb28f2ab76c2c1983/images/large/4.jpg not downloaded yet
2026-03-26 22:50:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ec/70d656a4edeb4d90af456f0a00ed231f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fb1f10320fb234bffb28f2ab76c2c1983%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/b1f10320fb234bffb28f2ab76c2c1983/images/large/5.jpg not downloaded yet
2026-03-26 22:50:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6dee750>
2026-03-26 22:50:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f848b84-78f6-5388-b7ab-a5470e154ec1/9f848b84-78f6-5388-b7ab-a5470e154ec1_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ec%252F70d656a4edeb4d90af456f0a00ed231f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ec/70d656a4edeb4d90af456f0a00ed231f/images/large/4.jpg saved to cache
2026-03-26 22:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9f848b84-78f6-5388-b7ab-a5470e154ec1
2026-03-26 22:50:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76eec10>
2026-03-26 22:50:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f848b84-78f6-5388-b7ab-a5470e154ec1/9f848b84-78f6-5388-b7ab-a5470e154ec1_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ec%252F70d656a4edeb4d90af456f0a00ed231f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ec/70d656a4edeb4d90af456f0a00ed231f/images/large/5.jpg saved to cache
2026-03-26 22:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9f848b84-78f6-5388-b7ab-a5470e154ec1
2026-03-26 22:50:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ec/70d656a4edeb4d90af456f0a00ed231f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fb1f10320fb234bffb28f2ab76c2c1983%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/b1f10320fb234bffb28f2ab76c2c1983/images/large/6.jpg not downloaded yet
2026-03-26 22:50:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ec/70d656a4edeb4d90af456f0a00ed231f/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fb1f10320fb234bffb28f2ab76c2c1983%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/b1f10320fb234bffb28f2ab76c2c1983/images/large/7.jpg not downloaded yet
2026-03-26 22:50:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ec/70d656a4edeb4d90af456f0a00ed231f/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7778390>
2026-03-26 22:50:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f848b84-78f6-5388-b7ab-a5470e154ec1/9f848b84-78f6-5388-b7ab-a5470e154ec1_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ec%252F70d656a4edeb4d90af456f0a00ed231f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ec/70d656a4edeb4d90af456f0a00ed231f/images/large/6.jpg saved to cache
2026-03-26 22:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9f848b84-78f6-5388-b7ab-a5470e154ec1
2026-03-26 22:50:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74a5b90>
2026-03-26 22:50:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f848b84-78f6-5388-b7ab-a5470e154ec1/9f848b84-78f6-5388-b7ab-a5470e154ec1_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ec%252F70d656a4edeb4d90af456f0a00ed231f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ec/70d656a4edeb4d90af456f0a00ed231f/images/large/7.jpg saved to cache
2026-03-26 22:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9f848b84-78f6-5388-b7ab-a5470e154ec1
2026-03-26 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fb1f10320fb234bffb28f2ab76c2c1983%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/b1f10320fb234bffb28f2ab76c2c1983/images/large/8.jpg not downloaded yet
2026-03-26 22:50:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/b1f10320fb234bffb28f2ab76c2c1983/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fb1f10320fb234bffb28f2ab76c2c1983%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/b1f10320fb234bffb28f2ab76c2c1983/images/large/9.jpg not downloaded yet
2026-03-26 22:50:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5ca4350>
2026-03-26 22:50:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f848b84-78f6-5388-b7ab-a5470e154ec1/9f848b84-78f6-5388-b7ab-a5470e154ec1_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ec%252F70d656a4edeb4d90af456f0a00ed231f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ec/70d656a4edeb4d90af456f0a00ed231f/images/large/8.jpg saved to cache
2026-03-26 22:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9f848b84-78f6-5388-b7ab-a5470e154ec1
2026-03-26 22:50:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cbcb50>
2026-03-26 22:50:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f848b84-78f6-5388-b7ab-a5470e154ec1/9f848b84-78f6-5388-b7ab-a5470e154ec1_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ec%252F70d656a4edeb4d90af456f0a00ed231f%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ec/70d656a4edeb4d90af456f0a00ed231f/images/large/9.jpg saved to cache
2026-03-26 22:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9f848b84-78f6-5388-b7ab-a5470e154ec1
2026-03-26 22:50:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79fb7d0>
2026-03-26 22:50:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f848b84-78f6-5388-b7ab-a5470e154ec1/9f848b84-78f6-5388-b7ab-a5470e154ec1_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ec%252F70d656a4edeb4d90af456f0a00ed231f%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ec/70d656a4edeb4d90af456f0a00ed231f/images/large/10.jpg saved to cache
2026-03-26 22:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9f848b84-78f6-5388-b7ab-a5470e154ec1
2026-03-26 22:50:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9f848b84-78f6-5388-b7ab-a5470e154ec1, skipping ID generation
2026-03-26 22:50:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f848b84-78f6-5388-b7ab-a5470e154ec1 with scrape type 1
2026-03-26 22:50:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9f848b84-78f6-5388-b7ab-a5470e154ec1 sending to next pipeline
2026-03-26 22:50:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 9f848b84-78f6-5388-b7ab-a5470e154ec1, identifier: 1985389
2026-03-26 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fb1f10320fb234bffb28f2ab76c2c1983%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/b1f10320fb234bffb28f2ab76c2c1983/images/large/10.jpg not downloaded yet
2026-03-26 22:50:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 9f848b84-78f6-5388-b7ab-a5470e154ec1 with identifier: 1985389
2026-03-26 22:50:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 9f848b84-78f6-5388-b7ab-a5470e154ec1 with identifier: 1985389
2026-03-26 22:50:19 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 9f848b84-78f6-5388-b7ab-a5470e154ec1 with identifier: 1985389 to the API
2026-03-26 22:50:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:50:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:50:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ec/70d656a4edeb4d90af456f0a00ed231f/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '9f848b84-78f6-5388-b7ab-a5470e154ec1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '2 SERIES ACTIVE TOURER',
 'odometer': 53679,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f848b84-78f6-5388-b7ab-a5470e154ec1/9f848b84-78f6-5388-b7ab-a5470e154ec1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 597766,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ec/70d656a4edeb4d90af456f0a00ed231f/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f848b84-78f6-5388-b7ab-a5470e154ec1/9f848b84-78f6-5388-b7ab-a5470e154ec1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 633663,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ec/70d656a4edeb4d90af456f0a00ed231f/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f848b84-78f6-5388-b7ab-a5470e154ec1/9f848b84-78f6-5388-b7ab-a5470e154ec1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 661656,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ec/70d656a4edeb4d90af456f0a00ed231f/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f848b84-78f6-5388-b7ab-a5470e154ec1/9f848b84-78f6-5388-b7ab-a5470e154ec1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 647845,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ec/70d656a4edeb4d90af456f0a00ed231f/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f848b84-78f6-5388-b7ab-a5470e154ec1/9f848b84-78f6-5388-b7ab-a5470e154ec1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 566252,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ec/70d656a4edeb4d90af456f0a00ed231f/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f848b84-78f6-5388-b7ab-a5470e154ec1/9f848b84-78f6-5388-b7ab-a5470e154ec1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 562737,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ec/70d656a4edeb4d90af456f0a00ed231f/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f848b84-78f6-5388-b7ab-a5470e154ec1/9f848b84-78f6-5388-b7ab-a5470e154ec1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 598564,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ec/70d656a4edeb4d90af456f0a00ed231f/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f848b84-78f6-5388-b7ab-a5470e154ec1/9f848b84-78f6-5388-b7ab-a5470e154ec1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 669959,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ec/70d656a4edeb4d90af456f0a00ed231f/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f848b84-78f6-5388-b7ab-a5470e154ec1/9f848b84-78f6-5388-b7ab-a5470e154ec1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 608188,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ec/70d656a4edeb4d90af456f0a00ed231f/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f848b84-78f6-5388-b7ab-a5470e154ec1/9f848b84-78f6-5388-b7ab-a5470e154ec1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 515915,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ec/70d656a4edeb4d90af456f0a00ed231f/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-08-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 2 SERIES ACTIVE TOURER 1.5 225E PHEV DCT XDRIVE ACTIVE TOURER',
 'transmission': 'automatic',
 'trim': '1.5 225E PHEV DCT XDRIVE ACTIVE TOURER',
 'vin': None,
 'year': 2023}
2026-03-26 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985389%27 HTTP/1.1" 200 None
2026-03-26 22:50:19 [ayvens.be] INFO: Saving data for 1985389: {'created_time': 1774565419.348604, 'last_price_update_time': 1774565419.348613, 'auction_closing_time': 1774958400.0}
2026-03-26 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985389') HTTP/1.1" 204 0
2026-03-26 22:50:19 [ayvens.be] INFO: Found listing with ID: 1985391
2026-03-26 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985391%27 HTTP/1.1" 200 None
2026-03-26 22:50:19 [ayvens.be] INFO: Scrape type for 1985391: 1
2026-03-26 22:50:19 [ayvens.be] INFO: Extracting data for car ID: 1985391
2026-03-26 22:50:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e70e0a53-f615-5e36-8282-b789dd1802c1 with identifier: 1985391
2026-03-26 22:50:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e70e0a53-f615-5e36-8282-b789dd1802c1 with scrape type 1
2026-03-26 22:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e70e0a53-f615-5e36-8282-b789dd1802c1
2026-03-26 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fe42a71b7c76b41dab3194cdba54a9501%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/e42a71b7c76b41dab3194cdba54a9501/images/large/1.jpg not downloaded yet
2026-03-26 22:50:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/b1f10320fb234bffb28f2ab76c2c1983/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/b1f10320fb234bffb28f2ab76c2c1983/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fe42a71b7c76b41dab3194cdba54a9501%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/e42a71b7c76b41dab3194cdba54a9501/images/large/2.jpg not downloaded yet
2026-03-26 22:50:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e155d0>
2026-03-26 22:50:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b30eb02b-510e-5cce-8b0c-c2f43e8c5e02/b30eb02b-510e-5cce-8b0c-c2f43e8c5e02_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fb1f10320fb234bffb28f2ab76c2c1983%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/b1f10320fb234bffb28f2ab76c2c1983/images/large/1.jpg saved to cache
2026-03-26 22:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b30eb02b-510e-5cce-8b0c-c2f43e8c5e02
2026-03-26 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fe42a71b7c76b41dab3194cdba54a9501%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/e42a71b7c76b41dab3194cdba54a9501/images/large/3.jpg not downloaded yet
2026-03-26 22:50:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/b1f10320fb234bffb28f2ab76c2c1983/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/b1f10320fb234bffb28f2ab76c2c1983/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fe42a71b7c76b41dab3194cdba54a9501%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/e42a71b7c76b41dab3194cdba54a9501/images/large/4.jpg not downloaded yet
2026-03-26 22:50:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7572790>
2026-03-26 22:50:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b30eb02b-510e-5cce-8b0c-c2f43e8c5e02/b30eb02b-510e-5cce-8b0c-c2f43e8c5e02_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fb1f10320fb234bffb28f2ab76c2c1983%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/b1f10320fb234bffb28f2ab76c2c1983/images/large/2.jpg saved to cache
2026-03-26 22:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b30eb02b-510e-5cce-8b0c-c2f43e8c5e02
2026-03-26 22:50:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e1d090>
2026-03-26 22:50:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b30eb02b-510e-5cce-8b0c-c2f43e8c5e02/b30eb02b-510e-5cce-8b0c-c2f43e8c5e02_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fb1f10320fb234bffb28f2ab76c2c1983%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/b1f10320fb234bffb28f2ab76c2c1983/images/large/3.jpg saved to cache
2026-03-26 22:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b30eb02b-510e-5cce-8b0c-c2f43e8c5e02
2026-03-26 22:50:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/b1f10320fb234bffb28f2ab76c2c1983/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fe42a71b7c76b41dab3194cdba54a9501%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/e42a71b7c76b41dab3194cdba54a9501/images/large/5.jpg not downloaded yet
2026-03-26 22:50:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/b1f10320fb234bffb28f2ab76c2c1983/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fe42a71b7c76b41dab3194cdba54a9501%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/e42a71b7c76b41dab3194cdba54a9501/images/large/6.jpg not downloaded yet
2026-03-26 22:50:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7ccde50>
2026-03-26 22:50:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b30eb02b-510e-5cce-8b0c-c2f43e8c5e02/b30eb02b-510e-5cce-8b0c-c2f43e8c5e02_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fb1f10320fb234bffb28f2ab76c2c1983%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/b1f10320fb234bffb28f2ab76c2c1983/images/large/5.jpg saved to cache
2026-03-26 22:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b30eb02b-510e-5cce-8b0c-c2f43e8c5e02
2026-03-26 22:50:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7a56a10>
2026-03-26 22:50:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b30eb02b-510e-5cce-8b0c-c2f43e8c5e02/b30eb02b-510e-5cce-8b0c-c2f43e8c5e02_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fb1f10320fb234bffb28f2ab76c2c1983%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/b1f10320fb234bffb28f2ab76c2c1983/images/large/4.jpg saved to cache
2026-03-26 22:50:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b30eb02b-510e-5cce-8b0c-c2f43e8c5e02
2026-03-26 22:50:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/b1f10320fb234bffb28f2ab76c2c1983/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fe42a71b7c76b41dab3194cdba54a9501%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/e42a71b7c76b41dab3194cdba54a9501/images/large/7.jpg not downloaded yet
2026-03-26 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fe42a71b7c76b41dab3194cdba54a9501%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/e42a71b7c76b41dab3194cdba54a9501/images/large/8.jpg not downloaded yet
2026-03-26 22:50:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/b1f10320fb234bffb28f2ab76c2c1983/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fe42a71b7c76b41dab3194cdba54a9501%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/e42a71b7c76b41dab3194cdba54a9501/images/large/9.jpg not downloaded yet
2026-03-26 22:50:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7572750>
2026-03-26 22:50:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b30eb02b-510e-5cce-8b0c-c2f43e8c5e02/b30eb02b-510e-5cce-8b0c-c2f43e8c5e02_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fb1f10320fb234bffb28f2ab76c2c1983%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/b1f10320fb234bffb28f2ab76c2c1983/images/large/7.jpg saved to cache
2026-03-26 22:50:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b30eb02b-510e-5cce-8b0c-c2f43e8c5e02
2026-03-26 22:50:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79a3190>
2026-03-26 22:50:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b30eb02b-510e-5cce-8b0c-c2f43e8c5e02/b30eb02b-510e-5cce-8b0c-c2f43e8c5e02_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fb1f10320fb234bffb28f2ab76c2c1983%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/b1f10320fb234bffb28f2ab76c2c1983/images/large/6.jpg saved to cache
2026-03-26 22:50:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b30eb02b-510e-5cce-8b0c-c2f43e8c5e02
2026-03-26 22:50:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/e42a71b7c76b41dab3194cdba54a9501/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fe42a71b7c76b41dab3194cdba54a9501%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/e42a71b7c76b41dab3194cdba54a9501/images/large/10.jpg not downloaded yet
2026-03-26 22:50:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/e42a71b7c76b41dab3194cdba54a9501/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/b1f10320fb234bffb28f2ab76c2c1983/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:20 [ayvens.be] INFO: Found listing with ID: 1985392
2026-03-26 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985392%27 HTTP/1.1" 200 None
2026-03-26 22:50:20 [ayvens.be] INFO: Scrape type for 1985392: 1
2026-03-26 22:50:20 [ayvens.be] INFO: Extracting data for car ID: 1985392
2026-03-26 22:50:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9474db12-7db3-5b4b-b87e-d1af39983ce6 with identifier: 1985392
2026-03-26 22:50:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9474db12-7db3-5b4b-b87e-d1af39983ce6 with scrape type 1
2026-03-26 22:50:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9474db12-7db3-5b4b-b87e-d1af39983ce6
2026-03-26 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F3647b6474f894bddb86e92b99498366e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/3647b6474f894bddb86e92b99498366e/images/large/1.jpg not downloaded yet
2026-03-26 22:50:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/e42a71b7c76b41dab3194cdba54a9501/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7404e90>
2026-03-26 22:50:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b30eb02b-510e-5cce-8b0c-c2f43e8c5e02/b30eb02b-510e-5cce-8b0c-c2f43e8c5e02_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fb1f10320fb234bffb28f2ab76c2c1983%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/b1f10320fb234bffb28f2ab76c2c1983/images/large/8.jpg saved to cache
2026-03-26 22:50:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b30eb02b-510e-5cce-8b0c-c2f43e8c5e02
2026-03-26 22:50:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7449010>
2026-03-26 22:50:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b30eb02b-510e-5cce-8b0c-c2f43e8c5e02/b30eb02b-510e-5cce-8b0c-c2f43e8c5e02_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fb1f10320fb234bffb28f2ab76c2c1983%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/b1f10320fb234bffb28f2ab76c2c1983/images/large/9.jpg saved to cache
2026-03-26 22:50:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b30eb02b-510e-5cce-8b0c-c2f43e8c5e02
2026-03-26 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F3647b6474f894bddb86e92b99498366e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/3647b6474f894bddb86e92b99498366e/images/large/2.jpg not downloaded yet
2026-03-26 22:50:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/e42a71b7c76b41dab3194cdba54a9501/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F3647b6474f894bddb86e92b99498366e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/3647b6474f894bddb86e92b99498366e/images/large/3.jpg not downloaded yet
2026-03-26 22:50:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e3e3d0>
2026-03-26 22:50:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e70e0a53-f615-5e36-8282-b789dd1802c1/e70e0a53-f615-5e36-8282-b789dd1802c1_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fe42a71b7c76b41dab3194cdba54a9501%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/e42a71b7c76b41dab3194cdba54a9501/images/large/2.jpg saved to cache
2026-03-26 22:50:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e70e0a53-f615-5e36-8282-b789dd1802c1
2026-03-26 22:50:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74afc50>
2026-03-26 22:50:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e70e0a53-f615-5e36-8282-b789dd1802c1/e70e0a53-f615-5e36-8282-b789dd1802c1_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fe42a71b7c76b41dab3194cdba54a9501%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/e42a71b7c76b41dab3194cdba54a9501/images/large/1.jpg saved to cache
2026-03-26 22:50:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e70e0a53-f615-5e36-8282-b789dd1802c1
2026-03-26 22:50:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e16dd0>
2026-03-26 22:50:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b30eb02b-510e-5cce-8b0c-c2f43e8c5e02/b30eb02b-510e-5cce-8b0c-c2f43e8c5e02_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fb1f10320fb234bffb28f2ab76c2c1983%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/b1f10320fb234bffb28f2ab76c2c1983/images/large/10.jpg saved to cache
2026-03-26 22:50:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b30eb02b-510e-5cce-8b0c-c2f43e8c5e02
2026-03-26 22:50:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b30eb02b-510e-5cce-8b0c-c2f43e8c5e02, skipping ID generation
2026-03-26 22:50:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b30eb02b-510e-5cce-8b0c-c2f43e8c5e02 with scrape type 1
2026-03-26 22:50:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b30eb02b-510e-5cce-8b0c-c2f43e8c5e02 sending to next pipeline
2026-03-26 22:50:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b30eb02b-510e-5cce-8b0c-c2f43e8c5e02, identifier: 1985390
2026-03-26 22:50:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74de650>
2026-03-26 22:50:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e70e0a53-f615-5e36-8282-b789dd1802c1/e70e0a53-f615-5e36-8282-b789dd1802c1_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fe42a71b7c76b41dab3194cdba54a9501%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/e42a71b7c76b41dab3194cdba54a9501/images/large/3.jpg saved to cache
2026-03-26 22:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e70e0a53-f615-5e36-8282-b789dd1802c1
2026-03-26 22:50:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/e42a71b7c76b41dab3194cdba54a9501/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F3647b6474f894bddb86e92b99498366e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/3647b6474f894bddb86e92b99498366e/images/large/4.jpg not downloaded yet
2026-03-26 22:50:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b30eb02b-510e-5cce-8b0c-c2f43e8c5e02 with identifier: 1985390
2026-03-26 22:50:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b30eb02b-510e-5cce-8b0c-c2f43e8c5e02 with identifier: 1985390
2026-03-26 22:50:21 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b30eb02b-510e-5cce-8b0c-c2f43e8c5e02 with identifier: 1985390 to the API
2026-03-26 22:50:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:50:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:50:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cm/b1f10320fb234bffb28f2ab76c2c1983/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b30eb02b-510e-5cce-8b0c-c2f43e8c5e02',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '1 SERIES HATCH',
 'odometer': 54790,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 20,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b30eb02b-510e-5cce-8b0c-c2f43e8c5e02/b30eb02b-510e-5cce-8b0c-c2f43e8c5e02_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 650044,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/b1f10320fb234bffb28f2ab76c2c1983/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b30eb02b-510e-5cce-8b0c-c2f43e8c5e02/b30eb02b-510e-5cce-8b0c-c2f43e8c5e02_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 693045,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/b1f10320fb234bffb28f2ab76c2c1983/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b30eb02b-510e-5cce-8b0c-c2f43e8c5e02/b30eb02b-510e-5cce-8b0c-c2f43e8c5e02_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 674293,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/b1f10320fb234bffb28f2ab76c2c1983/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b30eb02b-510e-5cce-8b0c-c2f43e8c5e02/b30eb02b-510e-5cce-8b0c-c2f43e8c5e02_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 679169,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/b1f10320fb234bffb28f2ab76c2c1983/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b30eb02b-510e-5cce-8b0c-c2f43e8c5e02/b30eb02b-510e-5cce-8b0c-c2f43e8c5e02_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 683603,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/b1f10320fb234bffb28f2ab76c2c1983/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b30eb02b-510e-5cce-8b0c-c2f43e8c5e02/b30eb02b-510e-5cce-8b0c-c2f43e8c5e02_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 762650,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/b1f10320fb234bffb28f2ab76c2c1983/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b30eb02b-510e-5cce-8b0c-c2f43e8c5e02/b30eb02b-510e-5cce-8b0c-c2f43e8c5e02_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 596277,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/b1f10320fb234bffb28f2ab76c2c1983/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b30eb02b-510e-5cce-8b0c-c2f43e8c5e02/b30eb02b-510e-5cce-8b0c-c2f43e8c5e02_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 795253,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/b1f10320fb234bffb28f2ab76c2c1983/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b30eb02b-510e-5cce-8b0c-c2f43e8c5e02/b30eb02b-510e-5cce-8b0c-c2f43e8c5e02_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 774562,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/b1f10320fb234bffb28f2ab76c2c1983/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b30eb02b-510e-5cce-8b0c-c2f43e8c5e02/b30eb02b-510e-5cce-8b0c-c2f43e8c5e02_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 816347,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/b1f10320fb234bffb28f2ab76c2c1983/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1 SERIES HATCH 1.5 116DA (85KW)',
 'transmission': 'automatic',
 'trim': '1.5 116DA (85KW)',
 'vin': None,
 'year': 2022}
2026-03-26 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985390%27 HTTP/1.1" 200 None
2026-03-26 22:50:21 [ayvens.be] INFO: Saving data for 1985390: {'created_time': 1774565421.532063, 'last_price_update_time': 1774565421.532074, 'auction_closing_time': 1774958400.0}
2026-03-26 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985390') HTTP/1.1" 204 0
2026-03-26 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F3647b6474f894bddb86e92b99498366e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/3647b6474f894bddb86e92b99498366e/images/large/5.jpg not downloaded yet
2026-03-26 22:50:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6da41d0>
2026-03-26 22:50:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e70e0a53-f615-5e36-8282-b789dd1802c1/e70e0a53-f615-5e36-8282-b789dd1802c1_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fe42a71b7c76b41dab3194cdba54a9501%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/e42a71b7c76b41dab3194cdba54a9501/images/large/4.jpg saved to cache
2026-03-26 22:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e70e0a53-f615-5e36-8282-b789dd1802c1
2026-03-26 22:50:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/e42a71b7c76b41dab3194cdba54a9501/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/e42a71b7c76b41dab3194cdba54a9501/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/3647b6474f894bddb86e92b99498366e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F3647b6474f894bddb86e92b99498366e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/3647b6474f894bddb86e92b99498366e/images/large/6.jpg not downloaded yet
2026-03-26 22:50:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7424bd0>
2026-03-26 22:50:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e70e0a53-f615-5e36-8282-b789dd1802c1/e70e0a53-f615-5e36-8282-b789dd1802c1_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fe42a71b7c76b41dab3194cdba54a9501%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/e42a71b7c76b41dab3194cdba54a9501/images/large/5.jpg saved to cache
2026-03-26 22:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e70e0a53-f615-5e36-8282-b789dd1802c1
2026-03-26 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F3647b6474f894bddb86e92b99498366e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/3647b6474f894bddb86e92b99498366e/images/large/7.jpg not downloaded yet
2026-03-26 22:50:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/e42a71b7c76b41dab3194cdba54a9501/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/3647b6474f894bddb86e92b99498366e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/e42a71b7c76b41dab3194cdba54a9501/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/3647b6474f894bddb86e92b99498366e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F3647b6474f894bddb86e92b99498366e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/3647b6474f894bddb86e92b99498366e/images/large/8.jpg not downloaded yet
2026-03-26 22:50:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6da7810>
2026-03-26 22:50:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e70e0a53-f615-5e36-8282-b789dd1802c1/e70e0a53-f615-5e36-8282-b789dd1802c1_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fe42a71b7c76b41dab3194cdba54a9501%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/e42a71b7c76b41dab3194cdba54a9501/images/large/6.jpg saved to cache
2026-03-26 22:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e70e0a53-f615-5e36-8282-b789dd1802c1
2026-03-26 22:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F3647b6474f894bddb86e92b99498366e%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/3647b6474f894bddb86e92b99498366e/images/large/9.jpg not downloaded yet
2026-03-26 22:50:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7726c50>
2026-03-26 22:50:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e70e0a53-f615-5e36-8282-b789dd1802c1/e70e0a53-f615-5e36-8282-b789dd1802c1_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fe42a71b7c76b41dab3194cdba54a9501%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/e42a71b7c76b41dab3194cdba54a9501/images/large/7.jpg saved to cache
2026-03-26 22:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e70e0a53-f615-5e36-8282-b789dd1802c1
2026-03-26 22:50:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e12d50>
2026-03-26 22:50:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9474db12-7db3-5b4b-b87e-d1af39983ce6/9474db12-7db3-5b4b-b87e-d1af39983ce6_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F3647b6474f894bddb86e92b99498366e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/3647b6474f894bddb86e92b99498366e/images/large/1.jpg saved to cache
2026-03-26 22:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9474db12-7db3-5b4b-b87e-d1af39983ce6
2026-03-26 22:50:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/e42a71b7c76b41dab3194cdba54a9501/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F3647b6474f894bddb86e92b99498366e%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/3647b6474f894bddb86e92b99498366e/images/large/10.jpg not downloaded yet
2026-03-26 22:50:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cbe8d0>
2026-03-26 22:50:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e70e0a53-f615-5e36-8282-b789dd1802c1/e70e0a53-f615-5e36-8282-b789dd1802c1_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fe42a71b7c76b41dab3194cdba54a9501%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/e42a71b7c76b41dab3194cdba54a9501/images/large/8.jpg saved to cache
2026-03-26 22:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e70e0a53-f615-5e36-8282-b789dd1802c1
2026-03-26 22:50:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77e8890>
2026-03-26 22:50:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9474db12-7db3-5b4b-b87e-d1af39983ce6/9474db12-7db3-5b4b-b87e-d1af39983ce6_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F3647b6474f894bddb86e92b99498366e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/3647b6474f894bddb86e92b99498366e/images/large/3.jpg saved to cache
2026-03-26 22:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9474db12-7db3-5b4b-b87e-d1af39983ce6
2026-03-26 22:50:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76ed1d0>
2026-03-26 22:50:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e70e0a53-f615-5e36-8282-b789dd1802c1/e70e0a53-f615-5e36-8282-b789dd1802c1_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fe42a71b7c76b41dab3194cdba54a9501%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/e42a71b7c76b41dab3194cdba54a9501/images/large/9.jpg saved to cache
2026-03-26 22:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e70e0a53-f615-5e36-8282-b789dd1802c1
2026-03-26 22:50:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5ca3910>
2026-03-26 22:50:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9474db12-7db3-5b4b-b87e-d1af39983ce6/9474db12-7db3-5b4b-b87e-d1af39983ce6_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F3647b6474f894bddb86e92b99498366e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/3647b6474f894bddb86e92b99498366e/images/large/2.jpg saved to cache
2026-03-26 22:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9474db12-7db3-5b4b-b87e-d1af39983ce6
2026-03-26 22:50:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/3647b6474f894bddb86e92b99498366e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:22 [ayvens.be] INFO: Found listing with ID: 1985393
2026-03-26 22:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985393%27 HTTP/1.1" 200 None
2026-03-26 22:50:22 [ayvens.be] INFO: Scrape type for 1985393: 1
2026-03-26 22:50:22 [ayvens.be] INFO: Extracting data for car ID: 1985393
2026-03-26 22:50:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ac0fe51-d303-5c51-b4c4-e751c647c8ad with identifier: 1985393
2026-03-26 22:50:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ac0fe51-d303-5c51-b4c4-e751c647c8ad with scrape type 1
2026-03-26 22:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7ac0fe51-d303-5c51-b4c4-e751c647c8ad
2026-03-26 22:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252Fc5c2260b4ad9400aa9fd2e1a2db8150f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/c5c2260b4ad9400aa9fd2e1a2db8150f/images/large/1.jpg not downloaded yet
2026-03-26 22:50:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/3647b6474f894bddb86e92b99498366e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/3647b6474f894bddb86e92b99498366e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252Fc5c2260b4ad9400aa9fd2e1a2db8150f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/c5c2260b4ad9400aa9fd2e1a2db8150f/images/large/2.jpg not downloaded yet
2026-03-26 22:50:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/3647b6474f894bddb86e92b99498366e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b788d0d0>
2026-03-26 22:50:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e70e0a53-f615-5e36-8282-b789dd1802c1/e70e0a53-f615-5e36-8282-b789dd1802c1_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fe42a71b7c76b41dab3194cdba54a9501%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/e42a71b7c76b41dab3194cdba54a9501/images/large/10.jpg saved to cache
2026-03-26 22:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e70e0a53-f615-5e36-8282-b789dd1802c1
2026-03-26 22:50:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e70e0a53-f615-5e36-8282-b789dd1802c1, skipping ID generation
2026-03-26 22:50:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e70e0a53-f615-5e36-8282-b789dd1802c1 with scrape type 1
2026-03-26 22:50:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e70e0a53-f615-5e36-8282-b789dd1802c1 sending to next pipeline
2026-03-26 22:50:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e70e0a53-f615-5e36-8282-b789dd1802c1, identifier: 1985391
2026-03-26 22:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252Fc5c2260b4ad9400aa9fd2e1a2db8150f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/c5c2260b4ad9400aa9fd2e1a2db8150f/images/large/3.jpg not downloaded yet
2026-03-26 22:50:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e70e0a53-f615-5e36-8282-b789dd1802c1 with identifier: 1985391
2026-03-26 22:50:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e70e0a53-f615-5e36-8282-b789dd1802c1 with identifier: 1985391
2026-03-26 22:50:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e70e0a53-f615-5e36-8282-b789dd1802c1 with identifier: 1985391 to the API
2026-03-26 22:50:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:50:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:50:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bs/e42a71b7c76b41dab3194cdba54a9501/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'e70e0a53-f615-5e36-8282-b789dd1802c1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLA - Klasse',
 'odometer': 71679,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e70e0a53-f615-5e36-8282-b789dd1802c1/e70e0a53-f615-5e36-8282-b789dd1802c1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 682064,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/e42a71b7c76b41dab3194cdba54a9501/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e70e0a53-f615-5e36-8282-b789dd1802c1/e70e0a53-f615-5e36-8282-b789dd1802c1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 639538,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/e42a71b7c76b41dab3194cdba54a9501/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e70e0a53-f615-5e36-8282-b789dd1802c1/e70e0a53-f615-5e36-8282-b789dd1802c1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 632755,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/e42a71b7c76b41dab3194cdba54a9501/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e70e0a53-f615-5e36-8282-b789dd1802c1/e70e0a53-f615-5e36-8282-b789dd1802c1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 696491,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/e42a71b7c76b41dab3194cdba54a9501/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e70e0a53-f615-5e36-8282-b789dd1802c1/e70e0a53-f615-5e36-8282-b789dd1802c1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 710034,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/e42a71b7c76b41dab3194cdba54a9501/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e70e0a53-f615-5e36-8282-b789dd1802c1/e70e0a53-f615-5e36-8282-b789dd1802c1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 749418,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/e42a71b7c76b41dab3194cdba54a9501/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e70e0a53-f615-5e36-8282-b789dd1802c1/e70e0a53-f615-5e36-8282-b789dd1802c1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 568664,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/e42a71b7c76b41dab3194cdba54a9501/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e70e0a53-f615-5e36-8282-b789dd1802c1/e70e0a53-f615-5e36-8282-b789dd1802c1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 742983,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/e42a71b7c76b41dab3194cdba54a9501/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e70e0a53-f615-5e36-8282-b789dd1802c1/e70e0a53-f615-5e36-8282-b789dd1802c1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 762099,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/e42a71b7c76b41dab3194cdba54a9501/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e70e0a53-f615-5e36-8282-b789dd1802c1/e70e0a53-f615-5e36-8282-b789dd1802c1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 742924,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/e42a71b7c76b41dab3194cdba54a9501/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLA - Klasse 1.3 CLA 250 E BUSINESS SOLUTION DCT',
 'transmission': 'automatic',
 'trim': '1.3 CLA 250 E BUSINESS SOLUTION DCT',
 'vin': None,
 'year': 2022}
2026-03-26 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985391%27 HTTP/1.1" 200 None
2026-03-26 22:50:23 [ayvens.be] INFO: Saving data for 1985391: {'created_time': 1774565423.013443, 'last_price_update_time': 1774565423.013452, 'auction_closing_time': 1774958400.0}
2026-03-26 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985391') HTTP/1.1" 204 0
2026-03-26 22:50:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/3647b6474f894bddb86e92b99498366e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252Fc5c2260b4ad9400aa9fd2e1a2db8150f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/c5c2260b4ad9400aa9fd2e1a2db8150f/images/large/4.jpg not downloaded yet
2026-03-26 22:50:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/3647b6474f894bddb86e92b99498366e/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b98950>
2026-03-26 22:50:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9474db12-7db3-5b4b-b87e-d1af39983ce6/9474db12-7db3-5b4b-b87e-d1af39983ce6_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F3647b6474f894bddb86e92b99498366e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/3647b6474f894bddb86e92b99498366e/images/large/4.jpg saved to cache
2026-03-26 22:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9474db12-7db3-5b4b-b87e-d1af39983ce6
2026-03-26 22:50:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74ac910>
2026-03-26 22:50:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9474db12-7db3-5b4b-b87e-d1af39983ce6/9474db12-7db3-5b4b-b87e-d1af39983ce6_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F3647b6474f894bddb86e92b99498366e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/3647b6474f894bddb86e92b99498366e/images/large/6.jpg saved to cache
2026-03-26 22:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9474db12-7db3-5b4b-b87e-d1af39983ce6
2026-03-26 22:50:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b72785d0>
2026-03-26 22:50:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9474db12-7db3-5b4b-b87e-d1af39983ce6/9474db12-7db3-5b4b-b87e-d1af39983ce6_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F3647b6474f894bddb86e92b99498366e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/3647b6474f894bddb86e92b99498366e/images/large/5.jpg saved to cache
2026-03-26 22:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9474db12-7db3-5b4b-b87e-d1af39983ce6
2026-03-26 22:50:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7aebf90>
2026-03-26 22:50:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9474db12-7db3-5b4b-b87e-d1af39983ce6/9474db12-7db3-5b4b-b87e-d1af39983ce6_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F3647b6474f894bddb86e92b99498366e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/3647b6474f894bddb86e92b99498366e/images/large/7.jpg saved to cache
2026-03-26 22:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9474db12-7db3-5b4b-b87e-d1af39983ce6
2026-03-26 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252Fc5c2260b4ad9400aa9fd2e1a2db8150f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/c5c2260b4ad9400aa9fd2e1a2db8150f/images/large/5.jpg not downloaded yet
2026-03-26 22:50:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/3647b6474f894bddb86e92b99498366e/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252Fc5c2260b4ad9400aa9fd2e1a2db8150f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/c5c2260b4ad9400aa9fd2e1a2db8150f/images/large/6.jpg not downloaded yet
2026-03-26 22:50:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74df210>
2026-03-26 22:50:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9474db12-7db3-5b4b-b87e-d1af39983ce6/9474db12-7db3-5b4b-b87e-d1af39983ce6_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F3647b6474f894bddb86e92b99498366e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/3647b6474f894bddb86e92b99498366e/images/large/8.jpg saved to cache
2026-03-26 22:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9474db12-7db3-5b4b-b87e-d1af39983ce6
2026-03-26 22:50:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd758290>
2026-03-26 22:50:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9474db12-7db3-5b4b-b87e-d1af39983ce6/9474db12-7db3-5b4b-b87e-d1af39983ce6_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F3647b6474f894bddb86e92b99498366e%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/3647b6474f894bddb86e92b99498366e/images/large/9.jpg saved to cache
2026-03-26 22:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9474db12-7db3-5b4b-b87e-d1af39983ce6
2026-03-26 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252Fc5c2260b4ad9400aa9fd2e1a2db8150f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/c5c2260b4ad9400aa9fd2e1a2db8150f/images/large/7.jpg not downloaded yet
2026-03-26 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252Fc5c2260b4ad9400aa9fd2e1a2db8150f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/c5c2260b4ad9400aa9fd2e1a2db8150f/images/large/8.jpg not downloaded yet
2026-03-26 22:50:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5ca3f10>
2026-03-26 22:50:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9474db12-7db3-5b4b-b87e-d1af39983ce6/9474db12-7db3-5b4b-b87e-d1af39983ce6_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F3647b6474f894bddb86e92b99498366e%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/3647b6474f894bddb86e92b99498366e/images/large/10.jpg saved to cache
2026-03-26 22:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9474db12-7db3-5b4b-b87e-d1af39983ce6
2026-03-26 22:50:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9474db12-7db3-5b4b-b87e-d1af39983ce6, skipping ID generation
2026-03-26 22:50:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9474db12-7db3-5b4b-b87e-d1af39983ce6 with scrape type 1
2026-03-26 22:50:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9474db12-7db3-5b4b-b87e-d1af39983ce6 sending to next pipeline
2026-03-26 22:50:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 9474db12-7db3-5b4b-b87e-d1af39983ce6, identifier: 1985392
2026-03-26 22:50:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 9474db12-7db3-5b4b-b87e-d1af39983ce6 with identifier: 1985392
2026-03-26 22:50:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 9474db12-7db3-5b4b-b87e-d1af39983ce6 with identifier: 1985392
2026-03-26 22:50:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 9474db12-7db3-5b4b-b87e-d1af39983ce6 with identifier: 1985392 to the API
2026-03-26 22:50:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:50:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:50:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bp/3647b6474f894bddb86e92b99498366e/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '9474db12-7db3-5b4b-b87e-d1af39983ce6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A-CLASS',
 'odometer': 164062,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9474db12-7db3-5b4b-b87e-d1af39983ce6/9474db12-7db3-5b4b-b87e-d1af39983ce6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 253780,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/3647b6474f894bddb86e92b99498366e/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9474db12-7db3-5b4b-b87e-d1af39983ce6/9474db12-7db3-5b4b-b87e-d1af39983ce6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 261812,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/3647b6474f894bddb86e92b99498366e/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9474db12-7db3-5b4b-b87e-d1af39983ce6/9474db12-7db3-5b4b-b87e-d1af39983ce6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 218442,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/3647b6474f894bddb86e92b99498366e/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9474db12-7db3-5b4b-b87e-d1af39983ce6/9474db12-7db3-5b4b-b87e-d1af39983ce6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 233974,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/3647b6474f894bddb86e92b99498366e/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9474db12-7db3-5b4b-b87e-d1af39983ce6/9474db12-7db3-5b4b-b87e-d1af39983ce6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 280648,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/3647b6474f894bddb86e92b99498366e/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9474db12-7db3-5b4b-b87e-d1af39983ce6/9474db12-7db3-5b4b-b87e-d1af39983ce6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 266840,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/3647b6474f894bddb86e92b99498366e/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9474db12-7db3-5b4b-b87e-d1af39983ce6/9474db12-7db3-5b4b-b87e-d1af39983ce6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 306688,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/3647b6474f894bddb86e92b99498366e/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9474db12-7db3-5b4b-b87e-d1af39983ce6/9474db12-7db3-5b4b-b87e-d1af39983ce6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 322762,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/3647b6474f894bddb86e92b99498366e/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9474db12-7db3-5b4b-b87e-d1af39983ce6/9474db12-7db3-5b4b-b87e-d1af39983ce6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 249857,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/3647b6474f894bddb86e92b99498366e/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9474db12-7db3-5b4b-b87e-d1af39983ce6/9474db12-7db3-5b4b-b87e-d1af39983ce6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 286996,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/3647b6474f894bddb86e92b99498366e/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ A-CLASS 1.3 A 250 E DCT',
 'transmission': 'automatic',
 'trim': '1.3 A 250 E DCT',
 'vin': None,
 'year': 2022}
2026-03-26 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985392%27 HTTP/1.1" 200 None
2026-03-26 22:50:24 [ayvens.be] INFO: Saving data for 1985392: {'created_time': 1774565424.053047, 'last_price_update_time': 1774565424.053057, 'auction_closing_time': 1774958400.0}
2026-03-26 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985392') HTTP/1.1" 204 0
2026-03-26 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252Fc5c2260b4ad9400aa9fd2e1a2db8150f%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/c5c2260b4ad9400aa9fd2e1a2db8150f/images/large/9.jpg not downloaded yet
2026-03-26 22:50:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/c5c2260b4ad9400aa9fd2e1a2db8150f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/c5c2260b4ad9400aa9fd2e1a2db8150f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252Fc5c2260b4ad9400aa9fd2e1a2db8150f%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/c5c2260b4ad9400aa9fd2e1a2db8150f/images/large/10.jpg not downloaded yet
2026-03-26 22:50:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/c5c2260b4ad9400aa9fd2e1a2db8150f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/c5c2260b4ad9400aa9fd2e1a2db8150f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:24 [ayvens.be] INFO: Found listing with ID: 1985394
2026-03-26 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985394%27 HTTP/1.1" 200 None
2026-03-26 22:50:24 [ayvens.be] INFO: Scrape type for 1985394: 1
2026-03-26 22:50:24 [ayvens.be] INFO: Extracting data for car ID: 1985394
2026-03-26 22:50:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e27584de-cb42-5218-b907-d6972bd9fd0f with identifier: 1985394
2026-03-26 22:50:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e27584de-cb42-5218-b907-d6972bd9fd0f with scrape type 1
2026-03-26 22:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e27584de-cb42-5218-b907-d6972bd9fd0f
2026-03-26 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252Fb77d9e00a84d48a098e3bb310f58fa49%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/b77d9e00a84d48a098e3bb310f58fa49/images/large/1.jpg not downloaded yet
2026-03-26 22:50:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/c5c2260b4ad9400aa9fd2e1a2db8150f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/c5c2260b4ad9400aa9fd2e1a2db8150f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252Fb77d9e00a84d48a098e3bb310f58fa49%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/b77d9e00a84d48a098e3bb310f58fa49/images/large/2.jpg not downloaded yet
2026-03-26 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252Fb77d9e00a84d48a098e3bb310f58fa49%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/b77d9e00a84d48a098e3bb310f58fa49/images/large/3.jpg not downloaded yet
2026-03-26 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252Fb77d9e00a84d48a098e3bb310f58fa49%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/b77d9e00a84d48a098e3bb310f58fa49/images/large/4.jpg not downloaded yet
2026-03-26 22:50:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/c5c2260b4ad9400aa9fd2e1a2db8150f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/c5c2260b4ad9400aa9fd2e1a2db8150f/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252Fb77d9e00a84d48a098e3bb310f58fa49%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/b77d9e00a84d48a098e3bb310f58fa49/images/large/5.jpg not downloaded yet
2026-03-26 22:50:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7426590>
2026-03-26 22:50:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ac0fe51-d303-5c51-b4c4-e751c647c8ad/7ac0fe51-d303-5c51-b4c4-e751c647c8ad_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252Fc5c2260b4ad9400aa9fd2e1a2db8150f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/c5c2260b4ad9400aa9fd2e1a2db8150f/images/large/2.jpg saved to cache
2026-03-26 22:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7ac0fe51-d303-5c51-b4c4-e751c647c8ad
2026-03-26 22:50:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b788e290>
2026-03-26 22:50:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ac0fe51-d303-5c51-b4c4-e751c647c8ad/7ac0fe51-d303-5c51-b4c4-e751c647c8ad_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252Fc5c2260b4ad9400aa9fd2e1a2db8150f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/c5c2260b4ad9400aa9fd2e1a2db8150f/images/large/1.jpg saved to cache
2026-03-26 22:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7ac0fe51-d303-5c51-b4c4-e751c647c8ad
2026-03-26 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252Fb77d9e00a84d48a098e3bb310f58fa49%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/b77d9e00a84d48a098e3bb310f58fa49/images/large/6.jpg not downloaded yet
2026-03-26 22:50:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77c9290>
2026-03-26 22:50:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ac0fe51-d303-5c51-b4c4-e751c647c8ad/7ac0fe51-d303-5c51-b4c4-e751c647c8ad_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252Fc5c2260b4ad9400aa9fd2e1a2db8150f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/c5c2260b4ad9400aa9fd2e1a2db8150f/images/large/3.jpg saved to cache
2026-03-26 22:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7ac0fe51-d303-5c51-b4c4-e751c647c8ad
2026-03-26 22:50:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b741ea50>
2026-03-26 22:50:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ac0fe51-d303-5c51-b4c4-e751c647c8ad/7ac0fe51-d303-5c51-b4c4-e751c647c8ad_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252Fc5c2260b4ad9400aa9fd2e1a2db8150f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/c5c2260b4ad9400aa9fd2e1a2db8150f/images/large/6.jpg saved to cache
2026-03-26 22:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7ac0fe51-d303-5c51-b4c4-e751c647c8ad
2026-03-26 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252Fb77d9e00a84d48a098e3bb310f58fa49%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/b77d9e00a84d48a098e3bb310f58fa49/images/large/7.jpg not downloaded yet
2026-03-26 22:50:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c5d050>
2026-03-26 22:50:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ac0fe51-d303-5c51-b4c4-e751c647c8ad/7ac0fe51-d303-5c51-b4c4-e751c647c8ad_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252Fc5c2260b4ad9400aa9fd2e1a2db8150f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/c5c2260b4ad9400aa9fd2e1a2db8150f/images/large/4.jpg saved to cache
2026-03-26 22:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7ac0fe51-d303-5c51-b4c4-e751c647c8ad
2026-03-26 22:50:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b787d1d0>
2026-03-26 22:50:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ac0fe51-d303-5c51-b4c4-e751c647c8ad/7ac0fe51-d303-5c51-b4c4-e751c647c8ad_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252Fc5c2260b4ad9400aa9fd2e1a2db8150f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/c5c2260b4ad9400aa9fd2e1a2db8150f/images/large/5.jpg saved to cache
2026-03-26 22:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7ac0fe51-d303-5c51-b4c4-e751c647c8ad
2026-03-26 22:50:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b75920d0>
2026-03-26 22:50:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ac0fe51-d303-5c51-b4c4-e751c647c8ad/7ac0fe51-d303-5c51-b4c4-e751c647c8ad_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252Fc5c2260b4ad9400aa9fd2e1a2db8150f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/c5c2260b4ad9400aa9fd2e1a2db8150f/images/large/8.jpg saved to cache
2026-03-26 22:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7ac0fe51-d303-5c51-b4c4-e751c647c8ad
2026-03-26 22:50:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b787e350>
2026-03-26 22:50:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ac0fe51-d303-5c51-b4c4-e751c647c8ad/7ac0fe51-d303-5c51-b4c4-e751c647c8ad_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252Fc5c2260b4ad9400aa9fd2e1a2db8150f%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/c5c2260b4ad9400aa9fd2e1a2db8150f/images/large/9.jpg saved to cache
2026-03-26 22:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7ac0fe51-d303-5c51-b4c4-e751c647c8ad
2026-03-26 22:50:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/c5c2260b4ad9400aa9fd2e1a2db8150f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/b77d9e00a84d48a098e3bb310f58fa49/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252Fb77d9e00a84d48a098e3bb310f58fa49%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/b77d9e00a84d48a098e3bb310f58fa49/images/large/8.jpg not downloaded yet
2026-03-26 22:50:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/c5c2260b4ad9400aa9fd2e1a2db8150f/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252Fb77d9e00a84d48a098e3bb310f58fa49%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/b77d9e00a84d48a098e3bb310f58fa49/images/large/9.jpg not downloaded yet
2026-03-26 22:50:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/b77d9e00a84d48a098e3bb310f58fa49/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/b77d9e00a84d48a098e3bb310f58fa49/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/b77d9e00a84d48a098e3bb310f58fa49/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252Fb77d9e00a84d48a098e3bb310f58fa49%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/b77d9e00a84d48a098e3bb310f58fa49/images/large/10.jpg not downloaded yet
2026-03-26 22:50:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/b77d9e00a84d48a098e3bb310f58fa49/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:25 [ayvens.be] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 300
2026-03-26 22:50:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-26 22:50:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cbf910>
2026-03-26 22:50:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ac0fe51-d303-5c51-b4c4-e751c647c8ad/7ac0fe51-d303-5c51-b4c4-e751c647c8ad_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252Fc5c2260b4ad9400aa9fd2e1a2db8150f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/c5c2260b4ad9400aa9fd2e1a2db8150f/images/large/7.jpg saved to cache
2026-03-26 22:50:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7ac0fe51-d303-5c51-b4c4-e751c647c8ad
2026-03-26 22:50:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b781b3d0>
2026-03-26 22:50:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e27584de-cb42-5218-b907-d6972bd9fd0f/e27584de-cb42-5218-b907-d6972bd9fd0f_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252Fb77d9e00a84d48a098e3bb310f58fa49%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/b77d9e00a84d48a098e3bb310f58fa49/images/large/1.jpg saved to cache
2026-03-26 22:50:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e27584de-cb42-5218-b907-d6972bd9fd0f
2026-03-26 22:50:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/b77d9e00a84d48a098e3bb310f58fa49/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/b77d9e00a84d48a098e3bb310f58fa49/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/b77d9e00a84d48a098e3bb310f58fa49/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7aa1290>
2026-03-26 22:50:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ac0fe51-d303-5c51-b4c4-e751c647c8ad/7ac0fe51-d303-5c51-b4c4-e751c647c8ad_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252Fc5c2260b4ad9400aa9fd2e1a2db8150f%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/c5c2260b4ad9400aa9fd2e1a2db8150f/images/large/10.jpg saved to cache
2026-03-26 22:50:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7ac0fe51-d303-5c51-b4c4-e751c647c8ad
2026-03-26 22:50:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7ac0fe51-d303-5c51-b4c4-e751c647c8ad, skipping ID generation
2026-03-26 22:50:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ac0fe51-d303-5c51-b4c4-e751c647c8ad with scrape type 1
2026-03-26 22:50:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7ac0fe51-d303-5c51-b4c4-e751c647c8ad sending to next pipeline
2026-03-26 22:50:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 7ac0fe51-d303-5c51-b4c4-e751c647c8ad, identifier: 1985393
2026-03-26 22:50:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7a638d0>
2026-03-26 22:50:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e27584de-cb42-5218-b907-d6972bd9fd0f/e27584de-cb42-5218-b907-d6972bd9fd0f_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252Fb77d9e00a84d48a098e3bb310f58fa49%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/b77d9e00a84d48a098e3bb310f58fa49/images/large/3.jpg saved to cache
2026-03-26 22:50:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e27584de-cb42-5218-b907-d6972bd9fd0f
2026-03-26 22:50:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7aa0cd0>
2026-03-26 22:50:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e27584de-cb42-5218-b907-d6972bd9fd0f/e27584de-cb42-5218-b907-d6972bd9fd0f_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252Fb77d9e00a84d48a098e3bb310f58fa49%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/b77d9e00a84d48a098e3bb310f58fa49/images/large/2.jpg saved to cache
2026-03-26 22:50:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e27584de-cb42-5218-b907-d6972bd9fd0f
2026-03-26 22:50:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74decd0>
2026-03-26 22:50:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e27584de-cb42-5218-b907-d6972bd9fd0f/e27584de-cb42-5218-b907-d6972bd9fd0f_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252Fb77d9e00a84d48a098e3bb310f58fa49%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/b77d9e00a84d48a098e3bb310f58fa49/images/large/5.jpg saved to cache
2026-03-26 22:50:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e27584de-cb42-5218-b907-d6972bd9fd0f
2026-03-26 22:50:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76a41d0>
2026-03-26 22:50:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e27584de-cb42-5218-b907-d6972bd9fd0f/e27584de-cb42-5218-b907-d6972bd9fd0f_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252Fb77d9e00a84d48a098e3bb310f58fa49%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/b77d9e00a84d48a098e3bb310f58fa49/images/large/4.jpg saved to cache
2026-03-26 22:50:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e27584de-cb42-5218-b907-d6972bd9fd0f
2026-03-26 22:50:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/b77d9e00a84d48a098e3bb310f58fa49/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 7ac0fe51-d303-5c51-b4c4-e751c647c8ad with identifier: 1985393
2026-03-26 22:50:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 7ac0fe51-d303-5c51-b4c4-e751c647c8ad with identifier: 1985393
2026-03-26 22:50:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 7ac0fe51-d303-5c51-b4c4-e751c647c8ad with identifier: 1985393 to the API
2026-03-26 22:50:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:50:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:50:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yp/c5c2260b4ad9400aa9fd2e1a2db8150f/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '7ac0fe51-d303-5c51-b4c4-e751c647c8ad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A4 AVANT',
 'odometer': 123145,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ac0fe51-d303-5c51-b4c4-e751c647c8ad/7ac0fe51-d303-5c51-b4c4-e751c647c8ad_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 612892,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/c5c2260b4ad9400aa9fd2e1a2db8150f/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ac0fe51-d303-5c51-b4c4-e751c647c8ad/7ac0fe51-d303-5c51-b4c4-e751c647c8ad_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 564510,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/c5c2260b4ad9400aa9fd2e1a2db8150f/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ac0fe51-d303-5c51-b4c4-e751c647c8ad/7ac0fe51-d303-5c51-b4c4-e751c647c8ad_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 439478,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/c5c2260b4ad9400aa9fd2e1a2db8150f/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ac0fe51-d303-5c51-b4c4-e751c647c8ad/7ac0fe51-d303-5c51-b4c4-e751c647c8ad_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 535089,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/c5c2260b4ad9400aa9fd2e1a2db8150f/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ac0fe51-d303-5c51-b4c4-e751c647c8ad/7ac0fe51-d303-5c51-b4c4-e751c647c8ad_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 451571,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/c5c2260b4ad9400aa9fd2e1a2db8150f/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ac0fe51-d303-5c51-b4c4-e751c647c8ad/7ac0fe51-d303-5c51-b4c4-e751c647c8ad_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 316800,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/c5c2260b4ad9400aa9fd2e1a2db8150f/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ac0fe51-d303-5c51-b4c4-e751c647c8ad/7ac0fe51-d303-5c51-b4c4-e751c647c8ad_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 446991,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/c5c2260b4ad9400aa9fd2e1a2db8150f/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ac0fe51-d303-5c51-b4c4-e751c647c8ad/7ac0fe51-d303-5c51-b4c4-e751c647c8ad_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 398664,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/c5c2260b4ad9400aa9fd2e1a2db8150f/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ac0fe51-d303-5c51-b4c4-e751c647c8ad/7ac0fe51-d303-5c51-b4c4-e751c647c8ad_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 310211,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/c5c2260b4ad9400aa9fd2e1a2db8150f/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ac0fe51-d303-5c51-b4c4-e751c647c8ad/7ac0fe51-d303-5c51-b4c4-e751c647c8ad_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 354520,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/c5c2260b4ad9400aa9fd2e1a2db8150f/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A4 AVANT 2.0 35 TDI 120KW S TR BUSINESS EDITION',
 'transmission': 'automatic',
 'trim': '2.0 35 TDI 120KW S TR BUSINESS EDITION',
 'vin': None,
 'year': 2020}
2026-03-26 22:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985393%27 HTTP/1.1" 200 None
2026-03-26 22:50:26 [ayvens.be] INFO: Saving data for 1985393: {'created_time': 1774565426.116583, 'last_price_update_time': 1774565426.116593, 'auction_closing_time': 1774958400.0}
2026-03-26 22:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985393') HTTP/1.1" 204 0
2026-03-26 22:50:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76a6ed0>
2026-03-26 22:50:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e27584de-cb42-5218-b907-d6972bd9fd0f/e27584de-cb42-5218-b907-d6972bd9fd0f_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252Fb77d9e00a84d48a098e3bb310f58fa49%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/b77d9e00a84d48a098e3bb310f58fa49/images/large/10.jpg saved to cache
2026-03-26 22:50:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e27584de-cb42-5218-b907-d6972bd9fd0f
2026-03-26 22:50:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74b7dd0>
2026-03-26 22:50:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e27584de-cb42-5218-b907-d6972bd9fd0f/e27584de-cb42-5218-b907-d6972bd9fd0f_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252Fb77d9e00a84d48a098e3bb310f58fa49%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/b77d9e00a84d48a098e3bb310f58fa49/images/large/7.jpg saved to cache
2026-03-26 22:50:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e27584de-cb42-5218-b907-d6972bd9fd0f
2026-03-26 22:50:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79a3fd0>
2026-03-26 22:50:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e27584de-cb42-5218-b907-d6972bd9fd0f/e27584de-cb42-5218-b907-d6972bd9fd0f_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252Fb77d9e00a84d48a098e3bb310f58fa49%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/b77d9e00a84d48a098e3bb310f58fa49/images/large/9.jpg saved to cache
2026-03-26 22:50:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e27584de-cb42-5218-b907-d6972bd9fd0f
2026-03-26 22:50:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6df32d0>
2026-03-26 22:50:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e27584de-cb42-5218-b907-d6972bd9fd0f/e27584de-cb42-5218-b907-d6972bd9fd0f_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252Fb77d9e00a84d48a098e3bb310f58fa49%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/b77d9e00a84d48a098e3bb310f58fa49/images/large/8.jpg saved to cache
2026-03-26 22:50:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e27584de-cb42-5218-b907-d6972bd9fd0f
2026-03-26 22:50:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/b77d9e00a84d48a098e3bb310f58fa49/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7269450>
2026-03-26 22:50:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e27584de-cb42-5218-b907-d6972bd9fd0f/e27584de-cb42-5218-b907-d6972bd9fd0f_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252Fb77d9e00a84d48a098e3bb310f58fa49%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/b77d9e00a84d48a098e3bb310f58fa49/images/large/6.jpg saved to cache
2026-03-26 22:50:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e27584de-cb42-5218-b907-d6972bd9fd0f
2026-03-26 22:50:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e27584de-cb42-5218-b907-d6972bd9fd0f, skipping ID generation
2026-03-26 22:50:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e27584de-cb42-5218-b907-d6972bd9fd0f with scrape type 1
2026-03-26 22:50:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e27584de-cb42-5218-b907-d6972bd9fd0f sending to next pipeline
2026-03-26 22:50:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e27584de-cb42-5218-b907-d6972bd9fd0f, identifier: 1985394
2026-03-26 22:50:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e27584de-cb42-5218-b907-d6972bd9fd0f with identifier: 1985394
2026-03-26 22:50:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e27584de-cb42-5218-b907-d6972bd9fd0f with identifier: 1985394
2026-03-26 22:50:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e27584de-cb42-5218-b907-d6972bd9fd0f with identifier: 1985394 to the API
2026-03-26 22:50:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:50:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:50:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ce/b77d9e00a84d48a098e3bb310f58fa49/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'e27584de-cb42-5218-b907-d6972bd9fd0f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '1 SERIES HATCH',
 'odometer': 110564,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e27584de-cb42-5218-b907-d6972bd9fd0f/e27584de-cb42-5218-b907-d6972bd9fd0f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 402504,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/b77d9e00a84d48a098e3bb310f58fa49/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e27584de-cb42-5218-b907-d6972bd9fd0f/e27584de-cb42-5218-b907-d6972bd9fd0f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 428069,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/b77d9e00a84d48a098e3bb310f58fa49/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e27584de-cb42-5218-b907-d6972bd9fd0f/e27584de-cb42-5218-b907-d6972bd9fd0f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 433010,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/b77d9e00a84d48a098e3bb310f58fa49/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e27584de-cb42-5218-b907-d6972bd9fd0f/e27584de-cb42-5218-b907-d6972bd9fd0f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 453383,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/b77d9e00a84d48a098e3bb310f58fa49/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e27584de-cb42-5218-b907-d6972bd9fd0f/e27584de-cb42-5218-b907-d6972bd9fd0f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 291102,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/b77d9e00a84d48a098e3bb310f58fa49/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e27584de-cb42-5218-b907-d6972bd9fd0f/e27584de-cb42-5218-b907-d6972bd9fd0f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 299796,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/b77d9e00a84d48a098e3bb310f58fa49/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e27584de-cb42-5218-b907-d6972bd9fd0f/e27584de-cb42-5218-b907-d6972bd9fd0f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 353711,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/b77d9e00a84d48a098e3bb310f58fa49/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e27584de-cb42-5218-b907-d6972bd9fd0f/e27584de-cb42-5218-b907-d6972bd9fd0f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 362099,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/b77d9e00a84d48a098e3bb310f58fa49/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e27584de-cb42-5218-b907-d6972bd9fd0f/e27584de-cb42-5218-b907-d6972bd9fd0f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 250679,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/b77d9e00a84d48a098e3bb310f58fa49/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e27584de-cb42-5218-b907-d6972bd9fd0f/e27584de-cb42-5218-b907-d6972bd9fd0f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 238800,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/b77d9e00a84d48a098e3bb310f58fa49/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1 SERIES HATCH 1.5 116DA (85KW)',
 'transmission': 'automatic',
 'trim': '1.5 116DA (85KW)',
 'vin': None,
 'year': 2022}
2026-03-26 22:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985394%27 HTTP/1.1" 200 None
2026-03-26 22:50:27 [ayvens.be] INFO: Saving data for 1985394: {'created_time': 1774565427.088802, 'last_price_update_time': 1774565427.088811, 'auction_closing_time': 1774958400.0}
2026-03-26 22:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985394') HTTP/1.1" 204 0
2026-03-26 22:50:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-03-26 22:50:28 [ayvens.be] INFO: Found listing with ID: 1985395
2026-03-26 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985395%27 HTTP/1.1" 200 None
2026-03-26 22:50:28 [ayvens.be] INFO: Scrape type for 1985395: 1
2026-03-26 22:50:28 [ayvens.be] INFO: Extracting data for car ID: 1985395
2026-03-26 22:50:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 80018c57-88ef-58a6-b4d1-48e1d08fa0ce with identifier: 1985395
2026-03-26 22:50:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80018c57-88ef-58a6-b4d1-48e1d08fa0ce with scrape type 1
2026-03-26 22:50:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 80018c57-88ef-58a6-b4d1-48e1d08fa0ce
2026-03-26 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F4e3eb86becf04913a7dd20069489105b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/4e3eb86becf04913a7dd20069489105b/images/large/1.jpg not downloaded yet
2026-03-26 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F4e3eb86becf04913a7dd20069489105b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/4e3eb86becf04913a7dd20069489105b/images/large/2.jpg not downloaded yet
2026-03-26 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F4e3eb86becf04913a7dd20069489105b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/4e3eb86becf04913a7dd20069489105b/images/large/3.jpg not downloaded yet
2026-03-26 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F4e3eb86becf04913a7dd20069489105b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/4e3eb86becf04913a7dd20069489105b/images/large/4.jpg not downloaded yet
2026-03-26 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F4e3eb86becf04913a7dd20069489105b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/4e3eb86becf04913a7dd20069489105b/images/large/5.jpg not downloaded yet
2026-03-26 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F4e3eb86becf04913a7dd20069489105b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/4e3eb86becf04913a7dd20069489105b/images/large/6.jpg not downloaded yet
2026-03-26 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F4e3eb86becf04913a7dd20069489105b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/4e3eb86becf04913a7dd20069489105b/images/large/7.jpg not downloaded yet
2026-03-26 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F4e3eb86becf04913a7dd20069489105b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/4e3eb86becf04913a7dd20069489105b/images/large/8.jpg not downloaded yet
2026-03-26 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F4e3eb86becf04913a7dd20069489105b%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/4e3eb86becf04913a7dd20069489105b/images/large/9.jpg not downloaded yet
2026-03-26 22:50:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/4e3eb86becf04913a7dd20069489105b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F4e3eb86becf04913a7dd20069489105b%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/4e3eb86becf04913a7dd20069489105b/images/large/10.jpg not downloaded yet
2026-03-26 22:50:28 [ayvens.be] INFO: Found listing with ID: 1985396
2026-03-26 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985396%27 HTTP/1.1" 200 None
2026-03-26 22:50:28 [ayvens.be] INFO: Scrape type for 1985396: 1
2026-03-26 22:50:28 [ayvens.be] INFO: Extracting data for car ID: 1985396
2026-03-26 22:50:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d99e8d78-c155-5dae-996d-4af8f0bf5beb with identifier: 1985396
2026-03-26 22:50:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d99e8d78-c155-5dae-996d-4af8f0bf5beb with scrape type 1
2026-03-26 22:50:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d99e8d78-c155-5dae-996d-4af8f0bf5beb
2026-03-26 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F991685e2a86d41ba8aa2120105bc6986%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/991685e2a86d41ba8aa2120105bc6986/images/large/1.jpg not downloaded yet
2026-03-26 22:50:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/4e3eb86becf04913a7dd20069489105b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/4e3eb86becf04913a7dd20069489105b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F991685e2a86d41ba8aa2120105bc6986%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/991685e2a86d41ba8aa2120105bc6986/images/large/2.jpg not downloaded yet
2026-03-26 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F991685e2a86d41ba8aa2120105bc6986%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/991685e2a86d41ba8aa2120105bc6986/images/large/3.jpg not downloaded yet
2026-03-26 22:50:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/4e3eb86becf04913a7dd20069489105b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F991685e2a86d41ba8aa2120105bc6986%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/991685e2a86d41ba8aa2120105bc6986/images/large/4.jpg not downloaded yet
2026-03-26 22:50:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/4e3eb86becf04913a7dd20069489105b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74e7950>
2026-03-26 22:50:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80018c57-88ef-58a6-b4d1-48e1d08fa0ce/80018c57-88ef-58a6-b4d1-48e1d08fa0ce_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F4e3eb86becf04913a7dd20069489105b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/4e3eb86becf04913a7dd20069489105b/images/large/1.jpg saved to cache
2026-03-26 22:50:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 80018c57-88ef-58a6-b4d1-48e1d08fa0ce
2026-03-26 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F991685e2a86d41ba8aa2120105bc6986%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/991685e2a86d41ba8aa2120105bc6986/images/large/5.jpg not downloaded yet
2026-03-26 22:50:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/4e3eb86becf04913a7dd20069489105b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/4e3eb86becf04913a7dd20069489105b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F991685e2a86d41ba8aa2120105bc6986%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/991685e2a86d41ba8aa2120105bc6986/images/large/6.jpg not downloaded yet
2026-03-26 22:50:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7404090>
2026-03-26 22:50:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80018c57-88ef-58a6-b4d1-48e1d08fa0ce/80018c57-88ef-58a6-b4d1-48e1d08fa0ce_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F4e3eb86becf04913a7dd20069489105b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/4e3eb86becf04913a7dd20069489105b/images/large/2.jpg saved to cache
2026-03-26 22:50:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 80018c57-88ef-58a6-b4d1-48e1d08fa0ce
2026-03-26 22:50:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7aeb690>
2026-03-26 22:50:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80018c57-88ef-58a6-b4d1-48e1d08fa0ce/80018c57-88ef-58a6-b4d1-48e1d08fa0ce_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F4e3eb86becf04913a7dd20069489105b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/4e3eb86becf04913a7dd20069489105b/images/large/3.jpg saved to cache
2026-03-26 22:50:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 80018c57-88ef-58a6-b4d1-48e1d08fa0ce
2026-03-26 22:50:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7492a50>
2026-03-26 22:50:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80018c57-88ef-58a6-b4d1-48e1d08fa0ce/80018c57-88ef-58a6-b4d1-48e1d08fa0ce_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F4e3eb86becf04913a7dd20069489105b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/4e3eb86becf04913a7dd20069489105b/images/large/5.jpg saved to cache
2026-03-26 22:50:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 80018c57-88ef-58a6-b4d1-48e1d08fa0ce
2026-03-26 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F991685e2a86d41ba8aa2120105bc6986%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/991685e2a86d41ba8aa2120105bc6986/images/large/7.jpg not downloaded yet
2026-03-26 22:50:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/4e3eb86becf04913a7dd20069489105b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/4e3eb86becf04913a7dd20069489105b/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b746f410>
2026-03-26 22:50:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80018c57-88ef-58a6-b4d1-48e1d08fa0ce/80018c57-88ef-58a6-b4d1-48e1d08fa0ce_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F4e3eb86becf04913a7dd20069489105b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/4e3eb86becf04913a7dd20069489105b/images/large/6.jpg saved to cache
2026-03-26 22:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 80018c57-88ef-58a6-b4d1-48e1d08fa0ce
2026-03-26 22:50:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79a4990>
2026-03-26 22:50:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80018c57-88ef-58a6-b4d1-48e1d08fa0ce/80018c57-88ef-58a6-b4d1-48e1d08fa0ce_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F4e3eb86becf04913a7dd20069489105b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/4e3eb86becf04913a7dd20069489105b/images/large/7.jpg saved to cache
2026-03-26 22:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 80018c57-88ef-58a6-b4d1-48e1d08fa0ce
2026-03-26 22:50:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7ca8410>
2026-03-26 22:50:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80018c57-88ef-58a6-b4d1-48e1d08fa0ce/80018c57-88ef-58a6-b4d1-48e1d08fa0ce_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F4e3eb86becf04913a7dd20069489105b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/4e3eb86becf04913a7dd20069489105b/images/large/4.jpg saved to cache
2026-03-26 22:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 80018c57-88ef-58a6-b4d1-48e1d08fa0ce
2026-03-26 22:50:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/4e3eb86becf04913a7dd20069489105b/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F991685e2a86d41ba8aa2120105bc6986%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/991685e2a86d41ba8aa2120105bc6986/images/large/8.jpg not downloaded yet
2026-03-26 22:50:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/991685e2a86d41ba8aa2120105bc6986/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F991685e2a86d41ba8aa2120105bc6986%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/991685e2a86d41ba8aa2120105bc6986/images/large/9.jpg not downloaded yet
2026-03-26 22:50:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77251d0>
2026-03-26 22:50:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80018c57-88ef-58a6-b4d1-48e1d08fa0ce/80018c57-88ef-58a6-b4d1-48e1d08fa0ce_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F4e3eb86becf04913a7dd20069489105b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/4e3eb86becf04913a7dd20069489105b/images/large/8.jpg saved to cache
2026-03-26 22:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 80018c57-88ef-58a6-b4d1-48e1d08fa0ce
2026-03-26 22:50:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e10410>
2026-03-26 22:50:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80018c57-88ef-58a6-b4d1-48e1d08fa0ce/80018c57-88ef-58a6-b4d1-48e1d08fa0ce_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F4e3eb86becf04913a7dd20069489105b%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/4e3eb86becf04913a7dd20069489105b/images/large/10.jpg saved to cache
2026-03-26 22:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 80018c57-88ef-58a6-b4d1-48e1d08fa0ce
2026-03-26 22:50:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/991685e2a86d41ba8aa2120105bc6986/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F991685e2a86d41ba8aa2120105bc6986%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/991685e2a86d41ba8aa2120105bc6986/images/large/10.jpg not downloaded yet
2026-03-26 22:50:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/991685e2a86d41ba8aa2120105bc6986/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/991685e2a86d41ba8aa2120105bc6986/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/991685e2a86d41ba8aa2120105bc6986/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:29 [ayvens.be] INFO: Found listing with ID: 1985397
2026-03-26 22:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985397%27 HTTP/1.1" 200 None
2026-03-26 22:50:29 [ayvens.be] INFO: Scrape type for 1985397: 1
2026-03-26 22:50:29 [ayvens.be] INFO: Extracting data for car ID: 1985397
2026-03-26 22:50:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b68131d5-3bb8-563a-a9f7-13cf7d85e87d with identifier: 1985397
2026-03-26 22:50:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b68131d5-3bb8-563a-a9f7-13cf7d85e87d with scrape type 1
2026-03-26 22:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b68131d5-3bb8-563a-a9f7-13cf7d85e87d
2026-03-26 22:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F7c3822146ad94785b54545990fae484b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/7c3822146ad94785b54545990fae484b/images/large/1.jpg not downloaded yet
2026-03-26 22:50:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79f2610>
2026-03-26 22:50:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80018c57-88ef-58a6-b4d1-48e1d08fa0ce/80018c57-88ef-58a6-b4d1-48e1d08fa0ce_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F4e3eb86becf04913a7dd20069489105b%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/4e3eb86becf04913a7dd20069489105b/images/large/9.jpg saved to cache
2026-03-26 22:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 80018c57-88ef-58a6-b4d1-48e1d08fa0ce
2026-03-26 22:50:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 80018c57-88ef-58a6-b4d1-48e1d08fa0ce, skipping ID generation
2026-03-26 22:50:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80018c57-88ef-58a6-b4d1-48e1d08fa0ce with scrape type 1
2026-03-26 22:50:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 80018c57-88ef-58a6-b4d1-48e1d08fa0ce sending to next pipeline
2026-03-26 22:50:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 80018c57-88ef-58a6-b4d1-48e1d08fa0ce, identifier: 1985395
2026-03-26 22:50:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd3d7ad0>
2026-03-26 22:50:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d99e8d78-c155-5dae-996d-4af8f0bf5beb/d99e8d78-c155-5dae-996d-4af8f0bf5beb_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F991685e2a86d41ba8aa2120105bc6986%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/991685e2a86d41ba8aa2120105bc6986/images/large/1.jpg saved to cache
2026-03-26 22:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d99e8d78-c155-5dae-996d-4af8f0bf5beb
2026-03-26 22:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F7c3822146ad94785b54545990fae484b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/7c3822146ad94785b54545990fae484b/images/large/2.jpg not downloaded yet
2026-03-26 22:50:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 80018c57-88ef-58a6-b4d1-48e1d08fa0ce with identifier: 1985395
2026-03-26 22:50:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 80018c57-88ef-58a6-b4d1-48e1d08fa0ce with identifier: 1985395
2026-03-26 22:50:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 80018c57-88ef-58a6-b4d1-48e1d08fa0ce with identifier: 1985395 to the API
2026-03-26 22:50:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:50:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:50:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bv/4e3eb86becf04913a7dd20069489105b/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '80018c57-88ef-58a6-b4d1-48e1d08fa0ce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '1 SERIES HATCH',
 'odometer': 116706,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80018c57-88ef-58a6-b4d1-48e1d08fa0ce/80018c57-88ef-58a6-b4d1-48e1d08fa0ce_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 438559,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/4e3eb86becf04913a7dd20069489105b/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80018c57-88ef-58a6-b4d1-48e1d08fa0ce/80018c57-88ef-58a6-b4d1-48e1d08fa0ce_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 511260,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/4e3eb86becf04913a7dd20069489105b/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80018c57-88ef-58a6-b4d1-48e1d08fa0ce/80018c57-88ef-58a6-b4d1-48e1d08fa0ce_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 458610,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/4e3eb86becf04913a7dd20069489105b/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80018c57-88ef-58a6-b4d1-48e1d08fa0ce/80018c57-88ef-58a6-b4d1-48e1d08fa0ce_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 511405,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/4e3eb86becf04913a7dd20069489105b/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80018c57-88ef-58a6-b4d1-48e1d08fa0ce/80018c57-88ef-58a6-b4d1-48e1d08fa0ce_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 313892,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/4e3eb86becf04913a7dd20069489105b/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80018c57-88ef-58a6-b4d1-48e1d08fa0ce/80018c57-88ef-58a6-b4d1-48e1d08fa0ce_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 342395,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/4e3eb86becf04913a7dd20069489105b/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80018c57-88ef-58a6-b4d1-48e1d08fa0ce/80018c57-88ef-58a6-b4d1-48e1d08fa0ce_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 497296,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/4e3eb86becf04913a7dd20069489105b/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80018c57-88ef-58a6-b4d1-48e1d08fa0ce/80018c57-88ef-58a6-b4d1-48e1d08fa0ce_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 368573,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/4e3eb86becf04913a7dd20069489105b/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80018c57-88ef-58a6-b4d1-48e1d08fa0ce/80018c57-88ef-58a6-b4d1-48e1d08fa0ce_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 384729,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/4e3eb86becf04913a7dd20069489105b/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80018c57-88ef-58a6-b4d1-48e1d08fa0ce/80018c57-88ef-58a6-b4d1-48e1d08fa0ce_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 280208,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/4e3eb86becf04913a7dd20069489105b/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1 SERIES HATCH 1.5 116DA (85KW)',
 'transmission': 'automatic',
 'trim': '1.5 116DA (85KW)',
 'vin': None,
 'year': 2022}
2026-03-26 22:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985395%27 HTTP/1.1" 200 None
2026-03-26 22:50:30 [ayvens.be] INFO: Saving data for 1985395: {'created_time': 1774565430.320032, 'last_price_update_time': 1774565430.320041, 'auction_closing_time': 1774958400.0}
2026-03-26 22:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985395') HTTP/1.1" 204 0
2026-03-26 22:50:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/991685e2a86d41ba8aa2120105bc6986/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/991685e2a86d41ba8aa2120105bc6986/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F7c3822146ad94785b54545990fae484b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/7c3822146ad94785b54545990fae484b/images/large/3.jpg not downloaded yet
2026-03-26 22:50:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7492d50>
2026-03-26 22:50:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d99e8d78-c155-5dae-996d-4af8f0bf5beb/d99e8d78-c155-5dae-996d-4af8f0bf5beb_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F991685e2a86d41ba8aa2120105bc6986%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/991685e2a86d41ba8aa2120105bc6986/images/large/2.jpg saved to cache
2026-03-26 22:50:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d99e8d78-c155-5dae-996d-4af8f0bf5beb
2026-03-26 22:50:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e15850>
2026-03-26 22:50:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d99e8d78-c155-5dae-996d-4af8f0bf5beb/d99e8d78-c155-5dae-996d-4af8f0bf5beb_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F991685e2a86d41ba8aa2120105bc6986%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/991685e2a86d41ba8aa2120105bc6986/images/large/3.jpg saved to cache
2026-03-26 22:50:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d99e8d78-c155-5dae-996d-4af8f0bf5beb
2026-03-26 22:50:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79f0210>
2026-03-26 22:50:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d99e8d78-c155-5dae-996d-4af8f0bf5beb/d99e8d78-c155-5dae-996d-4af8f0bf5beb_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F991685e2a86d41ba8aa2120105bc6986%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/991685e2a86d41ba8aa2120105bc6986/images/large/5.jpg saved to cache
2026-03-26 22:50:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d99e8d78-c155-5dae-996d-4af8f0bf5beb
2026-03-26 22:50:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6df3a50>
2026-03-26 22:50:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d99e8d78-c155-5dae-996d-4af8f0bf5beb/d99e8d78-c155-5dae-996d-4af8f0bf5beb_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F991685e2a86d41ba8aa2120105bc6986%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/991685e2a86d41ba8aa2120105bc6986/images/large/4.jpg saved to cache
2026-03-26 22:50:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d99e8d78-c155-5dae-996d-4af8f0bf5beb
2026-03-26 22:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F7c3822146ad94785b54545990fae484b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/7c3822146ad94785b54545990fae484b/images/large/4.jpg not downloaded yet
2026-03-26 22:50:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/991685e2a86d41ba8aa2120105bc6986/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/991685e2a86d41ba8aa2120105bc6986/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F7c3822146ad94785b54545990fae484b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/7c3822146ad94785b54545990fae484b/images/large/5.jpg not downloaded yet
2026-03-26 22:50:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b740b4d0>
2026-03-26 22:50:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d99e8d78-c155-5dae-996d-4af8f0bf5beb/d99e8d78-c155-5dae-996d-4af8f0bf5beb_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F991685e2a86d41ba8aa2120105bc6986%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/991685e2a86d41ba8aa2120105bc6986/images/large/6.jpg saved to cache
2026-03-26 22:50:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d99e8d78-c155-5dae-996d-4af8f0bf5beb
2026-03-26 22:50:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cbc450>
2026-03-26 22:50:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d99e8d78-c155-5dae-996d-4af8f0bf5beb/d99e8d78-c155-5dae-996d-4af8f0bf5beb_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F991685e2a86d41ba8aa2120105bc6986%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/991685e2a86d41ba8aa2120105bc6986/images/large/7.jpg saved to cache
2026-03-26 22:50:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d99e8d78-c155-5dae-996d-4af8f0bf5beb
2026-03-26 22:50:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/991685e2a86d41ba8aa2120105bc6986/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F7c3822146ad94785b54545990fae484b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/7c3822146ad94785b54545990fae484b/images/large/6.jpg not downloaded yet
2026-03-26 22:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F7c3822146ad94785b54545990fae484b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/7c3822146ad94785b54545990fae484b/images/large/7.jpg not downloaded yet
2026-03-26 22:50:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74e4550>
2026-03-26 22:50:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d99e8d78-c155-5dae-996d-4af8f0bf5beb/d99e8d78-c155-5dae-996d-4af8f0bf5beb_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F991685e2a86d41ba8aa2120105bc6986%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/991685e2a86d41ba8aa2120105bc6986/images/large/9.jpg saved to cache
2026-03-26 22:50:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d99e8d78-c155-5dae-996d-4af8f0bf5beb
2026-03-26 22:50:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7a81bd0>
2026-03-26 22:50:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d99e8d78-c155-5dae-996d-4af8f0bf5beb/d99e8d78-c155-5dae-996d-4af8f0bf5beb_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F991685e2a86d41ba8aa2120105bc6986%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/991685e2a86d41ba8aa2120105bc6986/images/large/8.jpg saved to cache
2026-03-26 22:50:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d99e8d78-c155-5dae-996d-4af8f0bf5beb
2026-03-26 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F7c3822146ad94785b54545990fae484b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/7c3822146ad94785b54545990fae484b/images/large/8.jpg not downloaded yet
2026-03-26 22:50:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/7c3822146ad94785b54545990fae484b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77bcf50>
2026-03-26 22:50:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d99e8d78-c155-5dae-996d-4af8f0bf5beb/d99e8d78-c155-5dae-996d-4af8f0bf5beb_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F991685e2a86d41ba8aa2120105bc6986%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/991685e2a86d41ba8aa2120105bc6986/images/large/10.jpg saved to cache
2026-03-26 22:50:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d99e8d78-c155-5dae-996d-4af8f0bf5beb
2026-03-26 22:50:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d99e8d78-c155-5dae-996d-4af8f0bf5beb, skipping ID generation
2026-03-26 22:50:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d99e8d78-c155-5dae-996d-4af8f0bf5beb with scrape type 1
2026-03-26 22:50:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d99e8d78-c155-5dae-996d-4af8f0bf5beb sending to next pipeline
2026-03-26 22:50:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d99e8d78-c155-5dae-996d-4af8f0bf5beb, identifier: 1985396
2026-03-26 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F7c3822146ad94785b54545990fae484b%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/7c3822146ad94785b54545990fae484b/images/large/9.jpg not downloaded yet
2026-03-26 22:50:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d99e8d78-c155-5dae-996d-4af8f0bf5beb with identifier: 1985396
2026-03-26 22:50:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d99e8d78-c155-5dae-996d-4af8f0bf5beb with identifier: 1985396
2026-03-26 22:50:31 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d99e8d78-c155-5dae-996d-4af8f0bf5beb with identifier: 1985396 to the API
2026-03-26 22:50:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:50:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:50:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ce/991685e2a86d41ba8aa2120105bc6986/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd99e8d78-c155-5dae-996d-4af8f0bf5beb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '1 SERIES HATCH',
 'odometer': 120860,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d99e8d78-c155-5dae-996d-4af8f0bf5beb/d99e8d78-c155-5dae-996d-4af8f0bf5beb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 457130,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/991685e2a86d41ba8aa2120105bc6986/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d99e8d78-c155-5dae-996d-4af8f0bf5beb/d99e8d78-c155-5dae-996d-4af8f0bf5beb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 440303,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/991685e2a86d41ba8aa2120105bc6986/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d99e8d78-c155-5dae-996d-4af8f0bf5beb/d99e8d78-c155-5dae-996d-4af8f0bf5beb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 488091,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/991685e2a86d41ba8aa2120105bc6986/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d99e8d78-c155-5dae-996d-4af8f0bf5beb/d99e8d78-c155-5dae-996d-4af8f0bf5beb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 418970,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/991685e2a86d41ba8aa2120105bc6986/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d99e8d78-c155-5dae-996d-4af8f0bf5beb/d99e8d78-c155-5dae-996d-4af8f0bf5beb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 337931,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/991685e2a86d41ba8aa2120105bc6986/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d99e8d78-c155-5dae-996d-4af8f0bf5beb/d99e8d78-c155-5dae-996d-4af8f0bf5beb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 309609,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/991685e2a86d41ba8aa2120105bc6986/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d99e8d78-c155-5dae-996d-4af8f0bf5beb/d99e8d78-c155-5dae-996d-4af8f0bf5beb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 389957,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/991685e2a86d41ba8aa2120105bc6986/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d99e8d78-c155-5dae-996d-4af8f0bf5beb/d99e8d78-c155-5dae-996d-4af8f0bf5beb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 340514,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/991685e2a86d41ba8aa2120105bc6986/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d99e8d78-c155-5dae-996d-4af8f0bf5beb/d99e8d78-c155-5dae-996d-4af8f0bf5beb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 299336,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/991685e2a86d41ba8aa2120105bc6986/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d99e8d78-c155-5dae-996d-4af8f0bf5beb/d99e8d78-c155-5dae-996d-4af8f0bf5beb_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 227966,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/991685e2a86d41ba8aa2120105bc6986/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1 SERIES HATCH 1.5 116DA (85KW)',
 'transmission': 'automatic',
 'trim': '1.5 116DA (85KW)',
 'vin': None,
 'year': 2022}
2026-03-26 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985396%27 HTTP/1.1" 200 None
2026-03-26 22:50:31 [ayvens.be] INFO: Saving data for 1985396: {'created_time': 1774565431.898034, 'last_price_update_time': 1774565431.898043, 'auction_closing_time': 1774958400.0}
2026-03-26 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985396') HTTP/1.1" 204 0
2026-03-26 22:50:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/7c3822146ad94785b54545990fae484b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F7c3822146ad94785b54545990fae484b%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/7c3822146ad94785b54545990fae484b/images/large/10.jpg not downloaded yet
2026-03-26 22:50:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79a5d50>
2026-03-26 22:50:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b68131d5-3bb8-563a-a9f7-13cf7d85e87d/b68131d5-3bb8-563a-a9f7-13cf7d85e87d_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F7c3822146ad94785b54545990fae484b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/7c3822146ad94785b54545990fae484b/images/large/1.jpg saved to cache
2026-03-26 22:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b68131d5-3bb8-563a-a9f7-13cf7d85e87d
2026-03-26 22:50:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/7c3822146ad94785b54545990fae484b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:32 [ayvens.be] INFO: Found listing with ID: 1985398
2026-03-26 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985398%27 HTTP/1.1" 200 None
2026-03-26 22:50:32 [ayvens.be] INFO: Scrape type for 1985398: 1
2026-03-26 22:50:32 [ayvens.be] INFO: Extracting data for car ID: 1985398
2026-03-26 22:50:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c226416-0ac9-5e76-b8df-1e2ae4911fb1 with identifier: 1985398
2026-03-26 22:50:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c226416-0ac9-5e76-b8df-1e2ae4911fb1 with scrape type 1
2026-03-26 22:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3c226416-0ac9-5e76-b8df-1e2ae4911fb1
2026-03-26 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252F59b7079d27a44c2cb416072264629b7a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/59b7079d27a44c2cb416072264629b7a/images/large/1.jpg not downloaded yet
2026-03-26 22:50:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74aee90>
2026-03-26 22:50:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b68131d5-3bb8-563a-a9f7-13cf7d85e87d/b68131d5-3bb8-563a-a9f7-13cf7d85e87d_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F7c3822146ad94785b54545990fae484b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/7c3822146ad94785b54545990fae484b/images/large/3.jpg saved to cache
2026-03-26 22:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b68131d5-3bb8-563a-a9f7-13cf7d85e87d
2026-03-26 22:50:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/7c3822146ad94785b54545990fae484b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252F59b7079d27a44c2cb416072264629b7a%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/59b7079d27a44c2cb416072264629b7a/images/large/2.jpg not downloaded yet
2026-03-26 22:50:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/7c3822146ad94785b54545990fae484b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252F59b7079d27a44c2cb416072264629b7a%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/59b7079d27a44c2cb416072264629b7a/images/large/3.jpg not downloaded yet
2026-03-26 22:50:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b782cad0>
2026-03-26 22:50:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b68131d5-3bb8-563a-a9f7-13cf7d85e87d/b68131d5-3bb8-563a-a9f7-13cf7d85e87d_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F7c3822146ad94785b54545990fae484b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/7c3822146ad94785b54545990fae484b/images/large/2.jpg saved to cache
2026-03-26 22:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b68131d5-3bb8-563a-a9f7-13cf7d85e87d
2026-03-26 22:50:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/7c3822146ad94785b54545990fae484b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252F59b7079d27a44c2cb416072264629b7a%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/59b7079d27a44c2cb416072264629b7a/images/large/4.jpg not downloaded yet
2026-03-26 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252F59b7079d27a44c2cb416072264629b7a%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/59b7079d27a44c2cb416072264629b7a/images/large/5.jpg not downloaded yet
2026-03-26 22:50:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/7c3822146ad94785b54545990fae484b/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7744fd0>
2026-03-26 22:50:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b68131d5-3bb8-563a-a9f7-13cf7d85e87d/b68131d5-3bb8-563a-a9f7-13cf7d85e87d_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F7c3822146ad94785b54545990fae484b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/7c3822146ad94785b54545990fae484b/images/large/5.jpg saved to cache
2026-03-26 22:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b68131d5-3bb8-563a-a9f7-13cf7d85e87d
2026-03-26 22:50:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7a62d10>
2026-03-26 22:50:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b68131d5-3bb8-563a-a9f7-13cf7d85e87d/b68131d5-3bb8-563a-a9f7-13cf7d85e87d_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F7c3822146ad94785b54545990fae484b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/7c3822146ad94785b54545990fae484b/images/large/4.jpg saved to cache
2026-03-26 22:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b68131d5-3bb8-563a-a9f7-13cf7d85e87d
2026-03-26 22:50:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/7c3822146ad94785b54545990fae484b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252F59b7079d27a44c2cb416072264629b7a%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/59b7079d27a44c2cb416072264629b7a/images/large/6.jpg not downloaded yet
2026-03-26 22:50:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/7c3822146ad94785b54545990fae484b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252F59b7079d27a44c2cb416072264629b7a%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/59b7079d27a44c2cb416072264629b7a/images/large/7.jpg not downloaded yet
2026-03-26 22:50:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/7c3822146ad94785b54545990fae484b/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cbcb50>
2026-03-26 22:50:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b68131d5-3bb8-563a-a9f7-13cf7d85e87d/b68131d5-3bb8-563a-a9f7-13cf7d85e87d_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F7c3822146ad94785b54545990fae484b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/7c3822146ad94785b54545990fae484b/images/large/6.jpg saved to cache
2026-03-26 22:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b68131d5-3bb8-563a-a9f7-13cf7d85e87d
2026-03-26 22:50:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7439ad0>
2026-03-26 22:50:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b68131d5-3bb8-563a-a9f7-13cf7d85e87d/b68131d5-3bb8-563a-a9f7-13cf7d85e87d_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F7c3822146ad94785b54545990fae484b%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/7c3822146ad94785b54545990fae484b/images/large/9.jpg saved to cache
2026-03-26 22:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b68131d5-3bb8-563a-a9f7-13cf7d85e87d
2026-03-26 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252F59b7079d27a44c2cb416072264629b7a%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/59b7079d27a44c2cb416072264629b7a/images/large/8.jpg not downloaded yet
2026-03-26 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252F59b7079d27a44c2cb416072264629b7a%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/59b7079d27a44c2cb416072264629b7a/images/large/9.jpg not downloaded yet
2026-03-26 22:50:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76a6cd0>
2026-03-26 22:50:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b68131d5-3bb8-563a-a9f7-13cf7d85e87d/b68131d5-3bb8-563a-a9f7-13cf7d85e87d_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F7c3822146ad94785b54545990fae484b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/7c3822146ad94785b54545990fae484b/images/large/7.jpg saved to cache
2026-03-26 22:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b68131d5-3bb8-563a-a9f7-13cf7d85e87d
2026-03-26 22:50:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7ae9d10>
2026-03-26 22:50:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b68131d5-3bb8-563a-a9f7-13cf7d85e87d/b68131d5-3bb8-563a-a9f7-13cf7d85e87d_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F7c3822146ad94785b54545990fae484b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/7c3822146ad94785b54545990fae484b/images/large/8.jpg saved to cache
2026-03-26 22:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b68131d5-3bb8-563a-a9f7-13cf7d85e87d
2026-03-26 22:50:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b745b810>
2026-03-26 22:50:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b68131d5-3bb8-563a-a9f7-13cf7d85e87d/b68131d5-3bb8-563a-a9f7-13cf7d85e87d_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F7c3822146ad94785b54545990fae484b%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/7c3822146ad94785b54545990fae484b/images/large/10.jpg saved to cache
2026-03-26 22:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b68131d5-3bb8-563a-a9f7-13cf7d85e87d
2026-03-26 22:50:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b68131d5-3bb8-563a-a9f7-13cf7d85e87d, skipping ID generation
2026-03-26 22:50:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b68131d5-3bb8-563a-a9f7-13cf7d85e87d with scrape type 1
2026-03-26 22:50:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b68131d5-3bb8-563a-a9f7-13cf7d85e87d sending to next pipeline
2026-03-26 22:50:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b68131d5-3bb8-563a-a9f7-13cf7d85e87d, identifier: 1985397
2026-03-26 22:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252F59b7079d27a44c2cb416072264629b7a%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/59b7079d27a44c2cb416072264629b7a/images/large/10.jpg not downloaded yet
2026-03-26 22:50:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b68131d5-3bb8-563a-a9f7-13cf7d85e87d with identifier: 1985397
2026-03-26 22:50:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b68131d5-3bb8-563a-a9f7-13cf7d85e87d with identifier: 1985397
2026-03-26 22:50:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b68131d5-3bb8-563a-a9f7-13cf7d85e87d with identifier: 1985397 to the API
2026-03-26 22:50:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:50:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:50:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yr/7c3822146ad94785b54545990fae484b/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.3L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'b68131d5-3bb8-563a-a9f7-13cf7d85e87d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A-CLASS LIMOUSINE',
 'odometer': 173866,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b68131d5-3bb8-563a-a9f7-13cf7d85e87d/b68131d5-3bb8-563a-a9f7-13cf7d85e87d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 577721,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/7c3822146ad94785b54545990fae484b/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b68131d5-3bb8-563a-a9f7-13cf7d85e87d/b68131d5-3bb8-563a-a9f7-13cf7d85e87d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 589695,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/7c3822146ad94785b54545990fae484b/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b68131d5-3bb8-563a-a9f7-13cf7d85e87d/b68131d5-3bb8-563a-a9f7-13cf7d85e87d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 497069,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/7c3822146ad94785b54545990fae484b/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b68131d5-3bb8-563a-a9f7-13cf7d85e87d/b68131d5-3bb8-563a-a9f7-13cf7d85e87d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 647672,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/7c3822146ad94785b54545990fae484b/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b68131d5-3bb8-563a-a9f7-13cf7d85e87d/b68131d5-3bb8-563a-a9f7-13cf7d85e87d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 570773,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/7c3822146ad94785b54545990fae484b/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b68131d5-3bb8-563a-a9f7-13cf7d85e87d/b68131d5-3bb8-563a-a9f7-13cf7d85e87d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 633196,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/7c3822146ad94785b54545990fae484b/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b68131d5-3bb8-563a-a9f7-13cf7d85e87d/b68131d5-3bb8-563a-a9f7-13cf7d85e87d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 618737,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/7c3822146ad94785b54545990fae484b/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b68131d5-3bb8-563a-a9f7-13cf7d85e87d/b68131d5-3bb8-563a-a9f7-13cf7d85e87d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 652618,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/7c3822146ad94785b54545990fae484b/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b68131d5-3bb8-563a-a9f7-13cf7d85e87d/b68131d5-3bb8-563a-a9f7-13cf7d85e87d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 438160,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/7c3822146ad94785b54545990fae484b/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b68131d5-3bb8-563a-a9f7-13cf7d85e87d/b68131d5-3bb8-563a-a9f7-13cf7d85e87d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 522155,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/7c3822146ad94785b54545990fae484b/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ A-CLASS LIMOUSINE 1.3 A 250 E BUSINESS SOLUTION DCT',
 'transmission': 'automatic',
 'trim': '1.3 A 250 E BUSINESS SOLUTION DCT',
 'vin': None,
 'year': 2020}
2026-03-26 22:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985397%27 HTTP/1.1" 200 None
2026-03-26 22:50:33 [ayvens.be] INFO: Saving data for 1985397: {'created_time': 1774565433.685434, 'last_price_update_time': 1774565433.685443, 'auction_closing_time': 1774958400.0}
2026-03-26 22:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985397') HTTP/1.1" 204 0
2026-03-26 22:50:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cn/59b7079d27a44c2cb416072264629b7a/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cn/59b7079d27a44c2cb416072264629b7a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:33 [ayvens.be] INFO: Found listing with ID: 1985399
2026-03-26 22:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985399%27 HTTP/1.1" 200 None
2026-03-26 22:50:33 [ayvens.be] INFO: Scrape type for 1985399: 1
2026-03-26 22:50:33 [ayvens.be] INFO: Extracting data for car ID: 1985399
2026-03-26 22:50:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 01115e5d-60ff-5dfb-bc55-79d8d479682e with identifier: 1985399
2026-03-26 22:50:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01115e5d-60ff-5dfb-bc55-79d8d479682e with scrape type 1
2026-03-26 22:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 01115e5d-60ff-5dfb-bc55-79d8d479682e
2026-03-26 22:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Fa4e118bb82fd40f284596e4a6995dab3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/a4e118bb82fd40f284596e4a6995dab3/images/large/1.jpg not downloaded yet
2026-03-26 22:50:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cn/59b7079d27a44c2cb416072264629b7a/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cn/59b7079d27a44c2cb416072264629b7a/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Fa4e118bb82fd40f284596e4a6995dab3%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/a4e118bb82fd40f284596e4a6995dab3/images/large/2.jpg not downloaded yet
2026-03-26 22:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Fa4e118bb82fd40f284596e4a6995dab3%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/a4e118bb82fd40f284596e4a6995dab3/images/large/3.jpg not downloaded yet
2026-03-26 22:50:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cn/59b7079d27a44c2cb416072264629b7a/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cn/59b7079d27a44c2cb416072264629b7a/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Fa4e118bb82fd40f284596e4a6995dab3%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/a4e118bb82fd40f284596e4a6995dab3/images/large/4.jpg not downloaded yet
2026-03-26 22:50:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cn/59b7079d27a44c2cb416072264629b7a/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Fa4e118bb82fd40f284596e4a6995dab3%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/a4e118bb82fd40f284596e4a6995dab3/images/large/5.jpg not downloaded yet
2026-03-26 22:50:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cn/59b7079d27a44c2cb416072264629b7a/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7cab2d0>
2026-03-26 22:50:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c226416-0ac9-5e76-b8df-1e2ae4911fb1/3c226416-0ac9-5e76-b8df-1e2ae4911fb1_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252F59b7079d27a44c2cb416072264629b7a%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/59b7079d27a44c2cb416072264629b7a/images/large/2.jpg saved to cache
2026-03-26 22:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3c226416-0ac9-5e76-b8df-1e2ae4911fb1
2026-03-26 22:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Fa4e118bb82fd40f284596e4a6995dab3%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/a4e118bb82fd40f284596e4a6995dab3/images/large/6.jpg not downloaded yet
2026-03-26 22:50:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7ccdfd0>
2026-03-26 22:50:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c226416-0ac9-5e76-b8df-1e2ae4911fb1/3c226416-0ac9-5e76-b8df-1e2ae4911fb1_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252F59b7079d27a44c2cb416072264629b7a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/59b7079d27a44c2cb416072264629b7a/images/large/1.jpg saved to cache
2026-03-26 22:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3c226416-0ac9-5e76-b8df-1e2ae4911fb1
2026-03-26 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Fa4e118bb82fd40f284596e4a6995dab3%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/a4e118bb82fd40f284596e4a6995dab3/images/large/7.jpg not downloaded yet
2026-03-26 22:50:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b728dcd0>
2026-03-26 22:50:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c226416-0ac9-5e76-b8df-1e2ae4911fb1/3c226416-0ac9-5e76-b8df-1e2ae4911fb1_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252F59b7079d27a44c2cb416072264629b7a%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/59b7079d27a44c2cb416072264629b7a/images/large/3.jpg saved to cache
2026-03-26 22:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3c226416-0ac9-5e76-b8df-1e2ae4911fb1
2026-03-26 22:50:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77d5010>
2026-03-26 22:50:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c226416-0ac9-5e76-b8df-1e2ae4911fb1/3c226416-0ac9-5e76-b8df-1e2ae4911fb1_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252F59b7079d27a44c2cb416072264629b7a%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/59b7079d27a44c2cb416072264629b7a/images/large/5.jpg saved to cache
2026-03-26 22:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3c226416-0ac9-5e76-b8df-1e2ae4911fb1
2026-03-26 22:50:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7489350>
2026-03-26 22:50:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c226416-0ac9-5e76-b8df-1e2ae4911fb1/3c226416-0ac9-5e76-b8df-1e2ae4911fb1_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252F59b7079d27a44c2cb416072264629b7a%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/59b7079d27a44c2cb416072264629b7a/images/large/4.jpg saved to cache
2026-03-26 22:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3c226416-0ac9-5e76-b8df-1e2ae4911fb1
2026-03-26 22:50:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b17a50>
2026-03-26 22:50:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c226416-0ac9-5e76-b8df-1e2ae4911fb1/3c226416-0ac9-5e76-b8df-1e2ae4911fb1_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252F59b7079d27a44c2cb416072264629b7a%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/59b7079d27a44c2cb416072264629b7a/images/large/6.jpg saved to cache
2026-03-26 22:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3c226416-0ac9-5e76-b8df-1e2ae4911fb1
2026-03-26 22:50:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77d5390>
2026-03-26 22:50:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c226416-0ac9-5e76-b8df-1e2ae4911fb1/3c226416-0ac9-5e76-b8df-1e2ae4911fb1_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252F59b7079d27a44c2cb416072264629b7a%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/59b7079d27a44c2cb416072264629b7a/images/large/7.jpg saved to cache
2026-03-26 22:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3c226416-0ac9-5e76-b8df-1e2ae4911fb1
2026-03-26 22:50:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74bcd90>
2026-03-26 22:50:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c226416-0ac9-5e76-b8df-1e2ae4911fb1/3c226416-0ac9-5e76-b8df-1e2ae4911fb1_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252F59b7079d27a44c2cb416072264629b7a%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/59b7079d27a44c2cb416072264629b7a/images/large/8.jpg saved to cache
2026-03-26 22:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3c226416-0ac9-5e76-b8df-1e2ae4911fb1
2026-03-26 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Fa4e118bb82fd40f284596e4a6995dab3%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/a4e118bb82fd40f284596e4a6995dab3/images/large/8.jpg not downloaded yet
2026-03-26 22:50:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cn/59b7079d27a44c2cb416072264629b7a/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Fa4e118bb82fd40f284596e4a6995dab3%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/a4e118bb82fd40f284596e4a6995dab3/images/large/9.jpg not downloaded yet
2026-03-26 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Fa4e118bb82fd40f284596e4a6995dab3%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/a4e118bb82fd40f284596e4a6995dab3/images/large/10.jpg not downloaded yet
2026-03-26 22:50:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/a4e118bb82fd40f284596e4a6995dab3/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cn/59b7079d27a44c2cb416072264629b7a/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/a4e118bb82fd40f284596e4a6995dab3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:34 [ayvens.be] INFO: Found listing with ID: 1985400
2026-03-26 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985400%27 HTTP/1.1" 200 None
2026-03-26 22:50:34 [ayvens.be] INFO: Scrape type for 1985400: 1
2026-03-26 22:50:34 [ayvens.be] INFO: Extracting data for car ID: 1985400
2026-03-26 22:50:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 06d66e48-2f7e-53b5-a957-8c3f93250b6e with identifier: 1985400
2026-03-26 22:50:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 06d66e48-2f7e-53b5-a957-8c3f93250b6e with scrape type 1
2026-03-26 22:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 06d66e48-2f7e-53b5-a957-8c3f93250b6e
2026-03-26 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dx%252F70cfe90370d741f5871709a157d925e3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dx/70cfe90370d741f5871709a157d925e3/images/large/1.jpg not downloaded yet
2026-03-26 22:50:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/a4e118bb82fd40f284596e4a6995dab3/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dx%252F70cfe90370d741f5871709a157d925e3%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dx/70cfe90370d741f5871709a157d925e3/images/large/2.jpg not downloaded yet
2026-03-26 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dx%252F70cfe90370d741f5871709a157d925e3%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dx/70cfe90370d741f5871709a157d925e3/images/large/3.jpg not downloaded yet
2026-03-26 22:50:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/a4e118bb82fd40f284596e4a6995dab3/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7a55650>
2026-03-26 22:50:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c226416-0ac9-5e76-b8df-1e2ae4911fb1/3c226416-0ac9-5e76-b8df-1e2ae4911fb1_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252F59b7079d27a44c2cb416072264629b7a%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/59b7079d27a44c2cb416072264629b7a/images/large/10.jpg saved to cache
2026-03-26 22:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3c226416-0ac9-5e76-b8df-1e2ae4911fb1
2026-03-26 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dx%252F70cfe90370d741f5871709a157d925e3%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dx/70cfe90370d741f5871709a157d925e3/images/large/4.jpg not downloaded yet
2026-03-26 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dx%252F70cfe90370d741f5871709a157d925e3%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dx/70cfe90370d741f5871709a157d925e3/images/large/5.jpg not downloaded yet
2026-03-26 22:50:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7414fd0>
2026-03-26 22:50:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01115e5d-60ff-5dfb-bc55-79d8d479682e/01115e5d-60ff-5dfb-bc55-79d8d479682e_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Fa4e118bb82fd40f284596e4a6995dab3%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/a4e118bb82fd40f284596e4a6995dab3/images/large/2.jpg saved to cache
2026-03-26 22:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 01115e5d-60ff-5dfb-bc55-79d8d479682e
2026-03-26 22:50:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6df2610>
2026-03-26 22:50:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c226416-0ac9-5e76-b8df-1e2ae4911fb1/3c226416-0ac9-5e76-b8df-1e2ae4911fb1_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252F59b7079d27a44c2cb416072264629b7a%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/59b7079d27a44c2cb416072264629b7a/images/large/9.jpg saved to cache
2026-03-26 22:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3c226416-0ac9-5e76-b8df-1e2ae4911fb1
2026-03-26 22:50:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3c226416-0ac9-5e76-b8df-1e2ae4911fb1, skipping ID generation
2026-03-26 22:50:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c226416-0ac9-5e76-b8df-1e2ae4911fb1 with scrape type 1
2026-03-26 22:50:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3c226416-0ac9-5e76-b8df-1e2ae4911fb1 sending to next pipeline
2026-03-26 22:50:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 3c226416-0ac9-5e76-b8df-1e2ae4911fb1, identifier: 1985398
2026-03-26 22:50:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b72cb2d0>
2026-03-26 22:50:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01115e5d-60ff-5dfb-bc55-79d8d479682e/01115e5d-60ff-5dfb-bc55-79d8d479682e_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Fa4e118bb82fd40f284596e4a6995dab3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/a4e118bb82fd40f284596e4a6995dab3/images/large/1.jpg saved to cache
2026-03-26 22:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 01115e5d-60ff-5dfb-bc55-79d8d479682e
2026-03-26 22:50:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76ee550>
2026-03-26 22:50:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01115e5d-60ff-5dfb-bc55-79d8d479682e/01115e5d-60ff-5dfb-bc55-79d8d479682e_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Fa4e118bb82fd40f284596e4a6995dab3%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/a4e118bb82fd40f284596e4a6995dab3/images/large/3.jpg saved to cache
2026-03-26 22:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 01115e5d-60ff-5dfb-bc55-79d8d479682e
2026-03-26 22:50:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/a4e118bb82fd40f284596e4a6995dab3/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 3c226416-0ac9-5e76-b8df-1e2ae4911fb1 with identifier: 1985398
2026-03-26 22:50:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 3c226416-0ac9-5e76-b8df-1e2ae4911fb1 with identifier: 1985398
2026-03-26 22:50:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 3c226416-0ac9-5e76-b8df-1e2ae4911fb1 with identifier: 1985398 to the API
2026-03-26 22:50:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:50:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:50:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cn/59b7079d27a44c2cb416072264629b7a/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '3c226416-0ac9-5e76-b8df-1e2ae4911fb1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X2',
 'odometer': 31143,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c226416-0ac9-5e76-b8df-1e2ae4911fb1/3c226416-0ac9-5e76-b8df-1e2ae4911fb1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 652208,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cn/59b7079d27a44c2cb416072264629b7a/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c226416-0ac9-5e76-b8df-1e2ae4911fb1/3c226416-0ac9-5e76-b8df-1e2ae4911fb1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 639820,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cn/59b7079d27a44c2cb416072264629b7a/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c226416-0ac9-5e76-b8df-1e2ae4911fb1/3c226416-0ac9-5e76-b8df-1e2ae4911fb1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 658941,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cn/59b7079d27a44c2cb416072264629b7a/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c226416-0ac9-5e76-b8df-1e2ae4911fb1/3c226416-0ac9-5e76-b8df-1e2ae4911fb1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 670871,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cn/59b7079d27a44c2cb416072264629b7a/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c226416-0ac9-5e76-b8df-1e2ae4911fb1/3c226416-0ac9-5e76-b8df-1e2ae4911fb1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 516129,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cn/59b7079d27a44c2cb416072264629b7a/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c226416-0ac9-5e76-b8df-1e2ae4911fb1/3c226416-0ac9-5e76-b8df-1e2ae4911fb1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 564832,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cn/59b7079d27a44c2cb416072264629b7a/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c226416-0ac9-5e76-b8df-1e2ae4911fb1/3c226416-0ac9-5e76-b8df-1e2ae4911fb1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 640413,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cn/59b7079d27a44c2cb416072264629b7a/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c226416-0ac9-5e76-b8df-1e2ae4911fb1/3c226416-0ac9-5e76-b8df-1e2ae4911fb1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 638369,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cn/59b7079d27a44c2cb416072264629b7a/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c226416-0ac9-5e76-b8df-1e2ae4911fb1/3c226416-0ac9-5e76-b8df-1e2ae4911fb1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 604305,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cn/59b7079d27a44c2cb416072264629b7a/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c226416-0ac9-5e76-b8df-1e2ae4911fb1/3c226416-0ac9-5e76-b8df-1e2ae4911fb1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 509560,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cn/59b7079d27a44c2cb416072264629b7a/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X2 1.5 XDRIVE25E PHEV 162KW)',
 'transmission': 'automatic',
 'trim': '1.5 XDRIVE25E PHEV 162KW)',
 'vin': None,
 'year': 2022}
2026-03-26 22:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985398%27 HTTP/1.1" 200 None
2026-03-26 22:50:35 [ayvens.be] INFO: Saving data for 1985398: {'created_time': 1774565435.621763, 'last_price_update_time': 1774565435.621772, 'auction_closing_time': 1774958400.0}
2026-03-26 22:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985398') HTTP/1.1" 204 0
2026-03-26 22:50:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dx/70cfe90370d741f5871709a157d925e3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dx%252F70cfe90370d741f5871709a157d925e3%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dx/70cfe90370d741f5871709a157d925e3/images/large/6.jpg not downloaded yet
2026-03-26 22:50:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6df2610>
2026-03-26 22:50:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01115e5d-60ff-5dfb-bc55-79d8d479682e/01115e5d-60ff-5dfb-bc55-79d8d479682e_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Fa4e118bb82fd40f284596e4a6995dab3%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/a4e118bb82fd40f284596e4a6995dab3/images/large/4.jpg saved to cache
2026-03-26 22:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 01115e5d-60ff-5dfb-bc55-79d8d479682e
2026-03-26 22:50:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/a4e118bb82fd40f284596e4a6995dab3/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/a4e118bb82fd40f284596e4a6995dab3/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dx%252F70cfe90370d741f5871709a157d925e3%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dx/70cfe90370d741f5871709a157d925e3/images/large/7.jpg not downloaded yet
2026-03-26 22:50:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/a4e118bb82fd40f284596e4a6995dab3/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dx/70cfe90370d741f5871709a157d925e3/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7726690>
2026-03-26 22:50:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01115e5d-60ff-5dfb-bc55-79d8d479682e/01115e5d-60ff-5dfb-bc55-79d8d479682e_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Fa4e118bb82fd40f284596e4a6995dab3%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/a4e118bb82fd40f284596e4a6995dab3/images/large/5.jpg saved to cache
2026-03-26 22:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 01115e5d-60ff-5dfb-bc55-79d8d479682e
2026-03-26 22:50:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b792fc10>
2026-03-26 22:50:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06d66e48-2f7e-53b5-a957-8c3f93250b6e/06d66e48-2f7e-53b5-a957-8c3f93250b6e_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dx%252F70cfe90370d741f5871709a157d925e3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dx/70cfe90370d741f5871709a157d925e3/images/large/1.jpg saved to cache
2026-03-26 22:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 06d66e48-2f7e-53b5-a957-8c3f93250b6e
2026-03-26 22:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dx%252F70cfe90370d741f5871709a157d925e3%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dx/70cfe90370d741f5871709a157d925e3/images/large/8.jpg not downloaded yet
2026-03-26 22:50:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/a4e118bb82fd40f284596e4a6995dab3/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dx%252F70cfe90370d741f5871709a157d925e3%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dx/70cfe90370d741f5871709a157d925e3/images/large/9.jpg not downloaded yet
2026-03-26 22:50:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7aea210>
2026-03-26 22:50:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01115e5d-60ff-5dfb-bc55-79d8d479682e/01115e5d-60ff-5dfb-bc55-79d8d479682e_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Fa4e118bb82fd40f284596e4a6995dab3%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/a4e118bb82fd40f284596e4a6995dab3/images/large/6.jpg saved to cache
2026-03-26 22:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 01115e5d-60ff-5dfb-bc55-79d8d479682e
2026-03-26 22:50:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b787d8d0>
2026-03-26 22:50:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01115e5d-60ff-5dfb-bc55-79d8d479682e/01115e5d-60ff-5dfb-bc55-79d8d479682e_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Fa4e118bb82fd40f284596e4a6995dab3%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/a4e118bb82fd40f284596e4a6995dab3/images/large/7.jpg saved to cache
2026-03-26 22:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 01115e5d-60ff-5dfb-bc55-79d8d479682e
2026-03-26 22:50:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7772f50>
2026-03-26 22:50:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01115e5d-60ff-5dfb-bc55-79d8d479682e/01115e5d-60ff-5dfb-bc55-79d8d479682e_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Fa4e118bb82fd40f284596e4a6995dab3%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/a4e118bb82fd40f284596e4a6995dab3/images/large/8.jpg saved to cache
2026-03-26 22:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 01115e5d-60ff-5dfb-bc55-79d8d479682e
2026-03-26 22:50:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7584c90>
2026-03-26 22:50:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06d66e48-2f7e-53b5-a957-8c3f93250b6e/06d66e48-2f7e-53b5-a957-8c3f93250b6e_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dx%252F70cfe90370d741f5871709a157d925e3%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dx/70cfe90370d741f5871709a157d925e3/images/large/2.jpg saved to cache
2026-03-26 22:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 06d66e48-2f7e-53b5-a957-8c3f93250b6e
2026-03-26 22:50:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/a4e118bb82fd40f284596e4a6995dab3/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dx/70cfe90370d741f5871709a157d925e3/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dx%252F70cfe90370d741f5871709a157d925e3%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dx/70cfe90370d741f5871709a157d925e3/images/large/10.jpg not downloaded yet
2026-03-26 22:50:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dx/70cfe90370d741f5871709a157d925e3/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dx/70cfe90370d741f5871709a157d925e3/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e479d0>
2026-03-26 22:50:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01115e5d-60ff-5dfb-bc55-79d8d479682e/01115e5d-60ff-5dfb-bc55-79d8d479682e_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Fa4e118bb82fd40f284596e4a6995dab3%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/a4e118bb82fd40f284596e4a6995dab3/images/large/9.jpg saved to cache
2026-03-26 22:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 01115e5d-60ff-5dfb-bc55-79d8d479682e
2026-03-26 22:50:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dx/70cfe90370d741f5871709a157d925e3/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:36 [ayvens.be] INFO: Found listing with ID: 1985401
2026-03-26 22:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985401%27 HTTP/1.1" 200 None
2026-03-26 22:50:36 [ayvens.be] INFO: Scrape type for 1985401: 1
2026-03-26 22:50:36 [ayvens.be] INFO: Extracting data for car ID: 1985401
2026-03-26 22:50:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d532fdcb-13d5-5c50-9730-da86ec6cb242 with identifier: 1985401
2026-03-26 22:50:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d532fdcb-13d5-5c50-9730-da86ec6cb242 with scrape type 1
2026-03-26 22:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d532fdcb-13d5-5c50-9730-da86ec6cb242
2026-03-26 22:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F48a89d7b107a4ffabbba0d420d1b8e2e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/48a89d7b107a4ffabbba0d420d1b8e2e/images/large/1.jpg not downloaded yet
2026-03-26 22:50:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dx/70cfe90370d741f5871709a157d925e3/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F48a89d7b107a4ffabbba0d420d1b8e2e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/48a89d7b107a4ffabbba0d420d1b8e2e/images/large/2.jpg not downloaded yet
2026-03-26 22:50:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7427710>
2026-03-26 22:50:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01115e5d-60ff-5dfb-bc55-79d8d479682e/01115e5d-60ff-5dfb-bc55-79d8d479682e_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Fa4e118bb82fd40f284596e4a6995dab3%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/a4e118bb82fd40f284596e4a6995dab3/images/large/10.jpg saved to cache
2026-03-26 22:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 01115e5d-60ff-5dfb-bc55-79d8d479682e
2026-03-26 22:50:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 01115e5d-60ff-5dfb-bc55-79d8d479682e, skipping ID generation
2026-03-26 22:50:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01115e5d-60ff-5dfb-bc55-79d8d479682e with scrape type 1
2026-03-26 22:50:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 01115e5d-60ff-5dfb-bc55-79d8d479682e sending to next pipeline
2026-03-26 22:50:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 01115e5d-60ff-5dfb-bc55-79d8d479682e, identifier: 1985399
2026-03-26 22:50:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b78c2510>
2026-03-26 22:50:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06d66e48-2f7e-53b5-a957-8c3f93250b6e/06d66e48-2f7e-53b5-a957-8c3f93250b6e_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dx%252F70cfe90370d741f5871709a157d925e3%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dx/70cfe90370d741f5871709a157d925e3/images/large/3.jpg saved to cache
2026-03-26 22:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 06d66e48-2f7e-53b5-a957-8c3f93250b6e
2026-03-26 22:50:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 01115e5d-60ff-5dfb-bc55-79d8d479682e with identifier: 1985399
2026-03-26 22:50:36 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 22:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 22:50:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 01115e5d-60ff-5dfb-bc55-79d8d479682e with identifier: 1985399
2026-03-26 22:50:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 01115e5d-60ff-5dfb-bc55-79d8d479682e with identifier: 1985399 to the API
2026-03-26 22:50:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:50:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:50:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2au/a4e118bb82fd40f284596e4a6995dab3/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 36,
 'color': 'CAVANSITE BLUE METALLIC',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '01115e5d-60ff-5dfb-bc55-79d8d479682e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'E-CLASS BREAK',
 'odometer': 215432,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01115e5d-60ff-5dfb-bc55-79d8d479682e/01115e5d-60ff-5dfb-bc55-79d8d479682e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 634548,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/a4e118bb82fd40f284596e4a6995dab3/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01115e5d-60ff-5dfb-bc55-79d8d479682e/01115e5d-60ff-5dfb-bc55-79d8d479682e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 647747,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/a4e118bb82fd40f284596e4a6995dab3/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01115e5d-60ff-5dfb-bc55-79d8d479682e/01115e5d-60ff-5dfb-bc55-79d8d479682e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 650710,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/a4e118bb82fd40f284596e4a6995dab3/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01115e5d-60ff-5dfb-bc55-79d8d479682e/01115e5d-60ff-5dfb-bc55-79d8d479682e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 711944,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/a4e118bb82fd40f284596e4a6995dab3/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01115e5d-60ff-5dfb-bc55-79d8d479682e/01115e5d-60ff-5dfb-bc55-79d8d479682e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 638717,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/a4e118bb82fd40f284596e4a6995dab3/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01115e5d-60ff-5dfb-bc55-79d8d479682e/01115e5d-60ff-5dfb-bc55-79d8d479682e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 614259,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/a4e118bb82fd40f284596e4a6995dab3/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01115e5d-60ff-5dfb-bc55-79d8d479682e/01115e5d-60ff-5dfb-bc55-79d8d479682e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 671548,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/a4e118bb82fd40f284596e4a6995dab3/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01115e5d-60ff-5dfb-bc55-79d8d479682e/01115e5d-60ff-5dfb-bc55-79d8d479682e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 675403,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/a4e118bb82fd40f284596e4a6995dab3/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01115e5d-60ff-5dfb-bc55-79d8d479682e/01115e5d-60ff-5dfb-bc55-79d8d479682e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 591129,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/a4e118bb82fd40f284596e4a6995dab3/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01115e5d-60ff-5dfb-bc55-79d8d479682e/01115e5d-60ff-5dfb-bc55-79d8d479682e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 672468,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/a4e118bb82fd40f284596e4a6995dab3/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ E-CLASS BREAK 2.0 E 300 DE AUTO',
 'transmission': 'automatic',
 'trim': '2.0 E 300 DE AUTO',
 'vin': None,
 'year': 2021}
2026-03-26 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985399%27 HTTP/1.1" 200 None
2026-03-26 22:50:37 [ayvens.be] INFO: Saving data for 1985399: {'created_time': 1774565437.169248, 'last_price_update_time': 1774565437.169257, 'auction_closing_time': 1774958400.0}
2026-03-26 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985399') HTTP/1.1" 204 0
2026-03-26 22:50:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b787ec50>
2026-03-26 22:50:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06d66e48-2f7e-53b5-a957-8c3f93250b6e/06d66e48-2f7e-53b5-a957-8c3f93250b6e_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dx%252F70cfe90370d741f5871709a157d925e3%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dx/70cfe90370d741f5871709a157d925e3/images/large/5.jpg saved to cache
2026-03-26 22:50:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 06d66e48-2f7e-53b5-a957-8c3f93250b6e
2026-03-26 22:50:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7727590>
2026-03-26 22:50:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06d66e48-2f7e-53b5-a957-8c3f93250b6e/06d66e48-2f7e-53b5-a957-8c3f93250b6e_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dx%252F70cfe90370d741f5871709a157d925e3%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dx/70cfe90370d741f5871709a157d925e3/images/large/4.jpg saved to cache
2026-03-26 22:50:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 06d66e48-2f7e-53b5-a957-8c3f93250b6e
2026-03-26 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F48a89d7b107a4ffabbba0d420d1b8e2e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/48a89d7b107a4ffabbba0d420d1b8e2e/images/large/3.jpg not downloaded yet
2026-03-26 22:50:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6defa50>
2026-03-26 22:50:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06d66e48-2f7e-53b5-a957-8c3f93250b6e/06d66e48-2f7e-53b5-a957-8c3f93250b6e_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dx%252F70cfe90370d741f5871709a157d925e3%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dx/70cfe90370d741f5871709a157d925e3/images/large/6.jpg saved to cache
2026-03-26 22:50:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 06d66e48-2f7e-53b5-a957-8c3f93250b6e
2026-03-26 22:50:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e2b4d0>
2026-03-26 22:50:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06d66e48-2f7e-53b5-a957-8c3f93250b6e/06d66e48-2f7e-53b5-a957-8c3f93250b6e_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dx%252F70cfe90370d741f5871709a157d925e3%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dx/70cfe90370d741f5871709a157d925e3/images/large/7.jpg saved to cache
2026-03-26 22:50:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 06d66e48-2f7e-53b5-a957-8c3f93250b6e
2026-03-26 22:50:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dx/70cfe90370d741f5871709a157d925e3/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F48a89d7b107a4ffabbba0d420d1b8e2e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/48a89d7b107a4ffabbba0d420d1b8e2e/images/large/4.jpg not downloaded yet
2026-03-26 22:50:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dx/70cfe90370d741f5871709a157d925e3/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dx/70cfe90370d741f5871709a157d925e3/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F48a89d7b107a4ffabbba0d420d1b8e2e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/48a89d7b107a4ffabbba0d420d1b8e2e/images/large/5.jpg not downloaded yet
2026-03-26 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F48a89d7b107a4ffabbba0d420d1b8e2e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/48a89d7b107a4ffabbba0d420d1b8e2e/images/large/6.jpg not downloaded yet
2026-03-26 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F48a89d7b107a4ffabbba0d420d1b8e2e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/48a89d7b107a4ffabbba0d420d1b8e2e/images/large/7.jpg not downloaded yet
2026-03-26 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F48a89d7b107a4ffabbba0d420d1b8e2e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/48a89d7b107a4ffabbba0d420d1b8e2e/images/large/8.jpg not downloaded yet
2026-03-26 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F48a89d7b107a4ffabbba0d420d1b8e2e%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/48a89d7b107a4ffabbba0d420d1b8e2e/images/large/9.jpg not downloaded yet
2026-03-26 22:50:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/48a89d7b107a4ffabbba0d420d1b8e2e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b78c2950>
2026-03-26 22:50:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06d66e48-2f7e-53b5-a957-8c3f93250b6e/06d66e48-2f7e-53b5-a957-8c3f93250b6e_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dx%252F70cfe90370d741f5871709a157d925e3%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dx/70cfe90370d741f5871709a157d925e3/images/large/8.jpg saved to cache
2026-03-26 22:50:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 06d66e48-2f7e-53b5-a957-8c3f93250b6e
2026-03-26 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F48a89d7b107a4ffabbba0d420d1b8e2e%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/48a89d7b107a4ffabbba0d420d1b8e2e/images/large/10.jpg not downloaded yet
2026-03-26 22:50:37 [ayvens.be] INFO: Found listing with ID: 1985402
2026-03-26 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985402%27 HTTP/1.1" 200 None
2026-03-26 22:50:37 [ayvens.be] INFO: Scrape type for 1985402: 1
2026-03-26 22:50:37 [ayvens.be] INFO: Extracting data for car ID: 1985402
2026-03-26 22:50:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0cccef83-c8e9-5e43-a466-86f3038f3493 with identifier: 1985402
2026-03-26 22:50:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0cccef83-c8e9-5e43-a466-86f3038f3493 with scrape type 1
2026-03-26 22:50:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0cccef83-c8e9-5e43-a466-86f3038f3493
2026-03-26 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fa1fdedb45072491b933939e06ffaee0b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/a1fdedb45072491b933939e06ffaee0b/images/large/1.jpg not downloaded yet
2026-03-26 22:50:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/48a89d7b107a4ffabbba0d420d1b8e2e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fa1fdedb45072491b933939e06ffaee0b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/a1fdedb45072491b933939e06ffaee0b/images/large/2.jpg not downloaded yet
2026-03-26 22:50:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5ca4e50>
2026-03-26 22:50:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06d66e48-2f7e-53b5-a957-8c3f93250b6e/06d66e48-2f7e-53b5-a957-8c3f93250b6e_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dx%252F70cfe90370d741f5871709a157d925e3%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dx/70cfe90370d741f5871709a157d925e3/images/large/10.jpg saved to cache
2026-03-26 22:50:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 06d66e48-2f7e-53b5-a957-8c3f93250b6e
2026-03-26 22:50:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77bcdd0>
2026-03-26 22:50:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06d66e48-2f7e-53b5-a957-8c3f93250b6e/06d66e48-2f7e-53b5-a957-8c3f93250b6e_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dx%252F70cfe90370d741f5871709a157d925e3%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dx/70cfe90370d741f5871709a157d925e3/images/large/9.jpg saved to cache
2026-03-26 22:50:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 06d66e48-2f7e-53b5-a957-8c3f93250b6e
2026-03-26 22:50:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 06d66e48-2f7e-53b5-a957-8c3f93250b6e, skipping ID generation
2026-03-26 22:50:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 06d66e48-2f7e-53b5-a957-8c3f93250b6e with scrape type 1
2026-03-26 22:50:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 06d66e48-2f7e-53b5-a957-8c3f93250b6e sending to next pipeline
2026-03-26 22:50:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 06d66e48-2f7e-53b5-a957-8c3f93250b6e, identifier: 1985400
2026-03-26 22:50:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cbdd50>
2026-03-26 22:50:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d532fdcb-13d5-5c50-9730-da86ec6cb242/d532fdcb-13d5-5c50-9730-da86ec6cb242_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F48a89d7b107a4ffabbba0d420d1b8e2e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/48a89d7b107a4ffabbba0d420d1b8e2e/images/large/1.jpg saved to cache
2026-03-26 22:50:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d532fdcb-13d5-5c50-9730-da86ec6cb242
2026-03-26 22:50:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 06d66e48-2f7e-53b5-a957-8c3f93250b6e with identifier: 1985400
2026-03-26 22:50:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 06d66e48-2f7e-53b5-a957-8c3f93250b6e with identifier: 1985400
2026-03-26 22:50:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 06d66e48-2f7e-53b5-a957-8c3f93250b6e with identifier: 1985400 to the API
2026-03-26 22:50:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:50:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:50:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2dx/70cfe90370d741f5871709a157d925e3/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 10835175,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '06d66e48-2f7e-53b5-a957-8c3f93250b6e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF VARIANT VIII',
 'odometer': 35175,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06d66e48-2f7e-53b5-a957-8c3f93250b6e/06d66e48-2f7e-53b5-a957-8c3f93250b6e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 251892,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dx/70cfe90370d741f5871709a157d925e3/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06d66e48-2f7e-53b5-a957-8c3f93250b6e/06d66e48-2f7e-53b5-a957-8c3f93250b6e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 249696,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dx/70cfe90370d741f5871709a157d925e3/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06d66e48-2f7e-53b5-a957-8c3f93250b6e/06d66e48-2f7e-53b5-a957-8c3f93250b6e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 260219,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dx/70cfe90370d741f5871709a157d925e3/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06d66e48-2f7e-53b5-a957-8c3f93250b6e/06d66e48-2f7e-53b5-a957-8c3f93250b6e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 280963,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dx/70cfe90370d741f5871709a157d925e3/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06d66e48-2f7e-53b5-a957-8c3f93250b6e/06d66e48-2f7e-53b5-a957-8c3f93250b6e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 282230,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dx/70cfe90370d741f5871709a157d925e3/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06d66e48-2f7e-53b5-a957-8c3f93250b6e/06d66e48-2f7e-53b5-a957-8c3f93250b6e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 257718,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dx/70cfe90370d741f5871709a157d925e3/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06d66e48-2f7e-53b5-a957-8c3f93250b6e/06d66e48-2f7e-53b5-a957-8c3f93250b6e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 276863,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dx/70cfe90370d741f5871709a157d925e3/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06d66e48-2f7e-53b5-a957-8c3f93250b6e/06d66e48-2f7e-53b5-a957-8c3f93250b6e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 350492,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dx/70cfe90370d741f5871709a157d925e3/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06d66e48-2f7e-53b5-a957-8c3f93250b6e/06d66e48-2f7e-53b5-a957-8c3f93250b6e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 318497,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dx/70cfe90370d741f5871709a157d925e3/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06d66e48-2f7e-53b5-a957-8c3f93250b6e/06d66e48-2f7e-53b5-a957-8c3f93250b6e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 308547,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dx/70cfe90370d741f5871709a157d925e3/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF VARIANT VIII 1.0 TSI 81KW LIFE BUSINESS',
 'transmission': 'manual',
 'trim': '1.0 TSI 81KW LIFE BUSINESS',
 'vin': None,
 'year': 2023}
2026-03-26 22:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985400%27 HTTP/1.1" 200 None
2026-03-26 22:50:38 [ayvens.be] INFO: Saving data for 1985400: {'created_time': 1774565438.523916, 'last_price_update_time': 1774565438.523927, 'auction_closing_time': 1774958400.0}
2026-03-26 22:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985400') HTTP/1.1" 204 0
2026-03-26 22:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fa1fdedb45072491b933939e06ffaee0b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/a1fdedb45072491b933939e06ffaee0b/images/large/3.jpg not downloaded yet
2026-03-26 22:50:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/48a89d7b107a4ffabbba0d420d1b8e2e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/48a89d7b107a4ffabbba0d420d1b8e2e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fa1fdedb45072491b933939e06ffaee0b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/a1fdedb45072491b933939e06ffaee0b/images/large/4.jpg not downloaded yet
2026-03-26 22:50:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/48a89d7b107a4ffabbba0d420d1b8e2e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7725290>
2026-03-26 22:50:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d532fdcb-13d5-5c50-9730-da86ec6cb242/d532fdcb-13d5-5c50-9730-da86ec6cb242_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F48a89d7b107a4ffabbba0d420d1b8e2e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/48a89d7b107a4ffabbba0d420d1b8e2e/images/large/2.jpg saved to cache
2026-03-26 22:50:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d532fdcb-13d5-5c50-9730-da86ec6cb242
2026-03-26 22:50:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/48a89d7b107a4ffabbba0d420d1b8e2e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/48a89d7b107a4ffabbba0d420d1b8e2e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fa1fdedb45072491b933939e06ffaee0b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/a1fdedb45072491b933939e06ffaee0b/images/large/5.jpg not downloaded yet
2026-03-26 22:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fa1fdedb45072491b933939e06ffaee0b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/a1fdedb45072491b933939e06ffaee0b/images/large/6.jpg not downloaded yet
2026-03-26 22:50:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e00b90>
2026-03-26 22:50:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d532fdcb-13d5-5c50-9730-da86ec6cb242/d532fdcb-13d5-5c50-9730-da86ec6cb242_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F48a89d7b107a4ffabbba0d420d1b8e2e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/48a89d7b107a4ffabbba0d420d1b8e2e/images/large/3.jpg saved to cache
2026-03-26 22:50:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d532fdcb-13d5-5c50-9730-da86ec6cb242
2026-03-26 22:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fa1fdedb45072491b933939e06ffaee0b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/a1fdedb45072491b933939e06ffaee0b/images/large/7.jpg not downloaded yet
2026-03-26 22:50:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/48a89d7b107a4ffabbba0d420d1b8e2e/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e16990>
2026-03-26 22:50:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d532fdcb-13d5-5c50-9730-da86ec6cb242/d532fdcb-13d5-5c50-9730-da86ec6cb242_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F48a89d7b107a4ffabbba0d420d1b8e2e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/48a89d7b107a4ffabbba0d420d1b8e2e/images/large/6.jpg saved to cache
2026-03-26 22:50:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d532fdcb-13d5-5c50-9730-da86ec6cb242
2026-03-26 22:50:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77c9190>
2026-03-26 22:50:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d532fdcb-13d5-5c50-9730-da86ec6cb242/d532fdcb-13d5-5c50-9730-da86ec6cb242_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F48a89d7b107a4ffabbba0d420d1b8e2e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/48a89d7b107a4ffabbba0d420d1b8e2e/images/large/5.jpg saved to cache
2026-03-26 22:50:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d532fdcb-13d5-5c50-9730-da86ec6cb242
2026-03-26 22:50:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/48a89d7b107a4ffabbba0d420d1b8e2e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/48a89d7b107a4ffabbba0d420d1b8e2e/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fa1fdedb45072491b933939e06ffaee0b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/a1fdedb45072491b933939e06ffaee0b/images/large/8.jpg not downloaded yet
2026-03-26 22:50:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7427190>
2026-03-26 22:50:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d532fdcb-13d5-5c50-9730-da86ec6cb242/d532fdcb-13d5-5c50-9730-da86ec6cb242_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F48a89d7b107a4ffabbba0d420d1b8e2e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/48a89d7b107a4ffabbba0d420d1b8e2e/images/large/4.jpg saved to cache
2026-03-26 22:50:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d532fdcb-13d5-5c50-9730-da86ec6cb242
2026-03-26 22:50:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77cad90>
2026-03-26 22:50:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d532fdcb-13d5-5c50-9730-da86ec6cb242/d532fdcb-13d5-5c50-9730-da86ec6cb242_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F48a89d7b107a4ffabbba0d420d1b8e2e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/48a89d7b107a4ffabbba0d420d1b8e2e/images/large/7.jpg saved to cache
2026-03-26 22:50:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d532fdcb-13d5-5c50-9730-da86ec6cb242
2026-03-26 22:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fa1fdedb45072491b933939e06ffaee0b%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/a1fdedb45072491b933939e06ffaee0b/images/large/9.jpg not downloaded yet
2026-03-26 22:50:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5ca1090>
2026-03-26 22:50:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d532fdcb-13d5-5c50-9730-da86ec6cb242/d532fdcb-13d5-5c50-9730-da86ec6cb242_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F48a89d7b107a4ffabbba0d420d1b8e2e%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/48a89d7b107a4ffabbba0d420d1b8e2e/images/large/9.jpg saved to cache
2026-03-26 22:50:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d532fdcb-13d5-5c50-9730-da86ec6cb242
2026-03-26 22:50:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/a1fdedb45072491b933939e06ffaee0b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fa1fdedb45072491b933939e06ffaee0b%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/a1fdedb45072491b933939e06ffaee0b/images/large/10.jpg not downloaded yet
2026-03-26 22:50:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7927650>
2026-03-26 22:50:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d532fdcb-13d5-5c50-9730-da86ec6cb242/d532fdcb-13d5-5c50-9730-da86ec6cb242_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F48a89d7b107a4ffabbba0d420d1b8e2e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/48a89d7b107a4ffabbba0d420d1b8e2e/images/large/8.jpg saved to cache
2026-03-26 22:50:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d532fdcb-13d5-5c50-9730-da86ec6cb242
2026-03-26 22:50:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7400b90>
2026-03-26 22:50:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d532fdcb-13d5-5c50-9730-da86ec6cb242/d532fdcb-13d5-5c50-9730-da86ec6cb242_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F48a89d7b107a4ffabbba0d420d1b8e2e%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/48a89d7b107a4ffabbba0d420d1b8e2e/images/large/10.jpg saved to cache
2026-03-26 22:50:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d532fdcb-13d5-5c50-9730-da86ec6cb242
2026-03-26 22:50:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d532fdcb-13d5-5c50-9730-da86ec6cb242, skipping ID generation
2026-03-26 22:50:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d532fdcb-13d5-5c50-9730-da86ec6cb242 with scrape type 1
2026-03-26 22:50:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d532fdcb-13d5-5c50-9730-da86ec6cb242 sending to next pipeline
2026-03-26 22:50:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d532fdcb-13d5-5c50-9730-da86ec6cb242, identifier: 1985401
2026-03-26 22:50:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d532fdcb-13d5-5c50-9730-da86ec6cb242 with identifier: 1985401
2026-03-26 22:50:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d532fdcb-13d5-5c50-9730-da86ec6cb242 with identifier: 1985401
2026-03-26 22:50:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d532fdcb-13d5-5c50-9730-da86ec6cb242 with identifier: 1985401 to the API
2026-03-26 22:50:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:50:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:50:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bw/48a89d7b107a4ffabbba0d420d1b8e2e/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'd532fdcb-13d5-5c50-9730-da86ec6cb242',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3 Sportback',
 'odometer': 60782,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d532fdcb-13d5-5c50-9730-da86ec6cb242/d532fdcb-13d5-5c50-9730-da86ec6cb242_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 661323,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/48a89d7b107a4ffabbba0d420d1b8e2e/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d532fdcb-13d5-5c50-9730-da86ec6cb242/d532fdcb-13d5-5c50-9730-da86ec6cb242_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 613920,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/48a89d7b107a4ffabbba0d420d1b8e2e/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d532fdcb-13d5-5c50-9730-da86ec6cb242/d532fdcb-13d5-5c50-9730-da86ec6cb242_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 616058,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/48a89d7b107a4ffabbba0d420d1b8e2e/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d532fdcb-13d5-5c50-9730-da86ec6cb242/d532fdcb-13d5-5c50-9730-da86ec6cb242_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 746543,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/48a89d7b107a4ffabbba0d420d1b8e2e/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d532fdcb-13d5-5c50-9730-da86ec6cb242/d532fdcb-13d5-5c50-9730-da86ec6cb242_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 598243,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/48a89d7b107a4ffabbba0d420d1b8e2e/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d532fdcb-13d5-5c50-9730-da86ec6cb242/d532fdcb-13d5-5c50-9730-da86ec6cb242_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 554108,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/48a89d7b107a4ffabbba0d420d1b8e2e/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d532fdcb-13d5-5c50-9730-da86ec6cb242/d532fdcb-13d5-5c50-9730-da86ec6cb242_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 631386,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/48a89d7b107a4ffabbba0d420d1b8e2e/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d532fdcb-13d5-5c50-9730-da86ec6cb242/d532fdcb-13d5-5c50-9730-da86ec6cb242_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 715671,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/48a89d7b107a4ffabbba0d420d1b8e2e/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d532fdcb-13d5-5c50-9730-da86ec6cb242/d532fdcb-13d5-5c50-9730-da86ec6cb242_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 602979,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/48a89d7b107a4ffabbba0d420d1b8e2e/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d532fdcb-13d5-5c50-9730-da86ec6cb242/d532fdcb-13d5-5c50-9730-da86ec6cb242_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 611807,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/48a89d7b107a4ffabbba0d420d1b8e2e/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 Sportback 1.4 45 TFSI E S TRONIC',
 'transmission': 'automatic',
 'trim': '1.4 45 TFSI E S TRONIC',
 'vin': None,
 'year': 2022}
2026-03-26 22:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985401%27 HTTP/1.1" 200 None
2026-03-26 22:50:39 [ayvens.be] INFO: Saving data for 1985401: {'created_time': 1774565439.856748, 'last_price_update_time': 1774565439.856757, 'auction_closing_time': 1774958400.0}
2026-03-26 22:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985401') HTTP/1.1" 204 0
2026-03-26 22:50:39 [ayvens.be] INFO: Found listing with ID: 1985403
2026-03-26 22:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985403%27 HTTP/1.1" 200 None
2026-03-26 22:50:39 [ayvens.be] INFO: Scrape type for 1985403: 1
2026-03-26 22:50:39 [ayvens.be] INFO: Extracting data for car ID: 1985403
2026-03-26 22:50:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a479119-61e5-5b1a-b329-a6f67a5b7217 with identifier: 1985403
2026-03-26 22:50:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a479119-61e5-5b1a-b329-a6f67a5b7217 with scrape type 1
2026-03-26 22:50:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3a479119-61e5-5b1a-b329-a6f67a5b7217
2026-03-26 22:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F1f5dd5294a9c49afa4b3052a8a48a4b2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/1f5dd5294a9c49afa4b3052a8a48a4b2/images/large/1.jpg not downloaded yet
2026-03-26 22:50:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7a81ed0>
2026-03-26 22:50:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cccef83-c8e9-5e43-a466-86f3038f3493/0cccef83-c8e9-5e43-a466-86f3038f3493_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fa1fdedb45072491b933939e06ffaee0b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/a1fdedb45072491b933939e06ffaee0b/images/large/1.jpg saved to cache
2026-03-26 22:50:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0cccef83-c8e9-5e43-a466-86f3038f3493
2026-03-26 22:50:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/a1fdedb45072491b933939e06ffaee0b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F1f5dd5294a9c49afa4b3052a8a48a4b2%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/1f5dd5294a9c49afa4b3052a8a48a4b2/images/large/2.jpg not downloaded yet
2026-03-26 22:50:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/a1fdedb45072491b933939e06ffaee0b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/a1fdedb45072491b933939e06ffaee0b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/a1fdedb45072491b933939e06ffaee0b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F1f5dd5294a9c49afa4b3052a8a48a4b2%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/1f5dd5294a9c49afa4b3052a8a48a4b2/images/large/3.jpg not downloaded yet
2026-03-26 22:50:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/a1fdedb45072491b933939e06ffaee0b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F1f5dd5294a9c49afa4b3052a8a48a4b2%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/1f5dd5294a9c49afa4b3052a8a48a4b2/images/large/4.jpg not downloaded yet
2026-03-26 22:50:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/a1fdedb45072491b933939e06ffaee0b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F1f5dd5294a9c49afa4b3052a8a48a4b2%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/1f5dd5294a9c49afa4b3052a8a48a4b2/images/large/5.jpg not downloaded yet
2026-03-26 22:50:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/a1fdedb45072491b933939e06ffaee0b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/a1fdedb45072491b933939e06ffaee0b/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F1f5dd5294a9c49afa4b3052a8a48a4b2%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/1f5dd5294a9c49afa4b3052a8a48a4b2/images/large/6.jpg not downloaded yet
2026-03-26 22:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F1f5dd5294a9c49afa4b3052a8a48a4b2%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/1f5dd5294a9c49afa4b3052a8a48a4b2/images/large/7.jpg not downloaded yet
2026-03-26 22:50:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5ca7c50>
2026-03-26 22:50:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cccef83-c8e9-5e43-a466-86f3038f3493/0cccef83-c8e9-5e43-a466-86f3038f3493_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fa1fdedb45072491b933939e06ffaee0b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/a1fdedb45072491b933939e06ffaee0b/images/large/5.jpg saved to cache
2026-03-26 22:50:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0cccef83-c8e9-5e43-a466-86f3038f3493
2026-03-26 22:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F1f5dd5294a9c49afa4b3052a8a48a4b2%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/1f5dd5294a9c49afa4b3052a8a48a4b2/images/large/8.jpg not downloaded yet
2026-03-26 22:50:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7818b10>
2026-03-26 22:50:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cccef83-c8e9-5e43-a466-86f3038f3493/0cccef83-c8e9-5e43-a466-86f3038f3493_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fa1fdedb45072491b933939e06ffaee0b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/a1fdedb45072491b933939e06ffaee0b/images/large/4.jpg saved to cache
2026-03-26 22:50:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0cccef83-c8e9-5e43-a466-86f3038f3493
2026-03-26 22:50:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7912450>
2026-03-26 22:50:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cccef83-c8e9-5e43-a466-86f3038f3493/0cccef83-c8e9-5e43-a466-86f3038f3493_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fa1fdedb45072491b933939e06ffaee0b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/a1fdedb45072491b933939e06ffaee0b/images/large/3.jpg saved to cache
2026-03-26 22:50:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0cccef83-c8e9-5e43-a466-86f3038f3493
2026-03-26 22:50:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79271d0>
2026-03-26 22:50:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cccef83-c8e9-5e43-a466-86f3038f3493/0cccef83-c8e9-5e43-a466-86f3038f3493_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fa1fdedb45072491b933939e06ffaee0b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/a1fdedb45072491b933939e06ffaee0b/images/large/2.jpg saved to cache
2026-03-26 22:50:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0cccef83-c8e9-5e43-a466-86f3038f3493
2026-03-26 22:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F1f5dd5294a9c49afa4b3052a8a48a4b2%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/1f5dd5294a9c49afa4b3052a8a48a4b2/images/large/9.jpg not downloaded yet
2026-03-26 22:50:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b78769d0>
2026-03-26 22:50:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cccef83-c8e9-5e43-a466-86f3038f3493/0cccef83-c8e9-5e43-a466-86f3038f3493_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fa1fdedb45072491b933939e06ffaee0b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/a1fdedb45072491b933939e06ffaee0b/images/large/6.jpg saved to cache
2026-03-26 22:50:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0cccef83-c8e9-5e43-a466-86f3038f3493
2026-03-26 22:50:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76a4290>
2026-03-26 22:50:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cccef83-c8e9-5e43-a466-86f3038f3493/0cccef83-c8e9-5e43-a466-86f3038f3493_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fa1fdedb45072491b933939e06ffaee0b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/a1fdedb45072491b933939e06ffaee0b/images/large/7.jpg saved to cache
2026-03-26 22:50:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0cccef83-c8e9-5e43-a466-86f3038f3493
2026-03-26 22:50:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6dee990>
2026-03-26 22:50:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cccef83-c8e9-5e43-a466-86f3038f3493/0cccef83-c8e9-5e43-a466-86f3038f3493_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fa1fdedb45072491b933939e06ffaee0b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/a1fdedb45072491b933939e06ffaee0b/images/large/8.jpg saved to cache
2026-03-26 22:50:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0cccef83-c8e9-5e43-a466-86f3038f3493
2026-03-26 22:50:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7585b10>
2026-03-26 22:50:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cccef83-c8e9-5e43-a466-86f3038f3493/0cccef83-c8e9-5e43-a466-86f3038f3493_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fa1fdedb45072491b933939e06ffaee0b%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/a1fdedb45072491b933939e06ffaee0b/images/large/9.jpg saved to cache
2026-03-26 22:50:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0cccef83-c8e9-5e43-a466-86f3038f3493
2026-03-26 22:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F1f5dd5294a9c49afa4b3052a8a48a4b2%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/1f5dd5294a9c49afa4b3052a8a48a4b2/images/large/10.jpg not downloaded yet
2026-03-26 22:50:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/1f5dd5294a9c49afa4b3052a8a48a4b2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:40 [ayvens.be] INFO: Found listing with ID: 1985404
2026-03-26 22:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985404%27 HTTP/1.1" 200 None
2026-03-26 22:50:40 [ayvens.be] INFO: Scrape type for 1985404: 1
2026-03-26 22:50:40 [ayvens.be] INFO: Extracting data for car ID: 1985404
2026-03-26 22:50:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a206e3e-7dc8-586a-86ea-5675f49b7965 with identifier: 1985404
2026-03-26 22:50:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a206e3e-7dc8-586a-86ea-5675f49b7965 with scrape type 1
2026-03-26 22:50:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8a206e3e-7dc8-586a-86ea-5675f49b7965
2026-03-26 22:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F73c7a401428742468437c7d3bdefd550%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/73c7a401428742468437c7d3bdefd550/images/large/1.jpg not downloaded yet
2026-03-26 22:50:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/a1fdedb45072491b933939e06ffaee0b/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/1f5dd5294a9c49afa4b3052a8a48a4b2/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F73c7a401428742468437c7d3bdefd550%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/73c7a401428742468437c7d3bdefd550/images/large/2.jpg not downloaded yet
2026-03-26 22:50:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/1f5dd5294a9c49afa4b3052a8a48a4b2/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/1f5dd5294a9c49afa4b3052a8a48a4b2/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F73c7a401428742468437c7d3bdefd550%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/73c7a401428742468437c7d3bdefd550/images/large/3.jpg not downloaded yet
2026-03-26 22:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F73c7a401428742468437c7d3bdefd550%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/73c7a401428742468437c7d3bdefd550/images/large/4.jpg not downloaded yet
2026-03-26 22:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F73c7a401428742468437c7d3bdefd550%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/73c7a401428742468437c7d3bdefd550/images/large/5.jpg not downloaded yet
2026-03-26 22:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F73c7a401428742468437c7d3bdefd550%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/73c7a401428742468437c7d3bdefd550/images/large/6.jpg not downloaded yet
2026-03-26 22:50:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/1f5dd5294a9c49afa4b3052a8a48a4b2/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77ae9d0>
2026-03-26 22:50:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a479119-61e5-5b1a-b329-a6f67a5b7217/3a479119-61e5-5b1a-b329-a6f67a5b7217_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F1f5dd5294a9c49afa4b3052a8a48a4b2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/1f5dd5294a9c49afa4b3052a8a48a4b2/images/large/1.jpg saved to cache
2026-03-26 22:50:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3a479119-61e5-5b1a-b329-a6f67a5b7217
2026-03-26 22:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F73c7a401428742468437c7d3bdefd550%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/73c7a401428742468437c7d3bdefd550/images/large/7.jpg not downloaded yet
2026-03-26 22:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F73c7a401428742468437c7d3bdefd550%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/73c7a401428742468437c7d3bdefd550/images/large/8.jpg not downloaded yet
2026-03-26 22:50:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/1f5dd5294a9c49afa4b3052a8a48a4b2/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F73c7a401428742468437c7d3bdefd550%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/73c7a401428742468437c7d3bdefd550/images/large/9.jpg not downloaded yet
2026-03-26 22:50:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e35910>
2026-03-26 22:50:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cccef83-c8e9-5e43-a466-86f3038f3493/0cccef83-c8e9-5e43-a466-86f3038f3493_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fa1fdedb45072491b933939e06ffaee0b%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/a1fdedb45072491b933939e06ffaee0b/images/large/10.jpg saved to cache
2026-03-26 22:50:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0cccef83-c8e9-5e43-a466-86f3038f3493
2026-03-26 22:50:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0cccef83-c8e9-5e43-a466-86f3038f3493, skipping ID generation
2026-03-26 22:50:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0cccef83-c8e9-5e43-a466-86f3038f3493 with scrape type 1
2026-03-26 22:50:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0cccef83-c8e9-5e43-a466-86f3038f3493 sending to next pipeline
2026-03-26 22:50:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 0cccef83-c8e9-5e43-a466-86f3038f3493, identifier: 1985402
2026-03-26 22:50:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd48ee90>
2026-03-26 22:50:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a479119-61e5-5b1a-b329-a6f67a5b7217/3a479119-61e5-5b1a-b329-a6f67a5b7217_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F1f5dd5294a9c49afa4b3052a8a48a4b2%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/1f5dd5294a9c49afa4b3052a8a48a4b2/images/large/3.jpg saved to cache
2026-03-26 22:50:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3a479119-61e5-5b1a-b329-a6f67a5b7217
2026-03-26 22:50:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7876dd0>
2026-03-26 22:50:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a479119-61e5-5b1a-b329-a6f67a5b7217/3a479119-61e5-5b1a-b329-a6f67a5b7217_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F1f5dd5294a9c49afa4b3052a8a48a4b2%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/1f5dd5294a9c49afa4b3052a8a48a4b2/images/large/2.jpg saved to cache
2026-03-26 22:50:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3a479119-61e5-5b1a-b329-a6f67a5b7217
2026-03-26 22:50:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77adad0>
2026-03-26 22:50:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a479119-61e5-5b1a-b329-a6f67a5b7217/3a479119-61e5-5b1a-b329-a6f67a5b7217_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F1f5dd5294a9c49afa4b3052a8a48a4b2%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/1f5dd5294a9c49afa4b3052a8a48a4b2/images/large/4.jpg saved to cache
2026-03-26 22:50:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3a479119-61e5-5b1a-b329-a6f67a5b7217
2026-03-26 22:50:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7caadd0>
2026-03-26 22:50:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a479119-61e5-5b1a-b329-a6f67a5b7217/3a479119-61e5-5b1a-b329-a6f67a5b7217_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F1f5dd5294a9c49afa4b3052a8a48a4b2%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/1f5dd5294a9c49afa4b3052a8a48a4b2/images/large/6.jpg saved to cache
2026-03-26 22:50:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3a479119-61e5-5b1a-b329-a6f67a5b7217
2026-03-26 22:50:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/1f5dd5294a9c49afa4b3052a8a48a4b2/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/1f5dd5294a9c49afa4b3052a8a48a4b2/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 0cccef83-c8e9-5e43-a466-86f3038f3493 with identifier: 1985402
2026-03-26 22:50:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 0cccef83-c8e9-5e43-a466-86f3038f3493 with identifier: 1985402
2026-03-26 22:50:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 0cccef83-c8e9-5e43-a466-86f3038f3493 with identifier: 1985402 to the API
2026-03-26 22:50:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:50:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:50:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bx/a1fdedb45072491b933939e06ffaee0b/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '0cccef83-c8e9-5e43-a466-86f3038f3493',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3 Sportback',
 'odometer': 74920,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cccef83-c8e9-5e43-a466-86f3038f3493/0cccef83-c8e9-5e43-a466-86f3038f3493_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 645468,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/a1fdedb45072491b933939e06ffaee0b/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cccef83-c8e9-5e43-a466-86f3038f3493/0cccef83-c8e9-5e43-a466-86f3038f3493_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 666905,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/a1fdedb45072491b933939e06ffaee0b/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cccef83-c8e9-5e43-a466-86f3038f3493/0cccef83-c8e9-5e43-a466-86f3038f3493_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 657588,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/a1fdedb45072491b933939e06ffaee0b/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cccef83-c8e9-5e43-a466-86f3038f3493/0cccef83-c8e9-5e43-a466-86f3038f3493_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 680940,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/a1fdedb45072491b933939e06ffaee0b/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cccef83-c8e9-5e43-a466-86f3038f3493/0cccef83-c8e9-5e43-a466-86f3038f3493_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 516808,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/a1fdedb45072491b933939e06ffaee0b/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cccef83-c8e9-5e43-a466-86f3038f3493/0cccef83-c8e9-5e43-a466-86f3038f3493_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 620616,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/a1fdedb45072491b933939e06ffaee0b/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cccef83-c8e9-5e43-a466-86f3038f3493/0cccef83-c8e9-5e43-a466-86f3038f3493_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 616650,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/a1fdedb45072491b933939e06ffaee0b/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cccef83-c8e9-5e43-a466-86f3038f3493/0cccef83-c8e9-5e43-a466-86f3038f3493_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 656382,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/a1fdedb45072491b933939e06ffaee0b/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cccef83-c8e9-5e43-a466-86f3038f3493/0cccef83-c8e9-5e43-a466-86f3038f3493_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 574032,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/a1fdedb45072491b933939e06ffaee0b/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cccef83-c8e9-5e43-a466-86f3038f3493/0cccef83-c8e9-5e43-a466-86f3038f3493_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 625847,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/a1fdedb45072491b933939e06ffaee0b/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 Sportback 1.4 45 TFSI E S TRONIC',
 'transmission': 'automatic',
 'trim': '1.4 45 TFSI E S TRONIC',
 'vin': None,
 'year': 2022}
2026-03-26 22:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985402%27 HTTP/1.1" 200 None
2026-03-26 22:50:42 [ayvens.be] INFO: Saving data for 1985402: {'created_time': 1774565442.21489, 'last_price_update_time': 1774565442.2149, 'auction_closing_time': 1774958400.0}
2026-03-26 22:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985402') HTTP/1.1" 204 0
2026-03-26 22:50:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/1f5dd5294a9c49afa4b3052a8a48a4b2/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F73c7a401428742468437c7d3bdefd550%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/73c7a401428742468437c7d3bdefd550/images/large/10.jpg not downloaded yet
2026-03-26 22:50:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/1f5dd5294a9c49afa4b3052a8a48a4b2/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:42 [ayvens.be] INFO: Found listing with ID: 1985405
2026-03-26 22:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985405%27 HTTP/1.1" 200 None
2026-03-26 22:50:42 [ayvens.be] INFO: Scrape type for 1985405: 1
2026-03-26 22:50:42 [ayvens.be] INFO: Extracting data for car ID: 1985405
2026-03-26 22:50:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4378404c-4d48-5176-8a9d-538d8488156b with identifier: 1985405
2026-03-26 22:50:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4378404c-4d48-5176-8a9d-538d8488156b with scrape type 1
2026-03-26 22:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4378404c-4d48-5176-8a9d-538d8488156b
2026-03-26 22:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2du%252Ff2cbc0e9dc4d45c093fe0a6e1675c7fd%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2du/f2cbc0e9dc4d45c093fe0a6e1675c7fd/images/large/1.jpg not downloaded yet
2026-03-26 22:50:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/73c7a401428742468437c7d3bdefd550/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b746ded0>
2026-03-26 22:50:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a479119-61e5-5b1a-b329-a6f67a5b7217/3a479119-61e5-5b1a-b329-a6f67a5b7217_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F1f5dd5294a9c49afa4b3052a8a48a4b2%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/1f5dd5294a9c49afa4b3052a8a48a4b2/images/large/7.jpg saved to cache
2026-03-26 22:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3a479119-61e5-5b1a-b329-a6f67a5b7217
2026-03-26 22:50:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7778c10>
2026-03-26 22:50:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a479119-61e5-5b1a-b329-a6f67a5b7217/3a479119-61e5-5b1a-b329-a6f67a5b7217_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F1f5dd5294a9c49afa4b3052a8a48a4b2%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/1f5dd5294a9c49afa4b3052a8a48a4b2/images/large/8.jpg saved to cache
2026-03-26 22:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3a479119-61e5-5b1a-b329-a6f67a5b7217
2026-03-26 22:50:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79f0790>
2026-03-26 22:50:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a479119-61e5-5b1a-b329-a6f67a5b7217/3a479119-61e5-5b1a-b329-a6f67a5b7217_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F1f5dd5294a9c49afa4b3052a8a48a4b2%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/1f5dd5294a9c49afa4b3052a8a48a4b2/images/large/5.jpg saved to cache
2026-03-26 22:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3a479119-61e5-5b1a-b329-a6f67a5b7217
2026-03-26 22:50:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/73c7a401428742468437c7d3bdefd550/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2du%252Ff2cbc0e9dc4d45c093fe0a6e1675c7fd%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2du/f2cbc0e9dc4d45c093fe0a6e1675c7fd/images/large/2.jpg not downloaded yet
2026-03-26 22:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2du%252Ff2cbc0e9dc4d45c093fe0a6e1675c7fd%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2du/f2cbc0e9dc4d45c093fe0a6e1675c7fd/images/large/3.jpg not downloaded yet
2026-03-26 22:50:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b35b50>
2026-03-26 22:50:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a479119-61e5-5b1a-b329-a6f67a5b7217/3a479119-61e5-5b1a-b329-a6f67a5b7217_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F1f5dd5294a9c49afa4b3052a8a48a4b2%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/1f5dd5294a9c49afa4b3052a8a48a4b2/images/large/9.jpg saved to cache
2026-03-26 22:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3a479119-61e5-5b1a-b329-a6f67a5b7217
2026-03-26 22:50:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7570250>
2026-03-26 22:50:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a479119-61e5-5b1a-b329-a6f67a5b7217/3a479119-61e5-5b1a-b329-a6f67a5b7217_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F1f5dd5294a9c49afa4b3052a8a48a4b2%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/1f5dd5294a9c49afa4b3052a8a48a4b2/images/large/10.jpg saved to cache
2026-03-26 22:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3a479119-61e5-5b1a-b329-a6f67a5b7217
2026-03-26 22:50:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3a479119-61e5-5b1a-b329-a6f67a5b7217, skipping ID generation
2026-03-26 22:50:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a479119-61e5-5b1a-b329-a6f67a5b7217 with scrape type 1
2026-03-26 22:50:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3a479119-61e5-5b1a-b329-a6f67a5b7217 sending to next pipeline
2026-03-26 22:50:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 3a479119-61e5-5b1a-b329-a6f67a5b7217, identifier: 1985403
2026-03-26 22:50:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7400890>
2026-03-26 22:50:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a206e3e-7dc8-586a-86ea-5675f49b7965/8a206e3e-7dc8-586a-86ea-5675f49b7965_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F73c7a401428742468437c7d3bdefd550%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/73c7a401428742468437c7d3bdefd550/images/large/2.jpg saved to cache
2026-03-26 22:50:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8a206e3e-7dc8-586a-86ea-5675f49b7965
2026-03-26 22:50:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 3a479119-61e5-5b1a-b329-a6f67a5b7217 with identifier: 1985403
2026-03-26 22:50:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 3a479119-61e5-5b1a-b329-a6f67a5b7217 with identifier: 1985403
2026-03-26 22:50:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 3a479119-61e5-5b1a-b329-a6f67a5b7217 with identifier: 1985403 to the API
2026-03-26 22:50:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:50:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:50:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cc/1f5dd5294a9c49afa4b3052a8a48a4b2/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '3a479119-61e5-5b1a-b329-a6f67a5b7217',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3 Sportback',
 'odometer': 100504,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a479119-61e5-5b1a-b329-a6f67a5b7217/3a479119-61e5-5b1a-b329-a6f67a5b7217_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 646571,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/1f5dd5294a9c49afa4b3052a8a48a4b2/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a479119-61e5-5b1a-b329-a6f67a5b7217/3a479119-61e5-5b1a-b329-a6f67a5b7217_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 643615,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/1f5dd5294a9c49afa4b3052a8a48a4b2/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a479119-61e5-5b1a-b329-a6f67a5b7217/3a479119-61e5-5b1a-b329-a6f67a5b7217_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 544111,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/1f5dd5294a9c49afa4b3052a8a48a4b2/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a479119-61e5-5b1a-b329-a6f67a5b7217/3a479119-61e5-5b1a-b329-a6f67a5b7217_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 703431,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/1f5dd5294a9c49afa4b3052a8a48a4b2/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a479119-61e5-5b1a-b329-a6f67a5b7217/3a479119-61e5-5b1a-b329-a6f67a5b7217_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 637179,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/1f5dd5294a9c49afa4b3052a8a48a4b2/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a479119-61e5-5b1a-b329-a6f67a5b7217/3a479119-61e5-5b1a-b329-a6f67a5b7217_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 649847,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/1f5dd5294a9c49afa4b3052a8a48a4b2/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a479119-61e5-5b1a-b329-a6f67a5b7217/3a479119-61e5-5b1a-b329-a6f67a5b7217_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 706369,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/1f5dd5294a9c49afa4b3052a8a48a4b2/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a479119-61e5-5b1a-b329-a6f67a5b7217/3a479119-61e5-5b1a-b329-a6f67a5b7217_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 691341,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/1f5dd5294a9c49afa4b3052a8a48a4b2/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a479119-61e5-5b1a-b329-a6f67a5b7217/3a479119-61e5-5b1a-b329-a6f67a5b7217_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 539561,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/1f5dd5294a9c49afa4b3052a8a48a4b2/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a479119-61e5-5b1a-b329-a6f67a5b7217/3a479119-61e5-5b1a-b329-a6f67a5b7217_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 609160,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/1f5dd5294a9c49afa4b3052a8a48a4b2/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 Sportback 1.4 45 TFSI E S TRONIC',
 'transmission': 'automatic',
 'trim': '1.4 45 TFSI E S TRONIC',
 'vin': None,
 'year': 2022}
2026-03-26 22:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985403%27 HTTP/1.1" 200 None
2026-03-26 22:50:43 [ayvens.be] INFO: Saving data for 1985403: {'created_time': 1774565443.412778, 'last_price_update_time': 1774565443.412787, 'auction_closing_time': 1774958400.0}
2026-03-26 22:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985403') HTTP/1.1" 204 0
2026-03-26 22:50:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/73c7a401428742468437c7d3bdefd550/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2du%252Ff2cbc0e9dc4d45c093fe0a6e1675c7fd%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2du/f2cbc0e9dc4d45c093fe0a6e1675c7fd/images/large/4.jpg not downloaded yet
2026-03-26 22:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2du%252Ff2cbc0e9dc4d45c093fe0a6e1675c7fd%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2du/f2cbc0e9dc4d45c093fe0a6e1675c7fd/images/large/5.jpg not downloaded yet
2026-03-26 22:50:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/73c7a401428742468437c7d3bdefd550/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7494610>
2026-03-26 22:50:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a206e3e-7dc8-586a-86ea-5675f49b7965/8a206e3e-7dc8-586a-86ea-5675f49b7965_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F73c7a401428742468437c7d3bdefd550%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/73c7a401428742468437c7d3bdefd550/images/large/1.jpg saved to cache
2026-03-26 22:50:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8a206e3e-7dc8-586a-86ea-5675f49b7965
2026-03-26 22:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2du%252Ff2cbc0e9dc4d45c093fe0a6e1675c7fd%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2du/f2cbc0e9dc4d45c093fe0a6e1675c7fd/images/large/6.jpg not downloaded yet
2026-03-26 22:50:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/73c7a401428742468437c7d3bdefd550/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2du%252Ff2cbc0e9dc4d45c093fe0a6e1675c7fd%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2du/f2cbc0e9dc4d45c093fe0a6e1675c7fd/images/large/7.jpg not downloaded yet
2026-03-26 22:50:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74ac6d0>
2026-03-26 22:50:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a206e3e-7dc8-586a-86ea-5675f49b7965/8a206e3e-7dc8-586a-86ea-5675f49b7965_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F73c7a401428742468437c7d3bdefd550%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/73c7a401428742468437c7d3bdefd550/images/large/3.jpg saved to cache
2026-03-26 22:50:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8a206e3e-7dc8-586a-86ea-5675f49b7965
2026-03-26 22:50:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/73c7a401428742468437c7d3bdefd550/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/73c7a401428742468437c7d3bdefd550/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2du%252Ff2cbc0e9dc4d45c093fe0a6e1675c7fd%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2du/f2cbc0e9dc4d45c093fe0a6e1675c7fd/images/large/8.jpg not downloaded yet
2026-03-26 22:50:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/73c7a401428742468437c7d3bdefd550/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/73c7a401428742468437c7d3bdefd550/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2du/f2cbc0e9dc4d45c093fe0a6e1675c7fd/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/73c7a401428742468437c7d3bdefd550/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2du%252Ff2cbc0e9dc4d45c093fe0a6e1675c7fd%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2du/f2cbc0e9dc4d45c093fe0a6e1675c7fd/images/large/9.jpg not downloaded yet
2026-03-26 22:50:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74752d0>
2026-03-26 22:50:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a206e3e-7dc8-586a-86ea-5675f49b7965/8a206e3e-7dc8-586a-86ea-5675f49b7965_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F73c7a401428742468437c7d3bdefd550%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/73c7a401428742468437c7d3bdefd550/images/large/4.jpg saved to cache
2026-03-26 22:50:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8a206e3e-7dc8-586a-86ea-5675f49b7965
2026-03-26 22:50:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b746ea50>
2026-03-26 22:50:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a206e3e-7dc8-586a-86ea-5675f49b7965/8a206e3e-7dc8-586a-86ea-5675f49b7965_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F73c7a401428742468437c7d3bdefd550%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/73c7a401428742468437c7d3bdefd550/images/large/6.jpg saved to cache
2026-03-26 22:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8a206e3e-7dc8-586a-86ea-5675f49b7965
2026-03-26 22:50:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2du/f2cbc0e9dc4d45c093fe0a6e1675c7fd/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2du%252Ff2cbc0e9dc4d45c093fe0a6e1675c7fd%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2du/f2cbc0e9dc4d45c093fe0a6e1675c7fd/images/large/10.jpg not downloaded yet
2026-03-26 22:50:44 [ayvens.be] INFO: Found listing with ID: 1985406
2026-03-26 22:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985406%27 HTTP/1.1" 200 None
2026-03-26 22:50:44 [ayvens.be] INFO: Scrape type for 1985406: 1
2026-03-26 22:50:44 [ayvens.be] INFO: Extracting data for car ID: 1985406
2026-03-26 22:50:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 59caa32e-8ead-511a-a254-01be2d4c5584 with identifier: 1985406
2026-03-26 22:50:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 59caa32e-8ead-511a-a254-01be2d4c5584 with scrape type 1
2026-03-26 22:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 59caa32e-8ead-511a-a254-01be2d4c5584
2026-03-26 22:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F4526e7d970ac4cf1881a043c4cb28d87%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/4526e7d970ac4cf1881a043c4cb28d87/images/large/1.jpg not downloaded yet
2026-03-26 22:50:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c5ef50>
2026-03-26 22:50:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a206e3e-7dc8-586a-86ea-5675f49b7965/8a206e3e-7dc8-586a-86ea-5675f49b7965_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F73c7a401428742468437c7d3bdefd550%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/73c7a401428742468437c7d3bdefd550/images/large/5.jpg saved to cache
2026-03-26 22:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8a206e3e-7dc8-586a-86ea-5675f49b7965
2026-03-26 22:50:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74b55d0>
2026-03-26 22:50:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a206e3e-7dc8-586a-86ea-5675f49b7965/8a206e3e-7dc8-586a-86ea-5675f49b7965_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F73c7a401428742468437c7d3bdefd550%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/73c7a401428742468437c7d3bdefd550/images/large/7.jpg saved to cache
2026-03-26 22:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8a206e3e-7dc8-586a-86ea-5675f49b7965
2026-03-26 22:50:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6dd9810>
2026-03-26 22:50:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a206e3e-7dc8-586a-86ea-5675f49b7965/8a206e3e-7dc8-586a-86ea-5675f49b7965_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F73c7a401428742468437c7d3bdefd550%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/73c7a401428742468437c7d3bdefd550/images/large/9.jpg saved to cache
2026-03-26 22:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8a206e3e-7dc8-586a-86ea-5675f49b7965
2026-03-26 22:50:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7911bd0>
2026-03-26 22:50:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a206e3e-7dc8-586a-86ea-5675f49b7965/8a206e3e-7dc8-586a-86ea-5675f49b7965_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F73c7a401428742468437c7d3bdefd550%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/73c7a401428742468437c7d3bdefd550/images/large/10.jpg saved to cache
2026-03-26 22:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8a206e3e-7dc8-586a-86ea-5675f49b7965
2026-03-26 22:50:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b727df90>
2026-03-26 22:50:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4378404c-4d48-5176-8a9d-538d8488156b/4378404c-4d48-5176-8a9d-538d8488156b_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2du%252Ff2cbc0e9dc4d45c093fe0a6e1675c7fd%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2du/f2cbc0e9dc4d45c093fe0a6e1675c7fd/images/large/1.jpg saved to cache
2026-03-26 22:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4378404c-4d48-5176-8a9d-538d8488156b
2026-03-26 22:50:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b787ced0>
2026-03-26 22:50:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a206e3e-7dc8-586a-86ea-5675f49b7965/8a206e3e-7dc8-586a-86ea-5675f49b7965_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F73c7a401428742468437c7d3bdefd550%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/73c7a401428742468437c7d3bdefd550/images/large/8.jpg saved to cache
2026-03-26 22:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8a206e3e-7dc8-586a-86ea-5675f49b7965
2026-03-26 22:50:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8a206e3e-7dc8-586a-86ea-5675f49b7965, skipping ID generation
2026-03-26 22:50:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a206e3e-7dc8-586a-86ea-5675f49b7965 with scrape type 1
2026-03-26 22:50:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8a206e3e-7dc8-586a-86ea-5675f49b7965 sending to next pipeline
2026-03-26 22:50:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 8a206e3e-7dc8-586a-86ea-5675f49b7965, identifier: 1985404
2026-03-26 22:50:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2du/f2cbc0e9dc4d45c093fe0a6e1675c7fd/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2du/f2cbc0e9dc4d45c093fe0a6e1675c7fd/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2du/f2cbc0e9dc4d45c093fe0a6e1675c7fd/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F4526e7d970ac4cf1881a043c4cb28d87%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/4526e7d970ac4cf1881a043c4cb28d87/images/large/2.jpg not downloaded yet
2026-03-26 22:50:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 8a206e3e-7dc8-586a-86ea-5675f49b7965 with identifier: 1985404
2026-03-26 22:50:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 8a206e3e-7dc8-586a-86ea-5675f49b7965 with identifier: 1985404
2026-03-26 22:50:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 8a206e3e-7dc8-586a-86ea-5675f49b7965 with identifier: 1985404 to the API
2026-03-26 22:50:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:50:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:50:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bs/73c7a401428742468437c7d3bdefd550/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '8a206e3e-7dc8-586a-86ea-5675f49b7965',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLA - Klasse',
 'odometer': 72093,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 18,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a206e3e-7dc8-586a-86ea-5675f49b7965/8a206e3e-7dc8-586a-86ea-5675f49b7965_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 640580,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/73c7a401428742468437c7d3bdefd550/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a206e3e-7dc8-586a-86ea-5675f49b7965/8a206e3e-7dc8-586a-86ea-5675f49b7965_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 665415,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/73c7a401428742468437c7d3bdefd550/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a206e3e-7dc8-586a-86ea-5675f49b7965/8a206e3e-7dc8-586a-86ea-5675f49b7965_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 711056,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/73c7a401428742468437c7d3bdefd550/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a206e3e-7dc8-586a-86ea-5675f49b7965/8a206e3e-7dc8-586a-86ea-5675f49b7965_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 704659,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/73c7a401428742468437c7d3bdefd550/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a206e3e-7dc8-586a-86ea-5675f49b7965/8a206e3e-7dc8-586a-86ea-5675f49b7965_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 704221,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/73c7a401428742468437c7d3bdefd550/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a206e3e-7dc8-586a-86ea-5675f49b7965/8a206e3e-7dc8-586a-86ea-5675f49b7965_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 637774,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/73c7a401428742468437c7d3bdefd550/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a206e3e-7dc8-586a-86ea-5675f49b7965/8a206e3e-7dc8-586a-86ea-5675f49b7965_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 727098,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/73c7a401428742468437c7d3bdefd550/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a206e3e-7dc8-586a-86ea-5675f49b7965/8a206e3e-7dc8-586a-86ea-5675f49b7965_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 683845,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/73c7a401428742468437c7d3bdefd550/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a206e3e-7dc8-586a-86ea-5675f49b7965/8a206e3e-7dc8-586a-86ea-5675f49b7965_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 711756,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/73c7a401428742468437c7d3bdefd550/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a206e3e-7dc8-586a-86ea-5675f49b7965/8a206e3e-7dc8-586a-86ea-5675f49b7965_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 698437,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/73c7a401428742468437c7d3bdefd550/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLA - Klasse 1.3 CLA 250 E BUSINESS SOLUTION DCT',
 'transmission': 'automatic',
 'trim': '1.3 CLA 250 E BUSINESS SOLUTION DCT',
 'vin': None,
 'year': 2022}
2026-03-26 22:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985404%27 HTTP/1.1" 200 None
2026-03-26 22:50:45 [ayvens.be] INFO: Saving data for 1985404: {'created_time': 1774565445.028697, 'last_price_update_time': 1774565445.028706, 'auction_closing_time': 1774958400.0}
2026-03-26 22:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985404') HTTP/1.1" 204 0
2026-03-26 22:50:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2du/f2cbc0e9dc4d45c093fe0a6e1675c7fd/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2du/f2cbc0e9dc4d45c093fe0a6e1675c7fd/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F4526e7d970ac4cf1881a043c4cb28d87%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/4526e7d970ac4cf1881a043c4cb28d87/images/large/3.jpg not downloaded yet
2026-03-26 22:50:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e012d0>
2026-03-26 22:50:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4378404c-4d48-5176-8a9d-538d8488156b/4378404c-4d48-5176-8a9d-538d8488156b_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2du%252Ff2cbc0e9dc4d45c093fe0a6e1675c7fd%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2du/f2cbc0e9dc4d45c093fe0a6e1675c7fd/images/large/2.jpg saved to cache
2026-03-26 22:50:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4378404c-4d48-5176-8a9d-538d8488156b
2026-03-26 22:50:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7a56b90>
2026-03-26 22:50:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4378404c-4d48-5176-8a9d-538d8488156b/4378404c-4d48-5176-8a9d-538d8488156b_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2du%252Ff2cbc0e9dc4d45c093fe0a6e1675c7fd%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2du/f2cbc0e9dc4d45c093fe0a6e1675c7fd/images/large/3.jpg saved to cache
2026-03-26 22:50:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4378404c-4d48-5176-8a9d-538d8488156b
2026-03-26 22:50:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77bddd0>
2026-03-26 22:50:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4378404c-4d48-5176-8a9d-538d8488156b/4378404c-4d48-5176-8a9d-538d8488156b_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2du%252Ff2cbc0e9dc4d45c093fe0a6e1675c7fd%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2du/f2cbc0e9dc4d45c093fe0a6e1675c7fd/images/large/4.jpg saved to cache
2026-03-26 22:50:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4378404c-4d48-5176-8a9d-538d8488156b
2026-03-26 22:50:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76e0410>
2026-03-26 22:50:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4378404c-4d48-5176-8a9d-538d8488156b/4378404c-4d48-5176-8a9d-538d8488156b_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2du%252Ff2cbc0e9dc4d45c093fe0a6e1675c7fd%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2du/f2cbc0e9dc4d45c093fe0a6e1675c7fd/images/large/6.jpg saved to cache
2026-03-26 22:50:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4378404c-4d48-5176-8a9d-538d8488156b
2026-03-26 22:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F4526e7d970ac4cf1881a043c4cb28d87%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/4526e7d970ac4cf1881a043c4cb28d87/images/large/4.jpg not downloaded yet
2026-03-26 22:50:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2du/f2cbc0e9dc4d45c093fe0a6e1675c7fd/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2du/f2cbc0e9dc4d45c093fe0a6e1675c7fd/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2du/f2cbc0e9dc4d45c093fe0a6e1675c7fd/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F4526e7d970ac4cf1881a043c4cb28d87%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/4526e7d970ac4cf1881a043c4cb28d87/images/large/5.jpg not downloaded yet
2026-03-26 22:50:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7459610>
2026-03-26 22:50:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4378404c-4d48-5176-8a9d-538d8488156b/4378404c-4d48-5176-8a9d-538d8488156b_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2du%252Ff2cbc0e9dc4d45c093fe0a6e1675c7fd%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2du/f2cbc0e9dc4d45c093fe0a6e1675c7fd/images/large/5.jpg saved to cache
2026-03-26 22:50:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4378404c-4d48-5176-8a9d-538d8488156b
2026-03-26 22:50:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c77650>
2026-03-26 22:50:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4378404c-4d48-5176-8a9d-538d8488156b/4378404c-4d48-5176-8a9d-538d8488156b_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2du%252Ff2cbc0e9dc4d45c093fe0a6e1675c7fd%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2du/f2cbc0e9dc4d45c093fe0a6e1675c7fd/images/large/7.jpg saved to cache
2026-03-26 22:50:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4378404c-4d48-5176-8a9d-538d8488156b
2026-03-26 22:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F4526e7d970ac4cf1881a043c4cb28d87%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/4526e7d970ac4cf1881a043c4cb28d87/images/large/6.jpg not downloaded yet
2026-03-26 22:50:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7415110>
2026-03-26 22:50:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4378404c-4d48-5176-8a9d-538d8488156b/4378404c-4d48-5176-8a9d-538d8488156b_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2du%252Ff2cbc0e9dc4d45c093fe0a6e1675c7fd%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2du/f2cbc0e9dc4d45c093fe0a6e1675c7fd/images/large/10.jpg saved to cache
2026-03-26 22:50:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4378404c-4d48-5176-8a9d-538d8488156b
2026-03-26 22:50:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7caad50>
2026-03-26 22:50:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4378404c-4d48-5176-8a9d-538d8488156b/4378404c-4d48-5176-8a9d-538d8488156b_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2du%252Ff2cbc0e9dc4d45c093fe0a6e1675c7fd%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2du/f2cbc0e9dc4d45c093fe0a6e1675c7fd/images/large/9.jpg saved to cache
2026-03-26 22:50:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4378404c-4d48-5176-8a9d-538d8488156b
2026-03-26 22:50:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7ce8ad0>
2026-03-26 22:50:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4378404c-4d48-5176-8a9d-538d8488156b/4378404c-4d48-5176-8a9d-538d8488156b_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2du%252Ff2cbc0e9dc4d45c093fe0a6e1675c7fd%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2du/f2cbc0e9dc4d45c093fe0a6e1675c7fd/images/large/8.jpg saved to cache
2026-03-26 22:50:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4378404c-4d48-5176-8a9d-538d8488156b
2026-03-26 22:50:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4378404c-4d48-5176-8a9d-538d8488156b, skipping ID generation
2026-03-26 22:50:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4378404c-4d48-5176-8a9d-538d8488156b with scrape type 1
2026-03-26 22:50:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4378404c-4d48-5176-8a9d-538d8488156b sending to next pipeline
2026-03-26 22:50:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 4378404c-4d48-5176-8a9d-538d8488156b, identifier: 1985405
2026-03-26 22:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F4526e7d970ac4cf1881a043c4cb28d87%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/4526e7d970ac4cf1881a043c4cb28d87/images/large/7.jpg not downloaded yet
2026-03-26 22:50:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 4378404c-4d48-5176-8a9d-538d8488156b with identifier: 1985405
2026-03-26 22:50:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 4378404c-4d48-5176-8a9d-538d8488156b with identifier: 1985405
2026-03-26 22:50:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 4378404c-4d48-5176-8a9d-538d8488156b with identifier: 1985405 to the API
2026-03-26 22:50:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:50:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:50:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2du/f2cbc0e9dc4d45c093fe0a6e1675c7fd/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '4378404c-4d48-5176-8a9d-538d8488156b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '1 SERIES HATCH',
 'odometer': 58116,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4378404c-4d48-5176-8a9d-538d8488156b/4378404c-4d48-5176-8a9d-538d8488156b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 289443,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2du/f2cbc0e9dc4d45c093fe0a6e1675c7fd/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4378404c-4d48-5176-8a9d-538d8488156b/4378404c-4d48-5176-8a9d-538d8488156b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 292256,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2du/f2cbc0e9dc4d45c093fe0a6e1675c7fd/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4378404c-4d48-5176-8a9d-538d8488156b/4378404c-4d48-5176-8a9d-538d8488156b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 313179,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2du/f2cbc0e9dc4d45c093fe0a6e1675c7fd/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4378404c-4d48-5176-8a9d-538d8488156b/4378404c-4d48-5176-8a9d-538d8488156b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 304539,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2du/f2cbc0e9dc4d45c093fe0a6e1675c7fd/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4378404c-4d48-5176-8a9d-538d8488156b/4378404c-4d48-5176-8a9d-538d8488156b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 300920,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2du/f2cbc0e9dc4d45c093fe0a6e1675c7fd/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4378404c-4d48-5176-8a9d-538d8488156b/4378404c-4d48-5176-8a9d-538d8488156b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 259385,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2du/f2cbc0e9dc4d45c093fe0a6e1675c7fd/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4378404c-4d48-5176-8a9d-538d8488156b/4378404c-4d48-5176-8a9d-538d8488156b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 335365,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2du/f2cbc0e9dc4d45c093fe0a6e1675c7fd/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4378404c-4d48-5176-8a9d-538d8488156b/4378404c-4d48-5176-8a9d-538d8488156b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 283418,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2du/f2cbc0e9dc4d45c093fe0a6e1675c7fd/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4378404c-4d48-5176-8a9d-538d8488156b/4378404c-4d48-5176-8a9d-538d8488156b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 309764,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2du/f2cbc0e9dc4d45c093fe0a6e1675c7fd/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4378404c-4d48-5176-8a9d-538d8488156b/4378404c-4d48-5176-8a9d-538d8488156b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 269512,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2du/f2cbc0e9dc4d45c093fe0a6e1675c7fd/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1 SERIES HATCH 1.5 116IA (80KW)',
 'transmission': 'automatic',
 'trim': '1.5 116IA (80KW)',
 'vin': None,
 'year': 2023}
2026-03-26 22:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985405%27 HTTP/1.1" 200 None
2026-03-26 22:50:46 [ayvens.be] INFO: Saving data for 1985405: {'created_time': 1774565446.256845, 'last_price_update_time': 1774565446.256857, 'auction_closing_time': 1774958400.0}
2026-03-26 22:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985405') HTTP/1.1" 204 0
2026-03-26 22:50:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/4526e7d970ac4cf1881a043c4cb28d87/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/4526e7d970ac4cf1881a043c4cb28d87/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/4526e7d970ac4cf1881a043c4cb28d87/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F4526e7d970ac4cf1881a043c4cb28d87%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/4526e7d970ac4cf1881a043c4cb28d87/images/large/8.jpg not downloaded yet
2026-03-26 22:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F4526e7d970ac4cf1881a043c4cb28d87%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/4526e7d970ac4cf1881a043c4cb28d87/images/large/9.jpg not downloaded yet
2026-03-26 22:50:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/4526e7d970ac4cf1881a043c4cb28d87/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F4526e7d970ac4cf1881a043c4cb28d87%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/4526e7d970ac4cf1881a043c4cb28d87/images/large/10.jpg not downloaded yet
2026-03-26 22:50:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/4526e7d970ac4cf1881a043c4cb28d87/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:46 [ayvens.be] INFO: Found listing with ID: 1985407
2026-03-26 22:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985407%27 HTTP/1.1" 200 None
2026-03-26 22:50:46 [ayvens.be] INFO: Scrape type for 1985407: 1
2026-03-26 22:50:46 [ayvens.be] INFO: Extracting data for car ID: 1985407
2026-03-26 22:50:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce58b6a6-8a34-5601-8af8-073b8badc5c5 with identifier: 1985407
2026-03-26 22:50:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce58b6a6-8a34-5601-8af8-073b8badc5c5 with scrape type 1
2026-03-26 22:50:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ce58b6a6-8a34-5601-8af8-073b8badc5c5
2026-03-26 22:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dj%252Fa7f39f93b0944ee5a59df9723b277079%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dj/a7f39f93b0944ee5a59df9723b277079/images/large/1.jpg not downloaded yet
2026-03-26 22:50:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/4526e7d970ac4cf1881a043c4cb28d87/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7726c50>
2026-03-26 22:50:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59caa32e-8ead-511a-a254-01be2d4c5584/59caa32e-8ead-511a-a254-01be2d4c5584_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F4526e7d970ac4cf1881a043c4cb28d87%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/4526e7d970ac4cf1881a043c4cb28d87/images/large/2.jpg saved to cache
2026-03-26 22:50:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 59caa32e-8ead-511a-a254-01be2d4c5584
2026-03-26 22:50:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7910dd0>
2026-03-26 22:50:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59caa32e-8ead-511a-a254-01be2d4c5584/59caa32e-8ead-511a-a254-01be2d4c5584_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F4526e7d970ac4cf1881a043c4cb28d87%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/4526e7d970ac4cf1881a043c4cb28d87/images/large/1.jpg saved to cache
2026-03-26 22:50:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 59caa32e-8ead-511a-a254-01be2d4c5584
2026-03-26 22:50:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b15e10>
2026-03-26 22:50:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59caa32e-8ead-511a-a254-01be2d4c5584/59caa32e-8ead-511a-a254-01be2d4c5584_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F4526e7d970ac4cf1881a043c4cb28d87%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/4526e7d970ac4cf1881a043c4cb28d87/images/large/3.jpg saved to cache
2026-03-26 22:50:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 59caa32e-8ead-511a-a254-01be2d4c5584
2026-03-26 22:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dj%252Fa7f39f93b0944ee5a59df9723b277079%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dj/a7f39f93b0944ee5a59df9723b277079/images/large/2.jpg not downloaded yet
2026-03-26 22:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dj%252Fa7f39f93b0944ee5a59df9723b277079%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dj/a7f39f93b0944ee5a59df9723b277079/images/large/3.jpg not downloaded yet
2026-03-26 22:50:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7911790>
2026-03-26 22:50:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59caa32e-8ead-511a-a254-01be2d4c5584/59caa32e-8ead-511a-a254-01be2d4c5584_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F4526e7d970ac4cf1881a043c4cb28d87%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/4526e7d970ac4cf1881a043c4cb28d87/images/large/4.jpg saved to cache
2026-03-26 22:50:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 59caa32e-8ead-511a-a254-01be2d4c5584
2026-03-26 22:50:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b9a790>
2026-03-26 22:50:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59caa32e-8ead-511a-a254-01be2d4c5584/59caa32e-8ead-511a-a254-01be2d4c5584_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F4526e7d970ac4cf1881a043c4cb28d87%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/4526e7d970ac4cf1881a043c4cb28d87/images/large/6.jpg saved to cache
2026-03-26 22:50:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 59caa32e-8ead-511a-a254-01be2d4c5584
2026-03-26 22:50:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7aa0b50>
2026-03-26 22:50:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59caa32e-8ead-511a-a254-01be2d4c5584/59caa32e-8ead-511a-a254-01be2d4c5584_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F4526e7d970ac4cf1881a043c4cb28d87%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/4526e7d970ac4cf1881a043c4cb28d87/images/large/5.jpg saved to cache
2026-03-26 22:50:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 59caa32e-8ead-511a-a254-01be2d4c5584
2026-03-26 22:50:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/4526e7d970ac4cf1881a043c4cb28d87/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/4526e7d970ac4cf1881a043c4cb28d87/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dj%252Fa7f39f93b0944ee5a59df9723b277079%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dj/a7f39f93b0944ee5a59df9723b277079/images/large/4.jpg not downloaded yet
2026-03-26 22:50:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/4526e7d970ac4cf1881a043c4cb28d87/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dj%252Fa7f39f93b0944ee5a59df9723b277079%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dj/a7f39f93b0944ee5a59df9723b277079/images/large/5.jpg not downloaded yet
2026-03-26 22:50:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/4526e7d970ac4cf1881a043c4cb28d87/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dj%252Fa7f39f93b0944ee5a59df9723b277079%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dj/a7f39f93b0944ee5a59df9723b277079/images/large/6.jpg not downloaded yet
2026-03-26 22:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dj%252Fa7f39f93b0944ee5a59df9723b277079%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dj/a7f39f93b0944ee5a59df9723b277079/images/large/7.jpg not downloaded yet
2026-03-26 22:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dj%252Fa7f39f93b0944ee5a59df9723b277079%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dj/a7f39f93b0944ee5a59df9723b277079/images/large/8.jpg not downloaded yet
2026-03-26 22:50:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7427410>
2026-03-26 22:50:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59caa32e-8ead-511a-a254-01be2d4c5584/59caa32e-8ead-511a-a254-01be2d4c5584_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F4526e7d970ac4cf1881a043c4cb28d87%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/4526e7d970ac4cf1881a043c4cb28d87/images/large/7.jpg saved to cache
2026-03-26 22:50:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 59caa32e-8ead-511a-a254-01be2d4c5584
2026-03-26 22:50:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74040d0>
2026-03-26 22:50:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59caa32e-8ead-511a-a254-01be2d4c5584/59caa32e-8ead-511a-a254-01be2d4c5584_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F4526e7d970ac4cf1881a043c4cb28d87%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/4526e7d970ac4cf1881a043c4cb28d87/images/large/8.jpg saved to cache
2026-03-26 22:50:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 59caa32e-8ead-511a-a254-01be2d4c5584
2026-03-26 22:50:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dj/a7f39f93b0944ee5a59df9723b277079/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dj%252Fa7f39f93b0944ee5a59df9723b277079%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dj/a7f39f93b0944ee5a59df9723b277079/images/large/9.jpg not downloaded yet
2026-03-26 22:50:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77278d0>
2026-03-26 22:50:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59caa32e-8ead-511a-a254-01be2d4c5584/59caa32e-8ead-511a-a254-01be2d4c5584_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F4526e7d970ac4cf1881a043c4cb28d87%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/4526e7d970ac4cf1881a043c4cb28d87/images/large/9.jpg saved to cache
2026-03-26 22:50:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 59caa32e-8ead-511a-a254-01be2d4c5584
2026-03-26 22:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dj%252Fa7f39f93b0944ee5a59df9723b277079%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dj/a7f39f93b0944ee5a59df9723b277079/images/large/10.jpg not downloaded yet
2026-03-26 22:50:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b9b690>
2026-03-26 22:50:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59caa32e-8ead-511a-a254-01be2d4c5584/59caa32e-8ead-511a-a254-01be2d4c5584_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F4526e7d970ac4cf1881a043c4cb28d87%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/4526e7d970ac4cf1881a043c4cb28d87/images/large/10.jpg saved to cache
2026-03-26 22:50:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 59caa32e-8ead-511a-a254-01be2d4c5584
2026-03-26 22:50:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 59caa32e-8ead-511a-a254-01be2d4c5584, skipping ID generation
2026-03-26 22:50:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 59caa32e-8ead-511a-a254-01be2d4c5584 with scrape type 1
2026-03-26 22:50:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 59caa32e-8ead-511a-a254-01be2d4c5584 sending to next pipeline
2026-03-26 22:50:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 59caa32e-8ead-511a-a254-01be2d4c5584, identifier: 1985406
2026-03-26 22:50:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 59caa32e-8ead-511a-a254-01be2d4c5584 with identifier: 1985406
2026-03-26 22:50:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 59caa32e-8ead-511a-a254-01be2d4c5584 with identifier: 1985406
2026-03-26 22:50:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 59caa32e-8ead-511a-a254-01be2d4c5584 with identifier: 1985406 to the API
2026-03-26 22:50:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:50:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:50:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cr/4526e7d970ac4cf1881a043c4cb28d87/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '59caa32e-8ead-511a-a254-01be2d4c5584',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'XCEED',
 'odometer': 61231,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59caa32e-8ead-511a-a254-01be2d4c5584/59caa32e-8ead-511a-a254-01be2d4c5584_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 244129,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/4526e7d970ac4cf1881a043c4cb28d87/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59caa32e-8ead-511a-a254-01be2d4c5584/59caa32e-8ead-511a-a254-01be2d4c5584_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 231577,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/4526e7d970ac4cf1881a043c4cb28d87/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59caa32e-8ead-511a-a254-01be2d4c5584/59caa32e-8ead-511a-a254-01be2d4c5584_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 261399,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/4526e7d970ac4cf1881a043c4cb28d87/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59caa32e-8ead-511a-a254-01be2d4c5584/59caa32e-8ead-511a-a254-01be2d4c5584_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 263847,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/4526e7d970ac4cf1881a043c4cb28d87/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59caa32e-8ead-511a-a254-01be2d4c5584/59caa32e-8ead-511a-a254-01be2d4c5584_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 333287,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/4526e7d970ac4cf1881a043c4cb28d87/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59caa32e-8ead-511a-a254-01be2d4c5584/59caa32e-8ead-511a-a254-01be2d4c5584_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 279673,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/4526e7d970ac4cf1881a043c4cb28d87/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59caa32e-8ead-511a-a254-01be2d4c5584/59caa32e-8ead-511a-a254-01be2d4c5584_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 308671,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/4526e7d970ac4cf1881a043c4cb28d87/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59caa32e-8ead-511a-a254-01be2d4c5584/59caa32e-8ead-511a-a254-01be2d4c5584_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 303069,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/4526e7d970ac4cf1881a043c4cb28d87/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59caa32e-8ead-511a-a254-01be2d4c5584/59caa32e-8ead-511a-a254-01be2d4c5584_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 300210,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/4526e7d970ac4cf1881a043c4cb28d87/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59caa32e-8ead-511a-a254-01be2d4c5584/59caa32e-8ead-511a-a254-01be2d4c5584_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 230223,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/4526e7d970ac4cf1881a043c4cb28d87/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA XCEED 1.6 GDI PHEV DCT BUSINESS LINE',
 'transmission': 'automatic',
 'trim': '1.6 GDI PHEV DCT BUSINESS LINE',
 'vin': None,
 'year': 2022}
2026-03-26 22:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985406%27 HTTP/1.1" 200 None
2026-03-26 22:50:47 [ayvens.be] INFO: Saving data for 1985406: {'created_time': 1774565447.873638, 'last_price_update_time': 1774565447.873647, 'auction_closing_time': 1774958400.0}
2026-03-26 22:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985406') HTTP/1.1" 204 0
2026-03-26 22:50:47 [ayvens.be] INFO: Found listing with ID: 1985408
2026-03-26 22:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985408%27 HTTP/1.1" 200 None
2026-03-26 22:50:47 [ayvens.be] INFO: Scrape type for 1985408: 1
2026-03-26 22:50:47 [ayvens.be] INFO: Extracting data for car ID: 1985408
2026-03-26 22:50:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7eacb2e9-21c7-546e-a8ff-8314d7a7253a with identifier: 1985408
2026-03-26 22:50:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7eacb2e9-21c7-546e-a8ff-8314d7a7253a with scrape type 1
2026-03-26 22:50:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7eacb2e9-21c7-546e-a8ff-8314d7a7253a
2026-03-26 22:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F188df062d54247629e32e4d638024501%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/188df062d54247629e32e4d638024501/images/large/1.jpg not downloaded yet
2026-03-26 22:50:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dj/a7f39f93b0944ee5a59df9723b277079/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dj/a7f39f93b0944ee5a59df9723b277079/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F188df062d54247629e32e4d638024501%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/188df062d54247629e32e4d638024501/images/large/2.jpg not downloaded yet
2026-03-26 22:50:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b15f10>
2026-03-26 22:50:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce58b6a6-8a34-5601-8af8-073b8badc5c5/ce58b6a6-8a34-5601-8af8-073b8badc5c5_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dj%252Fa7f39f93b0944ee5a59df9723b277079%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dj/a7f39f93b0944ee5a59df9723b277079/images/large/1.jpg saved to cache
2026-03-26 22:50:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ce58b6a6-8a34-5601-8af8-073b8badc5c5
2026-03-26 22:50:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dj/a7f39f93b0944ee5a59df9723b277079/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F188df062d54247629e32e4d638024501%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/188df062d54247629e32e4d638024501/images/large/3.jpg not downloaded yet
2026-03-26 22:50:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7779a90>
2026-03-26 22:50:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce58b6a6-8a34-5601-8af8-073b8badc5c5/ce58b6a6-8a34-5601-8af8-073b8badc5c5_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dj%252Fa7f39f93b0944ee5a59df9723b277079%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dj/a7f39f93b0944ee5a59df9723b277079/images/large/3.jpg saved to cache
2026-03-26 22:50:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ce58b6a6-8a34-5601-8af8-073b8badc5c5
2026-03-26 22:50:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7a54c10>
2026-03-26 22:50:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce58b6a6-8a34-5601-8af8-073b8badc5c5/ce58b6a6-8a34-5601-8af8-073b8badc5c5_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dj%252Fa7f39f93b0944ee5a59df9723b277079%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dj/a7f39f93b0944ee5a59df9723b277079/images/large/2.jpg saved to cache
2026-03-26 22:50:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ce58b6a6-8a34-5601-8af8-073b8badc5c5
2026-03-26 22:50:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dj/a7f39f93b0944ee5a59df9723b277079/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dj/a7f39f93b0944ee5a59df9723b277079/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F188df062d54247629e32e4d638024501%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/188df062d54247629e32e4d638024501/images/large/4.jpg not downloaded yet
2026-03-26 22:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F188df062d54247629e32e4d638024501%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/188df062d54247629e32e4d638024501/images/large/5.jpg not downloaded yet
2026-03-26 22:50:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7414250>
2026-03-26 22:50:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce58b6a6-8a34-5601-8af8-073b8badc5c5/ce58b6a6-8a34-5601-8af8-073b8badc5c5_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dj%252Fa7f39f93b0944ee5a59df9723b277079%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dj/a7f39f93b0944ee5a59df9723b277079/images/large/4.jpg saved to cache
2026-03-26 22:50:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ce58b6a6-8a34-5601-8af8-073b8badc5c5
2026-03-26 22:50:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dj/a7f39f93b0944ee5a59df9723b277079/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F188df062d54247629e32e4d638024501%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/188df062d54247629e32e4d638024501/images/large/6.jpg not downloaded yet
2026-03-26 22:50:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dj/a7f39f93b0944ee5a59df9723b277079/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dj/a7f39f93b0944ee5a59df9723b277079/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7725690>
2026-03-26 22:50:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce58b6a6-8a34-5601-8af8-073b8badc5c5/ce58b6a6-8a34-5601-8af8-073b8badc5c5_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dj%252Fa7f39f93b0944ee5a59df9723b277079%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dj/a7f39f93b0944ee5a59df9723b277079/images/large/5.jpg saved to cache
2026-03-26 22:50:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ce58b6a6-8a34-5601-8af8-073b8badc5c5
2026-03-26 22:50:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74148d0>
2026-03-26 22:50:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce58b6a6-8a34-5601-8af8-073b8badc5c5/ce58b6a6-8a34-5601-8af8-073b8badc5c5_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dj%252Fa7f39f93b0944ee5a59df9723b277079%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dj/a7f39f93b0944ee5a59df9723b277079/images/large/6.jpg saved to cache
2026-03-26 22:50:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ce58b6a6-8a34-5601-8af8-073b8badc5c5
2026-03-26 22:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F188df062d54247629e32e4d638024501%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/188df062d54247629e32e4d638024501/images/large/7.jpg not downloaded yet
2026-03-26 22:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F188df062d54247629e32e4d638024501%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/188df062d54247629e32e4d638024501/images/large/8.jpg not downloaded yet
2026-03-26 22:50:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74107d0>
2026-03-26 22:50:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce58b6a6-8a34-5601-8af8-073b8badc5c5/ce58b6a6-8a34-5601-8af8-073b8badc5c5_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dj%252Fa7f39f93b0944ee5a59df9723b277079%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dj/a7f39f93b0944ee5a59df9723b277079/images/large/7.jpg saved to cache
2026-03-26 22:50:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ce58b6a6-8a34-5601-8af8-073b8badc5c5
2026-03-26 22:50:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e35210>
2026-03-26 22:50:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce58b6a6-8a34-5601-8af8-073b8badc5c5/ce58b6a6-8a34-5601-8af8-073b8badc5c5_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dj%252Fa7f39f93b0944ee5a59df9723b277079%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dj/a7f39f93b0944ee5a59df9723b277079/images/large/8.jpg saved to cache
2026-03-26 22:50:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ce58b6a6-8a34-5601-8af8-073b8badc5c5
2026-03-26 22:50:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79a79d0>
2026-03-26 22:50:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce58b6a6-8a34-5601-8af8-073b8badc5c5/ce58b6a6-8a34-5601-8af8-073b8badc5c5_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dj%252Fa7f39f93b0944ee5a59df9723b277079%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dj/a7f39f93b0944ee5a59df9723b277079/images/large/9.jpg saved to cache
2026-03-26 22:50:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ce58b6a6-8a34-5601-8af8-073b8badc5c5
2026-03-26 22:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F188df062d54247629e32e4d638024501%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/188df062d54247629e32e4d638024501/images/large/9.jpg not downloaded yet
2026-03-26 22:50:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dj/a7f39f93b0944ee5a59df9723b277079/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/188df062d54247629e32e4d638024501/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F188df062d54247629e32e4d638024501%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/188df062d54247629e32e4d638024501/images/large/10.jpg not downloaded yet
2026-03-26 22:50:49 [ayvens.be] INFO: Found listing with ID: 1985409
2026-03-26 22:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985409%27 HTTP/1.1" 200 None
2026-03-26 22:50:49 [ayvens.be] INFO: Scrape type for 1985409: 1
2026-03-26 22:50:49 [ayvens.be] INFO: Extracting data for car ID: 1985409
2026-03-26 22:50:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8901dd7c-fe65-538f-9a8d-02dcb9b8fabb with identifier: 1985409
2026-03-26 22:50:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8901dd7c-fe65-538f-9a8d-02dcb9b8fabb with scrape type 1
2026-03-26 22:50:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8901dd7c-fe65-538f-9a8d-02dcb9b8fabb
2026-03-26 22:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F5fd8a4208ee74db99f73f13321c2f2f0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/5fd8a4208ee74db99f73f13321c2f2f0/images/large/1.jpg not downloaded yet
2026-03-26 22:50:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/188df062d54247629e32e4d638024501/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/188df062d54247629e32e4d638024501/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F5fd8a4208ee74db99f73f13321c2f2f0%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/5fd8a4208ee74db99f73f13321c2f2f0/images/large/2.jpg not downloaded yet
2026-03-26 22:50:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/188df062d54247629e32e4d638024501/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F5fd8a4208ee74db99f73f13321c2f2f0%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/5fd8a4208ee74db99f73f13321c2f2f0/images/large/3.jpg not downloaded yet
2026-03-26 22:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F5fd8a4208ee74db99f73f13321c2f2f0%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/5fd8a4208ee74db99f73f13321c2f2f0/images/large/4.jpg not downloaded yet
2026-03-26 22:50:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/188df062d54247629e32e4d638024501/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/188df062d54247629e32e4d638024501/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cc8650>
2026-03-26 22:50:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce58b6a6-8a34-5601-8af8-073b8badc5c5/ce58b6a6-8a34-5601-8af8-073b8badc5c5_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dj%252Fa7f39f93b0944ee5a59df9723b277079%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dj/a7f39f93b0944ee5a59df9723b277079/images/large/10.jpg saved to cache
2026-03-26 22:50:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ce58b6a6-8a34-5601-8af8-073b8badc5c5
2026-03-26 22:50:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ce58b6a6-8a34-5601-8af8-073b8badc5c5, skipping ID generation
2026-03-26 22:50:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce58b6a6-8a34-5601-8af8-073b8badc5c5 with scrape type 1
2026-03-26 22:50:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ce58b6a6-8a34-5601-8af8-073b8badc5c5 sending to next pipeline
2026-03-26 22:50:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: ce58b6a6-8a34-5601-8af8-073b8badc5c5, identifier: 1985407
2026-03-26 22:50:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c60f50>
2026-03-26 22:50:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7eacb2e9-21c7-546e-a8ff-8314d7a7253a/7eacb2e9-21c7-546e-a8ff-8314d7a7253a_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F188df062d54247629e32e4d638024501%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/188df062d54247629e32e4d638024501/images/large/1.jpg saved to cache
2026-03-26 22:50:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7eacb2e9-21c7-546e-a8ff-8314d7a7253a
2026-03-26 22:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F5fd8a4208ee74db99f73f13321c2f2f0%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/5fd8a4208ee74db99f73f13321c2f2f0/images/large/5.jpg not downloaded yet
2026-03-26 22:50:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: ce58b6a6-8a34-5601-8af8-073b8badc5c5 with identifier: 1985407
2026-03-26 22:50:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: ce58b6a6-8a34-5601-8af8-073b8badc5c5 with identifier: 1985407
2026-03-26 22:50:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: ce58b6a6-8a34-5601-8af8-073b8badc5c5 with identifier: 1985407 to the API
2026-03-26 22:50:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:50:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:50:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2dj/a7f39f93b0944ee5a59df9723b277079/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'ce58b6a6-8a34-5601-8af8-073b8badc5c5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLA SHOOTING BRAKE',
 'odometer': 60155,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce58b6a6-8a34-5601-8af8-073b8badc5c5/ce58b6a6-8a34-5601-8af8-073b8badc5c5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 592671,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dj/a7f39f93b0944ee5a59df9723b277079/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce58b6a6-8a34-5601-8af8-073b8badc5c5/ce58b6a6-8a34-5601-8af8-073b8badc5c5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 541511,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dj/a7f39f93b0944ee5a59df9723b277079/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce58b6a6-8a34-5601-8af8-073b8badc5c5/ce58b6a6-8a34-5601-8af8-073b8badc5c5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 583508,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dj/a7f39f93b0944ee5a59df9723b277079/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce58b6a6-8a34-5601-8af8-073b8badc5c5/ce58b6a6-8a34-5601-8af8-073b8badc5c5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 626727,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dj/a7f39f93b0944ee5a59df9723b277079/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce58b6a6-8a34-5601-8af8-073b8badc5c5/ce58b6a6-8a34-5601-8af8-073b8badc5c5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 595788,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dj/a7f39f93b0944ee5a59df9723b277079/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce58b6a6-8a34-5601-8af8-073b8badc5c5/ce58b6a6-8a34-5601-8af8-073b8badc5c5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 636668,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dj/a7f39f93b0944ee5a59df9723b277079/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce58b6a6-8a34-5601-8af8-073b8badc5c5/ce58b6a6-8a34-5601-8af8-073b8badc5c5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 662679,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dj/a7f39f93b0944ee5a59df9723b277079/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce58b6a6-8a34-5601-8af8-073b8badc5c5/ce58b6a6-8a34-5601-8af8-073b8badc5c5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 755904,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dj/a7f39f93b0944ee5a59df9723b277079/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce58b6a6-8a34-5601-8af8-073b8badc5c5/ce58b6a6-8a34-5601-8af8-073b8badc5c5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 649461,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dj/a7f39f93b0944ee5a59df9723b277079/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce58b6a6-8a34-5601-8af8-073b8badc5c5/ce58b6a6-8a34-5601-8af8-073b8badc5c5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 670172,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dj/a7f39f93b0944ee5a59df9723b277079/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLA SHOOTING BRAKE 1.3 CLA 250 E LUXURY LINE DCT SH '
          'BR',
 'transmission': 'automatic',
 'trim': '1.3 CLA 250 E LUXURY LINE DCT SH BR',
 'vin': None,
 'year': 2023}
2026-03-26 22:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985407%27 HTTP/1.1" 200 None
2026-03-26 22:50:50 [ayvens.be] INFO: Saving data for 1985407: {'created_time': 1774565450.413531, 'last_price_update_time': 1774565450.41354, 'auction_closing_time': 1774958400.0}
2026-03-26 22:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985407') HTTP/1.1" 204 0
2026-03-26 22:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F5fd8a4208ee74db99f73f13321c2f2f0%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/5fd8a4208ee74db99f73f13321c2f2f0/images/large/6.jpg not downloaded yet
2026-03-26 22:50:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/188df062d54247629e32e4d638024501/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b75936d0>
2026-03-26 22:50:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7eacb2e9-21c7-546e-a8ff-8314d7a7253a/7eacb2e9-21c7-546e-a8ff-8314d7a7253a_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F188df062d54247629e32e4d638024501%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/188df062d54247629e32e4d638024501/images/large/3.jpg saved to cache
2026-03-26 22:50:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7eacb2e9-21c7-546e-a8ff-8314d7a7253a
2026-03-26 22:50:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77d6fd0>
2026-03-26 22:50:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7eacb2e9-21c7-546e-a8ff-8314d7a7253a/7eacb2e9-21c7-546e-a8ff-8314d7a7253a_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F188df062d54247629e32e4d638024501%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/188df062d54247629e32e4d638024501/images/large/2.jpg saved to cache
2026-03-26 22:50:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7eacb2e9-21c7-546e-a8ff-8314d7a7253a
2026-03-26 22:50:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cb2290>
2026-03-26 22:50:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7eacb2e9-21c7-546e-a8ff-8314d7a7253a/7eacb2e9-21c7-546e-a8ff-8314d7a7253a_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F188df062d54247629e32e4d638024501%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/188df062d54247629e32e4d638024501/images/large/4.jpg saved to cache
2026-03-26 22:50:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7eacb2e9-21c7-546e-a8ff-8314d7a7253a
2026-03-26 22:50:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77d4290>
2026-03-26 22:50:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7eacb2e9-21c7-546e-a8ff-8314d7a7253a/7eacb2e9-21c7-546e-a8ff-8314d7a7253a_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F188df062d54247629e32e4d638024501%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/188df062d54247629e32e4d638024501/images/large/5.jpg saved to cache
2026-03-26 22:50:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7eacb2e9-21c7-546e-a8ff-8314d7a7253a
2026-03-26 22:50:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e1f790>
2026-03-26 22:50:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7eacb2e9-21c7-546e-a8ff-8314d7a7253a/7eacb2e9-21c7-546e-a8ff-8314d7a7253a_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F188df062d54247629e32e4d638024501%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/188df062d54247629e32e4d638024501/images/large/6.jpg saved to cache
2026-03-26 22:50:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7eacb2e9-21c7-546e-a8ff-8314d7a7253a
2026-03-26 22:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F5fd8a4208ee74db99f73f13321c2f2f0%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/5fd8a4208ee74db99f73f13321c2f2f0/images/large/7.jpg not downloaded yet
2026-03-26 22:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F5fd8a4208ee74db99f73f13321c2f2f0%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/5fd8a4208ee74db99f73f13321c2f2f0/images/large/8.jpg not downloaded yet
2026-03-26 22:50:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/188df062d54247629e32e4d638024501/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/188df062d54247629e32e4d638024501/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F5fd8a4208ee74db99f73f13321c2f2f0%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/5fd8a4208ee74db99f73f13321c2f2f0/images/large/9.jpg not downloaded yet
2026-03-26 22:50:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76a7710>
2026-03-26 22:50:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7eacb2e9-21c7-546e-a8ff-8314d7a7253a/7eacb2e9-21c7-546e-a8ff-8314d7a7253a_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F188df062d54247629e32e4d638024501%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/188df062d54247629e32e4d638024501/images/large/7.jpg saved to cache
2026-03-26 22:50:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7eacb2e9-21c7-546e-a8ff-8314d7a7253a
2026-03-26 22:50:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/5fd8a4208ee74db99f73f13321c2f2f0/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/5fd8a4208ee74db99f73f13321c2f2f0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F5fd8a4208ee74db99f73f13321c2f2f0%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/5fd8a4208ee74db99f73f13321c2f2f0/images/large/10.jpg not downloaded yet
2026-03-26 22:50:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/188df062d54247629e32e4d638024501/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:51 [ayvens.be] INFO: Found listing with ID: 1985410
2026-03-26 22:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985410%27 HTTP/1.1" 200 None
2026-03-26 22:50:51 [ayvens.be] INFO: Scrape type for 1985410: 1
2026-03-26 22:50:51 [ayvens.be] INFO: Extracting data for car ID: 1985410
2026-03-26 22:50:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b69abcb1-2d81-5245-b20d-dba2e0f2ba47 with identifier: 1985410
2026-03-26 22:50:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b69abcb1-2d81-5245-b20d-dba2e0f2ba47 with scrape type 1
2026-03-26 22:50:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b69abcb1-2d81-5245-b20d-dba2e0f2ba47
2026-03-26 22:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252Fc66dfbd95d474a62965e7804a52e75dd%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/c66dfbd95d474a62965e7804a52e75dd/images/large/1.jpg not downloaded yet
2026-03-26 22:50:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76e0150>
2026-03-26 22:50:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7eacb2e9-21c7-546e-a8ff-8314d7a7253a/7eacb2e9-21c7-546e-a8ff-8314d7a7253a_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F188df062d54247629e32e4d638024501%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/188df062d54247629e32e4d638024501/images/large/9.jpg saved to cache
2026-03-26 22:50:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7eacb2e9-21c7-546e-a8ff-8314d7a7253a
2026-03-26 22:50:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7a61350>
2026-03-26 22:50:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7eacb2e9-21c7-546e-a8ff-8314d7a7253a/7eacb2e9-21c7-546e-a8ff-8314d7a7253a_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F188df062d54247629e32e4d638024501%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/188df062d54247629e32e4d638024501/images/large/8.jpg saved to cache
2026-03-26 22:50:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7eacb2e9-21c7-546e-a8ff-8314d7a7253a
2026-03-26 22:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252Fc66dfbd95d474a62965e7804a52e75dd%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/c66dfbd95d474a62965e7804a52e75dd/images/large/2.jpg not downloaded yet
2026-03-26 22:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252Fc66dfbd95d474a62965e7804a52e75dd%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/c66dfbd95d474a62965e7804a52e75dd/images/large/3.jpg not downloaded yet
2026-03-26 22:50:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b78c2c50>
2026-03-26 22:50:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8901dd7c-fe65-538f-9a8d-02dcb9b8fabb/8901dd7c-fe65-538f-9a8d-02dcb9b8fabb_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F5fd8a4208ee74db99f73f13321c2f2f0%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/5fd8a4208ee74db99f73f13321c2f2f0/images/large/2.jpg saved to cache
2026-03-26 22:50:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8901dd7c-fe65-538f-9a8d-02dcb9b8fabb
2026-03-26 22:50:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7caabd0>
2026-03-26 22:50:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8901dd7c-fe65-538f-9a8d-02dcb9b8fabb/8901dd7c-fe65-538f-9a8d-02dcb9b8fabb_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F5fd8a4208ee74db99f73f13321c2f2f0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/5fd8a4208ee74db99f73f13321c2f2f0/images/large/1.jpg saved to cache
2026-03-26 22:50:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8901dd7c-fe65-538f-9a8d-02dcb9b8fabb
2026-03-26 22:50:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74aead0>
2026-03-26 22:50:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7eacb2e9-21c7-546e-a8ff-8314d7a7253a/7eacb2e9-21c7-546e-a8ff-8314d7a7253a_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F188df062d54247629e32e4d638024501%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/188df062d54247629e32e4d638024501/images/large/10.jpg saved to cache
2026-03-26 22:50:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7eacb2e9-21c7-546e-a8ff-8314d7a7253a
2026-03-26 22:50:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7eacb2e9-21c7-546e-a8ff-8314d7a7253a, skipping ID generation
2026-03-26 22:50:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7eacb2e9-21c7-546e-a8ff-8314d7a7253a with scrape type 1
2026-03-26 22:50:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7eacb2e9-21c7-546e-a8ff-8314d7a7253a sending to next pipeline
2026-03-26 22:50:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 7eacb2e9-21c7-546e-a8ff-8314d7a7253a, identifier: 1985408
2026-03-26 22:50:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/5fd8a4208ee74db99f73f13321c2f2f0/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/5fd8a4208ee74db99f73f13321c2f2f0/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/5fd8a4208ee74db99f73f13321c2f2f0/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 7eacb2e9-21c7-546e-a8ff-8314d7a7253a with identifier: 1985408
2026-03-26 22:50:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 7eacb2e9-21c7-546e-a8ff-8314d7a7253a with identifier: 1985408
2026-03-26 22:50:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 7eacb2e9-21c7-546e-a8ff-8314d7a7253a with identifier: 1985408 to the API
2026-03-26 22:50:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:50:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:50:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ac/188df062d54247629e32e4d638024501/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '7eacb2e9-21c7-546e-a8ff-8314d7a7253a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 120135,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7eacb2e9-21c7-546e-a8ff-8314d7a7253a/7eacb2e9-21c7-546e-a8ff-8314d7a7253a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 761023,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/188df062d54247629e32e4d638024501/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7eacb2e9-21c7-546e-a8ff-8314d7a7253a/7eacb2e9-21c7-546e-a8ff-8314d7a7253a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 794782,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/188df062d54247629e32e4d638024501/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7eacb2e9-21c7-546e-a8ff-8314d7a7253a/7eacb2e9-21c7-546e-a8ff-8314d7a7253a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 806120,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/188df062d54247629e32e4d638024501/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7eacb2e9-21c7-546e-a8ff-8314d7a7253a/7eacb2e9-21c7-546e-a8ff-8314d7a7253a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 784204,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/188df062d54247629e32e4d638024501/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7eacb2e9-21c7-546e-a8ff-8314d7a7253a/7eacb2e9-21c7-546e-a8ff-8314d7a7253a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 776725,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/188df062d54247629e32e4d638024501/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7eacb2e9-21c7-546e-a8ff-8314d7a7253a/7eacb2e9-21c7-546e-a8ff-8314d7a7253a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 739037,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/188df062d54247629e32e4d638024501/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7eacb2e9-21c7-546e-a8ff-8314d7a7253a/7eacb2e9-21c7-546e-a8ff-8314d7a7253a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 601887,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/188df062d54247629e32e4d638024501/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7eacb2e9-21c7-546e-a8ff-8314d7a7253a/7eacb2e9-21c7-546e-a8ff-8314d7a7253a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 748106,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/188df062d54247629e32e4d638024501/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7eacb2e9-21c7-546e-a8ff-8314d7a7253a/7eacb2e9-21c7-546e-a8ff-8314d7a7253a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 749399,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/188df062d54247629e32e4d638024501/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7eacb2e9-21c7-546e-a8ff-8314d7a7253a/7eacb2e9-21c7-546e-a8ff-8314d7a7253a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 722785,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/188df062d54247629e32e4d638024501/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T4 RECHARGE GEARTR. INSCRIPTION EXPR',
 'transmission': 'automatic',
 'trim': '1.5 T4 RECHARGE GEARTR. INSCRIPTION EXPR',
 'vin': None,
 'year': 2021}
2026-03-26 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985408%27 HTTP/1.1" 200 None
2026-03-26 22:50:52 [ayvens.be] INFO: Saving data for 1985408: {'created_time': 1774565452.17277, 'last_price_update_time': 1774565452.172779, 'auction_closing_time': 1774958400.0}
2026-03-26 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985408') HTTP/1.1" 204 0
2026-03-26 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252Fc66dfbd95d474a62965e7804a52e75dd%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/c66dfbd95d474a62965e7804a52e75dd/images/large/4.jpg not downloaded yet
2026-03-26 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252Fc66dfbd95d474a62965e7804a52e75dd%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/c66dfbd95d474a62965e7804a52e75dd/images/large/5.jpg not downloaded yet
2026-03-26 22:50:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76e0f90>
2026-03-26 22:50:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8901dd7c-fe65-538f-9a8d-02dcb9b8fabb/8901dd7c-fe65-538f-9a8d-02dcb9b8fabb_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F5fd8a4208ee74db99f73f13321c2f2f0%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/5fd8a4208ee74db99f73f13321c2f2f0/images/large/3.jpg saved to cache
2026-03-26 22:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8901dd7c-fe65-538f-9a8d-02dcb9b8fabb
2026-03-26 22:50:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7724890>
2026-03-26 22:50:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8901dd7c-fe65-538f-9a8d-02dcb9b8fabb/8901dd7c-fe65-538f-9a8d-02dcb9b8fabb_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F5fd8a4208ee74db99f73f13321c2f2f0%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/5fd8a4208ee74db99f73f13321c2f2f0/images/large/5.jpg saved to cache
2026-03-26 22:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8901dd7c-fe65-538f-9a8d-02dcb9b8fabb
2026-03-26 22:50:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b777b2d0>
2026-03-26 22:50:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8901dd7c-fe65-538f-9a8d-02dcb9b8fabb/8901dd7c-fe65-538f-9a8d-02dcb9b8fabb_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F5fd8a4208ee74db99f73f13321c2f2f0%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/5fd8a4208ee74db99f73f13321c2f2f0/images/large/4.jpg saved to cache
2026-03-26 22:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8901dd7c-fe65-538f-9a8d-02dcb9b8fabb
2026-03-26 22:50:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/5fd8a4208ee74db99f73f13321c2f2f0/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/5fd8a4208ee74db99f73f13321c2f2f0/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/5fd8a4208ee74db99f73f13321c2f2f0/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252Fc66dfbd95d474a62965e7804a52e75dd%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/c66dfbd95d474a62965e7804a52e75dd/images/large/6.jpg not downloaded yet
2026-03-26 22:50:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/5fd8a4208ee74db99f73f13321c2f2f0/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252Fc66dfbd95d474a62965e7804a52e75dd%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/c66dfbd95d474a62965e7804a52e75dd/images/large/7.jpg not downloaded yet
2026-03-26 22:50:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1uq/c66dfbd95d474a62965e7804a52e75dd/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252Fc66dfbd95d474a62965e7804a52e75dd%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/c66dfbd95d474a62965e7804a52e75dd/images/large/8.jpg not downloaded yet
2026-03-26 22:50:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/5fd8a4208ee74db99f73f13321c2f2f0/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1uq/c66dfbd95d474a62965e7804a52e75dd/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1uq/c66dfbd95d474a62965e7804a52e75dd/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252Fc66dfbd95d474a62965e7804a52e75dd%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/c66dfbd95d474a62965e7804a52e75dd/images/large/9.jpg not downloaded yet
2026-03-26 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252Fc66dfbd95d474a62965e7804a52e75dd%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/c66dfbd95d474a62965e7804a52e75dd/images/large/10.jpg not downloaded yet
2026-03-26 22:50:52 [ayvens.be] INFO: Found listing with ID: 1985411
2026-03-26 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985411%27 HTTP/1.1" 200 None
2026-03-26 22:50:52 [ayvens.be] INFO: Scrape type for 1985411: 1
2026-03-26 22:50:52 [ayvens.be] INFO: Extracting data for car ID: 1985411
2026-03-26 22:50:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6329b518-a0d7-5100-aa37-31aadb1cd7a5 with identifier: 1985411
2026-03-26 22:50:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6329b518-a0d7-5100-aa37-31aadb1cd7a5 with scrape type 1
2026-03-26 22:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6329b518-a0d7-5100-aa37-31aadb1cd7a5
2026-03-26 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F03719f7bc2b244bea71fc7d0572c6a88%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/03719f7bc2b244bea71fc7d0572c6a88/images/large/1.jpg not downloaded yet
2026-03-26 22:50:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e01990>
2026-03-26 22:50:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8901dd7c-fe65-538f-9a8d-02dcb9b8fabb/8901dd7c-fe65-538f-9a8d-02dcb9b8fabb_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F5fd8a4208ee74db99f73f13321c2f2f0%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/5fd8a4208ee74db99f73f13321c2f2f0/images/large/7.jpg saved to cache
2026-03-26 22:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8901dd7c-fe65-538f-9a8d-02dcb9b8fabb
2026-03-26 22:50:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cb1490>
2026-03-26 22:50:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8901dd7c-fe65-538f-9a8d-02dcb9b8fabb/8901dd7c-fe65-538f-9a8d-02dcb9b8fabb_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F5fd8a4208ee74db99f73f13321c2f2f0%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/5fd8a4208ee74db99f73f13321c2f2f0/images/large/6.jpg saved to cache
2026-03-26 22:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8901dd7c-fe65-538f-9a8d-02dcb9b8fabb
2026-03-26 22:50:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6df2d90>
2026-03-26 22:50:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8901dd7c-fe65-538f-9a8d-02dcb9b8fabb/8901dd7c-fe65-538f-9a8d-02dcb9b8fabb_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F5fd8a4208ee74db99f73f13321c2f2f0%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/5fd8a4208ee74db99f73f13321c2f2f0/images/large/9.jpg saved to cache
2026-03-26 22:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8901dd7c-fe65-538f-9a8d-02dcb9b8fabb
2026-03-26 22:50:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1uq/c66dfbd95d474a62965e7804a52e75dd/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F03719f7bc2b244bea71fc7d0572c6a88%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/03719f7bc2b244bea71fc7d0572c6a88/images/large/2.jpg not downloaded yet
2026-03-26 22:50:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1uq/c66dfbd95d474a62965e7804a52e75dd/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c83310>
2026-03-26 22:50:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8901dd7c-fe65-538f-9a8d-02dcb9b8fabb/8901dd7c-fe65-538f-9a8d-02dcb9b8fabb_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F5fd8a4208ee74db99f73f13321c2f2f0%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/5fd8a4208ee74db99f73f13321c2f2f0/images/large/8.jpg saved to cache
2026-03-26 22:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8901dd7c-fe65-538f-9a8d-02dcb9b8fabb
2026-03-26 22:50:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1uq/c66dfbd95d474a62965e7804a52e75dd/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F03719f7bc2b244bea71fc7d0572c6a88%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/03719f7bc2b244bea71fc7d0572c6a88/images/large/3.jpg not downloaded yet
2026-03-26 22:50:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7aa2510>
2026-03-26 22:50:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b69abcb1-2d81-5245-b20d-dba2e0f2ba47/b69abcb1-2d81-5245-b20d-dba2e0f2ba47_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252Fc66dfbd95d474a62965e7804a52e75dd%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/c66dfbd95d474a62965e7804a52e75dd/images/large/1.jpg saved to cache
2026-03-26 22:50:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b69abcb1-2d81-5245-b20d-dba2e0f2ba47
2026-03-26 22:50:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7aa0b90>
2026-03-26 22:50:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8901dd7c-fe65-538f-9a8d-02dcb9b8fabb/8901dd7c-fe65-538f-9a8d-02dcb9b8fabb_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F5fd8a4208ee74db99f73f13321c2f2f0%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/5fd8a4208ee74db99f73f13321c2f2f0/images/large/10.jpg saved to cache
2026-03-26 22:50:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8901dd7c-fe65-538f-9a8d-02dcb9b8fabb
2026-03-26 22:50:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8901dd7c-fe65-538f-9a8d-02dcb9b8fabb, skipping ID generation
2026-03-26 22:50:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8901dd7c-fe65-538f-9a8d-02dcb9b8fabb with scrape type 1
2026-03-26 22:50:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8901dd7c-fe65-538f-9a8d-02dcb9b8fabb sending to next pipeline
2026-03-26 22:50:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 8901dd7c-fe65-538f-9a8d-02dcb9b8fabb, identifier: 1985409
2026-03-26 22:50:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6dd9a10>
2026-03-26 22:50:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b69abcb1-2d81-5245-b20d-dba2e0f2ba47/b69abcb1-2d81-5245-b20d-dba2e0f2ba47_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252Fc66dfbd95d474a62965e7804a52e75dd%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/c66dfbd95d474a62965e7804a52e75dd/images/large/2.jpg saved to cache
2026-03-26 22:50:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b69abcb1-2d81-5245-b20d-dba2e0f2ba47
2026-03-26 22:50:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e039d0>
2026-03-26 22:50:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b69abcb1-2d81-5245-b20d-dba2e0f2ba47/b69abcb1-2d81-5245-b20d-dba2e0f2ba47_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252Fc66dfbd95d474a62965e7804a52e75dd%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/c66dfbd95d474a62965e7804a52e75dd/images/large/3.jpg saved to cache
2026-03-26 22:50:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b69abcb1-2d81-5245-b20d-dba2e0f2ba47
2026-03-26 22:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F03719f7bc2b244bea71fc7d0572c6a88%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/03719f7bc2b244bea71fc7d0572c6a88/images/large/4.jpg not downloaded yet
2026-03-26 22:50:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 8901dd7c-fe65-538f-9a8d-02dcb9b8fabb with identifier: 1985409
2026-03-26 22:50:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 8901dd7c-fe65-538f-9a8d-02dcb9b8fabb with identifier: 1985409
2026-03-26 22:50:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 8901dd7c-fe65-538f-9a8d-02dcb9b8fabb with identifier: 1985409 to the API
2026-03-26 22:50:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:50:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:50:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bq/5fd8a4208ee74db99f73f13321c2f2f0/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.2L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '8901dd7c-fe65-538f-9a8d-02dcb9b8fabb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'PROACE CITY',
 'odometer': 80086,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 18,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8901dd7c-fe65-538f-9a8d-02dcb9b8fabb/8901dd7c-fe65-538f-9a8d-02dcb9b8fabb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 614058,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/5fd8a4208ee74db99f73f13321c2f2f0/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8901dd7c-fe65-538f-9a8d-02dcb9b8fabb/8901dd7c-fe65-538f-9a8d-02dcb9b8fabb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 527682,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/5fd8a4208ee74db99f73f13321c2f2f0/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8901dd7c-fe65-538f-9a8d-02dcb9b8fabb/8901dd7c-fe65-538f-9a8d-02dcb9b8fabb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 547227,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/5fd8a4208ee74db99f73f13321c2f2f0/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8901dd7c-fe65-538f-9a8d-02dcb9b8fabb/8901dd7c-fe65-538f-9a8d-02dcb9b8fabb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 527581,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/5fd8a4208ee74db99f73f13321c2f2f0/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8901dd7c-fe65-538f-9a8d-02dcb9b8fabb/8901dd7c-fe65-538f-9a8d-02dcb9b8fabb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 547512,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/5fd8a4208ee74db99f73f13321c2f2f0/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8901dd7c-fe65-538f-9a8d-02dcb9b8fabb/8901dd7c-fe65-538f-9a8d-02dcb9b8fabb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 558941,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/5fd8a4208ee74db99f73f13321c2f2f0/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8901dd7c-fe65-538f-9a8d-02dcb9b8fabb/8901dd7c-fe65-538f-9a8d-02dcb9b8fabb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 583348,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/5fd8a4208ee74db99f73f13321c2f2f0/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8901dd7c-fe65-538f-9a8d-02dcb9b8fabb/8901dd7c-fe65-538f-9a8d-02dcb9b8fabb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 605264,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/5fd8a4208ee74db99f73f13321c2f2f0/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8901dd7c-fe65-538f-9a8d-02dcb9b8fabb/8901dd7c-fe65-538f-9a8d-02dcb9b8fabb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 555877,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/5fd8a4208ee74db99f73f13321c2f2f0/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8901dd7c-fe65-538f-9a8d-02dcb9b8fabb/8901dd7c-fe65-538f-9a8d-02dcb9b8fabb_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 593356,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/5fd8a4208ee74db99f73f13321c2f2f0/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-10',
 'seats_number': 3,
 'seller_name': None,
 'title': 'TOYOTA PROACE CITY 1.2I 96KW SWB COMFORT AUTO',
 'transmission': 'automatic',
 'trim': '1.2I 96KW SWB COMFORT AUTO',
 'vin': None,
 'year': 2022}
2026-03-26 22:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985409%27 HTTP/1.1" 200 None
2026-03-26 22:50:53 [ayvens.be] INFO: Saving data for 1985409: {'created_time': 1774565453.719712, 'last_price_update_time': 1774565453.719722, 'auction_closing_time': 1774958400.0}
2026-03-26 22:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985409') HTTP/1.1" 204 0
2026-03-26 22:50:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1uq/c66dfbd95d474a62965e7804a52e75dd/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1uq/c66dfbd95d474a62965e7804a52e75dd/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1uq/c66dfbd95d474a62965e7804a52e75dd/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b740b850>
2026-03-26 22:50:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b69abcb1-2d81-5245-b20d-dba2e0f2ba47/b69abcb1-2d81-5245-b20d-dba2e0f2ba47_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252Fc66dfbd95d474a62965e7804a52e75dd%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/c66dfbd95d474a62965e7804a52e75dd/images/large/4.jpg saved to cache
2026-03-26 22:50:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b69abcb1-2d81-5245-b20d-dba2e0f2ba47
2026-03-26 22:50:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1uq/c66dfbd95d474a62965e7804a52e75dd/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F03719f7bc2b244bea71fc7d0572c6a88%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/03719f7bc2b244bea71fc7d0572c6a88/images/large/5.jpg not downloaded yet
2026-03-26 22:50:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74489d0>
2026-03-26 22:50:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b69abcb1-2d81-5245-b20d-dba2e0f2ba47/b69abcb1-2d81-5245-b20d-dba2e0f2ba47_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252Fc66dfbd95d474a62965e7804a52e75dd%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/c66dfbd95d474a62965e7804a52e75dd/images/large/6.jpg saved to cache
2026-03-26 22:50:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b69abcb1-2d81-5245-b20d-dba2e0f2ba47
2026-03-26 22:50:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7416750>
2026-03-26 22:50:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b69abcb1-2d81-5245-b20d-dba2e0f2ba47/b69abcb1-2d81-5245-b20d-dba2e0f2ba47_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252Fc66dfbd95d474a62965e7804a52e75dd%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/c66dfbd95d474a62965e7804a52e75dd/images/large/5.jpg saved to cache
2026-03-26 22:50:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b69abcb1-2d81-5245-b20d-dba2e0f2ba47
2026-03-26 22:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F03719f7bc2b244bea71fc7d0572c6a88%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/03719f7bc2b244bea71fc7d0572c6a88/images/large/6.jpg not downloaded yet
2026-03-26 22:50:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7819a10>
2026-03-26 22:50:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b69abcb1-2d81-5245-b20d-dba2e0f2ba47/b69abcb1-2d81-5245-b20d-dba2e0f2ba47_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252Fc66dfbd95d474a62965e7804a52e75dd%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/c66dfbd95d474a62965e7804a52e75dd/images/large/8.jpg saved to cache
2026-03-26 22:50:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b69abcb1-2d81-5245-b20d-dba2e0f2ba47
2026-03-26 22:50:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74bcbd0>
2026-03-26 22:50:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b69abcb1-2d81-5245-b20d-dba2e0f2ba47/b69abcb1-2d81-5245-b20d-dba2e0f2ba47_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252Fc66dfbd95d474a62965e7804a52e75dd%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/c66dfbd95d474a62965e7804a52e75dd/images/large/7.jpg saved to cache
2026-03-26 22:50:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b69abcb1-2d81-5245-b20d-dba2e0f2ba47
2026-03-26 22:50:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6da4690>
2026-03-26 22:50:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b69abcb1-2d81-5245-b20d-dba2e0f2ba47/b69abcb1-2d81-5245-b20d-dba2e0f2ba47_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252Fc66dfbd95d474a62965e7804a52e75dd%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/c66dfbd95d474a62965e7804a52e75dd/images/large/9.jpg saved to cache
2026-03-26 22:50:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b69abcb1-2d81-5245-b20d-dba2e0f2ba47
2026-03-26 22:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F03719f7bc2b244bea71fc7d0572c6a88%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/03719f7bc2b244bea71fc7d0572c6a88/images/large/7.jpg not downloaded yet
2026-03-26 22:50:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6da4710>
2026-03-26 22:50:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b69abcb1-2d81-5245-b20d-dba2e0f2ba47/b69abcb1-2d81-5245-b20d-dba2e0f2ba47_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252Fc66dfbd95d474a62965e7804a52e75dd%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/c66dfbd95d474a62965e7804a52e75dd/images/large/10.jpg saved to cache
2026-03-26 22:50:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b69abcb1-2d81-5245-b20d-dba2e0f2ba47
2026-03-26 22:50:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b69abcb1-2d81-5245-b20d-dba2e0f2ba47, skipping ID generation
2026-03-26 22:50:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b69abcb1-2d81-5245-b20d-dba2e0f2ba47 with scrape type 1
2026-03-26 22:50:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b69abcb1-2d81-5245-b20d-dba2e0f2ba47 sending to next pipeline
2026-03-26 22:50:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b69abcb1-2d81-5245-b20d-dba2e0f2ba47, identifier: 1985410
2026-03-26 22:50:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b69abcb1-2d81-5245-b20d-dba2e0f2ba47 with identifier: 1985410
2026-03-26 22:50:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b69abcb1-2d81-5245-b20d-dba2e0f2ba47 with identifier: 1985410
2026-03-26 22:50:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b69abcb1-2d81-5245-b20d-dba2e0f2ba47 with identifier: 1985410 to the API
2026-03-26 22:50:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:50:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:50:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1uq/c66dfbd95d474a62965e7804a52e75dd/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 182,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b69abcb1-2d81-5245-b20d-dba2e0f2ba47',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT 2T 350M FOU MWB HR DSL',
 'odometer': 128237,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b69abcb1-2d81-5245-b20d-dba2e0f2ba47/b69abcb1-2d81-5245-b20d-dba2e0f2ba47_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 257844,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1uq/c66dfbd95d474a62965e7804a52e75dd/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b69abcb1-2d81-5245-b20d-dba2e0f2ba47/b69abcb1-2d81-5245-b20d-dba2e0f2ba47_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 261961,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1uq/c66dfbd95d474a62965e7804a52e75dd/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b69abcb1-2d81-5245-b20d-dba2e0f2ba47/b69abcb1-2d81-5245-b20d-dba2e0f2ba47_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 267206,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1uq/c66dfbd95d474a62965e7804a52e75dd/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b69abcb1-2d81-5245-b20d-dba2e0f2ba47/b69abcb1-2d81-5245-b20d-dba2e0f2ba47_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 261120,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1uq/c66dfbd95d474a62965e7804a52e75dd/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b69abcb1-2d81-5245-b20d-dba2e0f2ba47/b69abcb1-2d81-5245-b20d-dba2e0f2ba47_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 320017,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1uq/c66dfbd95d474a62965e7804a52e75dd/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b69abcb1-2d81-5245-b20d-dba2e0f2ba47/b69abcb1-2d81-5245-b20d-dba2e0f2ba47_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 216593,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1uq/c66dfbd95d474a62965e7804a52e75dd/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b69abcb1-2d81-5245-b20d-dba2e0f2ba47/b69abcb1-2d81-5245-b20d-dba2e0f2ba47_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 356910,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1uq/c66dfbd95d474a62965e7804a52e75dd/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b69abcb1-2d81-5245-b20d-dba2e0f2ba47/b69abcb1-2d81-5245-b20d-dba2e0f2ba47_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 333727,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1uq/c66dfbd95d474a62965e7804a52e75dd/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b69abcb1-2d81-5245-b20d-dba2e0f2ba47/b69abcb1-2d81-5245-b20d-dba2e0f2ba47_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 318913,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1uq/c66dfbd95d474a62965e7804a52e75dd/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b69abcb1-2d81-5245-b20d-dba2e0f2ba47/b69abcb1-2d81-5245-b20d-dba2e0f2ba47_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 250476,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1uq/c66dfbd95d474a62965e7804a52e75dd/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-10',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FORD TRANSIT 2T 350M FOU MWB HR DSL 2.0 TDCi L2H2 Trend',
 'transmission': 'manual',
 'trim': '2.0 TDCi L2H2 Trend',
 'vin': None,
 'year': 2018}
2026-03-26 22:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985410%27 HTTP/1.1" 200 None
2026-03-26 22:50:54 [ayvens.be] INFO: Saving data for 1985410: {'created_time': 1774565454.691634, 'last_price_update_time': 1774565454.691643, 'auction_closing_time': 1774958400.0}
2026-03-26 22:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985410') HTTP/1.1" 204 0
2026-03-26 22:50:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/03719f7bc2b244bea71fc7d0572c6a88/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F03719f7bc2b244bea71fc7d0572c6a88%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/03719f7bc2b244bea71fc7d0572c6a88/images/large/8.jpg not downloaded yet
2026-03-26 22:50:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/03719f7bc2b244bea71fc7d0572c6a88/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F03719f7bc2b244bea71fc7d0572c6a88%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/03719f7bc2b244bea71fc7d0572c6a88/images/large/9.jpg not downloaded yet
2026-03-26 22:50:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/03719f7bc2b244bea71fc7d0572c6a88/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F03719f7bc2b244bea71fc7d0572c6a88%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/03719f7bc2b244bea71fc7d0572c6a88/images/large/10.jpg not downloaded yet
2026-03-26 22:50:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/03719f7bc2b244bea71fc7d0572c6a88/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/03719f7bc2b244bea71fc7d0572c6a88/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:54 [ayvens.be] INFO: Found listing with ID: 1985412
2026-03-26 22:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985412%27 HTTP/1.1" 200 None
2026-03-26 22:50:54 [ayvens.be] INFO: Scrape type for 1985412: 1
2026-03-26 22:50:54 [ayvens.be] INFO: Extracting data for car ID: 1985412
2026-03-26 22:50:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2dcfa284-9a34-5515-b429-8748e9d277cc with identifier: 1985412
2026-03-26 22:50:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2dcfa284-9a34-5515-b429-8748e9d277cc with scrape type 1
2026-03-26 22:50:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2dcfa284-9a34-5515-b429-8748e9d277cc
2026-03-26 22:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xb%252Fa6040672c28b482e835f3c2124d8e720%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xb/a6040672c28b482e835f3c2124d8e720/images/large/1.jpg not downloaded yet
2026-03-26 22:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xb%252Fa6040672c28b482e835f3c2124d8e720%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xb/a6040672c28b482e835f3c2124d8e720/images/large/2.jpg not downloaded yet
2026-03-26 22:50:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b740ac50>
2026-03-26 22:50:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6329b518-a0d7-5100-aa37-31aadb1cd7a5/6329b518-a0d7-5100-aa37-31aadb1cd7a5_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F03719f7bc2b244bea71fc7d0572c6a88%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/03719f7bc2b244bea71fc7d0572c6a88/images/large/1.jpg saved to cache
2026-03-26 22:50:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6329b518-a0d7-5100-aa37-31aadb1cd7a5
2026-03-26 22:50:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7a55f10>
2026-03-26 22:50:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6329b518-a0d7-5100-aa37-31aadb1cd7a5/6329b518-a0d7-5100-aa37-31aadb1cd7a5_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F03719f7bc2b244bea71fc7d0572c6a88%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/03719f7bc2b244bea71fc7d0572c6a88/images/large/2.jpg saved to cache
2026-03-26 22:50:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6329b518-a0d7-5100-aa37-31aadb1cd7a5
2026-03-26 22:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xb%252Fa6040672c28b482e835f3c2124d8e720%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xb/a6040672c28b482e835f3c2124d8e720/images/large/3.jpg not downloaded yet
2026-03-26 22:50:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b75871d0>
2026-03-26 22:50:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6329b518-a0d7-5100-aa37-31aadb1cd7a5/6329b518-a0d7-5100-aa37-31aadb1cd7a5_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F03719f7bc2b244bea71fc7d0572c6a88%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/03719f7bc2b244bea71fc7d0572c6a88/images/large/3.jpg saved to cache
2026-03-26 22:50:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6329b518-a0d7-5100-aa37-31aadb1cd7a5
2026-03-26 22:50:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd3a8850>
2026-03-26 22:50:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6329b518-a0d7-5100-aa37-31aadb1cd7a5/6329b518-a0d7-5100-aa37-31aadb1cd7a5_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F03719f7bc2b244bea71fc7d0572c6a88%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/03719f7bc2b244bea71fc7d0572c6a88/images/large/5.jpg saved to cache
2026-03-26 22:50:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6329b518-a0d7-5100-aa37-31aadb1cd7a5
2026-03-26 22:50:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76a5790>
2026-03-26 22:50:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6329b518-a0d7-5100-aa37-31aadb1cd7a5/6329b518-a0d7-5100-aa37-31aadb1cd7a5_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F03719f7bc2b244bea71fc7d0572c6a88%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/03719f7bc2b244bea71fc7d0572c6a88/images/large/4.jpg saved to cache
2026-03-26 22:50:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6329b518-a0d7-5100-aa37-31aadb1cd7a5
2026-03-26 22:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xb%252Fa6040672c28b482e835f3c2124d8e720%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xb/a6040672c28b482e835f3c2124d8e720/images/large/4.jpg not downloaded yet
2026-03-26 22:50:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/03719f7bc2b244bea71fc7d0572c6a88/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/03719f7bc2b244bea71fc7d0572c6a88/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/03719f7bc2b244bea71fc7d0572c6a88/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/03719f7bc2b244bea71fc7d0572c6a88/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/03719f7bc2b244bea71fc7d0572c6a88/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xb%252Fa6040672c28b482e835f3c2124d8e720%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xb/a6040672c28b482e835f3c2124d8e720/images/large/5.jpg not downloaded yet
2026-03-26 22:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xb%252Fa6040672c28b482e835f3c2124d8e720%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xb/a6040672c28b482e835f3c2124d8e720/images/large/6.jpg not downloaded yet
2026-03-26 22:50:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xb/a6040672c28b482e835f3c2124d8e720/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xb%252Fa6040672c28b482e835f3c2124d8e720%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xb/a6040672c28b482e835f3c2124d8e720/images/large/7.jpg not downloaded yet
2026-03-26 22:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xb%252Fa6040672c28b482e835f3c2124d8e720%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xb/a6040672c28b482e835f3c2124d8e720/images/large/8.jpg not downloaded yet
2026-03-26 22:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xb%252Fa6040672c28b482e835f3c2124d8e720%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xb/a6040672c28b482e835f3c2124d8e720/images/large/9.jpg not downloaded yet
2026-03-26 22:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xb%252Fa6040672c28b482e835f3c2124d8e720%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xb/a6040672c28b482e835f3c2124d8e720/images/large/10.jpg not downloaded yet
2026-03-26 22:50:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xb/a6040672c28b482e835f3c2124d8e720/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xb/a6040672c28b482e835f3c2124d8e720/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:55 [ayvens.be] INFO: Found listing with ID: 1985413
2026-03-26 22:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985413%27 HTTP/1.1" 200 None
2026-03-26 22:50:55 [ayvens.be] INFO: Scrape type for 1985413: 1
2026-03-26 22:50:55 [ayvens.be] INFO: Extracting data for car ID: 1985413
2026-03-26 22:50:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb9d0228-9c97-532f-a19b-9fa29c9ae81c with identifier: 1985413
2026-03-26 22:50:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb9d0228-9c97-532f-a19b-9fa29c9ae81c with scrape type 1
2026-03-26 22:50:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bb9d0228-9c97-532f-a19b-9fa29c9ae81c
2026-03-26 22:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F62b47fe7741e45ab942268bcc642e25f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/62b47fe7741e45ab942268bcc642e25f/images/large/1.jpg not downloaded yet
2026-03-26 22:50:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xb/a6040672c28b482e835f3c2124d8e720/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77cb550>
2026-03-26 22:50:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6329b518-a0d7-5100-aa37-31aadb1cd7a5/6329b518-a0d7-5100-aa37-31aadb1cd7a5_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F03719f7bc2b244bea71fc7d0572c6a88%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/03719f7bc2b244bea71fc7d0572c6a88/images/large/6.jpg saved to cache
2026-03-26 22:50:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6329b518-a0d7-5100-aa37-31aadb1cd7a5
2026-03-26 22:50:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76e2050>
2026-03-26 22:50:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6329b518-a0d7-5100-aa37-31aadb1cd7a5/6329b518-a0d7-5100-aa37-31aadb1cd7a5_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F03719f7bc2b244bea71fc7d0572c6a88%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/03719f7bc2b244bea71fc7d0572c6a88/images/large/8.jpg saved to cache
2026-03-26 22:50:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6329b518-a0d7-5100-aa37-31aadb1cd7a5
2026-03-26 22:50:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b787d910>
2026-03-26 22:50:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6329b518-a0d7-5100-aa37-31aadb1cd7a5/6329b518-a0d7-5100-aa37-31aadb1cd7a5_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F03719f7bc2b244bea71fc7d0572c6a88%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/03719f7bc2b244bea71fc7d0572c6a88/images/large/9.jpg saved to cache
2026-03-26 22:50:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6329b518-a0d7-5100-aa37-31aadb1cd7a5
2026-03-26 22:50:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b741dbd0>
2026-03-26 22:50:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6329b518-a0d7-5100-aa37-31aadb1cd7a5/6329b518-a0d7-5100-aa37-31aadb1cd7a5_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F03719f7bc2b244bea71fc7d0572c6a88%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/03719f7bc2b244bea71fc7d0572c6a88/images/large/7.jpg saved to cache
2026-03-26 22:50:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6329b518-a0d7-5100-aa37-31aadb1cd7a5
2026-03-26 22:50:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7744190>
2026-03-26 22:50:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6329b518-a0d7-5100-aa37-31aadb1cd7a5/6329b518-a0d7-5100-aa37-31aadb1cd7a5_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F03719f7bc2b244bea71fc7d0572c6a88%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/03719f7bc2b244bea71fc7d0572c6a88/images/large/10.jpg saved to cache
2026-03-26 22:50:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6329b518-a0d7-5100-aa37-31aadb1cd7a5
2026-03-26 22:50:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6329b518-a0d7-5100-aa37-31aadb1cd7a5, skipping ID generation
2026-03-26 22:50:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6329b518-a0d7-5100-aa37-31aadb1cd7a5 with scrape type 1
2026-03-26 22:50:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6329b518-a0d7-5100-aa37-31aadb1cd7a5 sending to next pipeline
2026-03-26 22:50:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 6329b518-a0d7-5100-aa37-31aadb1cd7a5, identifier: 1985411
2026-03-26 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F62b47fe7741e45ab942268bcc642e25f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/62b47fe7741e45ab942268bcc642e25f/images/large/2.jpg not downloaded yet
2026-03-26 22:50:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 6329b518-a0d7-5100-aa37-31aadb1cd7a5 with identifier: 1985411
2026-03-26 22:50:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 6329b518-a0d7-5100-aa37-31aadb1cd7a5 with identifier: 1985411
2026-03-26 22:50:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 6329b518-a0d7-5100-aa37-31aadb1cd7a5 with identifier: 1985411 to the API
2026-03-26 22:50:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:50:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:50:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bm/03719f7bc2b244bea71fc7d0572c6a88/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '6329b518-a0d7-5100-aa37-31aadb1cd7a5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '3 SERIES TOURING',
 'odometer': 127995,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6329b518-a0d7-5100-aa37-31aadb1cd7a5/6329b518-a0d7-5100-aa37-31aadb1cd7a5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 516778,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/03719f7bc2b244bea71fc7d0572c6a88/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6329b518-a0d7-5100-aa37-31aadb1cd7a5/6329b518-a0d7-5100-aa37-31aadb1cd7a5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 477099,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/03719f7bc2b244bea71fc7d0572c6a88/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6329b518-a0d7-5100-aa37-31aadb1cd7a5/6329b518-a0d7-5100-aa37-31aadb1cd7a5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 465751,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/03719f7bc2b244bea71fc7d0572c6a88/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6329b518-a0d7-5100-aa37-31aadb1cd7a5/6329b518-a0d7-5100-aa37-31aadb1cd7a5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 493265,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/03719f7bc2b244bea71fc7d0572c6a88/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6329b518-a0d7-5100-aa37-31aadb1cd7a5/6329b518-a0d7-5100-aa37-31aadb1cd7a5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 379525,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/03719f7bc2b244bea71fc7d0572c6a88/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6329b518-a0d7-5100-aa37-31aadb1cd7a5/6329b518-a0d7-5100-aa37-31aadb1cd7a5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 354909,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/03719f7bc2b244bea71fc7d0572c6a88/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6329b518-a0d7-5100-aa37-31aadb1cd7a5/6329b518-a0d7-5100-aa37-31aadb1cd7a5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 405883,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/03719f7bc2b244bea71fc7d0572c6a88/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6329b518-a0d7-5100-aa37-31aadb1cd7a5/6329b518-a0d7-5100-aa37-31aadb1cd7a5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 384707,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/03719f7bc2b244bea71fc7d0572c6a88/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6329b518-a0d7-5100-aa37-31aadb1cd7a5/6329b518-a0d7-5100-aa37-31aadb1cd7a5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 390477,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/03719f7bc2b244bea71fc7d0572c6a88/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6329b518-a0d7-5100-aa37-31aadb1cd7a5/6329b518-a0d7-5100-aa37-31aadb1cd7a5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 248900,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/03719f7bc2b244bea71fc7d0572c6a88/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3 SERIES TOURING 2.0 330E (215KW) XDRIVE TOURING',
 'transmission': 'automatic',
 'trim': '2.0 330E (215KW) XDRIVE TOURING',
 'vin': None,
 'year': 2022}
2026-03-26 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985411%27 HTTP/1.1" 200 None
2026-03-26 22:50:56 [ayvens.be] INFO: Saving data for 1985411: {'created_time': 1774565456.395532, 'last_price_update_time': 1774565456.395544, 'auction_closing_time': 1774958400.0}
2026-03-26 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985411') HTTP/1.1" 204 0
2026-03-26 22:50:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7ccd410>
2026-03-26 22:50:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dcfa284-9a34-5515-b429-8748e9d277cc/2dcfa284-9a34-5515-b429-8748e9d277cc_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xb%252Fa6040672c28b482e835f3c2124d8e720%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xb/a6040672c28b482e835f3c2124d8e720/images/large/1.jpg saved to cache
2026-03-26 22:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2dcfa284-9a34-5515-b429-8748e9d277cc
2026-03-26 22:50:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xb/a6040672c28b482e835f3c2124d8e720/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F62b47fe7741e45ab942268bcc642e25f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/62b47fe7741e45ab942268bcc642e25f/images/large/3.jpg not downloaded yet
2026-03-26 22:50:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cbcf10>
2026-03-26 22:50:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dcfa284-9a34-5515-b429-8748e9d277cc/2dcfa284-9a34-5515-b429-8748e9d277cc_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xb%252Fa6040672c28b482e835f3c2124d8e720%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xb/a6040672c28b482e835f3c2124d8e720/images/large/3.jpg saved to cache
2026-03-26 22:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2dcfa284-9a34-5515-b429-8748e9d277cc
2026-03-26 22:50:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76a7d50>
2026-03-26 22:50:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dcfa284-9a34-5515-b429-8748e9d277cc/2dcfa284-9a34-5515-b429-8748e9d277cc_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xb%252Fa6040672c28b482e835f3c2124d8e720%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xb/a6040672c28b482e835f3c2124d8e720/images/large/5.jpg saved to cache
2026-03-26 22:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2dcfa284-9a34-5515-b429-8748e9d277cc
2026-03-26 22:50:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7ceb410>
2026-03-26 22:50:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dcfa284-9a34-5515-b429-8748e9d277cc/2dcfa284-9a34-5515-b429-8748e9d277cc_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xb%252Fa6040672c28b482e835f3c2124d8e720%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xb/a6040672c28b482e835f3c2124d8e720/images/large/2.jpg saved to cache
2026-03-26 22:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2dcfa284-9a34-5515-b429-8748e9d277cc
2026-03-26 22:50:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xb/a6040672c28b482e835f3c2124d8e720/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xb/a6040672c28b482e835f3c2124d8e720/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F62b47fe7741e45ab942268bcc642e25f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/62b47fe7741e45ab942268bcc642e25f/images/large/4.jpg not downloaded yet
2026-03-26 22:50:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cca310>
2026-03-26 22:50:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dcfa284-9a34-5515-b429-8748e9d277cc/2dcfa284-9a34-5515-b429-8748e9d277cc_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xb%252Fa6040672c28b482e835f3c2124d8e720%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xb/a6040672c28b482e835f3c2124d8e720/images/large/4.jpg saved to cache
2026-03-26 22:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2dcfa284-9a34-5515-b429-8748e9d277cc
2026-03-26 22:50:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xb/a6040672c28b482e835f3c2124d8e720/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xb/a6040672c28b482e835f3c2124d8e720/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F62b47fe7741e45ab942268bcc642e25f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/62b47fe7741e45ab942268bcc642e25f/images/large/5.jpg not downloaded yet
2026-03-26 22:50:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xb/a6040672c28b482e835f3c2124d8e720/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/62b47fe7741e45ab942268bcc642e25f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F62b47fe7741e45ab942268bcc642e25f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/62b47fe7741e45ab942268bcc642e25f/images/large/6.jpg not downloaded yet
2026-03-26 22:50:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7494f10>
2026-03-26 22:50:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dcfa284-9a34-5515-b429-8748e9d277cc/2dcfa284-9a34-5515-b429-8748e9d277cc_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xb%252Fa6040672c28b482e835f3c2124d8e720%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xb/a6040672c28b482e835f3c2124d8e720/images/large/6.jpg saved to cache
2026-03-26 22:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2dcfa284-9a34-5515-b429-8748e9d277cc
2026-03-26 22:50:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79a2490>
2026-03-26 22:50:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dcfa284-9a34-5515-b429-8748e9d277cc/2dcfa284-9a34-5515-b429-8748e9d277cc_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xb%252Fa6040672c28b482e835f3c2124d8e720%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xb/a6040672c28b482e835f3c2124d8e720/images/large/7.jpg saved to cache
2026-03-26 22:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2dcfa284-9a34-5515-b429-8748e9d277cc
2026-03-26 22:50:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/62b47fe7741e45ab942268bcc642e25f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F62b47fe7741e45ab942268bcc642e25f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/62b47fe7741e45ab942268bcc642e25f/images/large/7.jpg not downloaded yet
2026-03-26 22:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F62b47fe7741e45ab942268bcc642e25f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/62b47fe7741e45ab942268bcc642e25f/images/large/8.jpg not downloaded yet
2026-03-26 22:50:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7495850>
2026-03-26 22:50:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dcfa284-9a34-5515-b429-8748e9d277cc/2dcfa284-9a34-5515-b429-8748e9d277cc_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xb%252Fa6040672c28b482e835f3c2124d8e720%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xb/a6040672c28b482e835f3c2124d8e720/images/large/9.jpg saved to cache
2026-03-26 22:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2dcfa284-9a34-5515-b429-8748e9d277cc
2026-03-26 22:50:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77cbc10>
2026-03-26 22:50:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dcfa284-9a34-5515-b429-8748e9d277cc/2dcfa284-9a34-5515-b429-8748e9d277cc_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xb%252Fa6040672c28b482e835f3c2124d8e720%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xb/a6040672c28b482e835f3c2124d8e720/images/large/8.jpg saved to cache
2026-03-26 22:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2dcfa284-9a34-5515-b429-8748e9d277cc
2026-03-26 22:50:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79ce250>
2026-03-26 22:50:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dcfa284-9a34-5515-b429-8748e9d277cc/2dcfa284-9a34-5515-b429-8748e9d277cc_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xb%252Fa6040672c28b482e835f3c2124d8e720%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xb/a6040672c28b482e835f3c2124d8e720/images/large/10.jpg saved to cache
2026-03-26 22:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2dcfa284-9a34-5515-b429-8748e9d277cc
2026-03-26 22:50:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2dcfa284-9a34-5515-b429-8748e9d277cc, skipping ID generation
2026-03-26 22:50:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2dcfa284-9a34-5515-b429-8748e9d277cc with scrape type 1
2026-03-26 22:50:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2dcfa284-9a34-5515-b429-8748e9d277cc sending to next pipeline
2026-03-26 22:50:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 2dcfa284-9a34-5515-b429-8748e9d277cc, identifier: 1985412
2026-03-26 22:50:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77bd8d0>
2026-03-26 22:50:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb9d0228-9c97-532f-a19b-9fa29c9ae81c/bb9d0228-9c97-532f-a19b-9fa29c9ae81c_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F62b47fe7741e45ab942268bcc642e25f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/62b47fe7741e45ab942268bcc642e25f/images/large/1.jpg saved to cache
2026-03-26 22:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bb9d0228-9c97-532f-a19b-9fa29c9ae81c
2026-03-26 22:50:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/62b47fe7741e45ab942268bcc642e25f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 2dcfa284-9a34-5515-b429-8748e9d277cc with identifier: 1985412
2026-03-26 22:50:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 2dcfa284-9a34-5515-b429-8748e9d277cc with identifier: 1985412
2026-03-26 22:50:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 2dcfa284-9a34-5515-b429-8748e9d277cc with identifier: 1985412 to the API
2026-03-26 22:50:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:50:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:50:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1xb/a6040672c28b482e835f3c2124d8e720/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '2dcfa284-9a34-5515-b429-8748e9d277cc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'OCTAVIA COMBI - 2017',
 'odometer': 109215,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dcfa284-9a34-5515-b429-8748e9d277cc/2dcfa284-9a34-5515-b429-8748e9d277cc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 267236,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xb/a6040672c28b482e835f3c2124d8e720/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dcfa284-9a34-5515-b429-8748e9d277cc/2dcfa284-9a34-5515-b429-8748e9d277cc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 267158,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xb/a6040672c28b482e835f3c2124d8e720/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dcfa284-9a34-5515-b429-8748e9d277cc/2dcfa284-9a34-5515-b429-8748e9d277cc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 305872,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xb/a6040672c28b482e835f3c2124d8e720/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dcfa284-9a34-5515-b429-8748e9d277cc/2dcfa284-9a34-5515-b429-8748e9d277cc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 314425,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xb/a6040672c28b482e835f3c2124d8e720/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dcfa284-9a34-5515-b429-8748e9d277cc/2dcfa284-9a34-5515-b429-8748e9d277cc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 269755,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xb/a6040672c28b482e835f3c2124d8e720/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dcfa284-9a34-5515-b429-8748e9d277cc/2dcfa284-9a34-5515-b429-8748e9d277cc_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 257915,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xb/a6040672c28b482e835f3c2124d8e720/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dcfa284-9a34-5515-b429-8748e9d277cc/2dcfa284-9a34-5515-b429-8748e9d277cc_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 321858,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xb/a6040672c28b482e835f3c2124d8e720/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dcfa284-9a34-5515-b429-8748e9d277cc/2dcfa284-9a34-5515-b429-8748e9d277cc_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 328899,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xb/a6040672c28b482e835f3c2124d8e720/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dcfa284-9a34-5515-b429-8748e9d277cc/2dcfa284-9a34-5515-b429-8748e9d277cc_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 392739,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xb/a6040672c28b482e835f3c2124d8e720/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dcfa284-9a34-5515-b429-8748e9d277cc/2dcfa284-9a34-5515-b429-8748e9d277cc_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 308309,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xb/a6040672c28b482e835f3c2124d8e720/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA OCTAVIA COMBI - 2017 1.0 TSI Ambition',
 'transmission': 'manual',
 'trim': '1.0 TSI Ambition',
 'vin': None,
 'year': 2019}
2026-03-26 22:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985412%27 HTTP/1.1" 200 None
2026-03-26 22:50:57 [ayvens.be] INFO: Saving data for 1985412: {'created_time': 1774565457.874107, 'last_price_update_time': 1774565457.874118, 'auction_closing_time': 1774958400.0}
2026-03-26 22:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985412') HTTP/1.1" 204 0
2026-03-26 22:50:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/62b47fe7741e45ab942268bcc642e25f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F62b47fe7741e45ab942268bcc642e25f%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/62b47fe7741e45ab942268bcc642e25f/images/large/9.jpg not downloaded yet
2026-03-26 22:50:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77d6f90>
2026-03-26 22:50:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb9d0228-9c97-532f-a19b-9fa29c9ae81c/bb9d0228-9c97-532f-a19b-9fa29c9ae81c_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F62b47fe7741e45ab942268bcc642e25f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/62b47fe7741e45ab942268bcc642e25f/images/large/2.jpg saved to cache
2026-03-26 22:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bb9d0228-9c97-532f-a19b-9fa29c9ae81c
2026-03-26 22:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F62b47fe7741e45ab942268bcc642e25f%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/62b47fe7741e45ab942268bcc642e25f/images/large/10.jpg not downloaded yet
2026-03-26 22:50:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76cffd0>
2026-03-26 22:50:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb9d0228-9c97-532f-a19b-9fa29c9ae81c/bb9d0228-9c97-532f-a19b-9fa29c9ae81c_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F62b47fe7741e45ab942268bcc642e25f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/62b47fe7741e45ab942268bcc642e25f/images/large/4.jpg saved to cache
2026-03-26 22:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bb9d0228-9c97-532f-a19b-9fa29c9ae81c
2026-03-26 22:50:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/62b47fe7741e45ab942268bcc642e25f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:58 [ayvens.be] INFO: Found listing with ID: 1985414
2026-03-26 22:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985414%27 HTTP/1.1" 200 None
2026-03-26 22:50:58 [ayvens.be] INFO: Scrape type for 1985414: 1
2026-03-26 22:50:58 [ayvens.be] INFO: Extracting data for car ID: 1985414
2026-03-26 22:50:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b9748a28-f9a5-5325-a9b1-c3ddaa9b2b94 with identifier: 1985414
2026-03-26 22:50:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9748a28-f9a5-5325-a9b1-c3ddaa9b2b94 with scrape type 1
2026-03-26 22:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b9748a28-f9a5-5325-a9b1-c3ddaa9b2b94
2026-03-26 22:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dc%252F07357a9f20074fa6bde0707c60357697%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dc/07357a9f20074fa6bde0707c60357697/images/large/1.jpg not downloaded yet
2026-03-26 22:50:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/62b47fe7741e45ab942268bcc642e25f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dc%252F07357a9f20074fa6bde0707c60357697%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dc/07357a9f20074fa6bde0707c60357697/images/large/2.jpg not downloaded yet
2026-03-26 22:50:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/62b47fe7741e45ab942268bcc642e25f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7727010>
2026-03-26 22:50:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb9d0228-9c97-532f-a19b-9fa29c9ae81c/bb9d0228-9c97-532f-a19b-9fa29c9ae81c_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F62b47fe7741e45ab942268bcc642e25f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/62b47fe7741e45ab942268bcc642e25f/images/large/3.jpg saved to cache
2026-03-26 22:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bb9d0228-9c97-532f-a19b-9fa29c9ae81c
2026-03-26 22:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dc%252F07357a9f20074fa6bde0707c60357697%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dc/07357a9f20074fa6bde0707c60357697/images/large/3.jpg not downloaded yet
2026-03-26 22:50:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/62b47fe7741e45ab942268bcc642e25f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77d7ed0>
2026-03-26 22:50:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb9d0228-9c97-532f-a19b-9fa29c9ae81c/bb9d0228-9c97-532f-a19b-9fa29c9ae81c_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F62b47fe7741e45ab942268bcc642e25f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/62b47fe7741e45ab942268bcc642e25f/images/large/5.jpg saved to cache
2026-03-26 22:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bb9d0228-9c97-532f-a19b-9fa29c9ae81c
2026-03-26 22:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dc%252F07357a9f20074fa6bde0707c60357697%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dc/07357a9f20074fa6bde0707c60357697/images/large/4.jpg not downloaded yet
2026-03-26 22:50:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/62b47fe7741e45ab942268bcc642e25f/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7268510>
2026-03-26 22:50:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb9d0228-9c97-532f-a19b-9fa29c9ae81c/bb9d0228-9c97-532f-a19b-9fa29c9ae81c_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F62b47fe7741e45ab942268bcc642e25f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/62b47fe7741e45ab942268bcc642e25f/images/large/6.jpg saved to cache
2026-03-26 22:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bb9d0228-9c97-532f-a19b-9fa29c9ae81c
2026-03-26 22:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dc%252F07357a9f20074fa6bde0707c60357697%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dc/07357a9f20074fa6bde0707c60357697/images/large/5.jpg not downloaded yet
2026-03-26 22:50:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e15690>
2026-03-26 22:50:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb9d0228-9c97-532f-a19b-9fa29c9ae81c/bb9d0228-9c97-532f-a19b-9fa29c9ae81c_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F62b47fe7741e45ab942268bcc642e25f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/62b47fe7741e45ab942268bcc642e25f/images/large/7.jpg saved to cache
2026-03-26 22:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bb9d0228-9c97-532f-a19b-9fa29c9ae81c
2026-03-26 22:50:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/62b47fe7741e45ab942268bcc642e25f/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dc%252F07357a9f20074fa6bde0707c60357697%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dc/07357a9f20074fa6bde0707c60357697/images/large/6.jpg not downloaded yet
2026-03-26 22:50:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77ad550>
2026-03-26 22:50:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb9d0228-9c97-532f-a19b-9fa29c9ae81c/bb9d0228-9c97-532f-a19b-9fa29c9ae81c_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F62b47fe7741e45ab942268bcc642e25f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/62b47fe7741e45ab942268bcc642e25f/images/large/8.jpg saved to cache
2026-03-26 22:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bb9d0228-9c97-532f-a19b-9fa29c9ae81c
2026-03-26 22:50:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b782f410>
2026-03-26 22:50:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb9d0228-9c97-532f-a19b-9fa29c9ae81c/bb9d0228-9c97-532f-a19b-9fa29c9ae81c_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F62b47fe7741e45ab942268bcc642e25f%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/62b47fe7741e45ab942268bcc642e25f/images/large/9.jpg saved to cache
2026-03-26 22:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bb9d0228-9c97-532f-a19b-9fa29c9ae81c
2026-03-26 22:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dc%252F07357a9f20074fa6bde0707c60357697%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dc/07357a9f20074fa6bde0707c60357697/images/large/7.jpg not downloaded yet
2026-03-26 22:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dc%252F07357a9f20074fa6bde0707c60357697%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dc/07357a9f20074fa6bde0707c60357697/images/large/8.jpg not downloaded yet
2026-03-26 22:50:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79a5850>
2026-03-26 22:50:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb9d0228-9c97-532f-a19b-9fa29c9ae81c/bb9d0228-9c97-532f-a19b-9fa29c9ae81c_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F62b47fe7741e45ab942268bcc642e25f%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/62b47fe7741e45ab942268bcc642e25f/images/large/10.jpg saved to cache
2026-03-26 22:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bb9d0228-9c97-532f-a19b-9fa29c9ae81c
2026-03-26 22:50:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bb9d0228-9c97-532f-a19b-9fa29c9ae81c, skipping ID generation
2026-03-26 22:50:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb9d0228-9c97-532f-a19b-9fa29c9ae81c with scrape type 1
2026-03-26 22:50:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bb9d0228-9c97-532f-a19b-9fa29c9ae81c sending to next pipeline
2026-03-26 22:50:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: bb9d0228-9c97-532f-a19b-9fa29c9ae81c, identifier: 1985413
2026-03-26 22:50:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dc/07357a9f20074fa6bde0707c60357697/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: bb9d0228-9c97-532f-a19b-9fa29c9ae81c with identifier: 1985413
2026-03-26 22:50:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: bb9d0228-9c97-532f-a19b-9fa29c9ae81c with identifier: 1985413
2026-03-26 22:50:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: bb9d0228-9c97-532f-a19b-9fa29c9ae81c with identifier: 1985413 to the API
2026-03-26 22:50:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:50:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:50:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bq/62b47fe7741e45ab942268bcc642e25f/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 38,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'bb9d0228-9c97-532f-a19b-9fa29c9ae81c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3 SPORTBACK',
 'odometer': 159427,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb9d0228-9c97-532f-a19b-9fa29c9ae81c/bb9d0228-9c97-532f-a19b-9fa29c9ae81c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 235558,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/62b47fe7741e45ab942268bcc642e25f/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb9d0228-9c97-532f-a19b-9fa29c9ae81c/bb9d0228-9c97-532f-a19b-9fa29c9ae81c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 240173,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/62b47fe7741e45ab942268bcc642e25f/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb9d0228-9c97-532f-a19b-9fa29c9ae81c/bb9d0228-9c97-532f-a19b-9fa29c9ae81c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 282082,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/62b47fe7741e45ab942268bcc642e25f/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb9d0228-9c97-532f-a19b-9fa29c9ae81c/bb9d0228-9c97-532f-a19b-9fa29c9ae81c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 260207,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/62b47fe7741e45ab942268bcc642e25f/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb9d0228-9c97-532f-a19b-9fa29c9ae81c/bb9d0228-9c97-532f-a19b-9fa29c9ae81c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 298415,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/62b47fe7741e45ab942268bcc642e25f/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb9d0228-9c97-532f-a19b-9fa29c9ae81c/bb9d0228-9c97-532f-a19b-9fa29c9ae81c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 363610,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/62b47fe7741e45ab942268bcc642e25f/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb9d0228-9c97-532f-a19b-9fa29c9ae81c/bb9d0228-9c97-532f-a19b-9fa29c9ae81c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 298439,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/62b47fe7741e45ab942268bcc642e25f/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb9d0228-9c97-532f-a19b-9fa29c9ae81c/bb9d0228-9c97-532f-a19b-9fa29c9ae81c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 284978,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/62b47fe7741e45ab942268bcc642e25f/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb9d0228-9c97-532f-a19b-9fa29c9ae81c/bb9d0228-9c97-532f-a19b-9fa29c9ae81c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 375894,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/62b47fe7741e45ab942268bcc642e25f/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb9d0228-9c97-532f-a19b-9fa29c9ae81c/bb9d0228-9c97-532f-a19b-9fa29c9ae81c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 385922,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/62b47fe7741e45ab942268bcc642e25f/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 SPORTBACK 1.4 45 TFSI E S TRONIC S LINE',
 'transmission': 'automatic',
 'trim': '1.4 45 TFSI E S TRONIC S LINE',
 'vin': None,
 'year': 2022}
2026-03-26 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985413%27 HTTP/1.1" 200 None
2026-03-26 22:50:59 [ayvens.be] INFO: Saving data for 1985413: {'created_time': 1774565459.32529, 'last_price_update_time': 1774565459.3253, 'auction_closing_time': 1774958400.0}
2026-03-26 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985413') HTTP/1.1" 204 0
2026-03-26 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dc%252F07357a9f20074fa6bde0707c60357697%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dc/07357a9f20074fa6bde0707c60357697/images/large/9.jpg not downloaded yet
2026-03-26 22:50:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dc/07357a9f20074fa6bde0707c60357697/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dc%252F07357a9f20074fa6bde0707c60357697%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dc/07357a9f20074fa6bde0707c60357697/images/large/10.jpg not downloaded yet
2026-03-26 22:50:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dc/07357a9f20074fa6bde0707c60357697/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7924a50>
2026-03-26 22:50:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9748a28-f9a5-5325-a9b1-c3ddaa9b2b94/b9748a28-f9a5-5325-a9b1-c3ddaa9b2b94_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dc%252F07357a9f20074fa6bde0707c60357697%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dc/07357a9f20074fa6bde0707c60357697/images/large/1.jpg saved to cache
2026-03-26 22:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b9748a28-f9a5-5325-a9b1-c3ddaa9b2b94
2026-03-26 22:50:59 [ayvens.be] INFO: Found listing with ID: 1985415
2026-03-26 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985415%27 HTTP/1.1" 200 None
2026-03-26 22:50:59 [ayvens.be] INFO: Scrape type for 1985415: 1
2026-03-26 22:50:59 [ayvens.be] INFO: Extracting data for car ID: 1985415
2026-03-26 22:50:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bfd4a740-44f9-552f-baa0-850394236255 with identifier: 1985415
2026-03-26 22:50:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bfd4a740-44f9-552f-baa0-850394236255 with scrape type 1
2026-03-26 22:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bfd4a740-44f9-552f-baa0-850394236255
2026-03-26 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2as%252F8ae7e35974cf408493ce7a27221b597e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2as/8ae7e35974cf408493ce7a27221b597e/images/large/1.jpg not downloaded yet
2026-03-26 22:50:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dc/07357a9f20074fa6bde0707c60357697/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2as%252F8ae7e35974cf408493ce7a27221b597e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2as/8ae7e35974cf408493ce7a27221b597e/images/large/2.jpg not downloaded yet
2026-03-26 22:50:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dc/07357a9f20074fa6bde0707c60357697/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74cc790>
2026-03-26 22:50:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9748a28-f9a5-5325-a9b1-c3ddaa9b2b94/b9748a28-f9a5-5325-a9b1-c3ddaa9b2b94_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dc%252F07357a9f20074fa6bde0707c60357697%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dc/07357a9f20074fa6bde0707c60357697/images/large/2.jpg saved to cache
2026-03-26 22:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b9748a28-f9a5-5325-a9b1-c3ddaa9b2b94
2026-03-26 22:50:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7ceb950>
2026-03-26 22:50:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9748a28-f9a5-5325-a9b1-c3ddaa9b2b94/b9748a28-f9a5-5325-a9b1-c3ddaa9b2b94_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dc%252F07357a9f20074fa6bde0707c60357697%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dc/07357a9f20074fa6bde0707c60357697/images/large/3.jpg saved to cache
2026-03-26 22:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b9748a28-f9a5-5325-a9b1-c3ddaa9b2b94
2026-03-26 22:50:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dc/07357a9f20074fa6bde0707c60357697/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2as%252F8ae7e35974cf408493ce7a27221b597e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2as/8ae7e35974cf408493ce7a27221b597e/images/large/3.jpg not downloaded yet
2026-03-26 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2as%252F8ae7e35974cf408493ce7a27221b597e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2as/8ae7e35974cf408493ce7a27221b597e/images/large/4.jpg not downloaded yet
2026-03-26 22:50:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76e3c50>
2026-03-26 22:50:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9748a28-f9a5-5325-a9b1-c3ddaa9b2b94/b9748a28-f9a5-5325-a9b1-c3ddaa9b2b94_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dc%252F07357a9f20074fa6bde0707c60357697%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dc/07357a9f20074fa6bde0707c60357697/images/large/4.jpg saved to cache
2026-03-26 22:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b9748a28-f9a5-5325-a9b1-c3ddaa9b2b94
2026-03-26 22:50:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7a60050>
2026-03-26 22:50:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9748a28-f9a5-5325-a9b1-c3ddaa9b2b94/b9748a28-f9a5-5325-a9b1-c3ddaa9b2b94_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dc%252F07357a9f20074fa6bde0707c60357697%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dc/07357a9f20074fa6bde0707c60357697/images/large/5.jpg saved to cache
2026-03-26 22:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b9748a28-f9a5-5325-a9b1-c3ddaa9b2b94
2026-03-26 22:50:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dc/07357a9f20074fa6bde0707c60357697/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2as%252F8ae7e35974cf408493ce7a27221b597e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2as/8ae7e35974cf408493ce7a27221b597e/images/large/5.jpg not downloaded yet
2026-03-26 22:50:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dc/07357a9f20074fa6bde0707c60357697/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2as%252F8ae7e35974cf408493ce7a27221b597e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2as/8ae7e35974cf408493ce7a27221b597e/images/large/6.jpg not downloaded yet
2026-03-26 22:50:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dc/07357a9f20074fa6bde0707c60357697/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:50:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:50:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b727c210>
2026-03-26 22:50:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:50:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:50:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:50:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9748a28-f9a5-5325-a9b1-c3ddaa9b2b94/b9748a28-f9a5-5325-a9b1-c3ddaa9b2b94_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dc%252F07357a9f20074fa6bde0707c60357697%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dc/07357a9f20074fa6bde0707c60357697/images/large/6.jpg saved to cache
2026-03-26 22:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b9748a28-f9a5-5325-a9b1-c3ddaa9b2b94
2026-03-26 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2as%252F8ae7e35974cf408493ce7a27221b597e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2as/8ae7e35974cf408493ce7a27221b597e/images/large/7.jpg not downloaded yet
2026-03-26 22:50:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dc/07357a9f20074fa6bde0707c60357697/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2as%252F8ae7e35974cf408493ce7a27221b597e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2as/8ae7e35974cf408493ce7a27221b597e/images/large/8.jpg not downloaded yet
2026-03-26 22:51:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cb0410>
2026-03-26 22:51:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9748a28-f9a5-5325-a9b1-c3ddaa9b2b94/b9748a28-f9a5-5325-a9b1-c3ddaa9b2b94_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dc%252F07357a9f20074fa6bde0707c60357697%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dc/07357a9f20074fa6bde0707c60357697/images/large/9.jpg saved to cache
2026-03-26 22:51:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b9748a28-f9a5-5325-a9b1-c3ddaa9b2b94
2026-03-26 22:51:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76e0a10>
2026-03-26 22:51:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9748a28-f9a5-5325-a9b1-c3ddaa9b2b94/b9748a28-f9a5-5325-a9b1-c3ddaa9b2b94_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dc%252F07357a9f20074fa6bde0707c60357697%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dc/07357a9f20074fa6bde0707c60357697/images/large/7.jpg saved to cache
2026-03-26 22:51:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b9748a28-f9a5-5325-a9b1-c3ddaa9b2b94
2026-03-26 22:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2as%252F8ae7e35974cf408493ce7a27221b597e%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2as/8ae7e35974cf408493ce7a27221b597e/images/large/9.jpg not downloaded yet
2026-03-26 22:51:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7aeb7d0>
2026-03-26 22:51:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9748a28-f9a5-5325-a9b1-c3ddaa9b2b94/b9748a28-f9a5-5325-a9b1-c3ddaa9b2b94_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dc%252F07357a9f20074fa6bde0707c60357697%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dc/07357a9f20074fa6bde0707c60357697/images/large/8.jpg saved to cache
2026-03-26 22:51:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b9748a28-f9a5-5325-a9b1-c3ddaa9b2b94
2026-03-26 22:51:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2as/8ae7e35974cf408493ce7a27221b597e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2as%252F8ae7e35974cf408493ce7a27221b597e%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2as/8ae7e35974cf408493ce7a27221b597e/images/large/10.jpg not downloaded yet
2026-03-26 22:51:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2as/8ae7e35974cf408493ce7a27221b597e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7407e10>
2026-03-26 22:51:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9748a28-f9a5-5325-a9b1-c3ddaa9b2b94/b9748a28-f9a5-5325-a9b1-c3ddaa9b2b94_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dc%252F07357a9f20074fa6bde0707c60357697%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dc/07357a9f20074fa6bde0707c60357697/images/large/10.jpg saved to cache
2026-03-26 22:51:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b9748a28-f9a5-5325-a9b1-c3ddaa9b2b94
2026-03-26 22:51:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b9748a28-f9a5-5325-a9b1-c3ddaa9b2b94, skipping ID generation
2026-03-26 22:51:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9748a28-f9a5-5325-a9b1-c3ddaa9b2b94 with scrape type 1
2026-03-26 22:51:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b9748a28-f9a5-5325-a9b1-c3ddaa9b2b94 sending to next pipeline
2026-03-26 22:51:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b9748a28-f9a5-5325-a9b1-c3ddaa9b2b94, identifier: 1985414
2026-03-26 22:51:00 [ayvens.be] INFO: Found listing with ID: 1985416
2026-03-26 22:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985416%27 HTTP/1.1" 200 None
2026-03-26 22:51:00 [ayvens.be] INFO: Scrape type for 1985416: 1
2026-03-26 22:51:00 [ayvens.be] INFO: Extracting data for car ID: 1985416
2026-03-26 22:51:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6992e750-cb41-5f4d-961d-bf0913a096ba with identifier: 1985416
2026-03-26 22:51:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6992e750-cb41-5f4d-961d-bf0913a096ba with scrape type 1
2026-03-26 22:51:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6992e750-cb41-5f4d-961d-bf0913a096ba
2026-03-26 22:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F364b6d84d94549f7b8c0629a43f9099b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/364b6d84d94549f7b8c0629a43f9099b/images/large/1.jpg not downloaded yet
2026-03-26 22:51:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b9748a28-f9a5-5325-a9b1-c3ddaa9b2b94 with identifier: 1985414
2026-03-26 22:51:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b9748a28-f9a5-5325-a9b1-c3ddaa9b2b94 with identifier: 1985414
2026-03-26 22:51:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b9748a28-f9a5-5325-a9b1-c3ddaa9b2b94 with identifier: 1985414 to the API
2026-03-26 22:51:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:51:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:51:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2dc/07357a9f20074fa6bde0707c60357697/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'b9748a28-f9a5-5325-a9b1-c3ddaa9b2b94',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'DS AUTOMOBILES',
 'model': 'DS 4',
 'odometer': 113990,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9748a28-f9a5-5325-a9b1-c3ddaa9b2b94/b9748a28-f9a5-5325-a9b1-c3ddaa9b2b94_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 557133,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dc/07357a9f20074fa6bde0707c60357697/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9748a28-f9a5-5325-a9b1-c3ddaa9b2b94/b9748a28-f9a5-5325-a9b1-c3ddaa9b2b94_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 537495,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dc/07357a9f20074fa6bde0707c60357697/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9748a28-f9a5-5325-a9b1-c3ddaa9b2b94/b9748a28-f9a5-5325-a9b1-c3ddaa9b2b94_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 548829,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dc/07357a9f20074fa6bde0707c60357697/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9748a28-f9a5-5325-a9b1-c3ddaa9b2b94/b9748a28-f9a5-5325-a9b1-c3ddaa9b2b94_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 644515,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dc/07357a9f20074fa6bde0707c60357697/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9748a28-f9a5-5325-a9b1-c3ddaa9b2b94/b9748a28-f9a5-5325-a9b1-c3ddaa9b2b94_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 510458,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dc/07357a9f20074fa6bde0707c60357697/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9748a28-f9a5-5325-a9b1-c3ddaa9b2b94/b9748a28-f9a5-5325-a9b1-c3ddaa9b2b94_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 564063,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dc/07357a9f20074fa6bde0707c60357697/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9748a28-f9a5-5325-a9b1-c3ddaa9b2b94/b9748a28-f9a5-5325-a9b1-c3ddaa9b2b94_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 620942,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dc/07357a9f20074fa6bde0707c60357697/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9748a28-f9a5-5325-a9b1-c3ddaa9b2b94/b9748a28-f9a5-5325-a9b1-c3ddaa9b2b94_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 681452,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dc/07357a9f20074fa6bde0707c60357697/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9748a28-f9a5-5325-a9b1-c3ddaa9b2b94/b9748a28-f9a5-5325-a9b1-c3ddaa9b2b94_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 392806,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dc/07357a9f20074fa6bde0707c60357697/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9748a28-f9a5-5325-a9b1-c3ddaa9b2b94/b9748a28-f9a5-5325-a9b1-c3ddaa9b2b94_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 611128,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dc/07357a9f20074fa6bde0707c60357697/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DS AUTOMOBILES DS 4 1.6 PHEV 225 PERFORMANCE LINE + AUTO',
 'transmission': 'automatic',
 'trim': '1.6 PHEV 225 PERFORMANCE LINE + AUTO',
 'vin': None,
 'year': 2023}
2026-03-26 22:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985414%27 HTTP/1.1" 200 None
2026-03-26 22:51:00 [ayvens.be] INFO: Saving data for 1985414: {'created_time': 1774565460.813944, 'last_price_update_time': 1774565460.813954, 'auction_closing_time': 1774958400.0}
2026-03-26 22:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985414') HTTP/1.1" 204 0
2026-03-26 22:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F364b6d84d94549f7b8c0629a43f9099b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/364b6d84d94549f7b8c0629a43f9099b/images/large/2.jpg not downloaded yet
2026-03-26 22:51:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2as/8ae7e35974cf408493ce7a27221b597e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2as/8ae7e35974cf408493ce7a27221b597e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F364b6d84d94549f7b8c0629a43f9099b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/364b6d84d94549f7b8c0629a43f9099b/images/large/3.jpg not downloaded yet
2026-03-26 22:51:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7ae8950>
2026-03-26 22:51:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfd4a740-44f9-552f-baa0-850394236255/bfd4a740-44f9-552f-baa0-850394236255_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2as%252F8ae7e35974cf408493ce7a27221b597e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2as/8ae7e35974cf408493ce7a27221b597e/images/large/1.jpg saved to cache
2026-03-26 22:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bfd4a740-44f9-552f-baa0-850394236255
2026-03-26 22:51:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7427f90>
2026-03-26 22:51:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfd4a740-44f9-552f-baa0-850394236255/bfd4a740-44f9-552f-baa0-850394236255_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2as%252F8ae7e35974cf408493ce7a27221b597e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2as/8ae7e35974cf408493ce7a27221b597e/images/large/2.jpg saved to cache
2026-03-26 22:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bfd4a740-44f9-552f-baa0-850394236255
2026-03-26 22:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F364b6d84d94549f7b8c0629a43f9099b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/364b6d84d94549f7b8c0629a43f9099b/images/large/4.jpg not downloaded yet
2026-03-26 22:51:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2as/8ae7e35974cf408493ce7a27221b597e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2as/8ae7e35974cf408493ce7a27221b597e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2as/8ae7e35974cf408493ce7a27221b597e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77ade10>
2026-03-26 22:51:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfd4a740-44f9-552f-baa0-850394236255/bfd4a740-44f9-552f-baa0-850394236255_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2as%252F8ae7e35974cf408493ce7a27221b597e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2as/8ae7e35974cf408493ce7a27221b597e/images/large/3.jpg saved to cache
2026-03-26 22:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bfd4a740-44f9-552f-baa0-850394236255
2026-03-26 22:51:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7400c50>
2026-03-26 22:51:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfd4a740-44f9-552f-baa0-850394236255/bfd4a740-44f9-552f-baa0-850394236255_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2as%252F8ae7e35974cf408493ce7a27221b597e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2as/8ae7e35974cf408493ce7a27221b597e/images/large/4.jpg saved to cache
2026-03-26 22:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bfd4a740-44f9-552f-baa0-850394236255
2026-03-26 22:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F364b6d84d94549f7b8c0629a43f9099b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/364b6d84d94549f7b8c0629a43f9099b/images/large/5.jpg not downloaded yet
2026-03-26 22:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F364b6d84d94549f7b8c0629a43f9099b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/364b6d84d94549f7b8c0629a43f9099b/images/large/6.jpg not downloaded yet
2026-03-26 22:51:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80be057b10>
2026-03-26 22:51:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfd4a740-44f9-552f-baa0-850394236255/bfd4a740-44f9-552f-baa0-850394236255_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2as%252F8ae7e35974cf408493ce7a27221b597e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2as/8ae7e35974cf408493ce7a27221b597e/images/large/5.jpg saved to cache
2026-03-26 22:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bfd4a740-44f9-552f-baa0-850394236255
2026-03-26 22:51:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77d6b10>
2026-03-26 22:51:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfd4a740-44f9-552f-baa0-850394236255/bfd4a740-44f9-552f-baa0-850394236255_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2as%252F8ae7e35974cf408493ce7a27221b597e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2as/8ae7e35974cf408493ce7a27221b597e/images/large/6.jpg saved to cache
2026-03-26 22:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bfd4a740-44f9-552f-baa0-850394236255
2026-03-26 22:51:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b788c550>
2026-03-26 22:51:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfd4a740-44f9-552f-baa0-850394236255/bfd4a740-44f9-552f-baa0-850394236255_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2as%252F8ae7e35974cf408493ce7a27221b597e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2as/8ae7e35974cf408493ce7a27221b597e/images/large/7.jpg saved to cache
2026-03-26 22:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bfd4a740-44f9-552f-baa0-850394236255
2026-03-26 22:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F364b6d84d94549f7b8c0629a43f9099b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/364b6d84d94549f7b8c0629a43f9099b/images/large/7.jpg not downloaded yet
2026-03-26 22:51:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2as/8ae7e35974cf408493ce7a27221b597e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2as/8ae7e35974cf408493ce7a27221b597e/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F364b6d84d94549f7b8c0629a43f9099b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/364b6d84d94549f7b8c0629a43f9099b/images/large/8.jpg not downloaded yet
2026-03-26 22:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F364b6d84d94549f7b8c0629a43f9099b%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/364b6d84d94549f7b8c0629a43f9099b/images/large/9.jpg not downloaded yet
2026-03-26 22:51:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/364b6d84d94549f7b8c0629a43f9099b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/364b6d84d94549f7b8c0629a43f9099b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F364b6d84d94549f7b8c0629a43f9099b%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/364b6d84d94549f7b8c0629a43f9099b/images/large/10.jpg not downloaded yet
2026-03-26 22:51:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2as/8ae7e35974cf408493ce7a27221b597e/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/364b6d84d94549f7b8c0629a43f9099b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/364b6d84d94549f7b8c0629a43f9099b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:01 [ayvens.be] INFO: Found listing with ID: 1985417
2026-03-26 22:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985417%27 HTTP/1.1" 200 None
2026-03-26 22:51:01 [ayvens.be] INFO: Scrape type for 1985417: 1
2026-03-26 22:51:01 [ayvens.be] INFO: Extracting data for car ID: 1985417
2026-03-26 22:51:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3824f0f-7f9e-5c51-b42c-79ea05c8283e with identifier: 1985417
2026-03-26 22:51:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3824f0f-7f9e-5c51-b42c-79ea05c8283e with scrape type 1
2026-03-26 22:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d3824f0f-7f9e-5c51-b42c-79ea05c8283e
2026-03-26 22:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252Ff573b8cbe54d4a3eb62148bb6ff4c564%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/f573b8cbe54d4a3eb62148bb6ff4c564/images/large/1.jpg not downloaded yet
2026-03-26 22:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252Ff573b8cbe54d4a3eb62148bb6ff4c564%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/f573b8cbe54d4a3eb62148bb6ff4c564/images/large/2.jpg not downloaded yet
2026-03-26 22:51:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7aa1450>
2026-03-26 22:51:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfd4a740-44f9-552f-baa0-850394236255/bfd4a740-44f9-552f-baa0-850394236255_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2as%252F8ae7e35974cf408493ce7a27221b597e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2as/8ae7e35974cf408493ce7a27221b597e/images/large/8.jpg saved to cache
2026-03-26 22:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bfd4a740-44f9-552f-baa0-850394236255
2026-03-26 22:51:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7573810>
2026-03-26 22:51:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfd4a740-44f9-552f-baa0-850394236255/bfd4a740-44f9-552f-baa0-850394236255_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2as%252F8ae7e35974cf408493ce7a27221b597e%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2as/8ae7e35974cf408493ce7a27221b597e/images/large/9.jpg saved to cache
2026-03-26 22:51:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bfd4a740-44f9-552f-baa0-850394236255
2026-03-26 22:51:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e444d0>
2026-03-26 22:51:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6992e750-cb41-5f4d-961d-bf0913a096ba/6992e750-cb41-5f4d-961d-bf0913a096ba_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F364b6d84d94549f7b8c0629a43f9099b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/364b6d84d94549f7b8c0629a43f9099b/images/large/2.jpg saved to cache
2026-03-26 22:51:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6992e750-cb41-5f4d-961d-bf0913a096ba
2026-03-26 22:51:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79f3690>
2026-03-26 22:51:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6992e750-cb41-5f4d-961d-bf0913a096ba/6992e750-cb41-5f4d-961d-bf0913a096ba_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F364b6d84d94549f7b8c0629a43f9099b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/364b6d84d94549f7b8c0629a43f9099b/images/large/1.jpg saved to cache
2026-03-26 22:51:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6992e750-cb41-5f4d-961d-bf0913a096ba
2026-03-26 22:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252Ff573b8cbe54d4a3eb62148bb6ff4c564%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/f573b8cbe54d4a3eb62148bb6ff4c564/images/large/3.jpg not downloaded yet
2026-03-26 22:51:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/364b6d84d94549f7b8c0629a43f9099b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/364b6d84d94549f7b8c0629a43f9099b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/364b6d84d94549f7b8c0629a43f9099b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252Ff573b8cbe54d4a3eb62148bb6ff4c564%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/f573b8cbe54d4a3eb62148bb6ff4c564/images/large/4.jpg not downloaded yet
2026-03-26 22:51:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/364b6d84d94549f7b8c0629a43f9099b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e01390>
2026-03-26 22:51:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfd4a740-44f9-552f-baa0-850394236255/bfd4a740-44f9-552f-baa0-850394236255_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2as%252F8ae7e35974cf408493ce7a27221b597e%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2as/8ae7e35974cf408493ce7a27221b597e/images/large/10.jpg saved to cache
2026-03-26 22:51:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bfd4a740-44f9-552f-baa0-850394236255
2026-03-26 22:51:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bfd4a740-44f9-552f-baa0-850394236255, skipping ID generation
2026-03-26 22:51:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bfd4a740-44f9-552f-baa0-850394236255 with scrape type 1
2026-03-26 22:51:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bfd4a740-44f9-552f-baa0-850394236255 sending to next pipeline
2026-03-26 22:51:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: bfd4a740-44f9-552f-baa0-850394236255, identifier: 1985415
2026-03-26 22:51:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b782c810>
2026-03-26 22:51:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6992e750-cb41-5f4d-961d-bf0913a096ba/6992e750-cb41-5f4d-961d-bf0913a096ba_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F364b6d84d94549f7b8c0629a43f9099b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/364b6d84d94549f7b8c0629a43f9099b/images/large/4.jpg saved to cache
2026-03-26 22:51:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6992e750-cb41-5f4d-961d-bf0913a096ba
2026-03-26 22:51:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e11dd0>
2026-03-26 22:51:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6992e750-cb41-5f4d-961d-bf0913a096ba/6992e750-cb41-5f4d-961d-bf0913a096ba_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F364b6d84d94549f7b8c0629a43f9099b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/364b6d84d94549f7b8c0629a43f9099b/images/large/3.jpg saved to cache
2026-03-26 22:51:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6992e750-cb41-5f4d-961d-bf0913a096ba
2026-03-26 22:51:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/364b6d84d94549f7b8c0629a43f9099b/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252Ff573b8cbe54d4a3eb62148bb6ff4c564%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/f573b8cbe54d4a3eb62148bb6ff4c564/images/large/5.jpg not downloaded yet
2026-03-26 22:51:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: bfd4a740-44f9-552f-baa0-850394236255 with identifier: 1985415
2026-03-26 22:51:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: bfd4a740-44f9-552f-baa0-850394236255 with identifier: 1985415
2026-03-26 22:51:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: bfd4a740-44f9-552f-baa0-850394236255 with identifier: 1985415 to the API
2026-03-26 22:51:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:51:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:51:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2as/8ae7e35974cf408493ce7a27221b597e/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'bfd4a740-44f9-552f-baa0-850394236255',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3 SPORTBACK',
 'odometer': 90730,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfd4a740-44f9-552f-baa0-850394236255/bfd4a740-44f9-552f-baa0-850394236255_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 698041,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2as/8ae7e35974cf408493ce7a27221b597e/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfd4a740-44f9-552f-baa0-850394236255/bfd4a740-44f9-552f-baa0-850394236255_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 668881,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2as/8ae7e35974cf408493ce7a27221b597e/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfd4a740-44f9-552f-baa0-850394236255/bfd4a740-44f9-552f-baa0-850394236255_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 702192,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2as/8ae7e35974cf408493ce7a27221b597e/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfd4a740-44f9-552f-baa0-850394236255/bfd4a740-44f9-552f-baa0-850394236255_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 712944,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2as/8ae7e35974cf408493ce7a27221b597e/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfd4a740-44f9-552f-baa0-850394236255/bfd4a740-44f9-552f-baa0-850394236255_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 695533,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2as/8ae7e35974cf408493ce7a27221b597e/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfd4a740-44f9-552f-baa0-850394236255/bfd4a740-44f9-552f-baa0-850394236255_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 701010,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2as/8ae7e35974cf408493ce7a27221b597e/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfd4a740-44f9-552f-baa0-850394236255/bfd4a740-44f9-552f-baa0-850394236255_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 585420,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2as/8ae7e35974cf408493ce7a27221b597e/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfd4a740-44f9-552f-baa0-850394236255/bfd4a740-44f9-552f-baa0-850394236255_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 840170,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2as/8ae7e35974cf408493ce7a27221b597e/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfd4a740-44f9-552f-baa0-850394236255/bfd4a740-44f9-552f-baa0-850394236255_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 835595,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2as/8ae7e35974cf408493ce7a27221b597e/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfd4a740-44f9-552f-baa0-850394236255/bfd4a740-44f9-552f-baa0-850394236255_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 866380,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2as/8ae7e35974cf408493ce7a27221b597e/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 SPORTBACK 1.4 45 TFSI E S TRONIC',
 'transmission': 'automatic',
 'trim': '1.4 45 TFSI E S TRONIC',
 'vin': None,
 'year': 2021}
2026-03-26 22:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985415%27 HTTP/1.1" 200 None
2026-03-26 22:51:03 [ayvens.be] INFO: Saving data for 1985415: {'created_time': 1774565463.001194, 'last_price_update_time': 1774565463.001202, 'auction_closing_time': 1774958400.0}
2026-03-26 22:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985415') HTTP/1.1" 204 0
2026-03-26 22:51:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/364b6d84d94549f7b8c0629a43f9099b/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252Ff573b8cbe54d4a3eb62148bb6ff4c564%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/f573b8cbe54d4a3eb62148bb6ff4c564/images/large/6.jpg not downloaded yet
2026-03-26 22:51:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6d731d0>
2026-03-26 22:51:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6992e750-cb41-5f4d-961d-bf0913a096ba/6992e750-cb41-5f4d-961d-bf0913a096ba_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F364b6d84d94549f7b8c0629a43f9099b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/364b6d84d94549f7b8c0629a43f9099b/images/large/5.jpg saved to cache
2026-03-26 22:51:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6992e750-cb41-5f4d-961d-bf0913a096ba
2026-03-26 22:51:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cb1c90>
2026-03-26 22:51:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6992e750-cb41-5f4d-961d-bf0913a096ba/6992e750-cb41-5f4d-961d-bf0913a096ba_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F364b6d84d94549f7b8c0629a43f9099b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/364b6d84d94549f7b8c0629a43f9099b/images/large/6.jpg saved to cache
2026-03-26 22:51:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6992e750-cb41-5f4d-961d-bf0913a096ba
2026-03-26 22:51:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6d80390>
2026-03-26 22:51:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6992e750-cb41-5f4d-961d-bf0913a096ba/6992e750-cb41-5f4d-961d-bf0913a096ba_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F364b6d84d94549f7b8c0629a43f9099b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/364b6d84d94549f7b8c0629a43f9099b/images/large/7.jpg saved to cache
2026-03-26 22:51:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6992e750-cb41-5f4d-961d-bf0913a096ba
2026-03-26 22:51:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77bf590>
2026-03-26 22:51:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6992e750-cb41-5f4d-961d-bf0913a096ba/6992e750-cb41-5f4d-961d-bf0913a096ba_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F364b6d84d94549f7b8c0629a43f9099b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/364b6d84d94549f7b8c0629a43f9099b/images/large/8.jpg saved to cache
2026-03-26 22:51:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6992e750-cb41-5f4d-961d-bf0913a096ba
2026-03-26 22:51:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd3b6190>
2026-03-26 22:51:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6992e750-cb41-5f4d-961d-bf0913a096ba/6992e750-cb41-5f4d-961d-bf0913a096ba_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F364b6d84d94549f7b8c0629a43f9099b%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/364b6d84d94549f7b8c0629a43f9099b/images/large/9.jpg saved to cache
2026-03-26 22:51:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6992e750-cb41-5f4d-961d-bf0913a096ba
2026-03-26 22:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252Ff573b8cbe54d4a3eb62148bb6ff4c564%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/f573b8cbe54d4a3eb62148bb6ff4c564/images/large/7.jpg not downloaded yet
2026-03-26 22:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252Ff573b8cbe54d4a3eb62148bb6ff4c564%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/f573b8cbe54d4a3eb62148bb6ff4c564/images/large/8.jpg not downloaded yet
2026-03-26 22:51:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cc8310>
2026-03-26 22:51:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6992e750-cb41-5f4d-961d-bf0913a096ba/6992e750-cb41-5f4d-961d-bf0913a096ba_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F364b6d84d94549f7b8c0629a43f9099b%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/364b6d84d94549f7b8c0629a43f9099b/images/large/10.jpg saved to cache
2026-03-26 22:51:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6992e750-cb41-5f4d-961d-bf0913a096ba
2026-03-26 22:51:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6992e750-cb41-5f4d-961d-bf0913a096ba, skipping ID generation
2026-03-26 22:51:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6992e750-cb41-5f4d-961d-bf0913a096ba with scrape type 1
2026-03-26 22:51:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6992e750-cb41-5f4d-961d-bf0913a096ba sending to next pipeline
2026-03-26 22:51:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 6992e750-cb41-5f4d-961d-bf0913a096ba, identifier: 1985416
2026-03-26 22:51:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 6992e750-cb41-5f4d-961d-bf0913a096ba with identifier: 1985416
2026-03-26 22:51:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 6992e750-cb41-5f4d-961d-bf0913a096ba with identifier: 1985416
2026-03-26 22:51:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 6992e750-cb41-5f4d-961d-bf0913a096ba with identifier: 1985416 to the API
2026-03-26 22:51:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:51:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:51:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bp/364b6d84d94549f7b8c0629a43f9099b/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '6992e750-cb41-5f4d-961d-bf0913a096ba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'T-CROSS',
 'odometer': 29642,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6992e750-cb41-5f4d-961d-bf0913a096ba/6992e750-cb41-5f4d-961d-bf0913a096ba_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 556717,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/364b6d84d94549f7b8c0629a43f9099b/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6992e750-cb41-5f4d-961d-bf0913a096ba/6992e750-cb41-5f4d-961d-bf0913a096ba_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 527833,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/364b6d84d94549f7b8c0629a43f9099b/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6992e750-cb41-5f4d-961d-bf0913a096ba/6992e750-cb41-5f4d-961d-bf0913a096ba_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 562289,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/364b6d84d94549f7b8c0629a43f9099b/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6992e750-cb41-5f4d-961d-bf0913a096ba/6992e750-cb41-5f4d-961d-bf0913a096ba_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 566313,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/364b6d84d94549f7b8c0629a43f9099b/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6992e750-cb41-5f4d-961d-bf0913a096ba/6992e750-cb41-5f4d-961d-bf0913a096ba_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 335162,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/364b6d84d94549f7b8c0629a43f9099b/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6992e750-cb41-5f4d-961d-bf0913a096ba/6992e750-cb41-5f4d-961d-bf0913a096ba_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 318037,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/364b6d84d94549f7b8c0629a43f9099b/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6992e750-cb41-5f4d-961d-bf0913a096ba/6992e750-cb41-5f4d-961d-bf0913a096ba_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 326337,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/364b6d84d94549f7b8c0629a43f9099b/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6992e750-cb41-5f4d-961d-bf0913a096ba/6992e750-cb41-5f4d-961d-bf0913a096ba_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 365841,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/364b6d84d94549f7b8c0629a43f9099b/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6992e750-cb41-5f4d-961d-bf0913a096ba/6992e750-cb41-5f4d-961d-bf0913a096ba_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 396523,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/364b6d84d94549f7b8c0629a43f9099b/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6992e750-cb41-5f4d-961d-bf0913a096ba/6992e750-cb41-5f4d-961d-bf0913a096ba_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 287468,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/364b6d84d94549f7b8c0629a43f9099b/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN T-CROSS 1.0 TSI 81KW LIFE',
 'transmission': 'manual',
 'trim': '1.0 TSI 81KW LIFE',
 'vin': None,
 'year': 2022}
2026-03-26 22:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985416%27 HTTP/1.1" 200 None
2026-03-26 22:51:04 [ayvens.be] INFO: Saving data for 1985416: {'created_time': 1774565464.206135, 'last_price_update_time': 1774565464.206146, 'auction_closing_time': 1774958400.0}
2026-03-26 22:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985416') HTTP/1.1" 204 0
2026-03-26 22:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252Ff573b8cbe54d4a3eb62148bb6ff4c564%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/f573b8cbe54d4a3eb62148bb6ff4c564/images/large/9.jpg not downloaded yet
2026-03-26 22:51:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/f573b8cbe54d4a3eb62148bb6ff4c564/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252Ff573b8cbe54d4a3eb62148bb6ff4c564%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/f573b8cbe54d4a3eb62148bb6ff4c564/images/large/10.jpg not downloaded yet
2026-03-26 22:51:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/f573b8cbe54d4a3eb62148bb6ff4c564/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:04 [ayvens.be] INFO: Found listing with ID: 1985418
2026-03-26 22:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985418%27 HTTP/1.1" 200 None
2026-03-26 22:51:04 [ayvens.be] INFO: Scrape type for 1985418: 1
2026-03-26 22:51:04 [ayvens.be] INFO: Extracting data for car ID: 1985418
2026-03-26 22:51:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3523fb47-4378-50b8-98c0-ddf9b02d04ec with identifier: 1985418
2026-03-26 22:51:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3523fb47-4378-50b8-98c0-ddf9b02d04ec with scrape type 1
2026-03-26 22:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3523fb47-4378-50b8-98c0-ddf9b02d04ec
2026-03-26 22:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F97306c3bae29451aa8c0a5429131c762%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/97306c3bae29451aa8c0a5429131c762/images/large/1.jpg not downloaded yet
2026-03-26 22:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F97306c3bae29451aa8c0a5429131c762%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/97306c3bae29451aa8c0a5429131c762/images/large/2.jpg not downloaded yet
2026-03-26 22:51:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/f573b8cbe54d4a3eb62148bb6ff4c564/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/f573b8cbe54d4a3eb62148bb6ff4c564/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F97306c3bae29451aa8c0a5429131c762%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/97306c3bae29451aa8c0a5429131c762/images/large/3.jpg not downloaded yet
2026-03-26 22:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F97306c3bae29451aa8c0a5429131c762%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/97306c3bae29451aa8c0a5429131c762/images/large/4.jpg not downloaded yet
2026-03-26 22:51:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/f573b8cbe54d4a3eb62148bb6ff4c564/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7ccfb10>
2026-03-26 22:51:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3824f0f-7f9e-5c51-b42c-79ea05c8283e/d3824f0f-7f9e-5c51-b42c-79ea05c8283e_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252Ff573b8cbe54d4a3eb62148bb6ff4c564%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/f573b8cbe54d4a3eb62148bb6ff4c564/images/large/1.jpg saved to cache
2026-03-26 22:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d3824f0f-7f9e-5c51-b42c-79ea05c8283e
2026-03-26 22:51:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/f573b8cbe54d4a3eb62148bb6ff4c564/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F97306c3bae29451aa8c0a5429131c762%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/97306c3bae29451aa8c0a5429131c762/images/large/5.jpg not downloaded yet
2026-03-26 22:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F97306c3bae29451aa8c0a5429131c762%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/97306c3bae29451aa8c0a5429131c762/images/large/6.jpg not downloaded yet
2026-03-26 22:51:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77d4290>
2026-03-26 22:51:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3824f0f-7f9e-5c51-b42c-79ea05c8283e/d3824f0f-7f9e-5c51-b42c-79ea05c8283e_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252Ff573b8cbe54d4a3eb62148bb6ff4c564%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/f573b8cbe54d4a3eb62148bb6ff4c564/images/large/2.jpg saved to cache
2026-03-26 22:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d3824f0f-7f9e-5c51-b42c-79ea05c8283e
2026-03-26 22:51:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b98e90>
2026-03-26 22:51:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3824f0f-7f9e-5c51-b42c-79ea05c8283e/d3824f0f-7f9e-5c51-b42c-79ea05c8283e_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252Ff573b8cbe54d4a3eb62148bb6ff4c564%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/f573b8cbe54d4a3eb62148bb6ff4c564/images/large/3.jpg saved to cache
2026-03-26 22:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d3824f0f-7f9e-5c51-b42c-79ea05c8283e
2026-03-26 22:51:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e03250>
2026-03-26 22:51:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3824f0f-7f9e-5c51-b42c-79ea05c8283e/d3824f0f-7f9e-5c51-b42c-79ea05c8283e_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252Ff573b8cbe54d4a3eb62148bb6ff4c564%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/f573b8cbe54d4a3eb62148bb6ff4c564/images/large/4.jpg saved to cache
2026-03-26 22:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d3824f0f-7f9e-5c51-b42c-79ea05c8283e
2026-03-26 22:51:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b16e50>
2026-03-26 22:51:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3824f0f-7f9e-5c51-b42c-79ea05c8283e/d3824f0f-7f9e-5c51-b42c-79ea05c8283e_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252Ff573b8cbe54d4a3eb62148bb6ff4c564%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/f573b8cbe54d4a3eb62148bb6ff4c564/images/large/5.jpg saved to cache
2026-03-26 22:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d3824f0f-7f9e-5c51-b42c-79ea05c8283e
2026-03-26 22:51:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/f573b8cbe54d4a3eb62148bb6ff4c564/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F97306c3bae29451aa8c0a5429131c762%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/97306c3bae29451aa8c0a5429131c762/images/large/7.jpg not downloaded yet
2026-03-26 22:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F97306c3bae29451aa8c0a5429131c762%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/97306c3bae29451aa8c0a5429131c762/images/large/8.jpg not downloaded yet
2026-03-26 22:51:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7411c50>
2026-03-26 22:51:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3824f0f-7f9e-5c51-b42c-79ea05c8283e/d3824f0f-7f9e-5c51-b42c-79ea05c8283e_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252Ff573b8cbe54d4a3eb62148bb6ff4c564%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/f573b8cbe54d4a3eb62148bb6ff4c564/images/large/6.jpg saved to cache
2026-03-26 22:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d3824f0f-7f9e-5c51-b42c-79ea05c8283e
2026-03-26 22:51:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/f573b8cbe54d4a3eb62148bb6ff4c564/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F97306c3bae29451aa8c0a5429131c762%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/97306c3bae29451aa8c0a5429131c762/images/large/9.jpg not downloaded yet
2026-03-26 22:51:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/97306c3bae29451aa8c0a5429131c762/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/97306c3bae29451aa8c0a5429131c762/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/f573b8cbe54d4a3eb62148bb6ff4c564/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F97306c3bae29451aa8c0a5429131c762%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/97306c3bae29451aa8c0a5429131c762/images/large/10.jpg not downloaded yet
2026-03-26 22:51:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/f573b8cbe54d4a3eb62148bb6ff4c564/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7488510>
2026-03-26 22:51:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3824f0f-7f9e-5c51-b42c-79ea05c8283e/d3824f0f-7f9e-5c51-b42c-79ea05c8283e_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252Ff573b8cbe54d4a3eb62148bb6ff4c564%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/f573b8cbe54d4a3eb62148bb6ff4c564/images/large/7.jpg saved to cache
2026-03-26 22:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d3824f0f-7f9e-5c51-b42c-79ea05c8283e
2026-03-26 22:51:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/97306c3bae29451aa8c0a5429131c762/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:05 [ayvens.be] INFO: Found listing with ID: 1985419
2026-03-26 22:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985419%27 HTTP/1.1" 200 None
2026-03-26 22:51:05 [ayvens.be] INFO: Scrape type for 1985419: 1
2026-03-26 22:51:05 [ayvens.be] INFO: Extracting data for car ID: 1985419
2026-03-26 22:51:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a2b7706-9cb9-50f9-bf45-1d72b1675d17 with identifier: 1985419
2026-03-26 22:51:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a2b7706-9cb9-50f9-bf45-1d72b1675d17 with scrape type 1
2026-03-26 22:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3a2b7706-9cb9-50f9-bf45-1d72b1675d17
2026-03-26 22:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F49a6c5d768cc4237b156086e41936c85%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/49a6c5d768cc4237b156086e41936c85/images/large/1.jpg not downloaded yet
2026-03-26 22:51:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/97306c3bae29451aa8c0a5429131c762/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F49a6c5d768cc4237b156086e41936c85%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/49a6c5d768cc4237b156086e41936c85/images/large/2.jpg not downloaded yet
2026-03-26 22:51:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/97306c3bae29451aa8c0a5429131c762/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7412c50>
2026-03-26 22:51:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3824f0f-7f9e-5c51-b42c-79ea05c8283e/d3824f0f-7f9e-5c51-b42c-79ea05c8283e_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252Ff573b8cbe54d4a3eb62148bb6ff4c564%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/f573b8cbe54d4a3eb62148bb6ff4c564/images/large/9.jpg saved to cache
2026-03-26 22:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d3824f0f-7f9e-5c51-b42c-79ea05c8283e
2026-03-26 22:51:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79cead0>
2026-03-26 22:51:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3523fb47-4378-50b8-98c0-ddf9b02d04ec/3523fb47-4378-50b8-98c0-ddf9b02d04ec_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F97306c3bae29451aa8c0a5429131c762%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/97306c3bae29451aa8c0a5429131c762/images/large/1.jpg saved to cache
2026-03-26 22:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3523fb47-4378-50b8-98c0-ddf9b02d04ec
2026-03-26 22:51:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76ccdd0>
2026-03-26 22:51:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3523fb47-4378-50b8-98c0-ddf9b02d04ec/3523fb47-4378-50b8-98c0-ddf9b02d04ec_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F97306c3bae29451aa8c0a5429131c762%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/97306c3bae29451aa8c0a5429131c762/images/large/2.jpg saved to cache
2026-03-26 22:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3523fb47-4378-50b8-98c0-ddf9b02d04ec
2026-03-26 22:51:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74df890>
2026-03-26 22:51:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3824f0f-7f9e-5c51-b42c-79ea05c8283e/d3824f0f-7f9e-5c51-b42c-79ea05c8283e_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252Ff573b8cbe54d4a3eb62148bb6ff4c564%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/f573b8cbe54d4a3eb62148bb6ff4c564/images/large/8.jpg saved to cache
2026-03-26 22:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d3824f0f-7f9e-5c51-b42c-79ea05c8283e
2026-03-26 22:51:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74a7d10>
2026-03-26 22:51:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3824f0f-7f9e-5c51-b42c-79ea05c8283e/d3824f0f-7f9e-5c51-b42c-79ea05c8283e_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252Ff573b8cbe54d4a3eb62148bb6ff4c564%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/f573b8cbe54d4a3eb62148bb6ff4c564/images/large/10.jpg saved to cache
2026-03-26 22:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d3824f0f-7f9e-5c51-b42c-79ea05c8283e
2026-03-26 22:51:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d3824f0f-7f9e-5c51-b42c-79ea05c8283e, skipping ID generation
2026-03-26 22:51:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3824f0f-7f9e-5c51-b42c-79ea05c8283e with scrape type 1
2026-03-26 22:51:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d3824f0f-7f9e-5c51-b42c-79ea05c8283e sending to next pipeline
2026-03-26 22:51:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d3824f0f-7f9e-5c51-b42c-79ea05c8283e, identifier: 1985417
2026-03-26 22:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F49a6c5d768cc4237b156086e41936c85%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/49a6c5d768cc4237b156086e41936c85/images/large/3.jpg not downloaded yet
2026-03-26 22:51:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d3824f0f-7f9e-5c51-b42c-79ea05c8283e with identifier: 1985417
2026-03-26 22:51:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d3824f0f-7f9e-5c51-b42c-79ea05c8283e with identifier: 1985417
2026-03-26 22:51:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d3824f0f-7f9e-5c51-b42c-79ea05c8283e with identifier: 1985417 to the API
2026-03-26 22:51:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:51:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:51:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bu/f573b8cbe54d4a3eb62148bb6ff4c564/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'd3824f0f-7f9e-5c51-b42c-79ea05c8283e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3 Sportback',
 'odometer': 60223,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3824f0f-7f9e-5c51-b42c-79ea05c8283e/d3824f0f-7f9e-5c51-b42c-79ea05c8283e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 744087,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/f573b8cbe54d4a3eb62148bb6ff4c564/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3824f0f-7f9e-5c51-b42c-79ea05c8283e/d3824f0f-7f9e-5c51-b42c-79ea05c8283e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 764886,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/f573b8cbe54d4a3eb62148bb6ff4c564/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3824f0f-7f9e-5c51-b42c-79ea05c8283e/d3824f0f-7f9e-5c51-b42c-79ea05c8283e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 735106,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/f573b8cbe54d4a3eb62148bb6ff4c564/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3824f0f-7f9e-5c51-b42c-79ea05c8283e/d3824f0f-7f9e-5c51-b42c-79ea05c8283e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 772653,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/f573b8cbe54d4a3eb62148bb6ff4c564/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3824f0f-7f9e-5c51-b42c-79ea05c8283e/d3824f0f-7f9e-5c51-b42c-79ea05c8283e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 741804,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/f573b8cbe54d4a3eb62148bb6ff4c564/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3824f0f-7f9e-5c51-b42c-79ea05c8283e/d3824f0f-7f9e-5c51-b42c-79ea05c8283e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 789909,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/f573b8cbe54d4a3eb62148bb6ff4c564/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3824f0f-7f9e-5c51-b42c-79ea05c8283e/d3824f0f-7f9e-5c51-b42c-79ea05c8283e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 622395,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/f573b8cbe54d4a3eb62148bb6ff4c564/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3824f0f-7f9e-5c51-b42c-79ea05c8283e/d3824f0f-7f9e-5c51-b42c-79ea05c8283e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 810119,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/f573b8cbe54d4a3eb62148bb6ff4c564/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3824f0f-7f9e-5c51-b42c-79ea05c8283e/d3824f0f-7f9e-5c51-b42c-79ea05c8283e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 780271,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/f573b8cbe54d4a3eb62148bb6ff4c564/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3824f0f-7f9e-5c51-b42c-79ea05c8283e/d3824f0f-7f9e-5c51-b42c-79ea05c8283e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 771284,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/f573b8cbe54d4a3eb62148bb6ff4c564/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 Sportback 1.4 45 TFSI E S TRONIC',
 'transmission': 'automatic',
 'trim': '1.4 45 TFSI E S TRONIC',
 'vin': None,
 'year': 2022}
2026-03-26 22:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985417%27 HTTP/1.1" 200 None
2026-03-26 22:51:06 [ayvens.be] INFO: Saving data for 1985417: {'created_time': 1774565466.434055, 'last_price_update_time': 1774565466.434064, 'auction_closing_time': 1774958400.0}
2026-03-26 22:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985417') HTTP/1.1" 204 0
2026-03-26 22:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F49a6c5d768cc4237b156086e41936c85%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/49a6c5d768cc4237b156086e41936c85/images/large/4.jpg not downloaded yet
2026-03-26 22:51:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b744b2d0>
2026-03-26 22:51:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3523fb47-4378-50b8-98c0-ddf9b02d04ec/3523fb47-4378-50b8-98c0-ddf9b02d04ec_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F97306c3bae29451aa8c0a5429131c762%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/97306c3bae29451aa8c0a5429131c762/images/large/3.jpg saved to cache
2026-03-26 22:51:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3523fb47-4378-50b8-98c0-ddf9b02d04ec
2026-03-26 22:51:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b727b010>
2026-03-26 22:51:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3523fb47-4378-50b8-98c0-ddf9b02d04ec/3523fb47-4378-50b8-98c0-ddf9b02d04ec_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F97306c3bae29451aa8c0a5429131c762%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/97306c3bae29451aa8c0a5429131c762/images/large/4.jpg saved to cache
2026-03-26 22:51:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3523fb47-4378-50b8-98c0-ddf9b02d04ec
2026-03-26 22:51:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b744afd0>
2026-03-26 22:51:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3523fb47-4378-50b8-98c0-ddf9b02d04ec/3523fb47-4378-50b8-98c0-ddf9b02d04ec_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F97306c3bae29451aa8c0a5429131c762%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/97306c3bae29451aa8c0a5429131c762/images/large/5.jpg saved to cache
2026-03-26 22:51:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3523fb47-4378-50b8-98c0-ddf9b02d04ec
2026-03-26 22:51:06 [scrapy.extensions.logstats] INFO: Crawled 5 pages (at -1 pages/min), scraped 198 items (at 36 items/min)
2026-03-26 22:51:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 181MiB
2026-03-26 22:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F49a6c5d768cc4237b156086e41936c85%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/49a6c5d768cc4237b156086e41936c85/images/large/5.jpg not downloaded yet
2026-03-26 22:51:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/97306c3bae29451aa8c0a5429131c762/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/97306c3bae29451aa8c0a5429131c762/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F49a6c5d768cc4237b156086e41936c85%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/49a6c5d768cc4237b156086e41936c85/images/large/6.jpg not downloaded yet
2026-03-26 22:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F49a6c5d768cc4237b156086e41936c85%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/49a6c5d768cc4237b156086e41936c85/images/large/7.jpg not downloaded yet
2026-03-26 22:51:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/97306c3bae29451aa8c0a5429131c762/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/97306c3bae29451aa8c0a5429131c762/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/97306c3bae29451aa8c0a5429131c762/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F49a6c5d768cc4237b156086e41936c85%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/49a6c5d768cc4237b156086e41936c85/images/large/8.jpg not downloaded yet
2026-03-26 22:51:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/49a6c5d768cc4237b156086e41936c85/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F49a6c5d768cc4237b156086e41936c85%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/49a6c5d768cc4237b156086e41936c85/images/large/9.jpg not downloaded yet
2026-03-26 22:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F49a6c5d768cc4237b156086e41936c85%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/49a6c5d768cc4237b156086e41936c85/images/large/10.jpg not downloaded yet
2026-03-26 22:51:07 [ayvens.be] INFO: Found listing with ID: 1985420
2026-03-26 22:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985420%27 HTTP/1.1" 200 None
2026-03-26 22:51:07 [ayvens.be] INFO: Scrape type for 1985420: 1
2026-03-26 22:51:07 [ayvens.be] INFO: Extracting data for car ID: 1985420
2026-03-26 22:51:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6e478d88-9255-5fdd-848c-32c5ddc31c17 with identifier: 1985420
2026-03-26 22:51:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e478d88-9255-5fdd-848c-32c5ddc31c17 with scrape type 1
2026-03-26 22:51:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6e478d88-9255-5fdd-848c-32c5ddc31c17
2026-03-26 22:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F8794398acf314af2a2ca94b36bc5d865%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/8794398acf314af2a2ca94b36bc5d865/images/large/1.jpg not downloaded yet
2026-03-26 22:51:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b78751d0>
2026-03-26 22:51:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3523fb47-4378-50b8-98c0-ddf9b02d04ec/3523fb47-4378-50b8-98c0-ddf9b02d04ec_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F97306c3bae29451aa8c0a5429131c762%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/97306c3bae29451aa8c0a5429131c762/images/large/6.jpg saved to cache
2026-03-26 22:51:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3523fb47-4378-50b8-98c0-ddf9b02d04ec
2026-03-26 22:51:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b787f6d0>
2026-03-26 22:51:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3523fb47-4378-50b8-98c0-ddf9b02d04ec/3523fb47-4378-50b8-98c0-ddf9b02d04ec_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F97306c3bae29451aa8c0a5429131c762%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/97306c3bae29451aa8c0a5429131c762/images/large/7.jpg saved to cache
2026-03-26 22:51:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3523fb47-4378-50b8-98c0-ddf9b02d04ec
2026-03-26 22:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F8794398acf314af2a2ca94b36bc5d865%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/8794398acf314af2a2ca94b36bc5d865/images/large/2.jpg not downloaded yet
2026-03-26 22:51:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cc8690>
2026-03-26 22:51:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3523fb47-4378-50b8-98c0-ddf9b02d04ec/3523fb47-4378-50b8-98c0-ddf9b02d04ec_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F97306c3bae29451aa8c0a5429131c762%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/97306c3bae29451aa8c0a5429131c762/images/large/8.jpg saved to cache
2026-03-26 22:51:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3523fb47-4378-50b8-98c0-ddf9b02d04ec
2026-03-26 22:51:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd0af310>
2026-03-26 22:51:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3523fb47-4378-50b8-98c0-ddf9b02d04ec/3523fb47-4378-50b8-98c0-ddf9b02d04ec_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F97306c3bae29451aa8c0a5429131c762%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/97306c3bae29451aa8c0a5429131c762/images/large/9.jpg saved to cache
2026-03-26 22:51:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3523fb47-4378-50b8-98c0-ddf9b02d04ec
2026-03-26 22:51:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b728ebd0>
2026-03-26 22:51:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3523fb47-4378-50b8-98c0-ddf9b02d04ec/3523fb47-4378-50b8-98c0-ddf9b02d04ec_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F97306c3bae29451aa8c0a5429131c762%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/97306c3bae29451aa8c0a5429131c762/images/large/10.jpg saved to cache
2026-03-26 22:51:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3523fb47-4378-50b8-98c0-ddf9b02d04ec
2026-03-26 22:51:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3523fb47-4378-50b8-98c0-ddf9b02d04ec, skipping ID generation
2026-03-26 22:51:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3523fb47-4378-50b8-98c0-ddf9b02d04ec with scrape type 1
2026-03-26 22:51:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3523fb47-4378-50b8-98c0-ddf9b02d04ec sending to next pipeline
2026-03-26 22:51:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 3523fb47-4378-50b8-98c0-ddf9b02d04ec, identifier: 1985418
2026-03-26 22:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F8794398acf314af2a2ca94b36bc5d865%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/8794398acf314af2a2ca94b36bc5d865/images/large/3.jpg not downloaded yet
2026-03-26 22:51:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 3523fb47-4378-50b8-98c0-ddf9b02d04ec with identifier: 1985418
2026-03-26 22:51:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 3523fb47-4378-50b8-98c0-ddf9b02d04ec with identifier: 1985418
2026-03-26 22:51:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 3523fb47-4378-50b8-98c0-ddf9b02d04ec with identifier: 1985418 to the API
2026-03-26 22:51:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:51:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:51:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bp/97306c3bae29451aa8c0a5429131c762/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '3523fb47-4378-50b8-98c0-ddf9b02d04ec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '3 SERIES BERLINE',
 'odometer': 93484,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3523fb47-4378-50b8-98c0-ddf9b02d04ec/3523fb47-4378-50b8-98c0-ddf9b02d04ec_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 567599,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/97306c3bae29451aa8c0a5429131c762/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3523fb47-4378-50b8-98c0-ddf9b02d04ec/3523fb47-4378-50b8-98c0-ddf9b02d04ec_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 567398,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/97306c3bae29451aa8c0a5429131c762/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3523fb47-4378-50b8-98c0-ddf9b02d04ec/3523fb47-4378-50b8-98c0-ddf9b02d04ec_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 523451,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/97306c3bae29451aa8c0a5429131c762/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3523fb47-4378-50b8-98c0-ddf9b02d04ec/3523fb47-4378-50b8-98c0-ddf9b02d04ec_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 596489,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/97306c3bae29451aa8c0a5429131c762/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3523fb47-4378-50b8-98c0-ddf9b02d04ec/3523fb47-4378-50b8-98c0-ddf9b02d04ec_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 443634,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/97306c3bae29451aa8c0a5429131c762/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3523fb47-4378-50b8-98c0-ddf9b02d04ec/3523fb47-4378-50b8-98c0-ddf9b02d04ec_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 584484,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/97306c3bae29451aa8c0a5429131c762/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3523fb47-4378-50b8-98c0-ddf9b02d04ec/3523fb47-4378-50b8-98c0-ddf9b02d04ec_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 596636,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/97306c3bae29451aa8c0a5429131c762/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3523fb47-4378-50b8-98c0-ddf9b02d04ec/3523fb47-4378-50b8-98c0-ddf9b02d04ec_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 586049,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/97306c3bae29451aa8c0a5429131c762/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3523fb47-4378-50b8-98c0-ddf9b02d04ec/3523fb47-4378-50b8-98c0-ddf9b02d04ec_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 592027,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/97306c3bae29451aa8c0a5429131c762/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3523fb47-4378-50b8-98c0-ddf9b02d04ec/3523fb47-4378-50b8-98c0-ddf9b02d04ec_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 551284,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/97306c3bae29451aa8c0a5429131c762/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3 SERIES BERLINE 2.0 320E BERLINE',
 'transmission': 'automatic',
 'trim': '2.0 320E BERLINE',
 'vin': None,
 'year': 2022}
2026-03-26 22:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985418%27 HTTP/1.1" 200 None
2026-03-26 22:51:08 [ayvens.be] INFO: Saving data for 1985418: {'created_time': 1774565468.082764, 'last_price_update_time': 1774565468.082776, 'auction_closing_time': 1774958400.0}
2026-03-26 22:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985418') HTTP/1.1" 204 0
2026-03-26 22:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F8794398acf314af2a2ca94b36bc5d865%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/8794398acf314af2a2ca94b36bc5d865/images/large/4.jpg not downloaded yet
2026-03-26 22:51:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7910290>
2026-03-26 22:51:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a2b7706-9cb9-50f9-bf45-1d72b1675d17/3a2b7706-9cb9-50f9-bf45-1d72b1675d17_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F49a6c5d768cc4237b156086e41936c85%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/49a6c5d768cc4237b156086e41936c85/images/large/1.jpg saved to cache
2026-03-26 22:51:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3a2b7706-9cb9-50f9-bf45-1d72b1675d17
2026-03-26 22:51:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/49a6c5d768cc4237b156086e41936c85/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F8794398acf314af2a2ca94b36bc5d865%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/8794398acf314af2a2ca94b36bc5d865/images/large/5.jpg not downloaded yet
2026-03-26 22:51:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/49a6c5d768cc4237b156086e41936c85/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F8794398acf314af2a2ca94b36bc5d865%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/8794398acf314af2a2ca94b36bc5d865/images/large/6.jpg not downloaded yet
2026-03-26 22:51:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/49a6c5d768cc4237b156086e41936c85/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/49a6c5d768cc4237b156086e41936c85/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F8794398acf314af2a2ca94b36bc5d865%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/8794398acf314af2a2ca94b36bc5d865/images/large/7.jpg not downloaded yet
2026-03-26 22:51:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/49a6c5d768cc4237b156086e41936c85/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F8794398acf314af2a2ca94b36bc5d865%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/8794398acf314af2a2ca94b36bc5d865/images/large/8.jpg not downloaded yet
2026-03-26 22:51:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/49a6c5d768cc4237b156086e41936c85/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/49a6c5d768cc4237b156086e41936c85/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/49a6c5d768cc4237b156086e41936c85/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F8794398acf314af2a2ca94b36bc5d865%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/8794398acf314af2a2ca94b36bc5d865/images/large/9.jpg not downloaded yet
2026-03-26 22:51:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b741e5d0>
2026-03-26 22:51:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a2b7706-9cb9-50f9-bf45-1d72b1675d17/3a2b7706-9cb9-50f9-bf45-1d72b1675d17_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F49a6c5d768cc4237b156086e41936c85%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/49a6c5d768cc4237b156086e41936c85/images/large/3.jpg saved to cache
2026-03-26 22:51:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3a2b7706-9cb9-50f9-bf45-1d72b1675d17
2026-03-26 22:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F8794398acf314af2a2ca94b36bc5d865%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/8794398acf314af2a2ca94b36bc5d865/images/large/10.jpg not downloaded yet
2026-03-26 22:51:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74bf650>
2026-03-26 22:51:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a2b7706-9cb9-50f9-bf45-1d72b1675d17/3a2b7706-9cb9-50f9-bf45-1d72b1675d17_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F49a6c5d768cc4237b156086e41936c85%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/49a6c5d768cc4237b156086e41936c85/images/large/2.jpg saved to cache
2026-03-26 22:51:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3a2b7706-9cb9-50f9-bf45-1d72b1675d17
2026-03-26 22:51:08 [ayvens.be] INFO: Found listing with ID: 1985421
2026-03-26 22:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985421%27 HTTP/1.1" 200 None
2026-03-26 22:51:08 [ayvens.be] INFO: Scrape type for 1985421: 1
2026-03-26 22:51:08 [ayvens.be] INFO: Extracting data for car ID: 1985421
2026-03-26 22:51:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b0597b31-b618-5a7c-9897-7d9733dea90c with identifier: 1985421
2026-03-26 22:51:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0597b31-b618-5a7c-9897-7d9733dea90c with scrape type 1
2026-03-26 22:51:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b0597b31-b618-5a7c-9897-7d9733dea90c
2026-03-26 22:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Feec5061576004a43adb58930fcf48a25%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/eec5061576004a43adb58930fcf48a25/images/large/1.jpg not downloaded yet
2026-03-26 22:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Feec5061576004a43adb58930fcf48a25%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/eec5061576004a43adb58930fcf48a25/images/large/2.jpg not downloaded yet
2026-03-26 22:51:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77ae950>
2026-03-26 22:51:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a2b7706-9cb9-50f9-bf45-1d72b1675d17/3a2b7706-9cb9-50f9-bf45-1d72b1675d17_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F49a6c5d768cc4237b156086e41936c85%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/49a6c5d768cc4237b156086e41936c85/images/large/7.jpg saved to cache
2026-03-26 22:51:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3a2b7706-9cb9-50f9-bf45-1d72b1675d17
2026-03-26 22:51:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7911990>
2026-03-26 22:51:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a2b7706-9cb9-50f9-bf45-1d72b1675d17/3a2b7706-9cb9-50f9-bf45-1d72b1675d17_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F49a6c5d768cc4237b156086e41936c85%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/49a6c5d768cc4237b156086e41936c85/images/large/4.jpg saved to cache
2026-03-26 22:51:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3a2b7706-9cb9-50f9-bf45-1d72b1675d17
2026-03-26 22:51:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c80b90>
2026-03-26 22:51:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a2b7706-9cb9-50f9-bf45-1d72b1675d17/3a2b7706-9cb9-50f9-bf45-1d72b1675d17_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F49a6c5d768cc4237b156086e41936c85%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/49a6c5d768cc4237b156086e41936c85/images/large/5.jpg saved to cache
2026-03-26 22:51:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3a2b7706-9cb9-50f9-bf45-1d72b1675d17
2026-03-26 22:51:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b98610>
2026-03-26 22:51:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a2b7706-9cb9-50f9-bf45-1d72b1675d17/3a2b7706-9cb9-50f9-bf45-1d72b1675d17_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F49a6c5d768cc4237b156086e41936c85%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/49a6c5d768cc4237b156086e41936c85/images/large/6.jpg saved to cache
2026-03-26 22:51:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3a2b7706-9cb9-50f9-bf45-1d72b1675d17
2026-03-26 22:51:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79f2ed0>
2026-03-26 22:51:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a2b7706-9cb9-50f9-bf45-1d72b1675d17/3a2b7706-9cb9-50f9-bf45-1d72b1675d17_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F49a6c5d768cc4237b156086e41936c85%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/49a6c5d768cc4237b156086e41936c85/images/large/8.jpg saved to cache
2026-03-26 22:51:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3a2b7706-9cb9-50f9-bf45-1d72b1675d17
2026-03-26 22:51:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7ca9890>
2026-03-26 22:51:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a2b7706-9cb9-50f9-bf45-1d72b1675d17/3a2b7706-9cb9-50f9-bf45-1d72b1675d17_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F49a6c5d768cc4237b156086e41936c85%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/49a6c5d768cc4237b156086e41936c85/images/large/9.jpg saved to cache
2026-03-26 22:51:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3a2b7706-9cb9-50f9-bf45-1d72b1675d17
2026-03-26 22:51:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/8794398acf314af2a2ca94b36bc5d865/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Feec5061576004a43adb58930fcf48a25%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/eec5061576004a43adb58930fcf48a25/images/large/3.jpg not downloaded yet
2026-03-26 22:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Feec5061576004a43adb58930fcf48a25%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/eec5061576004a43adb58930fcf48a25/images/large/4.jpg not downloaded yet
2026-03-26 22:51:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/8794398acf314af2a2ca94b36bc5d865/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/8794398acf314af2a2ca94b36bc5d865/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/8794398acf314af2a2ca94b36bc5d865/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/8794398acf314af2a2ca94b36bc5d865/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Feec5061576004a43adb58930fcf48a25%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/eec5061576004a43adb58930fcf48a25/images/large/5.jpg not downloaded yet
2026-03-26 22:51:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/8794398acf314af2a2ca94b36bc5d865/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/49a6c5d768cc4237b156086e41936c85/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Feec5061576004a43adb58930fcf48a25%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/eec5061576004a43adb58930fcf48a25/images/large/6.jpg not downloaded yet
2026-03-26 22:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Feec5061576004a43adb58930fcf48a25%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/eec5061576004a43adb58930fcf48a25/images/large/7.jpg not downloaded yet
2026-03-26 22:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Feec5061576004a43adb58930fcf48a25%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/eec5061576004a43adb58930fcf48a25/images/large/8.jpg not downloaded yet
2026-03-26 22:51:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b743b850>
2026-03-26 22:51:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e478d88-9255-5fdd-848c-32c5ddc31c17/6e478d88-9255-5fdd-848c-32c5ddc31c17_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F8794398acf314af2a2ca94b36bc5d865%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/8794398acf314af2a2ca94b36bc5d865/images/large/1.jpg saved to cache
2026-03-26 22:51:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6e478d88-9255-5fdd-848c-32c5ddc31c17
2026-03-26 22:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Feec5061576004a43adb58930fcf48a25%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/eec5061576004a43adb58930fcf48a25/images/large/9.jpg not downloaded yet
2026-03-26 22:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Feec5061576004a43adb58930fcf48a25%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/eec5061576004a43adb58930fcf48a25/images/large/10.jpg not downloaded yet
2026-03-26 22:51:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/eec5061576004a43adb58930fcf48a25/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:09 [ayvens.be] INFO: Found listing with ID: 1985422
2026-03-26 22:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985422%27 HTTP/1.1" 200 None
2026-03-26 22:51:09 [ayvens.be] INFO: Scrape type for 1985422: 1
2026-03-26 22:51:09 [ayvens.be] INFO: Extracting data for car ID: 1985422
2026-03-26 22:51:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 10aede45-dc31-5ff5-8678-55acc89a1832 with identifier: 1985422
2026-03-26 22:51:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10aede45-dc31-5ff5-8678-55acc89a1832 with scrape type 1
2026-03-26 22:51:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 10aede45-dc31-5ff5-8678-55acc89a1832
2026-03-26 22:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F83d3b03f9c394241a570afcc207d5084%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/83d3b03f9c394241a570afcc207d5084/images/large/1.jpg not downloaded yet
2026-03-26 22:51:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e1fe90>
2026-03-26 22:51:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e478d88-9255-5fdd-848c-32c5ddc31c17/6e478d88-9255-5fdd-848c-32c5ddc31c17_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F8794398acf314af2a2ca94b36bc5d865%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/8794398acf314af2a2ca94b36bc5d865/images/large/4.jpg saved to cache
2026-03-26 22:51:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6e478d88-9255-5fdd-848c-32c5ddc31c17
2026-03-26 22:51:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c5d890>
2026-03-26 22:51:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e478d88-9255-5fdd-848c-32c5ddc31c17/6e478d88-9255-5fdd-848c-32c5ddc31c17_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F8794398acf314af2a2ca94b36bc5d865%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/8794398acf314af2a2ca94b36bc5d865/images/large/6.jpg saved to cache
2026-03-26 22:51:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6e478d88-9255-5fdd-848c-32c5ddc31c17
2026-03-26 22:51:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b728fb10>
2026-03-26 22:51:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e478d88-9255-5fdd-848c-32c5ddc31c17/6e478d88-9255-5fdd-848c-32c5ddc31c17_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F8794398acf314af2a2ca94b36bc5d865%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/8794398acf314af2a2ca94b36bc5d865/images/large/5.jpg saved to cache
2026-03-26 22:51:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6e478d88-9255-5fdd-848c-32c5ddc31c17
2026-03-26 22:51:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7aeb110>
2026-03-26 22:51:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e478d88-9255-5fdd-848c-32c5ddc31c17/6e478d88-9255-5fdd-848c-32c5ddc31c17_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F8794398acf314af2a2ca94b36bc5d865%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/8794398acf314af2a2ca94b36bc5d865/images/large/2.jpg saved to cache
2026-03-26 22:51:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6e478d88-9255-5fdd-848c-32c5ddc31c17
2026-03-26 22:51:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e1df90>
2026-03-26 22:51:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e478d88-9255-5fdd-848c-32c5ddc31c17/6e478d88-9255-5fdd-848c-32c5ddc31c17_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F8794398acf314af2a2ca94b36bc5d865%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/8794398acf314af2a2ca94b36bc5d865/images/large/3.jpg saved to cache
2026-03-26 22:51:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6e478d88-9255-5fdd-848c-32c5ddc31c17
2026-03-26 22:51:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c5f6d0>
2026-03-26 22:51:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a2b7706-9cb9-50f9-bf45-1d72b1675d17/3a2b7706-9cb9-50f9-bf45-1d72b1675d17_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F49a6c5d768cc4237b156086e41936c85%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/49a6c5d768cc4237b156086e41936c85/images/large/10.jpg saved to cache
2026-03-26 22:51:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3a2b7706-9cb9-50f9-bf45-1d72b1675d17
2026-03-26 22:51:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3a2b7706-9cb9-50f9-bf45-1d72b1675d17, skipping ID generation
2026-03-26 22:51:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a2b7706-9cb9-50f9-bf45-1d72b1675d17 with scrape type 1
2026-03-26 22:51:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3a2b7706-9cb9-50f9-bf45-1d72b1675d17 sending to next pipeline
2026-03-26 22:51:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 3a2b7706-9cb9-50f9-bf45-1d72b1675d17, identifier: 1985419
2026-03-26 22:51:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 3a2b7706-9cb9-50f9-bf45-1d72b1675d17 with identifier: 1985419
2026-03-26 22:51:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 3a2b7706-9cb9-50f9-bf45-1d72b1675d17 with identifier: 1985419
2026-03-26 22:51:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 3a2b7706-9cb9-50f9-bf45-1d72b1675d17 with identifier: 1985419 to the API
2026-03-26 22:51:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:51:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:51:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bm/49a6c5d768cc4237b156086e41936c85/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '3a2b7706-9cb9-50f9-bf45-1d72b1675d17',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 61319,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a2b7706-9cb9-50f9-bf45-1d72b1675d17/3a2b7706-9cb9-50f9-bf45-1d72b1675d17_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 688892,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/49a6c5d768cc4237b156086e41936c85/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a2b7706-9cb9-50f9-bf45-1d72b1675d17/3a2b7706-9cb9-50f9-bf45-1d72b1675d17_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 718320,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/49a6c5d768cc4237b156086e41936c85/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a2b7706-9cb9-50f9-bf45-1d72b1675d17/3a2b7706-9cb9-50f9-bf45-1d72b1675d17_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 670394,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/49a6c5d768cc4237b156086e41936c85/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a2b7706-9cb9-50f9-bf45-1d72b1675d17/3a2b7706-9cb9-50f9-bf45-1d72b1675d17_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 764159,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/49a6c5d768cc4237b156086e41936c85/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a2b7706-9cb9-50f9-bf45-1d72b1675d17/3a2b7706-9cb9-50f9-bf45-1d72b1675d17_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 671572,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/49a6c5d768cc4237b156086e41936c85/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a2b7706-9cb9-50f9-bf45-1d72b1675d17/3a2b7706-9cb9-50f9-bf45-1d72b1675d17_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 831188,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/49a6c5d768cc4237b156086e41936c85/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a2b7706-9cb9-50f9-bf45-1d72b1675d17/3a2b7706-9cb9-50f9-bf45-1d72b1675d17_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 645519,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/49a6c5d768cc4237b156086e41936c85/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a2b7706-9cb9-50f9-bf45-1d72b1675d17/3a2b7706-9cb9-50f9-bf45-1d72b1675d17_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 815268,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/49a6c5d768cc4237b156086e41936c85/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a2b7706-9cb9-50f9-bf45-1d72b1675d17/3a2b7706-9cb9-50f9-bf45-1d72b1675d17_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 803364,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/49a6c5d768cc4237b156086e41936c85/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a2b7706-9cb9-50f9-bf45-1d72b1675d17/3a2b7706-9cb9-50f9-bf45-1d72b1675d17_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 767823,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/49a6c5d768cc4237b156086e41936c85/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 2008 1.5 BLUEHDI 81KW S-S ACTIVE PACK',
 'transmission': 'manual',
 'trim': '1.5 BLUEHDI 81KW S-S ACTIVE PACK',
 'vin': None,
 'year': 2022}
2026-03-26 22:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985419%27 HTTP/1.1" 200 None
2026-03-26 22:51:10 [ayvens.be] INFO: Saving data for 1985419: {'created_time': 1774565470.722329, 'last_price_update_time': 1774565470.722338, 'auction_closing_time': 1774958400.0}
2026-03-26 22:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985419') HTTP/1.1" 204 0
2026-03-26 22:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F83d3b03f9c394241a570afcc207d5084%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/83d3b03f9c394241a570afcc207d5084/images/large/2.jpg not downloaded yet
2026-03-26 22:51:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/8794398acf314af2a2ca94b36bc5d865/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/eec5061576004a43adb58930fcf48a25/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F83d3b03f9c394241a570afcc207d5084%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/83d3b03f9c394241a570afcc207d5084/images/large/3.jpg not downloaded yet
2026-03-26 22:51:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/8794398acf314af2a2ca94b36bc5d865/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/eec5061576004a43adb58930fcf48a25/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/8794398acf314af2a2ca94b36bc5d865/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7818c10>
2026-03-26 22:51:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0597b31-b618-5a7c-9897-7d9733dea90c/b0597b31-b618-5a7c-9897-7d9733dea90c_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Feec5061576004a43adb58930fcf48a25%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/eec5061576004a43adb58930fcf48a25/images/large/1.jpg saved to cache
2026-03-26 22:51:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b0597b31-b618-5a7c-9897-7d9733dea90c
2026-03-26 22:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F83d3b03f9c394241a570afcc207d5084%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/83d3b03f9c394241a570afcc207d5084/images/large/4.jpg not downloaded yet
2026-03-26 22:51:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/8794398acf314af2a2ca94b36bc5d865/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/eec5061576004a43adb58930fcf48a25/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F83d3b03f9c394241a570afcc207d5084%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/83d3b03f9c394241a570afcc207d5084/images/large/5.jpg not downloaded yet
2026-03-26 22:51:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6dee810>
2026-03-26 22:51:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e478d88-9255-5fdd-848c-32c5ddc31c17/6e478d88-9255-5fdd-848c-32c5ddc31c17_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F8794398acf314af2a2ca94b36bc5d865%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/8794398acf314af2a2ca94b36bc5d865/images/large/10.jpg saved to cache
2026-03-26 22:51:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6e478d88-9255-5fdd-848c-32c5ddc31c17
2026-03-26 22:51:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7477090>
2026-03-26 22:51:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0597b31-b618-5a7c-9897-7d9733dea90c/b0597b31-b618-5a7c-9897-7d9733dea90c_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Feec5061576004a43adb58930fcf48a25%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/eec5061576004a43adb58930fcf48a25/images/large/3.jpg saved to cache
2026-03-26 22:51:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b0597b31-b618-5a7c-9897-7d9733dea90c
2026-03-26 22:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F83d3b03f9c394241a570afcc207d5084%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/83d3b03f9c394241a570afcc207d5084/images/large/6.jpg not downloaded yet
2026-03-26 22:51:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7573290>
2026-03-26 22:51:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e478d88-9255-5fdd-848c-32c5ddc31c17/6e478d88-9255-5fdd-848c-32c5ddc31c17_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F8794398acf314af2a2ca94b36bc5d865%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/8794398acf314af2a2ca94b36bc5d865/images/large/9.jpg saved to cache
2026-03-26 22:51:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6e478d88-9255-5fdd-848c-32c5ddc31c17
2026-03-26 22:51:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7aa25d0>
2026-03-26 22:51:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0597b31-b618-5a7c-9897-7d9733dea90c/b0597b31-b618-5a7c-9897-7d9733dea90c_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Feec5061576004a43adb58930fcf48a25%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/eec5061576004a43adb58930fcf48a25/images/large/2.jpg saved to cache
2026-03-26 22:51:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b0597b31-b618-5a7c-9897-7d9733dea90c
2026-03-26 22:51:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74070d0>
2026-03-26 22:51:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e478d88-9255-5fdd-848c-32c5ddc31c17/6e478d88-9255-5fdd-848c-32c5ddc31c17_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F8794398acf314af2a2ca94b36bc5d865%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/8794398acf314af2a2ca94b36bc5d865/images/large/8.jpg saved to cache
2026-03-26 22:51:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6e478d88-9255-5fdd-848c-32c5ddc31c17
2026-03-26 22:51:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/eec5061576004a43adb58930fcf48a25/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F83d3b03f9c394241a570afcc207d5084%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/83d3b03f9c394241a570afcc207d5084/images/large/7.jpg not downloaded yet
2026-03-26 22:51:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b777b490>
2026-03-26 22:51:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e478d88-9255-5fdd-848c-32c5ddc31c17/6e478d88-9255-5fdd-848c-32c5ddc31c17_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F8794398acf314af2a2ca94b36bc5d865%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/8794398acf314af2a2ca94b36bc5d865/images/large/7.jpg saved to cache
2026-03-26 22:51:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6e478d88-9255-5fdd-848c-32c5ddc31c17
2026-03-26 22:51:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6e478d88-9255-5fdd-848c-32c5ddc31c17, skipping ID generation
2026-03-26 22:51:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e478d88-9255-5fdd-848c-32c5ddc31c17 with scrape type 1
2026-03-26 22:51:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6e478d88-9255-5fdd-848c-32c5ddc31c17 sending to next pipeline
2026-03-26 22:51:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 6e478d88-9255-5fdd-848c-32c5ddc31c17, identifier: 1985420
2026-03-26 22:51:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79f9490>
2026-03-26 22:51:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0597b31-b618-5a7c-9897-7d9733dea90c/b0597b31-b618-5a7c-9897-7d9733dea90c_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Feec5061576004a43adb58930fcf48a25%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/eec5061576004a43adb58930fcf48a25/images/large/4.jpg saved to cache
2026-03-26 22:51:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b0597b31-b618-5a7c-9897-7d9733dea90c
2026-03-26 22:51:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/83d3b03f9c394241a570afcc207d5084/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/83d3b03f9c394241a570afcc207d5084/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F83d3b03f9c394241a570afcc207d5084%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/83d3b03f9c394241a570afcc207d5084/images/large/8.jpg not downloaded yet
2026-03-26 22:51:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 6e478d88-9255-5fdd-848c-32c5ddc31c17 with identifier: 1985420
2026-03-26 22:51:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 6e478d88-9255-5fdd-848c-32c5ddc31c17 with identifier: 1985420
2026-03-26 22:51:11 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 6e478d88-9255-5fdd-848c-32c5ddc31c17 with identifier: 1985420 to the API
2026-03-26 22:51:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:51:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:51:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bt/8794398acf314af2a2ca94b36bc5d865/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '6e478d88-9255-5fdd-848c-32c5ddc31c17',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLA - Klasse',
 'odometer': 95069,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e478d88-9255-5fdd-848c-32c5ddc31c17/6e478d88-9255-5fdd-848c-32c5ddc31c17_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 644211,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/8794398acf314af2a2ca94b36bc5d865/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e478d88-9255-5fdd-848c-32c5ddc31c17/6e478d88-9255-5fdd-848c-32c5ddc31c17_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 648493,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/8794398acf314af2a2ca94b36bc5d865/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e478d88-9255-5fdd-848c-32c5ddc31c17/6e478d88-9255-5fdd-848c-32c5ddc31c17_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 658489,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/8794398acf314af2a2ca94b36bc5d865/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e478d88-9255-5fdd-848c-32c5ddc31c17/6e478d88-9255-5fdd-848c-32c5ddc31c17_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 648184,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/8794398acf314af2a2ca94b36bc5d865/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e478d88-9255-5fdd-848c-32c5ddc31c17/6e478d88-9255-5fdd-848c-32c5ddc31c17_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 633562,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/8794398acf314af2a2ca94b36bc5d865/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e478d88-9255-5fdd-848c-32c5ddc31c17/6e478d88-9255-5fdd-848c-32c5ddc31c17_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 597298,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/8794398acf314af2a2ca94b36bc5d865/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e478d88-9255-5fdd-848c-32c5ddc31c17/6e478d88-9255-5fdd-848c-32c5ddc31c17_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 718132,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/8794398acf314af2a2ca94b36bc5d865/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e478d88-9255-5fdd-848c-32c5ddc31c17/6e478d88-9255-5fdd-848c-32c5ddc31c17_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 664493,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/8794398acf314af2a2ca94b36bc5d865/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e478d88-9255-5fdd-848c-32c5ddc31c17/6e478d88-9255-5fdd-848c-32c5ddc31c17_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 632225,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/8794398acf314af2a2ca94b36bc5d865/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e478d88-9255-5fdd-848c-32c5ddc31c17/6e478d88-9255-5fdd-848c-32c5ddc31c17_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 638025,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/8794398acf314af2a2ca94b36bc5d865/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLA - Klasse 1.3 CLA 250 E BUSINESS SOLUTION DCT',
 'transmission': 'automatic',
 'trim': '1.3 CLA 250 E BUSINESS SOLUTION DCT',
 'vin': None,
 'year': 2022}
2026-03-26 22:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985420%27 HTTP/1.1" 200 None
2026-03-26 22:51:12 [ayvens.be] INFO: Saving data for 1985420: {'created_time': 1774565472.05927, 'last_price_update_time': 1774565472.059285, 'auction_closing_time': 1774958400.0}
2026-03-26 22:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985420') HTTP/1.1" 204 0
2026-03-26 22:51:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/eec5061576004a43adb58930fcf48a25/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F83d3b03f9c394241a570afcc207d5084%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/83d3b03f9c394241a570afcc207d5084/images/large/9.jpg not downloaded yet
2026-03-26 22:51:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7408dd0>
2026-03-26 22:51:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0597b31-b618-5a7c-9897-7d9733dea90c/b0597b31-b618-5a7c-9897-7d9733dea90c_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Feec5061576004a43adb58930fcf48a25%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/eec5061576004a43adb58930fcf48a25/images/large/5.jpg saved to cache
2026-03-26 22:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b0597b31-b618-5a7c-9897-7d9733dea90c
2026-03-26 22:51:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/eec5061576004a43adb58930fcf48a25/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F83d3b03f9c394241a570afcc207d5084%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/83d3b03f9c394241a570afcc207d5084/images/large/10.jpg not downloaded yet
2026-03-26 22:51:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e4ccd0>
2026-03-26 22:51:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10aede45-dc31-5ff5-8678-55acc89a1832/10aede45-dc31-5ff5-8678-55acc89a1832_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F83d3b03f9c394241a570afcc207d5084%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/83d3b03f9c394241a570afcc207d5084/images/large/1.jpg saved to cache
2026-03-26 22:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 10aede45-dc31-5ff5-8678-55acc89a1832
2026-03-26 22:51:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b777b210>
2026-03-26 22:51:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10aede45-dc31-5ff5-8678-55acc89a1832/10aede45-dc31-5ff5-8678-55acc89a1832_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F83d3b03f9c394241a570afcc207d5084%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/83d3b03f9c394241a570afcc207d5084/images/large/2.jpg saved to cache
2026-03-26 22:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 10aede45-dc31-5ff5-8678-55acc89a1832
2026-03-26 22:51:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/eec5061576004a43adb58930fcf48a25/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/eec5061576004a43adb58930fcf48a25/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/83d3b03f9c394241a570afcc207d5084/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:12 [ayvens.be] INFO: Found listing with ID: 1985423
2026-03-26 22:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985423%27 HTTP/1.1" 200 None
2026-03-26 22:51:12 [ayvens.be] INFO: Scrape type for 1985423: 1
2026-03-26 22:51:12 [ayvens.be] INFO: Extracting data for car ID: 1985423
2026-03-26 22:51:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 85823419-bea0-53d2-b46c-8cd10925d2b0 with identifier: 1985423
2026-03-26 22:51:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85823419-bea0-53d2-b46c-8cd10925d2b0 with scrape type 1
2026-03-26 22:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 85823419-bea0-53d2-b46c-8cd10925d2b0
2026-03-26 22:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F21cdb5c07e094630b5fce1a5fc680c55%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/21cdb5c07e094630b5fce1a5fc680c55/images/large/1.jpg not downloaded yet
2026-03-26 22:51:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/eec5061576004a43adb58930fcf48a25/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/83d3b03f9c394241a570afcc207d5084/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7876dd0>
2026-03-26 22:51:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0597b31-b618-5a7c-9897-7d9733dea90c/b0597b31-b618-5a7c-9897-7d9733dea90c_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Feec5061576004a43adb58930fcf48a25%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/eec5061576004a43adb58930fcf48a25/images/large/6.jpg saved to cache
2026-03-26 22:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b0597b31-b618-5a7c-9897-7d9733dea90c
2026-03-26 22:51:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77c9910>
2026-03-26 22:51:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0597b31-b618-5a7c-9897-7d9733dea90c/b0597b31-b618-5a7c-9897-7d9733dea90c_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Feec5061576004a43adb58930fcf48a25%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/eec5061576004a43adb58930fcf48a25/images/large/10.jpg saved to cache
2026-03-26 22:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b0597b31-b618-5a7c-9897-7d9733dea90c
2026-03-26 22:51:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/83d3b03f9c394241a570afcc207d5084/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F21cdb5c07e094630b5fce1a5fc680c55%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/21cdb5c07e094630b5fce1a5fc680c55/images/large/2.jpg not downloaded yet
2026-03-26 22:51:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/83d3b03f9c394241a570afcc207d5084/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F21cdb5c07e094630b5fce1a5fc680c55%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/21cdb5c07e094630b5fce1a5fc680c55/images/large/3.jpg not downloaded yet
2026-03-26 22:51:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7876dd0>
2026-03-26 22:51:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0597b31-b618-5a7c-9897-7d9733dea90c/b0597b31-b618-5a7c-9897-7d9733dea90c_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Feec5061576004a43adb58930fcf48a25%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/eec5061576004a43adb58930fcf48a25/images/large/9.jpg saved to cache
2026-03-26 22:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b0597b31-b618-5a7c-9897-7d9733dea90c
2026-03-26 22:51:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e37b10>
2026-03-26 22:51:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0597b31-b618-5a7c-9897-7d9733dea90c/b0597b31-b618-5a7c-9897-7d9733dea90c_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Feec5061576004a43adb58930fcf48a25%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/eec5061576004a43adb58930fcf48a25/images/large/7.jpg saved to cache
2026-03-26 22:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b0597b31-b618-5a7c-9897-7d9733dea90c
2026-03-26 22:51:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76cc610>
2026-03-26 22:51:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10aede45-dc31-5ff5-8678-55acc89a1832/10aede45-dc31-5ff5-8678-55acc89a1832_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F83d3b03f9c394241a570afcc207d5084%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/83d3b03f9c394241a570afcc207d5084/images/large/3.jpg saved to cache
2026-03-26 22:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 10aede45-dc31-5ff5-8678-55acc89a1832
2026-03-26 22:51:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b787df90>
2026-03-26 22:51:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0597b31-b618-5a7c-9897-7d9733dea90c/b0597b31-b618-5a7c-9897-7d9733dea90c_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Feec5061576004a43adb58930fcf48a25%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/eec5061576004a43adb58930fcf48a25/images/large/8.jpg saved to cache
2026-03-26 22:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b0597b31-b618-5a7c-9897-7d9733dea90c
2026-03-26 22:51:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b0597b31-b618-5a7c-9897-7d9733dea90c, skipping ID generation
2026-03-26 22:51:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0597b31-b618-5a7c-9897-7d9733dea90c with scrape type 1
2026-03-26 22:51:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b0597b31-b618-5a7c-9897-7d9733dea90c sending to next pipeline
2026-03-26 22:51:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b0597b31-b618-5a7c-9897-7d9733dea90c, identifier: 1985421
2026-03-26 22:51:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5ca5110>
2026-03-26 22:51:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10aede45-dc31-5ff5-8678-55acc89a1832/10aede45-dc31-5ff5-8678-55acc89a1832_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F83d3b03f9c394241a570afcc207d5084%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/83d3b03f9c394241a570afcc207d5084/images/large/4.jpg saved to cache
2026-03-26 22:51:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 10aede45-dc31-5ff5-8678-55acc89a1832
2026-03-26 22:51:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b0597b31-b618-5a7c-9897-7d9733dea90c with identifier: 1985421
2026-03-26 22:51:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b0597b31-b618-5a7c-9897-7d9733dea90c with identifier: 1985421
2026-03-26 22:51:13 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b0597b31-b618-5a7c-9897-7d9733dea90c with identifier: 1985421 to the API
2026-03-26 22:51:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:51:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:51:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bm/eec5061576004a43adb58930fcf48a25/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'b0597b31-b618-5a7c-9897-7d9733dea90c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3 Sportback',
 'odometer': 102948,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0597b31-b618-5a7c-9897-7d9733dea90c/b0597b31-b618-5a7c-9897-7d9733dea90c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 667662,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/eec5061576004a43adb58930fcf48a25/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0597b31-b618-5a7c-9897-7d9733dea90c/b0597b31-b618-5a7c-9897-7d9733dea90c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 625596,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/eec5061576004a43adb58930fcf48a25/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0597b31-b618-5a7c-9897-7d9733dea90c/b0597b31-b618-5a7c-9897-7d9733dea90c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 596802,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/eec5061576004a43adb58930fcf48a25/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0597b31-b618-5a7c-9897-7d9733dea90c/b0597b31-b618-5a7c-9897-7d9733dea90c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 742934,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/eec5061576004a43adb58930fcf48a25/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0597b31-b618-5a7c-9897-7d9733dea90c/b0597b31-b618-5a7c-9897-7d9733dea90c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 598419,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/eec5061576004a43adb58930fcf48a25/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0597b31-b618-5a7c-9897-7d9733dea90c/b0597b31-b618-5a7c-9897-7d9733dea90c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 562021,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/eec5061576004a43adb58930fcf48a25/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0597b31-b618-5a7c-9897-7d9733dea90c/b0597b31-b618-5a7c-9897-7d9733dea90c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 625938,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/eec5061576004a43adb58930fcf48a25/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0597b31-b618-5a7c-9897-7d9733dea90c/b0597b31-b618-5a7c-9897-7d9733dea90c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 719215,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/eec5061576004a43adb58930fcf48a25/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0597b31-b618-5a7c-9897-7d9733dea90c/b0597b31-b618-5a7c-9897-7d9733dea90c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 617788,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/eec5061576004a43adb58930fcf48a25/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0597b31-b618-5a7c-9897-7d9733dea90c/b0597b31-b618-5a7c-9897-7d9733dea90c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 517394,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/eec5061576004a43adb58930fcf48a25/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 Sportback 1.4 45 TFSI E S TRONIC',
 'transmission': 'automatic',
 'trim': '1.4 45 TFSI E S TRONIC',
 'vin': None,
 'year': 2022}
2026-03-26 22:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985421%27 HTTP/1.1" 200 None
2026-03-26 22:51:13 [ayvens.be] INFO: Saving data for 1985421: {'created_time': 1774565473.324881, 'last_price_update_time': 1774565473.32489, 'auction_closing_time': 1774958400.0}
2026-03-26 22:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985421') HTTP/1.1" 204 0
2026-03-26 22:51:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/83d3b03f9c394241a570afcc207d5084/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/83d3b03f9c394241a570afcc207d5084/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F21cdb5c07e094630b5fce1a5fc680c55%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/21cdb5c07e094630b5fce1a5fc680c55/images/large/4.jpg not downloaded yet
2026-03-26 22:51:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/83d3b03f9c394241a570afcc207d5084/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7ca9c10>
2026-03-26 22:51:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10aede45-dc31-5ff5-8678-55acc89a1832/10aede45-dc31-5ff5-8678-55acc89a1832_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F83d3b03f9c394241a570afcc207d5084%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/83d3b03f9c394241a570afcc207d5084/images/large/5.jpg saved to cache
2026-03-26 22:51:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 10aede45-dc31-5ff5-8678-55acc89a1832
2026-03-26 22:51:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7279010>
2026-03-26 22:51:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10aede45-dc31-5ff5-8678-55acc89a1832/10aede45-dc31-5ff5-8678-55acc89a1832_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F83d3b03f9c394241a570afcc207d5084%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/83d3b03f9c394241a570afcc207d5084/images/large/6.jpg saved to cache
2026-03-26 22:51:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 10aede45-dc31-5ff5-8678-55acc89a1832
2026-03-26 22:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F21cdb5c07e094630b5fce1a5fc680c55%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/21cdb5c07e094630b5fce1a5fc680c55/images/large/5.jpg not downloaded yet
2026-03-26 22:51:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/21cdb5c07e094630b5fce1a5fc680c55/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F21cdb5c07e094630b5fce1a5fc680c55%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/21cdb5c07e094630b5fce1a5fc680c55/images/large/6.jpg not downloaded yet
2026-03-26 22:51:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b72ef650>
2026-03-26 22:51:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10aede45-dc31-5ff5-8678-55acc89a1832/10aede45-dc31-5ff5-8678-55acc89a1832_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F83d3b03f9c394241a570afcc207d5084%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/83d3b03f9c394241a570afcc207d5084/images/large/8.jpg saved to cache
2026-03-26 22:51:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 10aede45-dc31-5ff5-8678-55acc89a1832
2026-03-26 22:51:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7279b50>
2026-03-26 22:51:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10aede45-dc31-5ff5-8678-55acc89a1832/10aede45-dc31-5ff5-8678-55acc89a1832_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F83d3b03f9c394241a570afcc207d5084%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/83d3b03f9c394241a570afcc207d5084/images/large/7.jpg saved to cache
2026-03-26 22:51:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 10aede45-dc31-5ff5-8678-55acc89a1832
2026-03-26 22:51:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e35010>
2026-03-26 22:51:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10aede45-dc31-5ff5-8678-55acc89a1832/10aede45-dc31-5ff5-8678-55acc89a1832_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F83d3b03f9c394241a570afcc207d5084%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/83d3b03f9c394241a570afcc207d5084/images/large/9.jpg saved to cache
2026-03-26 22:51:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 10aede45-dc31-5ff5-8678-55acc89a1832
2026-03-26 22:51:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/83d3b03f9c394241a570afcc207d5084/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/21cdb5c07e094630b5fce1a5fc680c55/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F21cdb5c07e094630b5fce1a5fc680c55%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/21cdb5c07e094630b5fce1a5fc680c55/images/large/7.jpg not downloaded yet
2026-03-26 22:51:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cb3e50>
2026-03-26 22:51:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85823419-bea0-53d2-b46c-8cd10925d2b0/85823419-bea0-53d2-b46c-8cd10925d2b0_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F21cdb5c07e094630b5fce1a5fc680c55%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/21cdb5c07e094630b5fce1a5fc680c55/images/large/1.jpg saved to cache
2026-03-26 22:51:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 85823419-bea0-53d2-b46c-8cd10925d2b0
2026-03-26 22:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F21cdb5c07e094630b5fce1a5fc680c55%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/21cdb5c07e094630b5fce1a5fc680c55/images/large/8.jpg not downloaded yet
2026-03-26 22:51:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/21cdb5c07e094630b5fce1a5fc680c55/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/21cdb5c07e094630b5fce1a5fc680c55/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F21cdb5c07e094630b5fce1a5fc680c55%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/21cdb5c07e094630b5fce1a5fc680c55/images/large/9.jpg not downloaded yet
2026-03-26 22:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F21cdb5c07e094630b5fce1a5fc680c55%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/21cdb5c07e094630b5fce1a5fc680c55/images/large/10.jpg not downloaded yet
2026-03-26 22:51:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7586510>
2026-03-26 22:51:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10aede45-dc31-5ff5-8678-55acc89a1832/10aede45-dc31-5ff5-8678-55acc89a1832_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F83d3b03f9c394241a570afcc207d5084%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/83d3b03f9c394241a570afcc207d5084/images/large/10.jpg saved to cache
2026-03-26 22:51:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 10aede45-dc31-5ff5-8678-55acc89a1832
2026-03-26 22:51:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 10aede45-dc31-5ff5-8678-55acc89a1832, skipping ID generation
2026-03-26 22:51:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10aede45-dc31-5ff5-8678-55acc89a1832 with scrape type 1
2026-03-26 22:51:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 10aede45-dc31-5ff5-8678-55acc89a1832 sending to next pipeline
2026-03-26 22:51:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 10aede45-dc31-5ff5-8678-55acc89a1832, identifier: 1985422
2026-03-26 22:51:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b99850>
2026-03-26 22:51:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85823419-bea0-53d2-b46c-8cd10925d2b0/85823419-bea0-53d2-b46c-8cd10925d2b0_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F21cdb5c07e094630b5fce1a5fc680c55%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/21cdb5c07e094630b5fce1a5fc680c55/images/large/2.jpg saved to cache
2026-03-26 22:51:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 85823419-bea0-53d2-b46c-8cd10925d2b0
2026-03-26 22:51:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/21cdb5c07e094630b5fce1a5fc680c55/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:14 [ayvens.be] INFO: Found listing with ID: 1985424
2026-03-26 22:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985424%27 HTTP/1.1" 200 None
2026-03-26 22:51:14 [ayvens.be] INFO: Scrape type for 1985424: 1
2026-03-26 22:51:14 [ayvens.be] INFO: Extracting data for car ID: 1985424
2026-03-26 22:51:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b5d7ca9d-9d34-50ce-9519-5cb713e3392e with identifier: 1985424
2026-03-26 22:51:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5d7ca9d-9d34-50ce-9519-5cb713e3392e with scrape type 1
2026-03-26 22:51:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b5d7ca9d-9d34-50ce-9519-5cb713e3392e
2026-03-26 22:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F1dc05ff7dfbd467c8bee0ecfa3fe7cc1%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/1dc05ff7dfbd467c8bee0ecfa3fe7cc1/images/large/1.jpg not downloaded yet
2026-03-26 22:51:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 10aede45-dc31-5ff5-8678-55acc89a1832 with identifier: 1985422
2026-03-26 22:51:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 10aede45-dc31-5ff5-8678-55acc89a1832 with identifier: 1985422
2026-03-26 22:51:14 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 10aede45-dc31-5ff5-8678-55acc89a1832 with identifier: 1985422 to the API
2026-03-26 22:51:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:51:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:51:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yx/83d3b03f9c394241a570afcc207d5084/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '10aede45-dc31-5ff5-8678-55acc89a1832',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLASS GLB DIESEL (X247)',
 'odometer': 106199,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10aede45-dc31-5ff5-8678-55acc89a1832/10aede45-dc31-5ff5-8678-55acc89a1832_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 208982,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/83d3b03f9c394241a570afcc207d5084/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10aede45-dc31-5ff5-8678-55acc89a1832/10aede45-dc31-5ff5-8678-55acc89a1832_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 211331,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/83d3b03f9c394241a570afcc207d5084/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10aede45-dc31-5ff5-8678-55acc89a1832/10aede45-dc31-5ff5-8678-55acc89a1832_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 239567,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/83d3b03f9c394241a570afcc207d5084/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10aede45-dc31-5ff5-8678-55acc89a1832/10aede45-dc31-5ff5-8678-55acc89a1832_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 232997,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/83d3b03f9c394241a570afcc207d5084/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10aede45-dc31-5ff5-8678-55acc89a1832/10aede45-dc31-5ff5-8678-55acc89a1832_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 297488,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/83d3b03f9c394241a570afcc207d5084/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10aede45-dc31-5ff5-8678-55acc89a1832/10aede45-dc31-5ff5-8678-55acc89a1832_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 263207,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/83d3b03f9c394241a570afcc207d5084/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10aede45-dc31-5ff5-8678-55acc89a1832/10aede45-dc31-5ff5-8678-55acc89a1832_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 265623,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/83d3b03f9c394241a570afcc207d5084/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10aede45-dc31-5ff5-8678-55acc89a1832/10aede45-dc31-5ff5-8678-55acc89a1832_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 315055,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/83d3b03f9c394241a570afcc207d5084/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10aede45-dc31-5ff5-8678-55acc89a1832/10aede45-dc31-5ff5-8678-55acc89a1832_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 363025,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/83d3b03f9c394241a570afcc207d5084/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10aede45-dc31-5ff5-8678-55acc89a1832/10aede45-dc31-5ff5-8678-55acc89a1832_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 430966,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/83d3b03f9c394241a570afcc207d5084/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLASS GLB DIESEL (X247) GLB 200 d Business Solution',
 'transmission': 'automatic',
 'trim': 'GLB 200 d Business Solution',
 'vin': None,
 'year': 2021}
2026-03-26 22:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985422%27 HTTP/1.1" 200 None
2026-03-26 22:51:14 [ayvens.be] INFO: Saving data for 1985422: {'created_time': 1774565474.526966, 'last_price_update_time': 1774565474.526974, 'auction_closing_time': 1774958400.0}
2026-03-26 22:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985422') HTTP/1.1" 204 0
2026-03-26 22:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F1dc05ff7dfbd467c8bee0ecfa3fe7cc1%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/1dc05ff7dfbd467c8bee0ecfa3fe7cc1/images/large/2.jpg not downloaded yet
2026-03-26 22:51:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7ca9250>
2026-03-26 22:51:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85823419-bea0-53d2-b46c-8cd10925d2b0/85823419-bea0-53d2-b46c-8cd10925d2b0_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F21cdb5c07e094630b5fce1a5fc680c55%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/21cdb5c07e094630b5fce1a5fc680c55/images/large/4.jpg saved to cache
2026-03-26 22:51:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 85823419-bea0-53d2-b46c-8cd10925d2b0
2026-03-26 22:51:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd3b9950>
2026-03-26 22:51:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85823419-bea0-53d2-b46c-8cd10925d2b0/85823419-bea0-53d2-b46c-8cd10925d2b0_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F21cdb5c07e094630b5fce1a5fc680c55%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/21cdb5c07e094630b5fce1a5fc680c55/images/large/3.jpg saved to cache
2026-03-26 22:51:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 85823419-bea0-53d2-b46c-8cd10925d2b0
2026-03-26 22:51:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e4fc90>
2026-03-26 22:51:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85823419-bea0-53d2-b46c-8cd10925d2b0/85823419-bea0-53d2-b46c-8cd10925d2b0_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F21cdb5c07e094630b5fce1a5fc680c55%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/21cdb5c07e094630b5fce1a5fc680c55/images/large/5.jpg saved to cache
2026-03-26 22:51:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 85823419-bea0-53d2-b46c-8cd10925d2b0
2026-03-26 22:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F1dc05ff7dfbd467c8bee0ecfa3fe7cc1%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/1dc05ff7dfbd467c8bee0ecfa3fe7cc1/images/large/3.jpg not downloaded yet
2026-03-26 22:51:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/21cdb5c07e094630b5fce1a5fc680c55/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/21cdb5c07e094630b5fce1a5fc680c55/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/21cdb5c07e094630b5fce1a5fc680c55/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F1dc05ff7dfbd467c8bee0ecfa3fe7cc1%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/1dc05ff7dfbd467c8bee0ecfa3fe7cc1/images/large/4.jpg not downloaded yet
2026-03-26 22:51:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/21cdb5c07e094630b5fce1a5fc680c55/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F1dc05ff7dfbd467c8bee0ecfa3fe7cc1%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/1dc05ff7dfbd467c8bee0ecfa3fe7cc1/images/large/5.jpg not downloaded yet
2026-03-26 22:51:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/21cdb5c07e094630b5fce1a5fc680c55/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F1dc05ff7dfbd467c8bee0ecfa3fe7cc1%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/1dc05ff7dfbd467c8bee0ecfa3fe7cc1/images/large/6.jpg not downloaded yet
2026-03-26 22:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F1dc05ff7dfbd467c8bee0ecfa3fe7cc1%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/1dc05ff7dfbd467c8bee0ecfa3fe7cc1/images/large/7.jpg not downloaded yet
2026-03-26 22:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F1dc05ff7dfbd467c8bee0ecfa3fe7cc1%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/1dc05ff7dfbd467c8bee0ecfa3fe7cc1/images/large/8.jpg not downloaded yet
2026-03-26 22:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F1dc05ff7dfbd467c8bee0ecfa3fe7cc1%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/1dc05ff7dfbd467c8bee0ecfa3fe7cc1/images/large/9.jpg not downloaded yet
2026-03-26 22:51:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7a55cd0>
2026-03-26 22:51:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85823419-bea0-53d2-b46c-8cd10925d2b0/85823419-bea0-53d2-b46c-8cd10925d2b0_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F21cdb5c07e094630b5fce1a5fc680c55%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/21cdb5c07e094630b5fce1a5fc680c55/images/large/7.jpg saved to cache
2026-03-26 22:51:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 85823419-bea0-53d2-b46c-8cd10925d2b0
2026-03-26 22:51:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7474890>
2026-03-26 22:51:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85823419-bea0-53d2-b46c-8cd10925d2b0/85823419-bea0-53d2-b46c-8cd10925d2b0_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F21cdb5c07e094630b5fce1a5fc680c55%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/21cdb5c07e094630b5fce1a5fc680c55/images/large/8.jpg saved to cache
2026-03-26 22:51:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 85823419-bea0-53d2-b46c-8cd10925d2b0
2026-03-26 22:51:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b746cf50>
2026-03-26 22:51:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85823419-bea0-53d2-b46c-8cd10925d2b0/85823419-bea0-53d2-b46c-8cd10925d2b0_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F21cdb5c07e094630b5fce1a5fc680c55%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/21cdb5c07e094630b5fce1a5fc680c55/images/large/6.jpg saved to cache
2026-03-26 22:51:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 85823419-bea0-53d2-b46c-8cd10925d2b0
2026-03-26 22:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F1dc05ff7dfbd467c8bee0ecfa3fe7cc1%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/1dc05ff7dfbd467c8bee0ecfa3fe7cc1/images/large/10.jpg not downloaded yet
2026-03-26 22:51:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b746ca10>
2026-03-26 22:51:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85823419-bea0-53d2-b46c-8cd10925d2b0/85823419-bea0-53d2-b46c-8cd10925d2b0_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F21cdb5c07e094630b5fce1a5fc680c55%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/21cdb5c07e094630b5fce1a5fc680c55/images/large/9.jpg saved to cache
2026-03-26 22:51:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 85823419-bea0-53d2-b46c-8cd10925d2b0
2026-03-26 22:51:15 [ayvens.be] INFO: Found listing with ID: 1985425
2026-03-26 22:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985425%27 HTTP/1.1" 200 None
2026-03-26 22:51:15 [ayvens.be] INFO: Scrape type for 1985425: 1
2026-03-26 22:51:15 [ayvens.be] INFO: Extracting data for car ID: 1985425
2026-03-26 22:51:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d7cf7abd-ce36-549d-ad5b-cb0e608050f4 with identifier: 1985425
2026-03-26 22:51:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7cf7abd-ce36-549d-ad5b-cb0e608050f4 with scrape type 1
2026-03-26 22:51:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d7cf7abd-ce36-549d-ad5b-cb0e608050f4
2026-03-26 22:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fe08452ab1f7242998a79ecc439b8caa9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/e08452ab1f7242998a79ecc439b8caa9/images/large/1.jpg not downloaded yet
2026-03-26 22:51:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/1dc05ff7dfbd467c8bee0ecfa3fe7cc1/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/1dc05ff7dfbd467c8bee0ecfa3fe7cc1/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/1dc05ff7dfbd467c8bee0ecfa3fe7cc1/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fe08452ab1f7242998a79ecc439b8caa9%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/e08452ab1f7242998a79ecc439b8caa9/images/large/2.jpg not downloaded yet
2026-03-26 22:51:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76cf790>
2026-03-26 22:51:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85823419-bea0-53d2-b46c-8cd10925d2b0/85823419-bea0-53d2-b46c-8cd10925d2b0_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F21cdb5c07e094630b5fce1a5fc680c55%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/21cdb5c07e094630b5fce1a5fc680c55/images/large/10.jpg saved to cache
2026-03-26 22:51:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 85823419-bea0-53d2-b46c-8cd10925d2b0
2026-03-26 22:51:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 85823419-bea0-53d2-b46c-8cd10925d2b0, skipping ID generation
2026-03-26 22:51:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85823419-bea0-53d2-b46c-8cd10925d2b0 with scrape type 1
2026-03-26 22:51:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 85823419-bea0-53d2-b46c-8cd10925d2b0 sending to next pipeline
2026-03-26 22:51:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 85823419-bea0-53d2-b46c-8cd10925d2b0, identifier: 1985423
2026-03-26 22:51:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 85823419-bea0-53d2-b46c-8cd10925d2b0 with identifier: 1985423
2026-03-26 22:51:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 85823419-bea0-53d2-b46c-8cd10925d2b0 with identifier: 1985423
2026-03-26 22:51:15 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 85823419-bea0-53d2-b46c-8cd10925d2b0 with identifier: 1985423 to the API
2026-03-26 22:51:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:51:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:51:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2br/21cdb5c07e094630b5fce1a5fc680c55/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '85823419-bea0-53d2-b46c-8cd10925d2b0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 100619,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85823419-bea0-53d2-b46c-8cd10925d2b0/85823419-bea0-53d2-b46c-8cd10925d2b0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 222205,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/21cdb5c07e094630b5fce1a5fc680c55/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85823419-bea0-53d2-b46c-8cd10925d2b0/85823419-bea0-53d2-b46c-8cd10925d2b0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 221826,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/21cdb5c07e094630b5fce1a5fc680c55/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85823419-bea0-53d2-b46c-8cd10925d2b0/85823419-bea0-53d2-b46c-8cd10925d2b0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 245507,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/21cdb5c07e094630b5fce1a5fc680c55/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85823419-bea0-53d2-b46c-8cd10925d2b0/85823419-bea0-53d2-b46c-8cd10925d2b0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 247243,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/21cdb5c07e094630b5fce1a5fc680c55/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85823419-bea0-53d2-b46c-8cd10925d2b0/85823419-bea0-53d2-b46c-8cd10925d2b0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 287949,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/21cdb5c07e094630b5fce1a5fc680c55/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85823419-bea0-53d2-b46c-8cd10925d2b0/85823419-bea0-53d2-b46c-8cd10925d2b0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 264929,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/21cdb5c07e094630b5fce1a5fc680c55/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85823419-bea0-53d2-b46c-8cd10925d2b0/85823419-bea0-53d2-b46c-8cd10925d2b0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 265485,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/21cdb5c07e094630b5fce1a5fc680c55/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85823419-bea0-53d2-b46c-8cd10925d2b0/85823419-bea0-53d2-b46c-8cd10925d2b0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 276184,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/21cdb5c07e094630b5fce1a5fc680c55/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85823419-bea0-53d2-b46c-8cd10925d2b0/85823419-bea0-53d2-b46c-8cd10925d2b0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 388425,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/21cdb5c07e094630b5fce1a5fc680c55/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85823419-bea0-53d2-b46c-8cd10925d2b0/85823419-bea0-53d2-b46c-8cd10925d2b0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 358238,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/21cdb5c07e094630b5fce1a5fc680c55/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 1.5 SDRIVE16D',
 'transmission': 'manual',
 'trim': '1.5 SDRIVE16D',
 'vin': None,
 'year': 2022}
2026-03-26 22:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985423%27 HTTP/1.1" 200 None
2026-03-26 22:51:15 [ayvens.be] INFO: Saving data for 1985423: {'created_time': 1774565475.952964, 'last_price_update_time': 1774565475.952974, 'auction_closing_time': 1774958400.0}
2026-03-26 22:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985423') HTTP/1.1" 204 0
2026-03-26 22:51:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/1dc05ff7dfbd467c8bee0ecfa3fe7cc1/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fe08452ab1f7242998a79ecc439b8caa9%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/e08452ab1f7242998a79ecc439b8caa9/images/large/3.jpg not downloaded yet
2026-03-26 22:51:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/1dc05ff7dfbd467c8bee0ecfa3fe7cc1/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/1dc05ff7dfbd467c8bee0ecfa3fe7cc1/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/1dc05ff7dfbd467c8bee0ecfa3fe7cc1/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77c9710>
2026-03-26 22:51:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5d7ca9d-9d34-50ce-9519-5cb713e3392e/b5d7ca9d-9d34-50ce-9519-5cb713e3392e_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F1dc05ff7dfbd467c8bee0ecfa3fe7cc1%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/1dc05ff7dfbd467c8bee0ecfa3fe7cc1/images/large/4.jpg saved to cache
2026-03-26 22:51:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b5d7ca9d-9d34-50ce-9519-5cb713e3392e
2026-03-26 22:51:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77bc850>
2026-03-26 22:51:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5d7ca9d-9d34-50ce-9519-5cb713e3392e/b5d7ca9d-9d34-50ce-9519-5cb713e3392e_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F1dc05ff7dfbd467c8bee0ecfa3fe7cc1%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/1dc05ff7dfbd467c8bee0ecfa3fe7cc1/images/large/6.jpg saved to cache
2026-03-26 22:51:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b5d7ca9d-9d34-50ce-9519-5cb713e3392e
2026-03-26 22:51:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b78c0510>
2026-03-26 22:51:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5d7ca9d-9d34-50ce-9519-5cb713e3392e/b5d7ca9d-9d34-50ce-9519-5cb713e3392e_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F1dc05ff7dfbd467c8bee0ecfa3fe7cc1%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/1dc05ff7dfbd467c8bee0ecfa3fe7cc1/images/large/2.jpg saved to cache
2026-03-26 22:51:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b5d7ca9d-9d34-50ce-9519-5cb713e3392e
2026-03-26 22:51:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/1dc05ff7dfbd467c8bee0ecfa3fe7cc1/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fe08452ab1f7242998a79ecc439b8caa9%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/e08452ab1f7242998a79ecc439b8caa9/images/large/4.jpg not downloaded yet
2026-03-26 22:51:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/1dc05ff7dfbd467c8bee0ecfa3fe7cc1/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fe08452ab1f7242998a79ecc439b8caa9%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/e08452ab1f7242998a79ecc439b8caa9/images/large/5.jpg not downloaded yet
2026-03-26 22:51:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7a82690>
2026-03-26 22:51:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5d7ca9d-9d34-50ce-9519-5cb713e3392e/b5d7ca9d-9d34-50ce-9519-5cb713e3392e_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F1dc05ff7dfbd467c8bee0ecfa3fe7cc1%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/1dc05ff7dfbd467c8bee0ecfa3fe7cc1/images/large/3.jpg saved to cache
2026-03-26 22:51:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b5d7ca9d-9d34-50ce-9519-5cb713e3392e
2026-03-26 22:51:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7cab7d0>
2026-03-26 22:51:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5d7ca9d-9d34-50ce-9519-5cb713e3392e/b5d7ca9d-9d34-50ce-9519-5cb713e3392e_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F1dc05ff7dfbd467c8bee0ecfa3fe7cc1%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/1dc05ff7dfbd467c8bee0ecfa3fe7cc1/images/large/1.jpg saved to cache
2026-03-26 22:51:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b5d7ca9d-9d34-50ce-9519-5cb713e3392e
2026-03-26 22:51:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e4f590>
2026-03-26 22:51:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5d7ca9d-9d34-50ce-9519-5cb713e3392e/b5d7ca9d-9d34-50ce-9519-5cb713e3392e_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F1dc05ff7dfbd467c8bee0ecfa3fe7cc1%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/1dc05ff7dfbd467c8bee0ecfa3fe7cc1/images/large/7.jpg saved to cache
2026-03-26 22:51:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b5d7ca9d-9d34-50ce-9519-5cb713e3392e
2026-03-26 22:51:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cb18d0>
2026-03-26 22:51:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5d7ca9d-9d34-50ce-9519-5cb713e3392e/b5d7ca9d-9d34-50ce-9519-5cb713e3392e_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F1dc05ff7dfbd467c8bee0ecfa3fe7cc1%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/1dc05ff7dfbd467c8bee0ecfa3fe7cc1/images/large/5.jpg saved to cache
2026-03-26 22:51:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b5d7ca9d-9d34-50ce-9519-5cb713e3392e
2026-03-26 22:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fe08452ab1f7242998a79ecc439b8caa9%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/e08452ab1f7242998a79ecc439b8caa9/images/large/6.jpg not downloaded yet
2026-03-26 22:51:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/1dc05ff7dfbd467c8bee0ecfa3fe7cc1/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b72fd490>
2026-03-26 22:51:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5d7ca9d-9d34-50ce-9519-5cb713e3392e/b5d7ca9d-9d34-50ce-9519-5cb713e3392e_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F1dc05ff7dfbd467c8bee0ecfa3fe7cc1%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/1dc05ff7dfbd467c8bee0ecfa3fe7cc1/images/large/8.jpg saved to cache
2026-03-26 22:51:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b5d7ca9d-9d34-50ce-9519-5cb713e3392e
2026-03-26 22:51:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7925e50>
2026-03-26 22:51:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5d7ca9d-9d34-50ce-9519-5cb713e3392e/b5d7ca9d-9d34-50ce-9519-5cb713e3392e_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F1dc05ff7dfbd467c8bee0ecfa3fe7cc1%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/1dc05ff7dfbd467c8bee0ecfa3fe7cc1/images/large/10.jpg saved to cache
2026-03-26 22:51:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b5d7ca9d-9d34-50ce-9519-5cb713e3392e
2026-03-26 22:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fe08452ab1f7242998a79ecc439b8caa9%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/e08452ab1f7242998a79ecc439b8caa9/images/large/7.jpg not downloaded yet
2026-03-26 22:51:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/e08452ab1f7242998a79ecc439b8caa9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fe08452ab1f7242998a79ecc439b8caa9%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/e08452ab1f7242998a79ecc439b8caa9/images/large/8.jpg not downloaded yet
2026-03-26 22:51:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79264d0>
2026-03-26 22:51:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5d7ca9d-9d34-50ce-9519-5cb713e3392e/b5d7ca9d-9d34-50ce-9519-5cb713e3392e_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F1dc05ff7dfbd467c8bee0ecfa3fe7cc1%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/1dc05ff7dfbd467c8bee0ecfa3fe7cc1/images/large/9.jpg saved to cache
2026-03-26 22:51:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b5d7ca9d-9d34-50ce-9519-5cb713e3392e
2026-03-26 22:51:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b5d7ca9d-9d34-50ce-9519-5cb713e3392e, skipping ID generation
2026-03-26 22:51:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5d7ca9d-9d34-50ce-9519-5cb713e3392e with scrape type 1
2026-03-26 22:51:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b5d7ca9d-9d34-50ce-9519-5cb713e3392e sending to next pipeline
2026-03-26 22:51:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b5d7ca9d-9d34-50ce-9519-5cb713e3392e, identifier: 1985424
2026-03-26 22:51:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b5d7ca9d-9d34-50ce-9519-5cb713e3392e with identifier: 1985424
2026-03-26 22:51:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b5d7ca9d-9d34-50ce-9519-5cb713e3392e with identifier: 1985424
2026-03-26 22:51:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b5d7ca9d-9d34-50ce-9519-5cb713e3392e with identifier: 1985424 to the API
2026-03-26 22:51:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:51:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:51:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bd/1dc05ff7dfbd467c8bee0ecfa3fe7cc1/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'b5d7ca9d-9d34-50ce-9519-5cb713e3392e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLASS A (W177)',
 'odometer': 81688,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5d7ca9d-9d34-50ce-9519-5cb713e3392e/b5d7ca9d-9d34-50ce-9519-5cb713e3392e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 487614,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/1dc05ff7dfbd467c8bee0ecfa3fe7cc1/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5d7ca9d-9d34-50ce-9519-5cb713e3392e/b5d7ca9d-9d34-50ce-9519-5cb713e3392e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 539386,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/1dc05ff7dfbd467c8bee0ecfa3fe7cc1/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5d7ca9d-9d34-50ce-9519-5cb713e3392e/b5d7ca9d-9d34-50ce-9519-5cb713e3392e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 465569,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/1dc05ff7dfbd467c8bee0ecfa3fe7cc1/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5d7ca9d-9d34-50ce-9519-5cb713e3392e/b5d7ca9d-9d34-50ce-9519-5cb713e3392e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 393096,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/1dc05ff7dfbd467c8bee0ecfa3fe7cc1/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5d7ca9d-9d34-50ce-9519-5cb713e3392e/b5d7ca9d-9d34-50ce-9519-5cb713e3392e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 411453,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/1dc05ff7dfbd467c8bee0ecfa3fe7cc1/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5d7ca9d-9d34-50ce-9519-5cb713e3392e/b5d7ca9d-9d34-50ce-9519-5cb713e3392e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 243858,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/1dc05ff7dfbd467c8bee0ecfa3fe7cc1/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5d7ca9d-9d34-50ce-9519-5cb713e3392e/b5d7ca9d-9d34-50ce-9519-5cb713e3392e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 452191,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/1dc05ff7dfbd467c8bee0ecfa3fe7cc1/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5d7ca9d-9d34-50ce-9519-5cb713e3392e/b5d7ca9d-9d34-50ce-9519-5cb713e3392e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 377089,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/1dc05ff7dfbd467c8bee0ecfa3fe7cc1/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5d7ca9d-9d34-50ce-9519-5cb713e3392e/b5d7ca9d-9d34-50ce-9519-5cb713e3392e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 428792,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/1dc05ff7dfbd467c8bee0ecfa3fe7cc1/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5d7ca9d-9d34-50ce-9519-5cb713e3392e/b5d7ca9d-9d34-50ce-9519-5cb713e3392e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 222424,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/1dc05ff7dfbd467c8bee0ecfa3fe7cc1/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLASS A (W177) A 250 e PHEV Business Solution',
 'transmission': 'automatic',
 'trim': 'A 250 e PHEV Business Solution',
 'vin': None,
 'year': 2021}
2026-03-26 22:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985424%27 HTTP/1.1" 200 None
2026-03-26 22:51:17 [ayvens.be] INFO: Saving data for 1985424: {'created_time': 1774565477.401135, 'last_price_update_time': 1774565477.401147, 'auction_closing_time': 1774958400.0}
2026-03-26 22:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985424') HTTP/1.1" 204 0
2026-03-26 22:51:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/e08452ab1f7242998a79ecc439b8caa9/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fe08452ab1f7242998a79ecc439b8caa9%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/e08452ab1f7242998a79ecc439b8caa9/images/large/9.jpg not downloaded yet
2026-03-26 22:51:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/e08452ab1f7242998a79ecc439b8caa9/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7a60fd0>
2026-03-26 22:51:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7cf7abd-ce36-549d-ad5b-cb0e608050f4/d7cf7abd-ce36-549d-ad5b-cb0e608050f4_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fe08452ab1f7242998a79ecc439b8caa9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/e08452ab1f7242998a79ecc439b8caa9/images/large/1.jpg saved to cache
2026-03-26 22:51:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d7cf7abd-ce36-549d-ad5b-cb0e608050f4
2026-03-26 22:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fe08452ab1f7242998a79ecc439b8caa9%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/e08452ab1f7242998a79ecc439b8caa9/images/large/10.jpg not downloaded yet
2026-03-26 22:51:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/e08452ab1f7242998a79ecc439b8caa9/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/e08452ab1f7242998a79ecc439b8caa9/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:17 [ayvens.be] INFO: Found listing with ID: 1985426
2026-03-26 22:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985426%27 HTTP/1.1" 200 None
2026-03-26 22:51:17 [ayvens.be] INFO: Scrape type for 1985426: 1
2026-03-26 22:51:17 [ayvens.be] INFO: Extracting data for car ID: 1985426
2026-03-26 22:51:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 336ff642-b8c1-548c-a777-d27cc3548c5a with identifier: 1985426
2026-03-26 22:51:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 336ff642-b8c1-548c-a777-d27cc3548c5a with scrape type 1
2026-03-26 22:51:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 336ff642-b8c1-548c-a777-d27cc3548c5a
2026-03-26 22:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fr%252F55c9ac46ae5b4e5fa04bc78b87ee4f1c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fr/55c9ac46ae5b4e5fa04bc78b87ee4f1c/images/large/1.jpg not downloaded yet
2026-03-26 22:51:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/e08452ab1f7242998a79ecc439b8caa9/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b788f950>
2026-03-26 22:51:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7cf7abd-ce36-549d-ad5b-cb0e608050f4/d7cf7abd-ce36-549d-ad5b-cb0e608050f4_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fe08452ab1f7242998a79ecc439b8caa9%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/e08452ab1f7242998a79ecc439b8caa9/images/large/3.jpg saved to cache
2026-03-26 22:51:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d7cf7abd-ce36-549d-ad5b-cb0e608050f4
2026-03-26 22:51:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77cb810>
2026-03-26 22:51:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7cf7abd-ce36-549d-ad5b-cb0e608050f4/d7cf7abd-ce36-549d-ad5b-cb0e608050f4_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fe08452ab1f7242998a79ecc439b8caa9%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/e08452ab1f7242998a79ecc439b8caa9/images/large/2.jpg saved to cache
2026-03-26 22:51:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d7cf7abd-ce36-549d-ad5b-cb0e608050f4
2026-03-26 22:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fr%252F55c9ac46ae5b4e5fa04bc78b87ee4f1c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fr/55c9ac46ae5b4e5fa04bc78b87ee4f1c/images/large/2.jpg not downloaded yet
2026-03-26 22:51:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/e08452ab1f7242998a79ecc439b8caa9/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fr%252F55c9ac46ae5b4e5fa04bc78b87ee4f1c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fr/55c9ac46ae5b4e5fa04bc78b87ee4f1c/images/large/3.jpg not downloaded yet
2026-03-26 22:51:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd0cf4d0>
2026-03-26 22:51:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7cf7abd-ce36-549d-ad5b-cb0e608050f4/d7cf7abd-ce36-549d-ad5b-cb0e608050f4_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fe08452ab1f7242998a79ecc439b8caa9%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/e08452ab1f7242998a79ecc439b8caa9/images/large/4.jpg saved to cache
2026-03-26 22:51:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d7cf7abd-ce36-549d-ad5b-cb0e608050f4
2026-03-26 22:51:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7448750>
2026-03-26 22:51:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7cf7abd-ce36-549d-ad5b-cb0e608050f4/d7cf7abd-ce36-549d-ad5b-cb0e608050f4_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fe08452ab1f7242998a79ecc439b8caa9%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/e08452ab1f7242998a79ecc439b8caa9/images/large/6.jpg saved to cache
2026-03-26 22:51:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d7cf7abd-ce36-549d-ad5b-cb0e608050f4
2026-03-26 22:51:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7ccef50>
2026-03-26 22:51:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7cf7abd-ce36-549d-ad5b-cb0e608050f4/d7cf7abd-ce36-549d-ad5b-cb0e608050f4_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fe08452ab1f7242998a79ecc439b8caa9%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/e08452ab1f7242998a79ecc439b8caa9/images/large/5.jpg saved to cache
2026-03-26 22:51:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d7cf7abd-ce36-549d-ad5b-cb0e608050f4
2026-03-26 22:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fr%252F55c9ac46ae5b4e5fa04bc78b87ee4f1c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fr/55c9ac46ae5b4e5fa04bc78b87ee4f1c/images/large/4.jpg not downloaded yet
2026-03-26 22:51:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/e08452ab1f7242998a79ecc439b8caa9/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/e08452ab1f7242998a79ecc439b8caa9/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fr%252F55c9ac46ae5b4e5fa04bc78b87ee4f1c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fr/55c9ac46ae5b4e5fa04bc78b87ee4f1c/images/large/5.jpg not downloaded yet
2026-03-26 22:51:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/e08452ab1f7242998a79ecc439b8caa9/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7570a10>
2026-03-26 22:51:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7cf7abd-ce36-549d-ad5b-cb0e608050f4/d7cf7abd-ce36-549d-ad5b-cb0e608050f4_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fe08452ab1f7242998a79ecc439b8caa9%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/e08452ab1f7242998a79ecc439b8caa9/images/large/7.jpg saved to cache
2026-03-26 22:51:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d7cf7abd-ce36-549d-ad5b-cb0e608050f4
2026-03-26 22:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fr%252F55c9ac46ae5b4e5fa04bc78b87ee4f1c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fr/55c9ac46ae5b4e5fa04bc78b87ee4f1c/images/large/6.jpg not downloaded yet
2026-03-26 22:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fr%252F55c9ac46ae5b4e5fa04bc78b87ee4f1c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fr/55c9ac46ae5b4e5fa04bc78b87ee4f1c/images/large/7.jpg not downloaded yet
2026-03-26 22:51:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7982f10>
2026-03-26 22:51:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7cf7abd-ce36-549d-ad5b-cb0e608050f4/d7cf7abd-ce36-549d-ad5b-cb0e608050f4_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fe08452ab1f7242998a79ecc439b8caa9%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/e08452ab1f7242998a79ecc439b8caa9/images/large/9.jpg saved to cache
2026-03-26 22:51:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d7cf7abd-ce36-549d-ad5b-cb0e608050f4
2026-03-26 22:51:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7aa0210>
2026-03-26 22:51:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7cf7abd-ce36-549d-ad5b-cb0e608050f4/d7cf7abd-ce36-549d-ad5b-cb0e608050f4_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fe08452ab1f7242998a79ecc439b8caa9%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/e08452ab1f7242998a79ecc439b8caa9/images/large/8.jpg saved to cache
2026-03-26 22:51:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d7cf7abd-ce36-549d-ad5b-cb0e608050f4
2026-03-26 22:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fr%252F55c9ac46ae5b4e5fa04bc78b87ee4f1c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fr/55c9ac46ae5b4e5fa04bc78b87ee4f1c/images/large/8.jpg not downloaded yet
2026-03-26 22:51:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd0cf350>
2026-03-26 22:51:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7cf7abd-ce36-549d-ad5b-cb0e608050f4/d7cf7abd-ce36-549d-ad5b-cb0e608050f4_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fe08452ab1f7242998a79ecc439b8caa9%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/e08452ab1f7242998a79ecc439b8caa9/images/large/10.jpg saved to cache
2026-03-26 22:51:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d7cf7abd-ce36-549d-ad5b-cb0e608050f4
2026-03-26 22:51:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d7cf7abd-ce36-549d-ad5b-cb0e608050f4, skipping ID generation
2026-03-26 22:51:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7cf7abd-ce36-549d-ad5b-cb0e608050f4 with scrape type 1
2026-03-26 22:51:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d7cf7abd-ce36-549d-ad5b-cb0e608050f4 sending to next pipeline
2026-03-26 22:51:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d7cf7abd-ce36-549d-ad5b-cb0e608050f4, identifier: 1985425
2026-03-26 22:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fr%252F55c9ac46ae5b4e5fa04bc78b87ee4f1c%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fr/55c9ac46ae5b4e5fa04bc78b87ee4f1c/images/large/9.jpg not downloaded yet
2026-03-26 22:51:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d7cf7abd-ce36-549d-ad5b-cb0e608050f4 with identifier: 1985425
2026-03-26 22:51:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d7cf7abd-ce36-549d-ad5b-cb0e608050f4 with identifier: 1985425
2026-03-26 22:51:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d7cf7abd-ce36-549d-ad5b-cb0e608050f4 with identifier: 1985425 to the API
2026-03-26 22:51:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:51:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:51:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2be/e08452ab1f7242998a79ecc439b8caa9/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd7cf7abd-ce36-549d-ad5b-cb0e608050f4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A5',
 'odometer': 152619,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7cf7abd-ce36-549d-ad5b-cb0e608050f4/d7cf7abd-ce36-549d-ad5b-cb0e608050f4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 421692,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/e08452ab1f7242998a79ecc439b8caa9/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7cf7abd-ce36-549d-ad5b-cb0e608050f4/d7cf7abd-ce36-549d-ad5b-cb0e608050f4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 461632,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/e08452ab1f7242998a79ecc439b8caa9/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7cf7abd-ce36-549d-ad5b-cb0e608050f4/d7cf7abd-ce36-549d-ad5b-cb0e608050f4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 398738,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/e08452ab1f7242998a79ecc439b8caa9/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7cf7abd-ce36-549d-ad5b-cb0e608050f4/d7cf7abd-ce36-549d-ad5b-cb0e608050f4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 410841,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/e08452ab1f7242998a79ecc439b8caa9/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7cf7abd-ce36-549d-ad5b-cb0e608050f4/d7cf7abd-ce36-549d-ad5b-cb0e608050f4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 360384,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/e08452ab1f7242998a79ecc439b8caa9/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7cf7abd-ce36-549d-ad5b-cb0e608050f4/d7cf7abd-ce36-549d-ad5b-cb0e608050f4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 243283,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/e08452ab1f7242998a79ecc439b8caa9/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7cf7abd-ce36-549d-ad5b-cb0e608050f4/d7cf7abd-ce36-549d-ad5b-cb0e608050f4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 334449,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/e08452ab1f7242998a79ecc439b8caa9/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7cf7abd-ce36-549d-ad5b-cb0e608050f4/d7cf7abd-ce36-549d-ad5b-cb0e608050f4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 349772,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/e08452ab1f7242998a79ecc439b8caa9/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7cf7abd-ce36-549d-ad5b-cb0e608050f4/d7cf7abd-ce36-549d-ad5b-cb0e608050f4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 273405,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/e08452ab1f7242998a79ecc439b8caa9/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7cf7abd-ce36-549d-ad5b-cb0e608050f4/d7cf7abd-ce36-549d-ad5b-cb0e608050f4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 254645,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/e08452ab1f7242998a79ecc439b8caa9/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-20',
 'seats_number': 4,
 'seller_name': None,
 'title': 'AUDI A5 2.0 30 TDI S TRONIC BUS.ED. S LINE',
 'transmission': 'automatic',
 'trim': '2.0 30 TDI S TRONIC BUS.ED. S LINE',
 'vin': None,
 'year': 2021}
2026-03-26 22:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985425%27 HTTP/1.1" 200 None
2026-03-26 22:51:18 [ayvens.be] INFO: Saving data for 1985425: {'created_time': 1774565478.993624, 'last_price_update_time': 1774565478.993634, 'auction_closing_time': 1774958400.0}
2026-03-26 22:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985425') HTTP/1.1" 204 0
2026-03-26 22:51:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fr/55c9ac46ae5b4e5fa04bc78b87ee4f1c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fr%252F55c9ac46ae5b4e5fa04bc78b87ee4f1c%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fr/55c9ac46ae5b4e5fa04bc78b87ee4f1c/images/large/10.jpg not downloaded yet
2026-03-26 22:51:19 [ayvens.be] INFO: Found listing with ID: 1985427
2026-03-26 22:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985427%27 HTTP/1.1" 200 None
2026-03-26 22:51:19 [ayvens.be] INFO: Scrape type for 1985427: 1
2026-03-26 22:51:19 [ayvens.be] INFO: Extracting data for car ID: 1985427
2026-03-26 22:51:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 581e808f-db3d-59b1-ba12-bd1d1e86e005 with identifier: 1985427
2026-03-26 22:51:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 581e808f-db3d-59b1-ba12-bd1d1e86e005 with scrape type 1
2026-03-26 22:51:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 581e808f-db3d-59b1-ba12-bd1d1e86e005
2026-03-26 22:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fff27496219ea4bc79532672e5a910229%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/ff27496219ea4bc79532672e5a910229/images/large/1.jpg not downloaded yet
2026-03-26 22:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fff27496219ea4bc79532672e5a910229%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/ff27496219ea4bc79532672e5a910229/images/large/2.jpg not downloaded yet
2026-03-26 22:51:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fr/55c9ac46ae5b4e5fa04bc78b87ee4f1c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fr/55c9ac46ae5b4e5fa04bc78b87ee4f1c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fff27496219ea4bc79532672e5a910229%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/ff27496219ea4bc79532672e5a910229/images/large/3.jpg not downloaded yet
2026-03-26 22:51:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fr/55c9ac46ae5b4e5fa04bc78b87ee4f1c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fff27496219ea4bc79532672e5a910229%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/ff27496219ea4bc79532672e5a910229/images/large/4.jpg not downloaded yet
2026-03-26 22:51:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fr/55c9ac46ae5b4e5fa04bc78b87ee4f1c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7a567d0>
2026-03-26 22:51:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_336ff642-b8c1-548c-a777-d27cc3548c5a/336ff642-b8c1-548c-a777-d27cc3548c5a_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fr%252F55c9ac46ae5b4e5fa04bc78b87ee4f1c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fr/55c9ac46ae5b4e5fa04bc78b87ee4f1c/images/large/1.jpg saved to cache
2026-03-26 22:51:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 336ff642-b8c1-548c-a777-d27cc3548c5a
2026-03-26 22:51:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fr/55c9ac46ae5b4e5fa04bc78b87ee4f1c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fff27496219ea4bc79532672e5a910229%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/ff27496219ea4bc79532672e5a910229/images/large/5.jpg not downloaded yet
2026-03-26 22:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fff27496219ea4bc79532672e5a910229%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/ff27496219ea4bc79532672e5a910229/images/large/6.jpg not downloaded yet
2026-03-26 22:51:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7a60210>
2026-03-26 22:51:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_336ff642-b8c1-548c-a777-d27cc3548c5a/336ff642-b8c1-548c-a777-d27cc3548c5a_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fr%252F55c9ac46ae5b4e5fa04bc78b87ee4f1c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fr/55c9ac46ae5b4e5fa04bc78b87ee4f1c/images/large/2.jpg saved to cache
2026-03-26 22:51:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 336ff642-b8c1-548c-a777-d27cc3548c5a
2026-03-26 22:51:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76cf410>
2026-03-26 22:51:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_336ff642-b8c1-548c-a777-d27cc3548c5a/336ff642-b8c1-548c-a777-d27cc3548c5a_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fr%252F55c9ac46ae5b4e5fa04bc78b87ee4f1c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fr/55c9ac46ae5b4e5fa04bc78b87ee4f1c/images/large/3.jpg saved to cache
2026-03-26 22:51:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 336ff642-b8c1-548c-a777-d27cc3548c5a
2026-03-26 22:51:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fr/55c9ac46ae5b4e5fa04bc78b87ee4f1c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fff27496219ea4bc79532672e5a910229%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/ff27496219ea4bc79532672e5a910229/images/large/7.jpg not downloaded yet
2026-03-26 22:51:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7724b90>
2026-03-26 22:51:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_336ff642-b8c1-548c-a777-d27cc3548c5a/336ff642-b8c1-548c-a777-d27cc3548c5a_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fr%252F55c9ac46ae5b4e5fa04bc78b87ee4f1c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fr/55c9ac46ae5b4e5fa04bc78b87ee4f1c/images/large/5.jpg saved to cache
2026-03-26 22:51:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 336ff642-b8c1-548c-a777-d27cc3548c5a
2026-03-26 22:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fff27496219ea4bc79532672e5a910229%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/ff27496219ea4bc79532672e5a910229/images/large/8.jpg not downloaded yet
2026-03-26 22:51:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79ce1d0>
2026-03-26 22:51:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_336ff642-b8c1-548c-a777-d27cc3548c5a/336ff642-b8c1-548c-a777-d27cc3548c5a_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fr%252F55c9ac46ae5b4e5fa04bc78b87ee4f1c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fr/55c9ac46ae5b4e5fa04bc78b87ee4f1c/images/large/4.jpg saved to cache
2026-03-26 22:51:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 336ff642-b8c1-548c-a777-d27cc3548c5a
2026-03-26 22:51:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b788d790>
2026-03-26 22:51:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_336ff642-b8c1-548c-a777-d27cc3548c5a/336ff642-b8c1-548c-a777-d27cc3548c5a_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fr%252F55c9ac46ae5b4e5fa04bc78b87ee4f1c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fr/55c9ac46ae5b4e5fa04bc78b87ee4f1c/images/large/6.jpg saved to cache
2026-03-26 22:51:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 336ff642-b8c1-548c-a777-d27cc3548c5a
2026-03-26 22:51:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7cce450>
2026-03-26 22:51:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_336ff642-b8c1-548c-a777-d27cc3548c5a/336ff642-b8c1-548c-a777-d27cc3548c5a_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fr%252F55c9ac46ae5b4e5fa04bc78b87ee4f1c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fr/55c9ac46ae5b4e5fa04bc78b87ee4f1c/images/large/7.jpg saved to cache
2026-03-26 22:51:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 336ff642-b8c1-548c-a777-d27cc3548c5a
2026-03-26 22:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fff27496219ea4bc79532672e5a910229%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/ff27496219ea4bc79532672e5a910229/images/large/9.jpg not downloaded yet
2026-03-26 22:51:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fr/55c9ac46ae5b4e5fa04bc78b87ee4f1c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yh/ff27496219ea4bc79532672e5a910229/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fff27496219ea4bc79532672e5a910229%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/ff27496219ea4bc79532672e5a910229/images/large/10.jpg not downloaded yet
2026-03-26 22:51:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fr/55c9ac46ae5b4e5fa04bc78b87ee4f1c/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yh/ff27496219ea4bc79532672e5a910229/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yh/ff27496219ea4bc79532672e5a910229/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fr/55c9ac46ae5b4e5fa04bc78b87ee4f1c/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:19 [ayvens.be] INFO: Found listing with ID: 1985428
2026-03-26 22:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985428%27 HTTP/1.1" 200 None
2026-03-26 22:51:19 [ayvens.be] INFO: Scrape type for 1985428: 1
2026-03-26 22:51:19 [ayvens.be] INFO: Extracting data for car ID: 1985428
2026-03-26 22:51:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89e6be1e-eb40-5242-8521-e6bba00d5ed3 with identifier: 1985428
2026-03-26 22:51:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89e6be1e-eb40-5242-8521-e6bba00d5ed3 with scrape type 1
2026-03-26 22:51:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 89e6be1e-eb40-5242-8521-e6bba00d5ed3
2026-03-26 22:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F9b0646f94e534c198e83284e4c3b4b4c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/9b0646f94e534c198e83284e4c3b4b4c/images/large/1.jpg not downloaded yet
2026-03-26 22:51:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yh/ff27496219ea4bc79532672e5a910229/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F9b0646f94e534c198e83284e4c3b4b4c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/9b0646f94e534c198e83284e4c3b4b4c/images/large/2.jpg not downloaded yet
2026-03-26 22:51:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yh/ff27496219ea4bc79532672e5a910229/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F9b0646f94e534c198e83284e4c3b4b4c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/9b0646f94e534c198e83284e4c3b4b4c/images/large/3.jpg not downloaded yet
2026-03-26 22:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F9b0646f94e534c198e83284e4c3b4b4c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/9b0646f94e534c198e83284e4c3b4b4c/images/large/4.jpg not downloaded yet
2026-03-26 22:51:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7aead90>
2026-03-26 22:51:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_336ff642-b8c1-548c-a777-d27cc3548c5a/336ff642-b8c1-548c-a777-d27cc3548c5a_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fr%252F55c9ac46ae5b4e5fa04bc78b87ee4f1c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fr/55c9ac46ae5b4e5fa04bc78b87ee4f1c/images/large/8.jpg saved to cache
2026-03-26 22:51:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 336ff642-b8c1-548c-a777-d27cc3548c5a
2026-03-26 22:51:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74971d0>
2026-03-26 22:51:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_581e808f-db3d-59b1-ba12-bd1d1e86e005/581e808f-db3d-59b1-ba12-bd1d1e86e005_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fff27496219ea4bc79532672e5a910229%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/ff27496219ea4bc79532672e5a910229/images/large/2.jpg saved to cache
2026-03-26 22:51:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 581e808f-db3d-59b1-ba12-bd1d1e86e005
2026-03-26 22:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F9b0646f94e534c198e83284e4c3b4b4c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/9b0646f94e534c198e83284e4c3b4b4c/images/large/5.jpg not downloaded yet
2026-03-26 22:51:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7a636d0>
2026-03-26 22:51:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_336ff642-b8c1-548c-a777-d27cc3548c5a/336ff642-b8c1-548c-a777-d27cc3548c5a_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fr%252F55c9ac46ae5b4e5fa04bc78b87ee4f1c%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fr/55c9ac46ae5b4e5fa04bc78b87ee4f1c/images/large/10.jpg saved to cache
2026-03-26 22:51:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 336ff642-b8c1-548c-a777-d27cc3548c5a
2026-03-26 22:51:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79cd610>
2026-03-26 22:51:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_581e808f-db3d-59b1-ba12-bd1d1e86e005/581e808f-db3d-59b1-ba12-bd1d1e86e005_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fff27496219ea4bc79532672e5a910229%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/ff27496219ea4bc79532672e5a910229/images/large/1.jpg saved to cache
2026-03-26 22:51:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 581e808f-db3d-59b1-ba12-bd1d1e86e005
2026-03-26 22:51:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79ccf50>
2026-03-26 22:51:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_581e808f-db3d-59b1-ba12-bd1d1e86e005/581e808f-db3d-59b1-ba12-bd1d1e86e005_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fff27496219ea4bc79532672e5a910229%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/ff27496219ea4bc79532672e5a910229/images/large/4.jpg saved to cache
2026-03-26 22:51:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 581e808f-db3d-59b1-ba12-bd1d1e86e005
2026-03-26 22:51:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7cab7d0>
2026-03-26 22:51:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_336ff642-b8c1-548c-a777-d27cc3548c5a/336ff642-b8c1-548c-a777-d27cc3548c5a_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fr%252F55c9ac46ae5b4e5fa04bc78b87ee4f1c%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fr/55c9ac46ae5b4e5fa04bc78b87ee4f1c/images/large/9.jpg saved to cache
2026-03-26 22:51:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 336ff642-b8c1-548c-a777-d27cc3548c5a
2026-03-26 22:51:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 336ff642-b8c1-548c-a777-d27cc3548c5a, skipping ID generation
2026-03-26 22:51:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 336ff642-b8c1-548c-a777-d27cc3548c5a with scrape type 1
2026-03-26 22:51:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 336ff642-b8c1-548c-a777-d27cc3548c5a sending to next pipeline
2026-03-26 22:51:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 336ff642-b8c1-548c-a777-d27cc3548c5a, identifier: 1985426
2026-03-26 22:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F9b0646f94e534c198e83284e4c3b4b4c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/9b0646f94e534c198e83284e4c3b4b4c/images/large/6.jpg not downloaded yet
2026-03-26 22:51:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 336ff642-b8c1-548c-a777-d27cc3548c5a with identifier: 1985426
2026-03-26 22:51:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 336ff642-b8c1-548c-a777-d27cc3548c5a with identifier: 1985426
2026-03-26 22:51:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 336ff642-b8c1-548c-a777-d27cc3548c5a with identifier: 1985426 to the API
2026-03-26 22:51:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:51:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:51:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2fr/55c9ac46ae5b4e5fa04bc78b87ee4f1c/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'electric',
 'id': '336ff642-b8c1-548c-a777-d27cc3548c5a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'NIRO',
 'odometer': 52291,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 25,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_336ff642-b8c1-548c-a777-d27cc3548c5a/336ff642-b8c1-548c-a777-d27cc3548c5a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 780115,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fr/55c9ac46ae5b4e5fa04bc78b87ee4f1c/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_336ff642-b8c1-548c-a777-d27cc3548c5a/336ff642-b8c1-548c-a777-d27cc3548c5a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 766886,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fr/55c9ac46ae5b4e5fa04bc78b87ee4f1c/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_336ff642-b8c1-548c-a777-d27cc3548c5a/336ff642-b8c1-548c-a777-d27cc3548c5a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 766870,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fr/55c9ac46ae5b4e5fa04bc78b87ee4f1c/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_336ff642-b8c1-548c-a777-d27cc3548c5a/336ff642-b8c1-548c-a777-d27cc3548c5a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 796940,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fr/55c9ac46ae5b4e5fa04bc78b87ee4f1c/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_336ff642-b8c1-548c-a777-d27cc3548c5a/336ff642-b8c1-548c-a777-d27cc3548c5a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 763826,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fr/55c9ac46ae5b4e5fa04bc78b87ee4f1c/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_336ff642-b8c1-548c-a777-d27cc3548c5a/336ff642-b8c1-548c-a777-d27cc3548c5a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 743779,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fr/55c9ac46ae5b4e5fa04bc78b87ee4f1c/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_336ff642-b8c1-548c-a777-d27cc3548c5a/336ff642-b8c1-548c-a777-d27cc3548c5a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 657026,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fr/55c9ac46ae5b4e5fa04bc78b87ee4f1c/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_336ff642-b8c1-548c-a777-d27cc3548c5a/336ff642-b8c1-548c-a777-d27cc3548c5a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 952424,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fr/55c9ac46ae5b4e5fa04bc78b87ee4f1c/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_336ff642-b8c1-548c-a777-d27cc3548c5a/336ff642-b8c1-548c-a777-d27cc3548c5a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 876379,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fr/55c9ac46ae5b4e5fa04bc78b87ee4f1c/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_336ff642-b8c1-548c-a777-d27cc3548c5a/336ff642-b8c1-548c-a777-d27cc3548c5a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 656992,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fr/55c9ac46ae5b4e5fa04bc78b87ee4f1c/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-07-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA NIRO BEV 65KWH NIRO EV 150KW PURE AUTO',
 'transmission': 'automatic',
 'trim': 'BEV 65KWH NIRO EV 150KW PURE AUTO',
 'vin': None,
 'year': 2024}
2026-03-26 22:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985426%27 HTTP/1.1" 200 None
2026-03-26 22:51:21 [ayvens.be] INFO: Saving data for 1985426: {'created_time': 1774565481.122169, 'last_price_update_time': 1774565481.122178, 'auction_closing_time': 1774958400.0}
2026-03-26 22:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985426') HTTP/1.1" 204 0
2026-03-26 22:51:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yh/ff27496219ea4bc79532672e5a910229/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e14bd0>
2026-03-26 22:51:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_581e808f-db3d-59b1-ba12-bd1d1e86e005/581e808f-db3d-59b1-ba12-bd1d1e86e005_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fff27496219ea4bc79532672e5a910229%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/ff27496219ea4bc79532672e5a910229/images/large/3.jpg saved to cache
2026-03-26 22:51:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 581e808f-db3d-59b1-ba12-bd1d1e86e005
2026-03-26 22:51:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e34510>
2026-03-26 22:51:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_581e808f-db3d-59b1-ba12-bd1d1e86e005/581e808f-db3d-59b1-ba12-bd1d1e86e005_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fff27496219ea4bc79532672e5a910229%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/ff27496219ea4bc79532672e5a910229/images/large/5.jpg saved to cache
2026-03-26 22:51:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 581e808f-db3d-59b1-ba12-bd1d1e86e005
2026-03-26 22:51:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yh/ff27496219ea4bc79532672e5a910229/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yh/ff27496219ea4bc79532672e5a910229/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F9b0646f94e534c198e83284e4c3b4b4c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/9b0646f94e534c198e83284e4c3b4b4c/images/large/7.jpg not downloaded yet
2026-03-26 22:51:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yh/ff27496219ea4bc79532672e5a910229/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F9b0646f94e534c198e83284e4c3b4b4c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/9b0646f94e534c198e83284e4c3b4b4c/images/large/8.jpg not downloaded yet
2026-03-26 22:51:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b746eb10>
2026-03-26 22:51:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_581e808f-db3d-59b1-ba12-bd1d1e86e005/581e808f-db3d-59b1-ba12-bd1d1e86e005_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fff27496219ea4bc79532672e5a910229%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/ff27496219ea4bc79532672e5a910229/images/large/6.jpg saved to cache
2026-03-26 22:51:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 581e808f-db3d-59b1-ba12-bd1d1e86e005
2026-03-26 22:51:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yh/ff27496219ea4bc79532672e5a910229/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F9b0646f94e534c198e83284e4c3b4b4c%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/9b0646f94e534c198e83284e4c3b4b4c/images/large/9.jpg not downloaded yet
2026-03-26 22:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F9b0646f94e534c198e83284e4c3b4b4c%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/9b0646f94e534c198e83284e4c3b4b4c/images/large/10.jpg not downloaded yet
2026-03-26 22:51:21 [ayvens.be] INFO: Found listing with ID: 1985429
2026-03-26 22:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985429%27 HTTP/1.1" 200 None
2026-03-26 22:51:21 [ayvens.be] INFO: Scrape type for 1985429: 1
2026-03-26 22:51:21 [ayvens.be] INFO: Extracting data for car ID: 1985429
2026-03-26 22:51:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d244416-97dd-5dcf-9229-64139a9fcf6e with identifier: 1985429
2026-03-26 22:51:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d244416-97dd-5dcf-9229-64139a9fcf6e with scrape type 1
2026-03-26 22:51:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7d244416-97dd-5dcf-9229-64139a9fcf6e
2026-03-26 22:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cj%252Fc9c3d343392d4da99d1a06af1e05c92b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cj/c9c3d343392d4da99d1a06af1e05c92b/images/large/1.jpg not downloaded yet
2026-03-26 22:51:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c75750>
2026-03-26 22:51:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_581e808f-db3d-59b1-ba12-bd1d1e86e005/581e808f-db3d-59b1-ba12-bd1d1e86e005_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fff27496219ea4bc79532672e5a910229%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/ff27496219ea4bc79532672e5a910229/images/large/10.jpg saved to cache
2026-03-26 22:51:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 581e808f-db3d-59b1-ba12-bd1d1e86e005
2026-03-26 22:51:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b746c6d0>
2026-03-26 22:51:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_581e808f-db3d-59b1-ba12-bd1d1e86e005/581e808f-db3d-59b1-ba12-bd1d1e86e005_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fff27496219ea4bc79532672e5a910229%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/ff27496219ea4bc79532672e5a910229/images/large/9.jpg saved to cache
2026-03-26 22:51:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 581e808f-db3d-59b1-ba12-bd1d1e86e005
2026-03-26 22:51:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7411b10>
2026-03-26 22:51:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_581e808f-db3d-59b1-ba12-bd1d1e86e005/581e808f-db3d-59b1-ba12-bd1d1e86e005_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fff27496219ea4bc79532672e5a910229%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/ff27496219ea4bc79532672e5a910229/images/large/7.jpg saved to cache
2026-03-26 22:51:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 581e808f-db3d-59b1-ba12-bd1d1e86e005
2026-03-26 22:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cj%252Fc9c3d343392d4da99d1a06af1e05c92b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cj/c9c3d343392d4da99d1a06af1e05c92b/images/large/2.jpg not downloaded yet
2026-03-26 22:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cj%252Fc9c3d343392d4da99d1a06af1e05c92b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cj/c9c3d343392d4da99d1a06af1e05c92b/images/large/3.jpg not downloaded yet
2026-03-26 22:51:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74e7ed0>
2026-03-26 22:51:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_581e808f-db3d-59b1-ba12-bd1d1e86e005/581e808f-db3d-59b1-ba12-bd1d1e86e005_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fff27496219ea4bc79532672e5a910229%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/ff27496219ea4bc79532672e5a910229/images/large/8.jpg saved to cache
2026-03-26 22:51:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 581e808f-db3d-59b1-ba12-bd1d1e86e005
2026-03-26 22:51:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 581e808f-db3d-59b1-ba12-bd1d1e86e005, skipping ID generation
2026-03-26 22:51:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 581e808f-db3d-59b1-ba12-bd1d1e86e005 with scrape type 1
2026-03-26 22:51:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 581e808f-db3d-59b1-ba12-bd1d1e86e005 sending to next pipeline
2026-03-26 22:51:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 581e808f-db3d-59b1-ba12-bd1d1e86e005, identifier: 1985427
2026-03-26 22:51:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/9b0646f94e534c198e83284e4c3b4b4c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/9b0646f94e534c198e83284e4c3b4b4c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cj%252Fc9c3d343392d4da99d1a06af1e05c92b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cj/c9c3d343392d4da99d1a06af1e05c92b/images/large/4.jpg not downloaded yet
2026-03-26 22:51:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 581e808f-db3d-59b1-ba12-bd1d1e86e005 with identifier: 1985427
2026-03-26 22:51:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 581e808f-db3d-59b1-ba12-bd1d1e86e005 with identifier: 1985427
2026-03-26 22:51:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 581e808f-db3d-59b1-ba12-bd1d1e86e005 with identifier: 1985427 to the API
2026-03-26 22:51:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:51:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:51:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yh/ff27496219ea4bc79532672e5a910229/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '581e808f-db3d-59b1-ba12-bd1d1e86e005',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 122577,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_581e808f-db3d-59b1-ba12-bd1d1e86e005/581e808f-db3d-59b1-ba12-bd1d1e86e005_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 511597,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yh/ff27496219ea4bc79532672e5a910229/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_581e808f-db3d-59b1-ba12-bd1d1e86e005/581e808f-db3d-59b1-ba12-bd1d1e86e005_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 438972,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yh/ff27496219ea4bc79532672e5a910229/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_581e808f-db3d-59b1-ba12-bd1d1e86e005/581e808f-db3d-59b1-ba12-bd1d1e86e005_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 485709,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yh/ff27496219ea4bc79532672e5a910229/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_581e808f-db3d-59b1-ba12-bd1d1e86e005/581e808f-db3d-59b1-ba12-bd1d1e86e005_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 495629,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yh/ff27496219ea4bc79532672e5a910229/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_581e808f-db3d-59b1-ba12-bd1d1e86e005/581e808f-db3d-59b1-ba12-bd1d1e86e005_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 403873,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yh/ff27496219ea4bc79532672e5a910229/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_581e808f-db3d-59b1-ba12-bd1d1e86e005/581e808f-db3d-59b1-ba12-bd1d1e86e005_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 258721,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yh/ff27496219ea4bc79532672e5a910229/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_581e808f-db3d-59b1-ba12-bd1d1e86e005/581e808f-db3d-59b1-ba12-bd1d1e86e005_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 356575,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yh/ff27496219ea4bc79532672e5a910229/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_581e808f-db3d-59b1-ba12-bd1d1e86e005/581e808f-db3d-59b1-ba12-bd1d1e86e005_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 467199,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yh/ff27496219ea4bc79532672e5a910229/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_581e808f-db3d-59b1-ba12-bd1d1e86e005/581e808f-db3d-59b1-ba12-bd1d1e86e005_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 210540,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yh/ff27496219ea4bc79532672e5a910229/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_581e808f-db3d-59b1-ba12-bd1d1e86e005/581e808f-db3d-59b1-ba12-bd1d1e86e005_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 212929,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yh/ff27496219ea4bc79532672e5a910229/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 2008 1.2 PURETECH 74KW S-S ALLURE',
 'transmission': 'manual',
 'trim': '1.2 PURETECH 74KW S-S ALLURE',
 'vin': None,
 'year': 2020}
2026-03-26 22:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985427%27 HTTP/1.1" 200 None
2026-03-26 22:51:22 [ayvens.be] INFO: Saving data for 1985427: {'created_time': 1774565482.691453, 'last_price_update_time': 1774565482.691465, 'auction_closing_time': 1774958400.0}
2026-03-26 22:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985427') HTTP/1.1" 204 0
2026-03-26 22:51:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/9b0646f94e534c198e83284e4c3b4b4c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cj%252Fc9c3d343392d4da99d1a06af1e05c92b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cj/c9c3d343392d4da99d1a06af1e05c92b/images/large/5.jpg not downloaded yet
2026-03-26 22:51:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/9b0646f94e534c198e83284e4c3b4b4c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cc86d0>
2026-03-26 22:51:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89e6be1e-eb40-5242-8521-e6bba00d5ed3/89e6be1e-eb40-5242-8521-e6bba00d5ed3_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F9b0646f94e534c198e83284e4c3b4b4c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/9b0646f94e534c198e83284e4c3b4b4c/images/large/3.jpg saved to cache
2026-03-26 22:51:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 89e6be1e-eb40-5242-8521-e6bba00d5ed3
2026-03-26 22:51:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c62490>
2026-03-26 22:51:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89e6be1e-eb40-5242-8521-e6bba00d5ed3/89e6be1e-eb40-5242-8521-e6bba00d5ed3_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F9b0646f94e534c198e83284e4c3b4b4c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/9b0646f94e534c198e83284e4c3b4b4c/images/large/5.jpg saved to cache
2026-03-26 22:51:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 89e6be1e-eb40-5242-8521-e6bba00d5ed3
2026-03-26 22:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cj%252Fc9c3d343392d4da99d1a06af1e05c92b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cj/c9c3d343392d4da99d1a06af1e05c92b/images/large/6.jpg not downloaded yet
2026-03-26 22:51:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/9b0646f94e534c198e83284e4c3b4b4c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/9b0646f94e534c198e83284e4c3b4b4c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/9b0646f94e534c198e83284e4c3b4b4c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cj%252Fc9c3d343392d4da99d1a06af1e05c92b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cj/c9c3d343392d4da99d1a06af1e05c92b/images/large/7.jpg not downloaded yet
2026-03-26 22:51:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79f8cd0>
2026-03-26 22:51:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89e6be1e-eb40-5242-8521-e6bba00d5ed3/89e6be1e-eb40-5242-8521-e6bba00d5ed3_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F9b0646f94e534c198e83284e4c3b4b4c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/9b0646f94e534c198e83284e4c3b4b4c/images/large/2.jpg saved to cache
2026-03-26 22:51:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 89e6be1e-eb40-5242-8521-e6bba00d5ed3
2026-03-26 22:51:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd0d3210>
2026-03-26 22:51:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89e6be1e-eb40-5242-8521-e6bba00d5ed3/89e6be1e-eb40-5242-8521-e6bba00d5ed3_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F9b0646f94e534c198e83284e4c3b4b4c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/9b0646f94e534c198e83284e4c3b4b4c/images/large/1.jpg saved to cache
2026-03-26 22:51:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 89e6be1e-eb40-5242-8521-e6bba00d5ed3
2026-03-26 22:51:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/9b0646f94e534c198e83284e4c3b4b4c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cj%252Fc9c3d343392d4da99d1a06af1e05c92b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cj/c9c3d343392d4da99d1a06af1e05c92b/images/large/8.jpg not downloaded yet
2026-03-26 22:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cj%252Fc9c3d343392d4da99d1a06af1e05c92b%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cj/c9c3d343392d4da99d1a06af1e05c92b/images/large/9.jpg not downloaded yet
2026-03-26 22:51:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b748a310>
2026-03-26 22:51:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89e6be1e-eb40-5242-8521-e6bba00d5ed3/89e6be1e-eb40-5242-8521-e6bba00d5ed3_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F9b0646f94e534c198e83284e4c3b4b4c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/9b0646f94e534c198e83284e4c3b4b4c/images/large/7.jpg saved to cache
2026-03-26 22:51:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 89e6be1e-eb40-5242-8521-e6bba00d5ed3
2026-03-26 22:51:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cbf850>
2026-03-26 22:51:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89e6be1e-eb40-5242-8521-e6bba00d5ed3/89e6be1e-eb40-5242-8521-e6bba00d5ed3_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F9b0646f94e534c198e83284e4c3b4b4c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/9b0646f94e534c198e83284e4c3b4b4c/images/large/6.jpg saved to cache
2026-03-26 22:51:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 89e6be1e-eb40-5242-8521-e6bba00d5ed3
2026-03-26 22:51:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74dddd0>
2026-03-26 22:51:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89e6be1e-eb40-5242-8521-e6bba00d5ed3/89e6be1e-eb40-5242-8521-e6bba00d5ed3_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F9b0646f94e534c198e83284e4c3b4b4c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/9b0646f94e534c198e83284e4c3b4b4c/images/large/4.jpg saved to cache
2026-03-26 22:51:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 89e6be1e-eb40-5242-8521-e6bba00d5ed3
2026-03-26 22:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cj%252Fc9c3d343392d4da99d1a06af1e05c92b%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cj/c9c3d343392d4da99d1a06af1e05c92b/images/large/10.jpg not downloaded yet
2026-03-26 22:51:23 [ayvens.be] INFO: Found listing with ID: 1985430
2026-03-26 22:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985430%27 HTTP/1.1" 200 None
2026-03-26 22:51:23 [ayvens.be] INFO: Scrape type for 1985430: 1
2026-03-26 22:51:23 [ayvens.be] INFO: Extracting data for car ID: 1985430
2026-03-26 22:51:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 51809147-5da6-5336-96a6-dd315c4bbb21 with identifier: 1985430
2026-03-26 22:51:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 51809147-5da6-5336-96a6-dd315c4bbb21 with scrape type 1
2026-03-26 22:51:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 51809147-5da6-5336-96a6-dd315c4bbb21
2026-03-26 22:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F4d5049df288544cc8c8520c175f5a61d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/4d5049df288544cc8c8520c175f5a61d/images/large/1.jpg not downloaded yet
2026-03-26 22:51:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cj/c9c3d343392d4da99d1a06af1e05c92b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/9b0646f94e534c198e83284e4c3b4b4c/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/9b0646f94e534c198e83284e4c3b4b4c/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F4d5049df288544cc8c8520c175f5a61d%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/4d5049df288544cc8c8520c175f5a61d/images/large/2.jpg not downloaded yet
2026-03-26 22:51:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76ccad0>
2026-03-26 22:51:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89e6be1e-eb40-5242-8521-e6bba00d5ed3/89e6be1e-eb40-5242-8521-e6bba00d5ed3_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F9b0646f94e534c198e83284e4c3b4b4c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/9b0646f94e534c198e83284e4c3b4b4c/images/large/8.jpg saved to cache
2026-03-26 22:51:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 89e6be1e-eb40-5242-8521-e6bba00d5ed3
2026-03-26 22:51:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cj/c9c3d343392d4da99d1a06af1e05c92b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F4d5049df288544cc8c8520c175f5a61d%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/4d5049df288544cc8c8520c175f5a61d/images/large/3.jpg not downloaded yet
2026-03-26 22:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F4d5049df288544cc8c8520c175f5a61d%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/4d5049df288544cc8c8520c175f5a61d/images/large/4.jpg not downloaded yet
2026-03-26 22:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F4d5049df288544cc8c8520c175f5a61d%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/4d5049df288544cc8c8520c175f5a61d/images/large/5.jpg not downloaded yet
2026-03-26 22:51:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cc8850>
2026-03-26 22:51:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d244416-97dd-5dcf-9229-64139a9fcf6e/7d244416-97dd-5dcf-9229-64139a9fcf6e_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cj%252Fc9c3d343392d4da99d1a06af1e05c92b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cj/c9c3d343392d4da99d1a06af1e05c92b/images/large/1.jpg saved to cache
2026-03-26 22:51:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7d244416-97dd-5dcf-9229-64139a9fcf6e
2026-03-26 22:51:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b78c2890>
2026-03-26 22:51:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89e6be1e-eb40-5242-8521-e6bba00d5ed3/89e6be1e-eb40-5242-8521-e6bba00d5ed3_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F9b0646f94e534c198e83284e4c3b4b4c%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/9b0646f94e534c198e83284e4c3b4b4c/images/large/9.jpg saved to cache
2026-03-26 22:51:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 89e6be1e-eb40-5242-8521-e6bba00d5ed3
2026-03-26 22:51:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e10b90>
2026-03-26 22:51:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89e6be1e-eb40-5242-8521-e6bba00d5ed3/89e6be1e-eb40-5242-8521-e6bba00d5ed3_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F9b0646f94e534c198e83284e4c3b4b4c%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/9b0646f94e534c198e83284e4c3b4b4c/images/large/10.jpg saved to cache
2026-03-26 22:51:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 89e6be1e-eb40-5242-8521-e6bba00d5ed3
2026-03-26 22:51:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 89e6be1e-eb40-5242-8521-e6bba00d5ed3, skipping ID generation
2026-03-26 22:51:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89e6be1e-eb40-5242-8521-e6bba00d5ed3 with scrape type 1
2026-03-26 22:51:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 89e6be1e-eb40-5242-8521-e6bba00d5ed3 sending to next pipeline
2026-03-26 22:51:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 89e6be1e-eb40-5242-8521-e6bba00d5ed3, identifier: 1985428
2026-03-26 22:51:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cj/c9c3d343392d4da99d1a06af1e05c92b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cj/c9c3d343392d4da99d1a06af1e05c92b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cj/c9c3d343392d4da99d1a06af1e05c92b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 89e6be1e-eb40-5242-8521-e6bba00d5ed3 with identifier: 1985428
2026-03-26 22:51:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 89e6be1e-eb40-5242-8521-e6bba00d5ed3 with identifier: 1985428
2026-03-26 22:51:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 89e6be1e-eb40-5242-8521-e6bba00d5ed3 with identifier: 1985428 to the API
2026-03-26 22:51:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:51:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:51:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ac/9b0646f94e534c198e83284e4c3b4b4c/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '89e6be1e-eb40-5242-8521-e6bba00d5ed3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLA - Klasse',
 'odometer': 54317,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 24,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89e6be1e-eb40-5242-8521-e6bba00d5ed3/89e6be1e-eb40-5242-8521-e6bba00d5ed3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 703169,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/9b0646f94e534c198e83284e4c3b4b4c/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89e6be1e-eb40-5242-8521-e6bba00d5ed3/89e6be1e-eb40-5242-8521-e6bba00d5ed3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 725921,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/9b0646f94e534c198e83284e4c3b4b4c/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89e6be1e-eb40-5242-8521-e6bba00d5ed3/89e6be1e-eb40-5242-8521-e6bba00d5ed3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 698345,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/9b0646f94e534c198e83284e4c3b4b4c/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89e6be1e-eb40-5242-8521-e6bba00d5ed3/89e6be1e-eb40-5242-8521-e6bba00d5ed3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 714624,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/9b0646f94e534c198e83284e4c3b4b4c/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89e6be1e-eb40-5242-8521-e6bba00d5ed3/89e6be1e-eb40-5242-8521-e6bba00d5ed3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 680482,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/9b0646f94e534c198e83284e4c3b4b4c/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89e6be1e-eb40-5242-8521-e6bba00d5ed3/89e6be1e-eb40-5242-8521-e6bba00d5ed3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 712085,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/9b0646f94e534c198e83284e4c3b4b4c/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89e6be1e-eb40-5242-8521-e6bba00d5ed3/89e6be1e-eb40-5242-8521-e6bba00d5ed3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 629262,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/9b0646f94e534c198e83284e4c3b4b4c/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89e6be1e-eb40-5242-8521-e6bba00d5ed3/89e6be1e-eb40-5242-8521-e6bba00d5ed3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 845066,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/9b0646f94e534c198e83284e4c3b4b4c/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89e6be1e-eb40-5242-8521-e6bba00d5ed3/89e6be1e-eb40-5242-8521-e6bba00d5ed3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 754351,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/9b0646f94e534c198e83284e4c3b4b4c/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89e6be1e-eb40-5242-8521-e6bba00d5ed3/89e6be1e-eb40-5242-8521-e6bba00d5ed3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 766620,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/9b0646f94e534c198e83284e4c3b4b4c/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLA - Klasse 1.3 CLA 250 E DCT SHOOTING BRAKE',
 'transmission': 'automatic',
 'trim': '1.3 CLA 250 E DCT SHOOTING BRAKE',
 'vin': None,
 'year': 2021}
2026-03-26 22:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985428%27 HTTP/1.1" 200 None
2026-03-26 22:51:24 [ayvens.be] INFO: Saving data for 1985428: {'created_time': 1774565484.330691, 'last_price_update_time': 1774565484.330704, 'auction_closing_time': 1774958400.0}
2026-03-26 22:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985428') HTTP/1.1" 204 0
2026-03-26 22:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F4d5049df288544cc8c8520c175f5a61d%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/4d5049df288544cc8c8520c175f5a61d/images/large/6.jpg not downloaded yet
2026-03-26 22:51:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cj/c9c3d343392d4da99d1a06af1e05c92b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F4d5049df288544cc8c8520c175f5a61d%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/4d5049df288544cc8c8520c175f5a61d/images/large/7.jpg not downloaded yet
2026-03-26 22:51:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cb0e10>
2026-03-26 22:51:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d244416-97dd-5dcf-9229-64139a9fcf6e/7d244416-97dd-5dcf-9229-64139a9fcf6e_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cj%252Fc9c3d343392d4da99d1a06af1e05c92b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cj/c9c3d343392d4da99d1a06af1e05c92b/images/large/2.jpg saved to cache
2026-03-26 22:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7d244416-97dd-5dcf-9229-64139a9fcf6e
2026-03-26 22:51:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7407150>
2026-03-26 22:51:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d244416-97dd-5dcf-9229-64139a9fcf6e/7d244416-97dd-5dcf-9229-64139a9fcf6e_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cj%252Fc9c3d343392d4da99d1a06af1e05c92b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cj/c9c3d343392d4da99d1a06af1e05c92b/images/large/5.jpg saved to cache
2026-03-26 22:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7d244416-97dd-5dcf-9229-64139a9fcf6e
2026-03-26 22:51:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6dd8f90>
2026-03-26 22:51:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d244416-97dd-5dcf-9229-64139a9fcf6e/7d244416-97dd-5dcf-9229-64139a9fcf6e_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cj%252Fc9c3d343392d4da99d1a06af1e05c92b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cj/c9c3d343392d4da99d1a06af1e05c92b/images/large/4.jpg saved to cache
2026-03-26 22:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7d244416-97dd-5dcf-9229-64139a9fcf6e
2026-03-26 22:51:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7aa1e50>
2026-03-26 22:51:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d244416-97dd-5dcf-9229-64139a9fcf6e/7d244416-97dd-5dcf-9229-64139a9fcf6e_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cj%252Fc9c3d343392d4da99d1a06af1e05c92b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cj/c9c3d343392d4da99d1a06af1e05c92b/images/large/3.jpg saved to cache
2026-03-26 22:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7d244416-97dd-5dcf-9229-64139a9fcf6e
2026-03-26 22:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F4d5049df288544cc8c8520c175f5a61d%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/4d5049df288544cc8c8520c175f5a61d/images/large/8.jpg not downloaded yet
2026-03-26 22:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F4d5049df288544cc8c8520c175f5a61d%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/4d5049df288544cc8c8520c175f5a61d/images/large/9.jpg not downloaded yet
2026-03-26 22:51:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7aa0790>
2026-03-26 22:51:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d244416-97dd-5dcf-9229-64139a9fcf6e/7d244416-97dd-5dcf-9229-64139a9fcf6e_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cj%252Fc9c3d343392d4da99d1a06af1e05c92b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cj/c9c3d343392d4da99d1a06af1e05c92b/images/large/6.jpg saved to cache
2026-03-26 22:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7d244416-97dd-5dcf-9229-64139a9fcf6e
2026-03-26 22:51:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cj/c9c3d343392d4da99d1a06af1e05c92b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F4d5049df288544cc8c8520c175f5a61d%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/4d5049df288544cc8c8520c175f5a61d/images/large/10.jpg not downloaded yet
2026-03-26 22:51:24 [ayvens.be] INFO: Found listing with ID: 1985431
2026-03-26 22:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985431%27 HTTP/1.1" 200 None
2026-03-26 22:51:24 [ayvens.be] INFO: Scrape type for 1985431: 1
2026-03-26 22:51:24 [ayvens.be] INFO: Extracting data for car ID: 1985431
2026-03-26 22:51:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 110543a2-946b-58b5-a399-47a2e5bd84a4 with identifier: 1985431
2026-03-26 22:51:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 110543a2-946b-58b5-a399-47a2e5bd84a4 with scrape type 1
2026-03-26 22:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 110543a2-946b-58b5-a399-47a2e5bd84a4
2026-03-26 22:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F7414178dbd3443d4b7055118b16125f1%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/7414178dbd3443d4b7055118b16125f1/images/large/1.jpg not downloaded yet
2026-03-26 22:51:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cj/c9c3d343392d4da99d1a06af1e05c92b/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cj/c9c3d343392d4da99d1a06af1e05c92b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cj/c9c3d343392d4da99d1a06af1e05c92b/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F7414178dbd3443d4b7055118b16125f1%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/7414178dbd3443d4b7055118b16125f1/images/large/2.jpg not downloaded yet
2026-03-26 22:51:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/4d5049df288544cc8c8520c175f5a61d/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/4d5049df288544cc8c8520c175f5a61d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/4d5049df288544cc8c8520c175f5a61d/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F7414178dbd3443d4b7055118b16125f1%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/7414178dbd3443d4b7055118b16125f1/images/large/3.jpg not downloaded yet
2026-03-26 22:51:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/4d5049df288544cc8c8520c175f5a61d/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F7414178dbd3443d4b7055118b16125f1%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/7414178dbd3443d4b7055118b16125f1/images/large/4.jpg not downloaded yet
2026-03-26 22:51:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b78c0410>
2026-03-26 22:51:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d244416-97dd-5dcf-9229-64139a9fcf6e/7d244416-97dd-5dcf-9229-64139a9fcf6e_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cj%252Fc9c3d343392d4da99d1a06af1e05c92b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cj/c9c3d343392d4da99d1a06af1e05c92b/images/large/7.jpg saved to cache
2026-03-26 22:51:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7d244416-97dd-5dcf-9229-64139a9fcf6e
2026-03-26 22:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F7414178dbd3443d4b7055118b16125f1%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/7414178dbd3443d4b7055118b16125f1/images/large/5.jpg not downloaded yet
2026-03-26 22:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F7414178dbd3443d4b7055118b16125f1%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/7414178dbd3443d4b7055118b16125f1/images/large/6.jpg not downloaded yet
2026-03-26 22:51:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/7414178dbd3443d4b7055118b16125f1/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F7414178dbd3443d4b7055118b16125f1%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/7414178dbd3443d4b7055118b16125f1/images/large/7.jpg not downloaded yet
2026-03-26 22:51:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e454d0>
2026-03-26 22:51:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d244416-97dd-5dcf-9229-64139a9fcf6e/7d244416-97dd-5dcf-9229-64139a9fcf6e_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cj%252Fc9c3d343392d4da99d1a06af1e05c92b%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cj/c9c3d343392d4da99d1a06af1e05c92b/images/large/9.jpg saved to cache
2026-03-26 22:51:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7d244416-97dd-5dcf-9229-64139a9fcf6e
2026-03-26 22:51:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7482b90>
2026-03-26 22:51:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d244416-97dd-5dcf-9229-64139a9fcf6e/7d244416-97dd-5dcf-9229-64139a9fcf6e_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cj%252Fc9c3d343392d4da99d1a06af1e05c92b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cj/c9c3d343392d4da99d1a06af1e05c92b/images/large/8.jpg saved to cache
2026-03-26 22:51:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7d244416-97dd-5dcf-9229-64139a9fcf6e
2026-03-26 22:51:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74fbbd0>
2026-03-26 22:51:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d244416-97dd-5dcf-9229-64139a9fcf6e/7d244416-97dd-5dcf-9229-64139a9fcf6e_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cj%252Fc9c3d343392d4da99d1a06af1e05c92b%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cj/c9c3d343392d4da99d1a06af1e05c92b/images/large/10.jpg saved to cache
2026-03-26 22:51:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7d244416-97dd-5dcf-9229-64139a9fcf6e
2026-03-26 22:51:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7d244416-97dd-5dcf-9229-64139a9fcf6e, skipping ID generation
2026-03-26 22:51:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d244416-97dd-5dcf-9229-64139a9fcf6e with scrape type 1
2026-03-26 22:51:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7d244416-97dd-5dcf-9229-64139a9fcf6e sending to next pipeline
2026-03-26 22:51:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 7d244416-97dd-5dcf-9229-64139a9fcf6e, identifier: 1985429
2026-03-26 22:51:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b72ef690>
2026-03-26 22:51:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51809147-5da6-5336-96a6-dd315c4bbb21/51809147-5da6-5336-96a6-dd315c4bbb21_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F4d5049df288544cc8c8520c175f5a61d%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/4d5049df288544cc8c8520c175f5a61d/images/large/2.jpg saved to cache
2026-03-26 22:51:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 51809147-5da6-5336-96a6-dd315c4bbb21
2026-03-26 22:51:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7587a50>
2026-03-26 22:51:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51809147-5da6-5336-96a6-dd315c4bbb21/51809147-5da6-5336-96a6-dd315c4bbb21_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F4d5049df288544cc8c8520c175f5a61d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/4d5049df288544cc8c8520c175f5a61d/images/large/1.jpg saved to cache
2026-03-26 22:51:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 51809147-5da6-5336-96a6-dd315c4bbb21
2026-03-26 22:51:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7744550>
2026-03-26 22:51:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51809147-5da6-5336-96a6-dd315c4bbb21/51809147-5da6-5336-96a6-dd315c4bbb21_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F4d5049df288544cc8c8520c175f5a61d%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/4d5049df288544cc8c8520c175f5a61d/images/large/3.jpg saved to cache
2026-03-26 22:51:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 51809147-5da6-5336-96a6-dd315c4bbb21
2026-03-26 22:51:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7a60e10>
2026-03-26 22:51:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51809147-5da6-5336-96a6-dd315c4bbb21/51809147-5da6-5336-96a6-dd315c4bbb21_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F4d5049df288544cc8c8520c175f5a61d%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/4d5049df288544cc8c8520c175f5a61d/images/large/4.jpg saved to cache
2026-03-26 22:51:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 51809147-5da6-5336-96a6-dd315c4bbb21
2026-03-26 22:51:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 7d244416-97dd-5dcf-9229-64139a9fcf6e with identifier: 1985429
2026-03-26 22:51:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 7d244416-97dd-5dcf-9229-64139a9fcf6e with identifier: 1985429
2026-03-26 22:51:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 7d244416-97dd-5dcf-9229-64139a9fcf6e with identifier: 1985429 to the API
2026-03-26 22:51:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:51:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:51:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cj/c9c3d343392d4da99d1a06af1e05c92b/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '7d244416-97dd-5dcf-9229-64139a9fcf6e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'MINI',
 'model': 'MINI 5 DOOR',
 'odometer': 123903,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d244416-97dd-5dcf-9229-64139a9fcf6e/7d244416-97dd-5dcf-9229-64139a9fcf6e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 746801,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cj/c9c3d343392d4da99d1a06af1e05c92b/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d244416-97dd-5dcf-9229-64139a9fcf6e/7d244416-97dd-5dcf-9229-64139a9fcf6e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 711143,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cj/c9c3d343392d4da99d1a06af1e05c92b/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d244416-97dd-5dcf-9229-64139a9fcf6e/7d244416-97dd-5dcf-9229-64139a9fcf6e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 777040,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cj/c9c3d343392d4da99d1a06af1e05c92b/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d244416-97dd-5dcf-9229-64139a9fcf6e/7d244416-97dd-5dcf-9229-64139a9fcf6e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 783825,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cj/c9c3d343392d4da99d1a06af1e05c92b/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d244416-97dd-5dcf-9229-64139a9fcf6e/7d244416-97dd-5dcf-9229-64139a9fcf6e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 749112,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cj/c9c3d343392d4da99d1a06af1e05c92b/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d244416-97dd-5dcf-9229-64139a9fcf6e/7d244416-97dd-5dcf-9229-64139a9fcf6e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 806988,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cj/c9c3d343392d4da99d1a06af1e05c92b/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d244416-97dd-5dcf-9229-64139a9fcf6e/7d244416-97dd-5dcf-9229-64139a9fcf6e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 647934,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cj/c9c3d343392d4da99d1a06af1e05c92b/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d244416-97dd-5dcf-9229-64139a9fcf6e/7d244416-97dd-5dcf-9229-64139a9fcf6e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 810249,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cj/c9c3d343392d4da99d1a06af1e05c92b/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d244416-97dd-5dcf-9229-64139a9fcf6e/7d244416-97dd-5dcf-9229-64139a9fcf6e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 876669,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cj/c9c3d343392d4da99d1a06af1e05c92b/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d244416-97dd-5dcf-9229-64139a9fcf6e/7d244416-97dd-5dcf-9229-64139a9fcf6e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 796026,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cj/c9c3d343392d4da99d1a06af1e05c92b/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI MINI 5 DOOR 1.5 ONE',
 'transmission': 'manual',
 'trim': '1.5 ONE',
 'vin': None,
 'year': 2022}
2026-03-26 22:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985429%27 HTTP/1.1" 200 None
2026-03-26 22:51:27 [ayvens.be] INFO: Saving data for 1985429: {'created_time': 1774565487.096897, 'last_price_update_time': 1774565487.096906, 'auction_closing_time': 1774958400.0}
2026-03-26 22:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985429') HTTP/1.1" 204 0
2026-03-26 22:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F7414178dbd3443d4b7055118b16125f1%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/7414178dbd3443d4b7055118b16125f1/images/large/8.jpg not downloaded yet
2026-03-26 22:51:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/4d5049df288544cc8c8520c175f5a61d/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/4d5049df288544cc8c8520c175f5a61d/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F7414178dbd3443d4b7055118b16125f1%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/7414178dbd3443d4b7055118b16125f1/images/large/9.jpg not downloaded yet
2026-03-26 22:51:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd3b9810>
2026-03-26 22:51:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_110543a2-946b-58b5-a399-47a2e5bd84a4/110543a2-946b-58b5-a399-47a2e5bd84a4_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F7414178dbd3443d4b7055118b16125f1%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/7414178dbd3443d4b7055118b16125f1/images/large/1.jpg saved to cache
2026-03-26 22:51:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 110543a2-946b-58b5-a399-47a2e5bd84a4
2026-03-26 22:51:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/4d5049df288544cc8c8520c175f5a61d/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/4d5049df288544cc8c8520c175f5a61d/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/4d5049df288544cc8c8520c175f5a61d/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/4d5049df288544cc8c8520c175f5a61d/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F7414178dbd3443d4b7055118b16125f1%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/7414178dbd3443d4b7055118b16125f1/images/large/10.jpg not downloaded yet
2026-03-26 22:51:27 [ayvens.be] INFO: Found listing with ID: 1985432
2026-03-26 22:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985432%27 HTTP/1.1" 200 None
2026-03-26 22:51:27 [ayvens.be] INFO: Scrape type for 1985432: 1
2026-03-26 22:51:27 [ayvens.be] INFO: Extracting data for car ID: 1985432
2026-03-26 22:51:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73d04549-6880-5772-8780-32ea6fc9f9cf with identifier: 1985432
2026-03-26 22:51:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73d04549-6880-5772-8780-32ea6fc9f9cf with scrape type 1
2026-03-26 22:51:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 73d04549-6880-5772-8780-32ea6fc9f9cf
2026-03-26 22:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2as%252Fd57d688e58e04a5aafe0d662d3823757%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2as/d57d688e58e04a5aafe0d662d3823757/images/large/1.jpg not downloaded yet
2026-03-26 22:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2as%252Fd57d688e58e04a5aafe0d662d3823757%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2as/d57d688e58e04a5aafe0d662d3823757/images/large/2.jpg not downloaded yet
2026-03-26 22:51:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74427d0>
2026-03-26 22:51:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51809147-5da6-5336-96a6-dd315c4bbb21/51809147-5da6-5336-96a6-dd315c4bbb21_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F4d5049df288544cc8c8520c175f5a61d%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/4d5049df288544cc8c8520c175f5a61d/images/large/5.jpg saved to cache
2026-03-26 22:51:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 51809147-5da6-5336-96a6-dd315c4bbb21
2026-03-26 22:51:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c6b4d0>
2026-03-26 22:51:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51809147-5da6-5336-96a6-dd315c4bbb21/51809147-5da6-5336-96a6-dd315c4bbb21_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F4d5049df288544cc8c8520c175f5a61d%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/4d5049df288544cc8c8520c175f5a61d/images/large/6.jpg saved to cache
2026-03-26 22:51:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 51809147-5da6-5336-96a6-dd315c4bbb21
2026-03-26 22:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2as%252Fd57d688e58e04a5aafe0d662d3823757%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2as/d57d688e58e04a5aafe0d662d3823757/images/large/3.jpg not downloaded yet
2026-03-26 22:51:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/7414178dbd3443d4b7055118b16125f1/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/7414178dbd3443d4b7055118b16125f1/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/7414178dbd3443d4b7055118b16125f1/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2as%252Fd57d688e58e04a5aafe0d662d3823757%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2as/d57d688e58e04a5aafe0d662d3823757/images/large/4.jpg not downloaded yet
2026-03-26 22:51:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/7414178dbd3443d4b7055118b16125f1/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/7414178dbd3443d4b7055118b16125f1/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/7414178dbd3443d4b7055118b16125f1/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7279ad0>
2026-03-26 22:51:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51809147-5da6-5336-96a6-dd315c4bbb21/51809147-5da6-5336-96a6-dd315c4bbb21_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F4d5049df288544cc8c8520c175f5a61d%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/4d5049df288544cc8c8520c175f5a61d/images/large/9.jpg saved to cache
2026-03-26 22:51:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 51809147-5da6-5336-96a6-dd315c4bbb21
2026-03-26 22:51:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b746d850>
2026-03-26 22:51:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51809147-5da6-5336-96a6-dd315c4bbb21/51809147-5da6-5336-96a6-dd315c4bbb21_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F4d5049df288544cc8c8520c175f5a61d%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/4d5049df288544cc8c8520c175f5a61d/images/large/8.jpg saved to cache
2026-03-26 22:51:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 51809147-5da6-5336-96a6-dd315c4bbb21
2026-03-26 22:51:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c62110>
2026-03-26 22:51:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51809147-5da6-5336-96a6-dd315c4bbb21/51809147-5da6-5336-96a6-dd315c4bbb21_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F4d5049df288544cc8c8520c175f5a61d%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/4d5049df288544cc8c8520c175f5a61d/images/large/7.jpg saved to cache
2026-03-26 22:51:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 51809147-5da6-5336-96a6-dd315c4bbb21
2026-03-26 22:51:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6da5850>
2026-03-26 22:51:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51809147-5da6-5336-96a6-dd315c4bbb21/51809147-5da6-5336-96a6-dd315c4bbb21_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F4d5049df288544cc8c8520c175f5a61d%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/4d5049df288544cc8c8520c175f5a61d/images/large/10.jpg saved to cache
2026-03-26 22:51:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 51809147-5da6-5336-96a6-dd315c4bbb21
2026-03-26 22:51:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 51809147-5da6-5336-96a6-dd315c4bbb21, skipping ID generation
2026-03-26 22:51:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 51809147-5da6-5336-96a6-dd315c4bbb21 with scrape type 1
2026-03-26 22:51:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 51809147-5da6-5336-96a6-dd315c4bbb21 sending to next pipeline
2026-03-26 22:51:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 51809147-5da6-5336-96a6-dd315c4bbb21, identifier: 1985430
2026-03-26 22:51:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/7414178dbd3443d4b7055118b16125f1/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2as%252Fd57d688e58e04a5aafe0d662d3823757%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2as/d57d688e58e04a5aafe0d662d3823757/images/large/5.jpg not downloaded yet
2026-03-26 22:51:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 51809147-5da6-5336-96a6-dd315c4bbb21 with identifier: 1985430
2026-03-26 22:51:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 51809147-5da6-5336-96a6-dd315c4bbb21 with identifier: 1985430
2026-03-26 22:51:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 51809147-5da6-5336-96a6-dd315c4bbb21 with identifier: 1985430 to the API
2026-03-26 22:51:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:51:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:51:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bm/4d5049df288544cc8c8520c175f5a61d/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '51809147-5da6-5336-96a6-dd315c4bbb21',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLASS A (W177)',
 'odometer': 157535,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51809147-5da6-5336-96a6-dd315c4bbb21/51809147-5da6-5336-96a6-dd315c4bbb21_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 555271,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/4d5049df288544cc8c8520c175f5a61d/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51809147-5da6-5336-96a6-dd315c4bbb21/51809147-5da6-5336-96a6-dd315c4bbb21_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 547703,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/4d5049df288544cc8c8520c175f5a61d/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51809147-5da6-5336-96a6-dd315c4bbb21/51809147-5da6-5336-96a6-dd315c4bbb21_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 626582,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/4d5049df288544cc8c8520c175f5a61d/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51809147-5da6-5336-96a6-dd315c4bbb21/51809147-5da6-5336-96a6-dd315c4bbb21_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 666318,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/4d5049df288544cc8c8520c175f5a61d/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51809147-5da6-5336-96a6-dd315c4bbb21/51809147-5da6-5336-96a6-dd315c4bbb21_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 616504,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/4d5049df288544cc8c8520c175f5a61d/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51809147-5da6-5336-96a6-dd315c4bbb21/51809147-5da6-5336-96a6-dd315c4bbb21_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 567027,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/4d5049df288544cc8c8520c175f5a61d/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51809147-5da6-5336-96a6-dd315c4bbb21/51809147-5da6-5336-96a6-dd315c4bbb21_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 655652,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/4d5049df288544cc8c8520c175f5a61d/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51809147-5da6-5336-96a6-dd315c4bbb21/51809147-5da6-5336-96a6-dd315c4bbb21_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 676795,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/4d5049df288544cc8c8520c175f5a61d/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51809147-5da6-5336-96a6-dd315c4bbb21/51809147-5da6-5336-96a6-dd315c4bbb21_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 694034,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/4d5049df288544cc8c8520c175f5a61d/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51809147-5da6-5336-96a6-dd315c4bbb21/51809147-5da6-5336-96a6-dd315c4bbb21_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 625038,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/4d5049df288544cc8c8520c175f5a61d/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLASS A (W177) A 250 e PHEV Business Solution',
 'transmission': 'automatic',
 'trim': 'A 250 e PHEV Business Solution',
 'vin': None,
 'year': 2022}
2026-03-26 22:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985430%27 HTTP/1.1" 200 None
2026-03-26 22:51:28 [ayvens.be] INFO: Saving data for 1985430: {'created_time': 1774565488.329769, 'last_price_update_time': 1774565488.329778, 'auction_closing_time': 1774958400.0}
2026-03-26 22:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985430') HTTP/1.1" 204 0
2026-03-26 22:51:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/7414178dbd3443d4b7055118b16125f1/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2as%252Fd57d688e58e04a5aafe0d662d3823757%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2as/d57d688e58e04a5aafe0d662d3823757/images/large/6.jpg not downloaded yet
2026-03-26 22:51:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79ce1d0>
2026-03-26 22:51:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_110543a2-946b-58b5-a399-47a2e5bd84a4/110543a2-946b-58b5-a399-47a2e5bd84a4_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F7414178dbd3443d4b7055118b16125f1%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/7414178dbd3443d4b7055118b16125f1/images/large/4.jpg saved to cache
2026-03-26 22:51:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 110543a2-946b-58b5-a399-47a2e5bd84a4
2026-03-26 22:51:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7438f90>
2026-03-26 22:51:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_110543a2-946b-58b5-a399-47a2e5bd84a4/110543a2-946b-58b5-a399-47a2e5bd84a4_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F7414178dbd3443d4b7055118b16125f1%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/7414178dbd3443d4b7055118b16125f1/images/large/5.jpg saved to cache
2026-03-26 22:51:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 110543a2-946b-58b5-a399-47a2e5bd84a4
2026-03-26 22:51:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7416ed0>
2026-03-26 22:51:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_110543a2-946b-58b5-a399-47a2e5bd84a4/110543a2-946b-58b5-a399-47a2e5bd84a4_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F7414178dbd3443d4b7055118b16125f1%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/7414178dbd3443d4b7055118b16125f1/images/large/6.jpg saved to cache
2026-03-26 22:51:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 110543a2-946b-58b5-a399-47a2e5bd84a4
2026-03-26 22:51:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79f1fd0>
2026-03-26 22:51:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_110543a2-946b-58b5-a399-47a2e5bd84a4/110543a2-946b-58b5-a399-47a2e5bd84a4_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F7414178dbd3443d4b7055118b16125f1%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/7414178dbd3443d4b7055118b16125f1/images/large/7.jpg saved to cache
2026-03-26 22:51:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 110543a2-946b-58b5-a399-47a2e5bd84a4
2026-03-26 22:51:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7414450>
2026-03-26 22:51:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_110543a2-946b-58b5-a399-47a2e5bd84a4/110543a2-946b-58b5-a399-47a2e5bd84a4_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F7414178dbd3443d4b7055118b16125f1%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/7414178dbd3443d4b7055118b16125f1/images/large/3.jpg saved to cache
2026-03-26 22:51:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 110543a2-946b-58b5-a399-47a2e5bd84a4
2026-03-26 22:51:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7489890>
2026-03-26 22:51:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_110543a2-946b-58b5-a399-47a2e5bd84a4/110543a2-946b-58b5-a399-47a2e5bd84a4_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F7414178dbd3443d4b7055118b16125f1%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/7414178dbd3443d4b7055118b16125f1/images/large/2.jpg saved to cache
2026-03-26 22:51:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 110543a2-946b-58b5-a399-47a2e5bd84a4
2026-03-26 22:51:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7417290>
2026-03-26 22:51:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_110543a2-946b-58b5-a399-47a2e5bd84a4/110543a2-946b-58b5-a399-47a2e5bd84a4_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F7414178dbd3443d4b7055118b16125f1%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/7414178dbd3443d4b7055118b16125f1/images/large/8.jpg saved to cache
2026-03-26 22:51:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 110543a2-946b-58b5-a399-47a2e5bd84a4
2026-03-26 22:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2as%252Fd57d688e58e04a5aafe0d662d3823757%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2as/d57d688e58e04a5aafe0d662d3823757/images/large/7.jpg not downloaded yet
2026-03-26 22:51:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/7414178dbd3443d4b7055118b16125f1/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2as/d57d688e58e04a5aafe0d662d3823757/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2as/d57d688e58e04a5aafe0d662d3823757/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2as%252Fd57d688e58e04a5aafe0d662d3823757%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2as/d57d688e58e04a5aafe0d662d3823757/images/large/8.jpg not downloaded yet
2026-03-26 22:51:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6dd80d0>
2026-03-26 22:51:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_110543a2-946b-58b5-a399-47a2e5bd84a4/110543a2-946b-58b5-a399-47a2e5bd84a4_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F7414178dbd3443d4b7055118b16125f1%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/7414178dbd3443d4b7055118b16125f1/images/large/9.jpg saved to cache
2026-03-26 22:51:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 110543a2-946b-58b5-a399-47a2e5bd84a4
2026-03-26 22:51:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2as/d57d688e58e04a5aafe0d662d3823757/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2as/d57d688e58e04a5aafe0d662d3823757/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2as%252Fd57d688e58e04a5aafe0d662d3823757%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2as/d57d688e58e04a5aafe0d662d3823757/images/large/9.jpg not downloaded yet
2026-03-26 22:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2as%252Fd57d688e58e04a5aafe0d662d3823757%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2as/d57d688e58e04a5aafe0d662d3823757/images/large/10.jpg not downloaded yet
2026-03-26 22:51:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5ccbb10>
2026-03-26 22:51:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_110543a2-946b-58b5-a399-47a2e5bd84a4/110543a2-946b-58b5-a399-47a2e5bd84a4_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F7414178dbd3443d4b7055118b16125f1%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/7414178dbd3443d4b7055118b16125f1/images/large/10.jpg saved to cache
2026-03-26 22:51:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 110543a2-946b-58b5-a399-47a2e5bd84a4
2026-03-26 22:51:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 110543a2-946b-58b5-a399-47a2e5bd84a4, skipping ID generation
2026-03-26 22:51:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 110543a2-946b-58b5-a399-47a2e5bd84a4 with scrape type 1
2026-03-26 22:51:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 110543a2-946b-58b5-a399-47a2e5bd84a4 sending to next pipeline
2026-03-26 22:51:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 110543a2-946b-58b5-a399-47a2e5bd84a4, identifier: 1985431
2026-03-26 22:51:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd496f10>
2026-03-26 22:51:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73d04549-6880-5772-8780-32ea6fc9f9cf/73d04549-6880-5772-8780-32ea6fc9f9cf_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2as%252Fd57d688e58e04a5aafe0d662d3823757%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2as/d57d688e58e04a5aafe0d662d3823757/images/large/1.jpg saved to cache
2026-03-26 22:51:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 73d04549-6880-5772-8780-32ea6fc9f9cf
2026-03-26 22:51:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79241d0>
2026-03-26 22:51:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73d04549-6880-5772-8780-32ea6fc9f9cf/73d04549-6880-5772-8780-32ea6fc9f9cf_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2as%252Fd57d688e58e04a5aafe0d662d3823757%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2as/d57d688e58e04a5aafe0d662d3823757/images/large/2.jpg saved to cache
2026-03-26 22:51:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 73d04549-6880-5772-8780-32ea6fc9f9cf
2026-03-26 22:51:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 110543a2-946b-58b5-a399-47a2e5bd84a4 with identifier: 1985431
2026-03-26 22:51:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 110543a2-946b-58b5-a399-47a2e5bd84a4 with identifier: 1985431
2026-03-26 22:51:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 110543a2-946b-58b5-a399-47a2e5bd84a4 with identifier: 1985431 to the API
2026-03-26 22:51:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:51:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:51:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yl/7414178dbd3443d4b7055118b16125f1/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '110543a2-946b-58b5-a399-47a2e5bd84a4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X2',
 'odometer': 135124,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_110543a2-946b-58b5-a399-47a2e5bd84a4/110543a2-946b-58b5-a399-47a2e5bd84a4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 259026,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/7414178dbd3443d4b7055118b16125f1/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_110543a2-946b-58b5-a399-47a2e5bd84a4/110543a2-946b-58b5-a399-47a2e5bd84a4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 251292,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/7414178dbd3443d4b7055118b16125f1/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_110543a2-946b-58b5-a399-47a2e5bd84a4/110543a2-946b-58b5-a399-47a2e5bd84a4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 248533,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/7414178dbd3443d4b7055118b16125f1/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_110543a2-946b-58b5-a399-47a2e5bd84a4/110543a2-946b-58b5-a399-47a2e5bd84a4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 264616,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/7414178dbd3443d4b7055118b16125f1/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_110543a2-946b-58b5-a399-47a2e5bd84a4/110543a2-946b-58b5-a399-47a2e5bd84a4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 322942,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/7414178dbd3443d4b7055118b16125f1/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_110543a2-946b-58b5-a399-47a2e5bd84a4/110543a2-946b-58b5-a399-47a2e5bd84a4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 295244,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/7414178dbd3443d4b7055118b16125f1/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_110543a2-946b-58b5-a399-47a2e5bd84a4/110543a2-946b-58b5-a399-47a2e5bd84a4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 350648,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/7414178dbd3443d4b7055118b16125f1/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_110543a2-946b-58b5-a399-47a2e5bd84a4/110543a2-946b-58b5-a399-47a2e5bd84a4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 344194,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/7414178dbd3443d4b7055118b16125f1/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_110543a2-946b-58b5-a399-47a2e5bd84a4/110543a2-946b-58b5-a399-47a2e5bd84a4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 344362,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/7414178dbd3443d4b7055118b16125f1/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_110543a2-946b-58b5-a399-47a2e5bd84a4/110543a2-946b-58b5-a399-47a2e5bd84a4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 317003,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/7414178dbd3443d4b7055118b16125f1/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X2 1.5iA xDrive25e PHEV OPF',
 'transmission': 'automatic',
 'trim': '1.5iA xDrive25e PHEV OPF',
 'vin': None,
 'year': 2020}
2026-03-26 22:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985431%27 HTTP/1.1" 200 None
2026-03-26 22:51:29 [ayvens.be] INFO: Saving data for 1985431: {'created_time': 1774565489.580258, 'last_price_update_time': 1774565489.580268, 'auction_closing_time': 1774958400.0}
2026-03-26 22:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985431') HTTP/1.1" 204 0
2026-03-26 22:51:29 [ayvens.be] INFO: Found listing with ID: 1985433
2026-03-26 22:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985433%27 HTTP/1.1" 200 None
2026-03-26 22:51:29 [ayvens.be] INFO: Scrape type for 1985433: 1
2026-03-26 22:51:29 [ayvens.be] INFO: Extracting data for car ID: 1985433
2026-03-26 22:51:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac91607f-a69f-52f7-9c65-c869b70c8f00 with identifier: 1985433
2026-03-26 22:51:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac91607f-a69f-52f7-9c65-c869b70c8f00 with scrape type 1
2026-03-26 22:51:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ac91607f-a69f-52f7-9c65-c869b70c8f00
2026-03-26 22:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fb1364b95203b4a68b99701d99771961a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/b1364b95203b4a68b99701d99771961a/images/large/1.jpg not downloaded yet
2026-03-26 22:51:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c80250>
2026-03-26 22:51:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73d04549-6880-5772-8780-32ea6fc9f9cf/73d04549-6880-5772-8780-32ea6fc9f9cf_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2as%252Fd57d688e58e04a5aafe0d662d3823757%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2as/d57d688e58e04a5aafe0d662d3823757/images/large/3.jpg saved to cache
2026-03-26 22:51:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 73d04549-6880-5772-8780-32ea6fc9f9cf
2026-03-26 22:51:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7aa1e90>
2026-03-26 22:51:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73d04549-6880-5772-8780-32ea6fc9f9cf/73d04549-6880-5772-8780-32ea6fc9f9cf_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2as%252Fd57d688e58e04a5aafe0d662d3823757%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2as/d57d688e58e04a5aafe0d662d3823757/images/large/4.jpg saved to cache
2026-03-26 22:51:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 73d04549-6880-5772-8780-32ea6fc9f9cf
2026-03-26 22:51:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2as/d57d688e58e04a5aafe0d662d3823757/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fb1364b95203b4a68b99701d99771961a%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/b1364b95203b4a68b99701d99771961a/images/large/2.jpg not downloaded yet
2026-03-26 22:51:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2as/d57d688e58e04a5aafe0d662d3823757/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2as/d57d688e58e04a5aafe0d662d3823757/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fb1364b95203b4a68b99701d99771961a%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/b1364b95203b4a68b99701d99771961a/images/large/3.jpg not downloaded yet
2026-03-26 22:51:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2as/d57d688e58e04a5aafe0d662d3823757/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fb1364b95203b4a68b99701d99771961a%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/b1364b95203b4a68b99701d99771961a/images/large/4.jpg not downloaded yet
2026-03-26 22:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fb1364b95203b4a68b99701d99771961a%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/b1364b95203b4a68b99701d99771961a/images/large/5.jpg not downloaded yet
2026-03-26 22:51:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2as/d57d688e58e04a5aafe0d662d3823757/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fb1364b95203b4a68b99701d99771961a%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/b1364b95203b4a68b99701d99771961a/images/large/6.jpg not downloaded yet
2026-03-26 22:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fb1364b95203b4a68b99701d99771961a%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/b1364b95203b4a68b99701d99771961a/images/large/7.jpg not downloaded yet
2026-03-26 22:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fb1364b95203b4a68b99701d99771961a%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/b1364b95203b4a68b99701d99771961a/images/large/8.jpg not downloaded yet
2026-03-26 22:51:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7913bd0>
2026-03-26 22:51:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73d04549-6880-5772-8780-32ea6fc9f9cf/73d04549-6880-5772-8780-32ea6fc9f9cf_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2as%252Fd57d688e58e04a5aafe0d662d3823757%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2as/d57d688e58e04a5aafe0d662d3823757/images/large/6.jpg saved to cache
2026-03-26 22:51:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 73d04549-6880-5772-8780-32ea6fc9f9cf
2026-03-26 22:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fb1364b95203b4a68b99701d99771961a%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/b1364b95203b4a68b99701d99771961a/images/large/9.jpg not downloaded yet
2026-03-26 22:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fb1364b95203b4a68b99701d99771961a%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/b1364b95203b4a68b99701d99771961a/images/large/10.jpg not downloaded yet
2026-03-26 22:51:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7819690>
2026-03-26 22:51:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73d04549-6880-5772-8780-32ea6fc9f9cf/73d04549-6880-5772-8780-32ea6fc9f9cf_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2as%252Fd57d688e58e04a5aafe0d662d3823757%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2as/d57d688e58e04a5aafe0d662d3823757/images/large/7.jpg saved to cache
2026-03-26 22:51:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 73d04549-6880-5772-8780-32ea6fc9f9cf
2026-03-26 22:51:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77bd810>
2026-03-26 22:51:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73d04549-6880-5772-8780-32ea6fc9f9cf/73d04549-6880-5772-8780-32ea6fc9f9cf_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2as%252Fd57d688e58e04a5aafe0d662d3823757%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2as/d57d688e58e04a5aafe0d662d3823757/images/large/5.jpg saved to cache
2026-03-26 22:51:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 73d04549-6880-5772-8780-32ea6fc9f9cf
2026-03-26 22:51:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7ce8590>
2026-03-26 22:51:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73d04549-6880-5772-8780-32ea6fc9f9cf/73d04549-6880-5772-8780-32ea6fc9f9cf_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2as%252Fd57d688e58e04a5aafe0d662d3823757%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2as/d57d688e58e04a5aafe0d662d3823757/images/large/8.jpg saved to cache
2026-03-26 22:51:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 73d04549-6880-5772-8780-32ea6fc9f9cf
2026-03-26 22:51:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2as/d57d688e58e04a5aafe0d662d3823757/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:30 [ayvens.be] INFO: Found listing with ID: 1985434
2026-03-26 22:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985434%27 HTTP/1.1" 200 None
2026-03-26 22:51:30 [ayvens.be] INFO: Scrape type for 1985434: 1
2026-03-26 22:51:30 [ayvens.be] INFO: Extracting data for car ID: 1985434
2026-03-26 22:51:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0238b4ff-f3fd-56fb-b2ff-97a7b2555e89 with identifier: 1985434
2026-03-26 22:51:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0238b4ff-f3fd-56fb-b2ff-97a7b2555e89 with scrape type 1
2026-03-26 22:51:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0238b4ff-f3fd-56fb-b2ff-97a7b2555e89
2026-03-26 22:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0f70f1ec777b449daaccff6999a7980c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0f70f1ec777b449daaccff6999a7980c/images/large/1.jpg not downloaded yet
2026-03-26 22:51:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd48eb50>
2026-03-26 22:51:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73d04549-6880-5772-8780-32ea6fc9f9cf/73d04549-6880-5772-8780-32ea6fc9f9cf_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2as%252Fd57d688e58e04a5aafe0d662d3823757%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2as/d57d688e58e04a5aafe0d662d3823757/images/large/9.jpg saved to cache
2026-03-26 22:51:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 73d04549-6880-5772-8780-32ea6fc9f9cf
2026-03-26 22:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0f70f1ec777b449daaccff6999a7980c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0f70f1ec777b449daaccff6999a7980c/images/large/2.jpg not downloaded yet
2026-03-26 22:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0f70f1ec777b449daaccff6999a7980c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0f70f1ec777b449daaccff6999a7980c/images/large/3.jpg not downloaded yet
2026-03-26 22:51:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd0d3e90>
2026-03-26 22:51:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73d04549-6880-5772-8780-32ea6fc9f9cf/73d04549-6880-5772-8780-32ea6fc9f9cf_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2as%252Fd57d688e58e04a5aafe0d662d3823757%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2as/d57d688e58e04a5aafe0d662d3823757/images/large/10.jpg saved to cache
2026-03-26 22:51:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 73d04549-6880-5772-8780-32ea6fc9f9cf
2026-03-26 22:51:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 73d04549-6880-5772-8780-32ea6fc9f9cf, skipping ID generation
2026-03-26 22:51:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73d04549-6880-5772-8780-32ea6fc9f9cf with scrape type 1
2026-03-26 22:51:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 73d04549-6880-5772-8780-32ea6fc9f9cf sending to next pipeline
2026-03-26 22:51:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 73d04549-6880-5772-8780-32ea6fc9f9cf, identifier: 1985432
2026-03-26 22:51:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/b1364b95203b4a68b99701d99771961a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/b1364b95203b4a68b99701d99771961a/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/b1364b95203b4a68b99701d99771961a/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 73d04549-6880-5772-8780-32ea6fc9f9cf with identifier: 1985432
2026-03-26 22:51:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 73d04549-6880-5772-8780-32ea6fc9f9cf with identifier: 1985432
2026-03-26 22:51:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 73d04549-6880-5772-8780-32ea6fc9f9cf with identifier: 1985432 to the API
2026-03-26 22:51:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:51:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:51:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2as/d57d688e58e04a5aafe0d662d3823757/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 98,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '73d04549-6880-5772-8780-32ea6fc9f9cf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '508 SW',
 'odometer': 140777,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73d04549-6880-5772-8780-32ea6fc9f9cf/73d04549-6880-5772-8780-32ea6fc9f9cf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 258763,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2as/d57d688e58e04a5aafe0d662d3823757/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73d04549-6880-5772-8780-32ea6fc9f9cf/73d04549-6880-5772-8780-32ea6fc9f9cf_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 258181,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2as/d57d688e58e04a5aafe0d662d3823757/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73d04549-6880-5772-8780-32ea6fc9f9cf/73d04549-6880-5772-8780-32ea6fc9f9cf_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 236340,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2as/d57d688e58e04a5aafe0d662d3823757/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73d04549-6880-5772-8780-32ea6fc9f9cf/73d04549-6880-5772-8780-32ea6fc9f9cf_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 238948,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2as/d57d688e58e04a5aafe0d662d3823757/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73d04549-6880-5772-8780-32ea6fc9f9cf/73d04549-6880-5772-8780-32ea6fc9f9cf_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 277152,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2as/d57d688e58e04a5aafe0d662d3823757/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73d04549-6880-5772-8780-32ea6fc9f9cf/73d04549-6880-5772-8780-32ea6fc9f9cf_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 250370,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2as/d57d688e58e04a5aafe0d662d3823757/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73d04549-6880-5772-8780-32ea6fc9f9cf/73d04549-6880-5772-8780-32ea6fc9f9cf_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 282571,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2as/d57d688e58e04a5aafe0d662d3823757/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73d04549-6880-5772-8780-32ea6fc9f9cf/73d04549-6880-5772-8780-32ea6fc9f9cf_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 333226,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2as/d57d688e58e04a5aafe0d662d3823757/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73d04549-6880-5772-8780-32ea6fc9f9cf/73d04549-6880-5772-8780-32ea6fc9f9cf_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 323954,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2as/d57d688e58e04a5aafe0d662d3823757/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73d04549-6880-5772-8780-32ea6fc9f9cf/73d04549-6880-5772-8780-32ea6fc9f9cf_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 314437,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2as/d57d688e58e04a5aafe0d662d3823757/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 508 SW 1.5 BLUEHDI 130 S&S AUTO ALLURE',
 'transmission': 'automatic',
 'trim': '1.5 BLUEHDI 130 S&S AUTO ALLURE',
 'vin': None,
 'year': 2021}
2026-03-26 22:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985432%27 HTTP/1.1" 200 None
2026-03-26 22:51:30 [ayvens.be] INFO: Saving data for 1985432: {'created_time': 1774565490.852419, 'last_price_update_time': 1774565490.852431, 'auction_closing_time': 1774958400.0}
2026-03-26 22:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985432') HTTP/1.1" 204 0
2026-03-26 22:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0f70f1ec777b449daaccff6999a7980c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0f70f1ec777b449daaccff6999a7980c/images/large/4.jpg not downloaded yet
2026-03-26 22:51:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/b1364b95203b4a68b99701d99771961a/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/b1364b95203b4a68b99701d99771961a/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/b1364b95203b4a68b99701d99771961a/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0f70f1ec777b449daaccff6999a7980c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0f70f1ec777b449daaccff6999a7980c/images/large/5.jpg not downloaded yet
2026-03-26 22:51:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7a62e90>
2026-03-26 22:51:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac91607f-a69f-52f7-9c65-c869b70c8f00/ac91607f-a69f-52f7-9c65-c869b70c8f00_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fb1364b95203b4a68b99701d99771961a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/b1364b95203b4a68b99701d99771961a/images/large/1.jpg saved to cache
2026-03-26 22:51:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ac91607f-a69f-52f7-9c65-c869b70c8f00
2026-03-26 22:51:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7480950>
2026-03-26 22:51:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac91607f-a69f-52f7-9c65-c869b70c8f00/ac91607f-a69f-52f7-9c65-c869b70c8f00_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fb1364b95203b4a68b99701d99771961a%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/b1364b95203b4a68b99701d99771961a/images/large/6.jpg saved to cache
2026-03-26 22:51:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ac91607f-a69f-52f7-9c65-c869b70c8f00
2026-03-26 22:51:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b728dd50>
2026-03-26 22:51:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac91607f-a69f-52f7-9c65-c869b70c8f00/ac91607f-a69f-52f7-9c65-c869b70c8f00_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fb1364b95203b4a68b99701d99771961a%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/b1364b95203b4a68b99701d99771961a/images/large/5.jpg saved to cache
2026-03-26 22:51:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ac91607f-a69f-52f7-9c65-c869b70c8f00
2026-03-26 22:51:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/b1364b95203b4a68b99701d99771961a/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0f70f1ec777b449daaccff6999a7980c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0f70f1ec777b449daaccff6999a7980c/images/large/6.jpg not downloaded yet
2026-03-26 22:51:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b727e450>
2026-03-26 22:51:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac91607f-a69f-52f7-9c65-c869b70c8f00/ac91607f-a69f-52f7-9c65-c869b70c8f00_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fb1364b95203b4a68b99701d99771961a%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/b1364b95203b4a68b99701d99771961a/images/large/2.jpg saved to cache
2026-03-26 22:51:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ac91607f-a69f-52f7-9c65-c869b70c8f00
2026-03-26 22:51:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7724b50>
2026-03-26 22:51:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac91607f-a69f-52f7-9c65-c869b70c8f00/ac91607f-a69f-52f7-9c65-c869b70c8f00_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fb1364b95203b4a68b99701d99771961a%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/b1364b95203b4a68b99701d99771961a/images/large/3.jpg saved to cache
2026-03-26 22:51:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ac91607f-a69f-52f7-9c65-c869b70c8f00
2026-03-26 22:51:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7402b50>
2026-03-26 22:51:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac91607f-a69f-52f7-9c65-c869b70c8f00/ac91607f-a69f-52f7-9c65-c869b70c8f00_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fb1364b95203b4a68b99701d99771961a%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/b1364b95203b4a68b99701d99771961a/images/large/4.jpg saved to cache
2026-03-26 22:51:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ac91607f-a69f-52f7-9c65-c869b70c8f00
2026-03-26 22:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0f70f1ec777b449daaccff6999a7980c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0f70f1ec777b449daaccff6999a7980c/images/large/7.jpg not downloaded yet
2026-03-26 22:51:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/b1364b95203b4a68b99701d99771961a/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0f70f1ec777b449daaccff6999a7980c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0f70f1ec777b449daaccff6999a7980c/images/large/8.jpg not downloaded yet
2026-03-26 22:51:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b741f6d0>
2026-03-26 22:51:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac91607f-a69f-52f7-9c65-c869b70c8f00/ac91607f-a69f-52f7-9c65-c869b70c8f00_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fb1364b95203b4a68b99701d99771961a%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/b1364b95203b4a68b99701d99771961a/images/large/7.jpg saved to cache
2026-03-26 22:51:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ac91607f-a69f-52f7-9c65-c869b70c8f00
2026-03-26 22:51:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/b1364b95203b4a68b99701d99771961a/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/b1364b95203b4a68b99701d99771961a/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0f70f1ec777b449daaccff6999a7980c%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0f70f1ec777b449daaccff6999a7980c/images/large/9.jpg not downloaded yet
2026-03-26 22:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0f70f1ec777b449daaccff6999a7980c%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0f70f1ec777b449daaccff6999a7980c/images/large/10.jpg not downloaded yet
2026-03-26 22:51:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/0f70f1ec777b449daaccff6999a7980c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:31 [ayvens.be] INFO: Found listing with ID: 1985435
2026-03-26 22:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985435%27 HTTP/1.1" 200 None
2026-03-26 22:51:31 [ayvens.be] INFO: Scrape type for 1985435: 1
2026-03-26 22:51:31 [ayvens.be] INFO: Extracting data for car ID: 1985435
2026-03-26 22:51:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 340005c8-2f01-5331-9c8f-219207504f55 with identifier: 1985435
2026-03-26 22:51:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 340005c8-2f01-5331-9c8f-219207504f55 with scrape type 1
2026-03-26 22:51:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 340005c8-2f01-5331-9c8f-219207504f55
2026-03-26 22:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252F2826af8eda3b43e19af804b3570bf76a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/2826af8eda3b43e19af804b3570bf76a/images/large/1.jpg not downloaded yet
2026-03-26 22:51:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76efe50>
2026-03-26 22:51:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac91607f-a69f-52f7-9c65-c869b70c8f00/ac91607f-a69f-52f7-9c65-c869b70c8f00_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fb1364b95203b4a68b99701d99771961a%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/b1364b95203b4a68b99701d99771961a/images/large/10.jpg saved to cache
2026-03-26 22:51:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ac91607f-a69f-52f7-9c65-c869b70c8f00
2026-03-26 22:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252F2826af8eda3b43e19af804b3570bf76a%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/2826af8eda3b43e19af804b3570bf76a/images/large/2.jpg not downloaded yet
2026-03-26 22:51:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/0f70f1ec777b449daaccff6999a7980c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/0f70f1ec777b449daaccff6999a7980c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/0f70f1ec777b449daaccff6999a7980c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252F2826af8eda3b43e19af804b3570bf76a%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/2826af8eda3b43e19af804b3570bf76a/images/large/3.jpg not downloaded yet
2026-03-26 22:51:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/0f70f1ec777b449daaccff6999a7980c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7a56f10>
2026-03-26 22:51:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac91607f-a69f-52f7-9c65-c869b70c8f00/ac91607f-a69f-52f7-9c65-c869b70c8f00_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fb1364b95203b4a68b99701d99771961a%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/b1364b95203b4a68b99701d99771961a/images/large/8.jpg saved to cache
2026-03-26 22:51:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ac91607f-a69f-52f7-9c65-c869b70c8f00
2026-03-26 22:51:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7400350>
2026-03-26 22:51:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac91607f-a69f-52f7-9c65-c869b70c8f00/ac91607f-a69f-52f7-9c65-c869b70c8f00_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fb1364b95203b4a68b99701d99771961a%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/b1364b95203b4a68b99701d99771961a/images/large/9.jpg saved to cache
2026-03-26 22:51:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ac91607f-a69f-52f7-9c65-c869b70c8f00
2026-03-26 22:51:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ac91607f-a69f-52f7-9c65-c869b70c8f00, skipping ID generation
2026-03-26 22:51:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac91607f-a69f-52f7-9c65-c869b70c8f00 with scrape type 1
2026-03-26 22:51:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ac91607f-a69f-52f7-9c65-c869b70c8f00 sending to next pipeline
2026-03-26 22:51:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: ac91607f-a69f-52f7-9c65-c869b70c8f00, identifier: 1985433
2026-03-26 22:51:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd0d2010>
2026-03-26 22:51:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0238b4ff-f3fd-56fb-b2ff-97a7b2555e89/0238b4ff-f3fd-56fb-b2ff-97a7b2555e89_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0f70f1ec777b449daaccff6999a7980c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0f70f1ec777b449daaccff6999a7980c/images/large/1.jpg saved to cache
2026-03-26 22:51:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0238b4ff-f3fd-56fb-b2ff-97a7b2555e89
2026-03-26 22:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252F2826af8eda3b43e19af804b3570bf76a%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/2826af8eda3b43e19af804b3570bf76a/images/large/4.jpg not downloaded yet
2026-03-26 22:51:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: ac91607f-a69f-52f7-9c65-c869b70c8f00 with identifier: 1985433
2026-03-26 22:51:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: ac91607f-a69f-52f7-9c65-c869b70c8f00 with identifier: 1985433
2026-03-26 22:51:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: ac91607f-a69f-52f7-9c65-c869b70c8f00 with identifier: 1985433 to the API
2026-03-26 22:51:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:51:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:51:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bp/b1364b95203b4a68b99701d99771961a/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'ac91607f-a69f-52f7-9c65-c869b70c8f00',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 40666,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac91607f-a69f-52f7-9c65-c869b70c8f00/ac91607f-a69f-52f7-9c65-c869b70c8f00_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 637042,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/b1364b95203b4a68b99701d99771961a/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac91607f-a69f-52f7-9c65-c869b70c8f00/ac91607f-a69f-52f7-9c65-c869b70c8f00_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 620507,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/b1364b95203b4a68b99701d99771961a/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac91607f-a69f-52f7-9c65-c869b70c8f00/ac91607f-a69f-52f7-9c65-c869b70c8f00_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 591758,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/b1364b95203b4a68b99701d99771961a/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac91607f-a69f-52f7-9c65-c869b70c8f00/ac91607f-a69f-52f7-9c65-c869b70c8f00_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 705388,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/b1364b95203b4a68b99701d99771961a/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac91607f-a69f-52f7-9c65-c869b70c8f00/ac91607f-a69f-52f7-9c65-c869b70c8f00_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 581465,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/b1364b95203b4a68b99701d99771961a/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac91607f-a69f-52f7-9c65-c869b70c8f00/ac91607f-a69f-52f7-9c65-c869b70c8f00_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 567321,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/b1364b95203b4a68b99701d99771961a/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac91607f-a69f-52f7-9c65-c869b70c8f00/ac91607f-a69f-52f7-9c65-c869b70c8f00_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 633991,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/b1364b95203b4a68b99701d99771961a/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac91607f-a69f-52f7-9c65-c869b70c8f00/ac91607f-a69f-52f7-9c65-c869b70c8f00_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 718880,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/b1364b95203b4a68b99701d99771961a/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac91607f-a69f-52f7-9c65-c869b70c8f00/ac91607f-a69f-52f7-9c65-c869b70c8f00_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 424359,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/b1364b95203b4a68b99701d99771961a/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac91607f-a69f-52f7-9c65-c869b70c8f00/ac91607f-a69f-52f7-9c65-c869b70c8f00_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 286264,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/b1364b95203b4a68b99701d99771961a/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 1.2 PURETECH 96KW S&S GT',
 'transmission': 'manual',
 'trim': '1.2 PURETECH 96KW S&S GT',
 'vin': None,
 'year': 2022}
2026-03-26 22:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985433%27 HTTP/1.1" 200 None
2026-03-26 22:51:32 [ayvens.be] INFO: Saving data for 1985433: {'created_time': 1774565492.695053, 'last_price_update_time': 1774565492.695062, 'auction_closing_time': 1774958400.0}
2026-03-26 22:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985433') HTTP/1.1" 204 0
2026-03-26 22:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252F2826af8eda3b43e19af804b3570bf76a%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/2826af8eda3b43e19af804b3570bf76a/images/large/5.jpg not downloaded yet
2026-03-26 22:51:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7448b50>
2026-03-26 22:51:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0238b4ff-f3fd-56fb-b2ff-97a7b2555e89/0238b4ff-f3fd-56fb-b2ff-97a7b2555e89_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0f70f1ec777b449daaccff6999a7980c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0f70f1ec777b449daaccff6999a7980c/images/large/2.jpg saved to cache
2026-03-26 22:51:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0238b4ff-f3fd-56fb-b2ff-97a7b2555e89
2026-03-26 22:51:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7459590>
2026-03-26 22:51:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0238b4ff-f3fd-56fb-b2ff-97a7b2555e89/0238b4ff-f3fd-56fb-b2ff-97a7b2555e89_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0f70f1ec777b449daaccff6999a7980c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0f70f1ec777b449daaccff6999a7980c/images/large/4.jpg saved to cache
2026-03-26 22:51:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0238b4ff-f3fd-56fb-b2ff-97a7b2555e89
2026-03-26 22:51:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7278150>
2026-03-26 22:51:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0238b4ff-f3fd-56fb-b2ff-97a7b2555e89/0238b4ff-f3fd-56fb-b2ff-97a7b2555e89_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0f70f1ec777b449daaccff6999a7980c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0f70f1ec777b449daaccff6999a7980c/images/large/3.jpg saved to cache
2026-03-26 22:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0238b4ff-f3fd-56fb-b2ff-97a7b2555e89
2026-03-26 22:51:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b745afd0>
2026-03-26 22:51:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0238b4ff-f3fd-56fb-b2ff-97a7b2555e89/0238b4ff-f3fd-56fb-b2ff-97a7b2555e89_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0f70f1ec777b449daaccff6999a7980c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0f70f1ec777b449daaccff6999a7980c/images/large/5.jpg saved to cache
2026-03-26 22:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0238b4ff-f3fd-56fb-b2ff-97a7b2555e89
2026-03-26 22:51:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/0f70f1ec777b449daaccff6999a7980c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252F2826af8eda3b43e19af804b3570bf76a%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/2826af8eda3b43e19af804b3570bf76a/images/large/6.jpg not downloaded yet
2026-03-26 22:51:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/0f70f1ec777b449daaccff6999a7980c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252F2826af8eda3b43e19af804b3570bf76a%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/2826af8eda3b43e19af804b3570bf76a/images/large/7.jpg not downloaded yet
2026-03-26 22:51:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/0f70f1ec777b449daaccff6999a7980c/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252F2826af8eda3b43e19af804b3570bf76a%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/2826af8eda3b43e19af804b3570bf76a/images/large/8.jpg not downloaded yet
2026-03-26 22:51:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/0f70f1ec777b449daaccff6999a7980c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/0f70f1ec777b449daaccff6999a7980c/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252F2826af8eda3b43e19af804b3570bf76a%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/2826af8eda3b43e19af804b3570bf76a/images/large/9.jpg not downloaded yet
2026-03-26 22:51:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cg/2826af8eda3b43e19af804b3570bf76a/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252F2826af8eda3b43e19af804b3570bf76a%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/2826af8eda3b43e19af804b3570bf76a/images/large/10.jpg not downloaded yet
2026-03-26 22:51:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cg/2826af8eda3b43e19af804b3570bf76a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b35b50>
2026-03-26 22:51:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0238b4ff-f3fd-56fb-b2ff-97a7b2555e89/0238b4ff-f3fd-56fb-b2ff-97a7b2555e89_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0f70f1ec777b449daaccff6999a7980c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0f70f1ec777b449daaccff6999a7980c/images/large/6.jpg saved to cache
2026-03-26 22:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0238b4ff-f3fd-56fb-b2ff-97a7b2555e89
2026-03-26 22:51:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76ef810>
2026-03-26 22:51:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0238b4ff-f3fd-56fb-b2ff-97a7b2555e89/0238b4ff-f3fd-56fb-b2ff-97a7b2555e89_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0f70f1ec777b449daaccff6999a7980c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0f70f1ec777b449daaccff6999a7980c/images/large/7.jpg saved to cache
2026-03-26 22:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0238b4ff-f3fd-56fb-b2ff-97a7b2555e89
2026-03-26 22:51:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7494c90>
2026-03-26 22:51:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0238b4ff-f3fd-56fb-b2ff-97a7b2555e89/0238b4ff-f3fd-56fb-b2ff-97a7b2555e89_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0f70f1ec777b449daaccff6999a7980c%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0f70f1ec777b449daaccff6999a7980c/images/large/9.jpg saved to cache
2026-03-26 22:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0238b4ff-f3fd-56fb-b2ff-97a7b2555e89
2026-03-26 22:51:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cg/2826af8eda3b43e19af804b3570bf76a/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:33 [ayvens.be] INFO: Found listing with ID: 1985436
2026-03-26 22:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985436%27 HTTP/1.1" 200 None
2026-03-26 22:51:33 [ayvens.be] INFO: Scrape type for 1985436: 1
2026-03-26 22:51:33 [ayvens.be] INFO: Extracting data for car ID: 1985436
2026-03-26 22:51:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d44b29fe-b0ac-50ce-b5d2-6f0ae726e736 with identifier: 1985436
2026-03-26 22:51:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d44b29fe-b0ac-50ce-b5d2-6f0ae726e736 with scrape type 1
2026-03-26 22:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d44b29fe-b0ac-50ce-b5d2-6f0ae726e736
2026-03-26 22:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F1b7cf234db5e4290b96ca204d602e291%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/1b7cf234db5e4290b96ca204d602e291/images/large/1.jpg not downloaded yet
2026-03-26 22:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F1b7cf234db5e4290b96ca204d602e291%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/1b7cf234db5e4290b96ca204d602e291/images/large/2.jpg not downloaded yet
2026-03-26 22:51:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76a4490>
2026-03-26 22:51:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0238b4ff-f3fd-56fb-b2ff-97a7b2555e89/0238b4ff-f3fd-56fb-b2ff-97a7b2555e89_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0f70f1ec777b449daaccff6999a7980c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0f70f1ec777b449daaccff6999a7980c/images/large/8.jpg saved to cache
2026-03-26 22:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0238b4ff-f3fd-56fb-b2ff-97a7b2555e89
2026-03-26 22:51:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cc1350>
2026-03-26 22:51:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0238b4ff-f3fd-56fb-b2ff-97a7b2555e89/0238b4ff-f3fd-56fb-b2ff-97a7b2555e89_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0f70f1ec777b449daaccff6999a7980c%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0f70f1ec777b449daaccff6999a7980c/images/large/10.jpg saved to cache
2026-03-26 22:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0238b4ff-f3fd-56fb-b2ff-97a7b2555e89
2026-03-26 22:51:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0238b4ff-f3fd-56fb-b2ff-97a7b2555e89, skipping ID generation
2026-03-26 22:51:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0238b4ff-f3fd-56fb-b2ff-97a7b2555e89 with scrape type 1
2026-03-26 22:51:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0238b4ff-f3fd-56fb-b2ff-97a7b2555e89 sending to next pipeline
2026-03-26 22:51:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 0238b4ff-f3fd-56fb-b2ff-97a7b2555e89, identifier: 1985434
2026-03-26 22:51:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b727aad0>
2026-03-26 22:51:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_340005c8-2f01-5331-9c8f-219207504f55/340005c8-2f01-5331-9c8f-219207504f55_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252F2826af8eda3b43e19af804b3570bf76a%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/2826af8eda3b43e19af804b3570bf76a/images/large/3.jpg saved to cache
2026-03-26 22:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 340005c8-2f01-5331-9c8f-219207504f55
2026-03-26 22:51:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76e02d0>
2026-03-26 22:51:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_340005c8-2f01-5331-9c8f-219207504f55/340005c8-2f01-5331-9c8f-219207504f55_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252F2826af8eda3b43e19af804b3570bf76a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/2826af8eda3b43e19af804b3570bf76a/images/large/1.jpg saved to cache
2026-03-26 22:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 340005c8-2f01-5331-9c8f-219207504f55
2026-03-26 22:51:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 0238b4ff-f3fd-56fb-b2ff-97a7b2555e89 with identifier: 1985434
2026-03-26 22:51:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 0238b4ff-f3fd-56fb-b2ff-97a7b2555e89 with identifier: 1985434
2026-03-26 22:51:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 0238b4ff-f3fd-56fb-b2ff-97a7b2555e89 with identifier: 1985434 to the API
2026-03-26 22:51:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:51:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:51:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bg/0f70f1ec777b449daaccff6999a7980c/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '0238b4ff-f3fd-56fb-b2ff-97a7b2555e89',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'INSIGNIA SPORTS TOURER DIESEL',
 'odometer': 154481,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0238b4ff-f3fd-56fb-b2ff-97a7b2555e89/0238b4ff-f3fd-56fb-b2ff-97a7b2555e89_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 687881,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/0f70f1ec777b449daaccff6999a7980c/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0238b4ff-f3fd-56fb-b2ff-97a7b2555e89/0238b4ff-f3fd-56fb-b2ff-97a7b2555e89_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 681600,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/0f70f1ec777b449daaccff6999a7980c/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0238b4ff-f3fd-56fb-b2ff-97a7b2555e89/0238b4ff-f3fd-56fb-b2ff-97a7b2555e89_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 724830,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/0f70f1ec777b449daaccff6999a7980c/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0238b4ff-f3fd-56fb-b2ff-97a7b2555e89/0238b4ff-f3fd-56fb-b2ff-97a7b2555e89_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 772753,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/0f70f1ec777b449daaccff6999a7980c/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0238b4ff-f3fd-56fb-b2ff-97a7b2555e89/0238b4ff-f3fd-56fb-b2ff-97a7b2555e89_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 616243,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/0f70f1ec777b449daaccff6999a7980c/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0238b4ff-f3fd-56fb-b2ff-97a7b2555e89/0238b4ff-f3fd-56fb-b2ff-97a7b2555e89_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 625313,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/0f70f1ec777b449daaccff6999a7980c/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0238b4ff-f3fd-56fb-b2ff-97a7b2555e89/0238b4ff-f3fd-56fb-b2ff-97a7b2555e89_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 666817,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/0f70f1ec777b449daaccff6999a7980c/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0238b4ff-f3fd-56fb-b2ff-97a7b2555e89/0238b4ff-f3fd-56fb-b2ff-97a7b2555e89_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 765830,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/0f70f1ec777b449daaccff6999a7980c/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0238b4ff-f3fd-56fb-b2ff-97a7b2555e89/0238b4ff-f3fd-56fb-b2ff-97a7b2555e89_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 569543,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/0f70f1ec777b449daaccff6999a7980c/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0238b4ff-f3fd-56fb-b2ff-97a7b2555e89/0238b4ff-f3fd-56fb-b2ff-97a7b2555e89_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 641961,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/0f70f1ec777b449daaccff6999a7980c/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL INSIGNIA SPORTS TOURER DIESEL 1.5 Turbo D Business Edition',
 'transmission': 'automatic',
 'trim': '1.5 Turbo D Business Edition',
 'vin': None,
 'year': 2021}
2026-03-26 22:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985434%27 HTTP/1.1" 200 None
2026-03-26 22:51:34 [ayvens.be] INFO: Saving data for 1985434: {'created_time': 1774565494.617457, 'last_price_update_time': 1774565494.617466, 'auction_closing_time': 1774958400.0}
2026-03-26 22:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985434') HTTP/1.1" 204 0
2026-03-26 22:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F1b7cf234db5e4290b96ca204d602e291%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/1b7cf234db5e4290b96ca204d602e291/images/large/3.jpg not downloaded yet
2026-03-26 22:51:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b782e8d0>
2026-03-26 22:51:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_340005c8-2f01-5331-9c8f-219207504f55/340005c8-2f01-5331-9c8f-219207504f55_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252F2826af8eda3b43e19af804b3570bf76a%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/2826af8eda3b43e19af804b3570bf76a/images/large/2.jpg saved to cache
2026-03-26 22:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 340005c8-2f01-5331-9c8f-219207504f55
2026-03-26 22:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F1b7cf234db5e4290b96ca204d602e291%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/1b7cf234db5e4290b96ca204d602e291/images/large/4.jpg not downloaded yet
2026-03-26 22:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F1b7cf234db5e4290b96ca204d602e291%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/1b7cf234db5e4290b96ca204d602e291/images/large/5.jpg not downloaded yet
2026-03-26 22:51:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cg/2826af8eda3b43e19af804b3570bf76a/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cg/2826af8eda3b43e19af804b3570bf76a/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F1b7cf234db5e4290b96ca204d602e291%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/1b7cf234db5e4290b96ca204d602e291/images/large/6.jpg not downloaded yet
2026-03-26 22:51:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cg/2826af8eda3b43e19af804b3570bf76a/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cg/2826af8eda3b43e19af804b3570bf76a/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cg/2826af8eda3b43e19af804b3570bf76a/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cg/2826af8eda3b43e19af804b3570bf76a/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F1b7cf234db5e4290b96ca204d602e291%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/1b7cf234db5e4290b96ca204d602e291/images/large/7.jpg not downloaded yet
2026-03-26 22:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F1b7cf234db5e4290b96ca204d602e291%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/1b7cf234db5e4290b96ca204d602e291/images/large/8.jpg not downloaded yet
2026-03-26 22:51:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cg/2826af8eda3b43e19af804b3570bf76a/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F1b7cf234db5e4290b96ca204d602e291%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/1b7cf234db5e4290b96ca204d602e291/images/large/9.jpg not downloaded yet
2026-03-26 22:51:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/1b7cf234db5e4290b96ca204d602e291/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F1b7cf234db5e4290b96ca204d602e291%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/1b7cf234db5e4290b96ca204d602e291/images/large/10.jpg not downloaded yet
2026-03-26 22:51:34 [ayvens.be] INFO: Found listing with ID: 1985437
2026-03-26 22:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985437%27 HTTP/1.1" 200 None
2026-03-26 22:51:34 [ayvens.be] INFO: Scrape type for 1985437: 1
2026-03-26 22:51:34 [ayvens.be] INFO: Extracting data for car ID: 1985437
2026-03-26 22:51:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1fe3a826-d1b0-5341-92c4-687efe5da057 with identifier: 1985437
2026-03-26 22:51:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1fe3a826-d1b0-5341-92c4-687efe5da057 with scrape type 1
2026-03-26 22:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1fe3a826-d1b0-5341-92c4-687efe5da057
2026-03-26 22:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F069f334e9eb5496e97de4a8f91efc619%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/069f334e9eb5496e97de4a8f91efc619/images/large/1.jpg not downloaded yet
2026-03-26 22:51:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b16c50>
2026-03-26 22:51:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_340005c8-2f01-5331-9c8f-219207504f55/340005c8-2f01-5331-9c8f-219207504f55_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252F2826af8eda3b43e19af804b3570bf76a%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/2826af8eda3b43e19af804b3570bf76a/images/large/5.jpg saved to cache
2026-03-26 22:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 340005c8-2f01-5331-9c8f-219207504f55
2026-03-26 22:51:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6df0dd0>
2026-03-26 22:51:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_340005c8-2f01-5331-9c8f-219207504f55/340005c8-2f01-5331-9c8f-219207504f55_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252F2826af8eda3b43e19af804b3570bf76a%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/2826af8eda3b43e19af804b3570bf76a/images/large/6.jpg saved to cache
2026-03-26 22:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 340005c8-2f01-5331-9c8f-219207504f55
2026-03-26 22:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F069f334e9eb5496e97de4a8f91efc619%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/069f334e9eb5496e97de4a8f91efc619/images/large/2.jpg not downloaded yet
2026-03-26 22:51:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7417fd0>
2026-03-26 22:51:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_340005c8-2f01-5331-9c8f-219207504f55/340005c8-2f01-5331-9c8f-219207504f55_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252F2826af8eda3b43e19af804b3570bf76a%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/2826af8eda3b43e19af804b3570bf76a/images/large/4.jpg saved to cache
2026-03-26 22:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 340005c8-2f01-5331-9c8f-219207504f55
2026-03-26 22:51:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e10410>
2026-03-26 22:51:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_340005c8-2f01-5331-9c8f-219207504f55/340005c8-2f01-5331-9c8f-219207504f55_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252F2826af8eda3b43e19af804b3570bf76a%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/2826af8eda3b43e19af804b3570bf76a/images/large/7.jpg saved to cache
2026-03-26 22:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 340005c8-2f01-5331-9c8f-219207504f55
2026-03-26 22:51:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79a76d0>
2026-03-26 22:51:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_340005c8-2f01-5331-9c8f-219207504f55/340005c8-2f01-5331-9c8f-219207504f55_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252F2826af8eda3b43e19af804b3570bf76a%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/2826af8eda3b43e19af804b3570bf76a/images/large/8.jpg saved to cache
2026-03-26 22:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 340005c8-2f01-5331-9c8f-219207504f55
2026-03-26 22:51:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74ddf90>
2026-03-26 22:51:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_340005c8-2f01-5331-9c8f-219207504f55/340005c8-2f01-5331-9c8f-219207504f55_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252F2826af8eda3b43e19af804b3570bf76a%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/2826af8eda3b43e19af804b3570bf76a/images/large/9.jpg saved to cache
2026-03-26 22:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 340005c8-2f01-5331-9c8f-219207504f55
2026-03-26 22:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F069f334e9eb5496e97de4a8f91efc619%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/069f334e9eb5496e97de4a8f91efc619/images/large/3.jpg not downloaded yet
2026-03-26 22:51:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7591d10>
2026-03-26 22:51:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_340005c8-2f01-5331-9c8f-219207504f55/340005c8-2f01-5331-9c8f-219207504f55_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252F2826af8eda3b43e19af804b3570bf76a%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/2826af8eda3b43e19af804b3570bf76a/images/large/10.jpg saved to cache
2026-03-26 22:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 340005c8-2f01-5331-9c8f-219207504f55
2026-03-26 22:51:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 340005c8-2f01-5331-9c8f-219207504f55, skipping ID generation
2026-03-26 22:51:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 340005c8-2f01-5331-9c8f-219207504f55 with scrape type 1
2026-03-26 22:51:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 340005c8-2f01-5331-9c8f-219207504f55 sending to next pipeline
2026-03-26 22:51:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 340005c8-2f01-5331-9c8f-219207504f55, identifier: 1985435
2026-03-26 22:51:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd0c4790>
2026-03-26 22:51:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d44b29fe-b0ac-50ce-b5d2-6f0ae726e736/d44b29fe-b0ac-50ce-b5d2-6f0ae726e736_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F1b7cf234db5e4290b96ca204d602e291%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/1b7cf234db5e4290b96ca204d602e291/images/large/1.jpg saved to cache
2026-03-26 22:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d44b29fe-b0ac-50ce-b5d2-6f0ae726e736
2026-03-26 22:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F069f334e9eb5496e97de4a8f91efc619%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/069f334e9eb5496e97de4a8f91efc619/images/large/4.jpg not downloaded yet
2026-03-26 22:51:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 340005c8-2f01-5331-9c8f-219207504f55 with identifier: 1985435
2026-03-26 22:51:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 340005c8-2f01-5331-9c8f-219207504f55 with identifier: 1985435
2026-03-26 22:51:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 340005c8-2f01-5331-9c8f-219207504f55 with identifier: 1985435 to the API
2026-03-26 22:51:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:51:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:51:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cg/2826af8eda3b43e19af804b3570bf76a/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '340005c8-2f01-5331-9c8f-219207504f55',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '2 SERIES GRAN COUPE',
 'odometer': 102888,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_340005c8-2f01-5331-9c8f-219207504f55/340005c8-2f01-5331-9c8f-219207504f55_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 734846,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cg/2826af8eda3b43e19af804b3570bf76a/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_340005c8-2f01-5331-9c8f-219207504f55/340005c8-2f01-5331-9c8f-219207504f55_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 678864,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cg/2826af8eda3b43e19af804b3570bf76a/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_340005c8-2f01-5331-9c8f-219207504f55/340005c8-2f01-5331-9c8f-219207504f55_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 547423,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cg/2826af8eda3b43e19af804b3570bf76a/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_340005c8-2f01-5331-9c8f-219207504f55/340005c8-2f01-5331-9c8f-219207504f55_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 766932,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cg/2826af8eda3b43e19af804b3570bf76a/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_340005c8-2f01-5331-9c8f-219207504f55/340005c8-2f01-5331-9c8f-219207504f55_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 713609,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cg/2826af8eda3b43e19af804b3570bf76a/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_340005c8-2f01-5331-9c8f-219207504f55/340005c8-2f01-5331-9c8f-219207504f55_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 569079,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cg/2826af8eda3b43e19af804b3570bf76a/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_340005c8-2f01-5331-9c8f-219207504f55/340005c8-2f01-5331-9c8f-219207504f55_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 709293,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cg/2826af8eda3b43e19af804b3570bf76a/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_340005c8-2f01-5331-9c8f-219207504f55/340005c8-2f01-5331-9c8f-219207504f55_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 778240,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cg/2826af8eda3b43e19af804b3570bf76a/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_340005c8-2f01-5331-9c8f-219207504f55/340005c8-2f01-5331-9c8f-219207504f55_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 581078,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cg/2826af8eda3b43e19af804b3570bf76a/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_340005c8-2f01-5331-9c8f-219207504f55/340005c8-2f01-5331-9c8f-219207504f55_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 607470,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cg/2826af8eda3b43e19af804b3570bf76a/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 2 SERIES GRAN COUPE 1.5 216DA GRAN COUPE',
 'transmission': 'automatic',
 'trim': '1.5 216DA GRAN COUPE',
 'vin': None,
 'year': 2022}
2026-03-26 22:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985435%27 HTTP/1.1" 200 None
2026-03-26 22:51:36 [ayvens.be] INFO: Saving data for 1985435: {'created_time': 1774565496.244024, 'last_price_update_time': 1774565496.244034, 'auction_closing_time': 1774958400.0}
2026-03-26 22:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985435') HTTP/1.1" 204 0
2026-03-26 22:51:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/1b7cf234db5e4290b96ca204d602e291/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F069f334e9eb5496e97de4a8f91efc619%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/069f334e9eb5496e97de4a8f91efc619/images/large/5.jpg not downloaded yet
2026-03-26 22:51:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/1b7cf234db5e4290b96ca204d602e291/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/1b7cf234db5e4290b96ca204d602e291/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F069f334e9eb5496e97de4a8f91efc619%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/069f334e9eb5496e97de4a8f91efc619/images/large/6.jpg not downloaded yet
2026-03-26 22:51:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/1b7cf234db5e4290b96ca204d602e291/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/1b7cf234db5e4290b96ca204d602e291/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F069f334e9eb5496e97de4a8f91efc619%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/069f334e9eb5496e97de4a8f91efc619/images/large/7.jpg not downloaded yet
2026-03-26 22:51:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/1b7cf234db5e4290b96ca204d602e291/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F069f334e9eb5496e97de4a8f91efc619%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/069f334e9eb5496e97de4a8f91efc619/images/large/8.jpg not downloaded yet
2026-03-26 22:51:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7649ed0>
2026-03-26 22:51:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d44b29fe-b0ac-50ce-b5d2-6f0ae726e736/d44b29fe-b0ac-50ce-b5d2-6f0ae726e736_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F1b7cf234db5e4290b96ca204d602e291%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/1b7cf234db5e4290b96ca204d602e291/images/large/2.jpg saved to cache
2026-03-26 22:51:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d44b29fe-b0ac-50ce-b5d2-6f0ae726e736
2026-03-26 22:51:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/1b7cf234db5e4290b96ca204d602e291/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F069f334e9eb5496e97de4a8f91efc619%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/069f334e9eb5496e97de4a8f91efc619/images/large/9.jpg not downloaded yet
2026-03-26 22:51:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c68410>
2026-03-26 22:51:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d44b29fe-b0ac-50ce-b5d2-6f0ae726e736/d44b29fe-b0ac-50ce-b5d2-6f0ae726e736_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F1b7cf234db5e4290b96ca204d602e291%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/1b7cf234db5e4290b96ca204d602e291/images/large/5.jpg saved to cache
2026-03-26 22:51:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d44b29fe-b0ac-50ce-b5d2-6f0ae726e736
2026-03-26 22:51:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7477f10>
2026-03-26 22:51:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d44b29fe-b0ac-50ce-b5d2-6f0ae726e736/d44b29fe-b0ac-50ce-b5d2-6f0ae726e736_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F1b7cf234db5e4290b96ca204d602e291%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/1b7cf234db5e4290b96ca204d602e291/images/large/6.jpg saved to cache
2026-03-26 22:51:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d44b29fe-b0ac-50ce-b5d2-6f0ae726e736
2026-03-26 22:51:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/069f334e9eb5496e97de4a8f91efc619/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F069f334e9eb5496e97de4a8f91efc619%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/069f334e9eb5496e97de4a8f91efc619/images/large/10.jpg not downloaded yet
2026-03-26 22:51:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b75a6990>
2026-03-26 22:51:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d44b29fe-b0ac-50ce-b5d2-6f0ae726e736/d44b29fe-b0ac-50ce-b5d2-6f0ae726e736_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F1b7cf234db5e4290b96ca204d602e291%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/1b7cf234db5e4290b96ca204d602e291/images/large/7.jpg saved to cache
2026-03-26 22:51:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d44b29fe-b0ac-50ce-b5d2-6f0ae726e736
2026-03-26 22:51:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7cab910>
2026-03-26 22:51:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d44b29fe-b0ac-50ce-b5d2-6f0ae726e736/d44b29fe-b0ac-50ce-b5d2-6f0ae726e736_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F1b7cf234db5e4290b96ca204d602e291%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/1b7cf234db5e4290b96ca204d602e291/images/large/3.jpg saved to cache
2026-03-26 22:51:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d44b29fe-b0ac-50ce-b5d2-6f0ae726e736
2026-03-26 22:51:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e28190>
2026-03-26 22:51:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d44b29fe-b0ac-50ce-b5d2-6f0ae726e736/d44b29fe-b0ac-50ce-b5d2-6f0ae726e736_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F1b7cf234db5e4290b96ca204d602e291%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/1b7cf234db5e4290b96ca204d602e291/images/large/8.jpg saved to cache
2026-03-26 22:51:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d44b29fe-b0ac-50ce-b5d2-6f0ae726e736
2026-03-26 22:51:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b744ad10>
2026-03-26 22:51:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d44b29fe-b0ac-50ce-b5d2-6f0ae726e736/d44b29fe-b0ac-50ce-b5d2-6f0ae726e736_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F1b7cf234db5e4290b96ca204d602e291%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/1b7cf234db5e4290b96ca204d602e291/images/large/4.jpg saved to cache
2026-03-26 22:51:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d44b29fe-b0ac-50ce-b5d2-6f0ae726e736
2026-03-26 22:51:37 [ayvens.be] INFO: Found listing with ID: 1985438
2026-03-26 22:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985438%27 HTTP/1.1" 200 None
2026-03-26 22:51:37 [ayvens.be] INFO: Scrape type for 1985438: 1
2026-03-26 22:51:37 [ayvens.be] INFO: Extracting data for car ID: 1985438
2026-03-26 22:51:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a80622f-dbf6-5ccc-a105-af1847b0b8a4 with identifier: 1985438
2026-03-26 22:51:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a80622f-dbf6-5ccc-a105-af1847b0b8a4 with scrape type 1
2026-03-26 22:51:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9a80622f-dbf6-5ccc-a105-af1847b0b8a4
2026-03-26 22:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F0d65b3ac686649efb7fe9a78c419066e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/0d65b3ac686649efb7fe9a78c419066e/images/large/1.jpg not downloaded yet
2026-03-26 22:51:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/069f334e9eb5496e97de4a8f91efc619/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F0d65b3ac686649efb7fe9a78c419066e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/0d65b3ac686649efb7fe9a78c419066e/images/large/2.jpg not downloaded yet
2026-03-26 22:51:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7aa3a50>
2026-03-26 22:51:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fe3a826-d1b0-5341-92c4-687efe5da057/1fe3a826-d1b0-5341-92c4-687efe5da057_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F069f334e9eb5496e97de4a8f91efc619%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/069f334e9eb5496e97de4a8f91efc619/images/large/2.jpg saved to cache
2026-03-26 22:51:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1fe3a826-d1b0-5341-92c4-687efe5da057
2026-03-26 22:51:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/1b7cf234db5e4290b96ca204d602e291/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F0d65b3ac686649efb7fe9a78c419066e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/0d65b3ac686649efb7fe9a78c419066e/images/large/3.jpg not downloaded yet
2026-03-26 22:51:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/069f334e9eb5496e97de4a8f91efc619/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/1b7cf234db5e4290b96ca204d602e291/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/069f334e9eb5496e97de4a8f91efc619/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F0d65b3ac686649efb7fe9a78c419066e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/0d65b3ac686649efb7fe9a78c419066e/images/large/4.jpg not downloaded yet
2026-03-26 22:51:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/069f334e9eb5496e97de4a8f91efc619/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79a5b50>
2026-03-26 22:51:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fe3a826-d1b0-5341-92c4-687efe5da057/1fe3a826-d1b0-5341-92c4-687efe5da057_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F069f334e9eb5496e97de4a8f91efc619%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/069f334e9eb5496e97de4a8f91efc619/images/large/1.jpg saved to cache
2026-03-26 22:51:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1fe3a826-d1b0-5341-92c4-687efe5da057
2026-03-26 22:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F0d65b3ac686649efb7fe9a78c419066e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/0d65b3ac686649efb7fe9a78c419066e/images/large/5.jpg not downloaded yet
2026-03-26 22:51:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/069f334e9eb5496e97de4a8f91efc619/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/069f334e9eb5496e97de4a8f91efc619/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F0d65b3ac686649efb7fe9a78c419066e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/0d65b3ac686649efb7fe9a78c419066e/images/large/6.jpg not downloaded yet
2026-03-26 22:51:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cc2310>
2026-03-26 22:51:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d44b29fe-b0ac-50ce-b5d2-6f0ae726e736/d44b29fe-b0ac-50ce-b5d2-6f0ae726e736_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F1b7cf234db5e4290b96ca204d602e291%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/1b7cf234db5e4290b96ca204d602e291/images/large/10.jpg saved to cache
2026-03-26 22:51:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d44b29fe-b0ac-50ce-b5d2-6f0ae726e736
2026-03-26 22:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F0d65b3ac686649efb7fe9a78c419066e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/0d65b3ac686649efb7fe9a78c419066e/images/large/7.jpg not downloaded yet
2026-03-26 22:51:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7ce8350>
2026-03-26 22:51:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fe3a826-d1b0-5341-92c4-687efe5da057/1fe3a826-d1b0-5341-92c4-687efe5da057_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F069f334e9eb5496e97de4a8f91efc619%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/069f334e9eb5496e97de4a8f91efc619/images/large/3.jpg saved to cache
2026-03-26 22:51:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1fe3a826-d1b0-5341-92c4-687efe5da057
2026-03-26 22:51:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7725e50>
2026-03-26 22:51:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d44b29fe-b0ac-50ce-b5d2-6f0ae726e736/d44b29fe-b0ac-50ce-b5d2-6f0ae726e736_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F1b7cf234db5e4290b96ca204d602e291%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/1b7cf234db5e4290b96ca204d602e291/images/large/9.jpg saved to cache
2026-03-26 22:51:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d44b29fe-b0ac-50ce-b5d2-6f0ae726e736
2026-03-26 22:51:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d44b29fe-b0ac-50ce-b5d2-6f0ae726e736, skipping ID generation
2026-03-26 22:51:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d44b29fe-b0ac-50ce-b5d2-6f0ae726e736 with scrape type 1
2026-03-26 22:51:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d44b29fe-b0ac-50ce-b5d2-6f0ae726e736 sending to next pipeline
2026-03-26 22:51:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d44b29fe-b0ac-50ce-b5d2-6f0ae726e736, identifier: 1985436
2026-03-26 22:51:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6ded2d0>
2026-03-26 22:51:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fe3a826-d1b0-5341-92c4-687efe5da057/1fe3a826-d1b0-5341-92c4-687efe5da057_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F069f334e9eb5496e97de4a8f91efc619%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/069f334e9eb5496e97de4a8f91efc619/images/large/5.jpg saved to cache
2026-03-26 22:51:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1fe3a826-d1b0-5341-92c4-687efe5da057
2026-03-26 22:51:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b78ab3d0>
2026-03-26 22:51:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fe3a826-d1b0-5341-92c4-687efe5da057/1fe3a826-d1b0-5341-92c4-687efe5da057_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F069f334e9eb5496e97de4a8f91efc619%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/069f334e9eb5496e97de4a8f91efc619/images/large/4.jpg saved to cache
2026-03-26 22:51:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1fe3a826-d1b0-5341-92c4-687efe5da057
2026-03-26 22:51:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/069f334e9eb5496e97de4a8f91efc619/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F0d65b3ac686649efb7fe9a78c419066e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/0d65b3ac686649efb7fe9a78c419066e/images/large/8.jpg not downloaded yet
2026-03-26 22:51:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d44b29fe-b0ac-50ce-b5d2-6f0ae726e736 with identifier: 1985436
2026-03-26 22:51:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d44b29fe-b0ac-50ce-b5d2-6f0ae726e736 with identifier: 1985436
2026-03-26 22:51:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d44b29fe-b0ac-50ce-b5d2-6f0ae726e736 with identifier: 1985436 to the API
2026-03-26 22:51:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:51:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:51:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2de/1b7cf234db5e4290b96ca204d602e291/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd44b29fe-b0ac-50ce-b5d2-6f0ae726e736',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '1 SERIES HATCH',
 'odometer': 94681,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d44b29fe-b0ac-50ce-b5d2-6f0ae726e736/d44b29fe-b0ac-50ce-b5d2-6f0ae726e736_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 697062,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/1b7cf234db5e4290b96ca204d602e291/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d44b29fe-b0ac-50ce-b5d2-6f0ae726e736/d44b29fe-b0ac-50ce-b5d2-6f0ae726e736_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 722681,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/1b7cf234db5e4290b96ca204d602e291/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d44b29fe-b0ac-50ce-b5d2-6f0ae726e736/d44b29fe-b0ac-50ce-b5d2-6f0ae726e736_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 662859,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/1b7cf234db5e4290b96ca204d602e291/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d44b29fe-b0ac-50ce-b5d2-6f0ae726e736/d44b29fe-b0ac-50ce-b5d2-6f0ae726e736_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 751523,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/1b7cf234db5e4290b96ca204d602e291/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d44b29fe-b0ac-50ce-b5d2-6f0ae726e736/d44b29fe-b0ac-50ce-b5d2-6f0ae726e736_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 573895,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/1b7cf234db5e4290b96ca204d602e291/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d44b29fe-b0ac-50ce-b5d2-6f0ae726e736/d44b29fe-b0ac-50ce-b5d2-6f0ae726e736_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 565284,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/1b7cf234db5e4290b96ca204d602e291/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d44b29fe-b0ac-50ce-b5d2-6f0ae726e736/d44b29fe-b0ac-50ce-b5d2-6f0ae726e736_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 594275,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/1b7cf234db5e4290b96ca204d602e291/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d44b29fe-b0ac-50ce-b5d2-6f0ae726e736/d44b29fe-b0ac-50ce-b5d2-6f0ae726e736_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 724892,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/1b7cf234db5e4290b96ca204d602e291/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d44b29fe-b0ac-50ce-b5d2-6f0ae726e736/d44b29fe-b0ac-50ce-b5d2-6f0ae726e736_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 632306,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/1b7cf234db5e4290b96ca204d602e291/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d44b29fe-b0ac-50ce-b5d2-6f0ae726e736/d44b29fe-b0ac-50ce-b5d2-6f0ae726e736_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 516213,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/1b7cf234db5e4290b96ca204d602e291/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1 SERIES HATCH 1.5 116D (85KW)',
 'transmission': 'manual',
 'trim': '1.5 116D (85KW)',
 'vin': None,
 'year': 2023}
2026-03-26 22:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985436%27 HTTP/1.1" 200 None
2026-03-26 22:51:38 [ayvens.be] INFO: Saving data for 1985436: {'created_time': 1774565498.472771, 'last_price_update_time': 1774565498.472781, 'auction_closing_time': 1774958400.0}
2026-03-26 22:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985436') HTTP/1.1" 204 0
2026-03-26 22:51:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/069f334e9eb5496e97de4a8f91efc619/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F0d65b3ac686649efb7fe9a78c419066e%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/0d65b3ac686649efb7fe9a78c419066e/images/large/9.jpg not downloaded yet
2026-03-26 22:51:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7a61210>
2026-03-26 22:51:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fe3a826-d1b0-5341-92c4-687efe5da057/1fe3a826-d1b0-5341-92c4-687efe5da057_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F069f334e9eb5496e97de4a8f91efc619%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/069f334e9eb5496e97de4a8f91efc619/images/large/6.jpg saved to cache
2026-03-26 22:51:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1fe3a826-d1b0-5341-92c4-687efe5da057
2026-03-26 22:51:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76ef110>
2026-03-26 22:51:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fe3a826-d1b0-5341-92c4-687efe5da057/1fe3a826-d1b0-5341-92c4-687efe5da057_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F069f334e9eb5496e97de4a8f91efc619%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/069f334e9eb5496e97de4a8f91efc619/images/large/7.jpg saved to cache
2026-03-26 22:51:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1fe3a826-d1b0-5341-92c4-687efe5da057
2026-03-26 22:51:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/069f334e9eb5496e97de4a8f91efc619/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F0d65b3ac686649efb7fe9a78c419066e%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/0d65b3ac686649efb7fe9a78c419066e/images/large/10.jpg not downloaded yet
2026-03-26 22:51:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7413390>
2026-03-26 22:51:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fe3a826-d1b0-5341-92c4-687efe5da057/1fe3a826-d1b0-5341-92c4-687efe5da057_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F069f334e9eb5496e97de4a8f91efc619%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/069f334e9eb5496e97de4a8f91efc619/images/large/8.jpg saved to cache
2026-03-26 22:51:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1fe3a826-d1b0-5341-92c4-687efe5da057
2026-03-26 22:51:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/0d65b3ac686649efb7fe9a78c419066e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:38 [ayvens.be] INFO: Found listing with ID: 1985439
2026-03-26 22:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985439%27 HTTP/1.1" 200 None
2026-03-26 22:51:38 [ayvens.be] INFO: Scrape type for 1985439: 1
2026-03-26 22:51:38 [ayvens.be] INFO: Extracting data for car ID: 1985439
2026-03-26 22:51:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 433392de-fd62-5a76-88b4-6ae1052541af with identifier: 1985439
2026-03-26 22:51:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 433392de-fd62-5a76-88b4-6ae1052541af with scrape type 1
2026-03-26 22:51:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 433392de-fd62-5a76-88b4-6ae1052541af
2026-03-26 22:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F92f3af4e5aea4f3ca5c3dd4c619f1e39%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/92f3af4e5aea4f3ca5c3dd4c619f1e39/images/large/1.jpg not downloaded yet
2026-03-26 22:51:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6df0350>
2026-03-26 22:51:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fe3a826-d1b0-5341-92c4-687efe5da057/1fe3a826-d1b0-5341-92c4-687efe5da057_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F069f334e9eb5496e97de4a8f91efc619%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/069f334e9eb5496e97de4a8f91efc619/images/large/10.jpg saved to cache
2026-03-26 22:51:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1fe3a826-d1b0-5341-92c4-687efe5da057
2026-03-26 22:51:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76efa10>
2026-03-26 22:51:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fe3a826-d1b0-5341-92c4-687efe5da057/1fe3a826-d1b0-5341-92c4-687efe5da057_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F069f334e9eb5496e97de4a8f91efc619%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/069f334e9eb5496e97de4a8f91efc619/images/large/9.jpg saved to cache
2026-03-26 22:51:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1fe3a826-d1b0-5341-92c4-687efe5da057
2026-03-26 22:51:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1fe3a826-d1b0-5341-92c4-687efe5da057, skipping ID generation
2026-03-26 22:51:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1fe3a826-d1b0-5341-92c4-687efe5da057 with scrape type 1
2026-03-26 22:51:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1fe3a826-d1b0-5341-92c4-687efe5da057 sending to next pipeline
2026-03-26 22:51:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 1fe3a826-d1b0-5341-92c4-687efe5da057, identifier: 1985437
2026-03-26 22:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F92f3af4e5aea4f3ca5c3dd4c619f1e39%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/92f3af4e5aea4f3ca5c3dd4c619f1e39/images/large/2.jpg not downloaded yet
2026-03-26 22:51:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 1fe3a826-d1b0-5341-92c4-687efe5da057 with identifier: 1985437
2026-03-26 22:51:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 1fe3a826-d1b0-5341-92c4-687efe5da057 with identifier: 1985437
2026-03-26 22:51:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 1fe3a826-d1b0-5341-92c4-687efe5da057 with identifier: 1985437 to the API
2026-03-26 22:51:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:51:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:51:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cp/069f334e9eb5496e97de4a8f91efc619/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '1fe3a826-d1b0-5341-92c4-687efe5da057',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 110648,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fe3a826-d1b0-5341-92c4-687efe5da057/1fe3a826-d1b0-5341-92c4-687efe5da057_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 610461,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/069f334e9eb5496e97de4a8f91efc619/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fe3a826-d1b0-5341-92c4-687efe5da057/1fe3a826-d1b0-5341-92c4-687efe5da057_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 650919,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/069f334e9eb5496e97de4a8f91efc619/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fe3a826-d1b0-5341-92c4-687efe5da057/1fe3a826-d1b0-5341-92c4-687efe5da057_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 631877,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/069f334e9eb5496e97de4a8f91efc619/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fe3a826-d1b0-5341-92c4-687efe5da057/1fe3a826-d1b0-5341-92c4-687efe5da057_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 770237,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/069f334e9eb5496e97de4a8f91efc619/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fe3a826-d1b0-5341-92c4-687efe5da057/1fe3a826-d1b0-5341-92c4-687efe5da057_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 571373,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/069f334e9eb5496e97de4a8f91efc619/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fe3a826-d1b0-5341-92c4-687efe5da057/1fe3a826-d1b0-5341-92c4-687efe5da057_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 543449,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/069f334e9eb5496e97de4a8f91efc619/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fe3a826-d1b0-5341-92c4-687efe5da057/1fe3a826-d1b0-5341-92c4-687efe5da057_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 588000,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/069f334e9eb5496e97de4a8f91efc619/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fe3a826-d1b0-5341-92c4-687efe5da057/1fe3a826-d1b0-5341-92c4-687efe5da057_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 685798,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/069f334e9eb5496e97de4a8f91efc619/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fe3a826-d1b0-5341-92c4-687efe5da057/1fe3a826-d1b0-5341-92c4-687efe5da057_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 570629,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/069f334e9eb5496e97de4a8f91efc619/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fe3a826-d1b0-5341-92c4-687efe5da057/1fe3a826-d1b0-5341-92c4-687efe5da057_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 496509,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/069f334e9eb5496e97de4a8f91efc619/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 1.5 BLUEHDI S&S EAT8 ALLURE PACK',
 'transmission': 'automatic',
 'trim': '1.5 BLUEHDI S&S EAT8 ALLURE PACK',
 'vin': None,
 'year': 2022}
2026-03-26 22:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985437%27 HTTP/1.1" 200 None
2026-03-26 22:51:39 [ayvens.be] INFO: Saving data for 1985437: {'created_time': 1774565499.50325, 'last_price_update_time': 1774565499.50326, 'auction_closing_time': 1774958400.0}
2026-03-26 22:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985437') HTTP/1.1" 204 0
2026-03-26 22:51:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/0d65b3ac686649efb7fe9a78c419066e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/0d65b3ac686649efb7fe9a78c419066e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/0d65b3ac686649efb7fe9a78c419066e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F92f3af4e5aea4f3ca5c3dd4c619f1e39%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/92f3af4e5aea4f3ca5c3dd4c619f1e39/images/large/3.jpg not downloaded yet
2026-03-26 22:51:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74490d0>
2026-03-26 22:51:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a80622f-dbf6-5ccc-a105-af1847b0b8a4/9a80622f-dbf6-5ccc-a105-af1847b0b8a4_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F0d65b3ac686649efb7fe9a78c419066e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/0d65b3ac686649efb7fe9a78c419066e/images/large/1.jpg saved to cache
2026-03-26 22:51:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9a80622f-dbf6-5ccc-a105-af1847b0b8a4
2026-03-26 22:51:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/0d65b3ac686649efb7fe9a78c419066e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F92f3af4e5aea4f3ca5c3dd4c619f1e39%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/92f3af4e5aea4f3ca5c3dd4c619f1e39/images/large/4.jpg not downloaded yet
2026-03-26 22:51:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b768b310>
2026-03-26 22:51:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a80622f-dbf6-5ccc-a105-af1847b0b8a4/9a80622f-dbf6-5ccc-a105-af1847b0b8a4_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F0d65b3ac686649efb7fe9a78c419066e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/0d65b3ac686649efb7fe9a78c419066e/images/large/2.jpg saved to cache
2026-03-26 22:51:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9a80622f-dbf6-5ccc-a105-af1847b0b8a4
2026-03-26 22:51:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7587990>
2026-03-26 22:51:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a80622f-dbf6-5ccc-a105-af1847b0b8a4/9a80622f-dbf6-5ccc-a105-af1847b0b8a4_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F0d65b3ac686649efb7fe9a78c419066e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/0d65b3ac686649efb7fe9a78c419066e/images/large/3.jpg saved to cache
2026-03-26 22:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9a80622f-dbf6-5ccc-a105-af1847b0b8a4
2026-03-26 22:51:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e2b7d0>
2026-03-26 22:51:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a80622f-dbf6-5ccc-a105-af1847b0b8a4/9a80622f-dbf6-5ccc-a105-af1847b0b8a4_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F0d65b3ac686649efb7fe9a78c419066e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/0d65b3ac686649efb7fe9a78c419066e/images/large/5.jpg saved to cache
2026-03-26 22:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9a80622f-dbf6-5ccc-a105-af1847b0b8a4
2026-03-26 22:51:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/0d65b3ac686649efb7fe9a78c419066e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F92f3af4e5aea4f3ca5c3dd4c619f1e39%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/92f3af4e5aea4f3ca5c3dd4c619f1e39/images/large/5.jpg not downloaded yet
2026-03-26 22:51:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/0d65b3ac686649efb7fe9a78c419066e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F92f3af4e5aea4f3ca5c3dd4c619f1e39%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/92f3af4e5aea4f3ca5c3dd4c619f1e39/images/large/6.jpg not downloaded yet
2026-03-26 22:51:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7293510>
2026-03-26 22:51:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a80622f-dbf6-5ccc-a105-af1847b0b8a4/9a80622f-dbf6-5ccc-a105-af1847b0b8a4_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F0d65b3ac686649efb7fe9a78c419066e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/0d65b3ac686649efb7fe9a78c419066e/images/large/4.jpg saved to cache
2026-03-26 22:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9a80622f-dbf6-5ccc-a105-af1847b0b8a4
2026-03-26 22:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F92f3af4e5aea4f3ca5c3dd4c619f1e39%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/92f3af4e5aea4f3ca5c3dd4c619f1e39/images/large/7.jpg not downloaded yet
2026-03-26 22:51:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/0d65b3ac686649efb7fe9a78c419066e/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/0d65b3ac686649efb7fe9a78c419066e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F92f3af4e5aea4f3ca5c3dd4c619f1e39%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/92f3af4e5aea4f3ca5c3dd4c619f1e39/images/large/8.jpg not downloaded yet
2026-03-26 22:51:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cc34d0>
2026-03-26 22:51:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a80622f-dbf6-5ccc-a105-af1847b0b8a4/9a80622f-dbf6-5ccc-a105-af1847b0b8a4_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F0d65b3ac686649efb7fe9a78c419066e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/0d65b3ac686649efb7fe9a78c419066e/images/large/7.jpg saved to cache
2026-03-26 22:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9a80622f-dbf6-5ccc-a105-af1847b0b8a4
2026-03-26 22:51:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b75933d0>
2026-03-26 22:51:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a80622f-dbf6-5ccc-a105-af1847b0b8a4/9a80622f-dbf6-5ccc-a105-af1847b0b8a4_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F0d65b3ac686649efb7fe9a78c419066e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/0d65b3ac686649efb7fe9a78c419066e/images/large/6.jpg saved to cache
2026-03-26 22:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9a80622f-dbf6-5ccc-a105-af1847b0b8a4
2026-03-26 22:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F92f3af4e5aea4f3ca5c3dd4c619f1e39%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/92f3af4e5aea4f3ca5c3dd4c619f1e39/images/large/9.jpg not downloaded yet
2026-03-26 22:51:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/92f3af4e5aea4f3ca5c3dd4c619f1e39/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F92f3af4e5aea4f3ca5c3dd4c619f1e39%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/92f3af4e5aea4f3ca5c3dd4c619f1e39/images/large/10.jpg not downloaded yet
2026-03-26 22:51:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/92f3af4e5aea4f3ca5c3dd4c619f1e39/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:40 [ayvens.be] INFO: Found listing with ID: 1985440
2026-03-26 22:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985440%27 HTTP/1.1" 200 None
2026-03-26 22:51:40 [ayvens.be] INFO: Scrape type for 1985440: 1
2026-03-26 22:51:40 [ayvens.be] INFO: Extracting data for car ID: 1985440
2026-03-26 22:51:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 27122ce6-6efb-57c3-8ae6-24b13bc4abdb with identifier: 1985440
2026-03-26 22:51:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27122ce6-6efb-57c3-8ae6-24b13bc4abdb with scrape type 1
2026-03-26 22:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 27122ce6-6efb-57c3-8ae6-24b13bc4abdb
2026-03-26 22:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ak%252F3d166d7de5194d89ae364b18b4afc213%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ak/3d166d7de5194d89ae364b18b4afc213/images/large/1.jpg not downloaded yet
2026-03-26 22:51:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c76990>
2026-03-26 22:51:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a80622f-dbf6-5ccc-a105-af1847b0b8a4/9a80622f-dbf6-5ccc-a105-af1847b0b8a4_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F0d65b3ac686649efb7fe9a78c419066e%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/0d65b3ac686649efb7fe9a78c419066e/images/large/9.jpg saved to cache
2026-03-26 22:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9a80622f-dbf6-5ccc-a105-af1847b0b8a4
2026-03-26 22:51:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7a61f10>
2026-03-26 22:51:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a80622f-dbf6-5ccc-a105-af1847b0b8a4/9a80622f-dbf6-5ccc-a105-af1847b0b8a4_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F0d65b3ac686649efb7fe9a78c419066e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/0d65b3ac686649efb7fe9a78c419066e/images/large/8.jpg saved to cache
2026-03-26 22:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9a80622f-dbf6-5ccc-a105-af1847b0b8a4
2026-03-26 22:51:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/0d65b3ac686649efb7fe9a78c419066e/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/92f3af4e5aea4f3ca5c3dd4c619f1e39/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ak%252F3d166d7de5194d89ae364b18b4afc213%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ak/3d166d7de5194d89ae364b18b4afc213/images/large/2.jpg not downloaded yet
2026-03-26 22:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ak%252F3d166d7de5194d89ae364b18b4afc213%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ak/3d166d7de5194d89ae364b18b4afc213/images/large/3.jpg not downloaded yet
2026-03-26 22:51:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/92f3af4e5aea4f3ca5c3dd4c619f1e39/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7410710>
2026-03-26 22:51:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_433392de-fd62-5a76-88b4-6ae1052541af/433392de-fd62-5a76-88b4-6ae1052541af_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F92f3af4e5aea4f3ca5c3dd4c619f1e39%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/92f3af4e5aea4f3ca5c3dd4c619f1e39/images/large/1.jpg saved to cache
2026-03-26 22:51:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 433392de-fd62-5a76-88b4-6ae1052541af
2026-03-26 22:51:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7440550>
2026-03-26 22:51:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_433392de-fd62-5a76-88b4-6ae1052541af/433392de-fd62-5a76-88b4-6ae1052541af_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F92f3af4e5aea4f3ca5c3dd4c619f1e39%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/92f3af4e5aea4f3ca5c3dd4c619f1e39/images/large/2.jpg saved to cache
2026-03-26 22:51:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 433392de-fd62-5a76-88b4-6ae1052541af
2026-03-26 22:51:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/92f3af4e5aea4f3ca5c3dd4c619f1e39/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/92f3af4e5aea4f3ca5c3dd4c619f1e39/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ak%252F3d166d7de5194d89ae364b18b4afc213%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ak/3d166d7de5194d89ae364b18b4afc213/images/large/4.jpg not downloaded yet
2026-03-26 22:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ak%252F3d166d7de5194d89ae364b18b4afc213%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ak/3d166d7de5194d89ae364b18b4afc213/images/large/5.jpg not downloaded yet
2026-03-26 22:51:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7aa17d0>
2026-03-26 22:51:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a80622f-dbf6-5ccc-a105-af1847b0b8a4/9a80622f-dbf6-5ccc-a105-af1847b0b8a4_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F0d65b3ac686649efb7fe9a78c419066e%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/0d65b3ac686649efb7fe9a78c419066e/images/large/10.jpg saved to cache
2026-03-26 22:51:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9a80622f-dbf6-5ccc-a105-af1847b0b8a4
2026-03-26 22:51:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9a80622f-dbf6-5ccc-a105-af1847b0b8a4, skipping ID generation
2026-03-26 22:51:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a80622f-dbf6-5ccc-a105-af1847b0b8a4 with scrape type 1
2026-03-26 22:51:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9a80622f-dbf6-5ccc-a105-af1847b0b8a4 sending to next pipeline
2026-03-26 22:51:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 9a80622f-dbf6-5ccc-a105-af1847b0b8a4, identifier: 1985438
2026-03-26 22:51:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80cad3f090>
2026-03-26 22:51:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_433392de-fd62-5a76-88b4-6ae1052541af/433392de-fd62-5a76-88b4-6ae1052541af_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F92f3af4e5aea4f3ca5c3dd4c619f1e39%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/92f3af4e5aea4f3ca5c3dd4c619f1e39/images/large/3.jpg saved to cache
2026-03-26 22:51:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 433392de-fd62-5a76-88b4-6ae1052541af
2026-03-26 22:51:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b729ca50>
2026-03-26 22:51:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_433392de-fd62-5a76-88b4-6ae1052541af/433392de-fd62-5a76-88b4-6ae1052541af_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F92f3af4e5aea4f3ca5c3dd4c619f1e39%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/92f3af4e5aea4f3ca5c3dd4c619f1e39/images/large/5.jpg saved to cache
2026-03-26 22:51:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 433392de-fd62-5a76-88b4-6ae1052541af
2026-03-26 22:51:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 9a80622f-dbf6-5ccc-a105-af1847b0b8a4 with identifier: 1985438
2026-03-26 22:51:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 9a80622f-dbf6-5ccc-a105-af1847b0b8a4 with identifier: 1985438
2026-03-26 22:51:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 9a80622f-dbf6-5ccc-a105-af1847b0b8a4 with identifier: 1985438 to the API
2026-03-26 22:51:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:51:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:51:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bf/0d65b3ac686649efb7fe9a78c419066e/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'electric',
 'id': '9a80622f-dbf6-5ccc-a105-af1847b0b8a4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'IX3',
 'odometer': 139128,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a80622f-dbf6-5ccc-a105-af1847b0b8a4/9a80622f-dbf6-5ccc-a105-af1847b0b8a4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 718750,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/0d65b3ac686649efb7fe9a78c419066e/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a80622f-dbf6-5ccc-a105-af1847b0b8a4/9a80622f-dbf6-5ccc-a105-af1847b0b8a4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 730276,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/0d65b3ac686649efb7fe9a78c419066e/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a80622f-dbf6-5ccc-a105-af1847b0b8a4/9a80622f-dbf6-5ccc-a105-af1847b0b8a4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 761872,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/0d65b3ac686649efb7fe9a78c419066e/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a80622f-dbf6-5ccc-a105-af1847b0b8a4/9a80622f-dbf6-5ccc-a105-af1847b0b8a4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 761480,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/0d65b3ac686649efb7fe9a78c419066e/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a80622f-dbf6-5ccc-a105-af1847b0b8a4/9a80622f-dbf6-5ccc-a105-af1847b0b8a4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 717310,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/0d65b3ac686649efb7fe9a78c419066e/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a80622f-dbf6-5ccc-a105-af1847b0b8a4/9a80622f-dbf6-5ccc-a105-af1847b0b8a4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 784943,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/0d65b3ac686649efb7fe9a78c419066e/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a80622f-dbf6-5ccc-a105-af1847b0b8a4/9a80622f-dbf6-5ccc-a105-af1847b0b8a4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 565118,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/0d65b3ac686649efb7fe9a78c419066e/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a80622f-dbf6-5ccc-a105-af1847b0b8a4/9a80622f-dbf6-5ccc-a105-af1847b0b8a4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 780928,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/0d65b3ac686649efb7fe9a78c419066e/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a80622f-dbf6-5ccc-a105-af1847b0b8a4/9a80622f-dbf6-5ccc-a105-af1847b0b8a4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 820829,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/0d65b3ac686649efb7fe9a78c419066e/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a80622f-dbf6-5ccc-a105-af1847b0b8a4/9a80622f-dbf6-5ccc-a105-af1847b0b8a4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 792326,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/0d65b3ac686649efb7fe9a78c419066e/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW IX3 80KWH AUTO',
 'transmission': 'automatic',
 'trim': '80KWH AUTO',
 'vin': None,
 'year': 2021}
2026-03-26 22:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985438%27 HTTP/1.1" 200 None
2026-03-26 22:51:41 [ayvens.be] INFO: Saving data for 1985438: {'created_time': 1774565501.82198, 'last_price_update_time': 1774565501.821989, 'auction_closing_time': 1774958400.0}
2026-03-26 22:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985438') HTTP/1.1" 204 0
2026-03-26 22:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ak%252F3d166d7de5194d89ae364b18b4afc213%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ak/3d166d7de5194d89ae364b18b4afc213/images/large/6.jpg not downloaded yet
2026-03-26 22:51:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7aa08d0>
2026-03-26 22:51:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_433392de-fd62-5a76-88b4-6ae1052541af/433392de-fd62-5a76-88b4-6ae1052541af_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F92f3af4e5aea4f3ca5c3dd4c619f1e39%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/92f3af4e5aea4f3ca5c3dd4c619f1e39/images/large/4.jpg saved to cache
2026-03-26 22:51:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 433392de-fd62-5a76-88b4-6ae1052541af
2026-03-26 22:51:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c75c10>
2026-03-26 22:51:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_433392de-fd62-5a76-88b4-6ae1052541af/433392de-fd62-5a76-88b4-6ae1052541af_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F92f3af4e5aea4f3ca5c3dd4c619f1e39%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/92f3af4e5aea4f3ca5c3dd4c619f1e39/images/large/6.jpg saved to cache
2026-03-26 22:51:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 433392de-fd62-5a76-88b4-6ae1052541af
2026-03-26 22:51:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/92f3af4e5aea4f3ca5c3dd4c619f1e39/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ak%252F3d166d7de5194d89ae364b18b4afc213%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ak/3d166d7de5194d89ae364b18b4afc213/images/large/7.jpg not downloaded yet
2026-03-26 22:51:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/92f3af4e5aea4f3ca5c3dd4c619f1e39/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/92f3af4e5aea4f3ca5c3dd4c619f1e39/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ak%252F3d166d7de5194d89ae364b18b4afc213%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ak/3d166d7de5194d89ae364b18b4afc213/images/large/8.jpg not downloaded yet
2026-03-26 22:51:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/92f3af4e5aea4f3ca5c3dd4c619f1e39/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ak%252F3d166d7de5194d89ae364b18b4afc213%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ak/3d166d7de5194d89ae364b18b4afc213/images/large/9.jpg not downloaded yet
2026-03-26 22:51:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ak/3d166d7de5194d89ae364b18b4afc213/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ak%252F3d166d7de5194d89ae364b18b4afc213%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ak/3d166d7de5194d89ae364b18b4afc213/images/large/10.jpg not downloaded yet
2026-03-26 22:51:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ak/3d166d7de5194d89ae364b18b4afc213/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ak/3d166d7de5194d89ae364b18b4afc213/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:42 [ayvens.be] INFO: Found listing with ID: 1985441
2026-03-26 22:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985441%27 HTTP/1.1" 200 None
2026-03-26 22:51:42 [ayvens.be] INFO: Scrape type for 1985441: 1
2026-03-26 22:51:42 [ayvens.be] INFO: Extracting data for car ID: 1985441
2026-03-26 22:51:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 86ace69f-baad-5850-800a-8994805bd9da with identifier: 1985441
2026-03-26 22:51:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 86ace69f-baad-5850-800a-8994805bd9da with scrape type 1
2026-03-26 22:51:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 86ace69f-baad-5850-800a-8994805bd9da
2026-03-26 22:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F83eccd7274f04dd1b82db5446bb00de0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/83eccd7274f04dd1b82db5446bb00de0/images/large/1.jpg not downloaded yet
2026-03-26 22:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F83eccd7274f04dd1b82db5446bb00de0%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/83eccd7274f04dd1b82db5446bb00de0/images/large/2.jpg not downloaded yet
2026-03-26 22:51:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ak/3d166d7de5194d89ae364b18b4afc213/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7413510>
2026-03-26 22:51:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_433392de-fd62-5a76-88b4-6ae1052541af/433392de-fd62-5a76-88b4-6ae1052541af_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F92f3af4e5aea4f3ca5c3dd4c619f1e39%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/92f3af4e5aea4f3ca5c3dd4c619f1e39/images/large/7.jpg saved to cache
2026-03-26 22:51:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 433392de-fd62-5a76-88b4-6ae1052541af
2026-03-26 22:51:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79cea10>
2026-03-26 22:51:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_433392de-fd62-5a76-88b4-6ae1052541af/433392de-fd62-5a76-88b4-6ae1052541af_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F92f3af4e5aea4f3ca5c3dd4c619f1e39%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/92f3af4e5aea4f3ca5c3dd4c619f1e39/images/large/8.jpg saved to cache
2026-03-26 22:51:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 433392de-fd62-5a76-88b4-6ae1052541af
2026-03-26 22:51:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e455d0>
2026-03-26 22:51:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_433392de-fd62-5a76-88b4-6ae1052541af/433392de-fd62-5a76-88b4-6ae1052541af_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F92f3af4e5aea4f3ca5c3dd4c619f1e39%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/92f3af4e5aea4f3ca5c3dd4c619f1e39/images/large/9.jpg saved to cache
2026-03-26 22:51:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 433392de-fd62-5a76-88b4-6ae1052541af
2026-03-26 22:51:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79ce090>
2026-03-26 22:51:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_433392de-fd62-5a76-88b4-6ae1052541af/433392de-fd62-5a76-88b4-6ae1052541af_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F92f3af4e5aea4f3ca5c3dd4c619f1e39%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/92f3af4e5aea4f3ca5c3dd4c619f1e39/images/large/10.jpg saved to cache
2026-03-26 22:51:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 433392de-fd62-5a76-88b4-6ae1052541af
2026-03-26 22:51:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 433392de-fd62-5a76-88b4-6ae1052541af, skipping ID generation
2026-03-26 22:51:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 433392de-fd62-5a76-88b4-6ae1052541af with scrape type 1
2026-03-26 22:51:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 433392de-fd62-5a76-88b4-6ae1052541af sending to next pipeline
2026-03-26 22:51:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 433392de-fd62-5a76-88b4-6ae1052541af, identifier: 1985439
2026-03-26 22:51:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd0cf510>
2026-03-26 22:51:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27122ce6-6efb-57c3-8ae6-24b13bc4abdb/27122ce6-6efb-57c3-8ae6-24b13bc4abdb_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ak%252F3d166d7de5194d89ae364b18b4afc213%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ak/3d166d7de5194d89ae364b18b4afc213/images/large/1.jpg saved to cache
2026-03-26 22:51:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 27122ce6-6efb-57c3-8ae6-24b13bc4abdb
2026-03-26 22:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F83eccd7274f04dd1b82db5446bb00de0%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/83eccd7274f04dd1b82db5446bb00de0/images/large/3.jpg not downloaded yet
2026-03-26 22:51:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 433392de-fd62-5a76-88b4-6ae1052541af with identifier: 1985439
2026-03-26 22:51:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 433392de-fd62-5a76-88b4-6ae1052541af with identifier: 1985439
2026-03-26 22:51:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 433392de-fd62-5a76-88b4-6ae1052541af with identifier: 1985439 to the API
2026-03-26 22:51:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:51:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:51:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2dt/92f3af4e5aea4f3ca5c3dd4c619f1e39/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '433392de-fd62-5a76-88b4-6ae1052541af',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF VIII',
 'odometer': 76075,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_433392de-fd62-5a76-88b4-6ae1052541af/433392de-fd62-5a76-88b4-6ae1052541af_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 596508,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/92f3af4e5aea4f3ca5c3dd4c619f1e39/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_433392de-fd62-5a76-88b4-6ae1052541af/433392de-fd62-5a76-88b4-6ae1052541af_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 683451,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/92f3af4e5aea4f3ca5c3dd4c619f1e39/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_433392de-fd62-5a76-88b4-6ae1052541af/433392de-fd62-5a76-88b4-6ae1052541af_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 646633,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/92f3af4e5aea4f3ca5c3dd4c619f1e39/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_433392de-fd62-5a76-88b4-6ae1052541af/433392de-fd62-5a76-88b4-6ae1052541af_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 763678,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/92f3af4e5aea4f3ca5c3dd4c619f1e39/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_433392de-fd62-5a76-88b4-6ae1052541af/433392de-fd62-5a76-88b4-6ae1052541af_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 645121,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/92f3af4e5aea4f3ca5c3dd4c619f1e39/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_433392de-fd62-5a76-88b4-6ae1052541af/433392de-fd62-5a76-88b4-6ae1052541af_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 626924,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/92f3af4e5aea4f3ca5c3dd4c619f1e39/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_433392de-fd62-5a76-88b4-6ae1052541af/433392de-fd62-5a76-88b4-6ae1052541af_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 673894,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/92f3af4e5aea4f3ca5c3dd4c619f1e39/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_433392de-fd62-5a76-88b4-6ae1052541af/433392de-fd62-5a76-88b4-6ae1052541af_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 753598,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/92f3af4e5aea4f3ca5c3dd4c619f1e39/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_433392de-fd62-5a76-88b4-6ae1052541af/433392de-fd62-5a76-88b4-6ae1052541af_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 533821,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/92f3af4e5aea4f3ca5c3dd4c619f1e39/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_433392de-fd62-5a76-88b4-6ae1052541af/433392de-fd62-5a76-88b4-6ae1052541af_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 547460,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/92f3af4e5aea4f3ca5c3dd4c619f1e39/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF VIII 1.4 EHYBRID STYLE BUSINESS DSG',
 'transmission': 'automatic',
 'trim': '1.4 EHYBRID STYLE BUSINESS DSG',
 'vin': None,
 'year': 2023}
2026-03-26 22:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985439%27 HTTP/1.1" 200 None
2026-03-26 22:51:43 [ayvens.be] INFO: Saving data for 1985439: {'created_time': 1774565503.142336, 'last_price_update_time': 1774565503.142346, 'auction_closing_time': 1774958400.0}
2026-03-26 22:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985439') HTTP/1.1" 204 0
2026-03-26 22:51:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7874ed0>
2026-03-26 22:51:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27122ce6-6efb-57c3-8ae6-24b13bc4abdb/27122ce6-6efb-57c3-8ae6-24b13bc4abdb_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ak%252F3d166d7de5194d89ae364b18b4afc213%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ak/3d166d7de5194d89ae364b18b4afc213/images/large/3.jpg saved to cache
2026-03-26 22:51:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 27122ce6-6efb-57c3-8ae6-24b13bc4abdb
2026-03-26 22:51:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7910450>
2026-03-26 22:51:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27122ce6-6efb-57c3-8ae6-24b13bc4abdb/27122ce6-6efb-57c3-8ae6-24b13bc4abdb_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ak%252F3d166d7de5194d89ae364b18b4afc213%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ak/3d166d7de5194d89ae364b18b4afc213/images/large/2.jpg saved to cache
2026-03-26 22:51:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 27122ce6-6efb-57c3-8ae6-24b13bc4abdb
2026-03-26 22:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F83eccd7274f04dd1b82db5446bb00de0%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/83eccd7274f04dd1b82db5446bb00de0/images/large/4.jpg not downloaded yet
2026-03-26 22:51:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74aed50>
2026-03-26 22:51:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27122ce6-6efb-57c3-8ae6-24b13bc4abdb/27122ce6-6efb-57c3-8ae6-24b13bc4abdb_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ak%252F3d166d7de5194d89ae364b18b4afc213%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ak/3d166d7de5194d89ae364b18b4afc213/images/large/4.jpg saved to cache
2026-03-26 22:51:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 27122ce6-6efb-57c3-8ae6-24b13bc4abdb
2026-03-26 22:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F83eccd7274f04dd1b82db5446bb00de0%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/83eccd7274f04dd1b82db5446bb00de0/images/large/5.jpg not downloaded yet
2026-03-26 22:51:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ak/3d166d7de5194d89ae364b18b4afc213/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ak/3d166d7de5194d89ae364b18b4afc213/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F83eccd7274f04dd1b82db5446bb00de0%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/83eccd7274f04dd1b82db5446bb00de0/images/large/6.jpg not downloaded yet
2026-03-26 22:51:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ak/3d166d7de5194d89ae364b18b4afc213/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ak/3d166d7de5194d89ae364b18b4afc213/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ak/3d166d7de5194d89ae364b18b4afc213/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F83eccd7274f04dd1b82db5446bb00de0%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/83eccd7274f04dd1b82db5446bb00de0/images/large/7.jpg not downloaded yet
2026-03-26 22:51:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ak/3d166d7de5194d89ae364b18b4afc213/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F83eccd7274f04dd1b82db5446bb00de0%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/83eccd7274f04dd1b82db5446bb00de0/images/large/8.jpg not downloaded yet
2026-03-26 22:51:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/83eccd7274f04dd1b82db5446bb00de0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F83eccd7274f04dd1b82db5446bb00de0%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/83eccd7274f04dd1b82db5446bb00de0/images/large/9.jpg not downloaded yet
2026-03-26 22:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F83eccd7274f04dd1b82db5446bb00de0%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/83eccd7274f04dd1b82db5446bb00de0/images/large/10.jpg not downloaded yet
2026-03-26 22:51:43 [ayvens.be] INFO: Found listing with ID: 1985442
2026-03-26 22:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985442%27 HTTP/1.1" 200 None
2026-03-26 22:51:43 [ayvens.be] INFO: Scrape type for 1985442: 1
2026-03-26 22:51:43 [ayvens.be] INFO: Extracting data for car ID: 1985442
2026-03-26 22:51:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13cb0d5c-a1ec-528d-8bd3-8c2a28f16419 with identifier: 1985442
2026-03-26 22:51:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13cb0d5c-a1ec-528d-8bd3-8c2a28f16419 with scrape type 1
2026-03-26 22:51:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 13cb0d5c-a1ec-528d-8bd3-8c2a28f16419
2026-03-26 22:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fc285ace5903b42aa86d51a424054bf41%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/c285ace5903b42aa86d51a424054bf41/images/large/1.jpg not downloaded yet
2026-03-26 22:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fc285ace5903b42aa86d51a424054bf41%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/c285ace5903b42aa86d51a424054bf41/images/large/2.jpg not downloaded yet
2026-03-26 22:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fc285ace5903b42aa86d51a424054bf41%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/c285ace5903b42aa86d51a424054bf41/images/large/3.jpg not downloaded yet
2026-03-26 22:51:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74af550>
2026-03-26 22:51:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27122ce6-6efb-57c3-8ae6-24b13bc4abdb/27122ce6-6efb-57c3-8ae6-24b13bc4abdb_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ak%252F3d166d7de5194d89ae364b18b4afc213%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ak/3d166d7de5194d89ae364b18b4afc213/images/large/6.jpg saved to cache
2026-03-26 22:51:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 27122ce6-6efb-57c3-8ae6-24b13bc4abdb
2026-03-26 22:51:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7745010>
2026-03-26 22:51:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27122ce6-6efb-57c3-8ae6-24b13bc4abdb/27122ce6-6efb-57c3-8ae6-24b13bc4abdb_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ak%252F3d166d7de5194d89ae364b18b4afc213%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ak/3d166d7de5194d89ae364b18b4afc213/images/large/5.jpg saved to cache
2026-03-26 22:51:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 27122ce6-6efb-57c3-8ae6-24b13bc4abdb
2026-03-26 22:51:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74047d0>
2026-03-26 22:51:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27122ce6-6efb-57c3-8ae6-24b13bc4abdb/27122ce6-6efb-57c3-8ae6-24b13bc4abdb_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ak%252F3d166d7de5194d89ae364b18b4afc213%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ak/3d166d7de5194d89ae364b18b4afc213/images/large/7.jpg saved to cache
2026-03-26 22:51:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 27122ce6-6efb-57c3-8ae6-24b13bc4abdb
2026-03-26 22:51:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b98ed0>
2026-03-26 22:51:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27122ce6-6efb-57c3-8ae6-24b13bc4abdb/27122ce6-6efb-57c3-8ae6-24b13bc4abdb_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ak%252F3d166d7de5194d89ae364b18b4afc213%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ak/3d166d7de5194d89ae364b18b4afc213/images/large/9.jpg saved to cache
2026-03-26 22:51:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 27122ce6-6efb-57c3-8ae6-24b13bc4abdb
2026-03-26 22:51:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b782f710>
2026-03-26 22:51:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27122ce6-6efb-57c3-8ae6-24b13bc4abdb/27122ce6-6efb-57c3-8ae6-24b13bc4abdb_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ak%252F3d166d7de5194d89ae364b18b4afc213%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ak/3d166d7de5194d89ae364b18b4afc213/images/large/10.jpg saved to cache
2026-03-26 22:51:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 27122ce6-6efb-57c3-8ae6-24b13bc4abdb
2026-03-26 22:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fc285ace5903b42aa86d51a424054bf41%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/c285ace5903b42aa86d51a424054bf41/images/large/4.jpg not downloaded yet
2026-03-26 22:51:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c69010>
2026-03-26 22:51:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27122ce6-6efb-57c3-8ae6-24b13bc4abdb/27122ce6-6efb-57c3-8ae6-24b13bc4abdb_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ak%252F3d166d7de5194d89ae364b18b4afc213%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ak/3d166d7de5194d89ae364b18b4afc213/images/large/8.jpg saved to cache
2026-03-26 22:51:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 27122ce6-6efb-57c3-8ae6-24b13bc4abdb
2026-03-26 22:51:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 27122ce6-6efb-57c3-8ae6-24b13bc4abdb, skipping ID generation
2026-03-26 22:51:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27122ce6-6efb-57c3-8ae6-24b13bc4abdb with scrape type 1
2026-03-26 22:51:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 27122ce6-6efb-57c3-8ae6-24b13bc4abdb sending to next pipeline
2026-03-26 22:51:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 27122ce6-6efb-57c3-8ae6-24b13bc4abdb, identifier: 1985440
2026-03-26 22:51:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 27122ce6-6efb-57c3-8ae6-24b13bc4abdb with identifier: 1985440
2026-03-26 22:51:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 27122ce6-6efb-57c3-8ae6-24b13bc4abdb with identifier: 1985440
2026-03-26 22:51:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 27122ce6-6efb-57c3-8ae6-24b13bc4abdb with identifier: 1985440 to the API
2026-03-26 22:51:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:51:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:51:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ak/3d166d7de5194d89ae364b18b4afc213/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '27122ce6-6efb-57c3-8ae6-24b13bc4abdb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'CITROAu2039N',
 'model': 'C5 AIRCROSS',
 'odometer': 81085,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27122ce6-6efb-57c3-8ae6-24b13bc4abdb/27122ce6-6efb-57c3-8ae6-24b13bc4abdb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 666555,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ak/3d166d7de5194d89ae364b18b4afc213/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27122ce6-6efb-57c3-8ae6-24b13bc4abdb/27122ce6-6efb-57c3-8ae6-24b13bc4abdb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 684096,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ak/3d166d7de5194d89ae364b18b4afc213/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27122ce6-6efb-57c3-8ae6-24b13bc4abdb/27122ce6-6efb-57c3-8ae6-24b13bc4abdb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 639520,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ak/3d166d7de5194d89ae364b18b4afc213/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27122ce6-6efb-57c3-8ae6-24b13bc4abdb/27122ce6-6efb-57c3-8ae6-24b13bc4abdb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 716711,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ak/3d166d7de5194d89ae364b18b4afc213/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27122ce6-6efb-57c3-8ae6-24b13bc4abdb/27122ce6-6efb-57c3-8ae6-24b13bc4abdb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 601049,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ak/3d166d7de5194d89ae364b18b4afc213/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27122ce6-6efb-57c3-8ae6-24b13bc4abdb/27122ce6-6efb-57c3-8ae6-24b13bc4abdb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 589435,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ak/3d166d7de5194d89ae364b18b4afc213/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27122ce6-6efb-57c3-8ae6-24b13bc4abdb/27122ce6-6efb-57c3-8ae6-24b13bc4abdb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 649898,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ak/3d166d7de5194d89ae364b18b4afc213/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27122ce6-6efb-57c3-8ae6-24b13bc4abdb/27122ce6-6efb-57c3-8ae6-24b13bc4abdb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 724559,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ak/3d166d7de5194d89ae364b18b4afc213/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27122ce6-6efb-57c3-8ae6-24b13bc4abdb/27122ce6-6efb-57c3-8ae6-24b13bc4abdb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 411908,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ak/3d166d7de5194d89ae364b18b4afc213/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27122ce6-6efb-57c3-8ae6-24b13bc4abdb/27122ce6-6efb-57c3-8ae6-24b13bc4abdb_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 486175,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ak/3d166d7de5194d89ae364b18b4afc213/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROAu2039N C5 AIRCROSS 1.6 HYBRID 225 E-EAT8 SHINE AUTO',
 'transmission': 'automatic',
 'trim': '1.6 HYBRID 225 E-EAT8 SHINE AUTO',
 'vin': None,
 'year': 2021}
2026-03-26 22:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985440%27 HTTP/1.1" 200 None
2026-03-26 22:51:44 [ayvens.be] INFO: Saving data for 1985440: {'created_time': 1774565504.660343, 'last_price_update_time': 1774565504.660353, 'auction_closing_time': 1774958400.0}
2026-03-26 22:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985440') HTTP/1.1" 204 0
2026-03-26 22:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fc285ace5903b42aa86d51a424054bf41%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/c285ace5903b42aa86d51a424054bf41/images/large/5.jpg not downloaded yet
2026-03-26 22:51:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7876bd0>
2026-03-26 22:51:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86ace69f-baad-5850-800a-8994805bd9da/86ace69f-baad-5850-800a-8994805bd9da_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F83eccd7274f04dd1b82db5446bb00de0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/83eccd7274f04dd1b82db5446bb00de0/images/large/1.jpg saved to cache
2026-03-26 22:51:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 86ace69f-baad-5850-800a-8994805bd9da
2026-03-26 22:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fc285ace5903b42aa86d51a424054bf41%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/c285ace5903b42aa86d51a424054bf41/images/large/6.jpg not downloaded yet
2026-03-26 22:51:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/83eccd7274f04dd1b82db5446bb00de0/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fc285ace5903b42aa86d51a424054bf41%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/c285ace5903b42aa86d51a424054bf41/images/large/7.jpg not downloaded yet
2026-03-26 22:51:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/83eccd7274f04dd1b82db5446bb00de0/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/83eccd7274f04dd1b82db5446bb00de0/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/83eccd7274f04dd1b82db5446bb00de0/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fc285ace5903b42aa86d51a424054bf41%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/c285ace5903b42aa86d51a424054bf41/images/large/8.jpg not downloaded yet
2026-03-26 22:51:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/83eccd7274f04dd1b82db5446bb00de0/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/83eccd7274f04dd1b82db5446bb00de0/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/83eccd7274f04dd1b82db5446bb00de0/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/83eccd7274f04dd1b82db5446bb00de0/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fc285ace5903b42aa86d51a424054bf41%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/c285ace5903b42aa86d51a424054bf41/images/large/9.jpg not downloaded yet
2026-03-26 22:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fc285ace5903b42aa86d51a424054bf41%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/c285ace5903b42aa86d51a424054bf41/images/large/10.jpg not downloaded yet
2026-03-26 22:51:44 [ayvens.be] INFO: Found listing with ID: 1985443
2026-03-26 22:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985443%27 HTTP/1.1" 200 None
2026-03-26 22:51:44 [ayvens.be] INFO: Scrape type for 1985443: 1
2026-03-26 22:51:44 [ayvens.be] INFO: Extracting data for car ID: 1985443
2026-03-26 22:51:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f95e3aae-a4af-5899-ae14-85507159c18e with identifier: 1985443
2026-03-26 22:51:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f95e3aae-a4af-5899-ae14-85507159c18e with scrape type 1
2026-03-26 22:51:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f95e3aae-a4af-5899-ae14-85507159c18e
2026-03-26 22:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F0443deefe1f441868fce24d38ceba9be%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/0443deefe1f441868fce24d38ceba9be/images/large/1.jpg not downloaded yet
2026-03-26 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F0443deefe1f441868fce24d38ceba9be%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/0443deefe1f441868fce24d38ceba9be/images/large/2.jpg not downloaded yet
2026-03-26 22:51:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6df3910>
2026-03-26 22:51:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86ace69f-baad-5850-800a-8994805bd9da/86ace69f-baad-5850-800a-8994805bd9da_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F83eccd7274f04dd1b82db5446bb00de0%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/83eccd7274f04dd1b82db5446bb00de0/images/large/5.jpg saved to cache
2026-03-26 22:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 86ace69f-baad-5850-800a-8994805bd9da
2026-03-26 22:51:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7278410>
2026-03-26 22:51:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86ace69f-baad-5850-800a-8994805bd9da/86ace69f-baad-5850-800a-8994805bd9da_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F83eccd7274f04dd1b82db5446bb00de0%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/83eccd7274f04dd1b82db5446bb00de0/images/large/6.jpg saved to cache
2026-03-26 22:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 86ace69f-baad-5850-800a-8994805bd9da
2026-03-26 22:51:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79a5390>
2026-03-26 22:51:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86ace69f-baad-5850-800a-8994805bd9da/86ace69f-baad-5850-800a-8994805bd9da_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F83eccd7274f04dd1b82db5446bb00de0%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/83eccd7274f04dd1b82db5446bb00de0/images/large/8.jpg saved to cache
2026-03-26 22:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 86ace69f-baad-5850-800a-8994805bd9da
2026-03-26 22:51:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7474150>
2026-03-26 22:51:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86ace69f-baad-5850-800a-8994805bd9da/86ace69f-baad-5850-800a-8994805bd9da_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F83eccd7274f04dd1b82db5446bb00de0%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/83eccd7274f04dd1b82db5446bb00de0/images/large/3.jpg saved to cache
2026-03-26 22:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 86ace69f-baad-5850-800a-8994805bd9da
2026-03-26 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F0443deefe1f441868fce24d38ceba9be%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/0443deefe1f441868fce24d38ceba9be/images/large/3.jpg not downloaded yet
2026-03-26 22:51:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7980390>
2026-03-26 22:51:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86ace69f-baad-5850-800a-8994805bd9da/86ace69f-baad-5850-800a-8994805bd9da_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F83eccd7274f04dd1b82db5446bb00de0%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/83eccd7274f04dd1b82db5446bb00de0/images/large/2.jpg saved to cache
2026-03-26 22:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 86ace69f-baad-5850-800a-8994805bd9da
2026-03-26 22:51:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c5c390>
2026-03-26 22:51:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86ace69f-baad-5850-800a-8994805bd9da/86ace69f-baad-5850-800a-8994805bd9da_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F83eccd7274f04dd1b82db5446bb00de0%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/83eccd7274f04dd1b82db5446bb00de0/images/large/7.jpg saved to cache
2026-03-26 22:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 86ace69f-baad-5850-800a-8994805bd9da
2026-03-26 22:51:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76cfe90>
2026-03-26 22:51:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86ace69f-baad-5850-800a-8994805bd9da/86ace69f-baad-5850-800a-8994805bd9da_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F83eccd7274f04dd1b82db5446bb00de0%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/83eccd7274f04dd1b82db5446bb00de0/images/large/4.jpg saved to cache
2026-03-26 22:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 86ace69f-baad-5850-800a-8994805bd9da
2026-03-26 22:51:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c80410>
2026-03-26 22:51:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86ace69f-baad-5850-800a-8994805bd9da/86ace69f-baad-5850-800a-8994805bd9da_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F83eccd7274f04dd1b82db5446bb00de0%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/83eccd7274f04dd1b82db5446bb00de0/images/large/9.jpg saved to cache
2026-03-26 22:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 86ace69f-baad-5850-800a-8994805bd9da
2026-03-26 22:51:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/c285ace5903b42aa86d51a424054bf41/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/c285ace5903b42aa86d51a424054bf41/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/c285ace5903b42aa86d51a424054bf41/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F0443deefe1f441868fce24d38ceba9be%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/0443deefe1f441868fce24d38ceba9be/images/large/4.jpg not downloaded yet
2026-03-26 22:51:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/c285ace5903b42aa86d51a424054bf41/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/c285ace5903b42aa86d51a424054bf41/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/c285ace5903b42aa86d51a424054bf41/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F0443deefe1f441868fce24d38ceba9be%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/0443deefe1f441868fce24d38ceba9be/images/large/5.jpg not downloaded yet
2026-03-26 22:51:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/c285ace5903b42aa86d51a424054bf41/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F0443deefe1f441868fce24d38ceba9be%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/0443deefe1f441868fce24d38ceba9be/images/large/6.jpg not downloaded yet
2026-03-26 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F0443deefe1f441868fce24d38ceba9be%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/0443deefe1f441868fce24d38ceba9be/images/large/7.jpg not downloaded yet
2026-03-26 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F0443deefe1f441868fce24d38ceba9be%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/0443deefe1f441868fce24d38ceba9be/images/large/8.jpg not downloaded yet
2026-03-26 22:51:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/83eccd7274f04dd1b82db5446bb00de0/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F0443deefe1f441868fce24d38ceba9be%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/0443deefe1f441868fce24d38ceba9be/images/large/9.jpg not downloaded yet
2026-03-26 22:51:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c5d610>
2026-03-26 22:51:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13cb0d5c-a1ec-528d-8bd3-8c2a28f16419/13cb0d5c-a1ec-528d-8bd3-8c2a28f16419_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fc285ace5903b42aa86d51a424054bf41%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/c285ace5903b42aa86d51a424054bf41/images/large/2.jpg saved to cache
2026-03-26 22:51:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 13cb0d5c-a1ec-528d-8bd3-8c2a28f16419
2026-03-26 22:51:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76ee510>
2026-03-26 22:51:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13cb0d5c-a1ec-528d-8bd3-8c2a28f16419/13cb0d5c-a1ec-528d-8bd3-8c2a28f16419_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fc285ace5903b42aa86d51a424054bf41%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/c285ace5903b42aa86d51a424054bf41/images/large/6.jpg saved to cache
2026-03-26 22:51:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 13cb0d5c-a1ec-528d-8bd3-8c2a28f16419
2026-03-26 22:51:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b72790d0>
2026-03-26 22:51:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13cb0d5c-a1ec-528d-8bd3-8c2a28f16419/13cb0d5c-a1ec-528d-8bd3-8c2a28f16419_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fc285ace5903b42aa86d51a424054bf41%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/c285ace5903b42aa86d51a424054bf41/images/large/5.jpg saved to cache
2026-03-26 22:51:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 13cb0d5c-a1ec-528d-8bd3-8c2a28f16419
2026-03-26 22:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F0443deefe1f441868fce24d38ceba9be%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/0443deefe1f441868fce24d38ceba9be/images/large/10.jpg not downloaded yet
2026-03-26 22:51:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/c285ace5903b42aa86d51a424054bf41/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79f1610>
2026-03-26 22:51:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13cb0d5c-a1ec-528d-8bd3-8c2a28f16419/13cb0d5c-a1ec-528d-8bd3-8c2a28f16419_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fc285ace5903b42aa86d51a424054bf41%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/c285ace5903b42aa86d51a424054bf41/images/large/4.jpg saved to cache
2026-03-26 22:51:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 13cb0d5c-a1ec-528d-8bd3-8c2a28f16419
2026-03-26 22:51:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79f0410>
2026-03-26 22:51:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13cb0d5c-a1ec-528d-8bd3-8c2a28f16419/13cb0d5c-a1ec-528d-8bd3-8c2a28f16419_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fc285ace5903b42aa86d51a424054bf41%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/c285ace5903b42aa86d51a424054bf41/images/large/3.jpg saved to cache
2026-03-26 22:51:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 13cb0d5c-a1ec-528d-8bd3-8c2a28f16419
2026-03-26 22:51:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7400fd0>
2026-03-26 22:51:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13cb0d5c-a1ec-528d-8bd3-8c2a28f16419/13cb0d5c-a1ec-528d-8bd3-8c2a28f16419_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fc285ace5903b42aa86d51a424054bf41%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/c285ace5903b42aa86d51a424054bf41/images/large/1.jpg saved to cache
2026-03-26 22:51:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 13cb0d5c-a1ec-528d-8bd3-8c2a28f16419
2026-03-26 22:51:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/c285ace5903b42aa86d51a424054bf41/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:46 [ayvens.be] INFO: Found listing with ID: 1985444
2026-03-26 22:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985444%27 HTTP/1.1" 200 None
2026-03-26 22:51:46 [ayvens.be] INFO: Scrape type for 1985444: 1
2026-03-26 22:51:46 [ayvens.be] INFO: Extracting data for car ID: 1985444
2026-03-26 22:51:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b68f2489-e4bd-53cf-9df3-8a995c530188 with identifier: 1985444
2026-03-26 22:51:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b68f2489-e4bd-53cf-9df3-8a995c530188 with scrape type 1
2026-03-26 22:51:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b68f2489-e4bd-53cf-9df3-8a995c530188
2026-03-26 22:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Ffcab1ffecdbe4bb283a3c90f2168aa76%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/fcab1ffecdbe4bb283a3c90f2168aa76/images/large/1.jpg not downloaded yet
2026-03-26 22:51:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/0443deefe1f441868fce24d38ceba9be/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Ffcab1ffecdbe4bb283a3c90f2168aa76%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/fcab1ffecdbe4bb283a3c90f2168aa76/images/large/2.jpg not downloaded yet
2026-03-26 22:51:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79a22d0>
2026-03-26 22:51:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13cb0d5c-a1ec-528d-8bd3-8c2a28f16419/13cb0d5c-a1ec-528d-8bd3-8c2a28f16419_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fc285ace5903b42aa86d51a424054bf41%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/c285ace5903b42aa86d51a424054bf41/images/large/7.jpg saved to cache
2026-03-26 22:51:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 13cb0d5c-a1ec-528d-8bd3-8c2a28f16419
2026-03-26 22:51:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7648410>
2026-03-26 22:51:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86ace69f-baad-5850-800a-8994805bd9da/86ace69f-baad-5850-800a-8994805bd9da_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F83eccd7274f04dd1b82db5446bb00de0%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/83eccd7274f04dd1b82db5446bb00de0/images/large/10.jpg saved to cache
2026-03-26 22:51:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 86ace69f-baad-5850-800a-8994805bd9da
2026-03-26 22:51:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 86ace69f-baad-5850-800a-8994805bd9da, skipping ID generation
2026-03-26 22:51:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 86ace69f-baad-5850-800a-8994805bd9da with scrape type 1
2026-03-26 22:51:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 86ace69f-baad-5850-800a-8994805bd9da sending to next pipeline
2026-03-26 22:51:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 86ace69f-baad-5850-800a-8994805bd9da, identifier: 1985441
2026-03-26 22:51:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7290a10>
2026-03-26 22:51:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13cb0d5c-a1ec-528d-8bd3-8c2a28f16419/13cb0d5c-a1ec-528d-8bd3-8c2a28f16419_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fc285ace5903b42aa86d51a424054bf41%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/c285ace5903b42aa86d51a424054bf41/images/large/10.jpg saved to cache
2026-03-26 22:51:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 13cb0d5c-a1ec-528d-8bd3-8c2a28f16419
2026-03-26 22:51:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/c285ace5903b42aa86d51a424054bf41/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 86ace69f-baad-5850-800a-8994805bd9da with identifier: 1985441
2026-03-26 22:51:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 86ace69f-baad-5850-800a-8994805bd9da with identifier: 1985441
2026-03-26 22:51:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 86ace69f-baad-5850-800a-8994805bd9da with identifier: 1985441 to the API
2026-03-26 22:51:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:51:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:51:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ab/83eccd7274f04dd1b82db5446bb00de0/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '86ace69f-baad-5850-800a-8994805bd9da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X2',
 'odometer': 122499,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86ace69f-baad-5850-800a-8994805bd9da/86ace69f-baad-5850-800a-8994805bd9da_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 694142,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/83eccd7274f04dd1b82db5446bb00de0/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86ace69f-baad-5850-800a-8994805bd9da/86ace69f-baad-5850-800a-8994805bd9da_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 709000,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/83eccd7274f04dd1b82db5446bb00de0/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86ace69f-baad-5850-800a-8994805bd9da/86ace69f-baad-5850-800a-8994805bd9da_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 662314,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/83eccd7274f04dd1b82db5446bb00de0/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86ace69f-baad-5850-800a-8994805bd9da/86ace69f-baad-5850-800a-8994805bd9da_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 718589,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/83eccd7274f04dd1b82db5446bb00de0/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86ace69f-baad-5850-800a-8994805bd9da/86ace69f-baad-5850-800a-8994805bd9da_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 698819,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/83eccd7274f04dd1b82db5446bb00de0/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86ace69f-baad-5850-800a-8994805bd9da/86ace69f-baad-5850-800a-8994805bd9da_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 733718,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/83eccd7274f04dd1b82db5446bb00de0/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86ace69f-baad-5850-800a-8994805bd9da/86ace69f-baad-5850-800a-8994805bd9da_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 589152,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/83eccd7274f04dd1b82db5446bb00de0/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86ace69f-baad-5850-800a-8994805bd9da/86ace69f-baad-5850-800a-8994805bd9da_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 726084,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/83eccd7274f04dd1b82db5446bb00de0/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86ace69f-baad-5850-800a-8994805bd9da/86ace69f-baad-5850-800a-8994805bd9da_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 653527,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/83eccd7274f04dd1b82db5446bb00de0/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86ace69f-baad-5850-800a-8994805bd9da/86ace69f-baad-5850-800a-8994805bd9da_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 669687,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/83eccd7274f04dd1b82db5446bb00de0/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X2 1.5 XDRIVE25E PHEV 162KW)',
 'transmission': 'automatic',
 'trim': '1.5 XDRIVE25E PHEV 162KW)',
 'vin': None,
 'year': 2021}
2026-03-26 22:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985441%27 HTTP/1.1" 200 None
2026-03-26 22:51:47 [ayvens.be] INFO: Saving data for 1985441: {'created_time': 1774565507.380706, 'last_price_update_time': 1774565507.380719, 'auction_closing_time': 1774958400.0}
2026-03-26 22:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985441') HTTP/1.1" 204 0
2026-03-26 22:51:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/0443deefe1f441868fce24d38ceba9be/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Ffcab1ffecdbe4bb283a3c90f2168aa76%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/fcab1ffecdbe4bb283a3c90f2168aa76/images/large/3.jpg not downloaded yet
2026-03-26 22:51:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/0443deefe1f441868fce24d38ceba9be/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/0443deefe1f441868fce24d38ceba9be/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/0443deefe1f441868fce24d38ceba9be/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Ffcab1ffecdbe4bb283a3c90f2168aa76%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/fcab1ffecdbe4bb283a3c90f2168aa76/images/large/4.jpg not downloaded yet
2026-03-26 22:51:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b726ab90>
2026-03-26 22:51:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13cb0d5c-a1ec-528d-8bd3-8c2a28f16419/13cb0d5c-a1ec-528d-8bd3-8c2a28f16419_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fc285ace5903b42aa86d51a424054bf41%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/c285ace5903b42aa86d51a424054bf41/images/large/9.jpg saved to cache
2026-03-26 22:51:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 13cb0d5c-a1ec-528d-8bd3-8c2a28f16419
2026-03-26 22:51:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77d5e10>
2026-03-26 22:51:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f95e3aae-a4af-5899-ae14-85507159c18e/f95e3aae-a4af-5899-ae14-85507159c18e_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F0443deefe1f441868fce24d38ceba9be%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/0443deefe1f441868fce24d38ceba9be/images/large/2.jpg saved to cache
2026-03-26 22:51:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f95e3aae-a4af-5899-ae14-85507159c18e
2026-03-26 22:51:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74432d0>
2026-03-26 22:51:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13cb0d5c-a1ec-528d-8bd3-8c2a28f16419/13cb0d5c-a1ec-528d-8bd3-8c2a28f16419_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fc285ace5903b42aa86d51a424054bf41%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/c285ace5903b42aa86d51a424054bf41/images/large/8.jpg saved to cache
2026-03-26 22:51:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 13cb0d5c-a1ec-528d-8bd3-8c2a28f16419
2026-03-26 22:51:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 13cb0d5c-a1ec-528d-8bd3-8c2a28f16419, skipping ID generation
2026-03-26 22:51:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13cb0d5c-a1ec-528d-8bd3-8c2a28f16419 with scrape type 1
2026-03-26 22:51:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 13cb0d5c-a1ec-528d-8bd3-8c2a28f16419 sending to next pipeline
2026-03-26 22:51:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 13cb0d5c-a1ec-528d-8bd3-8c2a28f16419, identifier: 1985442
2026-03-26 22:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Ffcab1ffecdbe4bb283a3c90f2168aa76%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/fcab1ffecdbe4bb283a3c90f2168aa76/images/large/5.jpg not downloaded yet
2026-03-26 22:51:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 13cb0d5c-a1ec-528d-8bd3-8c2a28f16419 with identifier: 1985442
2026-03-26 22:51:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 13cb0d5c-a1ec-528d-8bd3-8c2a28f16419 with identifier: 1985442
2026-03-26 22:51:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 13cb0d5c-a1ec-528d-8bd3-8c2a28f16419 with identifier: 1985442 to the API
2026-03-26 22:51:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:51:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:51:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bm/c285ace5903b42aa86d51a424054bf41/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '13cb0d5c-a1ec-528d-8bd3-8c2a28f16419',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'GRAND C4 SPACETOURER',
 'odometer': 70990,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13cb0d5c-a1ec-528d-8bd3-8c2a28f16419/13cb0d5c-a1ec-528d-8bd3-8c2a28f16419_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 324659,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/c285ace5903b42aa86d51a424054bf41/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13cb0d5c-a1ec-528d-8bd3-8c2a28f16419/13cb0d5c-a1ec-528d-8bd3-8c2a28f16419_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 323063,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/c285ace5903b42aa86d51a424054bf41/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13cb0d5c-a1ec-528d-8bd3-8c2a28f16419/13cb0d5c-a1ec-528d-8bd3-8c2a28f16419_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 320884,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/c285ace5903b42aa86d51a424054bf41/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13cb0d5c-a1ec-528d-8bd3-8c2a28f16419/13cb0d5c-a1ec-528d-8bd3-8c2a28f16419_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 325755,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/c285ace5903b42aa86d51a424054bf41/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13cb0d5c-a1ec-528d-8bd3-8c2a28f16419/13cb0d5c-a1ec-528d-8bd3-8c2a28f16419_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 302565,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/c285ace5903b42aa86d51a424054bf41/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13cb0d5c-a1ec-528d-8bd3-8c2a28f16419/13cb0d5c-a1ec-528d-8bd3-8c2a28f16419_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 288449,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/c285ace5903b42aa86d51a424054bf41/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13cb0d5c-a1ec-528d-8bd3-8c2a28f16419/13cb0d5c-a1ec-528d-8bd3-8c2a28f16419_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 328855,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/c285ace5903b42aa86d51a424054bf41/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13cb0d5c-a1ec-528d-8bd3-8c2a28f16419/13cb0d5c-a1ec-528d-8bd3-8c2a28f16419_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 347304,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/c285ace5903b42aa86d51a424054bf41/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13cb0d5c-a1ec-528d-8bd3-8c2a28f16419/13cb0d5c-a1ec-528d-8bd3-8c2a28f16419_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 359420,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/c285ace5903b42aa86d51a424054bf41/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13cb0d5c-a1ec-528d-8bd3-8c2a28f16419/13cb0d5c-a1ec-528d-8bd3-8c2a28f16419_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 240162,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/c285ace5903b42aa86d51a424054bf41/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-18',
 'seats_number': 7,
 'seller_name': None,
 'title': 'CITROËN GRAND C4 SPACETOURER 1.2 PURETECH 130 S-S SHINE',
 'transmission': 'manual',
 'trim': '1.2 PURETECH 130 S-S SHINE',
 'vin': None,
 'year': 2022}
2026-03-26 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985442%27 HTTP/1.1" 200 None
2026-03-26 22:51:48 [ayvens.be] INFO: Saving data for 1985442: {'created_time': 1774565508.093884, 'last_price_update_time': 1774565508.093894, 'auction_closing_time': 1774958400.0}
2026-03-26 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985442') HTTP/1.1" 204 0
2026-03-26 22:51:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/0443deefe1f441868fce24d38ceba9be/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Ffcab1ffecdbe4bb283a3c90f2168aa76%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/fcab1ffecdbe4bb283a3c90f2168aa76/images/large/6.jpg not downloaded yet
2026-03-26 22:51:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7876ed0>
2026-03-26 22:51:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f95e3aae-a4af-5899-ae14-85507159c18e/f95e3aae-a4af-5899-ae14-85507159c18e_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F0443deefe1f441868fce24d38ceba9be%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/0443deefe1f441868fce24d38ceba9be/images/large/3.jpg saved to cache
2026-03-26 22:51:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f95e3aae-a4af-5899-ae14-85507159c18e
2026-03-26 22:51:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77711d0>
2026-03-26 22:51:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f95e3aae-a4af-5899-ae14-85507159c18e/f95e3aae-a4af-5899-ae14-85507159c18e_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F0443deefe1f441868fce24d38ceba9be%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/0443deefe1f441868fce24d38ceba9be/images/large/1.jpg saved to cache
2026-03-26 22:51:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f95e3aae-a4af-5899-ae14-85507159c18e
2026-03-26 22:51:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79a7910>
2026-03-26 22:51:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f95e3aae-a4af-5899-ae14-85507159c18e/f95e3aae-a4af-5899-ae14-85507159c18e_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F0443deefe1f441868fce24d38ceba9be%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/0443deefe1f441868fce24d38ceba9be/images/large/5.jpg saved to cache
2026-03-26 22:51:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f95e3aae-a4af-5899-ae14-85507159c18e
2026-03-26 22:51:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80cad3d850>
2026-03-26 22:51:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f95e3aae-a4af-5899-ae14-85507159c18e/f95e3aae-a4af-5899-ae14-85507159c18e_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F0443deefe1f441868fce24d38ceba9be%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/0443deefe1f441868fce24d38ceba9be/images/large/4.jpg saved to cache
2026-03-26 22:51:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f95e3aae-a4af-5899-ae14-85507159c18e
2026-03-26 22:51:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/0443deefe1f441868fce24d38ceba9be/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/0443deefe1f441868fce24d38ceba9be/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Ffcab1ffecdbe4bb283a3c90f2168aa76%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/fcab1ffecdbe4bb283a3c90f2168aa76/images/large/7.jpg not downloaded yet
2026-03-26 22:51:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/fcab1ffecdbe4bb283a3c90f2168aa76/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/fcab1ffecdbe4bb283a3c90f2168aa76/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/0443deefe1f441868fce24d38ceba9be/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/0443deefe1f441868fce24d38ceba9be/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Ffcab1ffecdbe4bb283a3c90f2168aa76%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/fcab1ffecdbe4bb283a3c90f2168aa76/images/large/8.jpg not downloaded yet
2026-03-26 22:51:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79cdc50>
2026-03-26 22:51:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f95e3aae-a4af-5899-ae14-85507159c18e/f95e3aae-a4af-5899-ae14-85507159c18e_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F0443deefe1f441868fce24d38ceba9be%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/0443deefe1f441868fce24d38ceba9be/images/large/6.jpg saved to cache
2026-03-26 22:51:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f95e3aae-a4af-5899-ae14-85507159c18e
2026-03-26 22:51:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/fcab1ffecdbe4bb283a3c90f2168aa76/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Ffcab1ffecdbe4bb283a3c90f2168aa76%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/fcab1ffecdbe4bb283a3c90f2168aa76/images/large/9.jpg not downloaded yet
2026-03-26 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Ffcab1ffecdbe4bb283a3c90f2168aa76%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/fcab1ffecdbe4bb283a3c90f2168aa76/images/large/10.jpg not downloaded yet
2026-03-26 22:51:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c827d0>
2026-03-26 22:51:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f95e3aae-a4af-5899-ae14-85507159c18e/f95e3aae-a4af-5899-ae14-85507159c18e_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F0443deefe1f441868fce24d38ceba9be%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/0443deefe1f441868fce24d38ceba9be/images/large/7.jpg saved to cache
2026-03-26 22:51:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f95e3aae-a4af-5899-ae14-85507159c18e
2026-03-26 22:51:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c5f710>
2026-03-26 22:51:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f95e3aae-a4af-5899-ae14-85507159c18e/f95e3aae-a4af-5899-ae14-85507159c18e_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F0443deefe1f441868fce24d38ceba9be%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/0443deefe1f441868fce24d38ceba9be/images/large/8.jpg saved to cache
2026-03-26 22:51:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f95e3aae-a4af-5899-ae14-85507159c18e
2026-03-26 22:51:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79a7d50>
2026-03-26 22:51:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b68f2489-e4bd-53cf-9df3-8a995c530188/b68f2489-e4bd-53cf-9df3-8a995c530188_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Ffcab1ffecdbe4bb283a3c90f2168aa76%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/fcab1ffecdbe4bb283a3c90f2168aa76/images/large/1.jpg saved to cache
2026-03-26 22:51:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b68f2489-e4bd-53cf-9df3-8a995c530188
2026-03-26 22:51:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7aa37d0>
2026-03-26 22:51:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b68f2489-e4bd-53cf-9df3-8a995c530188/b68f2489-e4bd-53cf-9df3-8a995c530188_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Ffcab1ffecdbe4bb283a3c90f2168aa76%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/fcab1ffecdbe4bb283a3c90f2168aa76/images/large/2.jpg saved to cache
2026-03-26 22:51:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b68f2489-e4bd-53cf-9df3-8a995c530188
2026-03-26 22:51:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b17550>
2026-03-26 22:51:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f95e3aae-a4af-5899-ae14-85507159c18e/f95e3aae-a4af-5899-ae14-85507159c18e_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F0443deefe1f441868fce24d38ceba9be%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/0443deefe1f441868fce24d38ceba9be/images/large/10.jpg saved to cache
2026-03-26 22:51:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f95e3aae-a4af-5899-ae14-85507159c18e
2026-03-26 22:51:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6df2010>
2026-03-26 22:51:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f95e3aae-a4af-5899-ae14-85507159c18e/f95e3aae-a4af-5899-ae14-85507159c18e_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F0443deefe1f441868fce24d38ceba9be%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/0443deefe1f441868fce24d38ceba9be/images/large/9.jpg saved to cache
2026-03-26 22:51:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f95e3aae-a4af-5899-ae14-85507159c18e
2026-03-26 22:51:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f95e3aae-a4af-5899-ae14-85507159c18e, skipping ID generation
2026-03-26 22:51:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f95e3aae-a4af-5899-ae14-85507159c18e with scrape type 1
2026-03-26 22:51:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f95e3aae-a4af-5899-ae14-85507159c18e sending to next pipeline
2026-03-26 22:51:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f95e3aae-a4af-5899-ae14-85507159c18e, identifier: 1985443
2026-03-26 22:51:49 [ayvens.be] INFO: Found listing with ID: 1985445
2026-03-26 22:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985445%27 HTTP/1.1" 200 None
2026-03-26 22:51:49 [ayvens.be] INFO: Scrape type for 1985445: 1
2026-03-26 22:51:49 [ayvens.be] INFO: Extracting data for car ID: 1985445
2026-03-26 22:51:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ce88cda-37cc-5ed6-9dc9-8eef121d5db6 with identifier: 1985445
2026-03-26 22:51:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ce88cda-37cc-5ed6-9dc9-8eef121d5db6 with scrape type 1
2026-03-26 22:51:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4ce88cda-37cc-5ed6-9dc9-8eef121d5db6
2026-03-26 22:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F7cc8e7e0e5694cd5ad686c75eb461290%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/7cc8e7e0e5694cd5ad686c75eb461290/images/large/1.jpg not downloaded yet
2026-03-26 22:51:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f95e3aae-a4af-5899-ae14-85507159c18e with identifier: 1985443
2026-03-26 22:51:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f95e3aae-a4af-5899-ae14-85507159c18e with identifier: 1985443
2026-03-26 22:51:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f95e3aae-a4af-5899-ae14-85507159c18e with identifier: 1985443 to the API
2026-03-26 22:51:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:51:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:51:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bw/0443deefe1f441868fce24d38ceba9be/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'f95e3aae-a4af-5899-ae14-85507159c18e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '5 SERIES BERLINE',
 'odometer': 43732,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f95e3aae-a4af-5899-ae14-85507159c18e/f95e3aae-a4af-5899-ae14-85507159c18e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 575754,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/0443deefe1f441868fce24d38ceba9be/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f95e3aae-a4af-5899-ae14-85507159c18e/f95e3aae-a4af-5899-ae14-85507159c18e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 560851,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/0443deefe1f441868fce24d38ceba9be/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f95e3aae-a4af-5899-ae14-85507159c18e/f95e3aae-a4af-5899-ae14-85507159c18e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 536577,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/0443deefe1f441868fce24d38ceba9be/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f95e3aae-a4af-5899-ae14-85507159c18e/f95e3aae-a4af-5899-ae14-85507159c18e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 568386,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/0443deefe1f441868fce24d38ceba9be/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f95e3aae-a4af-5899-ae14-85507159c18e/f95e3aae-a4af-5899-ae14-85507159c18e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 452219,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/0443deefe1f441868fce24d38ceba9be/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f95e3aae-a4af-5899-ae14-85507159c18e/f95e3aae-a4af-5899-ae14-85507159c18e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 452765,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/0443deefe1f441868fce24d38ceba9be/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f95e3aae-a4af-5899-ae14-85507159c18e/f95e3aae-a4af-5899-ae14-85507159c18e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 539949,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/0443deefe1f441868fce24d38ceba9be/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f95e3aae-a4af-5899-ae14-85507159c18e/f95e3aae-a4af-5899-ae14-85507159c18e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 508544,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/0443deefe1f441868fce24d38ceba9be/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f95e3aae-a4af-5899-ae14-85507159c18e/f95e3aae-a4af-5899-ae14-85507159c18e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 357729,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/0443deefe1f441868fce24d38ceba9be/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f95e3aae-a4af-5899-ae14-85507159c18e/f95e3aae-a4af-5899-ae14-85507159c18e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 379707,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/0443deefe1f441868fce24d38ceba9be/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 5 SERIES BERLINE 2.0 520E AUTO',
 'transmission': 'automatic',
 'trim': '2.0 520E AUTO',
 'vin': None,
 'year': 2022}
2026-03-26 22:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985443%27 HTTP/1.1" 200 None
2026-03-26 22:51:49 [ayvens.be] INFO: Saving data for 1985443: {'created_time': 1774565509.473504, 'last_price_update_time': 1774565509.473514, 'auction_closing_time': 1774958400.0}
2026-03-26 22:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985443') HTTP/1.1" 204 0
2026-03-26 22:51:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/fcab1ffecdbe4bb283a3c90f2168aa76/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7496590>
2026-03-26 22:51:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b68f2489-e4bd-53cf-9df3-8a995c530188/b68f2489-e4bd-53cf-9df3-8a995c530188_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Ffcab1ffecdbe4bb283a3c90f2168aa76%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/fcab1ffecdbe4bb283a3c90f2168aa76/images/large/3.jpg saved to cache
2026-03-26 22:51:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b68f2489-e4bd-53cf-9df3-8a995c530188
2026-03-26 22:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F7cc8e7e0e5694cd5ad686c75eb461290%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/7cc8e7e0e5694cd5ad686c75eb461290/images/large/2.jpg not downloaded yet
2026-03-26 22:51:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/fcab1ffecdbe4bb283a3c90f2168aa76/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/fcab1ffecdbe4bb283a3c90f2168aa76/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/fcab1ffecdbe4bb283a3c90f2168aa76/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F7cc8e7e0e5694cd5ad686c75eb461290%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/7cc8e7e0e5694cd5ad686c75eb461290/images/large/3.jpg not downloaded yet
2026-03-26 22:51:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/fcab1ffecdbe4bb283a3c90f2168aa76/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7a564d0>
2026-03-26 22:51:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b68f2489-e4bd-53cf-9df3-8a995c530188/b68f2489-e4bd-53cf-9df3-8a995c530188_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Ffcab1ffecdbe4bb283a3c90f2168aa76%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/fcab1ffecdbe4bb283a3c90f2168aa76/images/large/4.jpg saved to cache
2026-03-26 22:51:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b68f2489-e4bd-53cf-9df3-8a995c530188
2026-03-26 22:51:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/fcab1ffecdbe4bb283a3c90f2168aa76/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F7cc8e7e0e5694cd5ad686c75eb461290%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/7cc8e7e0e5694cd5ad686c75eb461290/images/large/4.jpg not downloaded yet
2026-03-26 22:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F7cc8e7e0e5694cd5ad686c75eb461290%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/7cc8e7e0e5694cd5ad686c75eb461290/images/large/5.jpg not downloaded yet
2026-03-26 22:51:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7a60350>
2026-03-26 22:51:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b68f2489-e4bd-53cf-9df3-8a995c530188/b68f2489-e4bd-53cf-9df3-8a995c530188_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Ffcab1ffecdbe4bb283a3c90f2168aa76%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/fcab1ffecdbe4bb283a3c90f2168aa76/images/large/5.jpg saved to cache
2026-03-26 22:51:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b68f2489-e4bd-53cf-9df3-8a995c530188
2026-03-26 22:51:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c5dd50>
2026-03-26 22:51:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b68f2489-e4bd-53cf-9df3-8a995c530188/b68f2489-e4bd-53cf-9df3-8a995c530188_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Ffcab1ffecdbe4bb283a3c90f2168aa76%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/fcab1ffecdbe4bb283a3c90f2168aa76/images/large/6.jpg saved to cache
2026-03-26 22:51:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b68f2489-e4bd-53cf-9df3-8a995c530188
2026-03-26 22:51:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b744b850>
2026-03-26 22:51:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b68f2489-e4bd-53cf-9df3-8a995c530188/b68f2489-e4bd-53cf-9df3-8a995c530188_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Ffcab1ffecdbe4bb283a3c90f2168aa76%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/fcab1ffecdbe4bb283a3c90f2168aa76/images/large/7.jpg saved to cache
2026-03-26 22:51:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b68f2489-e4bd-53cf-9df3-8a995c530188
2026-03-26 22:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F7cc8e7e0e5694cd5ad686c75eb461290%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/7cc8e7e0e5694cd5ad686c75eb461290/images/large/6.jpg not downloaded yet
2026-03-26 22:51:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd9ceb50>
2026-03-26 22:51:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b68f2489-e4bd-53cf-9df3-8a995c530188/b68f2489-e4bd-53cf-9df3-8a995c530188_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Ffcab1ffecdbe4bb283a3c90f2168aa76%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/fcab1ffecdbe4bb283a3c90f2168aa76/images/large/8.jpg saved to cache
2026-03-26 22:51:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b68f2489-e4bd-53cf-9df3-8a995c530188
2026-03-26 22:51:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/fcab1ffecdbe4bb283a3c90f2168aa76/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F7cc8e7e0e5694cd5ad686c75eb461290%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/7cc8e7e0e5694cd5ad686c75eb461290/images/large/7.jpg not downloaded yet
2026-03-26 22:51:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b34f50>
2026-03-26 22:51:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b68f2489-e4bd-53cf-9df3-8a995c530188/b68f2489-e4bd-53cf-9df3-8a995c530188_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Ffcab1ffecdbe4bb283a3c90f2168aa76%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/fcab1ffecdbe4bb283a3c90f2168aa76/images/large/9.jpg saved to cache
2026-03-26 22:51:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b68f2489-e4bd-53cf-9df3-8a995c530188
2026-03-26 22:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F7cc8e7e0e5694cd5ad686c75eb461290%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/7cc8e7e0e5694cd5ad686c75eb461290/images/large/8.jpg not downloaded yet
2026-03-26 22:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F7cc8e7e0e5694cd5ad686c75eb461290%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/7cc8e7e0e5694cd5ad686c75eb461290/images/large/9.jpg not downloaded yet
2026-03-26 22:51:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e4fc10>
2026-03-26 22:51:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b68f2489-e4bd-53cf-9df3-8a995c530188/b68f2489-e4bd-53cf-9df3-8a995c530188_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Ffcab1ffecdbe4bb283a3c90f2168aa76%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/fcab1ffecdbe4bb283a3c90f2168aa76/images/large/10.jpg saved to cache
2026-03-26 22:51:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b68f2489-e4bd-53cf-9df3-8a995c530188
2026-03-26 22:51:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b68f2489-e4bd-53cf-9df3-8a995c530188, skipping ID generation
2026-03-26 22:51:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b68f2489-e4bd-53cf-9df3-8a995c530188 with scrape type 1
2026-03-26 22:51:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b68f2489-e4bd-53cf-9df3-8a995c530188 sending to next pipeline
2026-03-26 22:51:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b68f2489-e4bd-53cf-9df3-8a995c530188, identifier: 1985444
2026-03-26 22:51:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/7cc8e7e0e5694cd5ad686c75eb461290/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b68f2489-e4bd-53cf-9df3-8a995c530188 with identifier: 1985444
2026-03-26 22:51:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b68f2489-e4bd-53cf-9df3-8a995c530188 with identifier: 1985444
2026-03-26 22:51:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b68f2489-e4bd-53cf-9df3-8a995c530188 with identifier: 1985444 to the API
2026-03-26 22:51:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:51:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:51:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bh/fcab1ffecdbe4bb283a3c90f2168aa76/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 102,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b68f2489-e4bd-53cf-9df3-8a995c530188',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '2 SERIES ACTIVE TOURER',
 'odometer': 73595,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b68f2489-e4bd-53cf-9df3-8a995c530188/b68f2489-e4bd-53cf-9df3-8a995c530188_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 273095,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/fcab1ffecdbe4bb283a3c90f2168aa76/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b68f2489-e4bd-53cf-9df3-8a995c530188/b68f2489-e4bd-53cf-9df3-8a995c530188_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 275842,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/fcab1ffecdbe4bb283a3c90f2168aa76/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b68f2489-e4bd-53cf-9df3-8a995c530188/b68f2489-e4bd-53cf-9df3-8a995c530188_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 291330,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/fcab1ffecdbe4bb283a3c90f2168aa76/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b68f2489-e4bd-53cf-9df3-8a995c530188/b68f2489-e4bd-53cf-9df3-8a995c530188_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 285852,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/fcab1ffecdbe4bb283a3c90f2168aa76/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b68f2489-e4bd-53cf-9df3-8a995c530188/b68f2489-e4bd-53cf-9df3-8a995c530188_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 318789,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/fcab1ffecdbe4bb283a3c90f2168aa76/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b68f2489-e4bd-53cf-9df3-8a995c530188/b68f2489-e4bd-53cf-9df3-8a995c530188_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 269180,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/fcab1ffecdbe4bb283a3c90f2168aa76/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b68f2489-e4bd-53cf-9df3-8a995c530188/b68f2489-e4bd-53cf-9df3-8a995c530188_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 264544,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/fcab1ffecdbe4bb283a3c90f2168aa76/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b68f2489-e4bd-53cf-9df3-8a995c530188/b68f2489-e4bd-53cf-9df3-8a995c530188_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 379048,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/fcab1ffecdbe4bb283a3c90f2168aa76/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b68f2489-e4bd-53cf-9df3-8a995c530188/b68f2489-e4bd-53cf-9df3-8a995c530188_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 288368,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/fcab1ffecdbe4bb283a3c90f2168aa76/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b68f2489-e4bd-53cf-9df3-8a995c530188/b68f2489-e4bd-53cf-9df3-8a995c530188_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 361142,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/fcab1ffecdbe4bb283a3c90f2168aa76/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 2 SERIES ACTIVE TOURER 1.5 216D ACTIVE TOURER',
 'transmission': 'manual',
 'trim': '1.5 216D ACTIVE TOURER',
 'vin': None,
 'year': 2021}
2026-03-26 22:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985444%27 HTTP/1.1" 200 None
2026-03-26 22:51:50 [ayvens.be] INFO: Saving data for 1985444: {'created_time': 1774565510.772181, 'last_price_update_time': 1774565510.772191, 'auction_closing_time': 1774958400.0}
2026-03-26 22:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985444') HTTP/1.1" 204 0
2026-03-26 22:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F7cc8e7e0e5694cd5ad686c75eb461290%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/7cc8e7e0e5694cd5ad686c75eb461290/images/large/10.jpg not downloaded yet
2026-03-26 22:51:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/7cc8e7e0e5694cd5ad686c75eb461290/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/7cc8e7e0e5694cd5ad686c75eb461290/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:50 [ayvens.be] INFO: Found listing with ID: 1985446
2026-03-26 22:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985446%27 HTTP/1.1" 200 None
2026-03-26 22:51:50 [ayvens.be] INFO: Scrape type for 1985446: 1
2026-03-26 22:51:50 [ayvens.be] INFO: Extracting data for car ID: 1985446
2026-03-26 22:51:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e6ba21e-49be-57d2-b325-bc6c4433d37a with identifier: 1985446
2026-03-26 22:51:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e6ba21e-49be-57d2-b325-bc6c4433d37a with scrape type 1
2026-03-26 22:51:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3e6ba21e-49be-57d2-b325-bc6c4433d37a
2026-03-26 22:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F2b6f75208a5f4927acf8b46b4f19ccb8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/2b6f75208a5f4927acf8b46b4f19ccb8/images/large/1.jpg not downloaded yet
2026-03-26 22:51:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/7cc8e7e0e5694cd5ad686c75eb461290/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e14a90>
2026-03-26 22:51:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ce88cda-37cc-5ed6-9dc9-8eef121d5db6/4ce88cda-37cc-5ed6-9dc9-8eef121d5db6_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F7cc8e7e0e5694cd5ad686c75eb461290%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/7cc8e7e0e5694cd5ad686c75eb461290/images/large/1.jpg saved to cache
2026-03-26 22:51:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4ce88cda-37cc-5ed6-9dc9-8eef121d5db6
2026-03-26 22:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F2b6f75208a5f4927acf8b46b4f19ccb8%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/2b6f75208a5f4927acf8b46b4f19ccb8/images/large/2.jpg not downloaded yet
2026-03-26 22:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F2b6f75208a5f4927acf8b46b4f19ccb8%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/2b6f75208a5f4927acf8b46b4f19ccb8/images/large/3.jpg not downloaded yet
2026-03-26 22:51:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/7cc8e7e0e5694cd5ad686c75eb461290/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b788d9d0>
2026-03-26 22:51:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ce88cda-37cc-5ed6-9dc9-8eef121d5db6/4ce88cda-37cc-5ed6-9dc9-8eef121d5db6_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F7cc8e7e0e5694cd5ad686c75eb461290%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/7cc8e7e0e5694cd5ad686c75eb461290/images/large/3.jpg saved to cache
2026-03-26 22:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4ce88cda-37cc-5ed6-9dc9-8eef121d5db6
2026-03-26 22:51:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c74150>
2026-03-26 22:51:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ce88cda-37cc-5ed6-9dc9-8eef121d5db6/4ce88cda-37cc-5ed6-9dc9-8eef121d5db6_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F7cc8e7e0e5694cd5ad686c75eb461290%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/7cc8e7e0e5694cd5ad686c75eb461290/images/large/2.jpg saved to cache
2026-03-26 22:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4ce88cda-37cc-5ed6-9dc9-8eef121d5db6
2026-03-26 22:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F2b6f75208a5f4927acf8b46b4f19ccb8%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/2b6f75208a5f4927acf8b46b4f19ccb8/images/large/4.jpg not downloaded yet
2026-03-26 22:51:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7a60550>
2026-03-26 22:51:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ce88cda-37cc-5ed6-9dc9-8eef121d5db6/4ce88cda-37cc-5ed6-9dc9-8eef121d5db6_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F7cc8e7e0e5694cd5ad686c75eb461290%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/7cc8e7e0e5694cd5ad686c75eb461290/images/large/4.jpg saved to cache
2026-03-26 22:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4ce88cda-37cc-5ed6-9dc9-8eef121d5db6
2026-03-26 22:51:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/7cc8e7e0e5694cd5ad686c75eb461290/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F2b6f75208a5f4927acf8b46b4f19ccb8%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/2b6f75208a5f4927acf8b46b4f19ccb8/images/large/5.jpg not downloaded yet
2026-03-26 22:51:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/7cc8e7e0e5694cd5ad686c75eb461290/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6df2790>
2026-03-26 22:51:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ce88cda-37cc-5ed6-9dc9-8eef121d5db6/4ce88cda-37cc-5ed6-9dc9-8eef121d5db6_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F7cc8e7e0e5694cd5ad686c75eb461290%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/7cc8e7e0e5694cd5ad686c75eb461290/images/large/5.jpg saved to cache
2026-03-26 22:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4ce88cda-37cc-5ed6-9dc9-8eef121d5db6
2026-03-26 22:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F2b6f75208a5f4927acf8b46b4f19ccb8%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/2b6f75208a5f4927acf8b46b4f19ccb8/images/large/6.jpg not downloaded yet
2026-03-26 22:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F2b6f75208a5f4927acf8b46b4f19ccb8%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/2b6f75208a5f4927acf8b46b4f19ccb8/images/large/7.jpg not downloaded yet
2026-03-26 22:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F2b6f75208a5f4927acf8b46b4f19ccb8%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/2b6f75208a5f4927acf8b46b4f19ccb8/images/large/8.jpg not downloaded yet
2026-03-26 22:51:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79f8c50>
2026-03-26 22:51:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ce88cda-37cc-5ed6-9dc9-8eef121d5db6/4ce88cda-37cc-5ed6-9dc9-8eef121d5db6_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F7cc8e7e0e5694cd5ad686c75eb461290%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/7cc8e7e0e5694cd5ad686c75eb461290/images/large/7.jpg saved to cache
2026-03-26 22:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4ce88cda-37cc-5ed6-9dc9-8eef121d5db6
2026-03-26 22:51:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/7cc8e7e0e5694cd5ad686c75eb461290/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F2b6f75208a5f4927acf8b46b4f19ccb8%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/2b6f75208a5f4927acf8b46b4f19ccb8/images/large/9.jpg not downloaded yet
2026-03-26 22:51:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7570410>
2026-03-26 22:51:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ce88cda-37cc-5ed6-9dc9-8eef121d5db6/4ce88cda-37cc-5ed6-9dc9-8eef121d5db6_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F7cc8e7e0e5694cd5ad686c75eb461290%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/7cc8e7e0e5694cd5ad686c75eb461290/images/large/6.jpg saved to cache
2026-03-26 22:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4ce88cda-37cc-5ed6-9dc9-8eef121d5db6
2026-03-26 22:51:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/7cc8e7e0e5694cd5ad686c75eb461290/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/7cc8e7e0e5694cd5ad686c75eb461290/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/2b6f75208a5f4927acf8b46b4f19ccb8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F2b6f75208a5f4927acf8b46b4f19ccb8%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/2b6f75208a5f4927acf8b46b4f19ccb8/images/large/10.jpg not downloaded yet
2026-03-26 22:51:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/2b6f75208a5f4927acf8b46b4f19ccb8/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b743bfd0>
2026-03-26 22:51:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ce88cda-37cc-5ed6-9dc9-8eef121d5db6/4ce88cda-37cc-5ed6-9dc9-8eef121d5db6_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F7cc8e7e0e5694cd5ad686c75eb461290%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/7cc8e7e0e5694cd5ad686c75eb461290/images/large/9.jpg saved to cache
2026-03-26 22:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4ce88cda-37cc-5ed6-9dc9-8eef121d5db6
2026-03-26 22:51:51 [ayvens.be] INFO: Found listing with ID: 1985447
2026-03-26 22:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985447%27 HTTP/1.1" 200 None
2026-03-26 22:51:51 [ayvens.be] INFO: Scrape type for 1985447: 1
2026-03-26 22:51:51 [ayvens.be] INFO: Extracting data for car ID: 1985447
2026-03-26 22:51:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c545d7af-3d4a-532c-b476-168ddfe5e144 with identifier: 1985447
2026-03-26 22:51:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c545d7af-3d4a-532c-b476-168ddfe5e144 with scrape type 1
2026-03-26 22:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c545d7af-3d4a-532c-b476-168ddfe5e144
2026-03-26 22:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Fd784a7e43cd34ea59d73fb672198c03e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/d784a7e43cd34ea59d73fb672198c03e/images/large/1.jpg not downloaded yet
2026-03-26 22:51:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/2b6f75208a5f4927acf8b46b4f19ccb8/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Fd784a7e43cd34ea59d73fb672198c03e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/d784a7e43cd34ea59d73fb672198c03e/images/large/2.jpg not downloaded yet
2026-03-26 22:51:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7572890>
2026-03-26 22:51:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ce88cda-37cc-5ed6-9dc9-8eef121d5db6/4ce88cda-37cc-5ed6-9dc9-8eef121d5db6_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F7cc8e7e0e5694cd5ad686c75eb461290%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/7cc8e7e0e5694cd5ad686c75eb461290/images/large/8.jpg saved to cache
2026-03-26 22:51:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4ce88cda-37cc-5ed6-9dc9-8eef121d5db6
2026-03-26 22:51:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7401d50>
2026-03-26 22:51:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ce88cda-37cc-5ed6-9dc9-8eef121d5db6/4ce88cda-37cc-5ed6-9dc9-8eef121d5db6_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F7cc8e7e0e5694cd5ad686c75eb461290%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/7cc8e7e0e5694cd5ad686c75eb461290/images/large/10.jpg saved to cache
2026-03-26 22:51:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4ce88cda-37cc-5ed6-9dc9-8eef121d5db6
2026-03-26 22:51:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4ce88cda-37cc-5ed6-9dc9-8eef121d5db6, skipping ID generation
2026-03-26 22:51:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ce88cda-37cc-5ed6-9dc9-8eef121d5db6 with scrape type 1
2026-03-26 22:51:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4ce88cda-37cc-5ed6-9dc9-8eef121d5db6 sending to next pipeline
2026-03-26 22:51:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 4ce88cda-37cc-5ed6-9dc9-8eef121d5db6, identifier: 1985445
2026-03-26 22:51:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b729c110>
2026-03-26 22:51:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e6ba21e-49be-57d2-b325-bc6c4433d37a/3e6ba21e-49be-57d2-b325-bc6c4433d37a_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F2b6f75208a5f4927acf8b46b4f19ccb8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/2b6f75208a5f4927acf8b46b4f19ccb8/images/large/1.jpg saved to cache
2026-03-26 22:51:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3e6ba21e-49be-57d2-b325-bc6c4433d37a
2026-03-26 22:51:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7779010>
2026-03-26 22:51:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e6ba21e-49be-57d2-b325-bc6c4433d37a/3e6ba21e-49be-57d2-b325-bc6c4433d37a_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F2b6f75208a5f4927acf8b46b4f19ccb8%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/2b6f75208a5f4927acf8b46b4f19ccb8/images/large/2.jpg saved to cache
2026-03-26 22:51:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3e6ba21e-49be-57d2-b325-bc6c4433d37a
2026-03-26 22:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Fd784a7e43cd34ea59d73fb672198c03e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/d784a7e43cd34ea59d73fb672198c03e/images/large/3.jpg not downloaded yet
2026-03-26 22:51:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 4ce88cda-37cc-5ed6-9dc9-8eef121d5db6 with identifier: 1985445
2026-03-26 22:51:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 4ce88cda-37cc-5ed6-9dc9-8eef121d5db6 with identifier: 1985445
2026-03-26 22:51:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 4ce88cda-37cc-5ed6-9dc9-8eef121d5db6 with identifier: 1985445 to the API
2026-03-26 22:51:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:51:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:51:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ce/7cc8e7e0e5694cd5ad686c75eb461290/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '4ce88cda-37cc-5ed6-9dc9-8eef121d5db6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'OCTAVIA COMBI',
 'odometer': 151110,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ce88cda-37cc-5ed6-9dc9-8eef121d5db6/4ce88cda-37cc-5ed6-9dc9-8eef121d5db6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 660801,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/7cc8e7e0e5694cd5ad686c75eb461290/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ce88cda-37cc-5ed6-9dc9-8eef121d5db6/4ce88cda-37cc-5ed6-9dc9-8eef121d5db6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 624814,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/7cc8e7e0e5694cd5ad686c75eb461290/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ce88cda-37cc-5ed6-9dc9-8eef121d5db6/4ce88cda-37cc-5ed6-9dc9-8eef121d5db6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 632316,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/7cc8e7e0e5694cd5ad686c75eb461290/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ce88cda-37cc-5ed6-9dc9-8eef121d5db6/4ce88cda-37cc-5ed6-9dc9-8eef121d5db6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 646116,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/7cc8e7e0e5694cd5ad686c75eb461290/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ce88cda-37cc-5ed6-9dc9-8eef121d5db6/4ce88cda-37cc-5ed6-9dc9-8eef121d5db6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 677558,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/7cc8e7e0e5694cd5ad686c75eb461290/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ce88cda-37cc-5ed6-9dc9-8eef121d5db6/4ce88cda-37cc-5ed6-9dc9-8eef121d5db6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 726833,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/7cc8e7e0e5694cd5ad686c75eb461290/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ce88cda-37cc-5ed6-9dc9-8eef121d5db6/4ce88cda-37cc-5ed6-9dc9-8eef121d5db6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 676185,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/7cc8e7e0e5694cd5ad686c75eb461290/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ce88cda-37cc-5ed6-9dc9-8eef121d5db6/4ce88cda-37cc-5ed6-9dc9-8eef121d5db6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 850566,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/7cc8e7e0e5694cd5ad686c75eb461290/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ce88cda-37cc-5ed6-9dc9-8eef121d5db6/4ce88cda-37cc-5ed6-9dc9-8eef121d5db6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 823058,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/7cc8e7e0e5694cd5ad686c75eb461290/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ce88cda-37cc-5ed6-9dc9-8eef121d5db6/4ce88cda-37cc-5ed6-9dc9-8eef121d5db6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 812155,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/7cc8e7e0e5694cd5ad686c75eb461290/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA OCTAVIA COMBI 1.0 TSI MHEV 81KW DSG CLEVER+',
 'transmission': 'automatic',
 'trim': '1.0 TSI MHEV 81KW DSG CLEVER+',
 'vin': None,
 'year': 2022}
2026-03-26 22:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985445%27 HTTP/1.1" 200 None
2026-03-26 22:51:52 [ayvens.be] INFO: Saving data for 1985445: {'created_time': 1774565512.760206, 'last_price_update_time': 1774565512.760216, 'auction_closing_time': 1774958400.0}
2026-03-26 22:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985445') HTTP/1.1" 204 0
2026-03-26 22:51:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/2b6f75208a5f4927acf8b46b4f19ccb8/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/2b6f75208a5f4927acf8b46b4f19ccb8/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Fd784a7e43cd34ea59d73fb672198c03e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/d784a7e43cd34ea59d73fb672198c03e/images/large/4.jpg not downloaded yet
2026-03-26 22:51:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b748be50>
2026-03-26 22:51:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e6ba21e-49be-57d2-b325-bc6c4433d37a/3e6ba21e-49be-57d2-b325-bc6c4433d37a_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F2b6f75208a5f4927acf8b46b4f19ccb8%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/2b6f75208a5f4927acf8b46b4f19ccb8/images/large/3.jpg saved to cache
2026-03-26 22:51:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3e6ba21e-49be-57d2-b325-bc6c4433d37a
2026-03-26 22:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Fd784a7e43cd34ea59d73fb672198c03e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/d784a7e43cd34ea59d73fb672198c03e/images/large/5.jpg not downloaded yet
2026-03-26 22:51:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b78198d0>
2026-03-26 22:51:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e6ba21e-49be-57d2-b325-bc6c4433d37a/3e6ba21e-49be-57d2-b325-bc6c4433d37a_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F2b6f75208a5f4927acf8b46b4f19ccb8%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/2b6f75208a5f4927acf8b46b4f19ccb8/images/large/4.jpg saved to cache
2026-03-26 22:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3e6ba21e-49be-57d2-b325-bc6c4433d37a
2026-03-26 22:51:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77ad890>
2026-03-26 22:51:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e6ba21e-49be-57d2-b325-bc6c4433d37a/3e6ba21e-49be-57d2-b325-bc6c4433d37a_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F2b6f75208a5f4927acf8b46b4f19ccb8%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/2b6f75208a5f4927acf8b46b4f19ccb8/images/large/5.jpg saved to cache
2026-03-26 22:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3e6ba21e-49be-57d2-b325-bc6c4433d37a
2026-03-26 22:51:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/2b6f75208a5f4927acf8b46b4f19ccb8/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Fd784a7e43cd34ea59d73fb672198c03e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/d784a7e43cd34ea59d73fb672198c03e/images/large/6.jpg not downloaded yet
2026-03-26 22:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Fd784a7e43cd34ea59d73fb672198c03e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/d784a7e43cd34ea59d73fb672198c03e/images/large/7.jpg not downloaded yet
2026-03-26 22:51:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/2b6f75208a5f4927acf8b46b4f19ccb8/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/2b6f75208a5f4927acf8b46b4f19ccb8/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/2b6f75208a5f4927acf8b46b4f19ccb8/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Fd784a7e43cd34ea59d73fb672198c03e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/d784a7e43cd34ea59d73fb672198c03e/images/large/8.jpg not downloaded yet
2026-03-26 22:51:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/2b6f75208a5f4927acf8b46b4f19ccb8/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Fd784a7e43cd34ea59d73fb672198c03e%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/d784a7e43cd34ea59d73fb672198c03e/images/large/9.jpg not downloaded yet
2026-03-26 22:51:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/d784a7e43cd34ea59d73fb672198c03e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Fd784a7e43cd34ea59d73fb672198c03e%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/d784a7e43cd34ea59d73fb672198c03e/images/large/10.jpg not downloaded yet
2026-03-26 22:51:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cc0410>
2026-03-26 22:51:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e6ba21e-49be-57d2-b325-bc6c4433d37a/3e6ba21e-49be-57d2-b325-bc6c4433d37a_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F2b6f75208a5f4927acf8b46b4f19ccb8%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/2b6f75208a5f4927acf8b46b4f19ccb8/images/large/7.jpg saved to cache
2026-03-26 22:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3e6ba21e-49be-57d2-b325-bc6c4433d37a
2026-03-26 22:51:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/d784a7e43cd34ea59d73fb672198c03e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/d784a7e43cd34ea59d73fb672198c03e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:53 [ayvens.be] INFO: Found listing with ID: 1985448
2026-03-26 22:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985448%27 HTTP/1.1" 200 None
2026-03-26 22:51:53 [ayvens.be] INFO: Scrape type for 1985448: 1
2026-03-26 22:51:53 [ayvens.be] INFO: Extracting data for car ID: 1985448
2026-03-26 22:51:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ed9de6f2-1704-5a9b-8651-e58841921921 with identifier: 1985448
2026-03-26 22:51:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed9de6f2-1704-5a9b-8651-e58841921921 with scrape type 1
2026-03-26 22:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ed9de6f2-1704-5a9b-8651-e58841921921
2026-03-26 22:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fa04d3197d62d4c4f8455607136bb09ef%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/a04d3197d62d4c4f8455607136bb09ef/images/large/1.jpg not downloaded yet
2026-03-26 22:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fa04d3197d62d4c4f8455607136bb09ef%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/a04d3197d62d4c4f8455607136bb09ef/images/large/2.jpg not downloaded yet
2026-03-26 22:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fa04d3197d62d4c4f8455607136bb09ef%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/a04d3197d62d4c4f8455607136bb09ef/images/large/3.jpg not downloaded yet
2026-03-26 22:51:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5ca1f90>
2026-03-26 22:51:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e6ba21e-49be-57d2-b325-bc6c4433d37a/3e6ba21e-49be-57d2-b325-bc6c4433d37a_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F2b6f75208a5f4927acf8b46b4f19ccb8%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/2b6f75208a5f4927acf8b46b4f19ccb8/images/large/6.jpg saved to cache
2026-03-26 22:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3e6ba21e-49be-57d2-b325-bc6c4433d37a
2026-03-26 22:51:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7cab850>
2026-03-26 22:51:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e6ba21e-49be-57d2-b325-bc6c4433d37a/3e6ba21e-49be-57d2-b325-bc6c4433d37a_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F2b6f75208a5f4927acf8b46b4f19ccb8%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/2b6f75208a5f4927acf8b46b4f19ccb8/images/large/8.jpg saved to cache
2026-03-26 22:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3e6ba21e-49be-57d2-b325-bc6c4433d37a
2026-03-26 22:51:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cc9410>
2026-03-26 22:51:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e6ba21e-49be-57d2-b325-bc6c4433d37a/3e6ba21e-49be-57d2-b325-bc6c4433d37a_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F2b6f75208a5f4927acf8b46b4f19ccb8%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/2b6f75208a5f4927acf8b46b4f19ccb8/images/large/9.jpg saved to cache
2026-03-26 22:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3e6ba21e-49be-57d2-b325-bc6c4433d37a
2026-03-26 22:51:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74de890>
2026-03-26 22:51:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e6ba21e-49be-57d2-b325-bc6c4433d37a/3e6ba21e-49be-57d2-b325-bc6c4433d37a_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F2b6f75208a5f4927acf8b46b4f19ccb8%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/2b6f75208a5f4927acf8b46b4f19ccb8/images/large/10.jpg saved to cache
2026-03-26 22:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3e6ba21e-49be-57d2-b325-bc6c4433d37a
2026-03-26 22:51:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3e6ba21e-49be-57d2-b325-bc6c4433d37a, skipping ID generation
2026-03-26 22:51:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e6ba21e-49be-57d2-b325-bc6c4433d37a with scrape type 1
2026-03-26 22:51:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3e6ba21e-49be-57d2-b325-bc6c4433d37a sending to next pipeline
2026-03-26 22:51:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 3e6ba21e-49be-57d2-b325-bc6c4433d37a, identifier: 1985446
2026-03-26 22:51:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd758290>
2026-03-26 22:51:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c545d7af-3d4a-532c-b476-168ddfe5e144/c545d7af-3d4a-532c-b476-168ddfe5e144_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Fd784a7e43cd34ea59d73fb672198c03e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/d784a7e43cd34ea59d73fb672198c03e/images/large/1.jpg saved to cache
2026-03-26 22:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c545d7af-3d4a-532c-b476-168ddfe5e144
2026-03-26 22:51:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 3e6ba21e-49be-57d2-b325-bc6c4433d37a with identifier: 1985446
2026-03-26 22:51:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 3e6ba21e-49be-57d2-b325-bc6c4433d37a with identifier: 1985446
2026-03-26 22:51:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 3e6ba21e-49be-57d2-b325-bc6c4433d37a with identifier: 1985446 to the API
2026-03-26 22:51:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:51:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:51:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bm/2b6f75208a5f4927acf8b46b4f19ccb8/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '3e6ba21e-49be-57d2-b325-bc6c4433d37a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X2',
 'odometer': 102886,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e6ba21e-49be-57d2-b325-bc6c4433d37a/3e6ba21e-49be-57d2-b325-bc6c4433d37a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 723384,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/2b6f75208a5f4927acf8b46b4f19ccb8/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e6ba21e-49be-57d2-b325-bc6c4433d37a/3e6ba21e-49be-57d2-b325-bc6c4433d37a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 693109,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/2b6f75208a5f4927acf8b46b4f19ccb8/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e6ba21e-49be-57d2-b325-bc6c4433d37a/3e6ba21e-49be-57d2-b325-bc6c4433d37a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 673565,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/2b6f75208a5f4927acf8b46b4f19ccb8/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e6ba21e-49be-57d2-b325-bc6c4433d37a/3e6ba21e-49be-57d2-b325-bc6c4433d37a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 694183,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/2b6f75208a5f4927acf8b46b4f19ccb8/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e6ba21e-49be-57d2-b325-bc6c4433d37a/3e6ba21e-49be-57d2-b325-bc6c4433d37a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 682212,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/2b6f75208a5f4927acf8b46b4f19ccb8/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e6ba21e-49be-57d2-b325-bc6c4433d37a/3e6ba21e-49be-57d2-b325-bc6c4433d37a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 786809,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/2b6f75208a5f4927acf8b46b4f19ccb8/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e6ba21e-49be-57d2-b325-bc6c4433d37a/3e6ba21e-49be-57d2-b325-bc6c4433d37a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 602020,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/2b6f75208a5f4927acf8b46b4f19ccb8/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e6ba21e-49be-57d2-b325-bc6c4433d37a/3e6ba21e-49be-57d2-b325-bc6c4433d37a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 750779,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/2b6f75208a5f4927acf8b46b4f19ccb8/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e6ba21e-49be-57d2-b325-bc6c4433d37a/3e6ba21e-49be-57d2-b325-bc6c4433d37a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 712839,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/2b6f75208a5f4927acf8b46b4f19ccb8/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e6ba21e-49be-57d2-b325-bc6c4433d37a/3e6ba21e-49be-57d2-b325-bc6c4433d37a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 766647,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/2b6f75208a5f4927acf8b46b4f19ccb8/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X2 1.5 SDRIVE18I 100KW',
 'transmission': 'manual',
 'trim': '1.5 SDRIVE18I 100KW',
 'vin': None,
 'year': 2022}
2026-03-26 22:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985446%27 HTTP/1.1" 200 None
2026-03-26 22:51:54 [ayvens.be] INFO: Saving data for 1985446: {'created_time': 1774565514.381879, 'last_price_update_time': 1774565514.381888, 'auction_closing_time': 1774958400.0}
2026-03-26 22:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985446') HTTP/1.1" 204 0
2026-03-26 22:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fa04d3197d62d4c4f8455607136bb09ef%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/a04d3197d62d4c4f8455607136bb09ef/images/large/4.jpg not downloaded yet
2026-03-26 22:51:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/d784a7e43cd34ea59d73fb672198c03e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fa04d3197d62d4c4f8455607136bb09ef%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/a04d3197d62d4c4f8455607136bb09ef/images/large/5.jpg not downloaded yet
2026-03-26 22:51:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e4f990>
2026-03-26 22:51:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c545d7af-3d4a-532c-b476-168ddfe5e144/c545d7af-3d4a-532c-b476-168ddfe5e144_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Fd784a7e43cd34ea59d73fb672198c03e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/d784a7e43cd34ea59d73fb672198c03e/images/large/2.jpg saved to cache
2026-03-26 22:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c545d7af-3d4a-532c-b476-168ddfe5e144
2026-03-26 22:51:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd3bb7d0>
2026-03-26 22:51:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c545d7af-3d4a-532c-b476-168ddfe5e144/c545d7af-3d4a-532c-b476-168ddfe5e144_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Fd784a7e43cd34ea59d73fb672198c03e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/d784a7e43cd34ea59d73fb672198c03e/images/large/3.jpg saved to cache
2026-03-26 22:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c545d7af-3d4a-532c-b476-168ddfe5e144
2026-03-26 22:51:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/d784a7e43cd34ea59d73fb672198c03e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fa04d3197d62d4c4f8455607136bb09ef%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/a04d3197d62d4c4f8455607136bb09ef/images/large/6.jpg not downloaded yet
2026-03-26 22:51:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/d784a7e43cd34ea59d73fb672198c03e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/d784a7e43cd34ea59d73fb672198c03e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/d784a7e43cd34ea59d73fb672198c03e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7649090>
2026-03-26 22:51:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c545d7af-3d4a-532c-b476-168ddfe5e144/c545d7af-3d4a-532c-b476-168ddfe5e144_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Fd784a7e43cd34ea59d73fb672198c03e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/d784a7e43cd34ea59d73fb672198c03e/images/large/4.jpg saved to cache
2026-03-26 22:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c545d7af-3d4a-532c-b476-168ddfe5e144
2026-03-26 22:51:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/d784a7e43cd34ea59d73fb672198c03e/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fa04d3197d62d4c4f8455607136bb09ef%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/a04d3197d62d4c4f8455607136bb09ef/images/large/7.jpg not downloaded yet
2026-03-26 22:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fa04d3197d62d4c4f8455607136bb09ef%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/a04d3197d62d4c4f8455607136bb09ef/images/large/8.jpg not downloaded yet
2026-03-26 22:51:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7877b90>
2026-03-26 22:51:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c545d7af-3d4a-532c-b476-168ddfe5e144/c545d7af-3d4a-532c-b476-168ddfe5e144_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Fd784a7e43cd34ea59d73fb672198c03e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/d784a7e43cd34ea59d73fb672198c03e/images/large/6.jpg saved to cache
2026-03-26 22:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c545d7af-3d4a-532c-b476-168ddfe5e144
2026-03-26 22:51:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7496c90>
2026-03-26 22:51:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c545d7af-3d4a-532c-b476-168ddfe5e144/c545d7af-3d4a-532c-b476-168ddfe5e144_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Fd784a7e43cd34ea59d73fb672198c03e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/d784a7e43cd34ea59d73fb672198c03e/images/large/7.jpg saved to cache
2026-03-26 22:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c545d7af-3d4a-532c-b476-168ddfe5e144
2026-03-26 22:51:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7912cd0>
2026-03-26 22:51:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c545d7af-3d4a-532c-b476-168ddfe5e144/c545d7af-3d4a-532c-b476-168ddfe5e144_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Fd784a7e43cd34ea59d73fb672198c03e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/d784a7e43cd34ea59d73fb672198c03e/images/large/8.jpg saved to cache
2026-03-26 22:51:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c545d7af-3d4a-532c-b476-168ddfe5e144
2026-03-26 22:51:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b729ca90>
2026-03-26 22:51:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c545d7af-3d4a-532c-b476-168ddfe5e144/c545d7af-3d4a-532c-b476-168ddfe5e144_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Fd784a7e43cd34ea59d73fb672198c03e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/d784a7e43cd34ea59d73fb672198c03e/images/large/5.jpg saved to cache
2026-03-26 22:51:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c545d7af-3d4a-532c-b476-168ddfe5e144
2026-03-26 22:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fa04d3197d62d4c4f8455607136bb09ef%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/a04d3197d62d4c4f8455607136bb09ef/images/large/9.jpg not downloaded yet
2026-03-26 22:51:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6da6090>
2026-03-26 22:51:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c545d7af-3d4a-532c-b476-168ddfe5e144/c545d7af-3d4a-532c-b476-168ddfe5e144_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Fd784a7e43cd34ea59d73fb672198c03e%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/d784a7e43cd34ea59d73fb672198c03e/images/large/9.jpg saved to cache
2026-03-26 22:51:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c545d7af-3d4a-532c-b476-168ddfe5e144
2026-03-26 22:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fa04d3197d62d4c4f8455607136bb09ef%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/a04d3197d62d4c4f8455607136bb09ef/images/large/10.jpg not downloaded yet
2026-03-26 22:51:55 [ayvens.be] INFO: Found listing with ID: 1985449
2026-03-26 22:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985449%27 HTTP/1.1" 200 None
2026-03-26 22:51:55 [ayvens.be] INFO: Scrape type for 1985449: 1
2026-03-26 22:51:55 [ayvens.be] INFO: Extracting data for car ID: 1985449
2026-03-26 22:51:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 42212df4-538e-5af0-8221-13c8f6d360d4 with identifier: 1985449
2026-03-26 22:51:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 42212df4-538e-5af0-8221-13c8f6d360d4 with scrape type 1
2026-03-26 22:51:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 42212df4-538e-5af0-8221-13c8f6d360d4
2026-03-26 22:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fr%252F19a0923ec92046f3b96bdab450a91c62%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fr/19a0923ec92046f3b96bdab450a91c62/images/large/1.jpg not downloaded yet
2026-03-26 22:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fr%252F19a0923ec92046f3b96bdab450a91c62%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fr/19a0923ec92046f3b96bdab450a91c62/images/large/2.jpg not downloaded yet
2026-03-26 22:51:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/d784a7e43cd34ea59d73fb672198c03e/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/a04d3197d62d4c4f8455607136bb09ef/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/a04d3197d62d4c4f8455607136bb09ef/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fr%252F19a0923ec92046f3b96bdab450a91c62%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fr/19a0923ec92046f3b96bdab450a91c62/images/large/3.jpg not downloaded yet
2026-03-26 22:51:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/a04d3197d62d4c4f8455607136bb09ef/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/a04d3197d62d4c4f8455607136bb09ef/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fr%252F19a0923ec92046f3b96bdab450a91c62%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fr/19a0923ec92046f3b96bdab450a91c62/images/large/4.jpg not downloaded yet
2026-03-26 22:51:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/a04d3197d62d4c4f8455607136bb09ef/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/a04d3197d62d4c4f8455607136bb09ef/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/a04d3197d62d4c4f8455607136bb09ef/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fr%252F19a0923ec92046f3b96bdab450a91c62%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fr/19a0923ec92046f3b96bdab450a91c62/images/large/5.jpg not downloaded yet
2026-03-26 22:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fr%252F19a0923ec92046f3b96bdab450a91c62%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fr/19a0923ec92046f3b96bdab450a91c62/images/large/6.jpg not downloaded yet
2026-03-26 22:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fr%252F19a0923ec92046f3b96bdab450a91c62%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fr/19a0923ec92046f3b96bdab450a91c62/images/large/7.jpg not downloaded yet
2026-03-26 22:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fr%252F19a0923ec92046f3b96bdab450a91c62%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fr/19a0923ec92046f3b96bdab450a91c62/images/large/8.jpg not downloaded yet
2026-03-26 22:51:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fr/19a0923ec92046f3b96bdab450a91c62/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7593750>
2026-03-26 22:51:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c545d7af-3d4a-532c-b476-168ddfe5e144/c545d7af-3d4a-532c-b476-168ddfe5e144_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Fd784a7e43cd34ea59d73fb672198c03e%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/d784a7e43cd34ea59d73fb672198c03e/images/large/10.jpg saved to cache
2026-03-26 22:51:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c545d7af-3d4a-532c-b476-168ddfe5e144
2026-03-26 22:51:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c545d7af-3d4a-532c-b476-168ddfe5e144, skipping ID generation
2026-03-26 22:51:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c545d7af-3d4a-532c-b476-168ddfe5e144 with scrape type 1
2026-03-26 22:51:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c545d7af-3d4a-532c-b476-168ddfe5e144 sending to next pipeline
2026-03-26 22:51:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c545d7af-3d4a-532c-b476-168ddfe5e144, identifier: 1985447
2026-03-26 22:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fr%252F19a0923ec92046f3b96bdab450a91c62%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fr/19a0923ec92046f3b96bdab450a91c62/images/large/9.jpg not downloaded yet
2026-03-26 22:51:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c545d7af-3d4a-532c-b476-168ddfe5e144 with identifier: 1985447
2026-03-26 22:51:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c545d7af-3d4a-532c-b476-168ddfe5e144 with identifier: 1985447
2026-03-26 22:51:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c545d7af-3d4a-532c-b476-168ddfe5e144 with identifier: 1985447 to the API
2026-03-26 22:51:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:51:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:51:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yt/d784a7e43cd34ea59d73fb672198c03e/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'c545d7af-3d4a-532c-b476-168ddfe5e144',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'SUPERB COMBI',
 'odometer': 149690,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c545d7af-3d4a-532c-b476-168ddfe5e144/c545d7af-3d4a-532c-b476-168ddfe5e144_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 641608,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/d784a7e43cd34ea59d73fb672198c03e/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c545d7af-3d4a-532c-b476-168ddfe5e144/c545d7af-3d4a-532c-b476-168ddfe5e144_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 630083,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/d784a7e43cd34ea59d73fb672198c03e/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c545d7af-3d4a-532c-b476-168ddfe5e144/c545d7af-3d4a-532c-b476-168ddfe5e144_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 594170,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/d784a7e43cd34ea59d73fb672198c03e/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c545d7af-3d4a-532c-b476-168ddfe5e144/c545d7af-3d4a-532c-b476-168ddfe5e144_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 677345,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/d784a7e43cd34ea59d73fb672198c03e/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c545d7af-3d4a-532c-b476-168ddfe5e144/c545d7af-3d4a-532c-b476-168ddfe5e144_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 607580,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/d784a7e43cd34ea59d73fb672198c03e/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c545d7af-3d4a-532c-b476-168ddfe5e144/c545d7af-3d4a-532c-b476-168ddfe5e144_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 567529,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/d784a7e43cd34ea59d73fb672198c03e/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c545d7af-3d4a-532c-b476-168ddfe5e144/c545d7af-3d4a-532c-b476-168ddfe5e144_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 669180,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/d784a7e43cd34ea59d73fb672198c03e/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c545d7af-3d4a-532c-b476-168ddfe5e144/c545d7af-3d4a-532c-b476-168ddfe5e144_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 661349,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/d784a7e43cd34ea59d73fb672198c03e/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c545d7af-3d4a-532c-b476-168ddfe5e144/c545d7af-3d4a-532c-b476-168ddfe5e144_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 581425,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/d784a7e43cd34ea59d73fb672198c03e/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c545d7af-3d4a-532c-b476-168ddfe5e144/c545d7af-3d4a-532c-b476-168ddfe5e144_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 614588,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/d784a7e43cd34ea59d73fb672198c03e/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA SUPERB COMBI 1.4 TSI PHEV 160KW DSG6 STYLE',
 'transmission': 'automatic',
 'trim': '1.4 TSI PHEV 160KW DSG6 STYLE',
 'vin': None,
 'year': 2020}
2026-03-26 22:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985447%27 HTTP/1.1" 200 None
2026-03-26 22:51:56 [ayvens.be] INFO: Saving data for 1985447: {'created_time': 1774565516.033158, 'last_price_update_time': 1774565516.03317, 'auction_closing_time': 1774958400.0}
2026-03-26 22:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985447') HTTP/1.1" 204 0
2026-03-26 22:51:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fr/19a0923ec92046f3b96bdab450a91c62/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79a7690>
2026-03-26 22:51:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed9de6f2-1704-5a9b-8651-e58841921921/ed9de6f2-1704-5a9b-8651-e58841921921_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fa04d3197d62d4c4f8455607136bb09ef%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/a04d3197d62d4c4f8455607136bb09ef/images/large/1.jpg saved to cache
2026-03-26 22:51:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ed9de6f2-1704-5a9b-8651-e58841921921
2026-03-26 22:51:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b745aed0>
2026-03-26 22:51:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed9de6f2-1704-5a9b-8651-e58841921921/ed9de6f2-1704-5a9b-8651-e58841921921_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fa04d3197d62d4c4f8455607136bb09ef%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/a04d3197d62d4c4f8455607136bb09ef/images/large/2.jpg saved to cache
2026-03-26 22:51:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ed9de6f2-1704-5a9b-8651-e58841921921
2026-03-26 22:51:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76cc6d0>
2026-03-26 22:51:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed9de6f2-1704-5a9b-8651-e58841921921/ed9de6f2-1704-5a9b-8651-e58841921921_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fa04d3197d62d4c4f8455607136bb09ef%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/a04d3197d62d4c4f8455607136bb09ef/images/large/3.jpg saved to cache
2026-03-26 22:51:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ed9de6f2-1704-5a9b-8651-e58841921921
2026-03-26 22:51:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6df07d0>
2026-03-26 22:51:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed9de6f2-1704-5a9b-8651-e58841921921/ed9de6f2-1704-5a9b-8651-e58841921921_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fa04d3197d62d4c4f8455607136bb09ef%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/a04d3197d62d4c4f8455607136bb09ef/images/large/5.jpg saved to cache
2026-03-26 22:51:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ed9de6f2-1704-5a9b-8651-e58841921921
2026-03-26 22:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fr%252F19a0923ec92046f3b96bdab450a91c62%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fr/19a0923ec92046f3b96bdab450a91c62/images/large/10.jpg not downloaded yet
2026-03-26 22:51:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fr/19a0923ec92046f3b96bdab450a91c62/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77d7ed0>
2026-03-26 22:51:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed9de6f2-1704-5a9b-8651-e58841921921/ed9de6f2-1704-5a9b-8651-e58841921921_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fa04d3197d62d4c4f8455607136bb09ef%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/a04d3197d62d4c4f8455607136bb09ef/images/large/4.jpg saved to cache
2026-03-26 22:51:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ed9de6f2-1704-5a9b-8651-e58841921921
2026-03-26 22:51:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c771d0>
2026-03-26 22:51:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed9de6f2-1704-5a9b-8651-e58841921921/ed9de6f2-1704-5a9b-8651-e58841921921_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fa04d3197d62d4c4f8455607136bb09ef%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/a04d3197d62d4c4f8455607136bb09ef/images/large/6.jpg saved to cache
2026-03-26 22:51:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ed9de6f2-1704-5a9b-8651-e58841921921
2026-03-26 22:51:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd3bb910>
2026-03-26 22:51:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed9de6f2-1704-5a9b-8651-e58841921921/ed9de6f2-1704-5a9b-8651-e58841921921_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fa04d3197d62d4c4f8455607136bb09ef%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/a04d3197d62d4c4f8455607136bb09ef/images/large/7.jpg saved to cache
2026-03-26 22:51:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ed9de6f2-1704-5a9b-8651-e58841921921
2026-03-26 22:51:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cb3a10>
2026-03-26 22:51:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_42212df4-538e-5af0-8221-13c8f6d360d4/42212df4-538e-5af0-8221-13c8f6d360d4_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fr%252F19a0923ec92046f3b96bdab450a91c62%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fr/19a0923ec92046f3b96bdab450a91c62/images/large/2.jpg saved to cache
2026-03-26 22:51:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 42212df4-538e-5af0-8221-13c8f6d360d4
2026-03-26 22:51:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/a04d3197d62d4c4f8455607136bb09ef/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/a04d3197d62d4c4f8455607136bb09ef/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:56 [ayvens.be] INFO: Found listing with ID: 1985450
2026-03-26 22:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985450%27 HTTP/1.1" 200 None
2026-03-26 22:51:56 [ayvens.be] INFO: Scrape type for 1985450: 1
2026-03-26 22:51:56 [ayvens.be] INFO: Extracting data for car ID: 1985450
2026-03-26 22:51:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0ff79cea-eef6-5bc9-94a6-2f1cd6b2b8d3 with identifier: 1985450
2026-03-26 22:51:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ff79cea-eef6-5bc9-94a6-2f1cd6b2b8d3 with scrape type 1
2026-03-26 22:51:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0ff79cea-eef6-5bc9-94a6-2f1cd6b2b8d3
2026-03-26 22:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F75b417c66cef4c39919958ad21eedf05%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/75b417c66cef4c39919958ad21eedf05/images/large/1.jpg not downloaded yet
2026-03-26 22:51:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd0cf990>
2026-03-26 22:51:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_42212df4-538e-5af0-8221-13c8f6d360d4/42212df4-538e-5af0-8221-13c8f6d360d4_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fr%252F19a0923ec92046f3b96bdab450a91c62%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fr/19a0923ec92046f3b96bdab450a91c62/images/large/1.jpg saved to cache
2026-03-26 22:51:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 42212df4-538e-5af0-8221-13c8f6d360d4
2026-03-26 22:51:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/a04d3197d62d4c4f8455607136bb09ef/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F75b417c66cef4c39919958ad21eedf05%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/75b417c66cef4c39919958ad21eedf05/images/large/2.jpg not downloaded yet
2026-03-26 22:51:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b727c050>
2026-03-26 22:51:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_42212df4-538e-5af0-8221-13c8f6d360d4/42212df4-538e-5af0-8221-13c8f6d360d4_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fr%252F19a0923ec92046f3b96bdab450a91c62%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fr/19a0923ec92046f3b96bdab450a91c62/images/large/3.jpg saved to cache
2026-03-26 22:51:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 42212df4-538e-5af0-8221-13c8f6d360d4
2026-03-26 22:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F75b417c66cef4c39919958ad21eedf05%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/75b417c66cef4c39919958ad21eedf05/images/large/3.jpg not downloaded yet
2026-03-26 22:51:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd9ce3d0>
2026-03-26 22:51:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed9de6f2-1704-5a9b-8651-e58841921921/ed9de6f2-1704-5a9b-8651-e58841921921_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fa04d3197d62d4c4f8455607136bb09ef%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/a04d3197d62d4c4f8455607136bb09ef/images/large/8.jpg saved to cache
2026-03-26 22:51:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ed9de6f2-1704-5a9b-8651-e58841921921
2026-03-26 22:51:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b741e110>
2026-03-26 22:51:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed9de6f2-1704-5a9b-8651-e58841921921/ed9de6f2-1704-5a9b-8651-e58841921921_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fa04d3197d62d4c4f8455607136bb09ef%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/a04d3197d62d4c4f8455607136bb09ef/images/large/9.jpg saved to cache
2026-03-26 22:51:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ed9de6f2-1704-5a9b-8651-e58841921921
2026-03-26 22:51:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7aa2910>
2026-03-26 22:51:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed9de6f2-1704-5a9b-8651-e58841921921/ed9de6f2-1704-5a9b-8651-e58841921921_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fa04d3197d62d4c4f8455607136bb09ef%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/a04d3197d62d4c4f8455607136bb09ef/images/large/10.jpg saved to cache
2026-03-26 22:51:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ed9de6f2-1704-5a9b-8651-e58841921921
2026-03-26 22:51:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ed9de6f2-1704-5a9b-8651-e58841921921, skipping ID generation
2026-03-26 22:51:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed9de6f2-1704-5a9b-8651-e58841921921 with scrape type 1
2026-03-26 22:51:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ed9de6f2-1704-5a9b-8651-e58841921921 sending to next pipeline
2026-03-26 22:51:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: ed9de6f2-1704-5a9b-8651-e58841921921, identifier: 1985448
2026-03-26 22:51:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fr/19a0923ec92046f3b96bdab450a91c62/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F75b417c66cef4c39919958ad21eedf05%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/75b417c66cef4c39919958ad21eedf05/images/large/4.jpg not downloaded yet
2026-03-26 22:51:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: ed9de6f2-1704-5a9b-8651-e58841921921 with identifier: 1985448
2026-03-26 22:51:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: ed9de6f2-1704-5a9b-8651-e58841921921 with identifier: 1985448
2026-03-26 22:51:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: ed9de6f2-1704-5a9b-8651-e58841921921 with identifier: 1985448 to the API
2026-03-26 22:51:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:51:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:51:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ab/a04d3197d62d4c4f8455607136bb09ef/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ed9de6f2-1704-5a9b-8651-e58841921921',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'SUPERB COMBI',
 'odometer': 169869,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed9de6f2-1704-5a9b-8651-e58841921921/ed9de6f2-1704-5a9b-8651-e58841921921_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 732761,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/a04d3197d62d4c4f8455607136bb09ef/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed9de6f2-1704-5a9b-8651-e58841921921/ed9de6f2-1704-5a9b-8651-e58841921921_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 729176,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/a04d3197d62d4c4f8455607136bb09ef/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed9de6f2-1704-5a9b-8651-e58841921921/ed9de6f2-1704-5a9b-8651-e58841921921_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 715518,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/a04d3197d62d4c4f8455607136bb09ef/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed9de6f2-1704-5a9b-8651-e58841921921/ed9de6f2-1704-5a9b-8651-e58841921921_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 733203,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/a04d3197d62d4c4f8455607136bb09ef/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed9de6f2-1704-5a9b-8651-e58841921921/ed9de6f2-1704-5a9b-8651-e58841921921_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 699933,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/a04d3197d62d4c4f8455607136bb09ef/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed9de6f2-1704-5a9b-8651-e58841921921/ed9de6f2-1704-5a9b-8651-e58841921921_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 725991,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/a04d3197d62d4c4f8455607136bb09ef/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed9de6f2-1704-5a9b-8651-e58841921921/ed9de6f2-1704-5a9b-8651-e58841921921_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 603063,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/a04d3197d62d4c4f8455607136bb09ef/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed9de6f2-1704-5a9b-8651-e58841921921/ed9de6f2-1704-5a9b-8651-e58841921921_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 740240,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/a04d3197d62d4c4f8455607136bb09ef/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed9de6f2-1704-5a9b-8651-e58841921921/ed9de6f2-1704-5a9b-8651-e58841921921_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 717974,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/a04d3197d62d4c4f8455607136bb09ef/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed9de6f2-1704-5a9b-8651-e58841921921/ed9de6f2-1704-5a9b-8651-e58841921921_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 759384,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/a04d3197d62d4c4f8455607136bb09ef/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA SUPERB COMBI 1.6 CRTDI 88KW DSG7 AMBITION',
 'transmission': 'automatic',
 'trim': '1.6 CRTDI 88KW DSG7 AMBITION',
 'vin': None,
 'year': 2021}
2026-03-26 22:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985448%27 HTTP/1.1" 200 None
2026-03-26 22:51:58 [ayvens.be] INFO: Saving data for 1985448: {'created_time': 1774565518.003271, 'last_price_update_time': 1774565518.003281, 'auction_closing_time': 1774958400.0}
2026-03-26 22:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985448') HTTP/1.1" 204 0
2026-03-26 22:51:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fr/19a0923ec92046f3b96bdab450a91c62/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fr/19a0923ec92046f3b96bdab450a91c62/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fr/19a0923ec92046f3b96bdab450a91c62/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F75b417c66cef4c39919958ad21eedf05%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/75b417c66cef4c39919958ad21eedf05/images/large/5.jpg not downloaded yet
2026-03-26 22:51:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/75b417c66cef4c39919958ad21eedf05/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74a40d0>
2026-03-26 22:51:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_42212df4-538e-5af0-8221-13c8f6d360d4/42212df4-538e-5af0-8221-13c8f6d360d4_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fr%252F19a0923ec92046f3b96bdab450a91c62%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fr/19a0923ec92046f3b96bdab450a91c62/images/large/10.jpg saved to cache
2026-03-26 22:51:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 42212df4-538e-5af0-8221-13c8f6d360d4
2026-03-26 22:51:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fr/19a0923ec92046f3b96bdab450a91c62/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fr/19a0923ec92046f3b96bdab450a91c62/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F75b417c66cef4c39919958ad21eedf05%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/75b417c66cef4c39919958ad21eedf05/images/large/6.jpg not downloaded yet
2026-03-26 22:51:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fr/19a0923ec92046f3b96bdab450a91c62/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F75b417c66cef4c39919958ad21eedf05%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/75b417c66cef4c39919958ad21eedf05/images/large/7.jpg not downloaded yet
2026-03-26 22:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F75b417c66cef4c39919958ad21eedf05%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/75b417c66cef4c39919958ad21eedf05/images/large/8.jpg not downloaded yet
2026-03-26 22:51:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79de750>
2026-03-26 22:51:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_42212df4-538e-5af0-8221-13c8f6d360d4/42212df4-538e-5af0-8221-13c8f6d360d4_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fr%252F19a0923ec92046f3b96bdab450a91c62%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fr/19a0923ec92046f3b96bdab450a91c62/images/large/6.jpg saved to cache
2026-03-26 22:51:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 42212df4-538e-5af0-8221-13c8f6d360d4
2026-03-26 22:51:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79f2310>
2026-03-26 22:51:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_42212df4-538e-5af0-8221-13c8f6d360d4/42212df4-538e-5af0-8221-13c8f6d360d4_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fr%252F19a0923ec92046f3b96bdab450a91c62%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fr/19a0923ec92046f3b96bdab450a91c62/images/large/7.jpg saved to cache
2026-03-26 22:51:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 42212df4-538e-5af0-8221-13c8f6d360d4
2026-03-26 22:51:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77af9d0>
2026-03-26 22:51:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_42212df4-538e-5af0-8221-13c8f6d360d4/42212df4-538e-5af0-8221-13c8f6d360d4_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fr%252F19a0923ec92046f3b96bdab450a91c62%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fr/19a0923ec92046f3b96bdab450a91c62/images/large/5.jpg saved to cache
2026-03-26 22:51:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 42212df4-538e-5af0-8221-13c8f6d360d4
2026-03-26 22:51:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7290e50>
2026-03-26 22:51:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ff79cea-eef6-5bc9-94a6-2f1cd6b2b8d3/0ff79cea-eef6-5bc9-94a6-2f1cd6b2b8d3_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F75b417c66cef4c39919958ad21eedf05%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/75b417c66cef4c39919958ad21eedf05/images/large/1.jpg saved to cache
2026-03-26 22:51:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0ff79cea-eef6-5bc9-94a6-2f1cd6b2b8d3
2026-03-26 22:51:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/75b417c66cef4c39919958ad21eedf05/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F75b417c66cef4c39919958ad21eedf05%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/75b417c66cef4c39919958ad21eedf05/images/large/9.jpg not downloaded yet
2026-03-26 22:51:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/75b417c66cef4c39919958ad21eedf05/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F75b417c66cef4c39919958ad21eedf05%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/75b417c66cef4c39919958ad21eedf05/images/large/10.jpg not downloaded yet
2026-03-26 22:51:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6ded390>
2026-03-26 22:51:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_42212df4-538e-5af0-8221-13c8f6d360d4/42212df4-538e-5af0-8221-13c8f6d360d4_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fr%252F19a0923ec92046f3b96bdab450a91c62%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fr/19a0923ec92046f3b96bdab450a91c62/images/large/9.jpg saved to cache
2026-03-26 22:51:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 42212df4-538e-5af0-8221-13c8f6d360d4
2026-03-26 22:51:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b9bbd0>
2026-03-26 22:51:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_42212df4-538e-5af0-8221-13c8f6d360d4/42212df4-538e-5af0-8221-13c8f6d360d4_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fr%252F19a0923ec92046f3b96bdab450a91c62%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fr/19a0923ec92046f3b96bdab450a91c62/images/large/4.jpg saved to cache
2026-03-26 22:51:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 42212df4-538e-5af0-8221-13c8f6d360d4
2026-03-26 22:51:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b727c3d0>
2026-03-26 22:51:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_42212df4-538e-5af0-8221-13c8f6d360d4/42212df4-538e-5af0-8221-13c8f6d360d4_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fr%252F19a0923ec92046f3b96bdab450a91c62%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fr/19a0923ec92046f3b96bdab450a91c62/images/large/8.jpg saved to cache
2026-03-26 22:51:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 42212df4-538e-5af0-8221-13c8f6d360d4
2026-03-26 22:51:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 42212df4-538e-5af0-8221-13c8f6d360d4, skipping ID generation
2026-03-26 22:51:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 42212df4-538e-5af0-8221-13c8f6d360d4 with scrape type 1
2026-03-26 22:51:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 42212df4-538e-5af0-8221-13c8f6d360d4 sending to next pipeline
2026-03-26 22:51:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 42212df4-538e-5af0-8221-13c8f6d360d4, identifier: 1985449
2026-03-26 22:51:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/75b417c66cef4c39919958ad21eedf05/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 42212df4-538e-5af0-8221-13c8f6d360d4 with identifier: 1985449
2026-03-26 22:51:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 42212df4-538e-5af0-8221-13c8f6d360d4 with identifier: 1985449
2026-03-26 22:51:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 42212df4-538e-5af0-8221-13c8f6d360d4 with identifier: 1985449 to the API
2026-03-26 22:51:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:51:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:51:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2fr/19a0923ec92046f3b96bdab450a91c62/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '42212df4-538e-5af0-8221-13c8f6d360d4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'POLO',
 'odometer': 16043,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42212df4-538e-5af0-8221-13c8f6d360d4/42212df4-538e-5af0-8221-13c8f6d360d4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 254401,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fr/19a0923ec92046f3b96bdab450a91c62/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42212df4-538e-5af0-8221-13c8f6d360d4/42212df4-538e-5af0-8221-13c8f6d360d4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 259523,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fr/19a0923ec92046f3b96bdab450a91c62/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42212df4-538e-5af0-8221-13c8f6d360d4/42212df4-538e-5af0-8221-13c8f6d360d4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 282046,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fr/19a0923ec92046f3b96bdab450a91c62/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42212df4-538e-5af0-8221-13c8f6d360d4/42212df4-538e-5af0-8221-13c8f6d360d4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 276657,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fr/19a0923ec92046f3b96bdab450a91c62/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42212df4-538e-5af0-8221-13c8f6d360d4/42212df4-538e-5af0-8221-13c8f6d360d4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 288786,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fr/19a0923ec92046f3b96bdab450a91c62/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42212df4-538e-5af0-8221-13c8f6d360d4/42212df4-538e-5af0-8221-13c8f6d360d4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 254995,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fr/19a0923ec92046f3b96bdab450a91c62/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42212df4-538e-5af0-8221-13c8f6d360d4/42212df4-538e-5af0-8221-13c8f6d360d4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 297294,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fr/19a0923ec92046f3b96bdab450a91c62/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42212df4-538e-5af0-8221-13c8f6d360d4/42212df4-538e-5af0-8221-13c8f6d360d4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 371115,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fr/19a0923ec92046f3b96bdab450a91c62/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42212df4-538e-5af0-8221-13c8f6d360d4/42212df4-538e-5af0-8221-13c8f6d360d4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 395794,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fr/19a0923ec92046f3b96bdab450a91c62/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42212df4-538e-5af0-8221-13c8f6d360d4/42212df4-538e-5af0-8221-13c8f6d360d4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 169599,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fr/19a0923ec92046f3b96bdab450a91c62/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-06-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN POLO 1.0 MPI 59KW',
 'transmission': 'manual',
 'trim': '1.0 MPI 59KW',
 'vin': None,
 'year': 2024}
2026-03-26 22:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985449%27 HTTP/1.1" 200 None
2026-03-26 22:51:59 [ayvens.be] INFO: Saving data for 1985449: {'created_time': 1774565519.285394, 'last_price_update_time': 1774565519.285404, 'auction_closing_time': 1774958400.0}
2026-03-26 22:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985449') HTTP/1.1" 204 0
2026-03-26 22:51:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/75b417c66cef4c39919958ad21eedf05/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:59 [ayvens.be] INFO: Found listing with ID: 1985451
2026-03-26 22:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985451%27 HTTP/1.1" 200 None
2026-03-26 22:51:59 [ayvens.be] INFO: Scrape type for 1985451: 1
2026-03-26 22:51:59 [ayvens.be] INFO: Extracting data for car ID: 1985451
2026-03-26 22:51:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 05305e5a-ae85-5ea5-9b7c-4b326ebe5517 with identifier: 1985451
2026-03-26 22:51:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05305e5a-ae85-5ea5-9b7c-4b326ebe5517 with scrape type 1
2026-03-26 22:51:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 05305e5a-ae85-5ea5-9b7c-4b326ebe5517
2026-03-26 22:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fcec1020c4f394ceca3713b41a2820cc5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/cec1020c4f394ceca3713b41a2820cc5/images/large/1.jpg not downloaded yet
2026-03-26 22:51:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/75b417c66cef4c39919958ad21eedf05/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76ec2d0>
2026-03-26 22:51:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ff79cea-eef6-5bc9-94a6-2f1cd6b2b8d3/0ff79cea-eef6-5bc9-94a6-2f1cd6b2b8d3_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F75b417c66cef4c39919958ad21eedf05%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/75b417c66cef4c39919958ad21eedf05/images/large/2.jpg saved to cache
2026-03-26 22:51:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0ff79cea-eef6-5bc9-94a6-2f1cd6b2b8d3
2026-03-26 22:51:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd0c7310>
2026-03-26 22:51:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ff79cea-eef6-5bc9-94a6-2f1cd6b2b8d3/0ff79cea-eef6-5bc9-94a6-2f1cd6b2b8d3_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F75b417c66cef4c39919958ad21eedf05%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/75b417c66cef4c39919958ad21eedf05/images/large/3.jpg saved to cache
2026-03-26 22:51:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0ff79cea-eef6-5bc9-94a6-2f1cd6b2b8d3
2026-03-26 22:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fcec1020c4f394ceca3713b41a2820cc5%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/cec1020c4f394ceca3713b41a2820cc5/images/large/2.jpg not downloaded yet
2026-03-26 22:51:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/75b417c66cef4c39919958ad21eedf05/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b787d850>
2026-03-26 22:51:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ff79cea-eef6-5bc9-94a6-2f1cd6b2b8d3/0ff79cea-eef6-5bc9-94a6-2f1cd6b2b8d3_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F75b417c66cef4c39919958ad21eedf05%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/75b417c66cef4c39919958ad21eedf05/images/large/4.jpg saved to cache
2026-03-26 22:51:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0ff79cea-eef6-5bc9-94a6-2f1cd6b2b8d3
2026-03-26 22:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fcec1020c4f394ceca3713b41a2820cc5%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/cec1020c4f394ceca3713b41a2820cc5/images/large/3.jpg not downloaded yet
2026-03-26 22:51:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7477a90>
2026-03-26 22:51:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ff79cea-eef6-5bc9-94a6-2f1cd6b2b8d3/0ff79cea-eef6-5bc9-94a6-2f1cd6b2b8d3_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F75b417c66cef4c39919958ad21eedf05%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/75b417c66cef4c39919958ad21eedf05/images/large/6.jpg saved to cache
2026-03-26 22:51:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0ff79cea-eef6-5bc9-94a6-2f1cd6b2b8d3
2026-03-26 22:51:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7475390>
2026-03-26 22:51:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ff79cea-eef6-5bc9-94a6-2f1cd6b2b8d3/0ff79cea-eef6-5bc9-94a6-2f1cd6b2b8d3_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F75b417c66cef4c39919958ad21eedf05%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/75b417c66cef4c39919958ad21eedf05/images/large/5.jpg saved to cache
2026-03-26 22:51:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0ff79cea-eef6-5bc9-94a6-2f1cd6b2b8d3
2026-03-26 22:51:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/75b417c66cef4c39919958ad21eedf05/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fcec1020c4f394ceca3713b41a2820cc5%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:51:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/cec1020c4f394ceca3713b41a2820cc5/images/large/4.jpg not downloaded yet
2026-03-26 22:51:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/75b417c66cef4c39919958ad21eedf05/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:51:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:51:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c68dd0>
2026-03-26 22:51:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:51:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:51:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:51:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ff79cea-eef6-5bc9-94a6-2f1cd6b2b8d3/0ff79cea-eef6-5bc9-94a6-2f1cd6b2b8d3_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F75b417c66cef4c39919958ad21eedf05%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:51:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/75b417c66cef4c39919958ad21eedf05/images/large/7.jpg saved to cache
2026-03-26 22:51:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0ff79cea-eef6-5bc9-94a6-2f1cd6b2b8d3
2026-03-26 22:51:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/75b417c66cef4c39919958ad21eedf05/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fcec1020c4f394ceca3713b41a2820cc5%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/cec1020c4f394ceca3713b41a2820cc5/images/large/5.jpg not downloaded yet
2026-03-26 22:52:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/cec1020c4f394ceca3713b41a2820cc5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fcec1020c4f394ceca3713b41a2820cc5%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/cec1020c4f394ceca3713b41a2820cc5/images/large/6.jpg not downloaded yet
2026-03-26 22:52:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b746fd50>
2026-03-26 22:52:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ff79cea-eef6-5bc9-94a6-2f1cd6b2b8d3/0ff79cea-eef6-5bc9-94a6-2f1cd6b2b8d3_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F75b417c66cef4c39919958ad21eedf05%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/75b417c66cef4c39919958ad21eedf05/images/large/8.jpg saved to cache
2026-03-26 22:52:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0ff79cea-eef6-5bc9-94a6-2f1cd6b2b8d3
2026-03-26 22:52:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74a58d0>
2026-03-26 22:52:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ff79cea-eef6-5bc9-94a6-2f1cd6b2b8d3/0ff79cea-eef6-5bc9-94a6-2f1cd6b2b8d3_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F75b417c66cef4c39919958ad21eedf05%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/75b417c66cef4c39919958ad21eedf05/images/large/9.jpg saved to cache
2026-03-26 22:52:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0ff79cea-eef6-5bc9-94a6-2f1cd6b2b8d3
2026-03-26 22:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fcec1020c4f394ceca3713b41a2820cc5%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/cec1020c4f394ceca3713b41a2820cc5/images/large/7.jpg not downloaded yet
2026-03-26 22:52:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/cec1020c4f394ceca3713b41a2820cc5/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fcec1020c4f394ceca3713b41a2820cc5%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/cec1020c4f394ceca3713b41a2820cc5/images/large/8.jpg not downloaded yet
2026-03-26 22:52:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76e34d0>
2026-03-26 22:52:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ff79cea-eef6-5bc9-94a6-2f1cd6b2b8d3/0ff79cea-eef6-5bc9-94a6-2f1cd6b2b8d3_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F75b417c66cef4c39919958ad21eedf05%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/75b417c66cef4c39919958ad21eedf05/images/large/10.jpg saved to cache
2026-03-26 22:52:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0ff79cea-eef6-5bc9-94a6-2f1cd6b2b8d3
2026-03-26 22:52:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0ff79cea-eef6-5bc9-94a6-2f1cd6b2b8d3, skipping ID generation
2026-03-26 22:52:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ff79cea-eef6-5bc9-94a6-2f1cd6b2b8d3 with scrape type 1
2026-03-26 22:52:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0ff79cea-eef6-5bc9-94a6-2f1cd6b2b8d3 sending to next pipeline
2026-03-26 22:52:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 0ff79cea-eef6-5bc9-94a6-2f1cd6b2b8d3, identifier: 1985450
2026-03-26 22:52:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e37890>
2026-03-26 22:52:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05305e5a-ae85-5ea5-9b7c-4b326ebe5517/05305e5a-ae85-5ea5-9b7c-4b326ebe5517_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fcec1020c4f394ceca3713b41a2820cc5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/cec1020c4f394ceca3713b41a2820cc5/images/large/1.jpg saved to cache
2026-03-26 22:52:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 05305e5a-ae85-5ea5-9b7c-4b326ebe5517
2026-03-26 22:52:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/cec1020c4f394ceca3713b41a2820cc5/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fcec1020c4f394ceca3713b41a2820cc5%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/cec1020c4f394ceca3713b41a2820cc5/images/large/9.jpg not downloaded yet
2026-03-26 22:52:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 0ff79cea-eef6-5bc9-94a6-2f1cd6b2b8d3 with identifier: 1985450
2026-03-26 22:52:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 0ff79cea-eef6-5bc9-94a6-2f1cd6b2b8d3 with identifier: 1985450
2026-03-26 22:52:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 0ff79cea-eef6-5bc9-94a6-2f1cd6b2b8d3 with identifier: 1985450 to the API
2026-03-26 22:52:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:52:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:52:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ct/75b417c66cef4c39919958ad21eedf05/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'electric',
 'id': '0ff79cea-eef6-5bc9-94a6-2f1cd6b2b8d3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 62676,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ff79cea-eef6-5bc9-94a6-2f1cd6b2b8d3/0ff79cea-eef6-5bc9-94a6-2f1cd6b2b8d3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 250466,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/75b417c66cef4c39919958ad21eedf05/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ff79cea-eef6-5bc9-94a6-2f1cd6b2b8d3/0ff79cea-eef6-5bc9-94a6-2f1cd6b2b8d3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 245106,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/75b417c66cef4c39919958ad21eedf05/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ff79cea-eef6-5bc9-94a6-2f1cd6b2b8d3/0ff79cea-eef6-5bc9-94a6-2f1cd6b2b8d3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 278834,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/75b417c66cef4c39919958ad21eedf05/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ff79cea-eef6-5bc9-94a6-2f1cd6b2b8d3/0ff79cea-eef6-5bc9-94a6-2f1cd6b2b8d3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 274274,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/75b417c66cef4c39919958ad21eedf05/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ff79cea-eef6-5bc9-94a6-2f1cd6b2b8d3/0ff79cea-eef6-5bc9-94a6-2f1cd6b2b8d3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 274402,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/75b417c66cef4c39919958ad21eedf05/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ff79cea-eef6-5bc9-94a6-2f1cd6b2b8d3/0ff79cea-eef6-5bc9-94a6-2f1cd6b2b8d3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 245558,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/75b417c66cef4c39919958ad21eedf05/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ff79cea-eef6-5bc9-94a6-2f1cd6b2b8d3/0ff79cea-eef6-5bc9-94a6-2f1cd6b2b8d3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 256019,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/75b417c66cef4c39919958ad21eedf05/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ff79cea-eef6-5bc9-94a6-2f1cd6b2b8d3/0ff79cea-eef6-5bc9-94a6-2f1cd6b2b8d3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 356511,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/75b417c66cef4c39919958ad21eedf05/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ff79cea-eef6-5bc9-94a6-2f1cd6b2b8d3/0ff79cea-eef6-5bc9-94a6-2f1cd6b2b8d3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 277339,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/75b417c66cef4c39919958ad21eedf05/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ff79cea-eef6-5bc9-94a6-2f1cd6b2b8d3/0ff79cea-eef6-5bc9-94a6-2f1cd6b2b8d3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 253252,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/75b417c66cef4c39919958ad21eedf05/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 BEV 70KWH RECHARGE PLUS',
 'transmission': 'automatic',
 'trim': 'BEV 70KWH RECHARGE PLUS',
 'vin': None,
 'year': 2022}
2026-03-26 22:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985450%27 HTTP/1.1" 200 None
2026-03-26 22:52:00 [ayvens.be] INFO: Saving data for 1985450: {'created_time': 1774565520.976353, 'last_price_update_time': 1774565520.976363, 'auction_closing_time': 1774958400.0}
2026-03-26 22:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985450') HTTP/1.1" 204 0
2026-03-26 22:52:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/cec1020c4f394ceca3713b41a2820cc5/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fcec1020c4f394ceca3713b41a2820cc5%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/cec1020c4f394ceca3713b41a2820cc5/images/large/10.jpg not downloaded yet
2026-03-26 22:52:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b99710>
2026-03-26 22:52:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05305e5a-ae85-5ea5-9b7c-4b326ebe5517/05305e5a-ae85-5ea5-9b7c-4b326ebe5517_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fcec1020c4f394ceca3713b41a2820cc5%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/cec1020c4f394ceca3713b41a2820cc5/images/large/2.jpg saved to cache
2026-03-26 22:52:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 05305e5a-ae85-5ea5-9b7c-4b326ebe5517
2026-03-26 22:52:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80cad3d850>
2026-03-26 22:52:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05305e5a-ae85-5ea5-9b7c-4b326ebe5517/05305e5a-ae85-5ea5-9b7c-4b326ebe5517_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fcec1020c4f394ceca3713b41a2820cc5%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/cec1020c4f394ceca3713b41a2820cc5/images/large/3.jpg saved to cache
2026-03-26 22:52:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 05305e5a-ae85-5ea5-9b7c-4b326ebe5517
2026-03-26 22:52:01 [ayvens.be] INFO: Found listing with ID: 1985452
2026-03-26 22:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985452%27 HTTP/1.1" 200 None
2026-03-26 22:52:01 [ayvens.be] INFO: Scrape type for 1985452: 1
2026-03-26 22:52:01 [ayvens.be] INFO: Extracting data for car ID: 1985452
2026-03-26 22:52:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a66ca23-9a13-5a20-bf55-db5cde8cb111 with identifier: 1985452
2026-03-26 22:52:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a66ca23-9a13-5a20-bf55-db5cde8cb111 with scrape type 1
2026-03-26 22:52:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4a66ca23-9a13-5a20-bf55-db5cde8cb111
2026-03-26 22:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Fcb88a6dde9c94d81b99213898cf7de6a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/cb88a6dde9c94d81b99213898cf7de6a/images/large/1.jpg not downloaded yet
2026-03-26 22:52:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/cec1020c4f394ceca3713b41a2820cc5/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/cec1020c4f394ceca3713b41a2820cc5/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Fcb88a6dde9c94d81b99213898cf7de6a%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/cb88a6dde9c94d81b99213898cf7de6a/images/large/2.jpg not downloaded yet
2026-03-26 22:52:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7688250>
2026-03-26 22:52:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05305e5a-ae85-5ea5-9b7c-4b326ebe5517/05305e5a-ae85-5ea5-9b7c-4b326ebe5517_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fcec1020c4f394ceca3713b41a2820cc5%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/cec1020c4f394ceca3713b41a2820cc5/images/large/4.jpg saved to cache
2026-03-26 22:52:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 05305e5a-ae85-5ea5-9b7c-4b326ebe5517
2026-03-26 22:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Fcb88a6dde9c94d81b99213898cf7de6a%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/cb88a6dde9c94d81b99213898cf7de6a/images/large/3.jpg not downloaded yet
2026-03-26 22:52:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/cec1020c4f394ceca3713b41a2820cc5/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/cec1020c4f394ceca3713b41a2820cc5/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Fcb88a6dde9c94d81b99213898cf7de6a%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/cb88a6dde9c94d81b99213898cf7de6a/images/large/4.jpg not downloaded yet
2026-03-26 22:52:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76e37d0>
2026-03-26 22:52:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05305e5a-ae85-5ea5-9b7c-4b326ebe5517/05305e5a-ae85-5ea5-9b7c-4b326ebe5517_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fcec1020c4f394ceca3713b41a2820cc5%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/cec1020c4f394ceca3713b41a2820cc5/images/large/5.jpg saved to cache
2026-03-26 22:52:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 05305e5a-ae85-5ea5-9b7c-4b326ebe5517
2026-03-26 22:52:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74a4210>
2026-03-26 22:52:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05305e5a-ae85-5ea5-9b7c-4b326ebe5517/05305e5a-ae85-5ea5-9b7c-4b326ebe5517_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fcec1020c4f394ceca3713b41a2820cc5%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/cec1020c4f394ceca3713b41a2820cc5/images/large/6.jpg saved to cache
2026-03-26 22:52:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 05305e5a-ae85-5ea5-9b7c-4b326ebe5517
2026-03-26 22:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Fcb88a6dde9c94d81b99213898cf7de6a%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/cb88a6dde9c94d81b99213898cf7de6a/images/large/5.jpg not downloaded yet
2026-03-26 22:52:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/cec1020c4f394ceca3713b41a2820cc5/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/cec1020c4f394ceca3713b41a2820cc5/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Fcb88a6dde9c94d81b99213898cf7de6a%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/cb88a6dde9c94d81b99213898cf7de6a/images/large/6.jpg not downloaded yet
2026-03-26 22:52:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7480450>
2026-03-26 22:52:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05305e5a-ae85-5ea5-9b7c-4b326ebe5517/05305e5a-ae85-5ea5-9b7c-4b326ebe5517_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fcec1020c4f394ceca3713b41a2820cc5%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/cec1020c4f394ceca3713b41a2820cc5/images/large/7.jpg saved to cache
2026-03-26 22:52:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 05305e5a-ae85-5ea5-9b7c-4b326ebe5517
2026-03-26 22:52:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b788e690>
2026-03-26 22:52:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05305e5a-ae85-5ea5-9b7c-4b326ebe5517/05305e5a-ae85-5ea5-9b7c-4b326ebe5517_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fcec1020c4f394ceca3713b41a2820cc5%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/cec1020c4f394ceca3713b41a2820cc5/images/large/8.jpg saved to cache
2026-03-26 22:52:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 05305e5a-ae85-5ea5-9b7c-4b326ebe5517
2026-03-26 22:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Fcb88a6dde9c94d81b99213898cf7de6a%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/cb88a6dde9c94d81b99213898cf7de6a/images/large/7.jpg not downloaded yet
2026-03-26 22:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Fcb88a6dde9c94d81b99213898cf7de6a%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/cb88a6dde9c94d81b99213898cf7de6a/images/large/8.jpg not downloaded yet
2026-03-26 22:52:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74a6ad0>
2026-03-26 22:52:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05305e5a-ae85-5ea5-9b7c-4b326ebe5517/05305e5a-ae85-5ea5-9b7c-4b326ebe5517_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fcec1020c4f394ceca3713b41a2820cc5%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/cec1020c4f394ceca3713b41a2820cc5/images/large/9.jpg saved to cache
2026-03-26 22:52:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 05305e5a-ae85-5ea5-9b7c-4b326ebe5517
2026-03-26 22:52:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76e0410>
2026-03-26 22:52:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05305e5a-ae85-5ea5-9b7c-4b326ebe5517/05305e5a-ae85-5ea5-9b7c-4b326ebe5517_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fcec1020c4f394ceca3713b41a2820cc5%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/cec1020c4f394ceca3713b41a2820cc5/images/large/10.jpg saved to cache
2026-03-26 22:52:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 05305e5a-ae85-5ea5-9b7c-4b326ebe5517
2026-03-26 22:52:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 05305e5a-ae85-5ea5-9b7c-4b326ebe5517, skipping ID generation
2026-03-26 22:52:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05305e5a-ae85-5ea5-9b7c-4b326ebe5517 with scrape type 1
2026-03-26 22:52:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 05305e5a-ae85-5ea5-9b7c-4b326ebe5517 sending to next pipeline
2026-03-26 22:52:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 05305e5a-ae85-5ea5-9b7c-4b326ebe5517, identifier: 1985451
2026-03-26 22:52:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 05305e5a-ae85-5ea5-9b7c-4b326ebe5517 with identifier: 1985451
2026-03-26 22:52:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 05305e5a-ae85-5ea5-9b7c-4b326ebe5517 with identifier: 1985451
2026-03-26 22:52:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 05305e5a-ae85-5ea5-9b7c-4b326ebe5517 with identifier: 1985451 to the API
2026-03-26 22:52:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:52:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:52:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bm/cec1020c4f394ceca3713b41a2820cc5/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '05305e5a-ae85-5ea5-9b7c-4b326ebe5517',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X2',
 'odometer': 83954,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05305e5a-ae85-5ea5-9b7c-4b326ebe5517/05305e5a-ae85-5ea5-9b7c-4b326ebe5517_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 257320,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/cec1020c4f394ceca3713b41a2820cc5/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05305e5a-ae85-5ea5-9b7c-4b326ebe5517/05305e5a-ae85-5ea5-9b7c-4b326ebe5517_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 269193,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/cec1020c4f394ceca3713b41a2820cc5/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05305e5a-ae85-5ea5-9b7c-4b326ebe5517/05305e5a-ae85-5ea5-9b7c-4b326ebe5517_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 266615,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/cec1020c4f394ceca3713b41a2820cc5/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05305e5a-ae85-5ea5-9b7c-4b326ebe5517/05305e5a-ae85-5ea5-9b7c-4b326ebe5517_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 272568,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/cec1020c4f394ceca3713b41a2820cc5/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05305e5a-ae85-5ea5-9b7c-4b326ebe5517/05305e5a-ae85-5ea5-9b7c-4b326ebe5517_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 288566,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/cec1020c4f394ceca3713b41a2820cc5/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05305e5a-ae85-5ea5-9b7c-4b326ebe5517/05305e5a-ae85-5ea5-9b7c-4b326ebe5517_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 266915,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/cec1020c4f394ceca3713b41a2820cc5/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05305e5a-ae85-5ea5-9b7c-4b326ebe5517/05305e5a-ae85-5ea5-9b7c-4b326ebe5517_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 284062,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/cec1020c4f394ceca3713b41a2820cc5/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05305e5a-ae85-5ea5-9b7c-4b326ebe5517/05305e5a-ae85-5ea5-9b7c-4b326ebe5517_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 342183,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/cec1020c4f394ceca3713b41a2820cc5/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05305e5a-ae85-5ea5-9b7c-4b326ebe5517/05305e5a-ae85-5ea5-9b7c-4b326ebe5517_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 319289,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/cec1020c4f394ceca3713b41a2820cc5/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05305e5a-ae85-5ea5-9b7c-4b326ebe5517/05305e5a-ae85-5ea5-9b7c-4b326ebe5517_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 364704,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/cec1020c4f394ceca3713b41a2820cc5/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X2 1.5 SDRIVE18I 100KW',
 'transmission': 'manual',
 'trim': '1.5 SDRIVE18I 100KW',
 'vin': None,
 'year': 2022}
2026-03-26 22:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985451%27 HTTP/1.1" 200 None
2026-03-26 22:52:02 [ayvens.be] INFO: Saving data for 1985451: {'created_time': 1774565522.373153, 'last_price_update_time': 1774565522.373162, 'auction_closing_time': 1774958400.0}
2026-03-26 22:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985451') HTTP/1.1" 204 0
2026-03-26 22:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Fcb88a6dde9c94d81b99213898cf7de6a%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/cb88a6dde9c94d81b99213898cf7de6a/images/large/9.jpg not downloaded yet
2026-03-26 22:52:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/cb88a6dde9c94d81b99213898cf7de6a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/cb88a6dde9c94d81b99213898cf7de6a/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Fcb88a6dde9c94d81b99213898cf7de6a%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/cb88a6dde9c94d81b99213898cf7de6a/images/large/10.jpg not downloaded yet
2026-03-26 22:52:02 [ayvens.be] INFO: Found listing with ID: 1985453
2026-03-26 22:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985453%27 HTTP/1.1" 200 None
2026-03-26 22:52:02 [ayvens.be] INFO: Scrape type for 1985453: 1
2026-03-26 22:52:02 [ayvens.be] INFO: Extracting data for car ID: 1985453
2026-03-26 22:52:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dcebad65-19ff-574e-af4a-d5af2b74f1ff with identifier: 1985453
2026-03-26 22:52:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dcebad65-19ff-574e-af4a-d5af2b74f1ff with scrape type 1
2026-03-26 22:52:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dcebad65-19ff-574e-af4a-d5af2b74f1ff
2026-03-26 22:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fb5c7bf3833f443318e1341b5979f7acc%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/b5c7bf3833f443318e1341b5979f7acc/images/large/1.jpg not downloaded yet
2026-03-26 22:52:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/cb88a6dde9c94d81b99213898cf7de6a/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fb5c7bf3833f443318e1341b5979f7acc%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/b5c7bf3833f443318e1341b5979f7acc/images/large/2.jpg not downloaded yet
2026-03-26 22:52:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/cb88a6dde9c94d81b99213898cf7de6a/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/cb88a6dde9c94d81b99213898cf7de6a/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fb5c7bf3833f443318e1341b5979f7acc%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/b5c7bf3833f443318e1341b5979f7acc/images/large/3.jpg not downloaded yet
2026-03-26 22:52:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/cb88a6dde9c94d81b99213898cf7de6a/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fb5c7bf3833f443318e1341b5979f7acc%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/b5c7bf3833f443318e1341b5979f7acc/images/large/4.jpg not downloaded yet
2026-03-26 22:52:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7769f90>
2026-03-26 22:52:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a66ca23-9a13-5a20-bf55-db5cde8cb111/4a66ca23-9a13-5a20-bf55-db5cde8cb111_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Fcb88a6dde9c94d81b99213898cf7de6a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/cb88a6dde9c94d81b99213898cf7de6a/images/large/1.jpg saved to cache
2026-03-26 22:52:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4a66ca23-9a13-5a20-bf55-db5cde8cb111
2026-03-26 22:52:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b741c190>
2026-03-26 22:52:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a66ca23-9a13-5a20-bf55-db5cde8cb111/4a66ca23-9a13-5a20-bf55-db5cde8cb111_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Fcb88a6dde9c94d81b99213898cf7de6a%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/cb88a6dde9c94d81b99213898cf7de6a/images/large/2.jpg saved to cache
2026-03-26 22:52:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4a66ca23-9a13-5a20-bf55-db5cde8cb111
2026-03-26 22:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fb5c7bf3833f443318e1341b5979f7acc%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/b5c7bf3833f443318e1341b5979f7acc/images/large/5.jpg not downloaded yet
2026-03-26 22:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fb5c7bf3833f443318e1341b5979f7acc%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/b5c7bf3833f443318e1341b5979f7acc/images/large/6.jpg not downloaded yet
2026-03-26 22:52:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74a5590>
2026-03-26 22:52:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a66ca23-9a13-5a20-bf55-db5cde8cb111/4a66ca23-9a13-5a20-bf55-db5cde8cb111_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Fcb88a6dde9c94d81b99213898cf7de6a%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/cb88a6dde9c94d81b99213898cf7de6a/images/large/3.jpg saved to cache
2026-03-26 22:52:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4a66ca23-9a13-5a20-bf55-db5cde8cb111
2026-03-26 22:52:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76cc3d0>
2026-03-26 22:52:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a66ca23-9a13-5a20-bf55-db5cde8cb111/4a66ca23-9a13-5a20-bf55-db5cde8cb111_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Fcb88a6dde9c94d81b99213898cf7de6a%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/cb88a6dde9c94d81b99213898cf7de6a/images/large/4.jpg saved to cache
2026-03-26 22:52:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4a66ca23-9a13-5a20-bf55-db5cde8cb111
2026-03-26 22:52:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7aa09d0>
2026-03-26 22:52:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a66ca23-9a13-5a20-bf55-db5cde8cb111/4a66ca23-9a13-5a20-bf55-db5cde8cb111_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Fcb88a6dde9c94d81b99213898cf7de6a%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/cb88a6dde9c94d81b99213898cf7de6a/images/large/5.jpg saved to cache
2026-03-26 22:52:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4a66ca23-9a13-5a20-bf55-db5cde8cb111
2026-03-26 22:52:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b777bbd0>
2026-03-26 22:52:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a66ca23-9a13-5a20-bf55-db5cde8cb111/4a66ca23-9a13-5a20-bf55-db5cde8cb111_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Fcb88a6dde9c94d81b99213898cf7de6a%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/cb88a6dde9c94d81b99213898cf7de6a/images/large/6.jpg saved to cache
2026-03-26 22:52:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4a66ca23-9a13-5a20-bf55-db5cde8cb111
2026-03-26 22:52:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/cb88a6dde9c94d81b99213898cf7de6a/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fb5c7bf3833f443318e1341b5979f7acc%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/b5c7bf3833f443318e1341b5979f7acc/images/large/7.jpg not downloaded yet
2026-03-26 22:52:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/cb88a6dde9c94d81b99213898cf7de6a/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fb5c7bf3833f443318e1341b5979f7acc%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/b5c7bf3833f443318e1341b5979f7acc/images/large/8.jpg not downloaded yet
2026-03-26 22:52:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/cb88a6dde9c94d81b99213898cf7de6a/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/cb88a6dde9c94d81b99213898cf7de6a/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fb5c7bf3833f443318e1341b5979f7acc%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/b5c7bf3833f443318e1341b5979f7acc/images/large/9.jpg not downloaded yet
2026-03-26 22:52:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/b5c7bf3833f443318e1341b5979f7acc/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/b5c7bf3833f443318e1341b5979f7acc/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fb5c7bf3833f443318e1341b5979f7acc%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/b5c7bf3833f443318e1341b5979f7acc/images/large/10.jpg not downloaded yet
2026-03-26 22:52:03 [ayvens.be] INFO: Found listing with ID: 1985454
2026-03-26 22:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985454%27 HTTP/1.1" 200 None
2026-03-26 22:52:03 [ayvens.be] INFO: Scrape type for 1985454: 1
2026-03-26 22:52:03 [ayvens.be] INFO: Extracting data for car ID: 1985454
2026-03-26 22:52:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 419dea60-40ec-58ec-b8a5-92561d4b6c07 with identifier: 1985454
2026-03-26 22:52:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 419dea60-40ec-58ec-b8a5-92561d4b6c07 with scrape type 1
2026-03-26 22:52:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 419dea60-40ec-58ec-b8a5-92561d4b6c07
2026-03-26 22:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F4580fc00efe241a9af2de452045f0da0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/4580fc00efe241a9af2de452045f0da0/images/large/1.jpg not downloaded yet
2026-03-26 22:52:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/b5c7bf3833f443318e1341b5979f7acc/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F4580fc00efe241a9af2de452045f0da0%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/4580fc00efe241a9af2de452045f0da0/images/large/2.jpg not downloaded yet
2026-03-26 22:52:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/b5c7bf3833f443318e1341b5979f7acc/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c757d0>
2026-03-26 22:52:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a66ca23-9a13-5a20-bf55-db5cde8cb111/4a66ca23-9a13-5a20-bf55-db5cde8cb111_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Fcb88a6dde9c94d81b99213898cf7de6a%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/cb88a6dde9c94d81b99213898cf7de6a/images/large/7.jpg saved to cache
2026-03-26 22:52:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4a66ca23-9a13-5a20-bf55-db5cde8cb111
2026-03-26 22:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F4580fc00efe241a9af2de452045f0da0%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/4580fc00efe241a9af2de452045f0da0/images/large/3.jpg not downloaded yet
2026-03-26 22:52:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b787f610>
2026-03-26 22:52:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a66ca23-9a13-5a20-bf55-db5cde8cb111/4a66ca23-9a13-5a20-bf55-db5cde8cb111_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Fcb88a6dde9c94d81b99213898cf7de6a%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/cb88a6dde9c94d81b99213898cf7de6a/images/large/9.jpg saved to cache
2026-03-26 22:52:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4a66ca23-9a13-5a20-bf55-db5cde8cb111
2026-03-26 22:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F4580fc00efe241a9af2de452045f0da0%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/4580fc00efe241a9af2de452045f0da0/images/large/4.jpg not downloaded yet
2026-03-26 22:52:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7405a10>
2026-03-26 22:52:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a66ca23-9a13-5a20-bf55-db5cde8cb111/4a66ca23-9a13-5a20-bf55-db5cde8cb111_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Fcb88a6dde9c94d81b99213898cf7de6a%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/cb88a6dde9c94d81b99213898cf7de6a/images/large/8.jpg saved to cache
2026-03-26 22:52:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4a66ca23-9a13-5a20-bf55-db5cde8cb111
2026-03-26 22:52:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7cce8d0>
2026-03-26 22:52:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a66ca23-9a13-5a20-bf55-db5cde8cb111/4a66ca23-9a13-5a20-bf55-db5cde8cb111_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Fcb88a6dde9c94d81b99213898cf7de6a%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/cb88a6dde9c94d81b99213898cf7de6a/images/large/10.jpg saved to cache
2026-03-26 22:52:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4a66ca23-9a13-5a20-bf55-db5cde8cb111
2026-03-26 22:52:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4a66ca23-9a13-5a20-bf55-db5cde8cb111, skipping ID generation
2026-03-26 22:52:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a66ca23-9a13-5a20-bf55-db5cde8cb111 with scrape type 1
2026-03-26 22:52:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4a66ca23-9a13-5a20-bf55-db5cde8cb111 sending to next pipeline
2026-03-26 22:52:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 4a66ca23-9a13-5a20-bf55-db5cde8cb111, identifier: 1985452
2026-03-26 22:52:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79dda90>
2026-03-26 22:52:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcebad65-19ff-574e-af4a-d5af2b74f1ff/dcebad65-19ff-574e-af4a-d5af2b74f1ff_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fb5c7bf3833f443318e1341b5979f7acc%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/b5c7bf3833f443318e1341b5979f7acc/images/large/1.jpg saved to cache
2026-03-26 22:52:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dcebad65-19ff-574e-af4a-d5af2b74f1ff
2026-03-26 22:52:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b746cd90>
2026-03-26 22:52:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcebad65-19ff-574e-af4a-d5af2b74f1ff/dcebad65-19ff-574e-af4a-d5af2b74f1ff_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fb5c7bf3833f443318e1341b5979f7acc%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/b5c7bf3833f443318e1341b5979f7acc/images/large/2.jpg saved to cache
2026-03-26 22:52:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dcebad65-19ff-574e-af4a-d5af2b74f1ff
2026-03-26 22:52:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b9a890>
2026-03-26 22:52:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcebad65-19ff-574e-af4a-d5af2b74f1ff/dcebad65-19ff-574e-af4a-d5af2b74f1ff_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fb5c7bf3833f443318e1341b5979f7acc%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/b5c7bf3833f443318e1341b5979f7acc/images/large/3.jpg saved to cache
2026-03-26 22:52:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dcebad65-19ff-574e-af4a-d5af2b74f1ff
2026-03-26 22:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F4580fc00efe241a9af2de452045f0da0%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/4580fc00efe241a9af2de452045f0da0/images/large/5.jpg not downloaded yet
2026-03-26 22:52:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 4a66ca23-9a13-5a20-bf55-db5cde8cb111 with identifier: 1985452
2026-03-26 22:52:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 4a66ca23-9a13-5a20-bf55-db5cde8cb111 with identifier: 1985452
2026-03-26 22:52:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 4a66ca23-9a13-5a20-bf55-db5cde8cb111 with identifier: 1985452 to the API
2026-03-26 22:52:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:52:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:52:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cr/cb88a6dde9c94d81b99213898cf7de6a/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '4a66ca23-9a13-5a20-bf55-db5cde8cb111',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A5 SPORTBACK',
 'odometer': 195631,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a66ca23-9a13-5a20-bf55-db5cde8cb111/4a66ca23-9a13-5a20-bf55-db5cde8cb111_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 624120,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/cb88a6dde9c94d81b99213898cf7de6a/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a66ca23-9a13-5a20-bf55-db5cde8cb111/4a66ca23-9a13-5a20-bf55-db5cde8cb111_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 612237,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/cb88a6dde9c94d81b99213898cf7de6a/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a66ca23-9a13-5a20-bf55-db5cde8cb111/4a66ca23-9a13-5a20-bf55-db5cde8cb111_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 618956,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/cb88a6dde9c94d81b99213898cf7de6a/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a66ca23-9a13-5a20-bf55-db5cde8cb111/4a66ca23-9a13-5a20-bf55-db5cde8cb111_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 687239,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/cb88a6dde9c94d81b99213898cf7de6a/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a66ca23-9a13-5a20-bf55-db5cde8cb111/4a66ca23-9a13-5a20-bf55-db5cde8cb111_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 578465,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/cb88a6dde9c94d81b99213898cf7de6a/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a66ca23-9a13-5a20-bf55-db5cde8cb111/4a66ca23-9a13-5a20-bf55-db5cde8cb111_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 630596,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/cb88a6dde9c94d81b99213898cf7de6a/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a66ca23-9a13-5a20-bf55-db5cde8cb111/4a66ca23-9a13-5a20-bf55-db5cde8cb111_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 607518,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/cb88a6dde9c94d81b99213898cf7de6a/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a66ca23-9a13-5a20-bf55-db5cde8cb111/4a66ca23-9a13-5a20-bf55-db5cde8cb111_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 706584,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/cb88a6dde9c94d81b99213898cf7de6a/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a66ca23-9a13-5a20-bf55-db5cde8cb111/4a66ca23-9a13-5a20-bf55-db5cde8cb111_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 480935,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/cb88a6dde9c94d81b99213898cf7de6a/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a66ca23-9a13-5a20-bf55-db5cde8cb111/4a66ca23-9a13-5a20-bf55-db5cde8cb111_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 532071,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/cb88a6dde9c94d81b99213898cf7de6a/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-02',
 'seats_number': 4,
 'seller_name': None,
 'title': 'AUDI A5 SPORTBACK 2.0 30 TDI S TRONIC BUS. ED. ATTRACTION',
 'transmission': 'automatic',
 'trim': '2.0 30 TDI S TRONIC BUS. ED. ATTRACTION',
 'vin': None,
 'year': 2022}
2026-03-26 22:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985452%27 HTTP/1.1" 200 None
2026-03-26 22:52:04 [ayvens.be] INFO: Saving data for 1985452: {'created_time': 1774565524.329393, 'last_price_update_time': 1774565524.329403, 'auction_closing_time': 1774958400.0}
2026-03-26 22:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985452') HTTP/1.1" 204 0
2026-03-26 22:52:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76ec690>
2026-03-26 22:52:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcebad65-19ff-574e-af4a-d5af2b74f1ff/dcebad65-19ff-574e-af4a-d5af2b74f1ff_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fb5c7bf3833f443318e1341b5979f7acc%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/b5c7bf3833f443318e1341b5979f7acc/images/large/4.jpg saved to cache
2026-03-26 22:52:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dcebad65-19ff-574e-af4a-d5af2b74f1ff
2026-03-26 22:52:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/b5c7bf3833f443318e1341b5979f7acc/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/b5c7bf3833f443318e1341b5979f7acc/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F4580fc00efe241a9af2de452045f0da0%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/4580fc00efe241a9af2de452045f0da0/images/large/6.jpg not downloaded yet
2026-03-26 22:52:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/b5c7bf3833f443318e1341b5979f7acc/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F4580fc00efe241a9af2de452045f0da0%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/4580fc00efe241a9af2de452045f0da0/images/large/7.jpg not downloaded yet
2026-03-26 22:52:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/b5c7bf3833f443318e1341b5979f7acc/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/b5c7bf3833f443318e1341b5979f7acc/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/b5c7bf3833f443318e1341b5979f7acc/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F4580fc00efe241a9af2de452045f0da0%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/4580fc00efe241a9af2de452045f0da0/images/large/8.jpg not downloaded yet
2026-03-26 22:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F4580fc00efe241a9af2de452045f0da0%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/4580fc00efe241a9af2de452045f0da0/images/large/9.jpg not downloaded yet
2026-03-26 22:52:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/4580fc00efe241a9af2de452045f0da0/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F4580fc00efe241a9af2de452045f0da0%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/4580fc00efe241a9af2de452045f0da0/images/large/10.jpg not downloaded yet
2026-03-26 22:52:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/4580fc00efe241a9af2de452045f0da0/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74819d0>
2026-03-26 22:52:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcebad65-19ff-574e-af4a-d5af2b74f1ff/dcebad65-19ff-574e-af4a-d5af2b74f1ff_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fb5c7bf3833f443318e1341b5979f7acc%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/b5c7bf3833f443318e1341b5979f7acc/images/large/5.jpg saved to cache
2026-03-26 22:52:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dcebad65-19ff-574e-af4a-d5af2b74f1ff
2026-03-26 22:52:04 [ayvens.be] INFO: Found listing with ID: 1985455
2026-03-26 22:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985455%27 HTTP/1.1" 200 None
2026-03-26 22:52:04 [ayvens.be] INFO: Scrape type for 1985455: 1
2026-03-26 22:52:04 [ayvens.be] INFO: Extracting data for car ID: 1985455
2026-03-26 22:52:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9971293-22a3-56ba-a1df-35de5b0fe5ea with identifier: 1985455
2026-03-26 22:52:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9971293-22a3-56ba-a1df-35de5b0fe5ea with scrape type 1
2026-03-26 22:52:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c9971293-22a3-56ba-a1df-35de5b0fe5ea
2026-03-26 22:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fbd06efd36b6d45109f8e659fa3166a02%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/bd06efd36b6d45109f8e659fa3166a02/images/large/1.jpg not downloaded yet
2026-03-26 22:52:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7452a90>
2026-03-26 22:52:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcebad65-19ff-574e-af4a-d5af2b74f1ff/dcebad65-19ff-574e-af4a-d5af2b74f1ff_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fb5c7bf3833f443318e1341b5979f7acc%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/b5c7bf3833f443318e1341b5979f7acc/images/large/6.jpg saved to cache
2026-03-26 22:52:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dcebad65-19ff-574e-af4a-d5af2b74f1ff
2026-03-26 22:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fbd06efd36b6d45109f8e659fa3166a02%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/bd06efd36b6d45109f8e659fa3166a02/images/large/2.jpg not downloaded yet
2026-03-26 22:52:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b781bbd0>
2026-03-26 22:52:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcebad65-19ff-574e-af4a-d5af2b74f1ff/dcebad65-19ff-574e-af4a-d5af2b74f1ff_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fb5c7bf3833f443318e1341b5979f7acc%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/b5c7bf3833f443318e1341b5979f7acc/images/large/10.jpg saved to cache
2026-03-26 22:52:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item dcebad65-19ff-574e-af4a-d5af2b74f1ff
2026-03-26 22:52:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd3ba6d0>
2026-03-26 22:52:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcebad65-19ff-574e-af4a-d5af2b74f1ff/dcebad65-19ff-574e-af4a-d5af2b74f1ff_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fb5c7bf3833f443318e1341b5979f7acc%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/b5c7bf3833f443318e1341b5979f7acc/images/large/7.jpg saved to cache
2026-03-26 22:52:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item dcebad65-19ff-574e-af4a-d5af2b74f1ff
2026-03-26 22:52:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b728ff10>
2026-03-26 22:52:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcebad65-19ff-574e-af4a-d5af2b74f1ff/dcebad65-19ff-574e-af4a-d5af2b74f1ff_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fb5c7bf3833f443318e1341b5979f7acc%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/b5c7bf3833f443318e1341b5979f7acc/images/large/9.jpg saved to cache
2026-03-26 22:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item dcebad65-19ff-574e-af4a-d5af2b74f1ff
2026-03-26 22:52:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7688a10>
2026-03-26 22:52:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcebad65-19ff-574e-af4a-d5af2b74f1ff/dcebad65-19ff-574e-af4a-d5af2b74f1ff_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fb5c7bf3833f443318e1341b5979f7acc%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/b5c7bf3833f443318e1341b5979f7acc/images/large/8.jpg saved to cache
2026-03-26 22:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item dcebad65-19ff-574e-af4a-d5af2b74f1ff
2026-03-26 22:52:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dcebad65-19ff-574e-af4a-d5af2b74f1ff, skipping ID generation
2026-03-26 22:52:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dcebad65-19ff-574e-af4a-d5af2b74f1ff with scrape type 1
2026-03-26 22:52:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dcebad65-19ff-574e-af4a-d5af2b74f1ff sending to next pipeline
2026-03-26 22:52:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: dcebad65-19ff-574e-af4a-d5af2b74f1ff, identifier: 1985453
2026-03-26 22:52:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6dd8e50>
2026-03-26 22:52:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_419dea60-40ec-58ec-b8a5-92561d4b6c07/419dea60-40ec-58ec-b8a5-92561d4b6c07_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F4580fc00efe241a9af2de452045f0da0%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/4580fc00efe241a9af2de452045f0da0/images/large/3.jpg saved to cache
2026-03-26 22:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 419dea60-40ec-58ec-b8a5-92561d4b6c07
2026-03-26 22:52:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74ad750>
2026-03-26 22:52:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_419dea60-40ec-58ec-b8a5-92561d4b6c07/419dea60-40ec-58ec-b8a5-92561d4b6c07_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F4580fc00efe241a9af2de452045f0da0%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/4580fc00efe241a9af2de452045f0da0/images/large/2.jpg saved to cache
2026-03-26 22:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 419dea60-40ec-58ec-b8a5-92561d4b6c07
2026-03-26 22:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fbd06efd36b6d45109f8e659fa3166a02%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/bd06efd36b6d45109f8e659fa3166a02/images/large/3.jpg not downloaded yet
2026-03-26 22:52:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: dcebad65-19ff-574e-af4a-d5af2b74f1ff with identifier: 1985453
2026-03-26 22:52:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: dcebad65-19ff-574e-af4a-d5af2b74f1ff with identifier: 1985453
2026-03-26 22:52:05 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: dcebad65-19ff-574e-af4a-d5af2b74f1ff with identifier: 1985453 to the API
2026-03-26 22:52:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:52:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:52:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yw/b5c7bf3833f443318e1341b5979f7acc/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'dcebad65-19ff-574e-af4a-d5af2b74f1ff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A4',
 'odometer': 124094,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcebad65-19ff-574e-af4a-d5af2b74f1ff/dcebad65-19ff-574e-af4a-d5af2b74f1ff_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 615848,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/b5c7bf3833f443318e1341b5979f7acc/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcebad65-19ff-574e-af4a-d5af2b74f1ff/dcebad65-19ff-574e-af4a-d5af2b74f1ff_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 598008,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/b5c7bf3833f443318e1341b5979f7acc/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcebad65-19ff-574e-af4a-d5af2b74f1ff/dcebad65-19ff-574e-af4a-d5af2b74f1ff_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 637015,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/b5c7bf3833f443318e1341b5979f7acc/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcebad65-19ff-574e-af4a-d5af2b74f1ff/dcebad65-19ff-574e-af4a-d5af2b74f1ff_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 729198,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/b5c7bf3833f443318e1341b5979f7acc/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcebad65-19ff-574e-af4a-d5af2b74f1ff/dcebad65-19ff-574e-af4a-d5af2b74f1ff_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 687781,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/b5c7bf3833f443318e1341b5979f7acc/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcebad65-19ff-574e-af4a-d5af2b74f1ff/dcebad65-19ff-574e-af4a-d5af2b74f1ff_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 583713,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/b5c7bf3833f443318e1341b5979f7acc/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcebad65-19ff-574e-af4a-d5af2b74f1ff/dcebad65-19ff-574e-af4a-d5af2b74f1ff_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 738811,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/b5c7bf3833f443318e1341b5979f7acc/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcebad65-19ff-574e-af4a-d5af2b74f1ff/dcebad65-19ff-574e-af4a-d5af2b74f1ff_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 704559,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/b5c7bf3833f443318e1341b5979f7acc/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcebad65-19ff-574e-af4a-d5af2b74f1ff/dcebad65-19ff-574e-af4a-d5af2b74f1ff_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 579404,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/b5c7bf3833f443318e1341b5979f7acc/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcebad65-19ff-574e-af4a-d5af2b74f1ff/dcebad65-19ff-574e-af4a-d5af2b74f1ff_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 497226,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/b5c7bf3833f443318e1341b5979f7acc/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A4 2.0 30 TDI 100KW S TR ADV BUSINESS ED',
 'transmission': 'automatic',
 'trim': '2.0 30 TDI 100KW S TR ADV BUSINESS ED',
 'vin': None,
 'year': 2021}
2026-03-26 22:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985453%27 HTTP/1.1" 200 None
2026-03-26 22:52:05 [ayvens.be] INFO: Saving data for 1985453: {'created_time': 1774565525.728824, 'last_price_update_time': 1774565525.728833, 'auction_closing_time': 1774958400.0}
2026-03-26 22:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985453') HTTP/1.1" 204 0
2026-03-26 22:52:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/4580fc00efe241a9af2de452045f0da0/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fbd06efd36b6d45109f8e659fa3166a02%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/bd06efd36b6d45109f8e659fa3166a02/images/large/4.jpg not downloaded yet
2026-03-26 22:52:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/4580fc00efe241a9af2de452045f0da0/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fbd06efd36b6d45109f8e659fa3166a02%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/bd06efd36b6d45109f8e659fa3166a02/images/large/5.jpg not downloaded yet
2026-03-26 22:52:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/4580fc00efe241a9af2de452045f0da0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/4580fc00efe241a9af2de452045f0da0/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/4580fc00efe241a9af2de452045f0da0/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/4580fc00efe241a9af2de452045f0da0/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fbd06efd36b6d45109f8e659fa3166a02%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/bd06efd36b6d45109f8e659fa3166a02/images/large/6.jpg not downloaded yet
2026-03-26 22:52:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/4580fc00efe241a9af2de452045f0da0/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fbd06efd36b6d45109f8e659fa3166a02%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/bd06efd36b6d45109f8e659fa3166a02/images/large/7.jpg not downloaded yet
2026-03-26 22:52:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/bd06efd36b6d45109f8e659fa3166a02/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b776bc50>
2026-03-26 22:52:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_419dea60-40ec-58ec-b8a5-92561d4b6c07/419dea60-40ec-58ec-b8a5-92561d4b6c07_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F4580fc00efe241a9af2de452045f0da0%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/4580fc00efe241a9af2de452045f0da0/images/large/4.jpg saved to cache
2026-03-26 22:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 419dea60-40ec-58ec-b8a5-92561d4b6c07
2026-03-26 22:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fbd06efd36b6d45109f8e659fa3166a02%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/bd06efd36b6d45109f8e659fa3166a02/images/large/8.jpg not downloaded yet
2026-03-26 22:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fbd06efd36b6d45109f8e659fa3166a02%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/bd06efd36b6d45109f8e659fa3166a02/images/large/9.jpg not downloaded yet
2026-03-26 22:52:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7769250>
2026-03-26 22:52:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_419dea60-40ec-58ec-b8a5-92561d4b6c07/419dea60-40ec-58ec-b8a5-92561d4b6c07_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F4580fc00efe241a9af2de452045f0da0%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/4580fc00efe241a9af2de452045f0da0/images/large/5.jpg saved to cache
2026-03-26 22:52:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 419dea60-40ec-58ec-b8a5-92561d4b6c07
2026-03-26 22:52:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74896d0>
2026-03-26 22:52:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_419dea60-40ec-58ec-b8a5-92561d4b6c07/419dea60-40ec-58ec-b8a5-92561d4b6c07_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F4580fc00efe241a9af2de452045f0da0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/4580fc00efe241a9af2de452045f0da0/images/large/1.jpg saved to cache
2026-03-26 22:52:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 419dea60-40ec-58ec-b8a5-92561d4b6c07
2026-03-26 22:52:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7773510>
2026-03-26 22:52:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_419dea60-40ec-58ec-b8a5-92561d4b6c07/419dea60-40ec-58ec-b8a5-92561d4b6c07_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F4580fc00efe241a9af2de452045f0da0%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/4580fc00efe241a9af2de452045f0da0/images/large/6.jpg saved to cache
2026-03-26 22:52:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 419dea60-40ec-58ec-b8a5-92561d4b6c07
2026-03-26 22:52:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6dee890>
2026-03-26 22:52:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_419dea60-40ec-58ec-b8a5-92561d4b6c07/419dea60-40ec-58ec-b8a5-92561d4b6c07_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F4580fc00efe241a9af2de452045f0da0%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/4580fc00efe241a9af2de452045f0da0/images/large/9.jpg saved to cache
2026-03-26 22:52:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 419dea60-40ec-58ec-b8a5-92561d4b6c07
2026-03-26 22:52:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77720d0>
2026-03-26 22:52:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_419dea60-40ec-58ec-b8a5-92561d4b6c07/419dea60-40ec-58ec-b8a5-92561d4b6c07_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F4580fc00efe241a9af2de452045f0da0%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/4580fc00efe241a9af2de452045f0da0/images/large/7.jpg saved to cache
2026-03-26 22:52:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 419dea60-40ec-58ec-b8a5-92561d4b6c07
2026-03-26 22:52:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7a55590>
2026-03-26 22:52:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_419dea60-40ec-58ec-b8a5-92561d4b6c07/419dea60-40ec-58ec-b8a5-92561d4b6c07_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F4580fc00efe241a9af2de452045f0da0%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/4580fc00efe241a9af2de452045f0da0/images/large/8.jpg saved to cache
2026-03-26 22:52:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 419dea60-40ec-58ec-b8a5-92561d4b6c07
2026-03-26 22:52:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7572850>
2026-03-26 22:52:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9971293-22a3-56ba-a1df-35de5b0fe5ea/c9971293-22a3-56ba-a1df-35de5b0fe5ea_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fbd06efd36b6d45109f8e659fa3166a02%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/bd06efd36b6d45109f8e659fa3166a02/images/large/1.jpg saved to cache
2026-03-26 22:52:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c9971293-22a3-56ba-a1df-35de5b0fe5ea
2026-03-26 22:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fbd06efd36b6d45109f8e659fa3166a02%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/bd06efd36b6d45109f8e659fa3166a02/images/large/10.jpg not downloaded yet
2026-03-26 22:52:06 [ayvens.be] INFO: Found listing with ID: 1985456
2026-03-26 22:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985456%27 HTTP/1.1" 200 None
2026-03-26 22:52:06 [ayvens.be] INFO: Scrape type for 1985456: 1
2026-03-26 22:52:06 [ayvens.be] INFO: Extracting data for car ID: 1985456
2026-03-26 22:52:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f67602dd-81c9-5bdc-a2f5-6c15735b97d6 with identifier: 1985456
2026-03-26 22:52:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f67602dd-81c9-5bdc-a2f5-6c15735b97d6 with scrape type 1
2026-03-26 22:52:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f67602dd-81c9-5bdc-a2f5-6c15735b97d6
2026-03-26 22:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F584ba05376924ddda5f69fe6b4d03e88%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/584ba05376924ddda5f69fe6b4d03e88/images/large/1.jpg not downloaded yet
2026-03-26 22:52:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/4580fc00efe241a9af2de452045f0da0/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/bd06efd36b6d45109f8e659fa3166a02/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/bd06efd36b6d45109f8e659fa3166a02/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F584ba05376924ddda5f69fe6b4d03e88%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/584ba05376924ddda5f69fe6b4d03e88/images/large/2.jpg not downloaded yet
2026-03-26 22:52:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/bd06efd36b6d45109f8e659fa3166a02/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/bd06efd36b6d45109f8e659fa3166a02/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F584ba05376924ddda5f69fe6b4d03e88%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/584ba05376924ddda5f69fe6b4d03e88/images/large/3.jpg not downloaded yet
2026-03-26 22:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F584ba05376924ddda5f69fe6b4d03e88%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/584ba05376924ddda5f69fe6b4d03e88/images/large/4.jpg not downloaded yet
2026-03-26 22:52:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/bd06efd36b6d45109f8e659fa3166a02/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F584ba05376924ddda5f69fe6b4d03e88%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/584ba05376924ddda5f69fe6b4d03e88/images/large/5.jpg not downloaded yet
2026-03-26 22:52:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/bd06efd36b6d45109f8e659fa3166a02/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/bd06efd36b6d45109f8e659fa3166a02/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F584ba05376924ddda5f69fe6b4d03e88%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/584ba05376924ddda5f69fe6b4d03e88/images/large/6.jpg not downloaded yet
2026-03-26 22:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F584ba05376924ddda5f69fe6b4d03e88%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/584ba05376924ddda5f69fe6b4d03e88/images/large/7.jpg not downloaded yet
2026-03-26 22:52:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7417310>
2026-03-26 22:52:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_419dea60-40ec-58ec-b8a5-92561d4b6c07/419dea60-40ec-58ec-b8a5-92561d4b6c07_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F4580fc00efe241a9af2de452045f0da0%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/4580fc00efe241a9af2de452045f0da0/images/large/10.jpg saved to cache
2026-03-26 22:52:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 419dea60-40ec-58ec-b8a5-92561d4b6c07
2026-03-26 22:52:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 419dea60-40ec-58ec-b8a5-92561d4b6c07, skipping ID generation
2026-03-26 22:52:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 419dea60-40ec-58ec-b8a5-92561d4b6c07 with scrape type 1
2026-03-26 22:52:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 419dea60-40ec-58ec-b8a5-92561d4b6c07 sending to next pipeline
2026-03-26 22:52:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 419dea60-40ec-58ec-b8a5-92561d4b6c07, identifier: 1985454
2026-03-26 22:52:07 [scrapy.extensions.logstats] INFO: Crawled 12 pages (at 7 pages/min), scraped 234 items (at 36 items/min)
2026-03-26 22:52:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 181MiB
2026-03-26 22:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F584ba05376924ddda5f69fe6b4d03e88%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/584ba05376924ddda5f69fe6b4d03e88/images/large/8.jpg not downloaded yet
2026-03-26 22:52:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 419dea60-40ec-58ec-b8a5-92561d4b6c07 with identifier: 1985454
2026-03-26 22:52:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 419dea60-40ec-58ec-b8a5-92561d4b6c07 with identifier: 1985454
2026-03-26 22:52:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 419dea60-40ec-58ec-b8a5-92561d4b6c07 with identifier: 1985454 to the API
2026-03-26 22:52:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:52:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:52:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ae/4580fc00efe241a9af2de452045f0da0/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '419dea60-40ec-58ec-b8a5-92561d4b6c07',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'KUGA - 2020',
 'odometer': 131988,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_419dea60-40ec-58ec-b8a5-92561d4b6c07/419dea60-40ec-58ec-b8a5-92561d4b6c07_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 615257,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/4580fc00efe241a9af2de452045f0da0/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_419dea60-40ec-58ec-b8a5-92561d4b6c07/419dea60-40ec-58ec-b8a5-92561d4b6c07_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 592083,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/4580fc00efe241a9af2de452045f0da0/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_419dea60-40ec-58ec-b8a5-92561d4b6c07/419dea60-40ec-58ec-b8a5-92561d4b6c07_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 573299,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/4580fc00efe241a9af2de452045f0da0/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_419dea60-40ec-58ec-b8a5-92561d4b6c07/419dea60-40ec-58ec-b8a5-92561d4b6c07_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 646371,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/4580fc00efe241a9af2de452045f0da0/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_419dea60-40ec-58ec-b8a5-92561d4b6c07/419dea60-40ec-58ec-b8a5-92561d4b6c07_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 626311,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/4580fc00efe241a9af2de452045f0da0/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_419dea60-40ec-58ec-b8a5-92561d4b6c07/419dea60-40ec-58ec-b8a5-92561d4b6c07_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 615001,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/4580fc00efe241a9af2de452045f0da0/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_419dea60-40ec-58ec-b8a5-92561d4b6c07/419dea60-40ec-58ec-b8a5-92561d4b6c07_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 707665,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/4580fc00efe241a9af2de452045f0da0/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_419dea60-40ec-58ec-b8a5-92561d4b6c07/419dea60-40ec-58ec-b8a5-92561d4b6c07_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 667718,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/4580fc00efe241a9af2de452045f0da0/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_419dea60-40ec-58ec-b8a5-92561d4b6c07/419dea60-40ec-58ec-b8a5-92561d4b6c07_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 480064,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/4580fc00efe241a9af2de452045f0da0/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_419dea60-40ec-58ec-b8a5-92561d4b6c07/419dea60-40ec-58ec-b8a5-92561d4b6c07_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 593481,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/4580fc00efe241a9af2de452045f0da0/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD KUGA - 2020 2.5 EcoBoost FWD PHEV ST-Line X',
 'transmission': 'automatic',
 'trim': '2.5 EcoBoost FWD PHEV ST-Line X',
 'vin': None,
 'year': 2021}
2026-03-26 22:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985454%27 HTTP/1.1" 200 None
2026-03-26 22:52:07 [ayvens.be] INFO: Saving data for 1985454: {'created_time': 1774565527.337, 'last_price_update_time': 1774565527.33701, 'auction_closing_time': 1774958400.0}
2026-03-26 22:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985454') HTTP/1.1" 204 0
2026-03-26 22:52:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7417610>
2026-03-26 22:52:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9971293-22a3-56ba-a1df-35de5b0fe5ea/c9971293-22a3-56ba-a1df-35de5b0fe5ea_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fbd06efd36b6d45109f8e659fa3166a02%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/bd06efd36b6d45109f8e659fa3166a02/images/large/2.jpg saved to cache
2026-03-26 22:52:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c9971293-22a3-56ba-a1df-35de5b0fe5ea
2026-03-26 22:52:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7571490>
2026-03-26 22:52:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9971293-22a3-56ba-a1df-35de5b0fe5ea/c9971293-22a3-56ba-a1df-35de5b0fe5ea_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fbd06efd36b6d45109f8e659fa3166a02%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/bd06efd36b6d45109f8e659fa3166a02/images/large/5.jpg saved to cache
2026-03-26 22:52:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c9971293-22a3-56ba-a1df-35de5b0fe5ea
2026-03-26 22:52:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/bd06efd36b6d45109f8e659fa3166a02/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F584ba05376924ddda5f69fe6b4d03e88%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/584ba05376924ddda5f69fe6b4d03e88/images/large/9.jpg not downloaded yet
2026-03-26 22:52:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76cde90>
2026-03-26 22:52:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9971293-22a3-56ba-a1df-35de5b0fe5ea/c9971293-22a3-56ba-a1df-35de5b0fe5ea_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fbd06efd36b6d45109f8e659fa3166a02%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/bd06efd36b6d45109f8e659fa3166a02/images/large/3.jpg saved to cache
2026-03-26 22:52:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c9971293-22a3-56ba-a1df-35de5b0fe5ea
2026-03-26 22:52:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b726b1d0>
2026-03-26 22:52:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9971293-22a3-56ba-a1df-35de5b0fe5ea/c9971293-22a3-56ba-a1df-35de5b0fe5ea_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fbd06efd36b6d45109f8e659fa3166a02%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/bd06efd36b6d45109f8e659fa3166a02/images/large/4.jpg saved to cache
2026-03-26 22:52:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c9971293-22a3-56ba-a1df-35de5b0fe5ea
2026-03-26 22:52:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74b5150>
2026-03-26 22:52:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9971293-22a3-56ba-a1df-35de5b0fe5ea/c9971293-22a3-56ba-a1df-35de5b0fe5ea_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fbd06efd36b6d45109f8e659fa3166a02%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/bd06efd36b6d45109f8e659fa3166a02/images/large/6.jpg saved to cache
2026-03-26 22:52:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c9971293-22a3-56ba-a1df-35de5b0fe5ea
2026-03-26 22:52:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7aeb7d0>
2026-03-26 22:52:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9971293-22a3-56ba-a1df-35de5b0fe5ea/c9971293-22a3-56ba-a1df-35de5b0fe5ea_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fbd06efd36b6d45109f8e659fa3166a02%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/bd06efd36b6d45109f8e659fa3166a02/images/large/7.jpg saved to cache
2026-03-26 22:52:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c9971293-22a3-56ba-a1df-35de5b0fe5ea
2026-03-26 22:52:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79a2490>
2026-03-26 22:52:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9971293-22a3-56ba-a1df-35de5b0fe5ea/c9971293-22a3-56ba-a1df-35de5b0fe5ea_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fbd06efd36b6d45109f8e659fa3166a02%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/bd06efd36b6d45109f8e659fa3166a02/images/large/8.jpg saved to cache
2026-03-26 22:52:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c9971293-22a3-56ba-a1df-35de5b0fe5ea
2026-03-26 22:52:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/bd06efd36b6d45109f8e659fa3166a02/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F584ba05376924ddda5f69fe6b4d03e88%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/584ba05376924ddda5f69fe6b4d03e88/images/large/10.jpg not downloaded yet
2026-03-26 22:52:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/584ba05376924ddda5f69fe6b4d03e88/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:07 [ayvens.be] INFO: Found listing with ID: 1985457
2026-03-26 22:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985457%27 HTTP/1.1" 200 None
2026-03-26 22:52:07 [ayvens.be] INFO: Scrape type for 1985457: 1
2026-03-26 22:52:07 [ayvens.be] INFO: Extracting data for car ID: 1985457
2026-03-26 22:52:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 53b7560e-0bef-5b10-a8ae-104759e2bef5 with identifier: 1985457
2026-03-26 22:52:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53b7560e-0bef-5b10-a8ae-104759e2bef5 with scrape type 1
2026-03-26 22:52:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 53b7560e-0bef-5b10-a8ae-104759e2bef5
2026-03-26 22:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fd85b5346362a4687954b6cc40ce20221%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/d85b5346362a4687954b6cc40ce20221/images/large/1.jpg not downloaded yet
2026-03-26 22:52:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7268750>
2026-03-26 22:52:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9971293-22a3-56ba-a1df-35de5b0fe5ea/c9971293-22a3-56ba-a1df-35de5b0fe5ea_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fbd06efd36b6d45109f8e659fa3166a02%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/bd06efd36b6d45109f8e659fa3166a02/images/large/9.jpg saved to cache
2026-03-26 22:52:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c9971293-22a3-56ba-a1df-35de5b0fe5ea
2026-03-26 22:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fd85b5346362a4687954b6cc40ce20221%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/d85b5346362a4687954b6cc40ce20221/images/large/2.jpg not downloaded yet
2026-03-26 22:52:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/584ba05376924ddda5f69fe6b4d03e88/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fd85b5346362a4687954b6cc40ce20221%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/d85b5346362a4687954b6cc40ce20221/images/large/3.jpg not downloaded yet
2026-03-26 22:52:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/584ba05376924ddda5f69fe6b4d03e88/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/584ba05376924ddda5f69fe6b4d03e88/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/584ba05376924ddda5f69fe6b4d03e88/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79dea50>
2026-03-26 22:52:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9971293-22a3-56ba-a1df-35de5b0fe5ea/c9971293-22a3-56ba-a1df-35de5b0fe5ea_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fbd06efd36b6d45109f8e659fa3166a02%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/bd06efd36b6d45109f8e659fa3166a02/images/large/10.jpg saved to cache
2026-03-26 22:52:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c9971293-22a3-56ba-a1df-35de5b0fe5ea
2026-03-26 22:52:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c9971293-22a3-56ba-a1df-35de5b0fe5ea, skipping ID generation
2026-03-26 22:52:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9971293-22a3-56ba-a1df-35de5b0fe5ea with scrape type 1
2026-03-26 22:52:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c9971293-22a3-56ba-a1df-35de5b0fe5ea sending to next pipeline
2026-03-26 22:52:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c9971293-22a3-56ba-a1df-35de5b0fe5ea, identifier: 1985455
2026-03-26 22:52:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7268a90>
2026-03-26 22:52:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f67602dd-81c9-5bdc-a2f5-6c15735b97d6/f67602dd-81c9-5bdc-a2f5-6c15735b97d6_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F584ba05376924ddda5f69fe6b4d03e88%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/584ba05376924ddda5f69fe6b4d03e88/images/large/1.jpg saved to cache
2026-03-26 22:52:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f67602dd-81c9-5bdc-a2f5-6c15735b97d6
2026-03-26 22:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fd85b5346362a4687954b6cc40ce20221%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/d85b5346362a4687954b6cc40ce20221/images/large/4.jpg not downloaded yet
2026-03-26 22:52:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c9971293-22a3-56ba-a1df-35de5b0fe5ea with identifier: 1985455
2026-03-26 22:52:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c9971293-22a3-56ba-a1df-35de5b0fe5ea with identifier: 1985455
2026-03-26 22:52:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c9971293-22a3-56ba-a1df-35de5b0fe5ea with identifier: 1985455 to the API
2026-03-26 22:52:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:52:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:52:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ab/bd06efd36b6d45109f8e659fa3166a02/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'c9971293-22a3-56ba-a1df-35de5b0fe5ea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '5008',
 'odometer': 121114,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9971293-22a3-56ba-a1df-35de5b0fe5ea/c9971293-22a3-56ba-a1df-35de5b0fe5ea_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 483656,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/bd06efd36b6d45109f8e659fa3166a02/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9971293-22a3-56ba-a1df-35de5b0fe5ea/c9971293-22a3-56ba-a1df-35de5b0fe5ea_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 524470,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/bd06efd36b6d45109f8e659fa3166a02/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9971293-22a3-56ba-a1df-35de5b0fe5ea/c9971293-22a3-56ba-a1df-35de5b0fe5ea_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 562641,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/bd06efd36b6d45109f8e659fa3166a02/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9971293-22a3-56ba-a1df-35de5b0fe5ea/c9971293-22a3-56ba-a1df-35de5b0fe5ea_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 551774,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/bd06efd36b6d45109f8e659fa3166a02/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9971293-22a3-56ba-a1df-35de5b0fe5ea/c9971293-22a3-56ba-a1df-35de5b0fe5ea_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 393023,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/bd06efd36b6d45109f8e659fa3166a02/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9971293-22a3-56ba-a1df-35de5b0fe5ea/c9971293-22a3-56ba-a1df-35de5b0fe5ea_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 396048,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/bd06efd36b6d45109f8e659fa3166a02/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9971293-22a3-56ba-a1df-35de5b0fe5ea/c9971293-22a3-56ba-a1df-35de5b0fe5ea_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 476307,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/bd06efd36b6d45109f8e659fa3166a02/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9971293-22a3-56ba-a1df-35de5b0fe5ea/c9971293-22a3-56ba-a1df-35de5b0fe5ea_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 450917,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/bd06efd36b6d45109f8e659fa3166a02/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9971293-22a3-56ba-a1df-35de5b0fe5ea/c9971293-22a3-56ba-a1df-35de5b0fe5ea_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 311513,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/bd06efd36b6d45109f8e659fa3166a02/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9971293-22a3-56ba-a1df-35de5b0fe5ea/c9971293-22a3-56ba-a1df-35de5b0fe5ea_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 303337,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/bd06efd36b6d45109f8e659fa3166a02/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 5008 1.2 PURETECH 130 GT',
 'transmission': 'manual',
 'trim': '1.2 PURETECH 130 GT',
 'vin': None,
 'year': 2021}
2026-03-26 22:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985455%27 HTTP/1.1" 200 None
2026-03-26 22:52:08 [ayvens.be] INFO: Saving data for 1985455: {'created_time': 1774565528.741252, 'last_price_update_time': 1774565528.741263, 'auction_closing_time': 1774958400.0}
2026-03-26 22:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985455') HTTP/1.1" 204 0
2026-03-26 22:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fd85b5346362a4687954b6cc40ce20221%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/d85b5346362a4687954b6cc40ce20221/images/large/5.jpg not downloaded yet
2026-03-26 22:52:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7290dd0>
2026-03-26 22:52:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f67602dd-81c9-5bdc-a2f5-6c15735b97d6/f67602dd-81c9-5bdc-a2f5-6c15735b97d6_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F584ba05376924ddda5f69fe6b4d03e88%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/584ba05376924ddda5f69fe6b4d03e88/images/large/2.jpg saved to cache
2026-03-26 22:52:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f67602dd-81c9-5bdc-a2f5-6c15735b97d6
2026-03-26 22:52:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76883d0>
2026-03-26 22:52:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f67602dd-81c9-5bdc-a2f5-6c15735b97d6/f67602dd-81c9-5bdc-a2f5-6c15735b97d6_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F584ba05376924ddda5f69fe6b4d03e88%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/584ba05376924ddda5f69fe6b4d03e88/images/large/5.jpg saved to cache
2026-03-26 22:52:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f67602dd-81c9-5bdc-a2f5-6c15735b97d6
2026-03-26 22:52:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cbf090>
2026-03-26 22:52:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f67602dd-81c9-5bdc-a2f5-6c15735b97d6/f67602dd-81c9-5bdc-a2f5-6c15735b97d6_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F584ba05376924ddda5f69fe6b4d03e88%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/584ba05376924ddda5f69fe6b4d03e88/images/large/4.jpg saved to cache
2026-03-26 22:52:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f67602dd-81c9-5bdc-a2f5-6c15735b97d6
2026-03-26 22:52:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7584d10>
2026-03-26 22:52:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f67602dd-81c9-5bdc-a2f5-6c15735b97d6/f67602dd-81c9-5bdc-a2f5-6c15735b97d6_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F584ba05376924ddda5f69fe6b4d03e88%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/584ba05376924ddda5f69fe6b4d03e88/images/large/3.jpg saved to cache
2026-03-26 22:52:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f67602dd-81c9-5bdc-a2f5-6c15735b97d6
2026-03-26 22:52:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/584ba05376924ddda5f69fe6b4d03e88/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fd85b5346362a4687954b6cc40ce20221%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/d85b5346362a4687954b6cc40ce20221/images/large/6.jpg not downloaded yet
2026-03-26 22:52:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/584ba05376924ddda5f69fe6b4d03e88/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fd85b5346362a4687954b6cc40ce20221%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/d85b5346362a4687954b6cc40ce20221/images/large/7.jpg not downloaded yet
2026-03-26 22:52:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/584ba05376924ddda5f69fe6b4d03e88/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/584ba05376924ddda5f69fe6b4d03e88/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fd85b5346362a4687954b6cc40ce20221%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/d85b5346362a4687954b6cc40ce20221/images/large/8.jpg not downloaded yet
2026-03-26 22:52:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/584ba05376924ddda5f69fe6b4d03e88/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fd85b5346362a4687954b6cc40ce20221%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/d85b5346362a4687954b6cc40ce20221/images/large/9.jpg not downloaded yet
2026-03-26 22:52:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/d85b5346362a4687954b6cc40ce20221/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fd85b5346362a4687954b6cc40ce20221%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/d85b5346362a4687954b6cc40ce20221/images/large/10.jpg not downloaded yet
2026-03-26 22:52:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/d85b5346362a4687954b6cc40ce20221/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/d85b5346362a4687954b6cc40ce20221/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:09 [ayvens.be] INFO: Found listing with ID: 1985458
2026-03-26 22:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985458%27 HTTP/1.1" 200 None
2026-03-26 22:52:09 [ayvens.be] INFO: Scrape type for 1985458: 1
2026-03-26 22:52:09 [ayvens.be] INFO: Extracting data for car ID: 1985458
2026-03-26 22:52:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a45f8f7b-8a49-592b-b05f-d0c43f0f9fcf with identifier: 1985458
2026-03-26 22:52:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a45f8f7b-8a49-592b-b05f-d0c43f0f9fcf with scrape type 1
2026-03-26 22:52:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a45f8f7b-8a49-592b-b05f-d0c43f0f9fcf
2026-03-26 22:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ek%252Fa38e15e7db7247a18e532eb8d69488ed%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ek/a38e15e7db7247a18e532eb8d69488ed/images/large/1.jpg not downloaded yet
2026-03-26 22:52:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77bc810>
2026-03-26 22:52:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f67602dd-81c9-5bdc-a2f5-6c15735b97d6/f67602dd-81c9-5bdc-a2f5-6c15735b97d6_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F584ba05376924ddda5f69fe6b4d03e88%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/584ba05376924ddda5f69fe6b4d03e88/images/large/6.jpg saved to cache
2026-03-26 22:52:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f67602dd-81c9-5bdc-a2f5-6c15735b97d6
2026-03-26 22:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ek%252Fa38e15e7db7247a18e532eb8d69488ed%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ek/a38e15e7db7247a18e532eb8d69488ed/images/large/2.jpg not downloaded yet
2026-03-26 22:52:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7a54210>
2026-03-26 22:52:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f67602dd-81c9-5bdc-a2f5-6c15735b97d6/f67602dd-81c9-5bdc-a2f5-6c15735b97d6_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F584ba05376924ddda5f69fe6b4d03e88%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/584ba05376924ddda5f69fe6b4d03e88/images/large/8.jpg saved to cache
2026-03-26 22:52:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f67602dd-81c9-5bdc-a2f5-6c15735b97d6
2026-03-26 22:52:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7ccfed0>
2026-03-26 22:52:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f67602dd-81c9-5bdc-a2f5-6c15735b97d6/f67602dd-81c9-5bdc-a2f5-6c15735b97d6_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F584ba05376924ddda5f69fe6b4d03e88%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/584ba05376924ddda5f69fe6b4d03e88/images/large/7.jpg saved to cache
2026-03-26 22:52:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f67602dd-81c9-5bdc-a2f5-6c15735b97d6
2026-03-26 22:52:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7a80910>
2026-03-26 22:52:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f67602dd-81c9-5bdc-a2f5-6c15735b97d6/f67602dd-81c9-5bdc-a2f5-6c15735b97d6_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F584ba05376924ddda5f69fe6b4d03e88%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/584ba05376924ddda5f69fe6b4d03e88/images/large/9.jpg saved to cache
2026-03-26 22:52:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f67602dd-81c9-5bdc-a2f5-6c15735b97d6
2026-03-26 22:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ek%252Fa38e15e7db7247a18e532eb8d69488ed%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ek/a38e15e7db7247a18e532eb8d69488ed/images/large/3.jpg not downloaded yet
2026-03-26 22:52:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e4cd10>
2026-03-26 22:52:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f67602dd-81c9-5bdc-a2f5-6c15735b97d6/f67602dd-81c9-5bdc-a2f5-6c15735b97d6_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F584ba05376924ddda5f69fe6b4d03e88%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/584ba05376924ddda5f69fe6b4d03e88/images/large/10.jpg saved to cache
2026-03-26 22:52:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f67602dd-81c9-5bdc-a2f5-6c15735b97d6
2026-03-26 22:52:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f67602dd-81c9-5bdc-a2f5-6c15735b97d6, skipping ID generation
2026-03-26 22:52:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f67602dd-81c9-5bdc-a2f5-6c15735b97d6 with scrape type 1
2026-03-26 22:52:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f67602dd-81c9-5bdc-a2f5-6c15735b97d6 sending to next pipeline
2026-03-26 22:52:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f67602dd-81c9-5bdc-a2f5-6c15735b97d6, identifier: 1985456
2026-03-26 22:52:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b777b0d0>
2026-03-26 22:52:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53b7560e-0bef-5b10-a8ae-104759e2bef5/53b7560e-0bef-5b10-a8ae-104759e2bef5_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fd85b5346362a4687954b6cc40ce20221%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/d85b5346362a4687954b6cc40ce20221/images/large/1.jpg saved to cache
2026-03-26 22:52:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 53b7560e-0bef-5b10-a8ae-104759e2bef5
2026-03-26 22:52:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80cb130110>
2026-03-26 22:52:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53b7560e-0bef-5b10-a8ae-104759e2bef5/53b7560e-0bef-5b10-a8ae-104759e2bef5_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fd85b5346362a4687954b6cc40ce20221%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/d85b5346362a4687954b6cc40ce20221/images/large/3.jpg saved to cache
2026-03-26 22:52:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 53b7560e-0bef-5b10-a8ae-104759e2bef5
2026-03-26 22:52:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7a61b10>
2026-03-26 22:52:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53b7560e-0bef-5b10-a8ae-104759e2bef5/53b7560e-0bef-5b10-a8ae-104759e2bef5_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fd85b5346362a4687954b6cc40ce20221%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/d85b5346362a4687954b6cc40ce20221/images/large/2.jpg saved to cache
2026-03-26 22:52:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 53b7560e-0bef-5b10-a8ae-104759e2bef5
2026-03-26 22:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ek%252Fa38e15e7db7247a18e532eb8d69488ed%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ek/a38e15e7db7247a18e532eb8d69488ed/images/large/4.jpg not downloaded yet
2026-03-26 22:52:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f67602dd-81c9-5bdc-a2f5-6c15735b97d6 with identifier: 1985456
2026-03-26 22:52:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f67602dd-81c9-5bdc-a2f5-6c15735b97d6 with identifier: 1985456
2026-03-26 22:52:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f67602dd-81c9-5bdc-a2f5-6c15735b97d6 with identifier: 1985456 to the API
2026-03-26 22:52:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:52:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:52:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yt/584ba05376924ddda5f69fe6b4d03e88/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'f67602dd-81c9-5bdc-a2f5-6c15735b97d6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X3 - 2018',
 'odometer': 173719,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 18,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f67602dd-81c9-5bdc-a2f5-6c15735b97d6/f67602dd-81c9-5bdc-a2f5-6c15735b97d6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 675678,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/584ba05376924ddda5f69fe6b4d03e88/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f67602dd-81c9-5bdc-a2f5-6c15735b97d6/f67602dd-81c9-5bdc-a2f5-6c15735b97d6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 659835,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/584ba05376924ddda5f69fe6b4d03e88/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f67602dd-81c9-5bdc-a2f5-6c15735b97d6/f67602dd-81c9-5bdc-a2f5-6c15735b97d6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 661918,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/584ba05376924ddda5f69fe6b4d03e88/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f67602dd-81c9-5bdc-a2f5-6c15735b97d6/f67602dd-81c9-5bdc-a2f5-6c15735b97d6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 677939,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/584ba05376924ddda5f69fe6b4d03e88/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f67602dd-81c9-5bdc-a2f5-6c15735b97d6/f67602dd-81c9-5bdc-a2f5-6c15735b97d6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 653525,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/584ba05376924ddda5f69fe6b4d03e88/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f67602dd-81c9-5bdc-a2f5-6c15735b97d6/f67602dd-81c9-5bdc-a2f5-6c15735b97d6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 659519,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/584ba05376924ddda5f69fe6b4d03e88/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f67602dd-81c9-5bdc-a2f5-6c15735b97d6/f67602dd-81c9-5bdc-a2f5-6c15735b97d6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 721017,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/584ba05376924ddda5f69fe6b4d03e88/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f67602dd-81c9-5bdc-a2f5-6c15735b97d6/f67602dd-81c9-5bdc-a2f5-6c15735b97d6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 704332,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/584ba05376924ddda5f69fe6b4d03e88/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f67602dd-81c9-5bdc-a2f5-6c15735b97d6/f67602dd-81c9-5bdc-a2f5-6c15735b97d6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 586999,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/584ba05376924ddda5f69fe6b4d03e88/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f67602dd-81c9-5bdc-a2f5-6c15735b97d6/f67602dd-81c9-5bdc-a2f5-6c15735b97d6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 567850,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/584ba05376924ddda5f69fe6b4d03e88/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X3 - 2018 2.0iA xDrive30e PHEV OPF',
 'transmission': 'automatic',
 'trim': '2.0iA xDrive30e PHEV OPF',
 'vin': None,
 'year': 2020}
2026-03-26 22:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985456%27 HTTP/1.1" 200 None
2026-03-26 22:52:10 [ayvens.be] INFO: Saving data for 1985456: {'created_time': 1774565530.522225, 'last_price_update_time': 1774565530.522236, 'auction_closing_time': 1774958400.0}
2026-03-26 22:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985456') HTTP/1.1" 204 0
2026-03-26 22:52:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/d85b5346362a4687954b6cc40ce20221/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/d85b5346362a4687954b6cc40ce20221/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ek%252Fa38e15e7db7247a18e532eb8d69488ed%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ek/a38e15e7db7247a18e532eb8d69488ed/images/large/5.jpg not downloaded yet
2026-03-26 22:52:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/d85b5346362a4687954b6cc40ce20221/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ek%252Fa38e15e7db7247a18e532eb8d69488ed%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ek/a38e15e7db7247a18e532eb8d69488ed/images/large/6.jpg not downloaded yet
2026-03-26 22:52:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/d85b5346362a4687954b6cc40ce20221/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ek/a38e15e7db7247a18e532eb8d69488ed/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ek/a38e15e7db7247a18e532eb8d69488ed/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/d85b5346362a4687954b6cc40ce20221/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/d85b5346362a4687954b6cc40ce20221/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ek%252Fa38e15e7db7247a18e532eb8d69488ed%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ek/a38e15e7db7247a18e532eb8d69488ed/images/large/7.jpg not downloaded yet
2026-03-26 22:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ek%252Fa38e15e7db7247a18e532eb8d69488ed%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ek/a38e15e7db7247a18e532eb8d69488ed/images/large/8.jpg not downloaded yet
2026-03-26 22:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ek%252Fa38e15e7db7247a18e532eb8d69488ed%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ek/a38e15e7db7247a18e532eb8d69488ed/images/large/9.jpg not downloaded yet
2026-03-26 22:52:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ek/a38e15e7db7247a18e532eb8d69488ed/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ek%252Fa38e15e7db7247a18e532eb8d69488ed%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ek/a38e15e7db7247a18e532eb8d69488ed/images/large/10.jpg not downloaded yet
2026-03-26 22:52:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cbd110>
2026-03-26 22:52:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53b7560e-0bef-5b10-a8ae-104759e2bef5/53b7560e-0bef-5b10-a8ae-104759e2bef5_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fd85b5346362a4687954b6cc40ce20221%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/d85b5346362a4687954b6cc40ce20221/images/large/4.jpg saved to cache
2026-03-26 22:52:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 53b7560e-0bef-5b10-a8ae-104759e2bef5
2026-03-26 22:52:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7440b90>
2026-03-26 22:52:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53b7560e-0bef-5b10-a8ae-104759e2bef5/53b7560e-0bef-5b10-a8ae-104759e2bef5_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fd85b5346362a4687954b6cc40ce20221%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/d85b5346362a4687954b6cc40ce20221/images/large/5.jpg saved to cache
2026-03-26 22:52:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 53b7560e-0bef-5b10-a8ae-104759e2bef5
2026-03-26 22:52:10 [ayvens.be] INFO: Found listing with ID: 1985459
2026-03-26 22:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985459%27 HTTP/1.1" 200 None
2026-03-26 22:52:10 [ayvens.be] INFO: Scrape type for 1985459: 1
2026-03-26 22:52:10 [ayvens.be] INFO: Extracting data for car ID: 1985459
2026-03-26 22:52:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a8ba7fa2-c04d-5732-8472-419439b4e0fc with identifier: 1985459
2026-03-26 22:52:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8ba7fa2-c04d-5732-8472-419439b4e0fc with scrape type 1
2026-03-26 22:52:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a8ba7fa2-c04d-5732-8472-419439b4e0fc
2026-03-26 22:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252F00e85a023c594781af503a6d61e2a9b9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/00e85a023c594781af503a6d61e2a9b9/images/large/1.jpg not downloaded yet
2026-03-26 22:52:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ek/a38e15e7db7247a18e532eb8d69488ed/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e03810>
2026-03-26 22:52:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53b7560e-0bef-5b10-a8ae-104759e2bef5/53b7560e-0bef-5b10-a8ae-104759e2bef5_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fd85b5346362a4687954b6cc40ce20221%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/d85b5346362a4687954b6cc40ce20221/images/large/6.jpg saved to cache
2026-03-26 22:52:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 53b7560e-0bef-5b10-a8ae-104759e2bef5
2026-03-26 22:52:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ek/a38e15e7db7247a18e532eb8d69488ed/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252F00e85a023c594781af503a6d61e2a9b9%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/00e85a023c594781af503a6d61e2a9b9/images/large/2.jpg not downloaded yet
2026-03-26 22:52:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/d85b5346362a4687954b6cc40ce20221/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ek/a38e15e7db7247a18e532eb8d69488ed/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7771190>
2026-03-26 22:52:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53b7560e-0bef-5b10-a8ae-104759e2bef5/53b7560e-0bef-5b10-a8ae-104759e2bef5_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fd85b5346362a4687954b6cc40ce20221%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/d85b5346362a4687954b6cc40ce20221/images/large/9.jpg saved to cache
2026-03-26 22:52:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 53b7560e-0bef-5b10-a8ae-104759e2bef5
2026-03-26 22:52:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e1d850>
2026-03-26 22:52:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a45f8f7b-8a49-592b-b05f-d0c43f0f9fcf/a45f8f7b-8a49-592b-b05f-d0c43f0f9fcf_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ek%252Fa38e15e7db7247a18e532eb8d69488ed%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ek/a38e15e7db7247a18e532eb8d69488ed/images/large/1.jpg saved to cache
2026-03-26 22:52:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a45f8f7b-8a49-592b-b05f-d0c43f0f9fcf
2026-03-26 22:52:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b728cd90>
2026-03-26 22:52:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a45f8f7b-8a49-592b-b05f-d0c43f0f9fcf/a45f8f7b-8a49-592b-b05f-d0c43f0f9fcf_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ek%252Fa38e15e7db7247a18e532eb8d69488ed%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ek/a38e15e7db7247a18e532eb8d69488ed/images/large/2.jpg saved to cache
2026-03-26 22:52:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a45f8f7b-8a49-592b-b05f-d0c43f0f9fcf
2026-03-26 22:52:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74b7f10>
2026-03-26 22:52:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53b7560e-0bef-5b10-a8ae-104759e2bef5/53b7560e-0bef-5b10-a8ae-104759e2bef5_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fd85b5346362a4687954b6cc40ce20221%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/d85b5346362a4687954b6cc40ce20221/images/large/7.jpg saved to cache
2026-03-26 22:52:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 53b7560e-0bef-5b10-a8ae-104759e2bef5
2026-03-26 22:52:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cca410>
2026-03-26 22:52:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53b7560e-0bef-5b10-a8ae-104759e2bef5/53b7560e-0bef-5b10-a8ae-104759e2bef5_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fd85b5346362a4687954b6cc40ce20221%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/d85b5346362a4687954b6cc40ce20221/images/large/8.jpg saved to cache
2026-03-26 22:52:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 53b7560e-0bef-5b10-a8ae-104759e2bef5
2026-03-26 22:52:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5ca1090>
2026-03-26 22:52:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a45f8f7b-8a49-592b-b05f-d0c43f0f9fcf/a45f8f7b-8a49-592b-b05f-d0c43f0f9fcf_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ek%252Fa38e15e7db7247a18e532eb8d69488ed%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ek/a38e15e7db7247a18e532eb8d69488ed/images/large/3.jpg saved to cache
2026-03-26 22:52:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a45f8f7b-8a49-592b-b05f-d0c43f0f9fcf
2026-03-26 22:52:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ek/a38e15e7db7247a18e532eb8d69488ed/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252F00e85a023c594781af503a6d61e2a9b9%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/00e85a023c594781af503a6d61e2a9b9/images/large/3.jpg not downloaded yet
2026-03-26 22:52:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ek/a38e15e7db7247a18e532eb8d69488ed/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b75a7710>
2026-03-26 22:52:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a45f8f7b-8a49-592b-b05f-d0c43f0f9fcf/a45f8f7b-8a49-592b-b05f-d0c43f0f9fcf_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ek%252Fa38e15e7db7247a18e532eb8d69488ed%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ek/a38e15e7db7247a18e532eb8d69488ed/images/large/4.jpg saved to cache
2026-03-26 22:52:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a45f8f7b-8a49-592b-b05f-d0c43f0f9fcf
2026-03-26 22:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252F00e85a023c594781af503a6d61e2a9b9%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/00e85a023c594781af503a6d61e2a9b9/images/large/4.jpg not downloaded yet
2026-03-26 22:52:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd0d04d0>
2026-03-26 22:52:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a45f8f7b-8a49-592b-b05f-d0c43f0f9fcf/a45f8f7b-8a49-592b-b05f-d0c43f0f9fcf_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ek%252Fa38e15e7db7247a18e532eb8d69488ed%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ek/a38e15e7db7247a18e532eb8d69488ed/images/large/6.jpg saved to cache
2026-03-26 22:52:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a45f8f7b-8a49-592b-b05f-d0c43f0f9fcf
2026-03-26 22:52:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79a5610>
2026-03-26 22:52:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53b7560e-0bef-5b10-a8ae-104759e2bef5/53b7560e-0bef-5b10-a8ae-104759e2bef5_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fd85b5346362a4687954b6cc40ce20221%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/d85b5346362a4687954b6cc40ce20221/images/large/10.jpg saved to cache
2026-03-26 22:52:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 53b7560e-0bef-5b10-a8ae-104759e2bef5
2026-03-26 22:52:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 53b7560e-0bef-5b10-a8ae-104759e2bef5, skipping ID generation
2026-03-26 22:52:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53b7560e-0bef-5b10-a8ae-104759e2bef5 with scrape type 1
2026-03-26 22:52:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 53b7560e-0bef-5b10-a8ae-104759e2bef5 sending to next pipeline
2026-03-26 22:52:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 53b7560e-0bef-5b10-a8ae-104759e2bef5, identifier: 1985457
2026-03-26 22:52:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76a7450>
2026-03-26 22:52:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a45f8f7b-8a49-592b-b05f-d0c43f0f9fcf/a45f8f7b-8a49-592b-b05f-d0c43f0f9fcf_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ek%252Fa38e15e7db7247a18e532eb8d69488ed%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ek/a38e15e7db7247a18e532eb8d69488ed/images/large/5.jpg saved to cache
2026-03-26 22:52:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a45f8f7b-8a49-592b-b05f-d0c43f0f9fcf
2026-03-26 22:52:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ek/a38e15e7db7247a18e532eb8d69488ed/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252F00e85a023c594781af503a6d61e2a9b9%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/00e85a023c594781af503a6d61e2a9b9/images/large/5.jpg not downloaded yet
2026-03-26 22:52:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 53b7560e-0bef-5b10-a8ae-104759e2bef5 with identifier: 1985457
2026-03-26 22:52:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 53b7560e-0bef-5b10-a8ae-104759e2bef5 with identifier: 1985457
2026-03-26 22:52:11 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 53b7560e-0bef-5b10-a8ae-104759e2bef5 with identifier: 1985457 to the API
2026-03-26 22:52:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:52:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:52:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ab/d85b5346362a4687954b6cc40ce20221/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '53b7560e-0bef-5b10-a8ae-104759e2bef5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A7 SPORTBACK DIESEL - 2018',
 'odometer': 95522,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53b7560e-0bef-5b10-a8ae-104759e2bef5/53b7560e-0bef-5b10-a8ae-104759e2bef5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 622769,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/d85b5346362a4687954b6cc40ce20221/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53b7560e-0bef-5b10-a8ae-104759e2bef5/53b7560e-0bef-5b10-a8ae-104759e2bef5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 659345,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/d85b5346362a4687954b6cc40ce20221/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53b7560e-0bef-5b10-a8ae-104759e2bef5/53b7560e-0bef-5b10-a8ae-104759e2bef5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 616209,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/d85b5346362a4687954b6cc40ce20221/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53b7560e-0bef-5b10-a8ae-104759e2bef5/53b7560e-0bef-5b10-a8ae-104759e2bef5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 725155,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/d85b5346362a4687954b6cc40ce20221/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53b7560e-0bef-5b10-a8ae-104759e2bef5/53b7560e-0bef-5b10-a8ae-104759e2bef5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 670039,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/d85b5346362a4687954b6cc40ce20221/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53b7560e-0bef-5b10-a8ae-104759e2bef5/53b7560e-0bef-5b10-a8ae-104759e2bef5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 557129,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/d85b5346362a4687954b6cc40ce20221/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53b7560e-0bef-5b10-a8ae-104759e2bef5/53b7560e-0bef-5b10-a8ae-104759e2bef5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 712580,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/d85b5346362a4687954b6cc40ce20221/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53b7560e-0bef-5b10-a8ae-104759e2bef5/53b7560e-0bef-5b10-a8ae-104759e2bef5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 710492,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/d85b5346362a4687954b6cc40ce20221/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53b7560e-0bef-5b10-a8ae-104759e2bef5/53b7560e-0bef-5b10-a8ae-104759e2bef5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 598432,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/d85b5346362a4687954b6cc40ce20221/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53b7560e-0bef-5b10-a8ae-104759e2bef5/53b7560e-0bef-5b10-a8ae-104759e2bef5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 572701,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/d85b5346362a4687954b6cc40ce20221/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-10',
 'seats_number': 4,
 'seller_name': None,
 'title': 'AUDI A7 SPORTBACK DIESEL - 2018 40 TDi S tronic',
 'transmission': 'automatic',
 'trim': '40 TDi S tronic',
 'vin': None,
 'year': 2021}
2026-03-26 22:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985457%27 HTTP/1.1" 200 None
2026-03-26 22:52:12 [ayvens.be] INFO: Saving data for 1985457: {'created_time': 1774565532.160085, 'last_price_update_time': 1774565532.160094, 'auction_closing_time': 1774958400.0}
2026-03-26 22:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985457') HTTP/1.1" 204 0
2026-03-26 22:52:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ek/a38e15e7db7247a18e532eb8d69488ed/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2em/00e85a023c594781af503a6d61e2a9b9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252F00e85a023c594781af503a6d61e2a9b9%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/00e85a023c594781af503a6d61e2a9b9/images/large/6.jpg not downloaded yet
2026-03-26 22:52:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7453050>
2026-03-26 22:52:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a45f8f7b-8a49-592b-b05f-d0c43f0f9fcf/a45f8f7b-8a49-592b-b05f-d0c43f0f9fcf_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ek%252Fa38e15e7db7247a18e532eb8d69488ed%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ek/a38e15e7db7247a18e532eb8d69488ed/images/large/7.jpg saved to cache
2026-03-26 22:52:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a45f8f7b-8a49-592b-b05f-d0c43f0f9fcf
2026-03-26 22:52:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b768ac50>
2026-03-26 22:52:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a45f8f7b-8a49-592b-b05f-d0c43f0f9fcf/a45f8f7b-8a49-592b-b05f-d0c43f0f9fcf_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ek%252Fa38e15e7db7247a18e532eb8d69488ed%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ek/a38e15e7db7247a18e532eb8d69488ed/images/large/8.jpg saved to cache
2026-03-26 22:52:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a45f8f7b-8a49-592b-b05f-d0c43f0f9fcf
2026-03-26 22:52:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e4ca90>
2026-03-26 22:52:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a45f8f7b-8a49-592b-b05f-d0c43f0f9fcf/a45f8f7b-8a49-592b-b05f-d0c43f0f9fcf_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ek%252Fa38e15e7db7247a18e532eb8d69488ed%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ek/a38e15e7db7247a18e532eb8d69488ed/images/large/9.jpg saved to cache
2026-03-26 22:52:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a45f8f7b-8a49-592b-b05f-d0c43f0f9fcf
2026-03-26 22:52:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2em/00e85a023c594781af503a6d61e2a9b9/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252F00e85a023c594781af503a6d61e2a9b9%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/00e85a023c594781af503a6d61e2a9b9/images/large/7.jpg not downloaded yet
2026-03-26 22:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252F00e85a023c594781af503a6d61e2a9b9%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/00e85a023c594781af503a6d61e2a9b9/images/large/8.jpg not downloaded yet
2026-03-26 22:52:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79a7190>
2026-03-26 22:52:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a45f8f7b-8a49-592b-b05f-d0c43f0f9fcf/a45f8f7b-8a49-592b-b05f-d0c43f0f9fcf_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ek%252Fa38e15e7db7247a18e532eb8d69488ed%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ek/a38e15e7db7247a18e532eb8d69488ed/images/large/10.jpg saved to cache
2026-03-26 22:52:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a45f8f7b-8a49-592b-b05f-d0c43f0f9fcf
2026-03-26 22:52:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a45f8f7b-8a49-592b-b05f-d0c43f0f9fcf, skipping ID generation
2026-03-26 22:52:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a45f8f7b-8a49-592b-b05f-d0c43f0f9fcf with scrape type 1
2026-03-26 22:52:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a45f8f7b-8a49-592b-b05f-d0c43f0f9fcf sending to next pipeline
2026-03-26 22:52:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a45f8f7b-8a49-592b-b05f-d0c43f0f9fcf, identifier: 1985458
2026-03-26 22:52:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79a5350>
2026-03-26 22:52:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8ba7fa2-c04d-5732-8472-419439b4e0fc/a8ba7fa2-c04d-5732-8472-419439b4e0fc_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252F00e85a023c594781af503a6d61e2a9b9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/00e85a023c594781af503a6d61e2a9b9/images/large/1.jpg saved to cache
2026-03-26 22:52:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a8ba7fa2-c04d-5732-8472-419439b4e0fc
2026-03-26 22:52:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a45f8f7b-8a49-592b-b05f-d0c43f0f9fcf with identifier: 1985458
2026-03-26 22:52:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a45f8f7b-8a49-592b-b05f-d0c43f0f9fcf with identifier: 1985458
2026-03-26 22:52:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a45f8f7b-8a49-592b-b05f-d0c43f0f9fcf with identifier: 1985458 to the API
2026-03-26 22:52:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:52:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:52:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ek/a38e15e7db7247a18e532eb8d69488ed/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'a45f8f7b-8a49-592b-b05f-d0c43f0f9fcf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'CROSSLAND',
 'odometer': 47102,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a45f8f7b-8a49-592b-b05f-d0c43f0f9fcf/a45f8f7b-8a49-592b-b05f-d0c43f0f9fcf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 227759,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ek/a38e15e7db7247a18e532eb8d69488ed/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a45f8f7b-8a49-592b-b05f-d0c43f0f9fcf/a45f8f7b-8a49-592b-b05f-d0c43f0f9fcf_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 230318,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ek/a38e15e7db7247a18e532eb8d69488ed/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a45f8f7b-8a49-592b-b05f-d0c43f0f9fcf/a45f8f7b-8a49-592b-b05f-d0c43f0f9fcf_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 209222,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ek/a38e15e7db7247a18e532eb8d69488ed/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a45f8f7b-8a49-592b-b05f-d0c43f0f9fcf/a45f8f7b-8a49-592b-b05f-d0c43f0f9fcf_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 204426,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ek/a38e15e7db7247a18e532eb8d69488ed/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a45f8f7b-8a49-592b-b05f-d0c43f0f9fcf/a45f8f7b-8a49-592b-b05f-d0c43f0f9fcf_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 236066,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ek/a38e15e7db7247a18e532eb8d69488ed/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a45f8f7b-8a49-592b-b05f-d0c43f0f9fcf/a45f8f7b-8a49-592b-b05f-d0c43f0f9fcf_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 216792,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ek/a38e15e7db7247a18e532eb8d69488ed/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a45f8f7b-8a49-592b-b05f-d0c43f0f9fcf/a45f8f7b-8a49-592b-b05f-d0c43f0f9fcf_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 219686,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ek/a38e15e7db7247a18e532eb8d69488ed/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a45f8f7b-8a49-592b-b05f-d0c43f0f9fcf/a45f8f7b-8a49-592b-b05f-d0c43f0f9fcf_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 293566,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ek/a38e15e7db7247a18e532eb8d69488ed/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a45f8f7b-8a49-592b-b05f-d0c43f0f9fcf/a45f8f7b-8a49-592b-b05f-d0c43f0f9fcf_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 331249,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ek/a38e15e7db7247a18e532eb8d69488ed/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a45f8f7b-8a49-592b-b05f-d0c43f0f9fcf/a45f8f7b-8a49-592b-b05f-d0c43f0f9fcf_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 275543,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ek/a38e15e7db7247a18e532eb8d69488ed/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-11-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL CROSSLAND 1.2 81KW TURBO S-S GS  Driving School  Double pedals',
 'transmission': 'manual',
 'trim': '1.2 81KW TURBO S-S GS  Driving School  Double pedals',
 'vin': None,
 'year': 2023}
2026-03-26 22:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985458%27 HTTP/1.1" 200 None
2026-03-26 22:52:13 [ayvens.be] INFO: Saving data for 1985458: {'created_time': 1774565533.000466, 'last_price_update_time': 1774565533.000474, 'auction_closing_time': 1774958400.0}
2026-03-26 22:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985458') HTTP/1.1" 204 0
2026-03-26 22:52:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2em/00e85a023c594781af503a6d61e2a9b9/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2em/00e85a023c594781af503a6d61e2a9b9/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252F00e85a023c594781af503a6d61e2a9b9%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/00e85a023c594781af503a6d61e2a9b9/images/large/9.jpg not downloaded yet
2026-03-26 22:52:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c62550>
2026-03-26 22:52:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8ba7fa2-c04d-5732-8472-419439b4e0fc/a8ba7fa2-c04d-5732-8472-419439b4e0fc_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252F00e85a023c594781af503a6d61e2a9b9%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/00e85a023c594781af503a6d61e2a9b9/images/large/2.jpg saved to cache
2026-03-26 22:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a8ba7fa2-c04d-5732-8472-419439b4e0fc
2026-03-26 22:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252F00e85a023c594781af503a6d61e2a9b9%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/00e85a023c594781af503a6d61e2a9b9/images/large/10.jpg not downloaded yet
2026-03-26 22:52:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2em/00e85a023c594781af503a6d61e2a9b9/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2em/00e85a023c594781af503a6d61e2a9b9/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:13 [ayvens.be] INFO: Found listing with ID: 1985460
2026-03-26 22:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985460%27 HTTP/1.1" 200 None
2026-03-26 22:52:13 [ayvens.be] INFO: Scrape type for 1985460: 1
2026-03-26 22:52:13 [ayvens.be] INFO: Extracting data for car ID: 1985460
2026-03-26 22:52:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d50c448c-b647-572e-8107-86e944765fb8 with identifier: 1985460
2026-03-26 22:52:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d50c448c-b647-572e-8107-86e944765fb8 with scrape type 1
2026-03-26 22:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d50c448c-b647-572e-8107-86e944765fb8
2026-03-26 22:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F9a8e2f3d703c434b9e33375616b80926%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/9a8e2f3d703c434b9e33375616b80926/images/large/1.jpg not downloaded yet
2026-03-26 22:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F9a8e2f3d703c434b9e33375616b80926%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/9a8e2f3d703c434b9e33375616b80926/images/large/2.jpg not downloaded yet
2026-03-26 22:52:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b740a3d0>
2026-03-26 22:52:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8ba7fa2-c04d-5732-8472-419439b4e0fc/a8ba7fa2-c04d-5732-8472-419439b4e0fc_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252F00e85a023c594781af503a6d61e2a9b9%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/00e85a023c594781af503a6d61e2a9b9/images/large/3.jpg saved to cache
2026-03-26 22:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a8ba7fa2-c04d-5732-8472-419439b4e0fc
2026-03-26 22:52:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76a7e90>
2026-03-26 22:52:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8ba7fa2-c04d-5732-8472-419439b4e0fc/a8ba7fa2-c04d-5732-8472-419439b4e0fc_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252F00e85a023c594781af503a6d61e2a9b9%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/00e85a023c594781af503a6d61e2a9b9/images/large/4.jpg saved to cache
2026-03-26 22:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a8ba7fa2-c04d-5732-8472-419439b4e0fc
2026-03-26 22:52:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2em/00e85a023c594781af503a6d61e2a9b9/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F9a8e2f3d703c434b9e33375616b80926%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/9a8e2f3d703c434b9e33375616b80926/images/large/3.jpg not downloaded yet
2026-03-26 22:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F9a8e2f3d703c434b9e33375616b80926%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/9a8e2f3d703c434b9e33375616b80926/images/large/4.jpg not downloaded yet
2026-03-26 22:52:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b78c1a10>
2026-03-26 22:52:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8ba7fa2-c04d-5732-8472-419439b4e0fc/a8ba7fa2-c04d-5732-8472-419439b4e0fc_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252F00e85a023c594781af503a6d61e2a9b9%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/00e85a023c594781af503a6d61e2a9b9/images/large/6.jpg saved to cache
2026-03-26 22:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a8ba7fa2-c04d-5732-8472-419439b4e0fc
2026-03-26 22:52:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b777b690>
2026-03-26 22:52:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8ba7fa2-c04d-5732-8472-419439b4e0fc/a8ba7fa2-c04d-5732-8472-419439b4e0fc_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252F00e85a023c594781af503a6d61e2a9b9%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/00e85a023c594781af503a6d61e2a9b9/images/large/5.jpg saved to cache
2026-03-26 22:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a8ba7fa2-c04d-5732-8472-419439b4e0fc
2026-03-26 22:52:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2em/00e85a023c594781af503a6d61e2a9b9/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F9a8e2f3d703c434b9e33375616b80926%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/9a8e2f3d703c434b9e33375616b80926/images/large/5.jpg not downloaded yet
2026-03-26 22:52:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2em/00e85a023c594781af503a6d61e2a9b9/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b9b7d0>
2026-03-26 22:52:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8ba7fa2-c04d-5732-8472-419439b4e0fc/a8ba7fa2-c04d-5732-8472-419439b4e0fc_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252F00e85a023c594781af503a6d61e2a9b9%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/00e85a023c594781af503a6d61e2a9b9/images/large/7.jpg saved to cache
2026-03-26 22:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a8ba7fa2-c04d-5732-8472-419439b4e0fc
2026-03-26 22:52:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2em/00e85a023c594781af503a6d61e2a9b9/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F9a8e2f3d703c434b9e33375616b80926%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/9a8e2f3d703c434b9e33375616b80926/images/large/6.jpg not downloaded yet
2026-03-26 22:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F9a8e2f3d703c434b9e33375616b80926%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/9a8e2f3d703c434b9e33375616b80926/images/large/7.jpg not downloaded yet
2026-03-26 22:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F9a8e2f3d703c434b9e33375616b80926%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/9a8e2f3d703c434b9e33375616b80926/images/large/8.jpg not downloaded yet
2026-03-26 22:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F9a8e2f3d703c434b9e33375616b80926%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/9a8e2f3d703c434b9e33375616b80926/images/large/9.jpg not downloaded yet
2026-03-26 22:52:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b740b7d0>
2026-03-26 22:52:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8ba7fa2-c04d-5732-8472-419439b4e0fc/a8ba7fa2-c04d-5732-8472-419439b4e0fc_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252F00e85a023c594781af503a6d61e2a9b9%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/00e85a023c594781af503a6d61e2a9b9/images/large/8.jpg saved to cache
2026-03-26 22:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a8ba7fa2-c04d-5732-8472-419439b4e0fc
2026-03-26 22:52:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/9a8e2f3d703c434b9e33375616b80926/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/9a8e2f3d703c434b9e33375616b80926/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F9a8e2f3d703c434b9e33375616b80926%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/9a8e2f3d703c434b9e33375616b80926/images/large/10.jpg not downloaded yet
2026-03-26 22:52:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7406d10>
2026-03-26 22:52:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8ba7fa2-c04d-5732-8472-419439b4e0fc/a8ba7fa2-c04d-5732-8472-419439b4e0fc_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252F00e85a023c594781af503a6d61e2a9b9%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/00e85a023c594781af503a6d61e2a9b9/images/large/9.jpg saved to cache
2026-03-26 22:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a8ba7fa2-c04d-5732-8472-419439b4e0fc
2026-03-26 22:52:13 [ayvens.be] INFO: Found listing with ID: 1985461
2026-03-26 22:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985461%27 HTTP/1.1" 200 None
2026-03-26 22:52:13 [ayvens.be] INFO: Scrape type for 1985461: 1
2026-03-26 22:52:13 [ayvens.be] INFO: Extracting data for car ID: 1985461
2026-03-26 22:52:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ba6157f0-92a1-5050-951a-f02475e00dae with identifier: 1985461
2026-03-26 22:52:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ba6157f0-92a1-5050-951a-f02475e00dae with scrape type 1
2026-03-26 22:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ba6157f0-92a1-5050-951a-f02475e00dae
2026-03-26 22:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fbf0d8d7060a24f89be196182b5b98b59%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/bf0d8d7060a24f89be196182b5b98b59/images/large/1.jpg not downloaded yet
2026-03-26 22:52:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b792fc50>
2026-03-26 22:52:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8ba7fa2-c04d-5732-8472-419439b4e0fc/a8ba7fa2-c04d-5732-8472-419439b4e0fc_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252F00e85a023c594781af503a6d61e2a9b9%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/00e85a023c594781af503a6d61e2a9b9/images/large/10.jpg saved to cache
2026-03-26 22:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a8ba7fa2-c04d-5732-8472-419439b4e0fc
2026-03-26 22:52:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a8ba7fa2-c04d-5732-8472-419439b4e0fc, skipping ID generation
2026-03-26 22:52:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8ba7fa2-c04d-5732-8472-419439b4e0fc with scrape type 1
2026-03-26 22:52:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a8ba7fa2-c04d-5732-8472-419439b4e0fc sending to next pipeline
2026-03-26 22:52:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a8ba7fa2-c04d-5732-8472-419439b4e0fc, identifier: 1985459
2026-03-26 22:52:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/9a8e2f3d703c434b9e33375616b80926/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fbf0d8d7060a24f89be196182b5b98b59%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/bf0d8d7060a24f89be196182b5b98b59/images/large/2.jpg not downloaded yet
2026-03-26 22:52:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a8ba7fa2-c04d-5732-8472-419439b4e0fc with identifier: 1985459
2026-03-26 22:52:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a8ba7fa2-c04d-5732-8472-419439b4e0fc with identifier: 1985459
2026-03-26 22:52:14 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a8ba7fa2-c04d-5732-8472-419439b4e0fc with identifier: 1985459 to the API
2026-03-26 22:52:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:52:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:52:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2em/00e85a023c594781af503a6d61e2a9b9/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'a8ba7fa2-c04d-5732-8472-419439b4e0fc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'CROSSLAND',
 'odometer': 35012,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8ba7fa2-c04d-5732-8472-419439b4e0fc/a8ba7fa2-c04d-5732-8472-419439b4e0fc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 238410,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2em/00e85a023c594781af503a6d61e2a9b9/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8ba7fa2-c04d-5732-8472-419439b4e0fc/a8ba7fa2-c04d-5732-8472-419439b4e0fc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 245172,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2em/00e85a023c594781af503a6d61e2a9b9/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8ba7fa2-c04d-5732-8472-419439b4e0fc/a8ba7fa2-c04d-5732-8472-419439b4e0fc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 236301,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2em/00e85a023c594781af503a6d61e2a9b9/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8ba7fa2-c04d-5732-8472-419439b4e0fc/a8ba7fa2-c04d-5732-8472-419439b4e0fc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 235530,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2em/00e85a023c594781af503a6d61e2a9b9/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8ba7fa2-c04d-5732-8472-419439b4e0fc/a8ba7fa2-c04d-5732-8472-419439b4e0fc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 243841,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2em/00e85a023c594781af503a6d61e2a9b9/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8ba7fa2-c04d-5732-8472-419439b4e0fc/a8ba7fa2-c04d-5732-8472-419439b4e0fc_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 243789,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2em/00e85a023c594781af503a6d61e2a9b9/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8ba7fa2-c04d-5732-8472-419439b4e0fc/a8ba7fa2-c04d-5732-8472-419439b4e0fc_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 246359,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2em/00e85a023c594781af503a6d61e2a9b9/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8ba7fa2-c04d-5732-8472-419439b4e0fc/a8ba7fa2-c04d-5732-8472-419439b4e0fc_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 318592,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2em/00e85a023c594781af503a6d61e2a9b9/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8ba7fa2-c04d-5732-8472-419439b4e0fc/a8ba7fa2-c04d-5732-8472-419439b4e0fc_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 309068,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2em/00e85a023c594781af503a6d61e2a9b9/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8ba7fa2-c04d-5732-8472-419439b4e0fc/a8ba7fa2-c04d-5732-8472-419439b4e0fc_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 330286,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2em/00e85a023c594781af503a6d61e2a9b9/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-11-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL CROSSLAND 1.2 81KW TURBO S-S GS  Driving School   Double '
          'pedals',
 'transmission': 'manual',
 'trim': '1.2 81KW TURBO S-S GS  Driving School   Double pedals',
 'vin': None,
 'year': 2023}
2026-03-26 22:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985459%27 HTTP/1.1" 200 None
2026-03-26 22:52:14 [ayvens.be] INFO: Saving data for 1985459: {'created_time': 1774565534.271781, 'last_price_update_time': 1774565534.27179, 'auction_closing_time': 1774958400.0}
2026-03-26 22:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985459') HTTP/1.1" 204 0
2026-03-26 22:52:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c75050>
2026-03-26 22:52:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d50c448c-b647-572e-8107-86e944765fb8/d50c448c-b647-572e-8107-86e944765fb8_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F9a8e2f3d703c434b9e33375616b80926%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/9a8e2f3d703c434b9e33375616b80926/images/large/2.jpg saved to cache
2026-03-26 22:52:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d50c448c-b647-572e-8107-86e944765fb8
2026-03-26 22:52:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79f20d0>
2026-03-26 22:52:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d50c448c-b647-572e-8107-86e944765fb8/d50c448c-b647-572e-8107-86e944765fb8_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F9a8e2f3d703c434b9e33375616b80926%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/9a8e2f3d703c434b9e33375616b80926/images/large/1.jpg saved to cache
2026-03-26 22:52:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d50c448c-b647-572e-8107-86e944765fb8
2026-03-26 22:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fbf0d8d7060a24f89be196182b5b98b59%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/bf0d8d7060a24f89be196182b5b98b59/images/large/3.jpg not downloaded yet
2026-03-26 22:52:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd3b9150>
2026-03-26 22:52:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d50c448c-b647-572e-8107-86e944765fb8/d50c448c-b647-572e-8107-86e944765fb8_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F9a8e2f3d703c434b9e33375616b80926%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/9a8e2f3d703c434b9e33375616b80926/images/large/3.jpg saved to cache
2026-03-26 22:52:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d50c448c-b647-572e-8107-86e944765fb8
2026-03-26 22:52:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/9a8e2f3d703c434b9e33375616b80926/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fbf0d8d7060a24f89be196182b5b98b59%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/bf0d8d7060a24f89be196182b5b98b59/images/large/4.jpg not downloaded yet
2026-03-26 22:52:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/9a8e2f3d703c434b9e33375616b80926/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fbf0d8d7060a24f89be196182b5b98b59%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/bf0d8d7060a24f89be196182b5b98b59/images/large/5.jpg not downloaded yet
2026-03-26 22:52:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/9a8e2f3d703c434b9e33375616b80926/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/9a8e2f3d703c434b9e33375616b80926/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/9a8e2f3d703c434b9e33375616b80926/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/bf0d8d7060a24f89be196182b5b98b59/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fbf0d8d7060a24f89be196182b5b98b59%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/bf0d8d7060a24f89be196182b5b98b59/images/large/6.jpg not downloaded yet
2026-03-26 22:52:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/9a8e2f3d703c434b9e33375616b80926/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fbf0d8d7060a24f89be196182b5b98b59%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/bf0d8d7060a24f89be196182b5b98b59/images/large/7.jpg not downloaded yet
2026-03-26 22:52:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/9a8e2f3d703c434b9e33375616b80926/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fbf0d8d7060a24f89be196182b5b98b59%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/bf0d8d7060a24f89be196182b5b98b59/images/large/8.jpg not downloaded yet
2026-03-26 22:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fbf0d8d7060a24f89be196182b5b98b59%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/bf0d8d7060a24f89be196182b5b98b59/images/large/9.jpg not downloaded yet
2026-03-26 22:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fbf0d8d7060a24f89be196182b5b98b59%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/bf0d8d7060a24f89be196182b5b98b59/images/large/10.jpg not downloaded yet
2026-03-26 22:52:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/bf0d8d7060a24f89be196182b5b98b59/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7ccd850>
2026-03-26 22:52:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d50c448c-b647-572e-8107-86e944765fb8/d50c448c-b647-572e-8107-86e944765fb8_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F9a8e2f3d703c434b9e33375616b80926%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/9a8e2f3d703c434b9e33375616b80926/images/large/5.jpg saved to cache
2026-03-26 22:52:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d50c448c-b647-572e-8107-86e944765fb8
2026-03-26 22:52:14 [ayvens.be] INFO: Found listing with ID: 1985462
2026-03-26 22:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985462%27 HTTP/1.1" 200 None
2026-03-26 22:52:14 [ayvens.be] INFO: Scrape type for 1985462: 1
2026-03-26 22:52:14 [ayvens.be] INFO: Extracting data for car ID: 1985462
2026-03-26 22:52:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 614090ff-627e-5a45-ad6b-0bc3cfa2266a with identifier: 1985462
2026-03-26 22:52:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 614090ff-627e-5a45-ad6b-0bc3cfa2266a with scrape type 1
2026-03-26 22:52:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 614090ff-627e-5a45-ad6b-0bc3cfa2266a
2026-03-26 22:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fb638e1a170d846839afcd7e047bcc74d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/b638e1a170d846839afcd7e047bcc74d/images/large/1.jpg not downloaded yet
2026-03-26 22:52:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/bf0d8d7060a24f89be196182b5b98b59/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7a81610>
2026-03-26 22:52:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d50c448c-b647-572e-8107-86e944765fb8/d50c448c-b647-572e-8107-86e944765fb8_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F9a8e2f3d703c434b9e33375616b80926%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/9a8e2f3d703c434b9e33375616b80926/images/large/4.jpg saved to cache
2026-03-26 22:52:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d50c448c-b647-572e-8107-86e944765fb8
2026-03-26 22:52:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e4dd10>
2026-03-26 22:52:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d50c448c-b647-572e-8107-86e944765fb8/d50c448c-b647-572e-8107-86e944765fb8_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F9a8e2f3d703c434b9e33375616b80926%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/9a8e2f3d703c434b9e33375616b80926/images/large/6.jpg saved to cache
2026-03-26 22:52:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d50c448c-b647-572e-8107-86e944765fb8
2026-03-26 22:52:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd3bb810>
2026-03-26 22:52:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d50c448c-b647-572e-8107-86e944765fb8/d50c448c-b647-572e-8107-86e944765fb8_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F9a8e2f3d703c434b9e33375616b80926%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/9a8e2f3d703c434b9e33375616b80926/images/large/7.jpg saved to cache
2026-03-26 22:52:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d50c448c-b647-572e-8107-86e944765fb8
2026-03-26 22:52:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7483cd0>
2026-03-26 22:52:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d50c448c-b647-572e-8107-86e944765fb8/d50c448c-b647-572e-8107-86e944765fb8_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F9a8e2f3d703c434b9e33375616b80926%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/9a8e2f3d703c434b9e33375616b80926/images/large/9.jpg saved to cache
2026-03-26 22:52:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d50c448c-b647-572e-8107-86e944765fb8
2026-03-26 22:52:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76a6c90>
2026-03-26 22:52:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba6157f0-92a1-5050-951a-f02475e00dae/ba6157f0-92a1-5050-951a-f02475e00dae_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fbf0d8d7060a24f89be196182b5b98b59%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/bf0d8d7060a24f89be196182b5b98b59/images/large/1.jpg saved to cache
2026-03-26 22:52:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ba6157f0-92a1-5050-951a-f02475e00dae
2026-03-26 22:52:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/bf0d8d7060a24f89be196182b5b98b59/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fb638e1a170d846839afcd7e047bcc74d%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/b638e1a170d846839afcd7e047bcc74d/images/large/2.jpg not downloaded yet
2026-03-26 22:52:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/bf0d8d7060a24f89be196182b5b98b59/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e12910>
2026-03-26 22:52:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d50c448c-b647-572e-8107-86e944765fb8/d50c448c-b647-572e-8107-86e944765fb8_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F9a8e2f3d703c434b9e33375616b80926%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/9a8e2f3d703c434b9e33375616b80926/images/large/8.jpg saved to cache
2026-03-26 22:52:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d50c448c-b647-572e-8107-86e944765fb8
2026-03-26 22:52:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6d82750>
2026-03-26 22:52:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d50c448c-b647-572e-8107-86e944765fb8/d50c448c-b647-572e-8107-86e944765fb8_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F9a8e2f3d703c434b9e33375616b80926%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/9a8e2f3d703c434b9e33375616b80926/images/large/10.jpg saved to cache
2026-03-26 22:52:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d50c448c-b647-572e-8107-86e944765fb8
2026-03-26 22:52:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d50c448c-b647-572e-8107-86e944765fb8, skipping ID generation
2026-03-26 22:52:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d50c448c-b647-572e-8107-86e944765fb8 with scrape type 1
2026-03-26 22:52:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d50c448c-b647-572e-8107-86e944765fb8 sending to next pipeline
2026-03-26 22:52:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d50c448c-b647-572e-8107-86e944765fb8, identifier: 1985460
2026-03-26 22:52:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b9bcd0>
2026-03-26 22:52:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba6157f0-92a1-5050-951a-f02475e00dae/ba6157f0-92a1-5050-951a-f02475e00dae_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fbf0d8d7060a24f89be196182b5b98b59%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/bf0d8d7060a24f89be196182b5b98b59/images/large/2.jpg saved to cache
2026-03-26 22:52:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ba6157f0-92a1-5050-951a-f02475e00dae
2026-03-26 22:52:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/bf0d8d7060a24f89be196182b5b98b59/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/bf0d8d7060a24f89be196182b5b98b59/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fb638e1a170d846839afcd7e047bcc74d%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/b638e1a170d846839afcd7e047bcc74d/images/large/3.jpg not downloaded yet
2026-03-26 22:52:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d50c448c-b647-572e-8107-86e944765fb8 with identifier: 1985460
2026-03-26 22:52:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d50c448c-b647-572e-8107-86e944765fb8 with identifier: 1985460
2026-03-26 22:52:15 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d50c448c-b647-572e-8107-86e944765fb8 with identifier: 1985460 to the API
2026-03-26 22:52:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:52:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:52:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bs/9a8e2f3d703c434b9e33375616b80926/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'd50c448c-b647-572e-8107-86e944765fb8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLA - Klasse',
 'odometer': 74123,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d50c448c-b647-572e-8107-86e944765fb8/d50c448c-b647-572e-8107-86e944765fb8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 678715,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/9a8e2f3d703c434b9e33375616b80926/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d50c448c-b647-572e-8107-86e944765fb8/d50c448c-b647-572e-8107-86e944765fb8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 674081,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/9a8e2f3d703c434b9e33375616b80926/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d50c448c-b647-572e-8107-86e944765fb8/d50c448c-b647-572e-8107-86e944765fb8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 558288,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/9a8e2f3d703c434b9e33375616b80926/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d50c448c-b647-572e-8107-86e944765fb8/d50c448c-b647-572e-8107-86e944765fb8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 609819,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/9a8e2f3d703c434b9e33375616b80926/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d50c448c-b647-572e-8107-86e944765fb8/d50c448c-b647-572e-8107-86e944765fb8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 623868,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/9a8e2f3d703c434b9e33375616b80926/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d50c448c-b647-572e-8107-86e944765fb8/d50c448c-b647-572e-8107-86e944765fb8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 667023,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/9a8e2f3d703c434b9e33375616b80926/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d50c448c-b647-572e-8107-86e944765fb8/d50c448c-b647-572e-8107-86e944765fb8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 683523,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/9a8e2f3d703c434b9e33375616b80926/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d50c448c-b647-572e-8107-86e944765fb8/d50c448c-b647-572e-8107-86e944765fb8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 675906,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/9a8e2f3d703c434b9e33375616b80926/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d50c448c-b647-572e-8107-86e944765fb8/d50c448c-b647-572e-8107-86e944765fb8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 496670,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/9a8e2f3d703c434b9e33375616b80926/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d50c448c-b647-572e-8107-86e944765fb8/d50c448c-b647-572e-8107-86e944765fb8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 677060,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/9a8e2f3d703c434b9e33375616b80926/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLA - Klasse 1.3 CLA 250 E BUSINESS SOLUTION DCT',
 'transmission': 'automatic',
 'trim': '1.3 CLA 250 E BUSINESS SOLUTION DCT',
 'vin': None,
 'year': 2022}
2026-03-26 22:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985460%27 HTTP/1.1" 200 None
2026-03-26 22:52:16 [ayvens.be] INFO: Saving data for 1985460: {'created_time': 1774565536.068034, 'last_price_update_time': 1774565536.068044, 'auction_closing_time': 1774958400.0}
2026-03-26 22:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985460') HTTP/1.1" 204 0
2026-03-26 22:52:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/bf0d8d7060a24f89be196182b5b98b59/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79dfb50>
2026-03-26 22:52:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba6157f0-92a1-5050-951a-f02475e00dae/ba6157f0-92a1-5050-951a-f02475e00dae_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fbf0d8d7060a24f89be196182b5b98b59%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/bf0d8d7060a24f89be196182b5b98b59/images/large/3.jpg saved to cache
2026-03-26 22:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ba6157f0-92a1-5050-951a-f02475e00dae
2026-03-26 22:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fb638e1a170d846839afcd7e047bcc74d%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/b638e1a170d846839afcd7e047bcc74d/images/large/4.jpg not downloaded yet
2026-03-26 22:52:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/bf0d8d7060a24f89be196182b5b98b59/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79dced0>
2026-03-26 22:52:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba6157f0-92a1-5050-951a-f02475e00dae/ba6157f0-92a1-5050-951a-f02475e00dae_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fbf0d8d7060a24f89be196182b5b98b59%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/bf0d8d7060a24f89be196182b5b98b59/images/large/4.jpg saved to cache
2026-03-26 22:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ba6157f0-92a1-5050-951a-f02475e00dae
2026-03-26 22:52:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7745b90>
2026-03-26 22:52:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba6157f0-92a1-5050-951a-f02475e00dae/ba6157f0-92a1-5050-951a-f02475e00dae_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fbf0d8d7060a24f89be196182b5b98b59%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/bf0d8d7060a24f89be196182b5b98b59/images/large/5.jpg saved to cache
2026-03-26 22:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ba6157f0-92a1-5050-951a-f02475e00dae
2026-03-26 22:52:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6dd8d10>
2026-03-26 22:52:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba6157f0-92a1-5050-951a-f02475e00dae/ba6157f0-92a1-5050-951a-f02475e00dae_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fbf0d8d7060a24f89be196182b5b98b59%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/bf0d8d7060a24f89be196182b5b98b59/images/large/7.jpg saved to cache
2026-03-26 22:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ba6157f0-92a1-5050-951a-f02475e00dae
2026-03-26 22:52:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74dd710>
2026-03-26 22:52:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba6157f0-92a1-5050-951a-f02475e00dae/ba6157f0-92a1-5050-951a-f02475e00dae_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fbf0d8d7060a24f89be196182b5b98b59%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/bf0d8d7060a24f89be196182b5b98b59/images/large/6.jpg saved to cache
2026-03-26 22:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ba6157f0-92a1-5050-951a-f02475e00dae
2026-03-26 22:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fb638e1a170d846839afcd7e047bcc74d%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/b638e1a170d846839afcd7e047bcc74d/images/large/5.jpg not downloaded yet
2026-03-26 22:52:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/b638e1a170d846839afcd7e047bcc74d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fb638e1a170d846839afcd7e047bcc74d%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/b638e1a170d846839afcd7e047bcc74d/images/large/6.jpg not downloaded yet
2026-03-26 22:52:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/bf0d8d7060a24f89be196182b5b98b59/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e47690>
2026-03-26 22:52:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba6157f0-92a1-5050-951a-f02475e00dae/ba6157f0-92a1-5050-951a-f02475e00dae_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fbf0d8d7060a24f89be196182b5b98b59%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/bf0d8d7060a24f89be196182b5b98b59/images/large/8.jpg saved to cache
2026-03-26 22:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ba6157f0-92a1-5050-951a-f02475e00dae
2026-03-26 22:52:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7cab190>
2026-03-26 22:52:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba6157f0-92a1-5050-951a-f02475e00dae/ba6157f0-92a1-5050-951a-f02475e00dae_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fbf0d8d7060a24f89be196182b5b98b59%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/bf0d8d7060a24f89be196182b5b98b59/images/large/9.jpg saved to cache
2026-03-26 22:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ba6157f0-92a1-5050-951a-f02475e00dae
2026-03-26 22:52:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/b638e1a170d846839afcd7e047bcc74d/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fb638e1a170d846839afcd7e047bcc74d%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/b638e1a170d846839afcd7e047bcc74d/images/large/7.jpg not downloaded yet
2026-03-26 22:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fb638e1a170d846839afcd7e047bcc74d%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/b638e1a170d846839afcd7e047bcc74d/images/large/8.jpg not downloaded yet
2026-03-26 22:52:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b72eeed0>
2026-03-26 22:52:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_614090ff-627e-5a45-ad6b-0bc3cfa2266a/614090ff-627e-5a45-ad6b-0bc3cfa2266a_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fb638e1a170d846839afcd7e047bcc74d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/b638e1a170d846839afcd7e047bcc74d/images/large/1.jpg saved to cache
2026-03-26 22:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 614090ff-627e-5a45-ad6b-0bc3cfa2266a
2026-03-26 22:52:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cbe790>
2026-03-26 22:52:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba6157f0-92a1-5050-951a-f02475e00dae/ba6157f0-92a1-5050-951a-f02475e00dae_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fbf0d8d7060a24f89be196182b5b98b59%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/bf0d8d7060a24f89be196182b5b98b59/images/large/10.jpg saved to cache
2026-03-26 22:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ba6157f0-92a1-5050-951a-f02475e00dae
2026-03-26 22:52:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ba6157f0-92a1-5050-951a-f02475e00dae, skipping ID generation
2026-03-26 22:52:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ba6157f0-92a1-5050-951a-f02475e00dae with scrape type 1
2026-03-26 22:52:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ba6157f0-92a1-5050-951a-f02475e00dae sending to next pipeline
2026-03-26 22:52:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: ba6157f0-92a1-5050-951a-f02475e00dae, identifier: 1985461
2026-03-26 22:52:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/b638e1a170d846839afcd7e047bcc74d/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fb638e1a170d846839afcd7e047bcc74d%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/b638e1a170d846839afcd7e047bcc74d/images/large/9.jpg not downloaded yet
2026-03-26 22:52:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: ba6157f0-92a1-5050-951a-f02475e00dae with identifier: 1985461
2026-03-26 22:52:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: ba6157f0-92a1-5050-951a-f02475e00dae with identifier: 1985461
2026-03-26 22:52:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: ba6157f0-92a1-5050-951a-f02475e00dae with identifier: 1985461 to the API
2026-03-26 22:52:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:52:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:52:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2dt/bf0d8d7060a24f89be196182b5b98b59/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'ba6157f0-92a1-5050-951a-f02475e00dae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '1 SERIES HATCH',
 'odometer': 78012,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba6157f0-92a1-5050-951a-f02475e00dae/ba6157f0-92a1-5050-951a-f02475e00dae_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 230370,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/bf0d8d7060a24f89be196182b5b98b59/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba6157f0-92a1-5050-951a-f02475e00dae/ba6157f0-92a1-5050-951a-f02475e00dae_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 219139,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/bf0d8d7060a24f89be196182b5b98b59/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba6157f0-92a1-5050-951a-f02475e00dae/ba6157f0-92a1-5050-951a-f02475e00dae_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 254778,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/bf0d8d7060a24f89be196182b5b98b59/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba6157f0-92a1-5050-951a-f02475e00dae/ba6157f0-92a1-5050-951a-f02475e00dae_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 246547,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/bf0d8d7060a24f89be196182b5b98b59/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba6157f0-92a1-5050-951a-f02475e00dae/ba6157f0-92a1-5050-951a-f02475e00dae_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 320845,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/bf0d8d7060a24f89be196182b5b98b59/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba6157f0-92a1-5050-951a-f02475e00dae/ba6157f0-92a1-5050-951a-f02475e00dae_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 322554,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/bf0d8d7060a24f89be196182b5b98b59/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba6157f0-92a1-5050-951a-f02475e00dae/ba6157f0-92a1-5050-951a-f02475e00dae_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 302007,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/bf0d8d7060a24f89be196182b5b98b59/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba6157f0-92a1-5050-951a-f02475e00dae/ba6157f0-92a1-5050-951a-f02475e00dae_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 314155,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/bf0d8d7060a24f89be196182b5b98b59/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba6157f0-92a1-5050-951a-f02475e00dae/ba6157f0-92a1-5050-951a-f02475e00dae_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 356194,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/bf0d8d7060a24f89be196182b5b98b59/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba6157f0-92a1-5050-951a-f02475e00dae/ba6157f0-92a1-5050-951a-f02475e00dae_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 383937,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/bf0d8d7060a24f89be196182b5b98b59/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1 SERIES HATCH 1.5 116IA (80KW)',
 'transmission': 'automatic',
 'trim': '1.5 116IA (80KW)',
 'vin': None,
 'year': 2023}
2026-03-26 22:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985461%27 HTTP/1.1" 200 None
2026-03-26 22:52:17 [ayvens.be] INFO: Saving data for 1985461: {'created_time': 1774565537.363588, 'last_price_update_time': 1774565537.3636, 'auction_closing_time': 1774958400.0}
2026-03-26 22:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985461') HTTP/1.1" 204 0
2026-03-26 22:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fb638e1a170d846839afcd7e047bcc74d%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/b638e1a170d846839afcd7e047bcc74d/images/large/10.jpg not downloaded yet
2026-03-26 22:52:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/b638e1a170d846839afcd7e047bcc74d/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7aa1f10>
2026-03-26 22:52:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_614090ff-627e-5a45-ad6b-0bc3cfa2266a/614090ff-627e-5a45-ad6b-0bc3cfa2266a_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fb638e1a170d846839afcd7e047bcc74d%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/b638e1a170d846839afcd7e047bcc74d/images/large/2.jpg saved to cache
2026-03-26 22:52:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 614090ff-627e-5a45-ad6b-0bc3cfa2266a
2026-03-26 22:52:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7769390>
2026-03-26 22:52:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_614090ff-627e-5a45-ad6b-0bc3cfa2266a/614090ff-627e-5a45-ad6b-0bc3cfa2266a_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fb638e1a170d846839afcd7e047bcc74d%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/b638e1a170d846839afcd7e047bcc74d/images/large/3.jpg saved to cache
2026-03-26 22:52:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 614090ff-627e-5a45-ad6b-0bc3cfa2266a
2026-03-26 22:52:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/b638e1a170d846839afcd7e047bcc74d/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/b638e1a170d846839afcd7e047bcc74d/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:17 [ayvens.be] INFO: Found listing with ID: 1985463
2026-03-26 22:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985463%27 HTTP/1.1" 200 None
2026-03-26 22:52:17 [ayvens.be] INFO: Scrape type for 1985463: 1
2026-03-26 22:52:17 [ayvens.be] INFO: Extracting data for car ID: 1985463
2026-03-26 22:52:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2d27c44-c77c-505e-93df-2041e7ceec72 with identifier: 1985463
2026-03-26 22:52:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2d27c44-c77c-505e-93df-2041e7ceec72 with scrape type 1
2026-03-26 22:52:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b2d27c44-c77c-505e-93df-2041e7ceec72
2026-03-26 22:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252Fddb219a40b0f45ba9743fafba7e10c9b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/ddb219a40b0f45ba9743fafba7e10c9b/images/large/1.jpg not downloaded yet
2026-03-26 22:52:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/b638e1a170d846839afcd7e047bcc74d/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252Fddb219a40b0f45ba9743fafba7e10c9b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/ddb219a40b0f45ba9743fafba7e10c9b/images/large/2.jpg not downloaded yet
2026-03-26 22:52:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b163d0>
2026-03-26 22:52:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_614090ff-627e-5a45-ad6b-0bc3cfa2266a/614090ff-627e-5a45-ad6b-0bc3cfa2266a_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fb638e1a170d846839afcd7e047bcc74d%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/b638e1a170d846839afcd7e047bcc74d/images/large/4.jpg saved to cache
2026-03-26 22:52:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 614090ff-627e-5a45-ad6b-0bc3cfa2266a
2026-03-26 22:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252Fddb219a40b0f45ba9743fafba7e10c9b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/ddb219a40b0f45ba9743fafba7e10c9b/images/large/3.jpg not downloaded yet
2026-03-26 22:52:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/b638e1a170d846839afcd7e047bcc74d/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252Fddb219a40b0f45ba9743fafba7e10c9b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/ddb219a40b0f45ba9743fafba7e10c9b/images/large/4.jpg not downloaded yet
2026-03-26 22:52:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7449a10>
2026-03-26 22:52:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_614090ff-627e-5a45-ad6b-0bc3cfa2266a/614090ff-627e-5a45-ad6b-0bc3cfa2266a_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fb638e1a170d846839afcd7e047bcc74d%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/b638e1a170d846839afcd7e047bcc74d/images/large/5.jpg saved to cache
2026-03-26 22:52:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 614090ff-627e-5a45-ad6b-0bc3cfa2266a
2026-03-26 22:52:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cbc650>
2026-03-26 22:52:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_614090ff-627e-5a45-ad6b-0bc3cfa2266a/614090ff-627e-5a45-ad6b-0bc3cfa2266a_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fb638e1a170d846839afcd7e047bcc74d%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/b638e1a170d846839afcd7e047bcc74d/images/large/6.jpg saved to cache
2026-03-26 22:52:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 614090ff-627e-5a45-ad6b-0bc3cfa2266a
2026-03-26 22:52:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/b638e1a170d846839afcd7e047bcc74d/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252Fddb219a40b0f45ba9743fafba7e10c9b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/ddb219a40b0f45ba9743fafba7e10c9b/images/large/5.jpg not downloaded yet
2026-03-26 22:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252Fddb219a40b0f45ba9743fafba7e10c9b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/ddb219a40b0f45ba9743fafba7e10c9b/images/large/6.jpg not downloaded yet
2026-03-26 22:52:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/b638e1a170d846839afcd7e047bcc74d/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/ddb219a40b0f45ba9743fafba7e10c9b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7491b10>
2026-03-26 22:52:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_614090ff-627e-5a45-ad6b-0bc3cfa2266a/614090ff-627e-5a45-ad6b-0bc3cfa2266a_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fb638e1a170d846839afcd7e047bcc74d%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/b638e1a170d846839afcd7e047bcc74d/images/large/7.jpg saved to cache
2026-03-26 22:52:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 614090ff-627e-5a45-ad6b-0bc3cfa2266a
2026-03-26 22:52:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74b4d50>
2026-03-26 22:52:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_614090ff-627e-5a45-ad6b-0bc3cfa2266a/614090ff-627e-5a45-ad6b-0bc3cfa2266a_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fb638e1a170d846839afcd7e047bcc74d%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/b638e1a170d846839afcd7e047bcc74d/images/large/8.jpg saved to cache
2026-03-26 22:52:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 614090ff-627e-5a45-ad6b-0bc3cfa2266a
2026-03-26 22:52:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/ddb219a40b0f45ba9743fafba7e10c9b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252Fddb219a40b0f45ba9743fafba7e10c9b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/ddb219a40b0f45ba9743fafba7e10c9b/images/large/7.jpg not downloaded yet
2026-03-26 22:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252Fddb219a40b0f45ba9743fafba7e10c9b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/ddb219a40b0f45ba9743fafba7e10c9b/images/large/8.jpg not downloaded yet
2026-03-26 22:52:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/ddb219a40b0f45ba9743fafba7e10c9b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76c7d10>
2026-03-26 22:52:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_614090ff-627e-5a45-ad6b-0bc3cfa2266a/614090ff-627e-5a45-ad6b-0bc3cfa2266a_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fb638e1a170d846839afcd7e047bcc74d%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/b638e1a170d846839afcd7e047bcc74d/images/large/9.jpg saved to cache
2026-03-26 22:52:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 614090ff-627e-5a45-ad6b-0bc3cfa2266a
2026-03-26 22:52:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b745bad0>
2026-03-26 22:52:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_614090ff-627e-5a45-ad6b-0bc3cfa2266a/614090ff-627e-5a45-ad6b-0bc3cfa2266a_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fb638e1a170d846839afcd7e047bcc74d%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/b638e1a170d846839afcd7e047bcc74d/images/large/10.jpg saved to cache
2026-03-26 22:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 614090ff-627e-5a45-ad6b-0bc3cfa2266a
2026-03-26 22:52:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 614090ff-627e-5a45-ad6b-0bc3cfa2266a, skipping ID generation
2026-03-26 22:52:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 614090ff-627e-5a45-ad6b-0bc3cfa2266a with scrape type 1
2026-03-26 22:52:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 614090ff-627e-5a45-ad6b-0bc3cfa2266a sending to next pipeline
2026-03-26 22:52:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 614090ff-627e-5a45-ad6b-0bc3cfa2266a, identifier: 1985462
2026-03-26 22:52:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7493590>
2026-03-26 22:52:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2d27c44-c77c-505e-93df-2041e7ceec72/b2d27c44-c77c-505e-93df-2041e7ceec72_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252Fddb219a40b0f45ba9743fafba7e10c9b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/ddb219a40b0f45ba9743fafba7e10c9b/images/large/1.jpg saved to cache
2026-03-26 22:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b2d27c44-c77c-505e-93df-2041e7ceec72
2026-03-26 22:52:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/ddb219a40b0f45ba9743fafba7e10c9b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252Fddb219a40b0f45ba9743fafba7e10c9b%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/ddb219a40b0f45ba9743fafba7e10c9b/images/large/9.jpg not downloaded yet
2026-03-26 22:52:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 614090ff-627e-5a45-ad6b-0bc3cfa2266a with identifier: 1985462
2026-03-26 22:52:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 614090ff-627e-5a45-ad6b-0bc3cfa2266a with identifier: 1985462
2026-03-26 22:52:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 614090ff-627e-5a45-ad6b-0bc3cfa2266a with identifier: 1985462 to the API
2026-03-26 22:52:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:52:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:52:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bx/b638e1a170d846839afcd7e047bcc74d/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '614090ff-627e-5a45-ad6b-0bc3cfa2266a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'ARONA',
 'odometer': 39857,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_614090ff-627e-5a45-ad6b-0bc3cfa2266a/614090ff-627e-5a45-ad6b-0bc3cfa2266a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 208886,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/b638e1a170d846839afcd7e047bcc74d/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_614090ff-627e-5a45-ad6b-0bc3cfa2266a/614090ff-627e-5a45-ad6b-0bc3cfa2266a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 205321,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/b638e1a170d846839afcd7e047bcc74d/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_614090ff-627e-5a45-ad6b-0bc3cfa2266a/614090ff-627e-5a45-ad6b-0bc3cfa2266a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 232367,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/b638e1a170d846839afcd7e047bcc74d/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_614090ff-627e-5a45-ad6b-0bc3cfa2266a/614090ff-627e-5a45-ad6b-0bc3cfa2266a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 239017,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/b638e1a170d846839afcd7e047bcc74d/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_614090ff-627e-5a45-ad6b-0bc3cfa2266a/614090ff-627e-5a45-ad6b-0bc3cfa2266a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 244697,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/b638e1a170d846839afcd7e047bcc74d/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_614090ff-627e-5a45-ad6b-0bc3cfa2266a/614090ff-627e-5a45-ad6b-0bc3cfa2266a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 234297,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/b638e1a170d846839afcd7e047bcc74d/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_614090ff-627e-5a45-ad6b-0bc3cfa2266a/614090ff-627e-5a45-ad6b-0bc3cfa2266a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 262891,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/b638e1a170d846839afcd7e047bcc74d/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_614090ff-627e-5a45-ad6b-0bc3cfa2266a/614090ff-627e-5a45-ad6b-0bc3cfa2266a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 225773,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/b638e1a170d846839afcd7e047bcc74d/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_614090ff-627e-5a45-ad6b-0bc3cfa2266a/614090ff-627e-5a45-ad6b-0bc3cfa2266a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 206467,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/b638e1a170d846839afcd7e047bcc74d/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_614090ff-627e-5a45-ad6b-0bc3cfa2266a/614090ff-627e-5a45-ad6b-0bc3cfa2266a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 351892,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/b638e1a170d846839afcd7e047bcc74d/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT ARONA 1.0 TSI 70KW MOVE',
 'transmission': 'manual',
 'trim': '1.0 TSI 70KW MOVE',
 'vin': None,
 'year': 2022}
2026-03-26 22:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985462%27 HTTP/1.1" 200 None
2026-03-26 22:52:18 [ayvens.be] INFO: Saving data for 1985462: {'created_time': 1774565538.576166, 'last_price_update_time': 1774565538.576175, 'auction_closing_time': 1774958400.0}
2026-03-26 22:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985462') HTTP/1.1" 204 0
2026-03-26 22:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252Fddb219a40b0f45ba9743fafba7e10c9b%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/ddb219a40b0f45ba9743fafba7e10c9b/images/large/10.jpg not downloaded yet
2026-03-26 22:52:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b727af90>
2026-03-26 22:52:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2d27c44-c77c-505e-93df-2041e7ceec72/b2d27c44-c77c-505e-93df-2041e7ceec72_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252Fddb219a40b0f45ba9743fafba7e10c9b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/ddb219a40b0f45ba9743fafba7e10c9b/images/large/2.jpg saved to cache
2026-03-26 22:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b2d27c44-c77c-505e-93df-2041e7ceec72
2026-03-26 22:52:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cc24d0>
2026-03-26 22:52:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2d27c44-c77c-505e-93df-2041e7ceec72/b2d27c44-c77c-505e-93df-2041e7ceec72_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252Fddb219a40b0f45ba9743fafba7e10c9b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/ddb219a40b0f45ba9743fafba7e10c9b/images/large/3.jpg saved to cache
2026-03-26 22:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b2d27c44-c77c-505e-93df-2041e7ceec72
2026-03-26 22:52:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7438490>
2026-03-26 22:52:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2d27c44-c77c-505e-93df-2041e7ceec72/b2d27c44-c77c-505e-93df-2041e7ceec72_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252Fddb219a40b0f45ba9743fafba7e10c9b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/ddb219a40b0f45ba9743fafba7e10c9b/images/large/4.jpg saved to cache
2026-03-26 22:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b2d27c44-c77c-505e-93df-2041e7ceec72
2026-03-26 22:52:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/ddb219a40b0f45ba9743fafba7e10c9b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:18 [ayvens.be] INFO: Found listing with ID: 1985464
2026-03-26 22:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985464%27 HTTP/1.1" 200 None
2026-03-26 22:52:18 [ayvens.be] INFO: Scrape type for 1985464: 1
2026-03-26 22:52:18 [ayvens.be] INFO: Extracting data for car ID: 1985464
2026-03-26 22:52:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b0aec5da-22aa-5563-bf01-bf7b6c9c5160 with identifier: 1985464
2026-03-26 22:52:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0aec5da-22aa-5563-bf01-bf7b6c9c5160 with scrape type 1
2026-03-26 22:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b0aec5da-22aa-5563-bf01-bf7b6c9c5160
2026-03-26 22:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F534ecb4ceff24743b4b207924efc67c9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/534ecb4ceff24743b4b207924efc67c9/images/large/1.jpg not downloaded yet
2026-03-26 22:52:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/ddb219a40b0f45ba9743fafba7e10c9b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/ddb219a40b0f45ba9743fafba7e10c9b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F534ecb4ceff24743b4b207924efc67c9%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/534ecb4ceff24743b4b207924efc67c9/images/large/2.jpg not downloaded yet
2026-03-26 22:52:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/ddb219a40b0f45ba9743fafba7e10c9b/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F534ecb4ceff24743b4b207924efc67c9%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/534ecb4ceff24743b4b207924efc67c9/images/large/3.jpg not downloaded yet
2026-03-26 22:52:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/ddb219a40b0f45ba9743fafba7e10c9b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F534ecb4ceff24743b4b207924efc67c9%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/534ecb4ceff24743b4b207924efc67c9/images/large/4.jpg not downloaded yet
2026-03-26 22:52:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74b6590>
2026-03-26 22:52:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2d27c44-c77c-505e-93df-2041e7ceec72/b2d27c44-c77c-505e-93df-2041e7ceec72_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252Fddb219a40b0f45ba9743fafba7e10c9b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/ddb219a40b0f45ba9743fafba7e10c9b/images/large/5.jpg saved to cache
2026-03-26 22:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b2d27c44-c77c-505e-93df-2041e7ceec72
2026-03-26 22:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F534ecb4ceff24743b4b207924efc67c9%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/534ecb4ceff24743b4b207924efc67c9/images/large/5.jpg not downloaded yet
2026-03-26 22:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F534ecb4ceff24743b4b207924efc67c9%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/534ecb4ceff24743b4b207924efc67c9/images/large/6.jpg not downloaded yet
2026-03-26 22:52:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e3fe50>
2026-03-26 22:52:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2d27c44-c77c-505e-93df-2041e7ceec72/b2d27c44-c77c-505e-93df-2041e7ceec72_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252Fddb219a40b0f45ba9743fafba7e10c9b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/ddb219a40b0f45ba9743fafba7e10c9b/images/large/6.jpg saved to cache
2026-03-26 22:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b2d27c44-c77c-505e-93df-2041e7ceec72
2026-03-26 22:52:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b78c22d0>
2026-03-26 22:52:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2d27c44-c77c-505e-93df-2041e7ceec72/b2d27c44-c77c-505e-93df-2041e7ceec72_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252Fddb219a40b0f45ba9743fafba7e10c9b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/ddb219a40b0f45ba9743fafba7e10c9b/images/large/7.jpg saved to cache
2026-03-26 22:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b2d27c44-c77c-505e-93df-2041e7ceec72
2026-03-26 22:52:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e1fd50>
2026-03-26 22:52:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2d27c44-c77c-505e-93df-2041e7ceec72/b2d27c44-c77c-505e-93df-2041e7ceec72_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252Fddb219a40b0f45ba9743fafba7e10c9b%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/ddb219a40b0f45ba9743fafba7e10c9b/images/large/9.jpg saved to cache
2026-03-26 22:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b2d27c44-c77c-505e-93df-2041e7ceec72
2026-03-26 22:52:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c76250>
2026-03-26 22:52:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2d27c44-c77c-505e-93df-2041e7ceec72/b2d27c44-c77c-505e-93df-2041e7ceec72_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252Fddb219a40b0f45ba9743fafba7e10c9b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/ddb219a40b0f45ba9743fafba7e10c9b/images/large/8.jpg saved to cache
2026-03-26 22:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b2d27c44-c77c-505e-93df-2041e7ceec72
2026-03-26 22:52:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/ddb219a40b0f45ba9743fafba7e10c9b/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F534ecb4ceff24743b4b207924efc67c9%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/534ecb4ceff24743b4b207924efc67c9/images/large/7.jpg not downloaded yet
2026-03-26 22:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F534ecb4ceff24743b4b207924efc67c9%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/534ecb4ceff24743b4b207924efc67c9/images/large/8.jpg not downloaded yet
2026-03-26 22:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F534ecb4ceff24743b4b207924efc67c9%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/534ecb4ceff24743b4b207924efc67c9/images/large/9.jpg not downloaded yet
2026-03-26 22:52:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/534ecb4ceff24743b4b207924efc67c9/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/534ecb4ceff24743b4b207924efc67c9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F534ecb4ceff24743b4b207924efc67c9%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/534ecb4ceff24743b4b207924efc67c9/images/large/10.jpg not downloaded yet
2026-03-26 22:52:19 [ayvens.be] INFO: Found listing with ID: 1985465
2026-03-26 22:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985465%27 HTTP/1.1" 200 None
2026-03-26 22:52:19 [ayvens.be] INFO: Scrape type for 1985465: 1
2026-03-26 22:52:19 [ayvens.be] INFO: Extracting data for car ID: 1985465
2026-03-26 22:52:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a3efe363-6c49-5207-84ad-6fdd8285a0ba with identifier: 1985465
2026-03-26 22:52:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3efe363-6c49-5207-84ad-6fdd8285a0ba with scrape type 1
2026-03-26 22:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a3efe363-6c49-5207-84ad-6fdd8285a0ba
2026-03-26 22:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Ffcadf66ab3454a0995a338f9677b7830%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/fcadf66ab3454a0995a338f9677b7830/images/large/1.jpg not downloaded yet
2026-03-26 22:52:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/534ecb4ceff24743b4b207924efc67c9/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/534ecb4ceff24743b4b207924efc67c9/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Ffcadf66ab3454a0995a338f9677b7830%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/fcadf66ab3454a0995a338f9677b7830/images/large/2.jpg not downloaded yet
2026-03-26 22:52:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b78c1ed0>
2026-03-26 22:52:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2d27c44-c77c-505e-93df-2041e7ceec72/b2d27c44-c77c-505e-93df-2041e7ceec72_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252Fddb219a40b0f45ba9743fafba7e10c9b%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/ddb219a40b0f45ba9743fafba7e10c9b/images/large/10.jpg saved to cache
2026-03-26 22:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b2d27c44-c77c-505e-93df-2041e7ceec72
2026-03-26 22:52:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b2d27c44-c77c-505e-93df-2041e7ceec72, skipping ID generation
2026-03-26 22:52:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2d27c44-c77c-505e-93df-2041e7ceec72 with scrape type 1
2026-03-26 22:52:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b2d27c44-c77c-505e-93df-2041e7ceec72 sending to next pipeline
2026-03-26 22:52:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b2d27c44-c77c-505e-93df-2041e7ceec72, identifier: 1985463
2026-03-26 22:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Ffcadf66ab3454a0995a338f9677b7830%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/fcadf66ab3454a0995a338f9677b7830/images/large/3.jpg not downloaded yet
2026-03-26 22:52:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b2d27c44-c77c-505e-93df-2041e7ceec72 with identifier: 1985463
2026-03-26 22:52:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b2d27c44-c77c-505e-93df-2041e7ceec72 with identifier: 1985463
2026-03-26 22:52:19 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b2d27c44-c77c-505e-93df-2041e7ceec72 with identifier: 1985463 to the API
2026-03-26 22:52:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:52:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:52:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cc/ddb219a40b0f45ba9743fafba7e10c9b/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'b2d27c44-c77c-505e-93df-2041e7ceec72',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'LEON',
 'odometer': 61239,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2d27c44-c77c-505e-93df-2041e7ceec72/b2d27c44-c77c-505e-93df-2041e7ceec72_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 200932,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/ddb219a40b0f45ba9743fafba7e10c9b/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2d27c44-c77c-505e-93df-2041e7ceec72/b2d27c44-c77c-505e-93df-2041e7ceec72_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 222857,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/ddb219a40b0f45ba9743fafba7e10c9b/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2d27c44-c77c-505e-93df-2041e7ceec72/b2d27c44-c77c-505e-93df-2041e7ceec72_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 226664,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/ddb219a40b0f45ba9743fafba7e10c9b/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2d27c44-c77c-505e-93df-2041e7ceec72/b2d27c44-c77c-505e-93df-2041e7ceec72_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 240854,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/ddb219a40b0f45ba9743fafba7e10c9b/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2d27c44-c77c-505e-93df-2041e7ceec72/b2d27c44-c77c-505e-93df-2041e7ceec72_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 295217,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/ddb219a40b0f45ba9743fafba7e10c9b/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2d27c44-c77c-505e-93df-2041e7ceec72/b2d27c44-c77c-505e-93df-2041e7ceec72_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 278618,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/ddb219a40b0f45ba9743fafba7e10c9b/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2d27c44-c77c-505e-93df-2041e7ceec72/b2d27c44-c77c-505e-93df-2041e7ceec72_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 255174,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/ddb219a40b0f45ba9743fafba7e10c9b/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2d27c44-c77c-505e-93df-2041e7ceec72/b2d27c44-c77c-505e-93df-2041e7ceec72_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 269315,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/ddb219a40b0f45ba9743fafba7e10c9b/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2d27c44-c77c-505e-93df-2041e7ceec72/b2d27c44-c77c-505e-93df-2041e7ceec72_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 184844,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/ddb219a40b0f45ba9743fafba7e10c9b/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2d27c44-c77c-505e-93df-2041e7ceec72/b2d27c44-c77c-505e-93df-2041e7ceec72_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 250899,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/ddb219a40b0f45ba9743fafba7e10c9b/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT LEON 1.0 ETSI 81KW S-S MOVE! DSG',
 'transmission': 'automatic',
 'trim': '1.0 ETSI 81KW S-S MOVE! DSG',
 'vin': None,
 'year': 2022}
2026-03-26 22:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985463%27 HTTP/1.1" 200 None
2026-03-26 22:52:20 [ayvens.be] INFO: Saving data for 1985463: {'created_time': 1774565540.065063, 'last_price_update_time': 1774565540.065072, 'auction_closing_time': 1774958400.0}
2026-03-26 22:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985463') HTTP/1.1" 204 0
2026-03-26 22:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Ffcadf66ab3454a0995a338f9677b7830%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/fcadf66ab3454a0995a338f9677b7830/images/large/4.jpg not downloaded yet
2026-03-26 22:52:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/534ecb4ceff24743b4b207924efc67c9/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Ffcadf66ab3454a0995a338f9677b7830%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/fcadf66ab3454a0995a338f9677b7830/images/large/5.jpg not downloaded yet
2026-03-26 22:52:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7592ad0>
2026-03-26 22:52:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0aec5da-22aa-5563-bf01-bf7b6c9c5160/b0aec5da-22aa-5563-bf01-bf7b6c9c5160_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F534ecb4ceff24743b4b207924efc67c9%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/534ecb4ceff24743b4b207924efc67c9/images/large/2.jpg saved to cache
2026-03-26 22:52:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b0aec5da-22aa-5563-bf01-bf7b6c9c5160
2026-03-26 22:52:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c76910>
2026-03-26 22:52:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0aec5da-22aa-5563-bf01-bf7b6c9c5160/b0aec5da-22aa-5563-bf01-bf7b6c9c5160_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F534ecb4ceff24743b4b207924efc67c9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/534ecb4ceff24743b4b207924efc67c9/images/large/1.jpg saved to cache
2026-03-26 22:52:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b0aec5da-22aa-5563-bf01-bf7b6c9c5160
2026-03-26 22:52:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6da6e90>
2026-03-26 22:52:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0aec5da-22aa-5563-bf01-bf7b6c9c5160/b0aec5da-22aa-5563-bf01-bf7b6c9c5160_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F534ecb4ceff24743b4b207924efc67c9%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/534ecb4ceff24743b4b207924efc67c9/images/large/4.jpg saved to cache
2026-03-26 22:52:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b0aec5da-22aa-5563-bf01-bf7b6c9c5160
2026-03-26 22:52:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e1f690>
2026-03-26 22:52:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0aec5da-22aa-5563-bf01-bf7b6c9c5160/b0aec5da-22aa-5563-bf01-bf7b6c9c5160_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F534ecb4ceff24743b4b207924efc67c9%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/534ecb4ceff24743b4b207924efc67c9/images/large/3.jpg saved to cache
2026-03-26 22:52:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b0aec5da-22aa-5563-bf01-bf7b6c9c5160
2026-03-26 22:52:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/534ecb4ceff24743b4b207924efc67c9/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Ffcadf66ab3454a0995a338f9677b7830%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/fcadf66ab3454a0995a338f9677b7830/images/large/6.jpg not downloaded yet
2026-03-26 22:52:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/534ecb4ceff24743b4b207924efc67c9/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/534ecb4ceff24743b4b207924efc67c9/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Ffcadf66ab3454a0995a338f9677b7830%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/fcadf66ab3454a0995a338f9677b7830/images/large/7.jpg not downloaded yet
2026-03-26 22:52:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/534ecb4ceff24743b4b207924efc67c9/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/534ecb4ceff24743b4b207924efc67c9/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74af250>
2026-03-26 22:52:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0aec5da-22aa-5563-bf01-bf7b6c9c5160/b0aec5da-22aa-5563-bf01-bf7b6c9c5160_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F534ecb4ceff24743b4b207924efc67c9%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/534ecb4ceff24743b4b207924efc67c9/images/large/5.jpg saved to cache
2026-03-26 22:52:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b0aec5da-22aa-5563-bf01-bf7b6c9c5160
2026-03-26 22:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Ffcadf66ab3454a0995a338f9677b7830%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/fcadf66ab3454a0995a338f9677b7830/images/large/8.jpg not downloaded yet
2026-03-26 22:52:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/fcadf66ab3454a0995a338f9677b7830/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Ffcadf66ab3454a0995a338f9677b7830%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/fcadf66ab3454a0995a338f9677b7830/images/large/9.jpg not downloaded yet
2026-03-26 22:52:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7482c50>
2026-03-26 22:52:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0aec5da-22aa-5563-bf01-bf7b6c9c5160/b0aec5da-22aa-5563-bf01-bf7b6c9c5160_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F534ecb4ceff24743b4b207924efc67c9%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/534ecb4ceff24743b4b207924efc67c9/images/large/6.jpg saved to cache
2026-03-26 22:52:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b0aec5da-22aa-5563-bf01-bf7b6c9c5160
2026-03-26 22:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Ffcadf66ab3454a0995a338f9677b7830%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/fcadf66ab3454a0995a338f9677b7830/images/large/10.jpg not downloaded yet
2026-03-26 22:52:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7876c50>
2026-03-26 22:52:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0aec5da-22aa-5563-bf01-bf7b6c9c5160/b0aec5da-22aa-5563-bf01-bf7b6c9c5160_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F534ecb4ceff24743b4b207924efc67c9%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/534ecb4ceff24743b4b207924efc67c9/images/large/7.jpg saved to cache
2026-03-26 22:52:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b0aec5da-22aa-5563-bf01-bf7b6c9c5160
2026-03-26 22:52:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7290090>
2026-03-26 22:52:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0aec5da-22aa-5563-bf01-bf7b6c9c5160/b0aec5da-22aa-5563-bf01-bf7b6c9c5160_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F534ecb4ceff24743b4b207924efc67c9%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/534ecb4ceff24743b4b207924efc67c9/images/large/9.jpg saved to cache
2026-03-26 22:52:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b0aec5da-22aa-5563-bf01-bf7b6c9c5160
2026-03-26 22:52:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b75a6c90>
2026-03-26 22:52:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0aec5da-22aa-5563-bf01-bf7b6c9c5160/b0aec5da-22aa-5563-bf01-bf7b6c9c5160_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F534ecb4ceff24743b4b207924efc67c9%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/534ecb4ceff24743b4b207924efc67c9/images/large/8.jpg saved to cache
2026-03-26 22:52:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b0aec5da-22aa-5563-bf01-bf7b6c9c5160
2026-03-26 22:52:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6da4510>
2026-03-26 22:52:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0aec5da-22aa-5563-bf01-bf7b6c9c5160/b0aec5da-22aa-5563-bf01-bf7b6c9c5160_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F534ecb4ceff24743b4b207924efc67c9%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/534ecb4ceff24743b4b207924efc67c9/images/large/10.jpg saved to cache
2026-03-26 22:52:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b0aec5da-22aa-5563-bf01-bf7b6c9c5160
2026-03-26 22:52:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b0aec5da-22aa-5563-bf01-bf7b6c9c5160, skipping ID generation
2026-03-26 22:52:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0aec5da-22aa-5563-bf01-bf7b6c9c5160 with scrape type 1
2026-03-26 22:52:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b0aec5da-22aa-5563-bf01-bf7b6c9c5160 sending to next pipeline
2026-03-26 22:52:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b0aec5da-22aa-5563-bf01-bf7b6c9c5160, identifier: 1985464
2026-03-26 22:52:21 [ayvens.be] INFO: Found listing with ID: 1985466
2026-03-26 22:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985466%27 HTTP/1.1" 200 None
2026-03-26 22:52:21 [ayvens.be] INFO: Scrape type for 1985466: 1
2026-03-26 22:52:21 [ayvens.be] INFO: Extracting data for car ID: 1985466
2026-03-26 22:52:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a584356-5629-50b3-a6ac-7d347cf34300 with identifier: 1985466
2026-03-26 22:52:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a584356-5629-50b3-a6ac-7d347cf34300 with scrape type 1
2026-03-26 22:52:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3a584356-5629-50b3-a6ac-7d347cf34300
2026-03-26 22:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Feb72861554ad47099f75954485416c3b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/eb72861554ad47099f75954485416c3b/images/large/1.jpg not downloaded yet
2026-03-26 22:52:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b0aec5da-22aa-5563-bf01-bf7b6c9c5160 with identifier: 1985464
2026-03-26 22:52:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b0aec5da-22aa-5563-bf01-bf7b6c9c5160 with identifier: 1985464
2026-03-26 22:52:21 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b0aec5da-22aa-5563-bf01-bf7b6c9c5160 with identifier: 1985464 to the API
2026-03-26 22:52:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:52:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:52:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2be/534ecb4ceff24743b4b207924efc67c9/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'b0aec5da-22aa-5563-bf01-bf7b6c9c5160',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 83978,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0aec5da-22aa-5563-bf01-bf7b6c9c5160/b0aec5da-22aa-5563-bf01-bf7b6c9c5160_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 623358,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/534ecb4ceff24743b4b207924efc67c9/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0aec5da-22aa-5563-bf01-bf7b6c9c5160/b0aec5da-22aa-5563-bf01-bf7b6c9c5160_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 638929,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/534ecb4ceff24743b4b207924efc67c9/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0aec5da-22aa-5563-bf01-bf7b6c9c5160/b0aec5da-22aa-5563-bf01-bf7b6c9c5160_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 693059,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/534ecb4ceff24743b4b207924efc67c9/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0aec5da-22aa-5563-bf01-bf7b6c9c5160/b0aec5da-22aa-5563-bf01-bf7b6c9c5160_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 655781,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/534ecb4ceff24743b4b207924efc67c9/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0aec5da-22aa-5563-bf01-bf7b6c9c5160/b0aec5da-22aa-5563-bf01-bf7b6c9c5160_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 544556,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/534ecb4ceff24743b4b207924efc67c9/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0aec5da-22aa-5563-bf01-bf7b6c9c5160/b0aec5da-22aa-5563-bf01-bf7b6c9c5160_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 547477,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/534ecb4ceff24743b4b207924efc67c9/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0aec5da-22aa-5563-bf01-bf7b6c9c5160/b0aec5da-22aa-5563-bf01-bf7b6c9c5160_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 645655,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/534ecb4ceff24743b4b207924efc67c9/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0aec5da-22aa-5563-bf01-bf7b6c9c5160/b0aec5da-22aa-5563-bf01-bf7b6c9c5160_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 648896,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/534ecb4ceff24743b4b207924efc67c9/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0aec5da-22aa-5563-bf01-bf7b6c9c5160/b0aec5da-22aa-5563-bf01-bf7b6c9c5160_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 492962,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/534ecb4ceff24743b4b207924efc67c9/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0aec5da-22aa-5563-bf01-bf7b6c9c5160/b0aec5da-22aa-5563-bf01-bf7b6c9c5160_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 546569,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/534ecb4ceff24743b4b207924efc67c9/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T4 RECHARGE GEARTR. INSCRIPTION',
 'transmission': 'automatic',
 'trim': '1.5 T4 RECHARGE GEARTR. INSCRIPTION',
 'vin': None,
 'year': 2021}
2026-03-26 22:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985464%27 HTTP/1.1" 200 None
2026-03-26 22:52:21 [ayvens.be] INFO: Saving data for 1985464: {'created_time': 1774565541.448145, 'last_price_update_time': 1774565541.448157, 'auction_closing_time': 1774958400.0}
2026-03-26 22:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985464') HTTP/1.1" 204 0
2026-03-26 22:52:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/fcadf66ab3454a0995a338f9677b7830/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Feb72861554ad47099f75954485416c3b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/eb72861554ad47099f75954485416c3b/images/large/2.jpg not downloaded yet
2026-03-26 22:52:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b78c1b50>
2026-03-26 22:52:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3efe363-6c49-5207-84ad-6fdd8285a0ba/a3efe363-6c49-5207-84ad-6fdd8285a0ba_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Ffcadf66ab3454a0995a338f9677b7830%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/fcadf66ab3454a0995a338f9677b7830/images/large/1.jpg saved to cache
2026-03-26 22:52:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a3efe363-6c49-5207-84ad-6fdd8285a0ba
2026-03-26 22:52:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/fcadf66ab3454a0995a338f9677b7830/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Feb72861554ad47099f75954485416c3b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/eb72861554ad47099f75954485416c3b/images/large/3.jpg not downloaded yet
2026-03-26 22:52:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/fcadf66ab3454a0995a338f9677b7830/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Feb72861554ad47099f75954485416c3b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/eb72861554ad47099f75954485416c3b/images/large/4.jpg not downloaded yet
2026-03-26 22:52:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/fcadf66ab3454a0995a338f9677b7830/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b78c14d0>
2026-03-26 22:52:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3efe363-6c49-5207-84ad-6fdd8285a0ba/a3efe363-6c49-5207-84ad-6fdd8285a0ba_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Ffcadf66ab3454a0995a338f9677b7830%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/fcadf66ab3454a0995a338f9677b7830/images/large/2.jpg saved to cache
2026-03-26 22:52:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a3efe363-6c49-5207-84ad-6fdd8285a0ba
2026-03-26 22:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Feb72861554ad47099f75954485416c3b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/eb72861554ad47099f75954485416c3b/images/large/5.jpg not downloaded yet
2026-03-26 22:52:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/fcadf66ab3454a0995a338f9677b7830/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Feb72861554ad47099f75954485416c3b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/eb72861554ad47099f75954485416c3b/images/large/6.jpg not downloaded yet
2026-03-26 22:52:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/fcadf66ab3454a0995a338f9677b7830/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Feb72861554ad47099f75954485416c3b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/eb72861554ad47099f75954485416c3b/images/large/7.jpg not downloaded yet
2026-03-26 22:52:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79a3510>
2026-03-26 22:52:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3efe363-6c49-5207-84ad-6fdd8285a0ba/a3efe363-6c49-5207-84ad-6fdd8285a0ba_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Ffcadf66ab3454a0995a338f9677b7830%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/fcadf66ab3454a0995a338f9677b7830/images/large/3.jpg saved to cache
2026-03-26 22:52:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a3efe363-6c49-5207-84ad-6fdd8285a0ba
2026-03-26 22:52:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b787e3d0>
2026-03-26 22:52:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3efe363-6c49-5207-84ad-6fdd8285a0ba/a3efe363-6c49-5207-84ad-6fdd8285a0ba_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Ffcadf66ab3454a0995a338f9677b7830%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/fcadf66ab3454a0995a338f9677b7830/images/large/4.jpg saved to cache
2026-03-26 22:52:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a3efe363-6c49-5207-84ad-6fdd8285a0ba
2026-03-26 22:52:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/fcadf66ab3454a0995a338f9677b7830/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Feb72861554ad47099f75954485416c3b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/eb72861554ad47099f75954485416c3b/images/large/8.jpg not downloaded yet
2026-03-26 22:52:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74363d0>
2026-03-26 22:52:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3efe363-6c49-5207-84ad-6fdd8285a0ba/a3efe363-6c49-5207-84ad-6fdd8285a0ba_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Ffcadf66ab3454a0995a338f9677b7830%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/fcadf66ab3454a0995a338f9677b7830/images/large/7.jpg saved to cache
2026-03-26 22:52:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a3efe363-6c49-5207-84ad-6fdd8285a0ba
2026-03-26 22:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Feb72861554ad47099f75954485416c3b%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/eb72861554ad47099f75954485416c3b/images/large/9.jpg not downloaded yet
2026-03-26 22:52:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7caa0d0>
2026-03-26 22:52:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3efe363-6c49-5207-84ad-6fdd8285a0ba/a3efe363-6c49-5207-84ad-6fdd8285a0ba_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Ffcadf66ab3454a0995a338f9677b7830%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/fcadf66ab3454a0995a338f9677b7830/images/large/5.jpg saved to cache
2026-03-26 22:52:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a3efe363-6c49-5207-84ad-6fdd8285a0ba
2026-03-26 22:52:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b728f310>
2026-03-26 22:52:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3efe363-6c49-5207-84ad-6fdd8285a0ba/a3efe363-6c49-5207-84ad-6fdd8285a0ba_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Ffcadf66ab3454a0995a338f9677b7830%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/fcadf66ab3454a0995a338f9677b7830/images/large/6.jpg saved to cache
2026-03-26 22:52:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a3efe363-6c49-5207-84ad-6fdd8285a0ba
2026-03-26 22:52:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7426390>
2026-03-26 22:52:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3efe363-6c49-5207-84ad-6fdd8285a0ba/a3efe363-6c49-5207-84ad-6fdd8285a0ba_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Ffcadf66ab3454a0995a338f9677b7830%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/fcadf66ab3454a0995a338f9677b7830/images/large/8.jpg saved to cache
2026-03-26 22:52:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a3efe363-6c49-5207-84ad-6fdd8285a0ba
2026-03-26 22:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Feb72861554ad47099f75954485416c3b%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/eb72861554ad47099f75954485416c3b/images/large/10.jpg not downloaded yet
2026-03-26 22:52:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/fcadf66ab3454a0995a338f9677b7830/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/eb72861554ad47099f75954485416c3b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:22 [ayvens.be] INFO: Found listing with ID: 1985467
2026-03-26 22:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985467%27 HTTP/1.1" 200 None
2026-03-26 22:52:22 [ayvens.be] INFO: Scrape type for 1985467: 1
2026-03-26 22:52:22 [ayvens.be] INFO: Extracting data for car ID: 1985467
2026-03-26 22:52:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1633be65-fc75-5ecc-9ded-a75cce69d482 with identifier: 1985467
2026-03-26 22:52:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1633be65-fc75-5ecc-9ded-a75cce69d482 with scrape type 1
2026-03-26 22:52:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1633be65-fc75-5ecc-9ded-a75cce69d482
2026-03-26 22:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F8ac74823cd474d8e8b79bbd2fbef175c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/8ac74823cd474d8e8b79bbd2fbef175c/images/large/1.jpg not downloaded yet
2026-03-26 22:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F8ac74823cd474d8e8b79bbd2fbef175c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/8ac74823cd474d8e8b79bbd2fbef175c/images/large/2.jpg not downloaded yet
2026-03-26 22:52:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/eb72861554ad47099f75954485416c3b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/eb72861554ad47099f75954485416c3b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F8ac74823cd474d8e8b79bbd2fbef175c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/8ac74823cd474d8e8b79bbd2fbef175c/images/large/3.jpg not downloaded yet
2026-03-26 22:52:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/fcadf66ab3454a0995a338f9677b7830/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/eb72861554ad47099f75954485416c3b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/eb72861554ad47099f75954485416c3b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F8ac74823cd474d8e8b79bbd2fbef175c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/8ac74823cd474d8e8b79bbd2fbef175c/images/large/4.jpg not downloaded yet
2026-03-26 22:52:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/eb72861554ad47099f75954485416c3b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e11750>
2026-03-26 22:52:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3efe363-6c49-5207-84ad-6fdd8285a0ba/a3efe363-6c49-5207-84ad-6fdd8285a0ba_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Ffcadf66ab3454a0995a338f9677b7830%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/fcadf66ab3454a0995a338f9677b7830/images/large/9.jpg saved to cache
2026-03-26 22:52:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a3efe363-6c49-5207-84ad-6fdd8285a0ba
2026-03-26 22:52:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7495e90>
2026-03-26 22:52:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a584356-5629-50b3-a6ac-7d347cf34300/3a584356-5629-50b3-a6ac-7d347cf34300_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Feb72861554ad47099f75954485416c3b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/eb72861554ad47099f75954485416c3b/images/large/1.jpg saved to cache
2026-03-26 22:52:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3a584356-5629-50b3-a6ac-7d347cf34300
2026-03-26 22:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F8ac74823cd474d8e8b79bbd2fbef175c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/8ac74823cd474d8e8b79bbd2fbef175c/images/large/5.jpg not downloaded yet
2026-03-26 22:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F8ac74823cd474d8e8b79bbd2fbef175c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/8ac74823cd474d8e8b79bbd2fbef175c/images/large/6.jpg not downloaded yet
2026-03-26 22:52:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77d72d0>
2026-03-26 22:52:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a584356-5629-50b3-a6ac-7d347cf34300/3a584356-5629-50b3-a6ac-7d347cf34300_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Feb72861554ad47099f75954485416c3b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/eb72861554ad47099f75954485416c3b/images/large/2.jpg saved to cache
2026-03-26 22:52:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3a584356-5629-50b3-a6ac-7d347cf34300
2026-03-26 22:52:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b37390>
2026-03-26 22:52:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a584356-5629-50b3-a6ac-7d347cf34300/3a584356-5629-50b3-a6ac-7d347cf34300_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Feb72861554ad47099f75954485416c3b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/eb72861554ad47099f75954485416c3b/images/large/3.jpg saved to cache
2026-03-26 22:52:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3a584356-5629-50b3-a6ac-7d347cf34300
2026-03-26 22:52:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b373d0>
2026-03-26 22:52:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3efe363-6c49-5207-84ad-6fdd8285a0ba/a3efe363-6c49-5207-84ad-6fdd8285a0ba_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Ffcadf66ab3454a0995a338f9677b7830%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/fcadf66ab3454a0995a338f9677b7830/images/large/10.jpg saved to cache
2026-03-26 22:52:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a3efe363-6c49-5207-84ad-6fdd8285a0ba
2026-03-26 22:52:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a3efe363-6c49-5207-84ad-6fdd8285a0ba, skipping ID generation
2026-03-26 22:52:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3efe363-6c49-5207-84ad-6fdd8285a0ba with scrape type 1
2026-03-26 22:52:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a3efe363-6c49-5207-84ad-6fdd8285a0ba sending to next pipeline
2026-03-26 22:52:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a3efe363-6c49-5207-84ad-6fdd8285a0ba, identifier: 1985465
2026-03-26 22:52:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd0affd0>
2026-03-26 22:52:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a584356-5629-50b3-a6ac-7d347cf34300/3a584356-5629-50b3-a6ac-7d347cf34300_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Feb72861554ad47099f75954485416c3b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/eb72861554ad47099f75954485416c3b/images/large/4.jpg saved to cache
2026-03-26 22:52:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3a584356-5629-50b3-a6ac-7d347cf34300
2026-03-26 22:52:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b787e6d0>
2026-03-26 22:52:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a584356-5629-50b3-a6ac-7d347cf34300/3a584356-5629-50b3-a6ac-7d347cf34300_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Feb72861554ad47099f75954485416c3b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/eb72861554ad47099f75954485416c3b/images/large/5.jpg saved to cache
2026-03-26 22:52:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3a584356-5629-50b3-a6ac-7d347cf34300
2026-03-26 22:52:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79a3450>
2026-03-26 22:52:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a584356-5629-50b3-a6ac-7d347cf34300/3a584356-5629-50b3-a6ac-7d347cf34300_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Feb72861554ad47099f75954485416c3b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/eb72861554ad47099f75954485416c3b/images/large/6.jpg saved to cache
2026-03-26 22:52:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3a584356-5629-50b3-a6ac-7d347cf34300
2026-03-26 22:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F8ac74823cd474d8e8b79bbd2fbef175c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/8ac74823cd474d8e8b79bbd2fbef175c/images/large/7.jpg not downloaded yet
2026-03-26 22:52:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a3efe363-6c49-5207-84ad-6fdd8285a0ba with identifier: 1985465
2026-03-26 22:52:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a3efe363-6c49-5207-84ad-6fdd8285a0ba with identifier: 1985465
2026-03-26 22:52:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a3efe363-6c49-5207-84ad-6fdd8285a0ba with identifier: 1985465 to the API
2026-03-26 22:52:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:52:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:52:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cr/fcadf66ab3454a0995a338f9677b7830/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'a3efe363-6c49-5207-84ad-6fdd8285a0ba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '1 SERIES HATCH',
 'odometer': 83798,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3efe363-6c49-5207-84ad-6fdd8285a0ba/a3efe363-6c49-5207-84ad-6fdd8285a0ba_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 700316,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/fcadf66ab3454a0995a338f9677b7830/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3efe363-6c49-5207-84ad-6fdd8285a0ba/a3efe363-6c49-5207-84ad-6fdd8285a0ba_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 726078,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/fcadf66ab3454a0995a338f9677b7830/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3efe363-6c49-5207-84ad-6fdd8285a0ba/a3efe363-6c49-5207-84ad-6fdd8285a0ba_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 685690,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/fcadf66ab3454a0995a338f9677b7830/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3efe363-6c49-5207-84ad-6fdd8285a0ba/a3efe363-6c49-5207-84ad-6fdd8285a0ba_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 730871,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/fcadf66ab3454a0995a338f9677b7830/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3efe363-6c49-5207-84ad-6fdd8285a0ba/a3efe363-6c49-5207-84ad-6fdd8285a0ba_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 742727,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/fcadf66ab3454a0995a338f9677b7830/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3efe363-6c49-5207-84ad-6fdd8285a0ba/a3efe363-6c49-5207-84ad-6fdd8285a0ba_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 778915,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/fcadf66ab3454a0995a338f9677b7830/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3efe363-6c49-5207-84ad-6fdd8285a0ba/a3efe363-6c49-5207-84ad-6fdd8285a0ba_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 620992,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/fcadf66ab3454a0995a338f9677b7830/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3efe363-6c49-5207-84ad-6fdd8285a0ba/a3efe363-6c49-5207-84ad-6fdd8285a0ba_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 810637,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/fcadf66ab3454a0995a338f9677b7830/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3efe363-6c49-5207-84ad-6fdd8285a0ba/a3efe363-6c49-5207-84ad-6fdd8285a0ba_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 820470,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/fcadf66ab3454a0995a338f9677b7830/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3efe363-6c49-5207-84ad-6fdd8285a0ba/a3efe363-6c49-5207-84ad-6fdd8285a0ba_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 757850,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/fcadf66ab3454a0995a338f9677b7830/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1 SERIES HATCH 1.5 116D (85KW)',
 'transmission': 'manual',
 'trim': '1.5 116D (85KW)',
 'vin': None,
 'year': 2022}
2026-03-26 22:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985465%27 HTTP/1.1" 200 None
2026-03-26 22:52:23 [ayvens.be] INFO: Saving data for 1985465: {'created_time': 1774565543.920968, 'last_price_update_time': 1774565543.920979, 'auction_closing_time': 1774958400.0}
2026-03-26 22:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985465') HTTP/1.1" 204 0
2026-03-26 22:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F8ac74823cd474d8e8b79bbd2fbef175c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/8ac74823cd474d8e8b79bbd2fbef175c/images/large/8.jpg not downloaded yet
2026-03-26 22:52:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/eb72861554ad47099f75954485416c3b/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/eb72861554ad47099f75954485416c3b/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F8ac74823cd474d8e8b79bbd2fbef175c%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/8ac74823cd474d8e8b79bbd2fbef175c/images/large/9.jpg not downloaded yet
2026-03-26 22:52:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/eb72861554ad47099f75954485416c3b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F8ac74823cd474d8e8b79bbd2fbef175c%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/8ac74823cd474d8e8b79bbd2fbef175c/images/large/10.jpg not downloaded yet
2026-03-26 22:52:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/8ac74823cd474d8e8b79bbd2fbef175c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/eb72861554ad47099f75954485416c3b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:24 [ayvens.be] INFO: Found listing with ID: 1985468
2026-03-26 22:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985468%27 HTTP/1.1" 200 None
2026-03-26 22:52:24 [ayvens.be] INFO: Scrape type for 1985468: 1
2026-03-26 22:52:24 [ayvens.be] INFO: Extracting data for car ID: 1985468
2026-03-26 22:52:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 69645680-dd88-54d6-bb22-6e98fa48909c with identifier: 1985468
2026-03-26 22:52:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69645680-dd88-54d6-bb22-6e98fa48909c with scrape type 1
2026-03-26 22:52:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 69645680-dd88-54d6-bb22-6e98fa48909c
2026-03-26 22:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F741de07effc9430f9f217f21e1cdc130%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/741de07effc9430f9f217f21e1cdc130/images/large/1.jpg not downloaded yet
2026-03-26 22:52:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/8ac74823cd474d8e8b79bbd2fbef175c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F741de07effc9430f9f217f21e1cdc130%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/741de07effc9430f9f217f21e1cdc130/images/large/2.jpg not downloaded yet
2026-03-26 22:52:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/8ac74823cd474d8e8b79bbd2fbef175c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F741de07effc9430f9f217f21e1cdc130%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/741de07effc9430f9f217f21e1cdc130/images/large/3.jpg not downloaded yet
2026-03-26 22:52:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/8ac74823cd474d8e8b79bbd2fbef175c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F741de07effc9430f9f217f21e1cdc130%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/741de07effc9430f9f217f21e1cdc130/images/large/4.jpg not downloaded yet
2026-03-26 22:52:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76e0d10>
2026-03-26 22:52:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a584356-5629-50b3-a6ac-7d347cf34300/3a584356-5629-50b3-a6ac-7d347cf34300_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Feb72861554ad47099f75954485416c3b%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/eb72861554ad47099f75954485416c3b/images/large/10.jpg saved to cache
2026-03-26 22:52:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3a584356-5629-50b3-a6ac-7d347cf34300
2026-03-26 22:52:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76e0d90>
2026-03-26 22:52:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a584356-5629-50b3-a6ac-7d347cf34300/3a584356-5629-50b3-a6ac-7d347cf34300_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Feb72861554ad47099f75954485416c3b%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/eb72861554ad47099f75954485416c3b/images/large/9.jpg saved to cache
2026-03-26 22:52:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3a584356-5629-50b3-a6ac-7d347cf34300
2026-03-26 22:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F741de07effc9430f9f217f21e1cdc130%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/741de07effc9430f9f217f21e1cdc130/images/large/5.jpg not downloaded yet
2026-03-26 22:52:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b727cbd0>
2026-03-26 22:52:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a584356-5629-50b3-a6ac-7d347cf34300/3a584356-5629-50b3-a6ac-7d347cf34300_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Feb72861554ad47099f75954485416c3b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/eb72861554ad47099f75954485416c3b/images/large/7.jpg saved to cache
2026-03-26 22:52:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3a584356-5629-50b3-a6ac-7d347cf34300
2026-03-26 22:52:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7a62550>
2026-03-26 22:52:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1633be65-fc75-5ecc-9ded-a75cce69d482/1633be65-fc75-5ecc-9ded-a75cce69d482_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F8ac74823cd474d8e8b79bbd2fbef175c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/8ac74823cd474d8e8b79bbd2fbef175c/images/large/1.jpg saved to cache
2026-03-26 22:52:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1633be65-fc75-5ecc-9ded-a75cce69d482
2026-03-26 22:52:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7a572d0>
2026-03-26 22:52:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a584356-5629-50b3-a6ac-7d347cf34300/3a584356-5629-50b3-a6ac-7d347cf34300_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Feb72861554ad47099f75954485416c3b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/eb72861554ad47099f75954485416c3b/images/large/8.jpg saved to cache
2026-03-26 22:52:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3a584356-5629-50b3-a6ac-7d347cf34300
2026-03-26 22:52:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3a584356-5629-50b3-a6ac-7d347cf34300, skipping ID generation
2026-03-26 22:52:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a584356-5629-50b3-a6ac-7d347cf34300 with scrape type 1
2026-03-26 22:52:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3a584356-5629-50b3-a6ac-7d347cf34300 sending to next pipeline
2026-03-26 22:52:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 3a584356-5629-50b3-a6ac-7d347cf34300, identifier: 1985466
2026-03-26 22:52:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7ca8210>
2026-03-26 22:52:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1633be65-fc75-5ecc-9ded-a75cce69d482/1633be65-fc75-5ecc-9ded-a75cce69d482_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F8ac74823cd474d8e8b79bbd2fbef175c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/8ac74823cd474d8e8b79bbd2fbef175c/images/large/5.jpg saved to cache
2026-03-26 22:52:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1633be65-fc75-5ecc-9ded-a75cce69d482
2026-03-26 22:52:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c77350>
2026-03-26 22:52:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1633be65-fc75-5ecc-9ded-a75cce69d482/1633be65-fc75-5ecc-9ded-a75cce69d482_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F8ac74823cd474d8e8b79bbd2fbef175c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/8ac74823cd474d8e8b79bbd2fbef175c/images/large/3.jpg saved to cache
2026-03-26 22:52:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1633be65-fc75-5ecc-9ded-a75cce69d482
2026-03-26 22:52:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74a5b50>
2026-03-26 22:52:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1633be65-fc75-5ecc-9ded-a75cce69d482/1633be65-fc75-5ecc-9ded-a75cce69d482_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F8ac74823cd474d8e8b79bbd2fbef175c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/8ac74823cd474d8e8b79bbd2fbef175c/images/large/4.jpg saved to cache
2026-03-26 22:52:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1633be65-fc75-5ecc-9ded-a75cce69d482
2026-03-26 22:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F741de07effc9430f9f217f21e1cdc130%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/741de07effc9430f9f217f21e1cdc130/images/large/6.jpg not downloaded yet
2026-03-26 22:52:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 3a584356-5629-50b3-a6ac-7d347cf34300 with identifier: 1985466
2026-03-26 22:52:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 3a584356-5629-50b3-a6ac-7d347cf34300 with identifier: 1985466
2026-03-26 22:52:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 3a584356-5629-50b3-a6ac-7d347cf34300 with identifier: 1985466 to the API
2026-03-26 22:52:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:52:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:52:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bp/eb72861554ad47099f75954485416c3b/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '3a584356-5629-50b3-a6ac-7d347cf34300',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '3 SERIES TOURING',
 'odometer': 94794,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a584356-5629-50b3-a6ac-7d347cf34300/3a584356-5629-50b3-a6ac-7d347cf34300_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 710070,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/eb72861554ad47099f75954485416c3b/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a584356-5629-50b3-a6ac-7d347cf34300/3a584356-5629-50b3-a6ac-7d347cf34300_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 728198,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/eb72861554ad47099f75954485416c3b/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a584356-5629-50b3-a6ac-7d347cf34300/3a584356-5629-50b3-a6ac-7d347cf34300_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 698057,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/eb72861554ad47099f75954485416c3b/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a584356-5629-50b3-a6ac-7d347cf34300/3a584356-5629-50b3-a6ac-7d347cf34300_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 760846,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/eb72861554ad47099f75954485416c3b/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a584356-5629-50b3-a6ac-7d347cf34300/3a584356-5629-50b3-a6ac-7d347cf34300_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 549653,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/eb72861554ad47099f75954485416c3b/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a584356-5629-50b3-a6ac-7d347cf34300/3a584356-5629-50b3-a6ac-7d347cf34300_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 585058,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/eb72861554ad47099f75954485416c3b/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a584356-5629-50b3-a6ac-7d347cf34300/3a584356-5629-50b3-a6ac-7d347cf34300_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 632065,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/eb72861554ad47099f75954485416c3b/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a584356-5629-50b3-a6ac-7d347cf34300/3a584356-5629-50b3-a6ac-7d347cf34300_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 739517,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/eb72861554ad47099f75954485416c3b/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a584356-5629-50b3-a6ac-7d347cf34300/3a584356-5629-50b3-a6ac-7d347cf34300_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 471263,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/eb72861554ad47099f75954485416c3b/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a584356-5629-50b3-a6ac-7d347cf34300/3a584356-5629-50b3-a6ac-7d347cf34300_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 437888,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/eb72861554ad47099f75954485416c3b/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3 SERIES TOURING 2.0 330E (215KW) TOURING',
 'transmission': 'automatic',
 'trim': '2.0 330E (215KW) TOURING',
 'vin': None,
 'year': 2022}
2026-03-26 22:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985466%27 HTTP/1.1" 200 None
2026-03-26 22:52:25 [ayvens.be] INFO: Saving data for 1985466: {'created_time': 1774565545.318801, 'last_price_update_time': 1774565545.31881, 'auction_closing_time': 1774958400.0}
2026-03-26 22:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985466') HTTP/1.1" 204 0
2026-03-26 22:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F741de07effc9430f9f217f21e1cdc130%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/741de07effc9430f9f217f21e1cdc130/images/large/7.jpg not downloaded yet
2026-03-26 22:52:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/8ac74823cd474d8e8b79bbd2fbef175c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/8ac74823cd474d8e8b79bbd2fbef175c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F741de07effc9430f9f217f21e1cdc130%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/741de07effc9430f9f217f21e1cdc130/images/large/8.jpg not downloaded yet
2026-03-26 22:52:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/8ac74823cd474d8e8b79bbd2fbef175c/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/8ac74823cd474d8e8b79bbd2fbef175c/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F741de07effc9430f9f217f21e1cdc130%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/741de07effc9430f9f217f21e1cdc130/images/large/9.jpg not downloaded yet
2026-03-26 22:52:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/8ac74823cd474d8e8b79bbd2fbef175c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/741de07effc9430f9f217f21e1cdc130/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/8ac74823cd474d8e8b79bbd2fbef175c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F741de07effc9430f9f217f21e1cdc130%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/741de07effc9430f9f217f21e1cdc130/images/large/10.jpg not downloaded yet
2026-03-26 22:52:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/741de07effc9430f9f217f21e1cdc130/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:25 [ayvens.be] INFO: Found listing with ID: 1985469
2026-03-26 22:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985469%27 HTTP/1.1" 200 None
2026-03-26 22:52:25 [ayvens.be] INFO: Scrape type for 1985469: 1
2026-03-26 22:52:25 [ayvens.be] INFO: Extracting data for car ID: 1985469
2026-03-26 22:52:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8580ac67-a34c-5f62-8fe2-1d5c6cfeef19 with identifier: 1985469
2026-03-26 22:52:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8580ac67-a34c-5f62-8fe2-1d5c6cfeef19 with scrape type 1
2026-03-26 22:52:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8580ac67-a34c-5f62-8fe2-1d5c6cfeef19
2026-03-26 22:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252F7ebb6e60fd414249bf43cc98f43f9919%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/7ebb6e60fd414249bf43cc98f43f9919/images/large/1.jpg not downloaded yet
2026-03-26 22:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252F7ebb6e60fd414249bf43cc98f43f9919%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/7ebb6e60fd414249bf43cc98f43f9919/images/large/2.jpg not downloaded yet
2026-03-26 22:52:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7437f90>
2026-03-26 22:52:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1633be65-fc75-5ecc-9ded-a75cce69d482/1633be65-fc75-5ecc-9ded-a75cce69d482_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F8ac74823cd474d8e8b79bbd2fbef175c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/8ac74823cd474d8e8b79bbd2fbef175c/images/large/6.jpg saved to cache
2026-03-26 22:52:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1633be65-fc75-5ecc-9ded-a75cce69d482
2026-03-26 22:52:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77d4fd0>
2026-03-26 22:52:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1633be65-fc75-5ecc-9ded-a75cce69d482/1633be65-fc75-5ecc-9ded-a75cce69d482_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F8ac74823cd474d8e8b79bbd2fbef175c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/8ac74823cd474d8e8b79bbd2fbef175c/images/large/2.jpg saved to cache
2026-03-26 22:52:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1633be65-fc75-5ecc-9ded-a75cce69d482
2026-03-26 22:52:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76c4c10>
2026-03-26 22:52:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1633be65-fc75-5ecc-9ded-a75cce69d482/1633be65-fc75-5ecc-9ded-a75cce69d482_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F8ac74823cd474d8e8b79bbd2fbef175c%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/8ac74823cd474d8e8b79bbd2fbef175c/images/large/10.jpg saved to cache
2026-03-26 22:52:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1633be65-fc75-5ecc-9ded-a75cce69d482
2026-03-26 22:52:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e13550>
2026-03-26 22:52:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1633be65-fc75-5ecc-9ded-a75cce69d482/1633be65-fc75-5ecc-9ded-a75cce69d482_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F8ac74823cd474d8e8b79bbd2fbef175c%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/8ac74823cd474d8e8b79bbd2fbef175c/images/large/9.jpg saved to cache
2026-03-26 22:52:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1633be65-fc75-5ecc-9ded-a75cce69d482
2026-03-26 22:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252F7ebb6e60fd414249bf43cc98f43f9919%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/7ebb6e60fd414249bf43cc98f43f9919/images/large/3.jpg not downloaded yet
2026-03-26 22:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252F7ebb6e60fd414249bf43cc98f43f9919%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/7ebb6e60fd414249bf43cc98f43f9919/images/large/4.jpg not downloaded yet
2026-03-26 22:52:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd234050>
2026-03-26 22:52:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1633be65-fc75-5ecc-9ded-a75cce69d482/1633be65-fc75-5ecc-9ded-a75cce69d482_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F8ac74823cd474d8e8b79bbd2fbef175c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/8ac74823cd474d8e8b79bbd2fbef175c/images/large/8.jpg saved to cache
2026-03-26 22:52:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1633be65-fc75-5ecc-9ded-a75cce69d482
2026-03-26 22:52:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77d7590>
2026-03-26 22:52:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69645680-dd88-54d6-bb22-6e98fa48909c/69645680-dd88-54d6-bb22-6e98fa48909c_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F741de07effc9430f9f217f21e1cdc130%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/741de07effc9430f9f217f21e1cdc130/images/large/1.jpg saved to cache
2026-03-26 22:52:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 69645680-dd88-54d6-bb22-6e98fa48909c
2026-03-26 22:52:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74a4390>
2026-03-26 22:52:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1633be65-fc75-5ecc-9ded-a75cce69d482/1633be65-fc75-5ecc-9ded-a75cce69d482_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F8ac74823cd474d8e8b79bbd2fbef175c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/8ac74823cd474d8e8b79bbd2fbef175c/images/large/7.jpg saved to cache
2026-03-26 22:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1633be65-fc75-5ecc-9ded-a75cce69d482
2026-03-26 22:52:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1633be65-fc75-5ecc-9ded-a75cce69d482, skipping ID generation
2026-03-26 22:52:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1633be65-fc75-5ecc-9ded-a75cce69d482 with scrape type 1
2026-03-26 22:52:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1633be65-fc75-5ecc-9ded-a75cce69d482 sending to next pipeline
2026-03-26 22:52:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 1633be65-fc75-5ecc-9ded-a75cce69d482, identifier: 1985467
2026-03-26 22:52:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77cbdd0>
2026-03-26 22:52:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69645680-dd88-54d6-bb22-6e98fa48909c/69645680-dd88-54d6-bb22-6e98fa48909c_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F741de07effc9430f9f217f21e1cdc130%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/741de07effc9430f9f217f21e1cdc130/images/large/2.jpg saved to cache
2026-03-26 22:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 69645680-dd88-54d6-bb22-6e98fa48909c
2026-03-26 22:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252F7ebb6e60fd414249bf43cc98f43f9919%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/7ebb6e60fd414249bf43cc98f43f9919/images/large/5.jpg not downloaded yet
2026-03-26 22:52:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 1633be65-fc75-5ecc-9ded-a75cce69d482 with identifier: 1985467
2026-03-26 22:52:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 1633be65-fc75-5ecc-9ded-a75cce69d482 with identifier: 1985467
2026-03-26 22:52:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 1633be65-fc75-5ecc-9ded-a75cce69d482 with identifier: 1985467 to the API
2026-03-26 22:52:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:52:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:52:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bp/8ac74823cd474d8e8b79bbd2fbef175c/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '1633be65-fc75-5ecc-9ded-a75cce69d482',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLC',
 'odometer': 82439,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1633be65-fc75-5ecc-9ded-a75cce69d482/1633be65-fc75-5ecc-9ded-a75cce69d482_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 705953,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/8ac74823cd474d8e8b79bbd2fbef175c/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1633be65-fc75-5ecc-9ded-a75cce69d482/1633be65-fc75-5ecc-9ded-a75cce69d482_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 724257,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/8ac74823cd474d8e8b79bbd2fbef175c/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1633be65-fc75-5ecc-9ded-a75cce69d482/1633be65-fc75-5ecc-9ded-a75cce69d482_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 636385,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/8ac74823cd474d8e8b79bbd2fbef175c/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1633be65-fc75-5ecc-9ded-a75cce69d482/1633be65-fc75-5ecc-9ded-a75cce69d482_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 781973,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/8ac74823cd474d8e8b79bbd2fbef175c/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1633be65-fc75-5ecc-9ded-a75cce69d482/1633be65-fc75-5ecc-9ded-a75cce69d482_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 581384,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/8ac74823cd474d8e8b79bbd2fbef175c/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1633be65-fc75-5ecc-9ded-a75cce69d482/1633be65-fc75-5ecc-9ded-a75cce69d482_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 596466,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/8ac74823cd474d8e8b79bbd2fbef175c/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1633be65-fc75-5ecc-9ded-a75cce69d482/1633be65-fc75-5ecc-9ded-a75cce69d482_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 694674,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/8ac74823cd474d8e8b79bbd2fbef175c/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1633be65-fc75-5ecc-9ded-a75cce69d482/1633be65-fc75-5ecc-9ded-a75cce69d482_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 766306,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/8ac74823cd474d8e8b79bbd2fbef175c/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1633be65-fc75-5ecc-9ded-a75cce69d482/1633be65-fc75-5ecc-9ded-a75cce69d482_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 577488,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/8ac74823cd474d8e8b79bbd2fbef175c/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1633be65-fc75-5ecc-9ded-a75cce69d482/1633be65-fc75-5ecc-9ded-a75cce69d482_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 522342,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/8ac74823cd474d8e8b79bbd2fbef175c/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLC 2.0 GLC 300 DE 4MATIC 4WD BUS SOL AUTO',
 'transmission': 'automatic',
 'trim': '2.0 GLC 300 DE 4MATIC 4WD BUS SOL AUTO',
 'vin': None,
 'year': 2022}
2026-03-26 22:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985467%27 HTTP/1.1" 200 None
2026-03-26 22:52:26 [ayvens.be] INFO: Saving data for 1985467: {'created_time': 1774565546.581144, 'last_price_update_time': 1774565546.581153, 'auction_closing_time': 1774958400.0}
2026-03-26 22:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985467') HTTP/1.1" 204 0
2026-03-26 22:52:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/741de07effc9430f9f217f21e1cdc130/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252F7ebb6e60fd414249bf43cc98f43f9919%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/7ebb6e60fd414249bf43cc98f43f9919/images/large/6.jpg not downloaded yet
2026-03-26 22:52:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/741de07effc9430f9f217f21e1cdc130/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/741de07effc9430f9f217f21e1cdc130/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/741de07effc9430f9f217f21e1cdc130/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/741de07effc9430f9f217f21e1cdc130/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/741de07effc9430f9f217f21e1cdc130/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252F7ebb6e60fd414249bf43cc98f43f9919%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/7ebb6e60fd414249bf43cc98f43f9919/images/large/7.jpg not downloaded yet
2026-03-26 22:52:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/741de07effc9430f9f217f21e1cdc130/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252F7ebb6e60fd414249bf43cc98f43f9919%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/7ebb6e60fd414249bf43cc98f43f9919/images/large/8.jpg not downloaded yet
2026-03-26 22:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252F7ebb6e60fd414249bf43cc98f43f9919%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/7ebb6e60fd414249bf43cc98f43f9919/images/large/9.jpg not downloaded yet
2026-03-26 22:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252F7ebb6e60fd414249bf43cc98f43f9919%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/7ebb6e60fd414249bf43cc98f43f9919/images/large/10.jpg not downloaded yet
2026-03-26 22:52:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xv/7ebb6e60fd414249bf43cc98f43f9919/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:26 [ayvens.be] INFO: Found listing with ID: 1985470
2026-03-26 22:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985470%27 HTTP/1.1" 200 None
2026-03-26 22:52:26 [ayvens.be] INFO: Scrape type for 1985470: 1
2026-03-26 22:52:26 [ayvens.be] INFO: Extracting data for car ID: 1985470
2026-03-26 22:52:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b18b9c8-f038-5154-8774-01efdde72620 with identifier: 1985470
2026-03-26 22:52:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b18b9c8-f038-5154-8774-01efdde72620 with scrape type 1
2026-03-26 22:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2b18b9c8-f038-5154-8774-01efdde72620
2026-03-26 22:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F8b21b4ae115946169f7234e9283e3969%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/8b21b4ae115946169f7234e9283e3969/images/large/1.jpg not downloaded yet
2026-03-26 22:52:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7490d50>
2026-03-26 22:52:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69645680-dd88-54d6-bb22-6e98fa48909c/69645680-dd88-54d6-bb22-6e98fa48909c_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F741de07effc9430f9f217f21e1cdc130%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/741de07effc9430f9f217f21e1cdc130/images/large/5.jpg saved to cache
2026-03-26 22:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 69645680-dd88-54d6-bb22-6e98fa48909c
2026-03-26 22:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F8b21b4ae115946169f7234e9283e3969%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/8b21b4ae115946169f7234e9283e3969/images/large/2.jpg not downloaded yet
2026-03-26 22:52:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5ca7a10>
2026-03-26 22:52:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69645680-dd88-54d6-bb22-6e98fa48909c/69645680-dd88-54d6-bb22-6e98fa48909c_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F741de07effc9430f9f217f21e1cdc130%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/741de07effc9430f9f217f21e1cdc130/images/large/3.jpg saved to cache
2026-03-26 22:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 69645680-dd88-54d6-bb22-6e98fa48909c
2026-03-26 22:52:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e354d0>
2026-03-26 22:52:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69645680-dd88-54d6-bb22-6e98fa48909c/69645680-dd88-54d6-bb22-6e98fa48909c_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F741de07effc9430f9f217f21e1cdc130%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/741de07effc9430f9f217f21e1cdc130/images/large/4.jpg saved to cache
2026-03-26 22:52:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 69645680-dd88-54d6-bb22-6e98fa48909c
2026-03-26 22:52:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e2a650>
2026-03-26 22:52:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69645680-dd88-54d6-bb22-6e98fa48909c/69645680-dd88-54d6-bb22-6e98fa48909c_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F741de07effc9430f9f217f21e1cdc130%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/741de07effc9430f9f217f21e1cdc130/images/large/7.jpg saved to cache
2026-03-26 22:52:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 69645680-dd88-54d6-bb22-6e98fa48909c
2026-03-26 22:52:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7493790>
2026-03-26 22:52:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69645680-dd88-54d6-bb22-6e98fa48909c/69645680-dd88-54d6-bb22-6e98fa48909c_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F741de07effc9430f9f217f21e1cdc130%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/741de07effc9430f9f217f21e1cdc130/images/large/9.jpg saved to cache
2026-03-26 22:52:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 69645680-dd88-54d6-bb22-6e98fa48909c
2026-03-26 22:52:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76cd390>
2026-03-26 22:52:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69645680-dd88-54d6-bb22-6e98fa48909c/69645680-dd88-54d6-bb22-6e98fa48909c_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F741de07effc9430f9f217f21e1cdc130%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/741de07effc9430f9f217f21e1cdc130/images/large/6.jpg saved to cache
2026-03-26 22:52:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 69645680-dd88-54d6-bb22-6e98fa48909c
2026-03-26 22:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F8b21b4ae115946169f7234e9283e3969%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/8b21b4ae115946169f7234e9283e3969/images/large/3.jpg not downloaded yet
2026-03-26 22:52:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xv/7ebb6e60fd414249bf43cc98f43f9919/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F8b21b4ae115946169f7234e9283e3969%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/8b21b4ae115946169f7234e9283e3969/images/large/4.jpg not downloaded yet
2026-03-26 22:52:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b727d590>
2026-03-26 22:52:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69645680-dd88-54d6-bb22-6e98fa48909c/69645680-dd88-54d6-bb22-6e98fa48909c_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F741de07effc9430f9f217f21e1cdc130%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/741de07effc9430f9f217f21e1cdc130/images/large/8.jpg saved to cache
2026-03-26 22:52:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 69645680-dd88-54d6-bb22-6e98fa48909c
2026-03-26 22:52:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7746710>
2026-03-26 22:52:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8580ac67-a34c-5f62-8fe2-1d5c6cfeef19/8580ac67-a34c-5f62-8fe2-1d5c6cfeef19_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252F7ebb6e60fd414249bf43cc98f43f9919%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/7ebb6e60fd414249bf43cc98f43f9919/images/large/3.jpg saved to cache
2026-03-26 22:52:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8580ac67-a34c-5f62-8fe2-1d5c6cfeef19
2026-03-26 22:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F8b21b4ae115946169f7234e9283e3969%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/8b21b4ae115946169f7234e9283e3969/images/large/5.jpg not downloaded yet
2026-03-26 22:52:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xv/7ebb6e60fd414249bf43cc98f43f9919/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/741de07effc9430f9f217f21e1cdc130/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xv/7ebb6e60fd414249bf43cc98f43f9919/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F8b21b4ae115946169f7234e9283e3969%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/8b21b4ae115946169f7234e9283e3969/images/large/6.jpg not downloaded yet
2026-03-26 22:52:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xv/7ebb6e60fd414249bf43cc98f43f9919/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7745d90>
2026-03-26 22:52:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8580ac67-a34c-5f62-8fe2-1d5c6cfeef19/8580ac67-a34c-5f62-8fe2-1d5c6cfeef19_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252F7ebb6e60fd414249bf43cc98f43f9919%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/7ebb6e60fd414249bf43cc98f43f9919/images/large/2.jpg saved to cache
2026-03-26 22:52:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8580ac67-a34c-5f62-8fe2-1d5c6cfeef19
2026-03-26 22:52:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xv/7ebb6e60fd414249bf43cc98f43f9919/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xv/7ebb6e60fd414249bf43cc98f43f9919/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F8b21b4ae115946169f7234e9283e3969%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/8b21b4ae115946169f7234e9283e3969/images/large/7.jpg not downloaded yet
2026-03-26 22:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F8b21b4ae115946169f7234e9283e3969%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/8b21b4ae115946169f7234e9283e3969/images/large/8.jpg not downloaded yet
2026-03-26 22:52:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xv/7ebb6e60fd414249bf43cc98f43f9919/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F8b21b4ae115946169f7234e9283e3969%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/8b21b4ae115946169f7234e9283e3969/images/large/9.jpg not downloaded yet
2026-03-26 22:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F8b21b4ae115946169f7234e9283e3969%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/8b21b4ae115946169f7234e9283e3969/images/large/10.jpg not downloaded yet
2026-03-26 22:52:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76c55d0>
2026-03-26 22:52:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8580ac67-a34c-5f62-8fe2-1d5c6cfeef19/8580ac67-a34c-5f62-8fe2-1d5c6cfeef19_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252F7ebb6e60fd414249bf43cc98f43f9919%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/7ebb6e60fd414249bf43cc98f43f9919/images/large/1.jpg saved to cache
2026-03-26 22:52:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8580ac67-a34c-5f62-8fe2-1d5c6cfeef19
2026-03-26 22:52:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7480c50>
2026-03-26 22:52:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69645680-dd88-54d6-bb22-6e98fa48909c/69645680-dd88-54d6-bb22-6e98fa48909c_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F741de07effc9430f9f217f21e1cdc130%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/741de07effc9430f9f217f21e1cdc130/images/large/10.jpg saved to cache
2026-03-26 22:52:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 69645680-dd88-54d6-bb22-6e98fa48909c
2026-03-26 22:52:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 69645680-dd88-54d6-bb22-6e98fa48909c, skipping ID generation
2026-03-26 22:52:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69645680-dd88-54d6-bb22-6e98fa48909c with scrape type 1
2026-03-26 22:52:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 69645680-dd88-54d6-bb22-6e98fa48909c sending to next pipeline
2026-03-26 22:52:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 69645680-dd88-54d6-bb22-6e98fa48909c, identifier: 1985468
2026-03-26 22:52:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77731d0>
2026-03-26 22:52:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8580ac67-a34c-5f62-8fe2-1d5c6cfeef19/8580ac67-a34c-5f62-8fe2-1d5c6cfeef19_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252F7ebb6e60fd414249bf43cc98f43f9919%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/7ebb6e60fd414249bf43cc98f43f9919/images/large/5.jpg saved to cache
2026-03-26 22:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8580ac67-a34c-5f62-8fe2-1d5c6cfeef19
2026-03-26 22:52:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 69645680-dd88-54d6-bb22-6e98fa48909c with identifier: 1985468
2026-03-26 22:52:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 69645680-dd88-54d6-bb22-6e98fa48909c with identifier: 1985468
2026-03-26 22:52:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 69645680-dd88-54d6-bb22-6e98fa48909c with identifier: 1985468 to the API
2026-03-26 22:52:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:52:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:52:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ct/741de07effc9430f9f217f21e1cdc130/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '69645680-dd88-54d6-bb22-6e98fa48909c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '5 SERIES BERLINE',
 'odometer': 98878,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69645680-dd88-54d6-bb22-6e98fa48909c/69645680-dd88-54d6-bb22-6e98fa48909c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 631455,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/741de07effc9430f9f217f21e1cdc130/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69645680-dd88-54d6-bb22-6e98fa48909c/69645680-dd88-54d6-bb22-6e98fa48909c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 623318,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/741de07effc9430f9f217f21e1cdc130/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69645680-dd88-54d6-bb22-6e98fa48909c/69645680-dd88-54d6-bb22-6e98fa48909c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 613373,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/741de07effc9430f9f217f21e1cdc130/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69645680-dd88-54d6-bb22-6e98fa48909c/69645680-dd88-54d6-bb22-6e98fa48909c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 655409,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/741de07effc9430f9f217f21e1cdc130/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69645680-dd88-54d6-bb22-6e98fa48909c/69645680-dd88-54d6-bb22-6e98fa48909c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 686226,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/741de07effc9430f9f217f21e1cdc130/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69645680-dd88-54d6-bb22-6e98fa48909c/69645680-dd88-54d6-bb22-6e98fa48909c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 593084,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/741de07effc9430f9f217f21e1cdc130/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69645680-dd88-54d6-bb22-6e98fa48909c/69645680-dd88-54d6-bb22-6e98fa48909c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 671228,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/741de07effc9430f9f217f21e1cdc130/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69645680-dd88-54d6-bb22-6e98fa48909c/69645680-dd88-54d6-bb22-6e98fa48909c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 681777,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/741de07effc9430f9f217f21e1cdc130/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69645680-dd88-54d6-bb22-6e98fa48909c/69645680-dd88-54d6-bb22-6e98fa48909c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 590764,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/741de07effc9430f9f217f21e1cdc130/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69645680-dd88-54d6-bb22-6e98fa48909c/69645680-dd88-54d6-bb22-6e98fa48909c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 579025,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/741de07effc9430f9f217f21e1cdc130/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 5 SERIES BERLINE 2.0 530E 200KW XDRIVE AUTO',
 'transmission': 'automatic',
 'trim': '2.0 530E 200KW XDRIVE AUTO',
 'vin': None,
 'year': 2022}
2026-03-26 22:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985468%27 HTTP/1.1" 200 None
2026-03-26 22:52:28 [ayvens.be] INFO: Saving data for 1985468: {'created_time': 1774565548.411986, 'last_price_update_time': 1774565548.411996, 'auction_closing_time': 1774958400.0}
2026-03-26 22:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985468') HTTP/1.1" 204 0
2026-03-26 22:52:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xv/7ebb6e60fd414249bf43cc98f43f9919/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:28 [ayvens.be] INFO: Found listing with ID: 1985471
2026-03-26 22:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985471%27 HTTP/1.1" 200 None
2026-03-26 22:52:28 [ayvens.be] INFO: Scrape type for 1985471: 1
2026-03-26 22:52:28 [ayvens.be] INFO: Extracting data for car ID: 1985471
2026-03-26 22:52:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 91c64d60-2a63-590b-be74-1f96dd9673c1 with identifier: 1985471
2026-03-26 22:52:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91c64d60-2a63-590b-be74-1f96dd9673c1 with scrape type 1
2026-03-26 22:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 91c64d60-2a63-590b-be74-1f96dd9673c1
2026-03-26 22:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F5129fa050b474cbebc96b524edc7a837%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/5129fa050b474cbebc96b524edc7a837/images/large/1.jpg not downloaded yet
2026-03-26 22:52:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b788d050>
2026-03-26 22:52:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8580ac67-a34c-5f62-8fe2-1d5c6cfeef19/8580ac67-a34c-5f62-8fe2-1d5c6cfeef19_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252F7ebb6e60fd414249bf43cc98f43f9919%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/7ebb6e60fd414249bf43cc98f43f9919/images/large/4.jpg saved to cache
2026-03-26 22:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8580ac67-a34c-5f62-8fe2-1d5c6cfeef19
2026-03-26 22:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F5129fa050b474cbebc96b524edc7a837%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/5129fa050b474cbebc96b524edc7a837/images/large/2.jpg not downloaded yet
2026-03-26 22:52:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7495a50>
2026-03-26 22:52:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8580ac67-a34c-5f62-8fe2-1d5c6cfeef19/8580ac67-a34c-5f62-8fe2-1d5c6cfeef19_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252F7ebb6e60fd414249bf43cc98f43f9919%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/7ebb6e60fd414249bf43cc98f43f9919/images/large/6.jpg saved to cache
2026-03-26 22:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8580ac67-a34c-5f62-8fe2-1d5c6cfeef19
2026-03-26 22:52:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c74590>
2026-03-26 22:52:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8580ac67-a34c-5f62-8fe2-1d5c6cfeef19/8580ac67-a34c-5f62-8fe2-1d5c6cfeef19_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252F7ebb6e60fd414249bf43cc98f43f9919%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/7ebb6e60fd414249bf43cc98f43f9919/images/large/7.jpg saved to cache
2026-03-26 22:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8580ac67-a34c-5f62-8fe2-1d5c6cfeef19
2026-03-26 22:52:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76e0ad0>
2026-03-26 22:52:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8580ac67-a34c-5f62-8fe2-1d5c6cfeef19/8580ac67-a34c-5f62-8fe2-1d5c6cfeef19_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252F7ebb6e60fd414249bf43cc98f43f9919%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/7ebb6e60fd414249bf43cc98f43f9919/images/large/8.jpg saved to cache
2026-03-26 22:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8580ac67-a34c-5f62-8fe2-1d5c6cfeef19
2026-03-26 22:52:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74801d0>
2026-03-26 22:52:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8580ac67-a34c-5f62-8fe2-1d5c6cfeef19/8580ac67-a34c-5f62-8fe2-1d5c6cfeef19_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252F7ebb6e60fd414249bf43cc98f43f9919%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/7ebb6e60fd414249bf43cc98f43f9919/images/large/9.jpg saved to cache
2026-03-26 22:52:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8580ac67-a34c-5f62-8fe2-1d5c6cfeef19
2026-03-26 22:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F5129fa050b474cbebc96b524edc7a837%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/5129fa050b474cbebc96b524edc7a837/images/large/3.jpg not downloaded yet
2026-03-26 22:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F5129fa050b474cbebc96b524edc7a837%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/5129fa050b474cbebc96b524edc7a837/images/large/4.jpg not downloaded yet
2026-03-26 22:52:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/8b21b4ae115946169f7234e9283e3969/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/8b21b4ae115946169f7234e9283e3969/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xv/7ebb6e60fd414249bf43cc98f43f9919/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F5129fa050b474cbebc96b524edc7a837%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/5129fa050b474cbebc96b524edc7a837/images/large/5.jpg not downloaded yet
2026-03-26 22:52:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/8b21b4ae115946169f7234e9283e3969/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/8b21b4ae115946169f7234e9283e3969/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/8b21b4ae115946169f7234e9283e3969/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F5129fa050b474cbebc96b524edc7a837%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/5129fa050b474cbebc96b524edc7a837/images/large/6.jpg not downloaded yet
2026-03-26 22:52:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/8b21b4ae115946169f7234e9283e3969/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F5129fa050b474cbebc96b524edc7a837%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/5129fa050b474cbebc96b524edc7a837/images/large/7.jpg not downloaded yet
2026-03-26 22:52:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/8b21b4ae115946169f7234e9283e3969/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F5129fa050b474cbebc96b524edc7a837%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/5129fa050b474cbebc96b524edc7a837/images/large/8.jpg not downloaded yet
2026-03-26 22:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F5129fa050b474cbebc96b524edc7a837%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/5129fa050b474cbebc96b524edc7a837/images/large/9.jpg not downloaded yet
2026-03-26 22:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F5129fa050b474cbebc96b524edc7a837%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/5129fa050b474cbebc96b524edc7a837/images/large/10.jpg not downloaded yet
2026-03-26 22:52:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b741c750>
2026-03-26 22:52:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b18b9c8-f038-5154-8774-01efdde72620/2b18b9c8-f038-5154-8774-01efdde72620_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F8b21b4ae115946169f7234e9283e3969%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/8b21b4ae115946169f7234e9283e3969/images/large/2.jpg saved to cache
2026-03-26 22:52:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2b18b9c8-f038-5154-8774-01efdde72620
2026-03-26 22:52:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cc3dd0>
2026-03-26 22:52:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b18b9c8-f038-5154-8774-01efdde72620/2b18b9c8-f038-5154-8774-01efdde72620_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F8b21b4ae115946169f7234e9283e3969%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/8b21b4ae115946169f7234e9283e3969/images/large/3.jpg saved to cache
2026-03-26 22:52:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2b18b9c8-f038-5154-8774-01efdde72620
2026-03-26 22:52:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79a7e50>
2026-03-26 22:52:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8580ac67-a34c-5f62-8fe2-1d5c6cfeef19/8580ac67-a34c-5f62-8fe2-1d5c6cfeef19_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252F7ebb6e60fd414249bf43cc98f43f9919%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/7ebb6e60fd414249bf43cc98f43f9919/images/large/10.jpg saved to cache
2026-03-26 22:52:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8580ac67-a34c-5f62-8fe2-1d5c6cfeef19
2026-03-26 22:52:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8580ac67-a34c-5f62-8fe2-1d5c6cfeef19, skipping ID generation
2026-03-26 22:52:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8580ac67-a34c-5f62-8fe2-1d5c6cfeef19 with scrape type 1
2026-03-26 22:52:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8580ac67-a34c-5f62-8fe2-1d5c6cfeef19 sending to next pipeline
2026-03-26 22:52:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 8580ac67-a34c-5f62-8fe2-1d5c6cfeef19, identifier: 1985469
2026-03-26 22:52:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd758310>
2026-03-26 22:52:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b18b9c8-f038-5154-8774-01efdde72620/2b18b9c8-f038-5154-8774-01efdde72620_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F8b21b4ae115946169f7234e9283e3969%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/8b21b4ae115946169f7234e9283e3969/images/large/1.jpg saved to cache
2026-03-26 22:52:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2b18b9c8-f038-5154-8774-01efdde72620
2026-03-26 22:52:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c75950>
2026-03-26 22:52:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b18b9c8-f038-5154-8774-01efdde72620/2b18b9c8-f038-5154-8774-01efdde72620_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F8b21b4ae115946169f7234e9283e3969%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/8b21b4ae115946169f7234e9283e3969/images/large/5.jpg saved to cache
2026-03-26 22:52:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2b18b9c8-f038-5154-8774-01efdde72620
2026-03-26 22:52:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cc8a10>
2026-03-26 22:52:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b18b9c8-f038-5154-8774-01efdde72620/2b18b9c8-f038-5154-8774-01efdde72620_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F8b21b4ae115946169f7234e9283e3969%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/8b21b4ae115946169f7234e9283e3969/images/large/6.jpg saved to cache
2026-03-26 22:52:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2b18b9c8-f038-5154-8774-01efdde72620
2026-03-26 22:52:29 [ayvens.be] INFO: Found listing with ID: 1985472
2026-03-26 22:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985472%27 HTTP/1.1" 200 None
2026-03-26 22:52:29 [ayvens.be] INFO: Scrape type for 1985472: 1
2026-03-26 22:52:29 [ayvens.be] INFO: Extracting data for car ID: 1985472
2026-03-26 22:52:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a224006a-ecb1-5777-9c36-19cb2bd63777 with identifier: 1985472
2026-03-26 22:52:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a224006a-ecb1-5777-9c36-19cb2bd63777 with scrape type 1
2026-03-26 22:52:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a224006a-ecb1-5777-9c36-19cb2bd63777
2026-03-26 22:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F9e5251d346604508907ae4ac0fed94fd%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/9e5251d346604508907ae4ac0fed94fd/images/large/1.jpg not downloaded yet
2026-03-26 22:52:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 8580ac67-a34c-5f62-8fe2-1d5c6cfeef19 with identifier: 1985469
2026-03-26 22:52:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 8580ac67-a34c-5f62-8fe2-1d5c6cfeef19 with identifier: 1985469
2026-03-26 22:52:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 8580ac67-a34c-5f62-8fe2-1d5c6cfeef19 with identifier: 1985469 to the API
2026-03-26 22:52:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:52:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:52:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1xv/7ebb6e60fd414249bf43cc98f43f9919/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '8580ac67-a34c-5f62-8fe2-1d5c6cfeef19',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'KODIAQ',
 'odometer': 150736,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8580ac67-a34c-5f62-8fe2-1d5c6cfeef19/8580ac67-a34c-5f62-8fe2-1d5c6cfeef19_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 724805,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xv/7ebb6e60fd414249bf43cc98f43f9919/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8580ac67-a34c-5f62-8fe2-1d5c6cfeef19/8580ac67-a34c-5f62-8fe2-1d5c6cfeef19_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 721653,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xv/7ebb6e60fd414249bf43cc98f43f9919/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8580ac67-a34c-5f62-8fe2-1d5c6cfeef19/8580ac67-a34c-5f62-8fe2-1d5c6cfeef19_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 681649,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xv/7ebb6e60fd414249bf43cc98f43f9919/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8580ac67-a34c-5f62-8fe2-1d5c6cfeef19/8580ac67-a34c-5f62-8fe2-1d5c6cfeef19_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 754974,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xv/7ebb6e60fd414249bf43cc98f43f9919/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8580ac67-a34c-5f62-8fe2-1d5c6cfeef19/8580ac67-a34c-5f62-8fe2-1d5c6cfeef19_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 551487,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xv/7ebb6e60fd414249bf43cc98f43f9919/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8580ac67-a34c-5f62-8fe2-1d5c6cfeef19/8580ac67-a34c-5f62-8fe2-1d5c6cfeef19_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 652479,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xv/7ebb6e60fd414249bf43cc98f43f9919/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8580ac67-a34c-5f62-8fe2-1d5c6cfeef19/8580ac67-a34c-5f62-8fe2-1d5c6cfeef19_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 678577,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xv/7ebb6e60fd414249bf43cc98f43f9919/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8580ac67-a34c-5f62-8fe2-1d5c6cfeef19/8580ac67-a34c-5f62-8fe2-1d5c6cfeef19_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 741684,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xv/7ebb6e60fd414249bf43cc98f43f9919/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8580ac67-a34c-5f62-8fe2-1d5c6cfeef19/8580ac67-a34c-5f62-8fe2-1d5c6cfeef19_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 553297,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xv/7ebb6e60fd414249bf43cc98f43f9919/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8580ac67-a34c-5f62-8fe2-1d5c6cfeef19/8580ac67-a34c-5f62-8fe2-1d5c6cfeef19_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 655079,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xv/7ebb6e60fd414249bf43cc98f43f9919/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-04',
 'seats_number': 7,
 'seller_name': None,
 'title': 'SKODA KODIAQ 1.5 TSI ACT Ambition',
 'transmission': 'manual',
 'trim': '1.5 TSI ACT Ambition',
 'vin': None,
 'year': 2020}
2026-03-26 22:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985469%27 HTTP/1.1" 200 None
2026-03-26 22:52:30 [ayvens.be] INFO: Saving data for 1985469: {'created_time': 1774565550.267904, 'last_price_update_time': 1774565550.267918, 'auction_closing_time': 1774958400.0}
2026-03-26 22:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985469') HTTP/1.1" 204 0
2026-03-26 22:52:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd0af850>
2026-03-26 22:52:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b18b9c8-f038-5154-8774-01efdde72620/2b18b9c8-f038-5154-8774-01efdde72620_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F8b21b4ae115946169f7234e9283e3969%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/8b21b4ae115946169f7234e9283e3969/images/large/4.jpg saved to cache
2026-03-26 22:52:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2b18b9c8-f038-5154-8774-01efdde72620
2026-03-26 22:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F9e5251d346604508907ae4ac0fed94fd%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/9e5251d346604508907ae4ac0fed94fd/images/large/2.jpg not downloaded yet
2026-03-26 22:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F9e5251d346604508907ae4ac0fed94fd%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/9e5251d346604508907ae4ac0fed94fd/images/large/3.jpg not downloaded yet
2026-03-26 22:52:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd0c5590>
2026-03-26 22:52:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b18b9c8-f038-5154-8774-01efdde72620/2b18b9c8-f038-5154-8774-01efdde72620_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F8b21b4ae115946169f7234e9283e3969%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/8b21b4ae115946169f7234e9283e3969/images/large/7.jpg saved to cache
2026-03-26 22:52:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2b18b9c8-f038-5154-8774-01efdde72620
2026-03-26 22:52:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/8b21b4ae115946169f7234e9283e3969/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/8b21b4ae115946169f7234e9283e3969/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/8b21b4ae115946169f7234e9283e3969/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F9e5251d346604508907ae4ac0fed94fd%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/9e5251d346604508907ae4ac0fed94fd/images/large/4.jpg not downloaded yet
2026-03-26 22:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F9e5251d346604508907ae4ac0fed94fd%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/9e5251d346604508907ae4ac0fed94fd/images/large/5.jpg not downloaded yet
2026-03-26 22:52:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/5129fa050b474cbebc96b524edc7a837/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/5129fa050b474cbebc96b524edc7a837/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/5129fa050b474cbebc96b524edc7a837/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F9e5251d346604508907ae4ac0fed94fd%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/9e5251d346604508907ae4ac0fed94fd/images/large/6.jpg not downloaded yet
2026-03-26 22:52:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/5129fa050b474cbebc96b524edc7a837/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F9e5251d346604508907ae4ac0fed94fd%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/9e5251d346604508907ae4ac0fed94fd/images/large/7.jpg not downloaded yet
2026-03-26 22:52:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/5129fa050b474cbebc96b524edc7a837/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F9e5251d346604508907ae4ac0fed94fd%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/9e5251d346604508907ae4ac0fed94fd/images/large/8.jpg not downloaded yet
2026-03-26 22:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F9e5251d346604508907ae4ac0fed94fd%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/9e5251d346604508907ae4ac0fed94fd/images/large/9.jpg not downloaded yet
2026-03-26 22:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F9e5251d346604508907ae4ac0fed94fd%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/9e5251d346604508907ae4ac0fed94fd/images/large/10.jpg not downloaded yet
2026-03-26 22:52:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74a4090>
2026-03-26 22:52:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b18b9c8-f038-5154-8774-01efdde72620/2b18b9c8-f038-5154-8774-01efdde72620_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F8b21b4ae115946169f7234e9283e3969%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/8b21b4ae115946169f7234e9283e3969/images/large/9.jpg saved to cache
2026-03-26 22:52:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2b18b9c8-f038-5154-8774-01efdde72620
2026-03-26 22:52:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74bf410>
2026-03-26 22:52:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b18b9c8-f038-5154-8774-01efdde72620/2b18b9c8-f038-5154-8774-01efdde72620_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F8b21b4ae115946169f7234e9283e3969%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/8b21b4ae115946169f7234e9283e3969/images/large/10.jpg saved to cache
2026-03-26 22:52:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2b18b9c8-f038-5154-8774-01efdde72620
2026-03-26 22:52:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7727e10>
2026-03-26 22:52:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b18b9c8-f038-5154-8774-01efdde72620/2b18b9c8-f038-5154-8774-01efdde72620_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F8b21b4ae115946169f7234e9283e3969%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/8b21b4ae115946169f7234e9283e3969/images/large/8.jpg saved to cache
2026-03-26 22:52:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2b18b9c8-f038-5154-8774-01efdde72620
2026-03-26 22:52:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2b18b9c8-f038-5154-8774-01efdde72620, skipping ID generation
2026-03-26 22:52:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b18b9c8-f038-5154-8774-01efdde72620 with scrape type 1
2026-03-26 22:52:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2b18b9c8-f038-5154-8774-01efdde72620 sending to next pipeline
2026-03-26 22:52:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 2b18b9c8-f038-5154-8774-01efdde72620, identifier: 1985470
2026-03-26 22:52:31 [ayvens.be] INFO: Found listing with ID: 1985473
2026-03-26 22:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985473%27 HTTP/1.1" 200 None
2026-03-26 22:52:31 [ayvens.be] INFO: Scrape type for 1985473: 1
2026-03-26 22:52:31 [ayvens.be] INFO: Extracting data for car ID: 1985473
2026-03-26 22:52:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b8a785fe-b5d0-56fa-83f9-4fab89d7a362 with identifier: 1985473
2026-03-26 22:52:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8a785fe-b5d0-56fa-83f9-4fab89d7a362 with scrape type 1
2026-03-26 22:52:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b8a785fe-b5d0-56fa-83f9-4fab89d7a362
2026-03-26 22:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F3c4b2c13fccd42cdb17d16df63331abf%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/3c4b2c13fccd42cdb17d16df63331abf/images/large/1.jpg not downloaded yet
2026-03-26 22:52:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 2b18b9c8-f038-5154-8774-01efdde72620 with identifier: 1985470
2026-03-26 22:52:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 2b18b9c8-f038-5154-8774-01efdde72620 with identifier: 1985470
2026-03-26 22:52:31 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 2b18b9c8-f038-5154-8774-01efdde72620 with identifier: 1985470 to the API
2026-03-26 22:52:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:52:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:52:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2av/8b21b4ae115946169f7234e9283e3969/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '2b18b9c8-f038-5154-8774-01efdde72620',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A3',
 'odometer': 52411,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b18b9c8-f038-5154-8774-01efdde72620/2b18b9c8-f038-5154-8774-01efdde72620_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 653593,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/8b21b4ae115946169f7234e9283e3969/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b18b9c8-f038-5154-8774-01efdde72620/2b18b9c8-f038-5154-8774-01efdde72620_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 666626,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/8b21b4ae115946169f7234e9283e3969/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b18b9c8-f038-5154-8774-01efdde72620/2b18b9c8-f038-5154-8774-01efdde72620_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 651336,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/8b21b4ae115946169f7234e9283e3969/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b18b9c8-f038-5154-8774-01efdde72620/2b18b9c8-f038-5154-8774-01efdde72620_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 726434,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/8b21b4ae115946169f7234e9283e3969/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b18b9c8-f038-5154-8774-01efdde72620/2b18b9c8-f038-5154-8774-01efdde72620_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 603229,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/8b21b4ae115946169f7234e9283e3969/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b18b9c8-f038-5154-8774-01efdde72620/2b18b9c8-f038-5154-8774-01efdde72620_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 609092,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/8b21b4ae115946169f7234e9283e3969/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b18b9c8-f038-5154-8774-01efdde72620/2b18b9c8-f038-5154-8774-01efdde72620_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 664476,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/8b21b4ae115946169f7234e9283e3969/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b18b9c8-f038-5154-8774-01efdde72620/2b18b9c8-f038-5154-8774-01efdde72620_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 675903,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/8b21b4ae115946169f7234e9283e3969/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b18b9c8-f038-5154-8774-01efdde72620/2b18b9c8-f038-5154-8774-01efdde72620_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 567731,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/8b21b4ae115946169f7234e9283e3969/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b18b9c8-f038-5154-8774-01efdde72620/2b18b9c8-f038-5154-8774-01efdde72620_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 475314,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/8b21b4ae115946169f7234e9283e3969/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A3 1.4 40 TFSI E S TRON. ADVANCED SPORTBACK',
 'transmission': 'automatic',
 'trim': '1.4 40 TFSI E S TRON. ADVANCED SPORTBACK',
 'vin': None,
 'year': 2021}
2026-03-26 22:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985470%27 HTTP/1.1" 200 None
2026-03-26 22:52:31 [ayvens.be] INFO: Saving data for 1985470: {'created_time': 1774565551.692874, 'last_price_update_time': 1774565551.692883, 'auction_closing_time': 1774958400.0}
2026-03-26 22:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985470') HTTP/1.1" 204 0
2026-03-26 22:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F3c4b2c13fccd42cdb17d16df63331abf%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/3c4b2c13fccd42cdb17d16df63331abf/images/large/2.jpg not downloaded yet
2026-03-26 22:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F3c4b2c13fccd42cdb17d16df63331abf%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/3c4b2c13fccd42cdb17d16df63331abf/images/large/3.jpg not downloaded yet
2026-03-26 22:52:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cc3250>
2026-03-26 22:52:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91c64d60-2a63-590b-be74-1f96dd9673c1/91c64d60-2a63-590b-be74-1f96dd9673c1_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F5129fa050b474cbebc96b524edc7a837%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/5129fa050b474cbebc96b524edc7a837/images/large/1.jpg saved to cache
2026-03-26 22:52:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 91c64d60-2a63-590b-be74-1f96dd9673c1
2026-03-26 22:52:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b78c1610>
2026-03-26 22:52:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91c64d60-2a63-590b-be74-1f96dd9673c1/91c64d60-2a63-590b-be74-1f96dd9673c1_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F5129fa050b474cbebc96b524edc7a837%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/5129fa050b474cbebc96b524edc7a837/images/large/2.jpg saved to cache
2026-03-26 22:52:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 91c64d60-2a63-590b-be74-1f96dd9673c1
2026-03-26 22:52:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6da43d0>
2026-03-26 22:52:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91c64d60-2a63-590b-be74-1f96dd9673c1/91c64d60-2a63-590b-be74-1f96dd9673c1_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F5129fa050b474cbebc96b524edc7a837%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/5129fa050b474cbebc96b524edc7a837/images/large/3.jpg saved to cache
2026-03-26 22:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 91c64d60-2a63-590b-be74-1f96dd9673c1
2026-03-26 22:52:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b78c3550>
2026-03-26 22:52:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91c64d60-2a63-590b-be74-1f96dd9673c1/91c64d60-2a63-590b-be74-1f96dd9673c1_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F5129fa050b474cbebc96b524edc7a837%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/5129fa050b474cbebc96b524edc7a837/images/large/4.jpg saved to cache
2026-03-26 22:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 91c64d60-2a63-590b-be74-1f96dd9673c1
2026-03-26 22:52:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7aa3b10>
2026-03-26 22:52:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91c64d60-2a63-590b-be74-1f96dd9673c1/91c64d60-2a63-590b-be74-1f96dd9673c1_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F5129fa050b474cbebc96b524edc7a837%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/5129fa050b474cbebc96b524edc7a837/images/large/5.jpg saved to cache
2026-03-26 22:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 91c64d60-2a63-590b-be74-1f96dd9673c1
2026-03-26 22:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F3c4b2c13fccd42cdb17d16df63331abf%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/3c4b2c13fccd42cdb17d16df63331abf/images/large/4.jpg not downloaded yet
2026-03-26 22:52:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/5129fa050b474cbebc96b524edc7a837/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/5129fa050b474cbebc96b524edc7a837/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/9e5251d346604508907ae4ac0fed94fd/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F3c4b2c13fccd42cdb17d16df63331abf%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/3c4b2c13fccd42cdb17d16df63331abf/images/large/5.jpg not downloaded yet
2026-03-26 22:52:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/9e5251d346604508907ae4ac0fed94fd/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/5129fa050b474cbebc96b524edc7a837/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/9e5251d346604508907ae4ac0fed94fd/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F3c4b2c13fccd42cdb17d16df63331abf%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/3c4b2c13fccd42cdb17d16df63331abf/images/large/6.jpg not downloaded yet
2026-03-26 22:52:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/5129fa050b474cbebc96b524edc7a837/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/5129fa050b474cbebc96b524edc7a837/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F3c4b2c13fccd42cdb17d16df63331abf%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/3c4b2c13fccd42cdb17d16df63331abf/images/large/7.jpg not downloaded yet
2026-03-26 22:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F3c4b2c13fccd42cdb17d16df63331abf%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/3c4b2c13fccd42cdb17d16df63331abf/images/large/8.jpg not downloaded yet
2026-03-26 22:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F3c4b2c13fccd42cdb17d16df63331abf%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/3c4b2c13fccd42cdb17d16df63331abf/images/large/9.jpg not downloaded yet
2026-03-26 22:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F3c4b2c13fccd42cdb17d16df63331abf%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/3c4b2c13fccd42cdb17d16df63331abf/images/large/10.jpg not downloaded yet
2026-03-26 22:52:32 [ayvens.be] INFO: Found listing with ID: 1985474
2026-03-26 22:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985474%27 HTTP/1.1" 200 None
2026-03-26 22:52:32 [ayvens.be] INFO: Scrape type for 1985474: 1
2026-03-26 22:52:32 [ayvens.be] INFO: Extracting data for car ID: 1985474
2026-03-26 22:52:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4cda1ee7-067d-5b55-a37f-ab40174ad128 with identifier: 1985474
2026-03-26 22:52:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4cda1ee7-067d-5b55-a37f-ab40174ad128 with scrape type 1
2026-03-26 22:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4cda1ee7-067d-5b55-a37f-ab40174ad128
2026-03-26 22:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252Ff019120b026b4e6ea3ffa7186350d10f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/f019120b026b4e6ea3ffa7186350d10f/images/large/1.jpg not downloaded yet
2026-03-26 22:52:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b78a9b50>
2026-03-26 22:52:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91c64d60-2a63-590b-be74-1f96dd9673c1/91c64d60-2a63-590b-be74-1f96dd9673c1_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F5129fa050b474cbebc96b524edc7a837%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/5129fa050b474cbebc96b524edc7a837/images/large/8.jpg saved to cache
2026-03-26 22:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 91c64d60-2a63-590b-be74-1f96dd9673c1
2026-03-26 22:52:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6df1e50>
2026-03-26 22:52:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91c64d60-2a63-590b-be74-1f96dd9673c1/91c64d60-2a63-590b-be74-1f96dd9673c1_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F5129fa050b474cbebc96b524edc7a837%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/5129fa050b474cbebc96b524edc7a837/images/large/6.jpg saved to cache
2026-03-26 22:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 91c64d60-2a63-590b-be74-1f96dd9673c1
2026-03-26 22:52:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b741e290>
2026-03-26 22:52:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a224006a-ecb1-5777-9c36-19cb2bd63777/a224006a-ecb1-5777-9c36-19cb2bd63777_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F9e5251d346604508907ae4ac0fed94fd%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/9e5251d346604508907ae4ac0fed94fd/images/large/1.jpg saved to cache
2026-03-26 22:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a224006a-ecb1-5777-9c36-19cb2bd63777
2026-03-26 22:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252Ff019120b026b4e6ea3ffa7186350d10f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/f019120b026b4e6ea3ffa7186350d10f/images/large/2.jpg not downloaded yet
2026-03-26 22:52:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77bd290>
2026-03-26 22:52:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a224006a-ecb1-5777-9c36-19cb2bd63777/a224006a-ecb1-5777-9c36-19cb2bd63777_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F9e5251d346604508907ae4ac0fed94fd%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/9e5251d346604508907ae4ac0fed94fd/images/large/3.jpg saved to cache
2026-03-26 22:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a224006a-ecb1-5777-9c36-19cb2bd63777
2026-03-26 22:52:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cbc190>
2026-03-26 22:52:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91c64d60-2a63-590b-be74-1f96dd9673c1/91c64d60-2a63-590b-be74-1f96dd9673c1_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F5129fa050b474cbebc96b524edc7a837%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/5129fa050b474cbebc96b524edc7a837/images/large/7.jpg saved to cache
2026-03-26 22:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 91c64d60-2a63-590b-be74-1f96dd9673c1
2026-03-26 22:52:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7ca9690>
2026-03-26 22:52:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a224006a-ecb1-5777-9c36-19cb2bd63777/a224006a-ecb1-5777-9c36-19cb2bd63777_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F9e5251d346604508907ae4ac0fed94fd%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/9e5251d346604508907ae4ac0fed94fd/images/large/2.jpg saved to cache
2026-03-26 22:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a224006a-ecb1-5777-9c36-19cb2bd63777
2026-03-26 22:52:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6dd8090>
2026-03-26 22:52:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91c64d60-2a63-590b-be74-1f96dd9673c1/91c64d60-2a63-590b-be74-1f96dd9673c1_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F5129fa050b474cbebc96b524edc7a837%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/5129fa050b474cbebc96b524edc7a837/images/large/9.jpg saved to cache
2026-03-26 22:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 91c64d60-2a63-590b-be74-1f96dd9673c1
2026-03-26 22:52:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74de3d0>
2026-03-26 22:52:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91c64d60-2a63-590b-be74-1f96dd9673c1/91c64d60-2a63-590b-be74-1f96dd9673c1_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F5129fa050b474cbebc96b524edc7a837%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/5129fa050b474cbebc96b524edc7a837/images/large/10.jpg saved to cache
2026-03-26 22:52:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 91c64d60-2a63-590b-be74-1f96dd9673c1
2026-03-26 22:52:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 91c64d60-2a63-590b-be74-1f96dd9673c1, skipping ID generation
2026-03-26 22:52:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91c64d60-2a63-590b-be74-1f96dd9673c1 with scrape type 1
2026-03-26 22:52:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 91c64d60-2a63-590b-be74-1f96dd9673c1 sending to next pipeline
2026-03-26 22:52:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 91c64d60-2a63-590b-be74-1f96dd9673c1, identifier: 1985471
2026-03-26 22:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252Ff019120b026b4e6ea3ffa7186350d10f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/f019120b026b4e6ea3ffa7186350d10f/images/large/3.jpg not downloaded yet
2026-03-26 22:52:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 91c64d60-2a63-590b-be74-1f96dd9673c1 with identifier: 1985471
2026-03-26 22:52:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 91c64d60-2a63-590b-be74-1f96dd9673c1 with identifier: 1985471
2026-03-26 22:52:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 91c64d60-2a63-590b-be74-1f96dd9673c1 with identifier: 1985471 to the API
2026-03-26 22:52:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:52:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:52:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yr/5129fa050b474cbebc96b524edc7a837/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '91c64d60-2a63-590b-be74-1f96dd9673c1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 117173,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91c64d60-2a63-590b-be74-1f96dd9673c1/91c64d60-2a63-590b-be74-1f96dd9673c1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 767130,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/5129fa050b474cbebc96b524edc7a837/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91c64d60-2a63-590b-be74-1f96dd9673c1/91c64d60-2a63-590b-be74-1f96dd9673c1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 709191,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/5129fa050b474cbebc96b524edc7a837/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91c64d60-2a63-590b-be74-1f96dd9673c1/91c64d60-2a63-590b-be74-1f96dd9673c1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 726103,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/5129fa050b474cbebc96b524edc7a837/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91c64d60-2a63-590b-be74-1f96dd9673c1/91c64d60-2a63-590b-be74-1f96dd9673c1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 796770,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/5129fa050b474cbebc96b524edc7a837/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91c64d60-2a63-590b-be74-1f96dd9673c1/91c64d60-2a63-590b-be74-1f96dd9673c1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 799814,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/5129fa050b474cbebc96b524edc7a837/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91c64d60-2a63-590b-be74-1f96dd9673c1/91c64d60-2a63-590b-be74-1f96dd9673c1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 758637,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/5129fa050b474cbebc96b524edc7a837/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91c64d60-2a63-590b-be74-1f96dd9673c1/91c64d60-2a63-590b-be74-1f96dd9673c1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 559100,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/5129fa050b474cbebc96b524edc7a837/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91c64d60-2a63-590b-be74-1f96dd9673c1/91c64d60-2a63-590b-be74-1f96dd9673c1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 709166,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/5129fa050b474cbebc96b524edc7a837/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91c64d60-2a63-590b-be74-1f96dd9673c1/91c64d60-2a63-590b-be74-1f96dd9673c1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 694381,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/5129fa050b474cbebc96b524edc7a837/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91c64d60-2a63-590b-be74-1f96dd9673c1/91c64d60-2a63-590b-be74-1f96dd9673c1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 710690,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/5129fa050b474cbebc96b524edc7a837/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 1.5 XDRIVE25E PHEV 162KW)',
 'transmission': 'automatic',
 'trim': '1.5 XDRIVE25E PHEV 162KW)',
 'vin': None,
 'year': 2020}
2026-03-26 22:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985471%27 HTTP/1.1" 200 None
2026-03-26 22:52:33 [ayvens.be] INFO: Saving data for 1985471: {'created_time': 1774565553.566298, 'last_price_update_time': 1774565553.566308, 'auction_closing_time': 1774958400.0}
2026-03-26 22:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985471') HTTP/1.1" 204 0
2026-03-26 22:52:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/9e5251d346604508907ae4ac0fed94fd/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252Ff019120b026b4e6ea3ffa7186350d10f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/f019120b026b4e6ea3ffa7186350d10f/images/large/4.jpg not downloaded yet
2026-03-26 22:52:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/9e5251d346604508907ae4ac0fed94fd/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252Ff019120b026b4e6ea3ffa7186350d10f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/f019120b026b4e6ea3ffa7186350d10f/images/large/5.jpg not downloaded yet
2026-03-26 22:52:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/9e5251d346604508907ae4ac0fed94fd/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/9e5251d346604508907ae4ac0fed94fd/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/3c4b2c13fccd42cdb17d16df63331abf/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/9e5251d346604508907ae4ac0fed94fd/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252Ff019120b026b4e6ea3ffa7186350d10f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/f019120b026b4e6ea3ffa7186350d10f/images/large/6.jpg not downloaded yet
2026-03-26 22:52:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/9e5251d346604508907ae4ac0fed94fd/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/9e5251d346604508907ae4ac0fed94fd/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252Ff019120b026b4e6ea3ffa7186350d10f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/f019120b026b4e6ea3ffa7186350d10f/images/large/7.jpg not downloaded yet
2026-03-26 22:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252Ff019120b026b4e6ea3ffa7186350d10f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/f019120b026b4e6ea3ffa7186350d10f/images/large/8.jpg not downloaded yet
2026-03-26 22:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252Ff019120b026b4e6ea3ffa7186350d10f%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/f019120b026b4e6ea3ffa7186350d10f/images/large/9.jpg not downloaded yet
2026-03-26 22:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252Ff019120b026b4e6ea3ffa7186350d10f%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/f019120b026b4e6ea3ffa7186350d10f/images/large/10.jpg not downloaded yet
2026-03-26 22:52:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77ae950>
2026-03-26 22:52:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a224006a-ecb1-5777-9c36-19cb2bd63777/a224006a-ecb1-5777-9c36-19cb2bd63777_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F9e5251d346604508907ae4ac0fed94fd%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/9e5251d346604508907ae4ac0fed94fd/images/large/6.jpg saved to cache
2026-03-26 22:52:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a224006a-ecb1-5777-9c36-19cb2bd63777
2026-03-26 22:52:33 [ayvens.be] INFO: Found listing with ID: 1985475
2026-03-26 22:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985475%27 HTTP/1.1" 200 None
2026-03-26 22:52:33 [ayvens.be] INFO: Scrape type for 1985475: 1
2026-03-26 22:52:33 [ayvens.be] INFO: Extracting data for car ID: 1985475
2026-03-26 22:52:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac3f7c41-dc83-5791-8842-4fd94dd6637f with identifier: 1985475
2026-03-26 22:52:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac3f7c41-dc83-5791-8842-4fd94dd6637f with scrape type 1
2026-03-26 22:52:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ac3f7c41-dc83-5791-8842-4fd94dd6637f
2026-03-26 22:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fdc28e12a24ac4ea6b0de2fcd429b5861%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/dc28e12a24ac4ea6b0de2fcd429b5861/images/large/1.jpg not downloaded yet
2026-03-26 22:52:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79a6ed0>
2026-03-26 22:52:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a224006a-ecb1-5777-9c36-19cb2bd63777/a224006a-ecb1-5777-9c36-19cb2bd63777_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F9e5251d346604508907ae4ac0fed94fd%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/9e5251d346604508907ae4ac0fed94fd/images/large/9.jpg saved to cache
2026-03-26 22:52:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a224006a-ecb1-5777-9c36-19cb2bd63777
2026-03-26 22:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fdc28e12a24ac4ea6b0de2fcd429b5861%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/dc28e12a24ac4ea6b0de2fcd429b5861/images/large/2.jpg not downloaded yet
2026-03-26 22:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fdc28e12a24ac4ea6b0de2fcd429b5861%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/dc28e12a24ac4ea6b0de2fcd429b5861/images/large/3.jpg not downloaded yet
2026-03-26 22:52:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b75a7210>
2026-03-26 22:52:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a224006a-ecb1-5777-9c36-19cb2bd63777/a224006a-ecb1-5777-9c36-19cb2bd63777_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F9e5251d346604508907ae4ac0fed94fd%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/9e5251d346604508907ae4ac0fed94fd/images/large/7.jpg saved to cache
2026-03-26 22:52:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a224006a-ecb1-5777-9c36-19cb2bd63777
2026-03-26 22:52:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7875890>
2026-03-26 22:52:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a224006a-ecb1-5777-9c36-19cb2bd63777/a224006a-ecb1-5777-9c36-19cb2bd63777_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F9e5251d346604508907ae4ac0fed94fd%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/9e5251d346604508907ae4ac0fed94fd/images/large/4.jpg saved to cache
2026-03-26 22:52:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a224006a-ecb1-5777-9c36-19cb2bd63777
2026-03-26 22:52:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b75a6090>
2026-03-26 22:52:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8a785fe-b5d0-56fa-83f9-4fab89d7a362/b8a785fe-b5d0-56fa-83f9-4fab89d7a362_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F3c4b2c13fccd42cdb17d16df63331abf%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/3c4b2c13fccd42cdb17d16df63331abf/images/large/1.jpg saved to cache
2026-03-26 22:52:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b8a785fe-b5d0-56fa-83f9-4fab89d7a362
2026-03-26 22:52:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cbf590>
2026-03-26 22:52:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a224006a-ecb1-5777-9c36-19cb2bd63777/a224006a-ecb1-5777-9c36-19cb2bd63777_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F9e5251d346604508907ae4ac0fed94fd%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/9e5251d346604508907ae4ac0fed94fd/images/large/10.jpg saved to cache
2026-03-26 22:52:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a224006a-ecb1-5777-9c36-19cb2bd63777
2026-03-26 22:52:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77bd310>
2026-03-26 22:52:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a224006a-ecb1-5777-9c36-19cb2bd63777/a224006a-ecb1-5777-9c36-19cb2bd63777_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F9e5251d346604508907ae4ac0fed94fd%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/9e5251d346604508907ae4ac0fed94fd/images/large/8.jpg saved to cache
2026-03-26 22:52:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a224006a-ecb1-5777-9c36-19cb2bd63777
2026-03-26 22:52:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7875290>
2026-03-26 22:52:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a224006a-ecb1-5777-9c36-19cb2bd63777/a224006a-ecb1-5777-9c36-19cb2bd63777_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F9e5251d346604508907ae4ac0fed94fd%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/9e5251d346604508907ae4ac0fed94fd/images/large/5.jpg saved to cache
2026-03-26 22:52:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a224006a-ecb1-5777-9c36-19cb2bd63777
2026-03-26 22:52:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a224006a-ecb1-5777-9c36-19cb2bd63777, skipping ID generation
2026-03-26 22:52:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a224006a-ecb1-5777-9c36-19cb2bd63777 with scrape type 1
2026-03-26 22:52:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a224006a-ecb1-5777-9c36-19cb2bd63777 sending to next pipeline
2026-03-26 22:52:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a224006a-ecb1-5777-9c36-19cb2bd63777, identifier: 1985472
2026-03-26 22:52:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a224006a-ecb1-5777-9c36-19cb2bd63777 with identifier: 1985472
2026-03-26 22:52:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a224006a-ecb1-5777-9c36-19cb2bd63777 with identifier: 1985472
2026-03-26 22:52:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a224006a-ecb1-5777-9c36-19cb2bd63777 with identifier: 1985472 to the API
2026-03-26 22:52:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:52:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:52:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bg/9e5251d346604508907ae4ac0fed94fd/images/large/5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'electric',
 'id': 'a224006a-ecb1-5777-9c36-19cb2bd63777',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'IX3',
 'odometer': 80986,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a224006a-ecb1-5777-9c36-19cb2bd63777/a224006a-ecb1-5777-9c36-19cb2bd63777_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 667302,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/9e5251d346604508907ae4ac0fed94fd/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a224006a-ecb1-5777-9c36-19cb2bd63777/a224006a-ecb1-5777-9c36-19cb2bd63777_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 706864,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/9e5251d346604508907ae4ac0fed94fd/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a224006a-ecb1-5777-9c36-19cb2bd63777/a224006a-ecb1-5777-9c36-19cb2bd63777_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 622218,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/9e5251d346604508907ae4ac0fed94fd/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a224006a-ecb1-5777-9c36-19cb2bd63777/a224006a-ecb1-5777-9c36-19cb2bd63777_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 748320,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/9e5251d346604508907ae4ac0fed94fd/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a224006a-ecb1-5777-9c36-19cb2bd63777/a224006a-ecb1-5777-9c36-19cb2bd63777_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 585500,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/9e5251d346604508907ae4ac0fed94fd/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a224006a-ecb1-5777-9c36-19cb2bd63777/a224006a-ecb1-5777-9c36-19cb2bd63777_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 594016,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/9e5251d346604508907ae4ac0fed94fd/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a224006a-ecb1-5777-9c36-19cb2bd63777/a224006a-ecb1-5777-9c36-19cb2bd63777_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 630831,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/9e5251d346604508907ae4ac0fed94fd/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a224006a-ecb1-5777-9c36-19cb2bd63777/a224006a-ecb1-5777-9c36-19cb2bd63777_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 735001,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/9e5251d346604508907ae4ac0fed94fd/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a224006a-ecb1-5777-9c36-19cb2bd63777/a224006a-ecb1-5777-9c36-19cb2bd63777_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 557647,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/9e5251d346604508907ae4ac0fed94fd/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a224006a-ecb1-5777-9c36-19cb2bd63777/a224006a-ecb1-5777-9c36-19cb2bd63777_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 491316,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/9e5251d346604508907ae4ac0fed94fd/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW IX3 80KWH AUTO',
 'transmission': 'automatic',
 'trim': '80KWH AUTO',
 'vin': None,
 'year': 2021}
2026-03-26 22:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985472%27 HTTP/1.1" 200 None
2026-03-26 22:52:34 [ayvens.be] INFO: Saving data for 1985472: {'created_time': 1774565554.968583, 'last_price_update_time': 1774565554.968594, 'auction_closing_time': 1774958400.0}
2026-03-26 22:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985472') HTTP/1.1" 204 0
2026-03-26 22:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fdc28e12a24ac4ea6b0de2fcd429b5861%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/dc28e12a24ac4ea6b0de2fcd429b5861/images/large/4.jpg not downloaded yet
2026-03-26 22:52:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/3c4b2c13fccd42cdb17d16df63331abf/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/3c4b2c13fccd42cdb17d16df63331abf/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/f019120b026b4e6ea3ffa7186350d10f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/f019120b026b4e6ea3ffa7186350d10f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fdc28e12a24ac4ea6b0de2fcd429b5861%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/dc28e12a24ac4ea6b0de2fcd429b5861/images/large/5.jpg not downloaded yet
2026-03-26 22:52:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/3c4b2c13fccd42cdb17d16df63331abf/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/3c4b2c13fccd42cdb17d16df63331abf/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/3c4b2c13fccd42cdb17d16df63331abf/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fdc28e12a24ac4ea6b0de2fcd429b5861%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/dc28e12a24ac4ea6b0de2fcd429b5861/images/large/6.jpg not downloaded yet
2026-03-26 22:52:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/3c4b2c13fccd42cdb17d16df63331abf/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fdc28e12a24ac4ea6b0de2fcd429b5861%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/dc28e12a24ac4ea6b0de2fcd429b5861/images/large/7.jpg not downloaded yet
2026-03-26 22:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fdc28e12a24ac4ea6b0de2fcd429b5861%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/dc28e12a24ac4ea6b0de2fcd429b5861/images/large/8.jpg not downloaded yet
2026-03-26 22:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fdc28e12a24ac4ea6b0de2fcd429b5861%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/dc28e12a24ac4ea6b0de2fcd429b5861/images/large/9.jpg not downloaded yet
2026-03-26 22:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fdc28e12a24ac4ea6b0de2fcd429b5861%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/dc28e12a24ac4ea6b0de2fcd429b5861/images/large/10.jpg not downloaded yet
2026-03-26 22:52:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6df3c90>
2026-03-26 22:52:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8a785fe-b5d0-56fa-83f9-4fab89d7a362/b8a785fe-b5d0-56fa-83f9-4fab89d7a362_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F3c4b2c13fccd42cdb17d16df63331abf%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/3c4b2c13fccd42cdb17d16df63331abf/images/large/4.jpg saved to cache
2026-03-26 22:52:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b8a785fe-b5d0-56fa-83f9-4fab89d7a362
2026-03-26 22:52:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b776b650>
2026-03-26 22:52:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8a785fe-b5d0-56fa-83f9-4fab89d7a362/b8a785fe-b5d0-56fa-83f9-4fab89d7a362_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F3c4b2c13fccd42cdb17d16df63331abf%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/3c4b2c13fccd42cdb17d16df63331abf/images/large/10.jpg saved to cache
2026-03-26 22:52:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b8a785fe-b5d0-56fa-83f9-4fab89d7a362
2026-03-26 22:52:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b787ea90>
2026-03-26 22:52:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cda1ee7-067d-5b55-a37f-ab40174ad128/4cda1ee7-067d-5b55-a37f-ab40174ad128_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252Ff019120b026b4e6ea3ffa7186350d10f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/f019120b026b4e6ea3ffa7186350d10f/images/large/1.jpg saved to cache
2026-03-26 22:52:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4cda1ee7-067d-5b55-a37f-ab40174ad128
2026-03-26 22:52:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b787c910>
2026-03-26 22:52:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cda1ee7-067d-5b55-a37f-ab40174ad128/4cda1ee7-067d-5b55-a37f-ab40174ad128_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252Ff019120b026b4e6ea3ffa7186350d10f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/f019120b026b4e6ea3ffa7186350d10f/images/large/2.jpg saved to cache
2026-03-26 22:52:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4cda1ee7-067d-5b55-a37f-ab40174ad128
2026-03-26 22:52:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/f019120b026b4e6ea3ffa7186350d10f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/dc28e12a24ac4ea6b0de2fcd429b5861/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:35 [ayvens.be] INFO: Found listing with ID: 1985476
2026-03-26 22:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985476%27 HTTP/1.1" 200 None
2026-03-26 22:52:35 [ayvens.be] INFO: Scrape type for 1985476: 1
2026-03-26 22:52:35 [ayvens.be] INFO: Extracting data for car ID: 1985476
2026-03-26 22:52:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 923415d3-d6d4-571e-8e07-9b822810782d with identifier: 1985476
2026-03-26 22:52:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 923415d3-d6d4-571e-8e07-9b822810782d with scrape type 1
2026-03-26 22:52:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 923415d3-d6d4-571e-8e07-9b822810782d
2026-03-26 22:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F59810485b3be46d8b831ad3ec04bf736%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/59810485b3be46d8b831ad3ec04bf736/images/large/1.jpg not downloaded yet
2026-03-26 22:52:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/f019120b026b4e6ea3ffa7186350d10f/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F59810485b3be46d8b831ad3ec04bf736%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/59810485b3be46d8b831ad3ec04bf736/images/large/2.jpg not downloaded yet
2026-03-26 22:52:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cc9390>
2026-03-26 22:52:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8a785fe-b5d0-56fa-83f9-4fab89d7a362/b8a785fe-b5d0-56fa-83f9-4fab89d7a362_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F3c4b2c13fccd42cdb17d16df63331abf%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/3c4b2c13fccd42cdb17d16df63331abf/images/large/3.jpg saved to cache
2026-03-26 22:52:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b8a785fe-b5d0-56fa-83f9-4fab89d7a362
2026-03-26 22:52:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74aca10>
2026-03-26 22:52:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8a785fe-b5d0-56fa-83f9-4fab89d7a362/b8a785fe-b5d0-56fa-83f9-4fab89d7a362_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F3c4b2c13fccd42cdb17d16df63331abf%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/3c4b2c13fccd42cdb17d16df63331abf/images/large/2.jpg saved to cache
2026-03-26 22:52:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b8a785fe-b5d0-56fa-83f9-4fab89d7a362
2026-03-26 22:52:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7ccf2d0>
2026-03-26 22:52:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8a785fe-b5d0-56fa-83f9-4fab89d7a362/b8a785fe-b5d0-56fa-83f9-4fab89d7a362_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F3c4b2c13fccd42cdb17d16df63331abf%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/3c4b2c13fccd42cdb17d16df63331abf/images/large/9.jpg saved to cache
2026-03-26 22:52:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b8a785fe-b5d0-56fa-83f9-4fab89d7a362
2026-03-26 22:52:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7772d50>
2026-03-26 22:52:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8a785fe-b5d0-56fa-83f9-4fab89d7a362/b8a785fe-b5d0-56fa-83f9-4fab89d7a362_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F3c4b2c13fccd42cdb17d16df63331abf%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/3c4b2c13fccd42cdb17d16df63331abf/images/large/8.jpg saved to cache
2026-03-26 22:52:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b8a785fe-b5d0-56fa-83f9-4fab89d7a362
2026-03-26 22:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F59810485b3be46d8b831ad3ec04bf736%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/59810485b3be46d8b831ad3ec04bf736/images/large/3.jpg not downloaded yet
2026-03-26 22:52:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/f019120b026b4e6ea3ffa7186350d10f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/f019120b026b4e6ea3ffa7186350d10f/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/f019120b026b4e6ea3ffa7186350d10f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/f019120b026b4e6ea3ffa7186350d10f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F59810485b3be46d8b831ad3ec04bf736%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/59810485b3be46d8b831ad3ec04bf736/images/large/4.jpg not downloaded yet
2026-03-26 22:52:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76ee610>
2026-03-26 22:52:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cda1ee7-067d-5b55-a37f-ab40174ad128/4cda1ee7-067d-5b55-a37f-ab40174ad128_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252Ff019120b026b4e6ea3ffa7186350d10f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/f019120b026b4e6ea3ffa7186350d10f/images/large/3.jpg saved to cache
2026-03-26 22:52:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4cda1ee7-067d-5b55-a37f-ab40174ad128
2026-03-26 22:52:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74ad910>
2026-03-26 22:52:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac3f7c41-dc83-5791-8842-4fd94dd6637f/ac3f7c41-dc83-5791-8842-4fd94dd6637f_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fdc28e12a24ac4ea6b0de2fcd429b5861%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/dc28e12a24ac4ea6b0de2fcd429b5861/images/large/1.jpg saved to cache
2026-03-26 22:52:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ac3f7c41-dc83-5791-8842-4fd94dd6637f
2026-03-26 22:52:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b787f9d0>
2026-03-26 22:52:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cda1ee7-067d-5b55-a37f-ab40174ad128/4cda1ee7-067d-5b55-a37f-ab40174ad128_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252Ff019120b026b4e6ea3ffa7186350d10f%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/f019120b026b4e6ea3ffa7186350d10f/images/large/9.jpg saved to cache
2026-03-26 22:52:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4cda1ee7-067d-5b55-a37f-ab40174ad128
2026-03-26 22:52:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/f019120b026b4e6ea3ffa7186350d10f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F59810485b3be46d8b831ad3ec04bf736%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/59810485b3be46d8b831ad3ec04bf736/images/large/5.jpg not downloaded yet
2026-03-26 22:52:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/dc28e12a24ac4ea6b0de2fcd429b5861/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F59810485b3be46d8b831ad3ec04bf736%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/59810485b3be46d8b831ad3ec04bf736/images/large/6.jpg not downloaded yet
2026-03-26 22:52:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/dc28e12a24ac4ea6b0de2fcd429b5861/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F59810485b3be46d8b831ad3ec04bf736%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/59810485b3be46d8b831ad3ec04bf736/images/large/7.jpg not downloaded yet
2026-03-26 22:52:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77bc190>
2026-03-26 22:52:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cda1ee7-067d-5b55-a37f-ab40174ad128/4cda1ee7-067d-5b55-a37f-ab40174ad128_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252Ff019120b026b4e6ea3ffa7186350d10f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/f019120b026b4e6ea3ffa7186350d10f/images/large/7.jpg saved to cache
2026-03-26 22:52:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4cda1ee7-067d-5b55-a37f-ab40174ad128
2026-03-26 22:52:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7414d10>
2026-03-26 22:52:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cda1ee7-067d-5b55-a37f-ab40174ad128/4cda1ee7-067d-5b55-a37f-ab40174ad128_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252Ff019120b026b4e6ea3ffa7186350d10f%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/f019120b026b4e6ea3ffa7186350d10f/images/large/10.jpg saved to cache
2026-03-26 22:52:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4cda1ee7-067d-5b55-a37f-ab40174ad128
2026-03-26 22:52:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e1d110>
2026-03-26 22:52:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cda1ee7-067d-5b55-a37f-ab40174ad128/4cda1ee7-067d-5b55-a37f-ab40174ad128_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252Ff019120b026b4e6ea3ffa7186350d10f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/f019120b026b4e6ea3ffa7186350d10f/images/large/8.jpg saved to cache
2026-03-26 22:52:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4cda1ee7-067d-5b55-a37f-ab40174ad128
2026-03-26 22:52:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7a61490>
2026-03-26 22:52:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cda1ee7-067d-5b55-a37f-ab40174ad128/4cda1ee7-067d-5b55-a37f-ab40174ad128_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252Ff019120b026b4e6ea3ffa7186350d10f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/f019120b026b4e6ea3ffa7186350d10f/images/large/6.jpg saved to cache
2026-03-26 22:52:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4cda1ee7-067d-5b55-a37f-ab40174ad128
2026-03-26 22:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F59810485b3be46d8b831ad3ec04bf736%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/59810485b3be46d8b831ad3ec04bf736/images/large/8.jpg not downloaded yet
2026-03-26 22:52:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/f019120b026b4e6ea3ffa7186350d10f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/dc28e12a24ac4ea6b0de2fcd429b5861/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F59810485b3be46d8b831ad3ec04bf736%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/59810485b3be46d8b831ad3ec04bf736/images/large/9.jpg not downloaded yet
2026-03-26 22:52:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/59810485b3be46d8b831ad3ec04bf736/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79a6710>
2026-03-26 22:52:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cda1ee7-067d-5b55-a37f-ab40174ad128/4cda1ee7-067d-5b55-a37f-ab40174ad128_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252Ff019120b026b4e6ea3ffa7186350d10f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/f019120b026b4e6ea3ffa7186350d10f/images/large/4.jpg saved to cache
2026-03-26 22:52:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4cda1ee7-067d-5b55-a37f-ab40174ad128
2026-03-26 22:52:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7a63010>
2026-03-26 22:52:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac3f7c41-dc83-5791-8842-4fd94dd6637f/ac3f7c41-dc83-5791-8842-4fd94dd6637f_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fdc28e12a24ac4ea6b0de2fcd429b5861%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/dc28e12a24ac4ea6b0de2fcd429b5861/images/large/3.jpg saved to cache
2026-03-26 22:52:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ac3f7c41-dc83-5791-8842-4fd94dd6637f
2026-03-26 22:52:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b740a950>
2026-03-26 22:52:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac3f7c41-dc83-5791-8842-4fd94dd6637f/ac3f7c41-dc83-5791-8842-4fd94dd6637f_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fdc28e12a24ac4ea6b0de2fcd429b5861%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/dc28e12a24ac4ea6b0de2fcd429b5861/images/large/4.jpg saved to cache
2026-03-26 22:52:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ac3f7c41-dc83-5791-8842-4fd94dd6637f
2026-03-26 22:52:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/dc28e12a24ac4ea6b0de2fcd429b5861/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F59810485b3be46d8b831ad3ec04bf736%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/59810485b3be46d8b831ad3ec04bf736/images/large/10.jpg not downloaded yet
2026-03-26 22:52:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/dc28e12a24ac4ea6b0de2fcd429b5861/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/dc28e12a24ac4ea6b0de2fcd429b5861/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:36 [ayvens.be] INFO: Found listing with ID: 1985477
2026-03-26 22:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985477%27 HTTP/1.1" 200 None
2026-03-26 22:52:36 [ayvens.be] INFO: Scrape type for 1985477: 1
2026-03-26 22:52:36 [ayvens.be] INFO: Extracting data for car ID: 1985477
2026-03-26 22:52:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a2e04f41-d376-5af6-88b1-4d1b9319a3f0 with identifier: 1985477
2026-03-26 22:52:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2e04f41-d376-5af6-88b1-4d1b9319a3f0 with scrape type 1
2026-03-26 22:52:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a2e04f41-d376-5af6-88b1-4d1b9319a3f0
2026-03-26 22:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Feabe18af1525459a99d1e32d05f4b9ca%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/eabe18af1525459a99d1e32d05f4b9ca/images/large/1.jpg not downloaded yet
2026-03-26 22:52:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/59810485b3be46d8b831ad3ec04bf736/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Feabe18af1525459a99d1e32d05f4b9ca%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/eabe18af1525459a99d1e32d05f4b9ca/images/large/2.jpg not downloaded yet
2026-03-26 22:52:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cbe810>
2026-03-26 22:52:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cda1ee7-067d-5b55-a37f-ab40174ad128/4cda1ee7-067d-5b55-a37f-ab40174ad128_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252Ff019120b026b4e6ea3ffa7186350d10f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/f019120b026b4e6ea3ffa7186350d10f/images/large/5.jpg saved to cache
2026-03-26 22:52:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4cda1ee7-067d-5b55-a37f-ab40174ad128
2026-03-26 22:52:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4cda1ee7-067d-5b55-a37f-ab40174ad128, skipping ID generation
2026-03-26 22:52:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4cda1ee7-067d-5b55-a37f-ab40174ad128 with scrape type 1
2026-03-26 22:52:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4cda1ee7-067d-5b55-a37f-ab40174ad128 sending to next pipeline
2026-03-26 22:52:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 4cda1ee7-067d-5b55-a37f-ab40174ad128, identifier: 1985474
2026-03-26 22:52:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76e34d0>
2026-03-26 22:52:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac3f7c41-dc83-5791-8842-4fd94dd6637f/ac3f7c41-dc83-5791-8842-4fd94dd6637f_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fdc28e12a24ac4ea6b0de2fcd429b5861%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/dc28e12a24ac4ea6b0de2fcd429b5861/images/large/2.jpg saved to cache
2026-03-26 22:52:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ac3f7c41-dc83-5791-8842-4fd94dd6637f
2026-03-26 22:52:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b727d610>
2026-03-26 22:52:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_923415d3-d6d4-571e-8e07-9b822810782d/923415d3-d6d4-571e-8e07-9b822810782d_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F59810485b3be46d8b831ad3ec04bf736%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/59810485b3be46d8b831ad3ec04bf736/images/large/1.jpg saved to cache
2026-03-26 22:52:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 923415d3-d6d4-571e-8e07-9b822810782d
2026-03-26 22:52:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/3c4b2c13fccd42cdb17d16df63331abf/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/dc28e12a24ac4ea6b0de2fcd429b5861/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 4cda1ee7-067d-5b55-a37f-ab40174ad128 with identifier: 1985474
2026-03-26 22:52:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 4cda1ee7-067d-5b55-a37f-ab40174ad128 with identifier: 1985474
2026-03-26 22:52:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 4cda1ee7-067d-5b55-a37f-ab40174ad128 with identifier: 1985474 to the API
2026-03-26 22:52:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:52:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:52:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2an/f019120b026b4e6ea3ffa7186350d10f/images/large/5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '4cda1ee7-067d-5b55-a37f-ab40174ad128',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X3',
 'odometer': 175265,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4cda1ee7-067d-5b55-a37f-ab40174ad128/4cda1ee7-067d-5b55-a37f-ab40174ad128_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 523196,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/f019120b026b4e6ea3ffa7186350d10f/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4cda1ee7-067d-5b55-a37f-ab40174ad128/4cda1ee7-067d-5b55-a37f-ab40174ad128_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 438300,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/f019120b026b4e6ea3ffa7186350d10f/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4cda1ee7-067d-5b55-a37f-ab40174ad128/4cda1ee7-067d-5b55-a37f-ab40174ad128_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 485406,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/f019120b026b4e6ea3ffa7186350d10f/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4cda1ee7-067d-5b55-a37f-ab40174ad128/4cda1ee7-067d-5b55-a37f-ab40174ad128_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 501195,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/f019120b026b4e6ea3ffa7186350d10f/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4cda1ee7-067d-5b55-a37f-ab40174ad128/4cda1ee7-067d-5b55-a37f-ab40174ad128_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 402390,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/f019120b026b4e6ea3ffa7186350d10f/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4cda1ee7-067d-5b55-a37f-ab40174ad128/4cda1ee7-067d-5b55-a37f-ab40174ad128_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 342585,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/f019120b026b4e6ea3ffa7186350d10f/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4cda1ee7-067d-5b55-a37f-ab40174ad128/4cda1ee7-067d-5b55-a37f-ab40174ad128_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 391481,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/f019120b026b4e6ea3ffa7186350d10f/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4cda1ee7-067d-5b55-a37f-ab40174ad128/4cda1ee7-067d-5b55-a37f-ab40174ad128_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 360215,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/f019120b026b4e6ea3ffa7186350d10f/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4cda1ee7-067d-5b55-a37f-ab40174ad128/4cda1ee7-067d-5b55-a37f-ab40174ad128_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 292995,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/f019120b026b4e6ea3ffa7186350d10f/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4cda1ee7-067d-5b55-a37f-ab40174ad128/4cda1ee7-067d-5b55-a37f-ab40174ad128_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 327301,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/f019120b026b4e6ea3ffa7186350d10f/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X3 2.0 XDRIVE30E (120KW) AUTO',
 'transmission': 'automatic',
 'trim': '2.0 XDRIVE30E (120KW) AUTO',
 'vin': None,
 'year': 2021}
2026-03-26 22:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985474%27 HTTP/1.1" 200 None
2026-03-26 22:52:37 [ayvens.be] INFO: Saving data for 1985474: {'created_time': 1774565557.772481, 'last_price_update_time': 1774565557.772491, 'auction_closing_time': 1774958400.0}
2026-03-26 22:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985474') HTTP/1.1" 204 0
2026-03-26 22:52:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/dc28e12a24ac4ea6b0de2fcd429b5861/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Feabe18af1525459a99d1e32d05f4b9ca%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/eabe18af1525459a99d1e32d05f4b9ca/images/large/3.jpg not downloaded yet
2026-03-26 22:52:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/dc28e12a24ac4ea6b0de2fcd429b5861/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b75a5c90>
2026-03-26 22:52:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac3f7c41-dc83-5791-8842-4fd94dd6637f/ac3f7c41-dc83-5791-8842-4fd94dd6637f_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fdc28e12a24ac4ea6b0de2fcd429b5861%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/dc28e12a24ac4ea6b0de2fcd429b5861/images/large/10.jpg saved to cache
2026-03-26 22:52:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ac3f7c41-dc83-5791-8842-4fd94dd6637f
2026-03-26 22:52:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7ce9d90>
2026-03-26 22:52:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac3f7c41-dc83-5791-8842-4fd94dd6637f/ac3f7c41-dc83-5791-8842-4fd94dd6637f_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fdc28e12a24ac4ea6b0de2fcd429b5861%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/dc28e12a24ac4ea6b0de2fcd429b5861/images/large/9.jpg saved to cache
2026-03-26 22:52:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ac3f7c41-dc83-5791-8842-4fd94dd6637f
2026-03-26 22:52:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7745890>
2026-03-26 22:52:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac3f7c41-dc83-5791-8842-4fd94dd6637f/ac3f7c41-dc83-5791-8842-4fd94dd6637f_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fdc28e12a24ac4ea6b0de2fcd429b5861%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/dc28e12a24ac4ea6b0de2fcd429b5861/images/large/8.jpg saved to cache
2026-03-26 22:52:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ac3f7c41-dc83-5791-8842-4fd94dd6637f
2026-03-26 22:52:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7ccf0d0>
2026-03-26 22:52:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_923415d3-d6d4-571e-8e07-9b822810782d/923415d3-d6d4-571e-8e07-9b822810782d_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F59810485b3be46d8b831ad3ec04bf736%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/59810485b3be46d8b831ad3ec04bf736/images/large/2.jpg saved to cache
2026-03-26 22:52:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 923415d3-d6d4-571e-8e07-9b822810782d
2026-03-26 22:52:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/59810485b3be46d8b831ad3ec04bf736/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Feabe18af1525459a99d1e32d05f4b9ca%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/eabe18af1525459a99d1e32d05f4b9ca/images/large/4.jpg not downloaded yet
2026-03-26 22:52:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6decfd0>
2026-03-26 22:52:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8a785fe-b5d0-56fa-83f9-4fab89d7a362/b8a785fe-b5d0-56fa-83f9-4fab89d7a362_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F3c4b2c13fccd42cdb17d16df63331abf%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/3c4b2c13fccd42cdb17d16df63331abf/images/large/7.jpg saved to cache
2026-03-26 22:52:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b8a785fe-b5d0-56fa-83f9-4fab89d7a362
2026-03-26 22:52:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7982950>
2026-03-26 22:52:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac3f7c41-dc83-5791-8842-4fd94dd6637f/ac3f7c41-dc83-5791-8842-4fd94dd6637f_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fdc28e12a24ac4ea6b0de2fcd429b5861%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/dc28e12a24ac4ea6b0de2fcd429b5861/images/large/7.jpg saved to cache
2026-03-26 22:52:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ac3f7c41-dc83-5791-8842-4fd94dd6637f
2026-03-26 22:52:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/59810485b3be46d8b831ad3ec04bf736/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Feabe18af1525459a99d1e32d05f4b9ca%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/eabe18af1525459a99d1e32d05f4b9ca/images/large/5.jpg not downloaded yet
2026-03-26 22:52:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7290e10>
2026-03-26 22:52:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac3f7c41-dc83-5791-8842-4fd94dd6637f/ac3f7c41-dc83-5791-8842-4fd94dd6637f_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fdc28e12a24ac4ea6b0de2fcd429b5861%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/dc28e12a24ac4ea6b0de2fcd429b5861/images/large/6.jpg saved to cache
2026-03-26 22:52:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ac3f7c41-dc83-5791-8842-4fd94dd6637f
2026-03-26 22:52:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b78c3310>
2026-03-26 22:52:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac3f7c41-dc83-5791-8842-4fd94dd6637f/ac3f7c41-dc83-5791-8842-4fd94dd6637f_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fdc28e12a24ac4ea6b0de2fcd429b5861%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/dc28e12a24ac4ea6b0de2fcd429b5861/images/large/5.jpg saved to cache
2026-03-26 22:52:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ac3f7c41-dc83-5791-8842-4fd94dd6637f
2026-03-26 22:52:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ac3f7c41-dc83-5791-8842-4fd94dd6637f, skipping ID generation
2026-03-26 22:52:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac3f7c41-dc83-5791-8842-4fd94dd6637f with scrape type 1
2026-03-26 22:52:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ac3f7c41-dc83-5791-8842-4fd94dd6637f sending to next pipeline
2026-03-26 22:52:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: ac3f7c41-dc83-5791-8842-4fd94dd6637f, identifier: 1985475
2026-03-26 22:52:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/59810485b3be46d8b831ad3ec04bf736/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: ac3f7c41-dc83-5791-8842-4fd94dd6637f with identifier: 1985475
2026-03-26 22:52:38 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 22:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 22:52:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: ac3f7c41-dc83-5791-8842-4fd94dd6637f with identifier: 1985475
2026-03-26 22:52:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: ac3f7c41-dc83-5791-8842-4fd94dd6637f with identifier: 1985475 to the API
2026-03-26 22:52:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:52:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:52:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bj/dc28e12a24ac4ea6b0de2fcd429b5861/images/large/5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'color': 'COSMOSZWART',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.9L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ac3f7c41-dc83-5791-8842-4fd94dd6637f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A-CLASS LIMOUSINE',
 'odometer': 120855,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac3f7c41-dc83-5791-8842-4fd94dd6637f/ac3f7c41-dc83-5791-8842-4fd94dd6637f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 430652,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/dc28e12a24ac4ea6b0de2fcd429b5861/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac3f7c41-dc83-5791-8842-4fd94dd6637f/ac3f7c41-dc83-5791-8842-4fd94dd6637f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 412464,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/dc28e12a24ac4ea6b0de2fcd429b5861/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac3f7c41-dc83-5791-8842-4fd94dd6637f/ac3f7c41-dc83-5791-8842-4fd94dd6637f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 421192,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/dc28e12a24ac4ea6b0de2fcd429b5861/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac3f7c41-dc83-5791-8842-4fd94dd6637f/ac3f7c41-dc83-5791-8842-4fd94dd6637f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 524738,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/dc28e12a24ac4ea6b0de2fcd429b5861/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac3f7c41-dc83-5791-8842-4fd94dd6637f/ac3f7c41-dc83-5791-8842-4fd94dd6637f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 236363,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/dc28e12a24ac4ea6b0de2fcd429b5861/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac3f7c41-dc83-5791-8842-4fd94dd6637f/ac3f7c41-dc83-5791-8842-4fd94dd6637f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 364356,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/dc28e12a24ac4ea6b0de2fcd429b5861/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac3f7c41-dc83-5791-8842-4fd94dd6637f/ac3f7c41-dc83-5791-8842-4fd94dd6637f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 405992,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/dc28e12a24ac4ea6b0de2fcd429b5861/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac3f7c41-dc83-5791-8842-4fd94dd6637f/ac3f7c41-dc83-5791-8842-4fd94dd6637f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 405510,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/dc28e12a24ac4ea6b0de2fcd429b5861/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac3f7c41-dc83-5791-8842-4fd94dd6637f/ac3f7c41-dc83-5791-8842-4fd94dd6637f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 373754,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/dc28e12a24ac4ea6b0de2fcd429b5861/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac3f7c41-dc83-5791-8842-4fd94dd6637f/ac3f7c41-dc83-5791-8842-4fd94dd6637f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 425687,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/dc28e12a24ac4ea6b0de2fcd429b5861/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ A-CLASS LIMOUSINE 2.0 A 180 D BUSINESS SOLUTION DCT',
 'transmission': 'automatic',
 'trim': '2.0 A 180 D BUSINESS SOLUTION DCT',
 'vin': None,
 'year': 2021}
2026-03-26 22:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985475%27 HTTP/1.1" 200 None
2026-03-26 22:52:39 [ayvens.be] INFO: Saving data for 1985475: {'created_time': 1774565559.062894, 'last_price_update_time': 1774565559.062904, 'auction_closing_time': 1774958400.0}
2026-03-26 22:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985475') HTTP/1.1" 204 0
2026-03-26 22:52:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/3c4b2c13fccd42cdb17d16df63331abf/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Feabe18af1525459a99d1e32d05f4b9ca%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/eabe18af1525459a99d1e32d05f4b9ca/images/large/6.jpg not downloaded yet
2026-03-26 22:52:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7427950>
2026-03-26 22:52:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_923415d3-d6d4-571e-8e07-9b822810782d/923415d3-d6d4-571e-8e07-9b822810782d_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F59810485b3be46d8b831ad3ec04bf736%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/59810485b3be46d8b831ad3ec04bf736/images/large/3.jpg saved to cache
2026-03-26 22:52:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 923415d3-d6d4-571e-8e07-9b822810782d
2026-03-26 22:52:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/59810485b3be46d8b831ad3ec04bf736/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/59810485b3be46d8b831ad3ec04bf736/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Feabe18af1525459a99d1e32d05f4b9ca%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/eabe18af1525459a99d1e32d05f4b9ca/images/large/7.jpg not downloaded yet
2026-03-26 22:52:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b788ef90>
2026-03-26 22:52:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_923415d3-d6d4-571e-8e07-9b822810782d/923415d3-d6d4-571e-8e07-9b822810782d_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F59810485b3be46d8b831ad3ec04bf736%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/59810485b3be46d8b831ad3ec04bf736/images/large/4.jpg saved to cache
2026-03-26 22:52:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 923415d3-d6d4-571e-8e07-9b822810782d
2026-03-26 22:52:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b782f650>
2026-03-26 22:52:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_923415d3-d6d4-571e-8e07-9b822810782d/923415d3-d6d4-571e-8e07-9b822810782d_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F59810485b3be46d8b831ad3ec04bf736%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/59810485b3be46d8b831ad3ec04bf736/images/large/5.jpg saved to cache
2026-03-26 22:52:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 923415d3-d6d4-571e-8e07-9b822810782d
2026-03-26 22:52:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/59810485b3be46d8b831ad3ec04bf736/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/59810485b3be46d8b831ad3ec04bf736/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Feabe18af1525459a99d1e32d05f4b9ca%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/eabe18af1525459a99d1e32d05f4b9ca/images/large/8.jpg not downloaded yet
2026-03-26 22:52:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/59810485b3be46d8b831ad3ec04bf736/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Feabe18af1525459a99d1e32d05f4b9ca%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/eabe18af1525459a99d1e32d05f4b9ca/images/large/9.jpg not downloaded yet
2026-03-26 22:52:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7771950>
2026-03-26 22:52:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8a785fe-b5d0-56fa-83f9-4fab89d7a362/b8a785fe-b5d0-56fa-83f9-4fab89d7a362_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F3c4b2c13fccd42cdb17d16df63331abf%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/3c4b2c13fccd42cdb17d16df63331abf/images/large/6.jpg saved to cache
2026-03-26 22:52:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b8a785fe-b5d0-56fa-83f9-4fab89d7a362
2026-03-26 22:52:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7980cd0>
2026-03-26 22:52:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_923415d3-d6d4-571e-8e07-9b822810782d/923415d3-d6d4-571e-8e07-9b822810782d_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F59810485b3be46d8b831ad3ec04bf736%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/59810485b3be46d8b831ad3ec04bf736/images/large/7.jpg saved to cache
2026-03-26 22:52:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 923415d3-d6d4-571e-8e07-9b822810782d
2026-03-26 22:52:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6df3090>
2026-03-26 22:52:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_923415d3-d6d4-571e-8e07-9b822810782d/923415d3-d6d4-571e-8e07-9b822810782d_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F59810485b3be46d8b831ad3ec04bf736%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/59810485b3be46d8b831ad3ec04bf736/images/large/6.jpg saved to cache
2026-03-26 22:52:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 923415d3-d6d4-571e-8e07-9b822810782d
2026-03-26 22:52:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/3c4b2c13fccd42cdb17d16df63331abf/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Feabe18af1525459a99d1e32d05f4b9ca%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/eabe18af1525459a99d1e32d05f4b9ca/images/large/10.jpg not downloaded yet
2026-03-26 22:52:39 [ayvens.be] INFO: Found listing with ID: 1985478
2026-03-26 22:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985478%27 HTTP/1.1" 200 None
2026-03-26 22:52:39 [ayvens.be] INFO: Scrape type for 1985478: 1
2026-03-26 22:52:39 [ayvens.be] INFO: Extracting data for car ID: 1985478
2026-03-26 22:52:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 70e48b0d-73c6-561d-946b-a94fc8b7222f with identifier: 1985478
2026-03-26 22:52:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70e48b0d-73c6-561d-946b-a94fc8b7222f with scrape type 1
2026-03-26 22:52:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 70e48b0d-73c6-561d-946b-a94fc8b7222f
2026-03-26 22:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F005eb4c39fc74bef99fee218cd289d4e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/005eb4c39fc74bef99fee218cd289d4e/images/large/1.jpg not downloaded yet
2026-03-26 22:52:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b787c850>
2026-03-26 22:52:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_923415d3-d6d4-571e-8e07-9b822810782d/923415d3-d6d4-571e-8e07-9b822810782d_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F59810485b3be46d8b831ad3ec04bf736%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/59810485b3be46d8b831ad3ec04bf736/images/large/9.jpg saved to cache
2026-03-26 22:52:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 923415d3-d6d4-571e-8e07-9b822810782d
2026-03-26 22:52:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7a60410>
2026-03-26 22:52:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_923415d3-d6d4-571e-8e07-9b822810782d/923415d3-d6d4-571e-8e07-9b822810782d_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F59810485b3be46d8b831ad3ec04bf736%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/59810485b3be46d8b831ad3ec04bf736/images/large/8.jpg saved to cache
2026-03-26 22:52:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 923415d3-d6d4-571e-8e07-9b822810782d
2026-03-26 22:52:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b728ea10>
2026-03-26 22:52:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_923415d3-d6d4-571e-8e07-9b822810782d/923415d3-d6d4-571e-8e07-9b822810782d_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F59810485b3be46d8b831ad3ec04bf736%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/59810485b3be46d8b831ad3ec04bf736/images/large/10.jpg saved to cache
2026-03-26 22:52:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 923415d3-d6d4-571e-8e07-9b822810782d
2026-03-26 22:52:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 923415d3-d6d4-571e-8e07-9b822810782d, skipping ID generation
2026-03-26 22:52:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 923415d3-d6d4-571e-8e07-9b822810782d with scrape type 1
2026-03-26 22:52:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 923415d3-d6d4-571e-8e07-9b822810782d sending to next pipeline
2026-03-26 22:52:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 923415d3-d6d4-571e-8e07-9b822810782d, identifier: 1985476
2026-03-26 22:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F005eb4c39fc74bef99fee218cd289d4e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/005eb4c39fc74bef99fee218cd289d4e/images/large/2.jpg not downloaded yet
2026-03-26 22:52:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 923415d3-d6d4-571e-8e07-9b822810782d with identifier: 1985476
2026-03-26 22:52:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 923415d3-d6d4-571e-8e07-9b822810782d with identifier: 1985476
2026-03-26 22:52:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 923415d3-d6d4-571e-8e07-9b822810782d with identifier: 1985476 to the API
2026-03-26 22:52:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:52:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:52:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cr/59810485b3be46d8b831ad3ec04bf736/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '923415d3-d6d4-571e-8e07-9b822810782d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '2 SERIES GRAN COUPE',
 'odometer': 118063,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_923415d3-d6d4-571e-8e07-9b822810782d/923415d3-d6d4-571e-8e07-9b822810782d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 240293,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/59810485b3be46d8b831ad3ec04bf736/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_923415d3-d6d4-571e-8e07-9b822810782d/923415d3-d6d4-571e-8e07-9b822810782d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 230544,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/59810485b3be46d8b831ad3ec04bf736/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_923415d3-d6d4-571e-8e07-9b822810782d/923415d3-d6d4-571e-8e07-9b822810782d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 270629,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/59810485b3be46d8b831ad3ec04bf736/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_923415d3-d6d4-571e-8e07-9b822810782d/923415d3-d6d4-571e-8e07-9b822810782d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 283956,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/59810485b3be46d8b831ad3ec04bf736/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_923415d3-d6d4-571e-8e07-9b822810782d/923415d3-d6d4-571e-8e07-9b822810782d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 309771,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/59810485b3be46d8b831ad3ec04bf736/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_923415d3-d6d4-571e-8e07-9b822810782d/923415d3-d6d4-571e-8e07-9b822810782d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 310916,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/59810485b3be46d8b831ad3ec04bf736/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_923415d3-d6d4-571e-8e07-9b822810782d/923415d3-d6d4-571e-8e07-9b822810782d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 294856,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/59810485b3be46d8b831ad3ec04bf736/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_923415d3-d6d4-571e-8e07-9b822810782d/923415d3-d6d4-571e-8e07-9b822810782d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 334168,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/59810485b3be46d8b831ad3ec04bf736/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_923415d3-d6d4-571e-8e07-9b822810782d/923415d3-d6d4-571e-8e07-9b822810782d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 353801,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/59810485b3be46d8b831ad3ec04bf736/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_923415d3-d6d4-571e-8e07-9b822810782d/923415d3-d6d4-571e-8e07-9b822810782d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 362732,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/59810485b3be46d8b831ad3ec04bf736/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 2 SERIES GRAN COUPE 1.5 216DA GRAN COUPE',
 'transmission': 'automatic',
 'trim': '1.5 216DA GRAN COUPE',
 'vin': None,
 'year': 2022}
2026-03-26 22:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985476%27 HTTP/1.1" 200 None
2026-03-26 22:52:40 [ayvens.be] INFO: Saving data for 1985476: {'created_time': 1774565560.346578, 'last_price_update_time': 1774565560.346588, 'auction_closing_time': 1774958400.0}
2026-03-26 22:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985476') HTTP/1.1" 204 0
2026-03-26 22:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F005eb4c39fc74bef99fee218cd289d4e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/005eb4c39fc74bef99fee218cd289d4e/images/large/3.jpg not downloaded yet
2026-03-26 22:52:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/eabe18af1525459a99d1e32d05f4b9ca/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/eabe18af1525459a99d1e32d05f4b9ca/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/eabe18af1525459a99d1e32d05f4b9ca/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F005eb4c39fc74bef99fee218cd289d4e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/005eb4c39fc74bef99fee218cd289d4e/images/large/4.jpg not downloaded yet
2026-03-26 22:52:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7924510>
2026-03-26 22:52:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8a785fe-b5d0-56fa-83f9-4fab89d7a362/b8a785fe-b5d0-56fa-83f9-4fab89d7a362_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F3c4b2c13fccd42cdb17d16df63331abf%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/3c4b2c13fccd42cdb17d16df63331abf/images/large/5.jpg saved to cache
2026-03-26 22:52:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b8a785fe-b5d0-56fa-83f9-4fab89d7a362
2026-03-26 22:52:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b8a785fe-b5d0-56fa-83f9-4fab89d7a362, skipping ID generation
2026-03-26 22:52:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8a785fe-b5d0-56fa-83f9-4fab89d7a362 with scrape type 1
2026-03-26 22:52:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b8a785fe-b5d0-56fa-83f9-4fab89d7a362 sending to next pipeline
2026-03-26 22:52:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b8a785fe-b5d0-56fa-83f9-4fab89d7a362, identifier: 1985473
2026-03-26 22:52:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/eabe18af1525459a99d1e32d05f4b9ca/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b8a785fe-b5d0-56fa-83f9-4fab89d7a362 with identifier: 1985473
2026-03-26 22:52:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b8a785fe-b5d0-56fa-83f9-4fab89d7a362 with identifier: 1985473
2026-03-26 22:52:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b8a785fe-b5d0-56fa-83f9-4fab89d7a362 with identifier: 1985473 to the API
2026-03-26 22:52:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:52:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:52:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2dt/3c4b2c13fccd42cdb17d16df63331abf/images/large/5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'b8a785fe-b5d0-56fa-83f9-4fab89d7a362',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF VIII',
 'odometer': 83009,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8a785fe-b5d0-56fa-83f9-4fab89d7a362/b8a785fe-b5d0-56fa-83f9-4fab89d7a362_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 769929,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/3c4b2c13fccd42cdb17d16df63331abf/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8a785fe-b5d0-56fa-83f9-4fab89d7a362/b8a785fe-b5d0-56fa-83f9-4fab89d7a362_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 757211,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/3c4b2c13fccd42cdb17d16df63331abf/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8a785fe-b5d0-56fa-83f9-4fab89d7a362/b8a785fe-b5d0-56fa-83f9-4fab89d7a362_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 692422,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/3c4b2c13fccd42cdb17d16df63331abf/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8a785fe-b5d0-56fa-83f9-4fab89d7a362/b8a785fe-b5d0-56fa-83f9-4fab89d7a362_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 807021,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/3c4b2c13fccd42cdb17d16df63331abf/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8a785fe-b5d0-56fa-83f9-4fab89d7a362/b8a785fe-b5d0-56fa-83f9-4fab89d7a362_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 594441,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/3c4b2c13fccd42cdb17d16df63331abf/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8a785fe-b5d0-56fa-83f9-4fab89d7a362/b8a785fe-b5d0-56fa-83f9-4fab89d7a362_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 556212,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/3c4b2c13fccd42cdb17d16df63331abf/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8a785fe-b5d0-56fa-83f9-4fab89d7a362/b8a785fe-b5d0-56fa-83f9-4fab89d7a362_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 614449,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/3c4b2c13fccd42cdb17d16df63331abf/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8a785fe-b5d0-56fa-83f9-4fab89d7a362/b8a785fe-b5d0-56fa-83f9-4fab89d7a362_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 802120,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/3c4b2c13fccd42cdb17d16df63331abf/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8a785fe-b5d0-56fa-83f9-4fab89d7a362/b8a785fe-b5d0-56fa-83f9-4fab89d7a362_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 605604,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/3c4b2c13fccd42cdb17d16df63331abf/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8a785fe-b5d0-56fa-83f9-4fab89d7a362/b8a785fe-b5d0-56fa-83f9-4fab89d7a362_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 497101,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/3c4b2c13fccd42cdb17d16df63331abf/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF VIII 1.4 EHYBRID STYLE BUSINESS DSG',
 'transmission': 'automatic',
 'trim': '1.4 EHYBRID STYLE BUSINESS DSG',
 'vin': None,
 'year': 2023}
2026-03-26 22:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985473%27 HTTP/1.1" 200 None
2026-03-26 22:52:40 [ayvens.be] INFO: Saving data for 1985473: {'created_time': 1774565560.845004, 'last_price_update_time': 1774565560.845015, 'auction_closing_time': 1774958400.0}
2026-03-26 22:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985473') HTTP/1.1" 204 0
2026-03-26 22:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F005eb4c39fc74bef99fee218cd289d4e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/005eb4c39fc74bef99fee218cd289d4e/images/large/5.jpg not downloaded yet
2026-03-26 22:52:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/eabe18af1525459a99d1e32d05f4b9ca/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/eabe18af1525459a99d1e32d05f4b9ca/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F005eb4c39fc74bef99fee218cd289d4e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/005eb4c39fc74bef99fee218cd289d4e/images/large/6.jpg not downloaded yet
2026-03-26 22:52:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79f9f50>
2026-03-26 22:52:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2e04f41-d376-5af6-88b1-4d1b9319a3f0/a2e04f41-d376-5af6-88b1-4d1b9319a3f0_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Feabe18af1525459a99d1e32d05f4b9ca%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/eabe18af1525459a99d1e32d05f4b9ca/images/large/3.jpg saved to cache
2026-03-26 22:52:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a2e04f41-d376-5af6-88b1-4d1b9319a3f0
2026-03-26 22:52:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79f1b50>
2026-03-26 22:52:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2e04f41-d376-5af6-88b1-4d1b9319a3f0/a2e04f41-d376-5af6-88b1-4d1b9319a3f0_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Feabe18af1525459a99d1e32d05f4b9ca%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/eabe18af1525459a99d1e32d05f4b9ca/images/large/2.jpg saved to cache
2026-03-26 22:52:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a2e04f41-d376-5af6-88b1-4d1b9319a3f0
2026-03-26 22:52:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7747c90>
2026-03-26 22:52:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2e04f41-d376-5af6-88b1-4d1b9319a3f0/a2e04f41-d376-5af6-88b1-4d1b9319a3f0_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Feabe18af1525459a99d1e32d05f4b9ca%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/eabe18af1525459a99d1e32d05f4b9ca/images/large/1.jpg saved to cache
2026-03-26 22:52:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a2e04f41-d376-5af6-88b1-4d1b9319a3f0
2026-03-26 22:52:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7584190>
2026-03-26 22:52:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2e04f41-d376-5af6-88b1-4d1b9319a3f0/a2e04f41-d376-5af6-88b1-4d1b9319a3f0_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Feabe18af1525459a99d1e32d05f4b9ca%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/eabe18af1525459a99d1e32d05f4b9ca/images/large/4.jpg saved to cache
2026-03-26 22:52:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a2e04f41-d376-5af6-88b1-4d1b9319a3f0
2026-03-26 22:52:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/eabe18af1525459a99d1e32d05f4b9ca/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F005eb4c39fc74bef99fee218cd289d4e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/005eb4c39fc74bef99fee218cd289d4e/images/large/7.jpg not downloaded yet
2026-03-26 22:52:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76ed910>
2026-03-26 22:52:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2e04f41-d376-5af6-88b1-4d1b9319a3f0/a2e04f41-d376-5af6-88b1-4d1b9319a3f0_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Feabe18af1525459a99d1e32d05f4b9ca%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/eabe18af1525459a99d1e32d05f4b9ca/images/large/5.jpg saved to cache
2026-03-26 22:52:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a2e04f41-d376-5af6-88b1-4d1b9319a3f0
2026-03-26 22:52:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b75a6890>
2026-03-26 22:52:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2e04f41-d376-5af6-88b1-4d1b9319a3f0/a2e04f41-d376-5af6-88b1-4d1b9319a3f0_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Feabe18af1525459a99d1e32d05f4b9ca%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/eabe18af1525459a99d1e32d05f4b9ca/images/large/6.jpg saved to cache
2026-03-26 22:52:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a2e04f41-d376-5af6-88b1-4d1b9319a3f0
2026-03-26 22:52:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/005eb4c39fc74bef99fee218cd289d4e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F005eb4c39fc74bef99fee218cd289d4e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/005eb4c39fc74bef99fee218cd289d4e/images/large/8.jpg not downloaded yet
2026-03-26 22:52:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/eabe18af1525459a99d1e32d05f4b9ca/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F005eb4c39fc74bef99fee218cd289d4e%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/005eb4c39fc74bef99fee218cd289d4e/images/large/9.jpg not downloaded yet
2026-03-26 22:52:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7cce490>
2026-03-26 22:52:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2e04f41-d376-5af6-88b1-4d1b9319a3f0/a2e04f41-d376-5af6-88b1-4d1b9319a3f0_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Feabe18af1525459a99d1e32d05f4b9ca%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/eabe18af1525459a99d1e32d05f4b9ca/images/large/7.jpg saved to cache
2026-03-26 22:52:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a2e04f41-d376-5af6-88b1-4d1b9319a3f0
2026-03-26 22:52:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/005eb4c39fc74bef99fee218cd289d4e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F005eb4c39fc74bef99fee218cd289d4e%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/005eb4c39fc74bef99fee218cd289d4e/images/large/10.jpg not downloaded yet
2026-03-26 22:52:41 [ayvens.be] INFO: Found listing with ID: 1985479
2026-03-26 22:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985479%27 HTTP/1.1" 200 None
2026-03-26 22:52:41 [ayvens.be] INFO: Scrape type for 1985479: 1
2026-03-26 22:52:41 [ayvens.be] INFO: Extracting data for car ID: 1985479
2026-03-26 22:52:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877 with identifier: 1985479
2026-03-26 22:52:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877 with scrape type 1
2026-03-26 22:52:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877
2026-03-26 22:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F0a48022c8c7d4946bf226871d2adb535%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/0a48022c8c7d4946bf226871d2adb535/images/large/1.jpg not downloaded yet
2026-03-26 22:52:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/005eb4c39fc74bef99fee218cd289d4e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77475d0>
2026-03-26 22:52:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70e48b0d-73c6-561d-946b-a94fc8b7222f/70e48b0d-73c6-561d-946b-a94fc8b7222f_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F005eb4c39fc74bef99fee218cd289d4e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/005eb4c39fc74bef99fee218cd289d4e/images/large/1.jpg saved to cache
2026-03-26 22:52:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 70e48b0d-73c6-561d-946b-a94fc8b7222f
2026-03-26 22:52:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e4d890>
2026-03-26 22:52:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2e04f41-d376-5af6-88b1-4d1b9319a3f0/a2e04f41-d376-5af6-88b1-4d1b9319a3f0_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Feabe18af1525459a99d1e32d05f4b9ca%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/eabe18af1525459a99d1e32d05f4b9ca/images/large/8.jpg saved to cache
2026-03-26 22:52:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a2e04f41-d376-5af6-88b1-4d1b9319a3f0
2026-03-26 22:52:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/eabe18af1525459a99d1e32d05f4b9ca/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/eabe18af1525459a99d1e32d05f4b9ca/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/005eb4c39fc74bef99fee218cd289d4e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F0a48022c8c7d4946bf226871d2adb535%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/0a48022c8c7d4946bf226871d2adb535/images/large/2.jpg not downloaded yet
2026-03-26 22:52:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/005eb4c39fc74bef99fee218cd289d4e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/005eb4c39fc74bef99fee218cd289d4e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F0a48022c8c7d4946bf226871d2adb535%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/0a48022c8c7d4946bf226871d2adb535/images/large/3.jpg not downloaded yet
2026-03-26 22:52:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/005eb4c39fc74bef99fee218cd289d4e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76c6650>
2026-03-26 22:52:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70e48b0d-73c6-561d-946b-a94fc8b7222f/70e48b0d-73c6-561d-946b-a94fc8b7222f_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F005eb4c39fc74bef99fee218cd289d4e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/005eb4c39fc74bef99fee218cd289d4e/images/large/2.jpg saved to cache
2026-03-26 22:52:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 70e48b0d-73c6-561d-946b-a94fc8b7222f
2026-03-26 22:52:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7425390>
2026-03-26 22:52:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70e48b0d-73c6-561d-946b-a94fc8b7222f/70e48b0d-73c6-561d-946b-a94fc8b7222f_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F005eb4c39fc74bef99fee218cd289d4e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/005eb4c39fc74bef99fee218cd289d4e/images/large/3.jpg saved to cache
2026-03-26 22:52:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 70e48b0d-73c6-561d-946b-a94fc8b7222f
2026-03-26 22:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F0a48022c8c7d4946bf226871d2adb535%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/0a48022c8c7d4946bf226871d2adb535/images/large/4.jpg not downloaded yet
2026-03-26 22:52:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/005eb4c39fc74bef99fee218cd289d4e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F0a48022c8c7d4946bf226871d2adb535%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/0a48022c8c7d4946bf226871d2adb535/images/large/5.jpg not downloaded yet
2026-03-26 22:52:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7a55d90>
2026-03-26 22:52:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2e04f41-d376-5af6-88b1-4d1b9319a3f0/a2e04f41-d376-5af6-88b1-4d1b9319a3f0_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Feabe18af1525459a99d1e32d05f4b9ca%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/eabe18af1525459a99d1e32d05f4b9ca/images/large/9.jpg saved to cache
2026-03-26 22:52:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a2e04f41-d376-5af6-88b1-4d1b9319a3f0
2026-03-26 22:52:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74bd850>
2026-03-26 22:52:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2e04f41-d376-5af6-88b1-4d1b9319a3f0/a2e04f41-d376-5af6-88b1-4d1b9319a3f0_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Feabe18af1525459a99d1e32d05f4b9ca%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/eabe18af1525459a99d1e32d05f4b9ca/images/large/10.jpg saved to cache
2026-03-26 22:52:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a2e04f41-d376-5af6-88b1-4d1b9319a3f0
2026-03-26 22:52:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a2e04f41-d376-5af6-88b1-4d1b9319a3f0, skipping ID generation
2026-03-26 22:52:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2e04f41-d376-5af6-88b1-4d1b9319a3f0 with scrape type 1
2026-03-26 22:52:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a2e04f41-d376-5af6-88b1-4d1b9319a3f0 sending to next pipeline
2026-03-26 22:52:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a2e04f41-d376-5af6-88b1-4d1b9319a3f0, identifier: 1985477
2026-03-26 22:52:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7927510>
2026-03-26 22:52:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70e48b0d-73c6-561d-946b-a94fc8b7222f/70e48b0d-73c6-561d-946b-a94fc8b7222f_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F005eb4c39fc74bef99fee218cd289d4e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/005eb4c39fc74bef99fee218cd289d4e/images/large/4.jpg saved to cache
2026-03-26 22:52:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 70e48b0d-73c6-561d-946b-a94fc8b7222f
2026-03-26 22:52:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b78c3e90>
2026-03-26 22:52:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70e48b0d-73c6-561d-946b-a94fc8b7222f/70e48b0d-73c6-561d-946b-a94fc8b7222f_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F005eb4c39fc74bef99fee218cd289d4e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/005eb4c39fc74bef99fee218cd289d4e/images/large/5.jpg saved to cache
2026-03-26 22:52:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 70e48b0d-73c6-561d-946b-a94fc8b7222f
2026-03-26 22:52:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74af850>
2026-03-26 22:52:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70e48b0d-73c6-561d-946b-a94fc8b7222f/70e48b0d-73c6-561d-946b-a94fc8b7222f_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F005eb4c39fc74bef99fee218cd289d4e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/005eb4c39fc74bef99fee218cd289d4e/images/large/7.jpg saved to cache
2026-03-26 22:52:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 70e48b0d-73c6-561d-946b-a94fc8b7222f
2026-03-26 22:52:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7980ad0>
2026-03-26 22:52:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70e48b0d-73c6-561d-946b-a94fc8b7222f/70e48b0d-73c6-561d-946b-a94fc8b7222f_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F005eb4c39fc74bef99fee218cd289d4e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/005eb4c39fc74bef99fee218cd289d4e/images/large/6.jpg saved to cache
2026-03-26 22:52:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 70e48b0d-73c6-561d-946b-a94fc8b7222f
2026-03-26 22:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F0a48022c8c7d4946bf226871d2adb535%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/0a48022c8c7d4946bf226871d2adb535/images/large/6.jpg not downloaded yet
2026-03-26 22:52:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a2e04f41-d376-5af6-88b1-4d1b9319a3f0 with identifier: 1985477
2026-03-26 22:52:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a2e04f41-d376-5af6-88b1-4d1b9319a3f0 with identifier: 1985477
2026-03-26 22:52:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a2e04f41-d376-5af6-88b1-4d1b9319a3f0 with identifier: 1985477 to the API
2026-03-26 22:52:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:52:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:52:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bl/eabe18af1525459a99d1e32d05f4b9ca/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'a2e04f41-d376-5af6-88b1-4d1b9319a3f0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '3 SERIES TOURING',
 'odometer': 78299,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2e04f41-d376-5af6-88b1-4d1b9319a3f0/a2e04f41-d376-5af6-88b1-4d1b9319a3f0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 751831,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/eabe18af1525459a99d1e32d05f4b9ca/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2e04f41-d376-5af6-88b1-4d1b9319a3f0/a2e04f41-d376-5af6-88b1-4d1b9319a3f0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 759526,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/eabe18af1525459a99d1e32d05f4b9ca/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2e04f41-d376-5af6-88b1-4d1b9319a3f0/a2e04f41-d376-5af6-88b1-4d1b9319a3f0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 760508,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/eabe18af1525459a99d1e32d05f4b9ca/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2e04f41-d376-5af6-88b1-4d1b9319a3f0/a2e04f41-d376-5af6-88b1-4d1b9319a3f0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 804269,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/eabe18af1525459a99d1e32d05f4b9ca/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2e04f41-d376-5af6-88b1-4d1b9319a3f0/a2e04f41-d376-5af6-88b1-4d1b9319a3f0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 759891,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/eabe18af1525459a99d1e32d05f4b9ca/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2e04f41-d376-5af6-88b1-4d1b9319a3f0/a2e04f41-d376-5af6-88b1-4d1b9319a3f0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 811900,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/eabe18af1525459a99d1e32d05f4b9ca/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2e04f41-d376-5af6-88b1-4d1b9319a3f0/a2e04f41-d376-5af6-88b1-4d1b9319a3f0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 705439,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/eabe18af1525459a99d1e32d05f4b9ca/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2e04f41-d376-5af6-88b1-4d1b9319a3f0/a2e04f41-d376-5af6-88b1-4d1b9319a3f0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 892821,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/eabe18af1525459a99d1e32d05f4b9ca/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2e04f41-d376-5af6-88b1-4d1b9319a3f0/a2e04f41-d376-5af6-88b1-4d1b9319a3f0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 864674,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/eabe18af1525459a99d1e32d05f4b9ca/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2e04f41-d376-5af6-88b1-4d1b9319a3f0/a2e04f41-d376-5af6-88b1-4d1b9319a3f0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 855760,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/eabe18af1525459a99d1e32d05f4b9ca/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3 SERIES TOURING 2.0 320E TOURING',
 'transmission': 'automatic',
 'trim': '2.0 320E TOURING',
 'vin': None,
 'year': 2021}
2026-03-26 22:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985477%27 HTTP/1.1" 200 None
2026-03-26 22:52:43 [ayvens.be] INFO: Saving data for 1985477: {'created_time': 1774565563.543636, 'last_price_update_time': 1774565563.543646, 'auction_closing_time': 1774958400.0}
2026-03-26 22:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985477') HTTP/1.1" 204 0
2026-03-26 22:52:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/005eb4c39fc74bef99fee218cd289d4e/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F0a48022c8c7d4946bf226871d2adb535%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/0a48022c8c7d4946bf226871d2adb535/images/large/7.jpg not downloaded yet
2026-03-26 22:52:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76ecf50>
2026-03-26 22:52:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70e48b0d-73c6-561d-946b-a94fc8b7222f/70e48b0d-73c6-561d-946b-a94fc8b7222f_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F005eb4c39fc74bef99fee218cd289d4e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/005eb4c39fc74bef99fee218cd289d4e/images/large/8.jpg saved to cache
2026-03-26 22:52:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 70e48b0d-73c6-561d-946b-a94fc8b7222f
2026-03-26 22:52:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/0a48022c8c7d4946bf226871d2adb535/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F0a48022c8c7d4946bf226871d2adb535%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/0a48022c8c7d4946bf226871d2adb535/images/large/8.jpg not downloaded yet
2026-03-26 22:52:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/005eb4c39fc74bef99fee218cd289d4e/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F0a48022c8c7d4946bf226871d2adb535%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/0a48022c8c7d4946bf226871d2adb535/images/large/9.jpg not downloaded yet
2026-03-26 22:52:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd8d3190>
2026-03-26 22:52:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70e48b0d-73c6-561d-946b-a94fc8b7222f/70e48b0d-73c6-561d-946b-a94fc8b7222f_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F005eb4c39fc74bef99fee218cd289d4e%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/005eb4c39fc74bef99fee218cd289d4e/images/large/9.jpg saved to cache
2026-03-26 22:52:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 70e48b0d-73c6-561d-946b-a94fc8b7222f
2026-03-26 22:52:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/0a48022c8c7d4946bf226871d2adb535/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/0a48022c8c7d4946bf226871d2adb535/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F0a48022c8c7d4946bf226871d2adb535%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/0a48022c8c7d4946bf226871d2adb535/images/large/10.jpg not downloaded yet
2026-03-26 22:52:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/0a48022c8c7d4946bf226871d2adb535/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:43 [ayvens.be] INFO: Found listing with ID: 1985480
2026-03-26 22:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985480%27 HTTP/1.1" 200 None
2026-03-26 22:52:43 [ayvens.be] INFO: Scrape type for 1985480: 1
2026-03-26 22:52:43 [ayvens.be] INFO: Extracting data for car ID: 1985480
2026-03-26 22:52:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6fbcad31-cd3d-5d96-a553-22221415efe3 with identifier: 1985480
2026-03-26 22:52:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6fbcad31-cd3d-5d96-a553-22221415efe3 with scrape type 1
2026-03-26 22:52:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6fbcad31-cd3d-5d96-a553-22221415efe3
2026-03-26 22:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F88961cd752654ecba98e1c9e72604247%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/88961cd752654ecba98e1c9e72604247/images/large/1.jpg not downloaded yet
2026-03-26 22:52:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b777ae10>
2026-03-26 22:52:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877/e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F0a48022c8c7d4946bf226871d2adb535%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/0a48022c8c7d4946bf226871d2adb535/images/large/1.jpg saved to cache
2026-03-26 22:52:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877
2026-03-26 22:52:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7458150>
2026-03-26 22:52:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70e48b0d-73c6-561d-946b-a94fc8b7222f/70e48b0d-73c6-561d-946b-a94fc8b7222f_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F005eb4c39fc74bef99fee218cd289d4e%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/005eb4c39fc74bef99fee218cd289d4e/images/large/10.jpg saved to cache
2026-03-26 22:52:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 70e48b0d-73c6-561d-946b-a94fc8b7222f
2026-03-26 22:52:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 70e48b0d-73c6-561d-946b-a94fc8b7222f, skipping ID generation
2026-03-26 22:52:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70e48b0d-73c6-561d-946b-a94fc8b7222f with scrape type 1
2026-03-26 22:52:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 70e48b0d-73c6-561d-946b-a94fc8b7222f sending to next pipeline
2026-03-26 22:52:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 70e48b0d-73c6-561d-946b-a94fc8b7222f, identifier: 1985478
2026-03-26 22:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F88961cd752654ecba98e1c9e72604247%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/88961cd752654ecba98e1c9e72604247/images/large/2.jpg not downloaded yet
2026-03-26 22:52:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 70e48b0d-73c6-561d-946b-a94fc8b7222f with identifier: 1985478
2026-03-26 22:52:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 70e48b0d-73c6-561d-946b-a94fc8b7222f with identifier: 1985478
2026-03-26 22:52:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 70e48b0d-73c6-561d-946b-a94fc8b7222f with identifier: 1985478 to the API
2026-03-26 22:52:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:52:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:52:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bj/005eb4c39fc74bef99fee218cd289d4e/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '70e48b0d-73c6-561d-946b-a94fc8b7222f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLA - Klasse',
 'odometer': 49781,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70e48b0d-73c6-561d-946b-a94fc8b7222f/70e48b0d-73c6-561d-946b-a94fc8b7222f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 368825,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/005eb4c39fc74bef99fee218cd289d4e/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70e48b0d-73c6-561d-946b-a94fc8b7222f/70e48b0d-73c6-561d-946b-a94fc8b7222f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 455019,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/005eb4c39fc74bef99fee218cd289d4e/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70e48b0d-73c6-561d-946b-a94fc8b7222f/70e48b0d-73c6-561d-946b-a94fc8b7222f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 429665,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/005eb4c39fc74bef99fee218cd289d4e/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70e48b0d-73c6-561d-946b-a94fc8b7222f/70e48b0d-73c6-561d-946b-a94fc8b7222f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 461775,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/005eb4c39fc74bef99fee218cd289d4e/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70e48b0d-73c6-561d-946b-a94fc8b7222f/70e48b0d-73c6-561d-946b-a94fc8b7222f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 337864,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/005eb4c39fc74bef99fee218cd289d4e/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70e48b0d-73c6-561d-946b-a94fc8b7222f/70e48b0d-73c6-561d-946b-a94fc8b7222f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 234516,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/005eb4c39fc74bef99fee218cd289d4e/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70e48b0d-73c6-561d-946b-a94fc8b7222f/70e48b0d-73c6-561d-946b-a94fc8b7222f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 420647,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/005eb4c39fc74bef99fee218cd289d4e/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70e48b0d-73c6-561d-946b-a94fc8b7222f/70e48b0d-73c6-561d-946b-a94fc8b7222f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 384675,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/005eb4c39fc74bef99fee218cd289d4e/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70e48b0d-73c6-561d-946b-a94fc8b7222f/70e48b0d-73c6-561d-946b-a94fc8b7222f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 363875,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/005eb4c39fc74bef99fee218cd289d4e/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70e48b0d-73c6-561d-946b-a94fc8b7222f/70e48b0d-73c6-561d-946b-a94fc8b7222f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 542804,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/005eb4c39fc74bef99fee218cd289d4e/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLA - Klasse 1.3 CLA 180 BUSINESS SOLUTION',
 'transmission': 'manual',
 'trim': '1.3 CLA 180 BUSINESS SOLUTION',
 'vin': None,
 'year': 2021}
2026-03-26 22:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985478%27 HTTP/1.1" 200 None
2026-03-26 22:52:44 [ayvens.be] INFO: Saving data for 1985478: {'created_time': 1774565564.484065, 'last_price_update_time': 1774565564.484074, 'auction_closing_time': 1774958400.0}
2026-03-26 22:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985478') HTTP/1.1" 204 0
2026-03-26 22:52:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/0a48022c8c7d4946bf226871d2adb535/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F88961cd752654ecba98e1c9e72604247%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/88961cd752654ecba98e1c9e72604247/images/large/3.jpg not downloaded yet
2026-03-26 22:52:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/0a48022c8c7d4946bf226871d2adb535/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/0a48022c8c7d4946bf226871d2adb535/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/0a48022c8c7d4946bf226871d2adb535/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cbd290>
2026-03-26 22:52:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877/e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F0a48022c8c7d4946bf226871d2adb535%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/0a48022c8c7d4946bf226871d2adb535/images/large/3.jpg saved to cache
2026-03-26 22:52:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877
2026-03-26 22:52:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79261d0>
2026-03-26 22:52:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877/e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F0a48022c8c7d4946bf226871d2adb535%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/0a48022c8c7d4946bf226871d2adb535/images/large/2.jpg saved to cache
2026-03-26 22:52:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877
2026-03-26 22:52:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7492b10>
2026-03-26 22:52:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877/e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F0a48022c8c7d4946bf226871d2adb535%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/0a48022c8c7d4946bf226871d2adb535/images/large/4.jpg saved to cache
2026-03-26 22:52:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877
2026-03-26 22:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F88961cd752654ecba98e1c9e72604247%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/88961cd752654ecba98e1c9e72604247/images/large/4.jpg not downloaded yet
2026-03-26 22:52:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/0a48022c8c7d4946bf226871d2adb535/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F88961cd752654ecba98e1c9e72604247%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/88961cd752654ecba98e1c9e72604247/images/large/5.jpg not downloaded yet
2026-03-26 22:52:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e28350>
2026-03-26 22:52:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877/e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F0a48022c8c7d4946bf226871d2adb535%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/0a48022c8c7d4946bf226871d2adb535/images/large/5.jpg saved to cache
2026-03-26 22:52:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877
2026-03-26 22:52:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c96990>
2026-03-26 22:52:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877/e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F0a48022c8c7d4946bf226871d2adb535%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/0a48022c8c7d4946bf226871d2adb535/images/large/7.jpg saved to cache
2026-03-26 22:52:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877
2026-03-26 22:52:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7770410>
2026-03-26 22:52:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877/e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F0a48022c8c7d4946bf226871d2adb535%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/0a48022c8c7d4946bf226871d2adb535/images/large/6.jpg saved to cache
2026-03-26 22:52:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877
2026-03-26 22:52:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6dd89d0>
2026-03-26 22:52:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877/e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F0a48022c8c7d4946bf226871d2adb535%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/0a48022c8c7d4946bf226871d2adb535/images/large/9.jpg saved to cache
2026-03-26 22:52:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877
2026-03-26 22:52:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/88961cd752654ecba98e1c9e72604247/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F88961cd752654ecba98e1c9e72604247%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/88961cd752654ecba98e1c9e72604247/images/large/6.jpg not downloaded yet
2026-03-26 22:52:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/0a48022c8c7d4946bf226871d2adb535/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7439510>
2026-03-26 22:52:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877/e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F0a48022c8c7d4946bf226871d2adb535%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/0a48022c8c7d4946bf226871d2adb535/images/large/8.jpg saved to cache
2026-03-26 22:52:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877
2026-03-26 22:52:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/88961cd752654ecba98e1c9e72604247/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F88961cd752654ecba98e1c9e72604247%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/88961cd752654ecba98e1c9e72604247/images/large/7.jpg not downloaded yet
2026-03-26 22:52:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/88961cd752654ecba98e1c9e72604247/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F88961cd752654ecba98e1c9e72604247%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/88961cd752654ecba98e1c9e72604247/images/large/8.jpg not downloaded yet
2026-03-26 22:52:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd5b1790>
2026-03-26 22:52:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fbcad31-cd3d-5d96-a553-22221415efe3/6fbcad31-cd3d-5d96-a553-22221415efe3_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F88961cd752654ecba98e1c9e72604247%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/88961cd752654ecba98e1c9e72604247/images/large/1.jpg saved to cache
2026-03-26 22:52:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6fbcad31-cd3d-5d96-a553-22221415efe3
2026-03-26 22:52:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76cfd10>
2026-03-26 22:52:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877/e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F0a48022c8c7d4946bf226871d2adb535%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/0a48022c8c7d4946bf226871d2adb535/images/large/10.jpg saved to cache
2026-03-26 22:52:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877
2026-03-26 22:52:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877, skipping ID generation
2026-03-26 22:52:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877 with scrape type 1
2026-03-26 22:52:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877 sending to next pipeline
2026-03-26 22:52:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877, identifier: 1985479
2026-03-26 22:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F88961cd752654ecba98e1c9e72604247%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/88961cd752654ecba98e1c9e72604247/images/large/9.jpg not downloaded yet
2026-03-26 22:52:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877 with identifier: 1985479
2026-03-26 22:52:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877 with identifier: 1985479
2026-03-26 22:52:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877 with identifier: 1985479 to the API
2026-03-26 22:52:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:52:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:52:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bb/0a48022c8c7d4946bf226871d2adb535/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'KUGA',
 'odometer': 116744,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877/e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 517962,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/0a48022c8c7d4946bf226871d2adb535/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877/e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 501103,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/0a48022c8c7d4946bf226871d2adb535/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877/e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 493955,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/0a48022c8c7d4946bf226871d2adb535/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877/e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 495630,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/0a48022c8c7d4946bf226871d2adb535/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877/e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 351041,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/0a48022c8c7d4946bf226871d2adb535/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877/e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 338611,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/0a48022c8c7d4946bf226871d2adb535/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877/e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 436530,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/0a48022c8c7d4946bf226871d2adb535/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877/e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 354957,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/0a48022c8c7d4946bf226871d2adb535/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877/e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 215948,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/0a48022c8c7d4946bf226871d2adb535/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877/e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 312770,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/0a48022c8c7d4946bf226871d2adb535/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD KUGA 2.5I PHEV 165KW TITANIUM AUTO',
 'transmission': 'automatic',
 'trim': '2.5I PHEV 165KW TITANIUM AUTO',
 'vin': None,
 'year': 2021}
2026-03-26 22:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985479%27 HTTP/1.1" 200 None
2026-03-26 22:52:46 [ayvens.be] INFO: Saving data for 1985479: {'created_time': 1774565566.033916, 'last_price_update_time': 1774565566.033927, 'auction_closing_time': 1774958400.0}
2026-03-26 22:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985479') HTTP/1.1" 204 0
2026-03-26 22:52:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/88961cd752654ecba98e1c9e72604247/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e2ab90>
2026-03-26 22:52:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fbcad31-cd3d-5d96-a553-22221415efe3/6fbcad31-cd3d-5d96-a553-22221415efe3_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F88961cd752654ecba98e1c9e72604247%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/88961cd752654ecba98e1c9e72604247/images/large/2.jpg saved to cache
2026-03-26 22:52:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6fbcad31-cd3d-5d96-a553-22221415efe3
2026-03-26 22:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F88961cd752654ecba98e1c9e72604247%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/88961cd752654ecba98e1c9e72604247/images/large/10.jpg not downloaded yet
2026-03-26 22:52:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b728c310>
2026-03-26 22:52:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fbcad31-cd3d-5d96-a553-22221415efe3/6fbcad31-cd3d-5d96-a553-22221415efe3_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F88961cd752654ecba98e1c9e72604247%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/88961cd752654ecba98e1c9e72604247/images/large/3.jpg saved to cache
2026-03-26 22:52:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6fbcad31-cd3d-5d96-a553-22221415efe3
2026-03-26 22:52:46 [ayvens.be] INFO: Found listing with ID: 1985481
2026-03-26 22:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985481%27 HTTP/1.1" 200 None
2026-03-26 22:52:46 [ayvens.be] INFO: Scrape type for 1985481: 1
2026-03-26 22:52:46 [ayvens.be] INFO: Extracting data for car ID: 1985481
2026-03-26 22:52:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 09858042-af1c-5045-843b-0c8ae2be13f9 with identifier: 1985481
2026-03-26 22:52:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09858042-af1c-5045-843b-0c8ae2be13f9 with scrape type 1
2026-03-26 22:52:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 09858042-af1c-5045-843b-0c8ae2be13f9
2026-03-26 22:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F2b7bbbb9ef5c42f2a90b6bb90a12b88b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/2b7bbbb9ef5c42f2a90b6bb90a12b88b/images/large/1.jpg not downloaded yet
2026-03-26 22:52:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/88961cd752654ecba98e1c9e72604247/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/88961cd752654ecba98e1c9e72604247/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/88961cd752654ecba98e1c9e72604247/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F2b7bbbb9ef5c42f2a90b6bb90a12b88b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/2b7bbbb9ef5c42f2a90b6bb90a12b88b/images/large/2.jpg not downloaded yet
2026-03-26 22:52:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e3f390>
2026-03-26 22:52:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fbcad31-cd3d-5d96-a553-22221415efe3/6fbcad31-cd3d-5d96-a553-22221415efe3_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F88961cd752654ecba98e1c9e72604247%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/88961cd752654ecba98e1c9e72604247/images/large/4.jpg saved to cache
2026-03-26 22:52:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6fbcad31-cd3d-5d96-a553-22221415efe3
2026-03-26 22:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F2b7bbbb9ef5c42f2a90b6bb90a12b88b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/2b7bbbb9ef5c42f2a90b6bb90a12b88b/images/large/3.jpg not downloaded yet
2026-03-26 22:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F2b7bbbb9ef5c42f2a90b6bb90a12b88b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/2b7bbbb9ef5c42f2a90b6bb90a12b88b/images/large/4.jpg not downloaded yet
2026-03-26 22:52:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e2b310>
2026-03-26 22:52:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fbcad31-cd3d-5d96-a553-22221415efe3/6fbcad31-cd3d-5d96-a553-22221415efe3_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F88961cd752654ecba98e1c9e72604247%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/88961cd752654ecba98e1c9e72604247/images/large/5.jpg saved to cache
2026-03-26 22:52:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6fbcad31-cd3d-5d96-a553-22221415efe3
2026-03-26 22:52:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6df1410>
2026-03-26 22:52:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fbcad31-cd3d-5d96-a553-22221415efe3/6fbcad31-cd3d-5d96-a553-22221415efe3_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F88961cd752654ecba98e1c9e72604247%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/88961cd752654ecba98e1c9e72604247/images/large/6.jpg saved to cache
2026-03-26 22:52:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6fbcad31-cd3d-5d96-a553-22221415efe3
2026-03-26 22:52:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7a80510>
2026-03-26 22:52:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fbcad31-cd3d-5d96-a553-22221415efe3/6fbcad31-cd3d-5d96-a553-22221415efe3_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F88961cd752654ecba98e1c9e72604247%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/88961cd752654ecba98e1c9e72604247/images/large/7.jpg saved to cache
2026-03-26 22:52:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6fbcad31-cd3d-5d96-a553-22221415efe3
2026-03-26 22:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F2b7bbbb9ef5c42f2a90b6bb90a12b88b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/2b7bbbb9ef5c42f2a90b6bb90a12b88b/images/large/5.jpg not downloaded yet
2026-03-26 22:52:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/88961cd752654ecba98e1c9e72604247/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/88961cd752654ecba98e1c9e72604247/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F2b7bbbb9ef5c42f2a90b6bb90a12b88b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/2b7bbbb9ef5c42f2a90b6bb90a12b88b/images/large/6.jpg not downloaded yet
2026-03-26 22:52:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/88961cd752654ecba98e1c9e72604247/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F2b7bbbb9ef5c42f2a90b6bb90a12b88b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/2b7bbbb9ef5c42f2a90b6bb90a12b88b/images/large/7.jpg not downloaded yet
2026-03-26 22:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F2b7bbbb9ef5c42f2a90b6bb90a12b88b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/2b7bbbb9ef5c42f2a90b6bb90a12b88b/images/large/8.jpg not downloaded yet
2026-03-26 22:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F2b7bbbb9ef5c42f2a90b6bb90a12b88b%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/2b7bbbb9ef5c42f2a90b6bb90a12b88b/images/large/9.jpg not downloaded yet
2026-03-26 22:52:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/2b7bbbb9ef5c42f2a90b6bb90a12b88b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/2b7bbbb9ef5c42f2a90b6bb90a12b88b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F2b7bbbb9ef5c42f2a90b6bb90a12b88b%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/2b7bbbb9ef5c42f2a90b6bb90a12b88b/images/large/10.jpg not downloaded yet
2026-03-26 22:52:46 [ayvens.be] INFO: Found listing with ID: 1985482
2026-03-26 22:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985482%27 HTTP/1.1" 200 None
2026-03-26 22:52:46 [ayvens.be] INFO: Scrape type for 1985482: 1
2026-03-26 22:52:46 [ayvens.be] INFO: Extracting data for car ID: 1985482
2026-03-26 22:52:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0dfdf38a-a3e5-5784-828a-f0c31612ee66 with identifier: 1985482
2026-03-26 22:52:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0dfdf38a-a3e5-5784-828a-f0c31612ee66 with scrape type 1
2026-03-26 22:52:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0dfdf38a-a3e5-5784-828a-f0c31612ee66
2026-03-26 22:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F98a3d0896c414479a3560e8a9660542e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/98a3d0896c414479a3560e8a9660542e/images/large/1.jpg not downloaded yet
2026-03-26 22:52:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c5d850>
2026-03-26 22:52:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fbcad31-cd3d-5d96-a553-22221415efe3/6fbcad31-cd3d-5d96-a553-22221415efe3_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F88961cd752654ecba98e1c9e72604247%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/88961cd752654ecba98e1c9e72604247/images/large/8.jpg saved to cache
2026-03-26 22:52:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6fbcad31-cd3d-5d96-a553-22221415efe3
2026-03-26 22:52:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7aa1590>
2026-03-26 22:52:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fbcad31-cd3d-5d96-a553-22221415efe3/6fbcad31-cd3d-5d96-a553-22221415efe3_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F88961cd752654ecba98e1c9e72604247%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/88961cd752654ecba98e1c9e72604247/images/large/10.jpg saved to cache
2026-03-26 22:52:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6fbcad31-cd3d-5d96-a553-22221415efe3
2026-03-26 22:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F98a3d0896c414479a3560e8a9660542e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/98a3d0896c414479a3560e8a9660542e/images/large/2.jpg not downloaded yet
2026-03-26 22:52:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/2b7bbbb9ef5c42f2a90b6bb90a12b88b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F98a3d0896c414479a3560e8a9660542e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/98a3d0896c414479a3560e8a9660542e/images/large/3.jpg not downloaded yet
2026-03-26 22:52:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7404b50>
2026-03-26 22:52:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fbcad31-cd3d-5d96-a553-22221415efe3/6fbcad31-cd3d-5d96-a553-22221415efe3_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F88961cd752654ecba98e1c9e72604247%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/88961cd752654ecba98e1c9e72604247/images/large/9.jpg saved to cache
2026-03-26 22:52:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6fbcad31-cd3d-5d96-a553-22221415efe3
2026-03-26 22:52:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6fbcad31-cd3d-5d96-a553-22221415efe3, skipping ID generation
2026-03-26 22:52:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6fbcad31-cd3d-5d96-a553-22221415efe3 with scrape type 1
2026-03-26 22:52:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6fbcad31-cd3d-5d96-a553-22221415efe3 sending to next pipeline
2026-03-26 22:52:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 6fbcad31-cd3d-5d96-a553-22221415efe3, identifier: 1985480
2026-03-26 22:52:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80be148490>
2026-03-26 22:52:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09858042-af1c-5045-843b-0c8ae2be13f9/09858042-af1c-5045-843b-0c8ae2be13f9_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F2b7bbbb9ef5c42f2a90b6bb90a12b88b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/2b7bbbb9ef5c42f2a90b6bb90a12b88b/images/large/1.jpg saved to cache
2026-03-26 22:52:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 09858042-af1c-5045-843b-0c8ae2be13f9
2026-03-26 22:52:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b743abd0>
2026-03-26 22:52:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09858042-af1c-5045-843b-0c8ae2be13f9/09858042-af1c-5045-843b-0c8ae2be13f9_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F2b7bbbb9ef5c42f2a90b6bb90a12b88b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/2b7bbbb9ef5c42f2a90b6bb90a12b88b/images/large/2.jpg saved to cache
2026-03-26 22:52:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 09858042-af1c-5045-843b-0c8ae2be13f9
2026-03-26 22:52:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 6fbcad31-cd3d-5d96-a553-22221415efe3 with identifier: 1985480
2026-03-26 22:52:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 6fbcad31-cd3d-5d96-a553-22221415efe3 with identifier: 1985480
2026-03-26 22:52:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 6fbcad31-cd3d-5d96-a553-22221415efe3 with identifier: 1985480 to the API
2026-03-26 22:52:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:52:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:52:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bh/88961cd752654ecba98e1c9e72604247/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '6fbcad31-cd3d-5d96-a553-22221415efe3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'HYUNDAI',
 'model': 'Santa Fe',
 'odometer': 122389,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fbcad31-cd3d-5d96-a553-22221415efe3/6fbcad31-cd3d-5d96-a553-22221415efe3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 253883,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/88961cd752654ecba98e1c9e72604247/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fbcad31-cd3d-5d96-a553-22221415efe3/6fbcad31-cd3d-5d96-a553-22221415efe3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 244922,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/88961cd752654ecba98e1c9e72604247/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fbcad31-cd3d-5d96-a553-22221415efe3/6fbcad31-cd3d-5d96-a553-22221415efe3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 273191,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/88961cd752654ecba98e1c9e72604247/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fbcad31-cd3d-5d96-a553-22221415efe3/6fbcad31-cd3d-5d96-a553-22221415efe3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 280027,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/88961cd752654ecba98e1c9e72604247/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fbcad31-cd3d-5d96-a553-22221415efe3/6fbcad31-cd3d-5d96-a553-22221415efe3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 352013,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/88961cd752654ecba98e1c9e72604247/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fbcad31-cd3d-5d96-a553-22221415efe3/6fbcad31-cd3d-5d96-a553-22221415efe3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 326264,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/88961cd752654ecba98e1c9e72604247/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fbcad31-cd3d-5d96-a553-22221415efe3/6fbcad31-cd3d-5d96-a553-22221415efe3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 322019,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/88961cd752654ecba98e1c9e72604247/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fbcad31-cd3d-5d96-a553-22221415efe3/6fbcad31-cd3d-5d96-a553-22221415efe3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 399354,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/88961cd752654ecba98e1c9e72604247/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fbcad31-cd3d-5d96-a553-22221415efe3/6fbcad31-cd3d-5d96-a553-22221415efe3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 332472,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/88961cd752654ecba98e1c9e72604247/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fbcad31-cd3d-5d96-a553-22221415efe3/6fbcad31-cd3d-5d96-a553-22221415efe3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 290103,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/88961cd752654ecba98e1c9e72604247/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'HYUNDAI Santa Fe 1.6 T-GDI PHEV 4WD SHINE AUTO',
 'transmission': 'automatic',
 'trim': '1.6 T-GDI PHEV 4WD SHINE AUTO',
 'vin': None,
 'year': 2021}
2026-03-26 22:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985480%27 HTTP/1.1" 200 None
2026-03-26 22:52:47 [ayvens.be] INFO: Saving data for 1985480: {'created_time': 1774565567.878744, 'last_price_update_time': 1774565567.878755, 'auction_closing_time': 1774958400.0}
2026-03-26 22:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985480') HTTP/1.1" 204 0
2026-03-26 22:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F98a3d0896c414479a3560e8a9660542e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/98a3d0896c414479a3560e8a9660542e/images/large/4.jpg not downloaded yet
2026-03-26 22:52:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/2b7bbbb9ef5c42f2a90b6bb90a12b88b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/2b7bbbb9ef5c42f2a90b6bb90a12b88b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F98a3d0896c414479a3560e8a9660542e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/98a3d0896c414479a3560e8a9660542e/images/large/5.jpg not downloaded yet
2026-03-26 22:52:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c77b90>
2026-03-26 22:52:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09858042-af1c-5045-843b-0c8ae2be13f9/09858042-af1c-5045-843b-0c8ae2be13f9_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F2b7bbbb9ef5c42f2a90b6bb90a12b88b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/2b7bbbb9ef5c42f2a90b6bb90a12b88b/images/large/3.jpg saved to cache
2026-03-26 22:52:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 09858042-af1c-5045-843b-0c8ae2be13f9
2026-03-26 22:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F98a3d0896c414479a3560e8a9660542e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/98a3d0896c414479a3560e8a9660542e/images/large/6.jpg not downloaded yet
2026-03-26 22:52:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/2b7bbbb9ef5c42f2a90b6bb90a12b88b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F98a3d0896c414479a3560e8a9660542e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/98a3d0896c414479a3560e8a9660542e/images/large/7.jpg not downloaded yet
2026-03-26 22:52:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c95d10>
2026-03-26 22:52:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09858042-af1c-5045-843b-0c8ae2be13f9/09858042-af1c-5045-843b-0c8ae2be13f9_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F2b7bbbb9ef5c42f2a90b6bb90a12b88b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/2b7bbbb9ef5c42f2a90b6bb90a12b88b/images/large/5.jpg saved to cache
2026-03-26 22:52:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 09858042-af1c-5045-843b-0c8ae2be13f9
2026-03-26 22:52:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74b5d90>
2026-03-26 22:52:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09858042-af1c-5045-843b-0c8ae2be13f9/09858042-af1c-5045-843b-0c8ae2be13f9_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F2b7bbbb9ef5c42f2a90b6bb90a12b88b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/2b7bbbb9ef5c42f2a90b6bb90a12b88b/images/large/4.jpg saved to cache
2026-03-26 22:52:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 09858042-af1c-5045-843b-0c8ae2be13f9
2026-03-26 22:52:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/2b7bbbb9ef5c42f2a90b6bb90a12b88b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F98a3d0896c414479a3560e8a9660542e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/98a3d0896c414479a3560e8a9660542e/images/large/8.jpg not downloaded yet
2026-03-26 22:52:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/2b7bbbb9ef5c42f2a90b6bb90a12b88b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/2b7bbbb9ef5c42f2a90b6bb90a12b88b/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/98a3d0896c414479a3560e8a9660542e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F98a3d0896c414479a3560e8a9660542e%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/98a3d0896c414479a3560e8a9660542e/images/large/9.jpg not downloaded yet
2026-03-26 22:52:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79106d0>
2026-03-26 22:52:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09858042-af1c-5045-843b-0c8ae2be13f9/09858042-af1c-5045-843b-0c8ae2be13f9_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F2b7bbbb9ef5c42f2a90b6bb90a12b88b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/2b7bbbb9ef5c42f2a90b6bb90a12b88b/images/large/7.jpg saved to cache
2026-03-26 22:52:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 09858042-af1c-5045-843b-0c8ae2be13f9
2026-03-26 22:52:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/2b7bbbb9ef5c42f2a90b6bb90a12b88b/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F98a3d0896c414479a3560e8a9660542e%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/98a3d0896c414479a3560e8a9660542e/images/large/10.jpg not downloaded yet
2026-03-26 22:52:48 [ayvens.be] INFO: Found listing with ID: 1985483
2026-03-26 22:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985483%27 HTTP/1.1" 200 None
2026-03-26 22:52:48 [ayvens.be] INFO: Scrape type for 1985483: 1
2026-03-26 22:52:48 [ayvens.be] INFO: Extracting data for car ID: 1985483
2026-03-26 22:52:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 84ff5c32-098b-5760-9181-7ea2e0123afc with identifier: 1985483
2026-03-26 22:52:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84ff5c32-098b-5760-9181-7ea2e0123afc with scrape type 1
2026-03-26 22:52:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 84ff5c32-098b-5760-9181-7ea2e0123afc
2026-03-26 22:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Ffc5d988092cf4f208194e5eec46dfa76%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/fc5d988092cf4f208194e5eec46dfa76/images/large/1.jpg not downloaded yet
2026-03-26 22:52:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e1c150>
2026-03-26 22:52:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09858042-af1c-5045-843b-0c8ae2be13f9/09858042-af1c-5045-843b-0c8ae2be13f9_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F2b7bbbb9ef5c42f2a90b6bb90a12b88b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/2b7bbbb9ef5c42f2a90b6bb90a12b88b/images/large/6.jpg saved to cache
2026-03-26 22:52:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 09858042-af1c-5045-843b-0c8ae2be13f9
2026-03-26 22:52:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/98a3d0896c414479a3560e8a9660542e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Ffc5d988092cf4f208194e5eec46dfa76%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/fc5d988092cf4f208194e5eec46dfa76/images/large/2.jpg not downloaded yet
2026-03-26 22:52:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79d4d10>
2026-03-26 22:52:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09858042-af1c-5045-843b-0c8ae2be13f9/09858042-af1c-5045-843b-0c8ae2be13f9_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F2b7bbbb9ef5c42f2a90b6bb90a12b88b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/2b7bbbb9ef5c42f2a90b6bb90a12b88b/images/large/8.jpg saved to cache
2026-03-26 22:52:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 09858042-af1c-5045-843b-0c8ae2be13f9
2026-03-26 22:52:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b728e090>
2026-03-26 22:52:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09858042-af1c-5045-843b-0c8ae2be13f9/09858042-af1c-5045-843b-0c8ae2be13f9_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F2b7bbbb9ef5c42f2a90b6bb90a12b88b%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/2b7bbbb9ef5c42f2a90b6bb90a12b88b/images/large/9.jpg saved to cache
2026-03-26 22:52:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 09858042-af1c-5045-843b-0c8ae2be13f9
2026-03-26 22:52:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76e2bd0>
2026-03-26 22:52:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0dfdf38a-a3e5-5784-828a-f0c31612ee66/0dfdf38a-a3e5-5784-828a-f0c31612ee66_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F98a3d0896c414479a3560e8a9660542e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/98a3d0896c414479a3560e8a9660542e/images/large/1.jpg saved to cache
2026-03-26 22:52:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0dfdf38a-a3e5-5784-828a-f0c31612ee66
2026-03-26 22:52:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/98a3d0896c414479a3560e8a9660542e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Ffc5d988092cf4f208194e5eec46dfa76%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/fc5d988092cf4f208194e5eec46dfa76/images/large/3.jpg not downloaded yet
2026-03-26 22:52:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd857150>
2026-03-26 22:52:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09858042-af1c-5045-843b-0c8ae2be13f9/09858042-af1c-5045-843b-0c8ae2be13f9_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F2b7bbbb9ef5c42f2a90b6bb90a12b88b%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/2b7bbbb9ef5c42f2a90b6bb90a12b88b/images/large/10.jpg saved to cache
2026-03-26 22:52:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 09858042-af1c-5045-843b-0c8ae2be13f9
2026-03-26 22:52:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 09858042-af1c-5045-843b-0c8ae2be13f9, skipping ID generation
2026-03-26 22:52:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09858042-af1c-5045-843b-0c8ae2be13f9 with scrape type 1
2026-03-26 22:52:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 09858042-af1c-5045-843b-0c8ae2be13f9 sending to next pipeline
2026-03-26 22:52:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 09858042-af1c-5045-843b-0c8ae2be13f9, identifier: 1985481
2026-03-26 22:52:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e36890>
2026-03-26 22:52:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0dfdf38a-a3e5-5784-828a-f0c31612ee66/0dfdf38a-a3e5-5784-828a-f0c31612ee66_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F98a3d0896c414479a3560e8a9660542e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/98a3d0896c414479a3560e8a9660542e/images/large/3.jpg saved to cache
2026-03-26 22:52:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0dfdf38a-a3e5-5784-828a-f0c31612ee66
2026-03-26 22:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Ffc5d988092cf4f208194e5eec46dfa76%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/fc5d988092cf4f208194e5eec46dfa76/images/large/4.jpg not downloaded yet
2026-03-26 22:52:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 09858042-af1c-5045-843b-0c8ae2be13f9 with identifier: 1985481
2026-03-26 22:52:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 09858042-af1c-5045-843b-0c8ae2be13f9 with identifier: 1985481
2026-03-26 22:52:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 09858042-af1c-5045-843b-0c8ae2be13f9 with identifier: 1985481 to the API
2026-03-26 22:52:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:52:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:52:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bn/2b7bbbb9ef5c42f2a90b6bb90a12b88b/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '09858042-af1c-5045-843b-0c8ae2be13f9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '2-serie',
 'odometer': 112080,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09858042-af1c-5045-843b-0c8ae2be13f9/09858042-af1c-5045-843b-0c8ae2be13f9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 701953,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/2b7bbbb9ef5c42f2a90b6bb90a12b88b/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09858042-af1c-5045-843b-0c8ae2be13f9/09858042-af1c-5045-843b-0c8ae2be13f9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 671965,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/2b7bbbb9ef5c42f2a90b6bb90a12b88b/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09858042-af1c-5045-843b-0c8ae2be13f9/09858042-af1c-5045-843b-0c8ae2be13f9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 664881,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/2b7bbbb9ef5c42f2a90b6bb90a12b88b/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09858042-af1c-5045-843b-0c8ae2be13f9/09858042-af1c-5045-843b-0c8ae2be13f9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 721425,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/2b7bbbb9ef5c42f2a90b6bb90a12b88b/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09858042-af1c-5045-843b-0c8ae2be13f9/09858042-af1c-5045-843b-0c8ae2be13f9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 692818,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/2b7bbbb9ef5c42f2a90b6bb90a12b88b/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09858042-af1c-5045-843b-0c8ae2be13f9/09858042-af1c-5045-843b-0c8ae2be13f9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 750189,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/2b7bbbb9ef5c42f2a90b6bb90a12b88b/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09858042-af1c-5045-843b-0c8ae2be13f9/09858042-af1c-5045-843b-0c8ae2be13f9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 631709,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/2b7bbbb9ef5c42f2a90b6bb90a12b88b/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09858042-af1c-5045-843b-0c8ae2be13f9/09858042-af1c-5045-843b-0c8ae2be13f9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 889230,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/2b7bbbb9ef5c42f2a90b6bb90a12b88b/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09858042-af1c-5045-843b-0c8ae2be13f9/09858042-af1c-5045-843b-0c8ae2be13f9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 861385,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/2b7bbbb9ef5c42f2a90b6bb90a12b88b/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09858042-af1c-5045-843b-0c8ae2be13f9/09858042-af1c-5045-843b-0c8ae2be13f9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 826463,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/2b7bbbb9ef5c42f2a90b6bb90a12b88b/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 2-serie 1.5 216DA GRAN COUPE',
 'transmission': 'automatic',
 'trim': '1.5 216DA GRAN COUPE',
 'vin': None,
 'year': 2022}
2026-03-26 22:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985481%27 HTTP/1.1" 200 None
2026-03-26 22:52:49 [ayvens.be] INFO: Saving data for 1985481: {'created_time': 1774565569.450281, 'last_price_update_time': 1774565569.450291, 'auction_closing_time': 1774958400.0}
2026-03-26 22:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985481') HTTP/1.1" 204 0
2026-03-26 22:52:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/98a3d0896c414479a3560e8a9660542e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Ffc5d988092cf4f208194e5eec46dfa76%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/fc5d988092cf4f208194e5eec46dfa76/images/large/5.jpg not downloaded yet
2026-03-26 22:52:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b745aad0>
2026-03-26 22:52:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0dfdf38a-a3e5-5784-828a-f0c31612ee66/0dfdf38a-a3e5-5784-828a-f0c31612ee66_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F98a3d0896c414479a3560e8a9660542e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/98a3d0896c414479a3560e8a9660542e/images/large/2.jpg saved to cache
2026-03-26 22:52:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0dfdf38a-a3e5-5784-828a-f0c31612ee66
2026-03-26 22:52:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/98a3d0896c414479a3560e8a9660542e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/98a3d0896c414479a3560e8a9660542e/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Ffc5d988092cf4f208194e5eec46dfa76%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/fc5d988092cf4f208194e5eec46dfa76/images/large/6.jpg not downloaded yet
2026-03-26 22:52:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/98a3d0896c414479a3560e8a9660542e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/98a3d0896c414479a3560e8a9660542e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/98a3d0896c414479a3560e8a9660542e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Ffc5d988092cf4f208194e5eec46dfa76%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/fc5d988092cf4f208194e5eec46dfa76/images/large/7.jpg not downloaded yet
2026-03-26 22:52:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c69710>
2026-03-26 22:52:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0dfdf38a-a3e5-5784-828a-f0c31612ee66/0dfdf38a-a3e5-5784-828a-f0c31612ee66_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F98a3d0896c414479a3560e8a9660542e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/98a3d0896c414479a3560e8a9660542e/images/large/6.jpg saved to cache
2026-03-26 22:52:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0dfdf38a-a3e5-5784-828a-f0c31612ee66
2026-03-26 22:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Ffc5d988092cf4f208194e5eec46dfa76%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/fc5d988092cf4f208194e5eec46dfa76/images/large/8.jpg not downloaded yet
2026-03-26 22:52:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/98a3d0896c414479a3560e8a9660542e/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Ffc5d988092cf4f208194e5eec46dfa76%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/fc5d988092cf4f208194e5eec46dfa76/images/large/9.jpg not downloaded yet
2026-03-26 22:52:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/fc5d988092cf4f208194e5eec46dfa76/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74a4710>
2026-03-26 22:52:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0dfdf38a-a3e5-5784-828a-f0c31612ee66/0dfdf38a-a3e5-5784-828a-f0c31612ee66_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F98a3d0896c414479a3560e8a9660542e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/98a3d0896c414479a3560e8a9660542e/images/large/5.jpg saved to cache
2026-03-26 22:52:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0dfdf38a-a3e5-5784-828a-f0c31612ee66
2026-03-26 22:52:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e4cd50>
2026-03-26 22:52:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0dfdf38a-a3e5-5784-828a-f0c31612ee66/0dfdf38a-a3e5-5784-828a-f0c31612ee66_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F98a3d0896c414479a3560e8a9660542e%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/98a3d0896c414479a3560e8a9660542e/images/large/9.jpg saved to cache
2026-03-26 22:52:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0dfdf38a-a3e5-5784-828a-f0c31612ee66
2026-03-26 22:52:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7744f50>
2026-03-26 22:52:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0dfdf38a-a3e5-5784-828a-f0c31612ee66/0dfdf38a-a3e5-5784-828a-f0c31612ee66_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F98a3d0896c414479a3560e8a9660542e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/98a3d0896c414479a3560e8a9660542e/images/large/4.jpg saved to cache
2026-03-26 22:52:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0dfdf38a-a3e5-5784-828a-f0c31612ee66
2026-03-26 22:52:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7424e90>
2026-03-26 22:52:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0dfdf38a-a3e5-5784-828a-f0c31612ee66/0dfdf38a-a3e5-5784-828a-f0c31612ee66_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F98a3d0896c414479a3560e8a9660542e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/98a3d0896c414479a3560e8a9660542e/images/large/7.jpg saved to cache
2026-03-26 22:52:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0dfdf38a-a3e5-5784-828a-f0c31612ee66
2026-03-26 22:52:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7494e10>
2026-03-26 22:52:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0dfdf38a-a3e5-5784-828a-f0c31612ee66/0dfdf38a-a3e5-5784-828a-f0c31612ee66_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F98a3d0896c414479a3560e8a9660542e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/98a3d0896c414479a3560e8a9660542e/images/large/8.jpg saved to cache
2026-03-26 22:52:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0dfdf38a-a3e5-5784-828a-f0c31612ee66
2026-03-26 22:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Ffc5d988092cf4f208194e5eec46dfa76%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/fc5d988092cf4f208194e5eec46dfa76/images/large/10.jpg not downloaded yet
2026-03-26 22:52:50 [ayvens.be] INFO: Found listing with ID: 1985484
2026-03-26 22:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985484%27 HTTP/1.1" 200 None
2026-03-26 22:52:50 [ayvens.be] INFO: Scrape type for 1985484: 1
2026-03-26 22:52:50 [ayvens.be] INFO: Extracting data for car ID: 1985484
2026-03-26 22:52:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e32f3c2-1201-53f9-a2fc-ea44d56970a7 with identifier: 1985484
2026-03-26 22:52:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e32f3c2-1201-53f9-a2fc-ea44d56970a7 with scrape type 1
2026-03-26 22:52:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8e32f3c2-1201-53f9-a2fc-ea44d56970a7
2026-03-26 22:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252Fdb3c6a90630e4108ad535982af3c3536%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/db3c6a90630e4108ad535982af3c3536/images/large/1.jpg not downloaded yet
2026-03-26 22:52:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6df11d0>
2026-03-26 22:52:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0dfdf38a-a3e5-5784-828a-f0c31612ee66/0dfdf38a-a3e5-5784-828a-f0c31612ee66_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F98a3d0896c414479a3560e8a9660542e%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/98a3d0896c414479a3560e8a9660542e/images/large/10.jpg saved to cache
2026-03-26 22:52:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0dfdf38a-a3e5-5784-828a-f0c31612ee66
2026-03-26 22:52:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0dfdf38a-a3e5-5784-828a-f0c31612ee66, skipping ID generation
2026-03-26 22:52:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0dfdf38a-a3e5-5784-828a-f0c31612ee66 with scrape type 1
2026-03-26 22:52:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0dfdf38a-a3e5-5784-828a-f0c31612ee66 sending to next pipeline
2026-03-26 22:52:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 0dfdf38a-a3e5-5784-828a-f0c31612ee66, identifier: 1985482
2026-03-26 22:52:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7ae9410>
2026-03-26 22:52:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84ff5c32-098b-5760-9181-7ea2e0123afc/84ff5c32-098b-5760-9181-7ea2e0123afc_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Ffc5d988092cf4f208194e5eec46dfa76%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/fc5d988092cf4f208194e5eec46dfa76/images/large/1.jpg saved to cache
2026-03-26 22:52:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 84ff5c32-098b-5760-9181-7ea2e0123afc
2026-03-26 22:52:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 0dfdf38a-a3e5-5784-828a-f0c31612ee66 with identifier: 1985482
2026-03-26 22:52:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 0dfdf38a-a3e5-5784-828a-f0c31612ee66 with identifier: 1985482
2026-03-26 22:52:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 0dfdf38a-a3e5-5784-828a-f0c31612ee66 with identifier: 1985482 to the API
2026-03-26 22:52:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:52:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:52:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bv/98a3d0896c414479a3560e8a9660542e/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '0dfdf38a-a3e5-5784-828a-f0c31612ee66',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X2',
 'odometer': 42466,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0dfdf38a-a3e5-5784-828a-f0c31612ee66/0dfdf38a-a3e5-5784-828a-f0c31612ee66_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 525395,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/98a3d0896c414479a3560e8a9660542e/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0dfdf38a-a3e5-5784-828a-f0c31612ee66/0dfdf38a-a3e5-5784-828a-f0c31612ee66_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 611361,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/98a3d0896c414479a3560e8a9660542e/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0dfdf38a-a3e5-5784-828a-f0c31612ee66/0dfdf38a-a3e5-5784-828a-f0c31612ee66_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 571701,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/98a3d0896c414479a3560e8a9660542e/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0dfdf38a-a3e5-5784-828a-f0c31612ee66/0dfdf38a-a3e5-5784-828a-f0c31612ee66_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 662801,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/98a3d0896c414479a3560e8a9660542e/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0dfdf38a-a3e5-5784-828a-f0c31612ee66/0dfdf38a-a3e5-5784-828a-f0c31612ee66_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 627043,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/98a3d0896c414479a3560e8a9660542e/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0dfdf38a-a3e5-5784-828a-f0c31612ee66/0dfdf38a-a3e5-5784-828a-f0c31612ee66_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 523425,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/98a3d0896c414479a3560e8a9660542e/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0dfdf38a-a3e5-5784-828a-f0c31612ee66/0dfdf38a-a3e5-5784-828a-f0c31612ee66_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 606794,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/98a3d0896c414479a3560e8a9660542e/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0dfdf38a-a3e5-5784-828a-f0c31612ee66/0dfdf38a-a3e5-5784-828a-f0c31612ee66_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 681944,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/98a3d0896c414479a3560e8a9660542e/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0dfdf38a-a3e5-5784-828a-f0c31612ee66/0dfdf38a-a3e5-5784-828a-f0c31612ee66_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 560114,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/98a3d0896c414479a3560e8a9660542e/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0dfdf38a-a3e5-5784-828a-f0c31612ee66/0dfdf38a-a3e5-5784-828a-f0c31612ee66_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 529329,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/98a3d0896c414479a3560e8a9660542e/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X2 1.5 XDRIVE25E PHEV 162KW)',
 'transmission': 'automatic',
 'trim': '1.5 XDRIVE25E PHEV 162KW)',
 'vin': None,
 'year': 2022}
2026-03-26 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985482%27 HTTP/1.1" 200 None
2026-03-26 22:52:51 [ayvens.be] INFO: Saving data for 1985482: {'created_time': 1774565571.1105, 'last_price_update_time': 1774565571.11051, 'auction_closing_time': 1774958400.0}
2026-03-26 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985482') HTTP/1.1" 204 0
2026-03-26 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252Fdb3c6a90630e4108ad535982af3c3536%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/db3c6a90630e4108ad535982af3c3536/images/large/2.jpg not downloaded yet
2026-03-26 22:52:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/fc5d988092cf4f208194e5eec46dfa76/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252Fdb3c6a90630e4108ad535982af3c3536%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/db3c6a90630e4108ad535982af3c3536/images/large/3.jpg not downloaded yet
2026-03-26 22:52:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/fc5d988092cf4f208194e5eec46dfa76/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252Fdb3c6a90630e4108ad535982af3c3536%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/db3c6a90630e4108ad535982af3c3536/images/large/4.jpg not downloaded yet
2026-03-26 22:52:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/fc5d988092cf4f208194e5eec46dfa76/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/fc5d988092cf4f208194e5eec46dfa76/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/fc5d988092cf4f208194e5eec46dfa76/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/fc5d988092cf4f208194e5eec46dfa76/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252Fdb3c6a90630e4108ad535982af3c3536%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/db3c6a90630e4108ad535982af3c3536/images/large/5.jpg not downloaded yet
2026-03-26 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252Fdb3c6a90630e4108ad535982af3c3536%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/db3c6a90630e4108ad535982af3c3536/images/large/6.jpg not downloaded yet
2026-03-26 22:52:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/fc5d988092cf4f208194e5eec46dfa76/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/fc5d988092cf4f208194e5eec46dfa76/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252Fdb3c6a90630e4108ad535982af3c3536%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/db3c6a90630e4108ad535982af3c3536/images/large/7.jpg not downloaded yet
2026-03-26 22:52:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77c9290>
2026-03-26 22:52:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84ff5c32-098b-5760-9181-7ea2e0123afc/84ff5c32-098b-5760-9181-7ea2e0123afc_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Ffc5d988092cf4f208194e5eec46dfa76%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/fc5d988092cf4f208194e5eec46dfa76/images/large/2.jpg saved to cache
2026-03-26 22:52:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 84ff5c32-098b-5760-9181-7ea2e0123afc
2026-03-26 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252Fdb3c6a90630e4108ad535982af3c3536%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/db3c6a90630e4108ad535982af3c3536/images/large/8.jpg not downloaded yet
2026-03-26 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252Fdb3c6a90630e4108ad535982af3c3536%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/db3c6a90630e4108ad535982af3c3536/images/large/9.jpg not downloaded yet
2026-03-26 22:52:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e2bb50>
2026-03-26 22:52:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84ff5c32-098b-5760-9181-7ea2e0123afc/84ff5c32-098b-5760-9181-7ea2e0123afc_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Ffc5d988092cf4f208194e5eec46dfa76%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/fc5d988092cf4f208194e5eec46dfa76/images/large/5.jpg saved to cache
2026-03-26 22:52:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 84ff5c32-098b-5760-9181-7ea2e0123afc
2026-03-26 22:52:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7aa1650>
2026-03-26 22:52:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84ff5c32-098b-5760-9181-7ea2e0123afc/84ff5c32-098b-5760-9181-7ea2e0123afc_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Ffc5d988092cf4f208194e5eec46dfa76%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/fc5d988092cf4f208194e5eec46dfa76/images/large/3.jpg saved to cache
2026-03-26 22:52:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 84ff5c32-098b-5760-9181-7ea2e0123afc
2026-03-26 22:52:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76e0a90>
2026-03-26 22:52:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84ff5c32-098b-5760-9181-7ea2e0123afc/84ff5c32-098b-5760-9181-7ea2e0123afc_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Ffc5d988092cf4f208194e5eec46dfa76%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/fc5d988092cf4f208194e5eec46dfa76/images/large/4.jpg saved to cache
2026-03-26 22:52:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 84ff5c32-098b-5760-9181-7ea2e0123afc
2026-03-26 22:52:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74be450>
2026-03-26 22:52:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84ff5c32-098b-5760-9181-7ea2e0123afc/84ff5c32-098b-5760-9181-7ea2e0123afc_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Ffc5d988092cf4f208194e5eec46dfa76%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/fc5d988092cf4f208194e5eec46dfa76/images/large/6.jpg saved to cache
2026-03-26 22:52:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 84ff5c32-098b-5760-9181-7ea2e0123afc
2026-03-26 22:52:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7aa2910>
2026-03-26 22:52:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84ff5c32-098b-5760-9181-7ea2e0123afc/84ff5c32-098b-5760-9181-7ea2e0123afc_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Ffc5d988092cf4f208194e5eec46dfa76%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/fc5d988092cf4f208194e5eec46dfa76/images/large/7.jpg saved to cache
2026-03-26 22:52:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 84ff5c32-098b-5760-9181-7ea2e0123afc
2026-03-26 22:52:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dd/db3c6a90630e4108ad535982af3c3536/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252Fdb3c6a90630e4108ad535982af3c3536%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/db3c6a90630e4108ad535982af3c3536/images/large/10.jpg not downloaded yet
2026-03-26 22:52:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74bfdd0>
2026-03-26 22:52:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84ff5c32-098b-5760-9181-7ea2e0123afc/84ff5c32-098b-5760-9181-7ea2e0123afc_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Ffc5d988092cf4f208194e5eec46dfa76%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/fc5d988092cf4f208194e5eec46dfa76/images/large/9.jpg saved to cache
2026-03-26 22:52:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 84ff5c32-098b-5760-9181-7ea2e0123afc
2026-03-26 22:52:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7747610>
2026-03-26 22:52:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84ff5c32-098b-5760-9181-7ea2e0123afc/84ff5c32-098b-5760-9181-7ea2e0123afc_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Ffc5d988092cf4f208194e5eec46dfa76%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/fc5d988092cf4f208194e5eec46dfa76/images/large/8.jpg saved to cache
2026-03-26 22:52:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 84ff5c32-098b-5760-9181-7ea2e0123afc
2026-03-26 22:52:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dd/db3c6a90630e4108ad535982af3c3536/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dd/db3c6a90630e4108ad535982af3c3536/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dd/db3c6a90630e4108ad535982af3c3536/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:52 [ayvens.be] INFO: Found listing with ID: 1985485
2026-03-26 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985485%27 HTTP/1.1" 200 None
2026-03-26 22:52:52 [ayvens.be] INFO: Scrape type for 1985485: 1
2026-03-26 22:52:52 [ayvens.be] INFO: Extracting data for car ID: 1985485
2026-03-26 22:52:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4861b22-3a31-5b05-984b-5666753bb4c0 with identifier: 1985485
2026-03-26 22:52:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4861b22-3a31-5b05-984b-5666753bb4c0 with scrape type 1
2026-03-26 22:52:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b4861b22-3a31-5b05-984b-5666753bb4c0
2026-03-26 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252Fb44b14985ff4413580b2eb5860c73c1e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/b44b14985ff4413580b2eb5860c73c1e/images/large/1.jpg not downloaded yet
2026-03-26 22:52:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dd/db3c6a90630e4108ad535982af3c3536/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/fc5d988092cf4f208194e5eec46dfa76/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252Fb44b14985ff4413580b2eb5860c73c1e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/b44b14985ff4413580b2eb5860c73c1e/images/large/2.jpg not downloaded yet
2026-03-26 22:52:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74df850>
2026-03-26 22:52:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e32f3c2-1201-53f9-a2fc-ea44d56970a7/8e32f3c2-1201-53f9-a2fc-ea44d56970a7_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252Fdb3c6a90630e4108ad535982af3c3536%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/db3c6a90630e4108ad535982af3c3536/images/large/1.jpg saved to cache
2026-03-26 22:52:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8e32f3c2-1201-53f9-a2fc-ea44d56970a7
2026-03-26 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252Fb44b14985ff4413580b2eb5860c73c1e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/b44b14985ff4413580b2eb5860c73c1e/images/large/3.jpg not downloaded yet
2026-03-26 22:52:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dd/db3c6a90630e4108ad535982af3c3536/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dd/db3c6a90630e4108ad535982af3c3536/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b787cb50>
2026-03-26 22:52:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e32f3c2-1201-53f9-a2fc-ea44d56970a7/8e32f3c2-1201-53f9-a2fc-ea44d56970a7_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252Fdb3c6a90630e4108ad535982af3c3536%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/db3c6a90630e4108ad535982af3c3536/images/large/4.jpg saved to cache
2026-03-26 22:52:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8e32f3c2-1201-53f9-a2fc-ea44d56970a7
2026-03-26 22:52:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74ae710>
2026-03-26 22:52:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e32f3c2-1201-53f9-a2fc-ea44d56970a7/8e32f3c2-1201-53f9-a2fc-ea44d56970a7_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252Fdb3c6a90630e4108ad535982af3c3536%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/db3c6a90630e4108ad535982af3c3536/images/large/3.jpg saved to cache
2026-03-26 22:52:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8e32f3c2-1201-53f9-a2fc-ea44d56970a7
2026-03-26 22:52:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7304450>
2026-03-26 22:52:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e32f3c2-1201-53f9-a2fc-ea44d56970a7/8e32f3c2-1201-53f9-a2fc-ea44d56970a7_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252Fdb3c6a90630e4108ad535982af3c3536%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/db3c6a90630e4108ad535982af3c3536/images/large/2.jpg saved to cache
2026-03-26 22:52:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8e32f3c2-1201-53f9-a2fc-ea44d56970a7
2026-03-26 22:52:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7ca9010>
2026-03-26 22:52:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e32f3c2-1201-53f9-a2fc-ea44d56970a7/8e32f3c2-1201-53f9-a2fc-ea44d56970a7_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252Fdb3c6a90630e4108ad535982af3c3536%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/db3c6a90630e4108ad535982af3c3536/images/large/5.jpg saved to cache
2026-03-26 22:52:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8e32f3c2-1201-53f9-a2fc-ea44d56970a7
2026-03-26 22:52:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dd/db3c6a90630e4108ad535982af3c3536/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252Fb44b14985ff4413580b2eb5860c73c1e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/b44b14985ff4413580b2eb5860c73c1e/images/large/4.jpg not downloaded yet
2026-03-26 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252Fb44b14985ff4413580b2eb5860c73c1e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/b44b14985ff4413580b2eb5860c73c1e/images/large/5.jpg not downloaded yet
2026-03-26 22:52:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c81250>
2026-03-26 22:52:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84ff5c32-098b-5760-9181-7ea2e0123afc/84ff5c32-098b-5760-9181-7ea2e0123afc_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Ffc5d988092cf4f208194e5eec46dfa76%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/fc5d988092cf4f208194e5eec46dfa76/images/large/10.jpg saved to cache
2026-03-26 22:52:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 84ff5c32-098b-5760-9181-7ea2e0123afc
2026-03-26 22:52:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 84ff5c32-098b-5760-9181-7ea2e0123afc, skipping ID generation
2026-03-26 22:52:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84ff5c32-098b-5760-9181-7ea2e0123afc with scrape type 1
2026-03-26 22:52:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 84ff5c32-098b-5760-9181-7ea2e0123afc sending to next pipeline
2026-03-26 22:52:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 84ff5c32-098b-5760-9181-7ea2e0123afc, identifier: 1985483
2026-03-26 22:52:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76e2fd0>
2026-03-26 22:52:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e32f3c2-1201-53f9-a2fc-ea44d56970a7/8e32f3c2-1201-53f9-a2fc-ea44d56970a7_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252Fdb3c6a90630e4108ad535982af3c3536%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/db3c6a90630e4108ad535982af3c3536/images/large/7.jpg saved to cache
2026-03-26 22:52:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8e32f3c2-1201-53f9-a2fc-ea44d56970a7
2026-03-26 22:52:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7746e50>
2026-03-26 22:52:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e32f3c2-1201-53f9-a2fc-ea44d56970a7/8e32f3c2-1201-53f9-a2fc-ea44d56970a7_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252Fdb3c6a90630e4108ad535982af3c3536%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/db3c6a90630e4108ad535982af3c3536/images/large/6.jpg saved to cache
2026-03-26 22:52:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8e32f3c2-1201-53f9-a2fc-ea44d56970a7
2026-03-26 22:52:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 84ff5c32-098b-5760-9181-7ea2e0123afc with identifier: 1985483
2026-03-26 22:52:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 84ff5c32-098b-5760-9181-7ea2e0123afc with identifier: 1985483
2026-03-26 22:52:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 84ff5c32-098b-5760-9181-7ea2e0123afc with identifier: 1985483 to the API
2026-03-26 22:52:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:52:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:52:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2br/fc5d988092cf4f208194e5eec46dfa76/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'electric',
 'id': '84ff5c32-098b-5760-9181-7ea2e0123afc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'EQB',
 'odometer': 49153,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84ff5c32-098b-5760-9181-7ea2e0123afc/84ff5c32-098b-5760-9181-7ea2e0123afc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 718556,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/fc5d988092cf4f208194e5eec46dfa76/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84ff5c32-098b-5760-9181-7ea2e0123afc/84ff5c32-098b-5760-9181-7ea2e0123afc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 694177,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/fc5d988092cf4f208194e5eec46dfa76/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84ff5c32-098b-5760-9181-7ea2e0123afc/84ff5c32-098b-5760-9181-7ea2e0123afc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 710669,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/fc5d988092cf4f208194e5eec46dfa76/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84ff5c32-098b-5760-9181-7ea2e0123afc/84ff5c32-098b-5760-9181-7ea2e0123afc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 779336,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/fc5d988092cf4f208194e5eec46dfa76/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84ff5c32-098b-5760-9181-7ea2e0123afc/84ff5c32-098b-5760-9181-7ea2e0123afc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 636617,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/fc5d988092cf4f208194e5eec46dfa76/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84ff5c32-098b-5760-9181-7ea2e0123afc/84ff5c32-098b-5760-9181-7ea2e0123afc_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 596591,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/fc5d988092cf4f208194e5eec46dfa76/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84ff5c32-098b-5760-9181-7ea2e0123afc/84ff5c32-098b-5760-9181-7ea2e0123afc_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 628341,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/fc5d988092cf4f208194e5eec46dfa76/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84ff5c32-098b-5760-9181-7ea2e0123afc/84ff5c32-098b-5760-9181-7ea2e0123afc_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 716417,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/fc5d988092cf4f208194e5eec46dfa76/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84ff5c32-098b-5760-9181-7ea2e0123afc/84ff5c32-098b-5760-9181-7ea2e0123afc_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 632251,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/fc5d988092cf4f208194e5eec46dfa76/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84ff5c32-098b-5760-9181-7ea2e0123afc/84ff5c32-098b-5760-9181-7ea2e0123afc_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 676438,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/fc5d988092cf4f208194e5eec46dfa76/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ EQB BEV 67KWH EQB 300 AMG LINE AUTO 4M',
 'transmission': 'automatic',
 'trim': 'BEV 67KWH EQB 300 AMG LINE AUTO 4M',
 'vin': None,
 'year': 2022}
2026-03-26 22:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985483%27 HTTP/1.1" 200 None
2026-03-26 22:52:53 [ayvens.be] INFO: Saving data for 1985483: {'created_time': 1774565573.333968, 'last_price_update_time': 1774565573.333977, 'auction_closing_time': 1774958400.0}
2026-03-26 22:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985483') HTTP/1.1" 204 0
2026-03-26 22:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252Fb44b14985ff4413580b2eb5860c73c1e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/b44b14985ff4413580b2eb5860c73c1e/images/large/6.jpg not downloaded yet
2026-03-26 22:52:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74973d0>
2026-03-26 22:52:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e32f3c2-1201-53f9-a2fc-ea44d56970a7/8e32f3c2-1201-53f9-a2fc-ea44d56970a7_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252Fdb3c6a90630e4108ad535982af3c3536%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/db3c6a90630e4108ad535982af3c3536/images/large/8.jpg saved to cache
2026-03-26 22:52:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8e32f3c2-1201-53f9-a2fc-ea44d56970a7
2026-03-26 22:52:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dd/db3c6a90630e4108ad535982af3c3536/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dd/db3c6a90630e4108ad535982af3c3536/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252Fb44b14985ff4413580b2eb5860c73c1e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/b44b14985ff4413580b2eb5860c73c1e/images/large/7.jpg not downloaded yet
2026-03-26 22:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252Fb44b14985ff4413580b2eb5860c73c1e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/b44b14985ff4413580b2eb5860c73c1e/images/large/8.jpg not downloaded yet
2026-03-26 22:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252Fb44b14985ff4413580b2eb5860c73c1e%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/b44b14985ff4413580b2eb5860c73c1e/images/large/9.jpg not downloaded yet
2026-03-26 22:52:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/b44b14985ff4413580b2eb5860c73c1e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252Fb44b14985ff4413580b2eb5860c73c1e%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/b44b14985ff4413580b2eb5860c73c1e/images/large/10.jpg not downloaded yet
2026-03-26 22:52:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6df2f50>
2026-03-26 22:52:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e32f3c2-1201-53f9-a2fc-ea44d56970a7/8e32f3c2-1201-53f9-a2fc-ea44d56970a7_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252Fdb3c6a90630e4108ad535982af3c3536%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/db3c6a90630e4108ad535982af3c3536/images/large/10.jpg saved to cache
2026-03-26 22:52:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8e32f3c2-1201-53f9-a2fc-ea44d56970a7
2026-03-26 22:52:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76e2050>
2026-03-26 22:52:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e32f3c2-1201-53f9-a2fc-ea44d56970a7/8e32f3c2-1201-53f9-a2fc-ea44d56970a7_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252Fdb3c6a90630e4108ad535982af3c3536%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/db3c6a90630e4108ad535982af3c3536/images/large/9.jpg saved to cache
2026-03-26 22:52:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8e32f3c2-1201-53f9-a2fc-ea44d56970a7
2026-03-26 22:52:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8e32f3c2-1201-53f9-a2fc-ea44d56970a7, skipping ID generation
2026-03-26 22:52:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e32f3c2-1201-53f9-a2fc-ea44d56970a7 with scrape type 1
2026-03-26 22:52:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8e32f3c2-1201-53f9-a2fc-ea44d56970a7 sending to next pipeline
2026-03-26 22:52:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 8e32f3c2-1201-53f9-a2fc-ea44d56970a7, identifier: 1985484
2026-03-26 22:52:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/b44b14985ff4413580b2eb5860c73c1e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/b44b14985ff4413580b2eb5860c73c1e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:53 [ayvens.be] INFO: Found listing with ID: 1985486
2026-03-26 22:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985486%27 HTTP/1.1" 200 None
2026-03-26 22:52:53 [ayvens.be] INFO: Scrape type for 1985486: 1
2026-03-26 22:52:53 [ayvens.be] INFO: Extracting data for car ID: 1985486
2026-03-26 22:52:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6cd00884-726f-5fb7-acaa-5d76390baede with identifier: 1985486
2026-03-26 22:52:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6cd00884-726f-5fb7-acaa-5d76390baede with scrape type 1
2026-03-26 22:52:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6cd00884-726f-5fb7-acaa-5d76390baede
2026-03-26 22:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Faffc69b0eeb945769e0066a16ac53816%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/affc69b0eeb945769e0066a16ac53816/images/large/1.jpg not downloaded yet
2026-03-26 22:52:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 8e32f3c2-1201-53f9-a2fc-ea44d56970a7 with identifier: 1985484
2026-03-26 22:52:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 8e32f3c2-1201-53f9-a2fc-ea44d56970a7 with identifier: 1985484
2026-03-26 22:52:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 8e32f3c2-1201-53f9-a2fc-ea44d56970a7 with identifier: 1985484 to the API
2026-03-26 22:52:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:52:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:52:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2dd/db3c6a90630e4108ad535982af3c3536/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '8e32f3c2-1201-53f9-a2fc-ea44d56970a7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLB',
 'odometer': 91408,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e32f3c2-1201-53f9-a2fc-ea44d56970a7/8e32f3c2-1201-53f9-a2fc-ea44d56970a7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 253239,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dd/db3c6a90630e4108ad535982af3c3536/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e32f3c2-1201-53f9-a2fc-ea44d56970a7/8e32f3c2-1201-53f9-a2fc-ea44d56970a7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 254855,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dd/db3c6a90630e4108ad535982af3c3536/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e32f3c2-1201-53f9-a2fc-ea44d56970a7/8e32f3c2-1201-53f9-a2fc-ea44d56970a7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 266816,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dd/db3c6a90630e4108ad535982af3c3536/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e32f3c2-1201-53f9-a2fc-ea44d56970a7/8e32f3c2-1201-53f9-a2fc-ea44d56970a7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 268514,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dd/db3c6a90630e4108ad535982af3c3536/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e32f3c2-1201-53f9-a2fc-ea44d56970a7/8e32f3c2-1201-53f9-a2fc-ea44d56970a7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 328319,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dd/db3c6a90630e4108ad535982af3c3536/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e32f3c2-1201-53f9-a2fc-ea44d56970a7/8e32f3c2-1201-53f9-a2fc-ea44d56970a7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 319734,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dd/db3c6a90630e4108ad535982af3c3536/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e32f3c2-1201-53f9-a2fc-ea44d56970a7/8e32f3c2-1201-53f9-a2fc-ea44d56970a7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 317291,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dd/db3c6a90630e4108ad535982af3c3536/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e32f3c2-1201-53f9-a2fc-ea44d56970a7/8e32f3c2-1201-53f9-a2fc-ea44d56970a7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 350720,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dd/db3c6a90630e4108ad535982af3c3536/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e32f3c2-1201-53f9-a2fc-ea44d56970a7/8e32f3c2-1201-53f9-a2fc-ea44d56970a7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 370768,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dd/db3c6a90630e4108ad535982af3c3536/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e32f3c2-1201-53f9-a2fc-ea44d56970a7/8e32f3c2-1201-53f9-a2fc-ea44d56970a7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 375892,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dd/db3c6a90630e4108ad535982af3c3536/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLB 2.0 GLB 180 D BUSINESS SOLUTION',
 'transmission': 'automatic',
 'trim': '2.0 GLB 180 D BUSINESS SOLUTION',
 'vin': None,
 'year': 2023}
2026-03-26 22:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985484%27 HTTP/1.1" 200 None
2026-03-26 22:52:54 [ayvens.be] INFO: Saving data for 1985484: {'created_time': 1774565574.142203, 'last_price_update_time': 1774565574.142214, 'auction_closing_time': 1774958400.0}
2026-03-26 22:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985484') HTTP/1.1" 204 0
2026-03-26 22:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Faffc69b0eeb945769e0066a16ac53816%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/affc69b0eeb945769e0066a16ac53816/images/large/2.jpg not downloaded yet
2026-03-26 22:52:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/b44b14985ff4413580b2eb5860c73c1e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e47850>
2026-03-26 22:52:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4861b22-3a31-5b05-984b-5666753bb4c0/b4861b22-3a31-5b05-984b-5666753bb4c0_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252Fb44b14985ff4413580b2eb5860c73c1e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/b44b14985ff4413580b2eb5860c73c1e/images/large/1.jpg saved to cache
2026-03-26 22:52:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b4861b22-3a31-5b05-984b-5666753bb4c0
2026-03-26 22:52:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7443150>
2026-03-26 22:52:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4861b22-3a31-5b05-984b-5666753bb4c0/b4861b22-3a31-5b05-984b-5666753bb4c0_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252Fb44b14985ff4413580b2eb5860c73c1e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/b44b14985ff4413580b2eb5860c73c1e/images/large/3.jpg saved to cache
2026-03-26 22:52:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b4861b22-3a31-5b05-984b-5666753bb4c0
2026-03-26 22:52:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b34fd0>
2026-03-26 22:52:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4861b22-3a31-5b05-984b-5666753bb4c0/b4861b22-3a31-5b05-984b-5666753bb4c0_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252Fb44b14985ff4413580b2eb5860c73c1e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/b44b14985ff4413580b2eb5860c73c1e/images/large/2.jpg saved to cache
2026-03-26 22:52:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b4861b22-3a31-5b05-984b-5666753bb4c0
2026-03-26 22:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Faffc69b0eeb945769e0066a16ac53816%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/affc69b0eeb945769e0066a16ac53816/images/large/3.jpg not downloaded yet
2026-03-26 22:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Faffc69b0eeb945769e0066a16ac53816%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/affc69b0eeb945769e0066a16ac53816/images/large/4.jpg not downloaded yet
2026-03-26 22:52:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/b44b14985ff4413580b2eb5860c73c1e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Faffc69b0eeb945769e0066a16ac53816%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/affc69b0eeb945769e0066a16ac53816/images/large/5.jpg not downloaded yet
2026-03-26 22:52:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b782f310>
2026-03-26 22:52:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4861b22-3a31-5b05-984b-5666753bb4c0/b4861b22-3a31-5b05-984b-5666753bb4c0_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252Fb44b14985ff4413580b2eb5860c73c1e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/b44b14985ff4413580b2eb5860c73c1e/images/large/4.jpg saved to cache
2026-03-26 22:52:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b4861b22-3a31-5b05-984b-5666753bb4c0
2026-03-26 22:52:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/b44b14985ff4413580b2eb5860c73c1e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/b44b14985ff4413580b2eb5860c73c1e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/b44b14985ff4413580b2eb5860c73c1e/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Faffc69b0eeb945769e0066a16ac53816%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/affc69b0eeb945769e0066a16ac53816/images/large/6.jpg not downloaded yet
2026-03-26 22:52:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/b44b14985ff4413580b2eb5860c73c1e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/b44b14985ff4413580b2eb5860c73c1e/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Faffc69b0eeb945769e0066a16ac53816%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/affc69b0eeb945769e0066a16ac53816/images/large/7.jpg not downloaded yet
2026-03-26 22:52:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c83690>
2026-03-26 22:52:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4861b22-3a31-5b05-984b-5666753bb4c0/b4861b22-3a31-5b05-984b-5666753bb4c0_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252Fb44b14985ff4413580b2eb5860c73c1e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/b44b14985ff4413580b2eb5860c73c1e/images/large/6.jpg saved to cache
2026-03-26 22:52:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b4861b22-3a31-5b05-984b-5666753bb4c0
2026-03-26 22:52:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/affc69b0eeb945769e0066a16ac53816/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Faffc69b0eeb945769e0066a16ac53816%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/affc69b0eeb945769e0066a16ac53816/images/large/8.jpg not downloaded yet
2026-03-26 22:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Faffc69b0eeb945769e0066a16ac53816%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/affc69b0eeb945769e0066a16ac53816/images/large/9.jpg not downloaded yet
2026-03-26 22:52:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7406690>
2026-03-26 22:52:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4861b22-3a31-5b05-984b-5666753bb4c0/b4861b22-3a31-5b05-984b-5666753bb4c0_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252Fb44b14985ff4413580b2eb5860c73c1e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/b44b14985ff4413580b2eb5860c73c1e/images/large/7.jpg saved to cache
2026-03-26 22:52:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b4861b22-3a31-5b05-984b-5666753bb4c0
2026-03-26 22:52:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77685d0>
2026-03-26 22:52:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4861b22-3a31-5b05-984b-5666753bb4c0/b4861b22-3a31-5b05-984b-5666753bb4c0_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252Fb44b14985ff4413580b2eb5860c73c1e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/b44b14985ff4413580b2eb5860c73c1e/images/large/5.jpg saved to cache
2026-03-26 22:52:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b4861b22-3a31-5b05-984b-5666753bb4c0
2026-03-26 22:52:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7773ad0>
2026-03-26 22:52:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4861b22-3a31-5b05-984b-5666753bb4c0/b4861b22-3a31-5b05-984b-5666753bb4c0_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252Fb44b14985ff4413580b2eb5860c73c1e%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/b44b14985ff4413580b2eb5860c73c1e/images/large/9.jpg saved to cache
2026-03-26 22:52:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b4861b22-3a31-5b05-984b-5666753bb4c0
2026-03-26 22:52:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6da7790>
2026-03-26 22:52:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4861b22-3a31-5b05-984b-5666753bb4c0/b4861b22-3a31-5b05-984b-5666753bb4c0_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252Fb44b14985ff4413580b2eb5860c73c1e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/b44b14985ff4413580b2eb5860c73c1e/images/large/8.jpg saved to cache
2026-03-26 22:52:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b4861b22-3a31-5b05-984b-5666753bb4c0
2026-03-26 22:52:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7ccc290>
2026-03-26 22:52:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4861b22-3a31-5b05-984b-5666753bb4c0/b4861b22-3a31-5b05-984b-5666753bb4c0_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252Fb44b14985ff4413580b2eb5860c73c1e%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/b44b14985ff4413580b2eb5860c73c1e/images/large/10.jpg saved to cache
2026-03-26 22:52:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b4861b22-3a31-5b05-984b-5666753bb4c0
2026-03-26 22:52:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b4861b22-3a31-5b05-984b-5666753bb4c0, skipping ID generation
2026-03-26 22:52:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4861b22-3a31-5b05-984b-5666753bb4c0 with scrape type 1
2026-03-26 22:52:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b4861b22-3a31-5b05-984b-5666753bb4c0 sending to next pipeline
2026-03-26 22:52:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b4861b22-3a31-5b05-984b-5666753bb4c0, identifier: 1985485
2026-03-26 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Faffc69b0eeb945769e0066a16ac53816%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/affc69b0eeb945769e0066a16ac53816/images/large/10.jpg not downloaded yet
2026-03-26 22:52:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b4861b22-3a31-5b05-984b-5666753bb4c0 with identifier: 1985485
2026-03-26 22:52:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b4861b22-3a31-5b05-984b-5666753bb4c0 with identifier: 1985485
2026-03-26 22:52:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b4861b22-3a31-5b05-984b-5666753bb4c0 with identifier: 1985485 to the API
2026-03-26 22:52:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:52:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:52:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cq/b44b14985ff4413580b2eb5860c73c1e/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b4861b22-3a31-5b05-984b-5666753bb4c0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '1 SERIES HATCH',
 'odometer': 65837,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4861b22-3a31-5b05-984b-5666753bb4c0/b4861b22-3a31-5b05-984b-5666753bb4c0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 706131,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/b44b14985ff4413580b2eb5860c73c1e/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4861b22-3a31-5b05-984b-5666753bb4c0/b4861b22-3a31-5b05-984b-5666753bb4c0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 695859,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/b44b14985ff4413580b2eb5860c73c1e/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4861b22-3a31-5b05-984b-5666753bb4c0/b4861b22-3a31-5b05-984b-5666753bb4c0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 667139,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/b44b14985ff4413580b2eb5860c73c1e/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4861b22-3a31-5b05-984b-5666753bb4c0/b4861b22-3a31-5b05-984b-5666753bb4c0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 716105,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/b44b14985ff4413580b2eb5860c73c1e/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4861b22-3a31-5b05-984b-5666753bb4c0/b4861b22-3a31-5b05-984b-5666753bb4c0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 582177,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/b44b14985ff4413580b2eb5860c73c1e/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4861b22-3a31-5b05-984b-5666753bb4c0/b4861b22-3a31-5b05-984b-5666753bb4c0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 601611,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/b44b14985ff4413580b2eb5860c73c1e/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4861b22-3a31-5b05-984b-5666753bb4c0/b4861b22-3a31-5b05-984b-5666753bb4c0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 610926,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/b44b14985ff4413580b2eb5860c73c1e/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4861b22-3a31-5b05-984b-5666753bb4c0/b4861b22-3a31-5b05-984b-5666753bb4c0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 716439,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/b44b14985ff4413580b2eb5860c73c1e/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4861b22-3a31-5b05-984b-5666753bb4c0/b4861b22-3a31-5b05-984b-5666753bb4c0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 522759,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/b44b14985ff4413580b2eb5860c73c1e/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4861b22-3a31-5b05-984b-5666753bb4c0/b4861b22-3a31-5b05-984b-5666753bb4c0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 459189,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/b44b14985ff4413580b2eb5860c73c1e/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1 SERIES HATCH 1.5 116D (85KW)',
 'transmission': 'manual',
 'trim': '1.5 116D (85KW)',
 'vin': None,
 'year': 2022}
2026-03-26 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985485%27 HTTP/1.1" 200 None
2026-03-26 22:52:55 [ayvens.be] INFO: Saving data for 1985485: {'created_time': 1774565575.659829, 'last_price_update_time': 1774565575.659843, 'auction_closing_time': 1774958400.0}
2026-03-26 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985485') HTTP/1.1" 204 0
2026-03-26 22:52:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/affc69b0eeb945769e0066a16ac53816/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/affc69b0eeb945769e0066a16ac53816/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/affc69b0eeb945769e0066a16ac53816/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/affc69b0eeb945769e0066a16ac53816/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77ac750>
2026-03-26 22:52:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cd00884-726f-5fb7-acaa-5d76390baede/6cd00884-726f-5fb7-acaa-5d76390baede_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Faffc69b0eeb945769e0066a16ac53816%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/affc69b0eeb945769e0066a16ac53816/images/large/1.jpg saved to cache
2026-03-26 22:52:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6cd00884-726f-5fb7-acaa-5d76390baede
2026-03-26 22:52:55 [ayvens.be] INFO: Found listing with ID: 1985487
2026-03-26 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985487%27 HTTP/1.1" 200 None
2026-03-26 22:52:55 [ayvens.be] INFO: Scrape type for 1985487: 1
2026-03-26 22:52:55 [ayvens.be] INFO: Extracting data for car ID: 1985487
2026-03-26 22:52:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58b59445-e654-592a-ad8a-689c6e0c1bad with identifier: 1985487
2026-03-26 22:52:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58b59445-e654-592a-ad8a-689c6e0c1bad with scrape type 1
2026-03-26 22:52:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 58b59445-e654-592a-ad8a-689c6e0c1bad
2026-03-26 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fee66c3123bd64c20ba6a6d39b66c468b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/ee66c3123bd64c20ba6a6d39b66c468b/images/large/1.jpg not downloaded yet
2026-03-26 22:52:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/affc69b0eeb945769e0066a16ac53816/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/affc69b0eeb945769e0066a16ac53816/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fee66c3123bd64c20ba6a6d39b66c468b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/ee66c3123bd64c20ba6a6d39b66c468b/images/large/2.jpg not downloaded yet
2026-03-26 22:52:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e3ef10>
2026-03-26 22:52:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cd00884-726f-5fb7-acaa-5d76390baede/6cd00884-726f-5fb7-acaa-5d76390baede_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Faffc69b0eeb945769e0066a16ac53816%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/affc69b0eeb945769e0066a16ac53816/images/large/2.jpg saved to cache
2026-03-26 22:52:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6cd00884-726f-5fb7-acaa-5d76390baede
2026-03-26 22:52:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cc2290>
2026-03-26 22:52:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cd00884-726f-5fb7-acaa-5d76390baede/6cd00884-726f-5fb7-acaa-5d76390baede_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Faffc69b0eeb945769e0066a16ac53816%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/affc69b0eeb945769e0066a16ac53816/images/large/4.jpg saved to cache
2026-03-26 22:52:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6cd00884-726f-5fb7-acaa-5d76390baede
2026-03-26 22:52:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd0cfad0>
2026-03-26 22:52:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cd00884-726f-5fb7-acaa-5d76390baede/6cd00884-726f-5fb7-acaa-5d76390baede_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Faffc69b0eeb945769e0066a16ac53816%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/affc69b0eeb945769e0066a16ac53816/images/large/5.jpg saved to cache
2026-03-26 22:52:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6cd00884-726f-5fb7-acaa-5d76390baede
2026-03-26 22:52:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7a56210>
2026-03-26 22:52:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cd00884-726f-5fb7-acaa-5d76390baede/6cd00884-726f-5fb7-acaa-5d76390baede_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Faffc69b0eeb945769e0066a16ac53816%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/affc69b0eeb945769e0066a16ac53816/images/large/3.jpg saved to cache
2026-03-26 22:52:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6cd00884-726f-5fb7-acaa-5d76390baede
2026-03-26 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fee66c3123bd64c20ba6a6d39b66c468b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/ee66c3123bd64c20ba6a6d39b66c468b/images/large/3.jpg not downloaded yet
2026-03-26 22:52:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/affc69b0eeb945769e0066a16ac53816/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fee66c3123bd64c20ba6a6d39b66c468b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/ee66c3123bd64c20ba6a6d39b66c468b/images/large/4.jpg not downloaded yet
2026-03-26 22:52:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b72efb50>
2026-03-26 22:52:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cd00884-726f-5fb7-acaa-5d76390baede/6cd00884-726f-5fb7-acaa-5d76390baede_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Faffc69b0eeb945769e0066a16ac53816%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/affc69b0eeb945769e0066a16ac53816/images/large/6.jpg saved to cache
2026-03-26 22:52:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6cd00884-726f-5fb7-acaa-5d76390baede
2026-03-26 22:52:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b75a4f10>
2026-03-26 22:52:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cd00884-726f-5fb7-acaa-5d76390baede/6cd00884-726f-5fb7-acaa-5d76390baede_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Faffc69b0eeb945769e0066a16ac53816%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/affc69b0eeb945769e0066a16ac53816/images/large/7.jpg saved to cache
2026-03-26 22:52:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6cd00884-726f-5fb7-acaa-5d76390baede
2026-03-26 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fee66c3123bd64c20ba6a6d39b66c468b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/ee66c3123bd64c20ba6a6d39b66c468b/images/large/5.jpg not downloaded yet
2026-03-26 22:52:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/affc69b0eeb945769e0066a16ac53816/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/affc69b0eeb945769e0066a16ac53816/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fee66c3123bd64c20ba6a6d39b66c468b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/ee66c3123bd64c20ba6a6d39b66c468b/images/large/6.jpg not downloaded yet
2026-03-26 22:52:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74e7790>
2026-03-26 22:52:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cd00884-726f-5fb7-acaa-5d76390baede/6cd00884-726f-5fb7-acaa-5d76390baede_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Faffc69b0eeb945769e0066a16ac53816%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/affc69b0eeb945769e0066a16ac53816/images/large/8.jpg saved to cache
2026-03-26 22:52:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6cd00884-726f-5fb7-acaa-5d76390baede
2026-03-26 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fee66c3123bd64c20ba6a6d39b66c468b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/ee66c3123bd64c20ba6a6d39b66c468b/images/large/7.jpg not downloaded yet
2026-03-26 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fee66c3123bd64c20ba6a6d39b66c468b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/ee66c3123bd64c20ba6a6d39b66c468b/images/large/8.jpg not downloaded yet
2026-03-26 22:52:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7cab410>
2026-03-26 22:52:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cd00884-726f-5fb7-acaa-5d76390baede/6cd00884-726f-5fb7-acaa-5d76390baede_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Faffc69b0eeb945769e0066a16ac53816%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/affc69b0eeb945769e0066a16ac53816/images/large/10.jpg saved to cache
2026-03-26 22:52:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6cd00884-726f-5fb7-acaa-5d76390baede
2026-03-26 22:52:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b72ed390>
2026-03-26 22:52:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cd00884-726f-5fb7-acaa-5d76390baede/6cd00884-726f-5fb7-acaa-5d76390baede_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Faffc69b0eeb945769e0066a16ac53816%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/affc69b0eeb945769e0066a16ac53816/images/large/9.jpg saved to cache
2026-03-26 22:52:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6cd00884-726f-5fb7-acaa-5d76390baede
2026-03-26 22:52:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6cd00884-726f-5fb7-acaa-5d76390baede, skipping ID generation
2026-03-26 22:52:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6cd00884-726f-5fb7-acaa-5d76390baede with scrape type 1
2026-03-26 22:52:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6cd00884-726f-5fb7-acaa-5d76390baede sending to next pipeline
2026-03-26 22:52:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 6cd00884-726f-5fb7-acaa-5d76390baede, identifier: 1985486
2026-03-26 22:52:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 6cd00884-726f-5fb7-acaa-5d76390baede with identifier: 1985486
2026-03-26 22:52:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 6cd00884-726f-5fb7-acaa-5d76390baede with identifier: 1985486
2026-03-26 22:52:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 6cd00884-726f-5fb7-acaa-5d76390baede with identifier: 1985486 to the API
2026-03-26 22:52:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:52:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:52:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bs/affc69b0eeb945769e0066a16ac53816/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 41,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '6cd00884-726f-5fb7-acaa-5d76390baede',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 131568,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cd00884-726f-5fb7-acaa-5d76390baede/6cd00884-726f-5fb7-acaa-5d76390baede_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 267661,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/affc69b0eeb945769e0066a16ac53816/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cd00884-726f-5fb7-acaa-5d76390baede/6cd00884-726f-5fb7-acaa-5d76390baede_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 268679,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/affc69b0eeb945769e0066a16ac53816/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cd00884-726f-5fb7-acaa-5d76390baede/6cd00884-726f-5fb7-acaa-5d76390baede_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 281181,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/affc69b0eeb945769e0066a16ac53816/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cd00884-726f-5fb7-acaa-5d76390baede/6cd00884-726f-5fb7-acaa-5d76390baede_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 273639,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/affc69b0eeb945769e0066a16ac53816/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cd00884-726f-5fb7-acaa-5d76390baede/6cd00884-726f-5fb7-acaa-5d76390baede_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 276645,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/affc69b0eeb945769e0066a16ac53816/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cd00884-726f-5fb7-acaa-5d76390baede/6cd00884-726f-5fb7-acaa-5d76390baede_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 241869,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/affc69b0eeb945769e0066a16ac53816/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cd00884-726f-5fb7-acaa-5d76390baede/6cd00884-726f-5fb7-acaa-5d76390baede_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 318664,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/affc69b0eeb945769e0066a16ac53816/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cd00884-726f-5fb7-acaa-5d76390baede/6cd00884-726f-5fb7-acaa-5d76390baede_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 343408,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/affc69b0eeb945769e0066a16ac53816/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cd00884-726f-5fb7-acaa-5d76390baede/6cd00884-726f-5fb7-acaa-5d76390baede_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 345336,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/affc69b0eeb945769e0066a16ac53816/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cd00884-726f-5fb7-acaa-5d76390baede/6cd00884-726f-5fb7-acaa-5d76390baede_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 282394,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/affc69b0eeb945769e0066a16ac53816/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T4 PHEV INSCRIPTION EXPR. DCT',
 'transmission': 'automatic',
 'trim': '1.5 T4 PHEV INSCRIPTION EXPR. DCT',
 'vin': None,
 'year': 2022}
2026-03-26 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985486%27 HTTP/1.1" 200 None
2026-03-26 22:52:57 [ayvens.be] INFO: Saving data for 1985486: {'created_time': 1774565577.055165, 'last_price_update_time': 1774565577.055176, 'auction_closing_time': 1774958400.0}
2026-03-26 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985486') HTTP/1.1" 204 0
2026-03-26 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fee66c3123bd64c20ba6a6d39b66c468b%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/ee66c3123bd64c20ba6a6d39b66c468b/images/large/9.jpg not downloaded yet
2026-03-26 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fee66c3123bd64c20ba6a6d39b66c468b%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/ee66c3123bd64c20ba6a6d39b66c468b/images/large/10.jpg not downloaded yet
2026-03-26 22:52:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/ee66c3123bd64c20ba6a6d39b66c468b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/ee66c3123bd64c20ba6a6d39b66c468b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:57 [ayvens.be] INFO: Found listing with ID: 1985488
2026-03-26 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985488%27 HTTP/1.1" 200 None
2026-03-26 22:52:57 [ayvens.be] INFO: Scrape type for 1985488: 1
2026-03-26 22:52:57 [ayvens.be] INFO: Extracting data for car ID: 1985488
2026-03-26 22:52:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1c9b0a89-eb14-5060-bb05-ef2d70ce6924 with identifier: 1985488
2026-03-26 22:52:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c9b0a89-eb14-5060-bb05-ef2d70ce6924 with scrape type 1
2026-03-26 22:52:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1c9b0a89-eb14-5060-bb05-ef2d70ce6924
2026-03-26 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ec%252F8e806e5e4b724913a3b5ddf4513ab132%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ec/8e806e5e4b724913a3b5ddf4513ab132/images/large/1.jpg not downloaded yet
2026-03-26 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ec%252F8e806e5e4b724913a3b5ddf4513ab132%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ec/8e806e5e4b724913a3b5ddf4513ab132/images/large/2.jpg not downloaded yet
2026-03-26 22:52:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/ee66c3123bd64c20ba6a6d39b66c468b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ec%252F8e806e5e4b724913a3b5ddf4513ab132%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ec/8e806e5e4b724913a3b5ddf4513ab132/images/large/3.jpg not downloaded yet
2026-03-26 22:52:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/ee66c3123bd64c20ba6a6d39b66c468b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/ee66c3123bd64c20ba6a6d39b66c468b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/ee66c3123bd64c20ba6a6d39b66c468b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ec%252F8e806e5e4b724913a3b5ddf4513ab132%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ec/8e806e5e4b724913a3b5ddf4513ab132/images/large/4.jpg not downloaded yet
2026-03-26 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ec%252F8e806e5e4b724913a3b5ddf4513ab132%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ec/8e806e5e4b724913a3b5ddf4513ab132/images/large/5.jpg not downloaded yet
2026-03-26 22:52:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76ce210>
2026-03-26 22:52:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58b59445-e654-592a-ad8a-689c6e0c1bad/58b59445-e654-592a-ad8a-689c6e0c1bad_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fee66c3123bd64c20ba6a6d39b66c468b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/ee66c3123bd64c20ba6a6d39b66c468b/images/large/1.jpg saved to cache
2026-03-26 22:52:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 58b59445-e654-592a-ad8a-689c6e0c1bad
2026-03-26 22:52:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b75a4890>
2026-03-26 22:52:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58b59445-e654-592a-ad8a-689c6e0c1bad/58b59445-e654-592a-ad8a-689c6e0c1bad_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fee66c3123bd64c20ba6a6d39b66c468b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/ee66c3123bd64c20ba6a6d39b66c468b/images/large/2.jpg saved to cache
2026-03-26 22:52:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 58b59445-e654-592a-ad8a-689c6e0c1bad
2026-03-26 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ec%252F8e806e5e4b724913a3b5ddf4513ab132%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ec/8e806e5e4b724913a3b5ddf4513ab132/images/large/6.jpg not downloaded yet
2026-03-26 22:52:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/ee66c3123bd64c20ba6a6d39b66c468b/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ec%252F8e806e5e4b724913a3b5ddf4513ab132%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ec/8e806e5e4b724913a3b5ddf4513ab132/images/large/7.jpg not downloaded yet
2026-03-26 22:52:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b792ed10>
2026-03-26 22:52:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58b59445-e654-592a-ad8a-689c6e0c1bad/58b59445-e654-592a-ad8a-689c6e0c1bad_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fee66c3123bd64c20ba6a6d39b66c468b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/ee66c3123bd64c20ba6a6d39b66c468b/images/large/3.jpg saved to cache
2026-03-26 22:52:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 58b59445-e654-592a-ad8a-689c6e0c1bad
2026-03-26 22:52:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b36050>
2026-03-26 22:52:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58b59445-e654-592a-ad8a-689c6e0c1bad/58b59445-e654-592a-ad8a-689c6e0c1bad_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fee66c3123bd64c20ba6a6d39b66c468b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/ee66c3123bd64c20ba6a6d39b66c468b/images/large/4.jpg saved to cache
2026-03-26 22:52:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 58b59445-e654-592a-ad8a-689c6e0c1bad
2026-03-26 22:52:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79a4b10>
2026-03-26 22:52:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58b59445-e654-592a-ad8a-689c6e0c1bad/58b59445-e654-592a-ad8a-689c6e0c1bad_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fee66c3123bd64c20ba6a6d39b66c468b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/ee66c3123bd64c20ba6a6d39b66c468b/images/large/6.jpg saved to cache
2026-03-26 22:52:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 58b59445-e654-592a-ad8a-689c6e0c1bad
2026-03-26 22:52:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76cc250>
2026-03-26 22:52:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58b59445-e654-592a-ad8a-689c6e0c1bad/58b59445-e654-592a-ad8a-689c6e0c1bad_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fee66c3123bd64c20ba6a6d39b66c468b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/ee66c3123bd64c20ba6a6d39b66c468b/images/large/5.jpg saved to cache
2026-03-26 22:52:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 58b59445-e654-592a-ad8a-689c6e0c1bad
2026-03-26 22:52:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/ee66c3123bd64c20ba6a6d39b66c468b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ec%252F8e806e5e4b724913a3b5ddf4513ab132%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ec/8e806e5e4b724913a3b5ddf4513ab132/images/large/8.jpg not downloaded yet
2026-03-26 22:52:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/ee66c3123bd64c20ba6a6d39b66c468b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ec%252F8e806e5e4b724913a3b5ddf4513ab132%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ec/8e806e5e4b724913a3b5ddf4513ab132/images/large/9.jpg not downloaded yet
2026-03-26 22:52:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7980a10>
2026-03-26 22:52:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58b59445-e654-592a-ad8a-689c6e0c1bad/58b59445-e654-592a-ad8a-689c6e0c1bad_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fee66c3123bd64c20ba6a6d39b66c468b%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/ee66c3123bd64c20ba6a6d39b66c468b/images/large/9.jpg saved to cache
2026-03-26 22:52:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 58b59445-e654-592a-ad8a-689c6e0c1bad
2026-03-26 22:52:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/ee66c3123bd64c20ba6a6d39b66c468b/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ec%252F8e806e5e4b724913a3b5ddf4513ab132%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ec/8e806e5e4b724913a3b5ddf4513ab132/images/large/10.jpg not downloaded yet
2026-03-26 22:52:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ec/8e806e5e4b724913a3b5ddf4513ab132/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ec/8e806e5e4b724913a3b5ddf4513ab132/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ec/8e806e5e4b724913a3b5ddf4513ab132/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:58 [ayvens.be] INFO: Found listing with ID: 1985489
2026-03-26 22:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985489%27 HTTP/1.1" 200 None
2026-03-26 22:52:58 [ayvens.be] INFO: Scrape type for 1985489: 1
2026-03-26 22:52:58 [ayvens.be] INFO: Extracting data for car ID: 1985489
2026-03-26 22:52:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 651317bf-da71-5928-93a9-8df683ca4d4f with identifier: 1985489
2026-03-26 22:52:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 651317bf-da71-5928-93a9-8df683ca4d4f with scrape type 1
2026-03-26 22:52:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 651317bf-da71-5928-93a9-8df683ca4d4f
2026-03-26 22:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252Ffc5ee4b155a54f0dba86b6664c25cade%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/fc5ee4b155a54f0dba86b6664c25cade/images/large/1.jpg not downloaded yet
2026-03-26 22:52:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7497510>
2026-03-26 22:52:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58b59445-e654-592a-ad8a-689c6e0c1bad/58b59445-e654-592a-ad8a-689c6e0c1bad_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fee66c3123bd64c20ba6a6d39b66c468b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/ee66c3123bd64c20ba6a6d39b66c468b/images/large/7.jpg saved to cache
2026-03-26 22:52:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 58b59445-e654-592a-ad8a-689c6e0c1bad
2026-03-26 22:52:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7570a90>
2026-03-26 22:52:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58b59445-e654-592a-ad8a-689c6e0c1bad/58b59445-e654-592a-ad8a-689c6e0c1bad_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fee66c3123bd64c20ba6a6d39b66c468b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/ee66c3123bd64c20ba6a6d39b66c468b/images/large/8.jpg saved to cache
2026-03-26 22:52:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 58b59445-e654-592a-ad8a-689c6e0c1bad
2026-03-26 22:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252Ffc5ee4b155a54f0dba86b6664c25cade%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/fc5ee4b155a54f0dba86b6664c25cade/images/large/2.jpg not downloaded yet
2026-03-26 22:52:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ec/8e806e5e4b724913a3b5ddf4513ab132/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252Ffc5ee4b155a54f0dba86b6664c25cade%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/fc5ee4b155a54f0dba86b6664c25cade/images/large/3.jpg not downloaded yet
2026-03-26 22:52:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ec/8e806e5e4b724913a3b5ddf4513ab132/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cbe7d0>
2026-03-26 22:52:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58b59445-e654-592a-ad8a-689c6e0c1bad/58b59445-e654-592a-ad8a-689c6e0c1bad_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fee66c3123bd64c20ba6a6d39b66c468b%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/ee66c3123bd64c20ba6a6d39b66c468b/images/large/10.jpg saved to cache
2026-03-26 22:52:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 58b59445-e654-592a-ad8a-689c6e0c1bad
2026-03-26 22:52:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 58b59445-e654-592a-ad8a-689c6e0c1bad, skipping ID generation
2026-03-26 22:52:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58b59445-e654-592a-ad8a-689c6e0c1bad with scrape type 1
2026-03-26 22:52:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 58b59445-e654-592a-ad8a-689c6e0c1bad sending to next pipeline
2026-03-26 22:52:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 58b59445-e654-592a-ad8a-689c6e0c1bad, identifier: 1985487
2026-03-26 22:52:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd0c5610>
2026-03-26 22:52:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c9b0a89-eb14-5060-bb05-ef2d70ce6924/1c9b0a89-eb14-5060-bb05-ef2d70ce6924_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ec%252F8e806e5e4b724913a3b5ddf4513ab132%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ec/8e806e5e4b724913a3b5ddf4513ab132/images/large/1.jpg saved to cache
2026-03-26 22:52:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1c9b0a89-eb14-5060-bb05-ef2d70ce6924
2026-03-26 22:52:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74bed10>
2026-03-26 22:52:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c9b0a89-eb14-5060-bb05-ef2d70ce6924/1c9b0a89-eb14-5060-bb05-ef2d70ce6924_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ec%252F8e806e5e4b724913a3b5ddf4513ab132%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ec/8e806e5e4b724913a3b5ddf4513ab132/images/large/2.jpg saved to cache
2026-03-26 22:52:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1c9b0a89-eb14-5060-bb05-ef2d70ce6924
2026-03-26 22:52:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7779890>
2026-03-26 22:52:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c9b0a89-eb14-5060-bb05-ef2d70ce6924/1c9b0a89-eb14-5060-bb05-ef2d70ce6924_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ec%252F8e806e5e4b724913a3b5ddf4513ab132%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ec/8e806e5e4b724913a3b5ddf4513ab132/images/large/3.jpg saved to cache
2026-03-26 22:52:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1c9b0a89-eb14-5060-bb05-ef2d70ce6924
2026-03-26 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252Ffc5ee4b155a54f0dba86b6664c25cade%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/fc5ee4b155a54f0dba86b6664c25cade/images/large/4.jpg not downloaded yet
2026-03-26 22:52:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 58b59445-e654-592a-ad8a-689c6e0c1bad with identifier: 1985487
2026-03-26 22:52:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 58b59445-e654-592a-ad8a-689c6e0c1bad with identifier: 1985487
2026-03-26 22:52:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 58b59445-e654-592a-ad8a-689c6e0c1bad with identifier: 1985487 to the API
2026-03-26 22:52:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:52:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:52:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bn/ee66c3123bd64c20ba6a6d39b66c468b/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '58b59445-e654-592a-ad8a-689c6e0c1bad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 101820,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58b59445-e654-592a-ad8a-689c6e0c1bad/58b59445-e654-592a-ad8a-689c6e0c1bad_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 711828,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/ee66c3123bd64c20ba6a6d39b66c468b/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58b59445-e654-592a-ad8a-689c6e0c1bad/58b59445-e654-592a-ad8a-689c6e0c1bad_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 674671,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/ee66c3123bd64c20ba6a6d39b66c468b/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58b59445-e654-592a-ad8a-689c6e0c1bad/58b59445-e654-592a-ad8a-689c6e0c1bad_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 711588,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/ee66c3123bd64c20ba6a6d39b66c468b/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58b59445-e654-592a-ad8a-689c6e0c1bad/58b59445-e654-592a-ad8a-689c6e0c1bad_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 689972,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/ee66c3123bd64c20ba6a6d39b66c468b/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58b59445-e654-592a-ad8a-689c6e0c1bad/58b59445-e654-592a-ad8a-689c6e0c1bad_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 710931,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/ee66c3123bd64c20ba6a6d39b66c468b/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58b59445-e654-592a-ad8a-689c6e0c1bad/58b59445-e654-592a-ad8a-689c6e0c1bad_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 633706,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/ee66c3123bd64c20ba6a6d39b66c468b/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58b59445-e654-592a-ad8a-689c6e0c1bad/58b59445-e654-592a-ad8a-689c6e0c1bad_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 735055,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/ee66c3123bd64c20ba6a6d39b66c468b/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58b59445-e654-592a-ad8a-689c6e0c1bad/58b59445-e654-592a-ad8a-689c6e0c1bad_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 746859,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/ee66c3123bd64c20ba6a6d39b66c468b/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58b59445-e654-592a-ad8a-689c6e0c1bad/58b59445-e654-592a-ad8a-689c6e0c1bad_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 604506,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/ee66c3123bd64c20ba6a6d39b66c468b/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58b59445-e654-592a-ad8a-689c6e0c1bad/58b59445-e654-592a-ad8a-689c6e0c1bad_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 599255,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/ee66c3123bd64c20ba6a6d39b66c468b/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 1.5 XDRIVE25E (162KW)',
 'transmission': 'automatic',
 'trim': '1.5 XDRIVE25E (162KW)',
 'vin': None,
 'year': 2022}
2026-03-26 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985487%27 HTTP/1.1" 200 None
2026-03-26 22:52:59 [ayvens.be] INFO: Saving data for 1985487: {'created_time': 1774565579.613135, 'last_price_update_time': 1774565579.613145, 'auction_closing_time': 1774958400.0}
2026-03-26 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985487') HTTP/1.1" 204 0
2026-03-26 22:52:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ec/8e806e5e4b724913a3b5ddf4513ab132/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252Ffc5ee4b155a54f0dba86b6664c25cade%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/fc5ee4b155a54f0dba86b6664c25cade/images/large/5.jpg not downloaded yet
2026-03-26 22:52:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80cad48350>
2026-03-26 22:52:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c9b0a89-eb14-5060-bb05-ef2d70ce6924/1c9b0a89-eb14-5060-bb05-ef2d70ce6924_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ec%252F8e806e5e4b724913a3b5ddf4513ab132%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ec/8e806e5e4b724913a3b5ddf4513ab132/images/large/4.jpg saved to cache
2026-03-26 22:52:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1c9b0a89-eb14-5060-bb05-ef2d70ce6924
2026-03-26 22:52:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7745bd0>
2026-03-26 22:52:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c9b0a89-eb14-5060-bb05-ef2d70ce6924/1c9b0a89-eb14-5060-bb05-ef2d70ce6924_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ec%252F8e806e5e4b724913a3b5ddf4513ab132%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ec/8e806e5e4b724913a3b5ddf4513ab132/images/large/5.jpg saved to cache
2026-03-26 22:52:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1c9b0a89-eb14-5060-bb05-ef2d70ce6924
2026-03-26 22:52:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ec/8e806e5e4b724913a3b5ddf4513ab132/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252Ffc5ee4b155a54f0dba86b6664c25cade%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/fc5ee4b155a54f0dba86b6664c25cade/images/large/6.jpg not downloaded yet
2026-03-26 22:52:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ec/8e806e5e4b724913a3b5ddf4513ab132/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ec/8e806e5e4b724913a3b5ddf4513ab132/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252Ffc5ee4b155a54f0dba86b6664c25cade%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/fc5ee4b155a54f0dba86b6664c25cade/images/large/7.jpg not downloaded yet
2026-03-26 22:52:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74dc690>
2026-03-26 22:52:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c9b0a89-eb14-5060-bb05-ef2d70ce6924/1c9b0a89-eb14-5060-bb05-ef2d70ce6924_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ec%252F8e806e5e4b724913a3b5ddf4513ab132%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:52:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ec/8e806e5e4b724913a3b5ddf4513ab132/images/large/6.jpg saved to cache
2026-03-26 22:52:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1c9b0a89-eb14-5060-bb05-ef2d70ce6924
2026-03-26 22:52:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ec/8e806e5e4b724913a3b5ddf4513ab132/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252Ffc5ee4b155a54f0dba86b6664c25cade%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/fc5ee4b155a54f0dba86b6664c25cade/images/large/8.jpg not downloaded yet
2026-03-26 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252Ffc5ee4b155a54f0dba86b6664c25cade%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:52:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/fc5ee4b155a54f0dba86b6664c25cade/images/large/9.jpg not downloaded yet
2026-03-26 22:52:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:52:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b792d850>
2026-03-26 22:52:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:52:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:52:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:52:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c9b0a89-eb14-5060-bb05-ef2d70ce6924/1c9b0a89-eb14-5060-bb05-ef2d70ce6924_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ec%252F8e806e5e4b724913a3b5ddf4513ab132%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ec/8e806e5e4b724913a3b5ddf4513ab132/images/large/9.jpg saved to cache
2026-03-26 22:53:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1c9b0a89-eb14-5060-bb05-ef2d70ce6924
2026-03-26 22:53:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b75a53d0>
2026-03-26 22:53:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c9b0a89-eb14-5060-bb05-ef2d70ce6924/1c9b0a89-eb14-5060-bb05-ef2d70ce6924_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ec%252F8e806e5e4b724913a3b5ddf4513ab132%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ec/8e806e5e4b724913a3b5ddf4513ab132/images/large/7.jpg saved to cache
2026-03-26 22:53:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1c9b0a89-eb14-5060-bb05-ef2d70ce6924
2026-03-26 22:53:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7591210>
2026-03-26 22:53:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c9b0a89-eb14-5060-bb05-ef2d70ce6924/1c9b0a89-eb14-5060-bb05-ef2d70ce6924_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ec%252F8e806e5e4b724913a3b5ddf4513ab132%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ec/8e806e5e4b724913a3b5ddf4513ab132/images/large/8.jpg saved to cache
2026-03-26 22:53:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1c9b0a89-eb14-5060-bb05-ef2d70ce6924
2026-03-26 22:53:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/fc5ee4b155a54f0dba86b6664c25cade/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/fc5ee4b155a54f0dba86b6664c25cade/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252Ffc5ee4b155a54f0dba86b6664c25cade%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/fc5ee4b155a54f0dba86b6664c25cade/images/large/10.jpg not downloaded yet
2026-03-26 22:53:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7458d10>
2026-03-26 22:53:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c9b0a89-eb14-5060-bb05-ef2d70ce6924/1c9b0a89-eb14-5060-bb05-ef2d70ce6924_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ec%252F8e806e5e4b724913a3b5ddf4513ab132%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ec/8e806e5e4b724913a3b5ddf4513ab132/images/large/10.jpg saved to cache
2026-03-26 22:53:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1c9b0a89-eb14-5060-bb05-ef2d70ce6924
2026-03-26 22:53:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1c9b0a89-eb14-5060-bb05-ef2d70ce6924, skipping ID generation
2026-03-26 22:53:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c9b0a89-eb14-5060-bb05-ef2d70ce6924 with scrape type 1
2026-03-26 22:53:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1c9b0a89-eb14-5060-bb05-ef2d70ce6924 sending to next pipeline
2026-03-26 22:53:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 1c9b0a89-eb14-5060-bb05-ef2d70ce6924, identifier: 1985488
2026-03-26 22:53:00 [ayvens.be] INFO: Found listing with ID: 1985490
2026-03-26 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985490%27 HTTP/1.1" 200 None
2026-03-26 22:53:00 [ayvens.be] INFO: Scrape type for 1985490: 1
2026-03-26 22:53:00 [ayvens.be] INFO: Extracting data for car ID: 1985490
2026-03-26 22:53:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b5a211d9-f255-57a9-bd89-c1a1a699cf54 with identifier: 1985490
2026-03-26 22:53:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5a211d9-f255-57a9-bd89-c1a1a699cf54 with scrape type 1
2026-03-26 22:53:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b5a211d9-f255-57a9-bd89-c1a1a699cf54
2026-03-26 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wj%252F8ee1253420374506b55607b65139a6d9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wj/8ee1253420374506b55607b65139a6d9/images/large/1.jpg not downloaded yet
2026-03-26 22:53:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 1c9b0a89-eb14-5060-bb05-ef2d70ce6924 with identifier: 1985488
2026-03-26 22:53:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 1c9b0a89-eb14-5060-bb05-ef2d70ce6924 with identifier: 1985488
2026-03-26 22:53:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 1c9b0a89-eb14-5060-bb05-ef2d70ce6924 with identifier: 1985488 to the API
2026-03-26 22:53:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:53:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:53:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ec/8e806e5e4b724913a3b5ddf4513ab132/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'electric',
 'id': '1c9b0a89-eb14-5060-bb05-ef2d70ce6924',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '208',
 'odometer': 84469,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c9b0a89-eb14-5060-bb05-ef2d70ce6924/1c9b0a89-eb14-5060-bb05-ef2d70ce6924_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 592966,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ec/8e806e5e4b724913a3b5ddf4513ab132/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c9b0a89-eb14-5060-bb05-ef2d70ce6924/1c9b0a89-eb14-5060-bb05-ef2d70ce6924_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 550958,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ec/8e806e5e4b724913a3b5ddf4513ab132/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c9b0a89-eb14-5060-bb05-ef2d70ce6924/1c9b0a89-eb14-5060-bb05-ef2d70ce6924_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 588563,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ec/8e806e5e4b724913a3b5ddf4513ab132/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c9b0a89-eb14-5060-bb05-ef2d70ce6924/1c9b0a89-eb14-5060-bb05-ef2d70ce6924_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 625592,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ec/8e806e5e4b724913a3b5ddf4513ab132/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c9b0a89-eb14-5060-bb05-ef2d70ce6924/1c9b0a89-eb14-5060-bb05-ef2d70ce6924_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 535048,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ec/8e806e5e4b724913a3b5ddf4513ab132/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c9b0a89-eb14-5060-bb05-ef2d70ce6924/1c9b0a89-eb14-5060-bb05-ef2d70ce6924_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 524408,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ec/8e806e5e4b724913a3b5ddf4513ab132/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c9b0a89-eb14-5060-bb05-ef2d70ce6924/1c9b0a89-eb14-5060-bb05-ef2d70ce6924_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 626662,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ec/8e806e5e4b724913a3b5ddf4513ab132/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c9b0a89-eb14-5060-bb05-ef2d70ce6924/1c9b0a89-eb14-5060-bb05-ef2d70ce6924_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 646974,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ec/8e806e5e4b724913a3b5ddf4513ab132/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c9b0a89-eb14-5060-bb05-ef2d70ce6924/1c9b0a89-eb14-5060-bb05-ef2d70ce6924_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 499208,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ec/8e806e5e4b724913a3b5ddf4513ab132/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c9b0a89-eb14-5060-bb05-ef2d70ce6924/1c9b0a89-eb14-5060-bb05-ef2d70ce6924_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 523919,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ec/8e806e5e4b724913a3b5ddf4513ab132/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-08-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 208 BEV 50KWH ELECTR. E-208 AUTO ALLURE PACK',
 'transmission': 'automatic',
 'trim': 'BEV 50KWH ELECTR. E-208 AUTO ALLURE PACK',
 'vin': None,
 'year': 2023}
2026-03-26 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985488%27 HTTP/1.1" 200 None
2026-03-26 22:53:00 [ayvens.be] INFO: Saving data for 1985488: {'created_time': 1774565580.722873, 'last_price_update_time': 1774565580.722881, 'auction_closing_time': 1774958400.0}
2026-03-26 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985488') HTTP/1.1" 204 0
2026-03-26 22:53:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/fc5ee4b155a54f0dba86b6664c25cade/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wj%252F8ee1253420374506b55607b65139a6d9%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wj/8ee1253420374506b55607b65139a6d9/images/large/2.jpg not downloaded yet
2026-03-26 22:53:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd3d7ad0>
2026-03-26 22:53:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_651317bf-da71-5928-93a9-8df683ca4d4f/651317bf-da71-5928-93a9-8df683ca4d4f_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252Ffc5ee4b155a54f0dba86b6664c25cade%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/fc5ee4b155a54f0dba86b6664c25cade/images/large/1.jpg saved to cache
2026-03-26 22:53:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 651317bf-da71-5928-93a9-8df683ca4d4f
2026-03-26 22:53:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7593250>
2026-03-26 22:53:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_651317bf-da71-5928-93a9-8df683ca4d4f/651317bf-da71-5928-93a9-8df683ca4d4f_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252Ffc5ee4b155a54f0dba86b6664c25cade%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/fc5ee4b155a54f0dba86b6664c25cade/images/large/2.jpg saved to cache
2026-03-26 22:53:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 651317bf-da71-5928-93a9-8df683ca4d4f
2026-03-26 22:53:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/fc5ee4b155a54f0dba86b6664c25cade/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wj%252F8ee1253420374506b55607b65139a6d9%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wj/8ee1253420374506b55607b65139a6d9/images/large/3.jpg not downloaded yet
2026-03-26 22:53:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/fc5ee4b155a54f0dba86b6664c25cade/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wj%252F8ee1253420374506b55607b65139a6d9%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wj/8ee1253420374506b55607b65139a6d9/images/large/4.jpg not downloaded yet
2026-03-26 22:53:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cbdf90>
2026-03-26 22:53:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_651317bf-da71-5928-93a9-8df683ca4d4f/651317bf-da71-5928-93a9-8df683ca4d4f_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252Ffc5ee4b155a54f0dba86b6664c25cade%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/fc5ee4b155a54f0dba86b6664c25cade/images/large/3.jpg saved to cache
2026-03-26 22:53:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 651317bf-da71-5928-93a9-8df683ca4d4f
2026-03-26 22:53:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/fc5ee4b155a54f0dba86b6664c25cade/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wj%252F8ee1253420374506b55607b65139a6d9%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wj/8ee1253420374506b55607b65139a6d9/images/large/5.jpg not downloaded yet
2026-03-26 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wj%252F8ee1253420374506b55607b65139a6d9%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wj/8ee1253420374506b55607b65139a6d9/images/large/6.jpg not downloaded yet
2026-03-26 22:53:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/fc5ee4b155a54f0dba86b6664c25cade/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/fc5ee4b155a54f0dba86b6664c25cade/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wj%252F8ee1253420374506b55607b65139a6d9%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wj/8ee1253420374506b55607b65139a6d9/images/large/7.jpg not downloaded yet
2026-03-26 22:53:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7592c90>
2026-03-26 22:53:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_651317bf-da71-5928-93a9-8df683ca4d4f/651317bf-da71-5928-93a9-8df683ca4d4f_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252Ffc5ee4b155a54f0dba86b6664c25cade%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/fc5ee4b155a54f0dba86b6664c25cade/images/large/4.jpg saved to cache
2026-03-26 22:53:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 651317bf-da71-5928-93a9-8df683ca4d4f
2026-03-26 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wj%252F8ee1253420374506b55607b65139a6d9%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wj/8ee1253420374506b55607b65139a6d9/images/large/8.jpg not downloaded yet
2026-03-26 22:53:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/fc5ee4b155a54f0dba86b6664c25cade/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cbc250>
2026-03-26 22:53:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_651317bf-da71-5928-93a9-8df683ca4d4f/651317bf-da71-5928-93a9-8df683ca4d4f_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252Ffc5ee4b155a54f0dba86b6664c25cade%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/fc5ee4b155a54f0dba86b6664c25cade/images/large/5.jpg saved to cache
2026-03-26 22:53:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 651317bf-da71-5928-93a9-8df683ca4d4f
2026-03-26 22:53:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7744590>
2026-03-26 22:53:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_651317bf-da71-5928-93a9-8df683ca4d4f/651317bf-da71-5928-93a9-8df683ca4d4f_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252Ffc5ee4b155a54f0dba86b6664c25cade%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/fc5ee4b155a54f0dba86b6664c25cade/images/large/7.jpg saved to cache
2026-03-26 22:53:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 651317bf-da71-5928-93a9-8df683ca4d4f
2026-03-26 22:53:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7425d10>
2026-03-26 22:53:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_651317bf-da71-5928-93a9-8df683ca4d4f/651317bf-da71-5928-93a9-8df683ca4d4f_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252Ffc5ee4b155a54f0dba86b6664c25cade%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/fc5ee4b155a54f0dba86b6664c25cade/images/large/6.jpg saved to cache
2026-03-26 22:53:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 651317bf-da71-5928-93a9-8df683ca4d4f
2026-03-26 22:53:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7778050>
2026-03-26 22:53:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_651317bf-da71-5928-93a9-8df683ca4d4f/651317bf-da71-5928-93a9-8df683ca4d4f_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252Ffc5ee4b155a54f0dba86b6664c25cade%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/fc5ee4b155a54f0dba86b6664c25cade/images/large/8.jpg saved to cache
2026-03-26 22:53:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 651317bf-da71-5928-93a9-8df683ca4d4f
2026-03-26 22:53:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/fc5ee4b155a54f0dba86b6664c25cade/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wj%252F8ee1253420374506b55607b65139a6d9%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wj/8ee1253420374506b55607b65139a6d9/images/large/9.jpg not downloaded yet
2026-03-26 22:53:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wj/8ee1253420374506b55607b65139a6d9/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wj%252F8ee1253420374506b55607b65139a6d9%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wj/8ee1253420374506b55607b65139a6d9/images/large/10.jpg not downloaded yet
2026-03-26 22:53:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7425c90>
2026-03-26 22:53:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_651317bf-da71-5928-93a9-8df683ca4d4f/651317bf-da71-5928-93a9-8df683ca4d4f_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252Ffc5ee4b155a54f0dba86b6664c25cade%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/fc5ee4b155a54f0dba86b6664c25cade/images/large/10.jpg saved to cache
2026-03-26 22:53:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 651317bf-da71-5928-93a9-8df683ca4d4f
2026-03-26 22:53:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wj/8ee1253420374506b55607b65139a6d9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:01 [ayvens.be] INFO: Found listing with ID: 1985491
2026-03-26 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985491%27 HTTP/1.1" 200 None
2026-03-26 22:53:01 [ayvens.be] INFO: Scrape type for 1985491: 1
2026-03-26 22:53:01 [ayvens.be] INFO: Extracting data for car ID: 1985491
2026-03-26 22:53:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 81b859eb-2d0f-5da7-8500-172f1eebee15 with identifier: 1985491
2026-03-26 22:53:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 81b859eb-2d0f-5da7-8500-172f1eebee15 with scrape type 1
2026-03-26 22:53:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 81b859eb-2d0f-5da7-8500-172f1eebee15
2026-03-26 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F823f50971f074fe392b69ac5aa9fc084%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/823f50971f074fe392b69ac5aa9fc084/images/large/1.jpg not downloaded yet
2026-03-26 22:53:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7aa3b90>
2026-03-26 22:53:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_651317bf-da71-5928-93a9-8df683ca4d4f/651317bf-da71-5928-93a9-8df683ca4d4f_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252Ffc5ee4b155a54f0dba86b6664c25cade%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/fc5ee4b155a54f0dba86b6664c25cade/images/large/9.jpg saved to cache
2026-03-26 22:53:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 651317bf-da71-5928-93a9-8df683ca4d4f
2026-03-26 22:53:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 651317bf-da71-5928-93a9-8df683ca4d4f, skipping ID generation
2026-03-26 22:53:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 651317bf-da71-5928-93a9-8df683ca4d4f with scrape type 1
2026-03-26 22:53:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 651317bf-da71-5928-93a9-8df683ca4d4f sending to next pipeline
2026-03-26 22:53:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 651317bf-da71-5928-93a9-8df683ca4d4f, identifier: 1985489
2026-03-26 22:53:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wj/8ee1253420374506b55607b65139a6d9/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F823f50971f074fe392b69ac5aa9fc084%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/823f50971f074fe392b69ac5aa9fc084/images/large/2.jpg not downloaded yet
2026-03-26 22:53:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 651317bf-da71-5928-93a9-8df683ca4d4f with identifier: 1985489
2026-03-26 22:53:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 651317bf-da71-5928-93a9-8df683ca4d4f with identifier: 1985489
2026-03-26 22:53:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 651317bf-da71-5928-93a9-8df683ca4d4f with identifier: 1985489 to the API
2026-03-26 22:53:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:53:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:53:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cp/fc5ee4b155a54f0dba86b6664c25cade/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '651317bf-da71-5928-93a9-8df683ca4d4f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'SUPERB COMBI',
 'odometer': 157154,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_651317bf-da71-5928-93a9-8df683ca4d4f/651317bf-da71-5928-93a9-8df683ca4d4f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 704430,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/fc5ee4b155a54f0dba86b6664c25cade/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_651317bf-da71-5928-93a9-8df683ca4d4f/651317bf-da71-5928-93a9-8df683ca4d4f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 692375,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/fc5ee4b155a54f0dba86b6664c25cade/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_651317bf-da71-5928-93a9-8df683ca4d4f/651317bf-da71-5928-93a9-8df683ca4d4f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 690412,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/fc5ee4b155a54f0dba86b6664c25cade/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_651317bf-da71-5928-93a9-8df683ca4d4f/651317bf-da71-5928-93a9-8df683ca4d4f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 694944,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/fc5ee4b155a54f0dba86b6664c25cade/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_651317bf-da71-5928-93a9-8df683ca4d4f/651317bf-da71-5928-93a9-8df683ca4d4f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 694551,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/fc5ee4b155a54f0dba86b6664c25cade/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_651317bf-da71-5928-93a9-8df683ca4d4f/651317bf-da71-5928-93a9-8df683ca4d4f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 716132,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/fc5ee4b155a54f0dba86b6664c25cade/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_651317bf-da71-5928-93a9-8df683ca4d4f/651317bf-da71-5928-93a9-8df683ca4d4f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 664396,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/fc5ee4b155a54f0dba86b6664c25cade/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_651317bf-da71-5928-93a9-8df683ca4d4f/651317bf-da71-5928-93a9-8df683ca4d4f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 737042,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/fc5ee4b155a54f0dba86b6664c25cade/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_651317bf-da71-5928-93a9-8df683ca4d4f/651317bf-da71-5928-93a9-8df683ca4d4f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 745954,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/fc5ee4b155a54f0dba86b6664c25cade/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_651317bf-da71-5928-93a9-8df683ca4d4f/651317bf-da71-5928-93a9-8df683ca4d4f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 709698,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/fc5ee4b155a54f0dba86b6664c25cade/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA SUPERB COMBI 1.5 TSI ACT 110KW DSG7 CLEVER+',
 'transmission': 'automatic',
 'trim': '1.5 TSI ACT 110KW DSG7 CLEVER+',
 'vin': None,
 'year': 2022}
2026-03-26 22:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985489%27 HTTP/1.1" 200 None
2026-03-26 22:53:02 [ayvens.be] INFO: Saving data for 1985489: {'created_time': 1774565582.455503, 'last_price_update_time': 1774565582.455512, 'auction_closing_time': 1774958400.0}
2026-03-26 22:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985489') HTTP/1.1" 204 0
2026-03-26 22:53:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wj/8ee1253420374506b55607b65139a6d9/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74b5490>
2026-03-26 22:53:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5a211d9-f255-57a9-bd89-c1a1a699cf54/b5a211d9-f255-57a9-bd89-c1a1a699cf54_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wj%252F8ee1253420374506b55607b65139a6d9%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wj/8ee1253420374506b55607b65139a6d9/images/large/2.jpg saved to cache
2026-03-26 22:53:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b5a211d9-f255-57a9-bd89-c1a1a699cf54
2026-03-26 22:53:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wj/8ee1253420374506b55607b65139a6d9/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F823f50971f074fe392b69ac5aa9fc084%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/823f50971f074fe392b69ac5aa9fc084/images/large/3.jpg not downloaded yet
2026-03-26 22:53:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5ca4bd0>
2026-03-26 22:53:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5a211d9-f255-57a9-bd89-c1a1a699cf54/b5a211d9-f255-57a9-bd89-c1a1a699cf54_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wj%252F8ee1253420374506b55607b65139a6d9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wj/8ee1253420374506b55607b65139a6d9/images/large/1.jpg saved to cache
2026-03-26 22:53:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b5a211d9-f255-57a9-bd89-c1a1a699cf54
2026-03-26 22:53:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76c4190>
2026-03-26 22:53:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5a211d9-f255-57a9-bd89-c1a1a699cf54/b5a211d9-f255-57a9-bd89-c1a1a699cf54_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wj%252F8ee1253420374506b55607b65139a6d9%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wj/8ee1253420374506b55607b65139a6d9/images/large/4.jpg saved to cache
2026-03-26 22:53:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b5a211d9-f255-57a9-bd89-c1a1a699cf54
2026-03-26 22:53:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wj/8ee1253420374506b55607b65139a6d9/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F823f50971f074fe392b69ac5aa9fc084%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/823f50971f074fe392b69ac5aa9fc084/images/large/4.jpg not downloaded yet
2026-03-26 22:53:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wj/8ee1253420374506b55607b65139a6d9/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wj/8ee1253420374506b55607b65139a6d9/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F823f50971f074fe392b69ac5aa9fc084%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/823f50971f074fe392b69ac5aa9fc084/images/large/5.jpg not downloaded yet
2026-03-26 22:53:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7495010>
2026-03-26 22:53:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5a211d9-f255-57a9-bd89-c1a1a699cf54/b5a211d9-f255-57a9-bd89-c1a1a699cf54_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wj%252F8ee1253420374506b55607b65139a6d9%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wj/8ee1253420374506b55607b65139a6d9/images/large/3.jpg saved to cache
2026-03-26 22:53:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b5a211d9-f255-57a9-bd89-c1a1a699cf54
2026-03-26 22:53:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7913410>
2026-03-26 22:53:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5a211d9-f255-57a9-bd89-c1a1a699cf54/b5a211d9-f255-57a9-bd89-c1a1a699cf54_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wj%252F8ee1253420374506b55607b65139a6d9%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wj/8ee1253420374506b55607b65139a6d9/images/large/5.jpg saved to cache
2026-03-26 22:53:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b5a211d9-f255-57a9-bd89-c1a1a699cf54
2026-03-26 22:53:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wj/8ee1253420374506b55607b65139a6d9/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F823f50971f074fe392b69ac5aa9fc084%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/823f50971f074fe392b69ac5aa9fc084/images/large/6.jpg not downloaded yet
2026-03-26 22:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F823f50971f074fe392b69ac5aa9fc084%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/823f50971f074fe392b69ac5aa9fc084/images/large/7.jpg not downloaded yet
2026-03-26 22:53:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74254d0>
2026-03-26 22:53:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5a211d9-f255-57a9-bd89-c1a1a699cf54/b5a211d9-f255-57a9-bd89-c1a1a699cf54_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wj%252F8ee1253420374506b55607b65139a6d9%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wj/8ee1253420374506b55607b65139a6d9/images/large/6.jpg saved to cache
2026-03-26 22:53:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b5a211d9-f255-57a9-bd89-c1a1a699cf54
2026-03-26 22:53:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74e5290>
2026-03-26 22:53:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5a211d9-f255-57a9-bd89-c1a1a699cf54/b5a211d9-f255-57a9-bd89-c1a1a699cf54_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wj%252F8ee1253420374506b55607b65139a6d9%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wj/8ee1253420374506b55607b65139a6d9/images/large/7.jpg saved to cache
2026-03-26 22:53:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b5a211d9-f255-57a9-bd89-c1a1a699cf54
2026-03-26 22:53:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7aa0d90>
2026-03-26 22:53:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5a211d9-f255-57a9-bd89-c1a1a699cf54/b5a211d9-f255-57a9-bd89-c1a1a699cf54_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wj%252F8ee1253420374506b55607b65139a6d9%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wj/8ee1253420374506b55607b65139a6d9/images/large/8.jpg saved to cache
2026-03-26 22:53:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b5a211d9-f255-57a9-bd89-c1a1a699cf54
2026-03-26 22:53:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wj/8ee1253420374506b55607b65139a6d9/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F823f50971f074fe392b69ac5aa9fc084%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/823f50971f074fe392b69ac5aa9fc084/images/large/8.jpg not downloaded yet
2026-03-26 22:53:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7747d50>
2026-03-26 22:53:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5a211d9-f255-57a9-bd89-c1a1a699cf54/b5a211d9-f255-57a9-bd89-c1a1a699cf54_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wj%252F8ee1253420374506b55607b65139a6d9%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wj/8ee1253420374506b55607b65139a6d9/images/large/9.jpg saved to cache
2026-03-26 22:53:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b5a211d9-f255-57a9-bd89-c1a1a699cf54
2026-03-26 22:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F823f50971f074fe392b69ac5aa9fc084%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/823f50971f074fe392b69ac5aa9fc084/images/large/9.jpg not downloaded yet
2026-03-26 22:53:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/823f50971f074fe392b69ac5aa9fc084/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F823f50971f074fe392b69ac5aa9fc084%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/823f50971f074fe392b69ac5aa9fc084/images/large/10.jpg not downloaded yet
2026-03-26 22:53:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7a553d0>
2026-03-26 22:53:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5a211d9-f255-57a9-bd89-c1a1a699cf54/b5a211d9-f255-57a9-bd89-c1a1a699cf54_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wj%252F8ee1253420374506b55607b65139a6d9%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wj/8ee1253420374506b55607b65139a6d9/images/large/10.jpg saved to cache
2026-03-26 22:53:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b5a211d9-f255-57a9-bd89-c1a1a699cf54
2026-03-26 22:53:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b5a211d9-f255-57a9-bd89-c1a1a699cf54, skipping ID generation
2026-03-26 22:53:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5a211d9-f255-57a9-bd89-c1a1a699cf54 with scrape type 1
2026-03-26 22:53:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b5a211d9-f255-57a9-bd89-c1a1a699cf54 sending to next pipeline
2026-03-26 22:53:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b5a211d9-f255-57a9-bd89-c1a1a699cf54, identifier: 1985490
2026-03-26 22:53:03 [ayvens.be] INFO: Found listing with ID: 1985492
2026-03-26 22:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985492%27 HTTP/1.1" 200 None
2026-03-26 22:53:03 [ayvens.be] INFO: Scrape type for 1985492: 1
2026-03-26 22:53:03 [ayvens.be] INFO: Extracting data for car ID: 1985492
2026-03-26 22:53:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47fff314-ef4f-5e31-bb30-6e5d411dc9a2 with identifier: 1985492
2026-03-26 22:53:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47fff314-ef4f-5e31-bb30-6e5d411dc9a2 with scrape type 1
2026-03-26 22:53:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 47fff314-ef4f-5e31-bb30-6e5d411dc9a2
2026-03-26 22:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F7e9011ce113144a5ab44cd5ad049c9cc%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/7e9011ce113144a5ab44cd5ad049c9cc/images/large/1.jpg not downloaded yet
2026-03-26 22:53:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b5a211d9-f255-57a9-bd89-c1a1a699cf54 with identifier: 1985490
2026-03-26 22:53:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b5a211d9-f255-57a9-bd89-c1a1a699cf54 with identifier: 1985490
2026-03-26 22:53:03 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b5a211d9-f255-57a9-bd89-c1a1a699cf54 with identifier: 1985490 to the API
2026-03-26 22:53:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:53:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:53:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1wj/8ee1253420374506b55607b65139a6d9/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b5a211d9-f255-57a9-bd89-c1a1a699cf54',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TRANSPORTER 1400 FOU SWB DSL -',
 'odometer': 178778,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5a211d9-f255-57a9-bd89-c1a1a699cf54/b5a211d9-f255-57a9-bd89-c1a1a699cf54_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 582413,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wj/8ee1253420374506b55607b65139a6d9/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5a211d9-f255-57a9-bd89-c1a1a699cf54/b5a211d9-f255-57a9-bd89-c1a1a699cf54_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 509393,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wj/8ee1253420374506b55607b65139a6d9/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5a211d9-f255-57a9-bd89-c1a1a699cf54/b5a211d9-f255-57a9-bd89-c1a1a699cf54_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 618286,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wj/8ee1253420374506b55607b65139a6d9/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5a211d9-f255-57a9-bd89-c1a1a699cf54/b5a211d9-f255-57a9-bd89-c1a1a699cf54_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 532118,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wj/8ee1253420374506b55607b65139a6d9/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5a211d9-f255-57a9-bd89-c1a1a699cf54/b5a211d9-f255-57a9-bd89-c1a1a699cf54_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 492734,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wj/8ee1253420374506b55607b65139a6d9/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5a211d9-f255-57a9-bd89-c1a1a699cf54/b5a211d9-f255-57a9-bd89-c1a1a699cf54_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 589802,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wj/8ee1253420374506b55607b65139a6d9/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5a211d9-f255-57a9-bd89-c1a1a699cf54/b5a211d9-f255-57a9-bd89-c1a1a699cf54_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 506780,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wj/8ee1253420374506b55607b65139a6d9/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5a211d9-f255-57a9-bd89-c1a1a699cf54/b5a211d9-f255-57a9-bd89-c1a1a699cf54_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 565845,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wj/8ee1253420374506b55607b65139a6d9/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5a211d9-f255-57a9-bd89-c1a1a699cf54/b5a211d9-f255-57a9-bd89-c1a1a699cf54_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 536397,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wj/8ee1253420374506b55607b65139a6d9/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5a211d9-f255-57a9-bd89-c1a1a699cf54/b5a211d9-f255-57a9-bd89-c1a1a699cf54_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 604441,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wj/8ee1253420374506b55607b65139a6d9/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-18',
 'seats_number': 3,
 'seller_name': None,
 'title': 'VOLKSWAGEN TRANSPORTER 1400 FOU SWB DSL - 2.0 TDi SCR BMT STOCK',
 'transmission': 'manual',
 'trim': '2.0 TDi SCR BMT STOCK',
 'vin': None,
 'year': 2019}
2026-03-26 22:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985490%27 HTTP/1.1" 200 None
2026-03-26 22:53:03 [ayvens.be] INFO: Saving data for 1985490: {'created_time': 1774565583.960699, 'last_price_update_time': 1774565583.960708, 'auction_closing_time': 1774958400.0}
2026-03-26 22:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985490') HTTP/1.1" 204 0
2026-03-26 22:53:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/823f50971f074fe392b69ac5aa9fc084/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/823f50971f074fe392b69ac5aa9fc084/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F7e9011ce113144a5ab44cd5ad049c9cc%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/7e9011ce113144a5ab44cd5ad049c9cc/images/large/2.jpg not downloaded yet
2026-03-26 22:53:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7aa1cd0>
2026-03-26 22:53:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81b859eb-2d0f-5da7-8500-172f1eebee15/81b859eb-2d0f-5da7-8500-172f1eebee15_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F823f50971f074fe392b69ac5aa9fc084%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/823f50971f074fe392b69ac5aa9fc084/images/large/1.jpg saved to cache
2026-03-26 22:53:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 81b859eb-2d0f-5da7-8500-172f1eebee15
2026-03-26 22:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F7e9011ce113144a5ab44cd5ad049c9cc%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/7e9011ce113144a5ab44cd5ad049c9cc/images/large/3.jpg not downloaded yet
2026-03-26 22:53:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/823f50971f074fe392b69ac5aa9fc084/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/823f50971f074fe392b69ac5aa9fc084/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7aeacd0>
2026-03-26 22:53:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81b859eb-2d0f-5da7-8500-172f1eebee15/81b859eb-2d0f-5da7-8500-172f1eebee15_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F823f50971f074fe392b69ac5aa9fc084%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/823f50971f074fe392b69ac5aa9fc084/images/large/2.jpg saved to cache
2026-03-26 22:53:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 81b859eb-2d0f-5da7-8500-172f1eebee15
2026-03-26 22:53:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76a7c10>
2026-03-26 22:53:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81b859eb-2d0f-5da7-8500-172f1eebee15/81b859eb-2d0f-5da7-8500-172f1eebee15_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F823f50971f074fe392b69ac5aa9fc084%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/823f50971f074fe392b69ac5aa9fc084/images/large/3.jpg saved to cache
2026-03-26 22:53:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 81b859eb-2d0f-5da7-8500-172f1eebee15
2026-03-26 22:53:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/823f50971f074fe392b69ac5aa9fc084/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F7e9011ce113144a5ab44cd5ad049c9cc%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/7e9011ce113144a5ab44cd5ad049c9cc/images/large/4.jpg not downloaded yet
2026-03-26 22:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F7e9011ce113144a5ab44cd5ad049c9cc%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/7e9011ce113144a5ab44cd5ad049c9cc/images/large/5.jpg not downloaded yet
2026-03-26 22:53:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b746ca90>
2026-03-26 22:53:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81b859eb-2d0f-5da7-8500-172f1eebee15/81b859eb-2d0f-5da7-8500-172f1eebee15_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F823f50971f074fe392b69ac5aa9fc084%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/823f50971f074fe392b69ac5aa9fc084/images/large/4.jpg saved to cache
2026-03-26 22:53:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 81b859eb-2d0f-5da7-8500-172f1eebee15
2026-03-26 22:53:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7426b90>
2026-03-26 22:53:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81b859eb-2d0f-5da7-8500-172f1eebee15/81b859eb-2d0f-5da7-8500-172f1eebee15_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F823f50971f074fe392b69ac5aa9fc084%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/823f50971f074fe392b69ac5aa9fc084/images/large/5.jpg saved to cache
2026-03-26 22:53:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 81b859eb-2d0f-5da7-8500-172f1eebee15
2026-03-26 22:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F7e9011ce113144a5ab44cd5ad049c9cc%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/7e9011ce113144a5ab44cd5ad049c9cc/images/large/6.jpg not downloaded yet
2026-03-26 22:53:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/823f50971f074fe392b69ac5aa9fc084/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/823f50971f074fe392b69ac5aa9fc084/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/823f50971f074fe392b69ac5aa9fc084/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F7e9011ce113144a5ab44cd5ad049c9cc%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/7e9011ce113144a5ab44cd5ad049c9cc/images/large/7.jpg not downloaded yet
2026-03-26 22:53:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7910d90>
2026-03-26 22:53:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81b859eb-2d0f-5da7-8500-172f1eebee15/81b859eb-2d0f-5da7-8500-172f1eebee15_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F823f50971f074fe392b69ac5aa9fc084%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/823f50971f074fe392b69ac5aa9fc084/images/large/6.jpg saved to cache
2026-03-26 22:53:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 81b859eb-2d0f-5da7-8500-172f1eebee15
2026-03-26 22:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F7e9011ce113144a5ab44cd5ad049c9cc%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/7e9011ce113144a5ab44cd5ad049c9cc/images/large/8.jpg not downloaded yet
2026-03-26 22:53:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/823f50971f074fe392b69ac5aa9fc084/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/7e9011ce113144a5ab44cd5ad049c9cc/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F7e9011ce113144a5ab44cd5ad049c9cc%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/7e9011ce113144a5ab44cd5ad049c9cc/images/large/9.jpg not downloaded yet
2026-03-26 22:53:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7913f90>
2026-03-26 22:53:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81b859eb-2d0f-5da7-8500-172f1eebee15/81b859eb-2d0f-5da7-8500-172f1eebee15_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F823f50971f074fe392b69ac5aa9fc084%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/823f50971f074fe392b69ac5aa9fc084/images/large/8.jpg saved to cache
2026-03-26 22:53:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 81b859eb-2d0f-5da7-8500-172f1eebee15
2026-03-26 22:53:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b788cad0>
2026-03-26 22:53:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81b859eb-2d0f-5da7-8500-172f1eebee15/81b859eb-2d0f-5da7-8500-172f1eebee15_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F823f50971f074fe392b69ac5aa9fc084%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/823f50971f074fe392b69ac5aa9fc084/images/large/9.jpg saved to cache
2026-03-26 22:53:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 81b859eb-2d0f-5da7-8500-172f1eebee15
2026-03-26 22:53:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77aec90>
2026-03-26 22:53:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81b859eb-2d0f-5da7-8500-172f1eebee15/81b859eb-2d0f-5da7-8500-172f1eebee15_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F823f50971f074fe392b69ac5aa9fc084%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/823f50971f074fe392b69ac5aa9fc084/images/large/7.jpg saved to cache
2026-03-26 22:53:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 81b859eb-2d0f-5da7-8500-172f1eebee15
2026-03-26 22:53:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/7e9011ce113144a5ab44cd5ad049c9cc/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F7e9011ce113144a5ab44cd5ad049c9cc%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/7e9011ce113144a5ab44cd5ad049c9cc/images/large/10.jpg not downloaded yet
2026-03-26 22:53:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/7e9011ce113144a5ab44cd5ad049c9cc/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:04 [ayvens.be] INFO: Found listing with ID: 1985493
2026-03-26 22:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985493%27 HTTP/1.1" 200 None
2026-03-26 22:53:04 [ayvens.be] INFO: Scrape type for 1985493: 1
2026-03-26 22:53:04 [ayvens.be] INFO: Extracting data for car ID: 1985493
2026-03-26 22:53:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 896ab42b-530f-5fb1-81d6-cb9f62e346c9 with identifier: 1985493
2026-03-26 22:53:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 896ab42b-530f-5fb1-81d6-cb9f62e346c9 with scrape type 1
2026-03-26 22:53:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 896ab42b-530f-5fb1-81d6-cb9f62e346c9
2026-03-26 22:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F224d188996624d3e96cc0c5ff79157d5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/224d188996624d3e96cc0c5ff79157d5/images/large/1.jpg not downloaded yet
2026-03-26 22:53:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/7e9011ce113144a5ab44cd5ad049c9cc/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/7e9011ce113144a5ab44cd5ad049c9cc/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd0cfed0>
2026-03-26 22:53:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81b859eb-2d0f-5da7-8500-172f1eebee15/81b859eb-2d0f-5da7-8500-172f1eebee15_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F823f50971f074fe392b69ac5aa9fc084%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/823f50971f074fe392b69ac5aa9fc084/images/large/10.jpg saved to cache
2026-03-26 22:53:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 81b859eb-2d0f-5da7-8500-172f1eebee15
2026-03-26 22:53:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 81b859eb-2d0f-5da7-8500-172f1eebee15, skipping ID generation
2026-03-26 22:53:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 81b859eb-2d0f-5da7-8500-172f1eebee15 with scrape type 1
2026-03-26 22:53:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 81b859eb-2d0f-5da7-8500-172f1eebee15 sending to next pipeline
2026-03-26 22:53:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 81b859eb-2d0f-5da7-8500-172f1eebee15, identifier: 1985491
2026-03-26 22:53:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6d83b50>
2026-03-26 22:53:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47fff314-ef4f-5e31-bb30-6e5d411dc9a2/47fff314-ef4f-5e31-bb30-6e5d411dc9a2_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F7e9011ce113144a5ab44cd5ad049c9cc%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/7e9011ce113144a5ab44cd5ad049c9cc/images/large/1.jpg saved to cache
2026-03-26 22:53:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 47fff314-ef4f-5e31-bb30-6e5d411dc9a2
2026-03-26 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F224d188996624d3e96cc0c5ff79157d5%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/224d188996624d3e96cc0c5ff79157d5/images/large/2.jpg not downloaded yet
2026-03-26 22:53:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 81b859eb-2d0f-5da7-8500-172f1eebee15 with identifier: 1985491
2026-03-26 22:53:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 81b859eb-2d0f-5da7-8500-172f1eebee15 with identifier: 1985491
2026-03-26 22:53:05 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 81b859eb-2d0f-5da7-8500-172f1eebee15 with identifier: 1985491 to the API
2026-03-26 22:53:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:53:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:53:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bu/823f50971f074fe392b69ac5aa9fc084/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '81b859eb-2d0f-5da7-8500-172f1eebee15',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A3 BERLINE',
 'odometer': 116952,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81b859eb-2d0f-5da7-8500-172f1eebee15/81b859eb-2d0f-5da7-8500-172f1eebee15_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 679908,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/823f50971f074fe392b69ac5aa9fc084/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81b859eb-2d0f-5da7-8500-172f1eebee15/81b859eb-2d0f-5da7-8500-172f1eebee15_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 661413,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/823f50971f074fe392b69ac5aa9fc084/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81b859eb-2d0f-5da7-8500-172f1eebee15/81b859eb-2d0f-5da7-8500-172f1eebee15_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 665913,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/823f50971f074fe392b69ac5aa9fc084/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81b859eb-2d0f-5da7-8500-172f1eebee15/81b859eb-2d0f-5da7-8500-172f1eebee15_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 719146,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/823f50971f074fe392b69ac5aa9fc084/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81b859eb-2d0f-5da7-8500-172f1eebee15/81b859eb-2d0f-5da7-8500-172f1eebee15_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 748878,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/823f50971f074fe392b69ac5aa9fc084/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81b859eb-2d0f-5da7-8500-172f1eebee15/81b859eb-2d0f-5da7-8500-172f1eebee15_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 613293,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/823f50971f074fe392b69ac5aa9fc084/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81b859eb-2d0f-5da7-8500-172f1eebee15/81b859eb-2d0f-5da7-8500-172f1eebee15_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 752009,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/823f50971f074fe392b69ac5aa9fc084/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81b859eb-2d0f-5da7-8500-172f1eebee15/81b859eb-2d0f-5da7-8500-172f1eebee15_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 718560,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/823f50971f074fe392b69ac5aa9fc084/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81b859eb-2d0f-5da7-8500-172f1eebee15/81b859eb-2d0f-5da7-8500-172f1eebee15_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 465154,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/823f50971f074fe392b69ac5aa9fc084/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81b859eb-2d0f-5da7-8500-172f1eebee15/81b859eb-2d0f-5da7-8500-172f1eebee15_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 543936,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/823f50971f074fe392b69ac5aa9fc084/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A3 BERLINE 1.5 TFSI 35 110KW S TRONIC S LINE',
 'transmission': 'automatic',
 'trim': '1.5 TFSI 35 110KW S TRONIC S LINE',
 'vin': None,
 'year': 2022}
2026-03-26 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985491%27 HTTP/1.1" 200 None
2026-03-26 22:53:05 [ayvens.be] INFO: Saving data for 1985491: {'created_time': 1774565585.521764, 'last_price_update_time': 1774565585.521773, 'auction_closing_time': 1774958400.0}
2026-03-26 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985491') HTTP/1.1" 204 0
2026-03-26 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F224d188996624d3e96cc0c5ff79157d5%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/224d188996624d3e96cc0c5ff79157d5/images/large/3.jpg not downloaded yet
2026-03-26 22:53:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79cd610>
2026-03-26 22:53:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47fff314-ef4f-5e31-bb30-6e5d411dc9a2/47fff314-ef4f-5e31-bb30-6e5d411dc9a2_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F7e9011ce113144a5ab44cd5ad049c9cc%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/7e9011ce113144a5ab44cd5ad049c9cc/images/large/2.jpg saved to cache
2026-03-26 22:53:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 47fff314-ef4f-5e31-bb30-6e5d411dc9a2
2026-03-26 22:53:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b75902d0>
2026-03-26 22:53:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47fff314-ef4f-5e31-bb30-6e5d411dc9a2/47fff314-ef4f-5e31-bb30-6e5d411dc9a2_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F7e9011ce113144a5ab44cd5ad049c9cc%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/7e9011ce113144a5ab44cd5ad049c9cc/images/large/3.jpg saved to cache
2026-03-26 22:53:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 47fff314-ef4f-5e31-bb30-6e5d411dc9a2
2026-03-26 22:53:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b792fe90>
2026-03-26 22:53:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47fff314-ef4f-5e31-bb30-6e5d411dc9a2/47fff314-ef4f-5e31-bb30-6e5d411dc9a2_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F7e9011ce113144a5ab44cd5ad049c9cc%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/7e9011ce113144a5ab44cd5ad049c9cc/images/large/4.jpg saved to cache
2026-03-26 22:53:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 47fff314-ef4f-5e31-bb30-6e5d411dc9a2
2026-03-26 22:53:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74125d0>
2026-03-26 22:53:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47fff314-ef4f-5e31-bb30-6e5d411dc9a2/47fff314-ef4f-5e31-bb30-6e5d411dc9a2_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F7e9011ce113144a5ab44cd5ad049c9cc%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/7e9011ce113144a5ab44cd5ad049c9cc/images/large/5.jpg saved to cache
2026-03-26 22:53:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 47fff314-ef4f-5e31-bb30-6e5d411dc9a2
2026-03-26 22:53:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/7e9011ce113144a5ab44cd5ad049c9cc/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F224d188996624d3e96cc0c5ff79157d5%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/224d188996624d3e96cc0c5ff79157d5/images/large/4.jpg not downloaded yet
2026-03-26 22:53:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/7e9011ce113144a5ab44cd5ad049c9cc/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F224d188996624d3e96cc0c5ff79157d5%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/224d188996624d3e96cc0c5ff79157d5/images/large/5.jpg not downloaded yet
2026-03-26 22:53:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/7e9011ce113144a5ab44cd5ad049c9cc/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/7e9011ce113144a5ab44cd5ad049c9cc/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F224d188996624d3e96cc0c5ff79157d5%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/224d188996624d3e96cc0c5ff79157d5/images/large/6.jpg not downloaded yet
2026-03-26 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F224d188996624d3e96cc0c5ff79157d5%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/224d188996624d3e96cc0c5ff79157d5/images/large/7.jpg not downloaded yet
2026-03-26 22:53:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/7e9011ce113144a5ab44cd5ad049c9cc/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F224d188996624d3e96cc0c5ff79157d5%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/224d188996624d3e96cc0c5ff79157d5/images/large/8.jpg not downloaded yet
2026-03-26 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F224d188996624d3e96cc0c5ff79157d5%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/224d188996624d3e96cc0c5ff79157d5/images/large/9.jpg not downloaded yet
2026-03-26 22:53:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/224d188996624d3e96cc0c5ff79157d5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74af890>
2026-03-26 22:53:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47fff314-ef4f-5e31-bb30-6e5d411dc9a2/47fff314-ef4f-5e31-bb30-6e5d411dc9a2_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F7e9011ce113144a5ab44cd5ad049c9cc%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/7e9011ce113144a5ab44cd5ad049c9cc/images/large/6.jpg saved to cache
2026-03-26 22:53:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 47fff314-ef4f-5e31-bb30-6e5d411dc9a2
2026-03-26 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F224d188996624d3e96cc0c5ff79157d5%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/224d188996624d3e96cc0c5ff79157d5/images/large/10.jpg not downloaded yet
2026-03-26 22:53:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7910ed0>
2026-03-26 22:53:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47fff314-ef4f-5e31-bb30-6e5d411dc9a2/47fff314-ef4f-5e31-bb30-6e5d411dc9a2_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F7e9011ce113144a5ab44cd5ad049c9cc%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/7e9011ce113144a5ab44cd5ad049c9cc/images/large/7.jpg saved to cache
2026-03-26 22:53:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 47fff314-ef4f-5e31-bb30-6e5d411dc9a2
2026-03-26 22:53:06 [ayvens.be] INFO: Found listing with ID: 1985494
2026-03-26 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985494%27 HTTP/1.1" 200 None
2026-03-26 22:53:06 [ayvens.be] INFO: Scrape type for 1985494: 1
2026-03-26 22:53:06 [ayvens.be] INFO: Extracting data for car ID: 1985494
2026-03-26 22:53:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b6076ab-d217-582e-9c06-1ea0acaa8d72 with identifier: 1985494
2026-03-26 22:53:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b6076ab-d217-582e-9c06-1ea0acaa8d72 with scrape type 1
2026-03-26 22:53:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8b6076ab-d217-582e-9c06-1ea0acaa8d72
2026-03-26 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F12fa7407c2154c478bac232277682adb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/12fa7407c2154c478bac232277682adb/images/large/1.jpg not downloaded yet
2026-03-26 22:53:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b792ffd0>
2026-03-26 22:53:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47fff314-ef4f-5e31-bb30-6e5d411dc9a2/47fff314-ef4f-5e31-bb30-6e5d411dc9a2_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F7e9011ce113144a5ab44cd5ad049c9cc%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/7e9011ce113144a5ab44cd5ad049c9cc/images/large/9.jpg saved to cache
2026-03-26 22:53:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 47fff314-ef4f-5e31-bb30-6e5d411dc9a2
2026-03-26 22:53:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6dda910>
2026-03-26 22:53:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47fff314-ef4f-5e31-bb30-6e5d411dc9a2/47fff314-ef4f-5e31-bb30-6e5d411dc9a2_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F7e9011ce113144a5ab44cd5ad049c9cc%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/7e9011ce113144a5ab44cd5ad049c9cc/images/large/8.jpg saved to cache
2026-03-26 22:53:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 47fff314-ef4f-5e31-bb30-6e5d411dc9a2
2026-03-26 22:53:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e4fc50>
2026-03-26 22:53:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47fff314-ef4f-5e31-bb30-6e5d411dc9a2/47fff314-ef4f-5e31-bb30-6e5d411dc9a2_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F7e9011ce113144a5ab44cd5ad049c9cc%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/7e9011ce113144a5ab44cd5ad049c9cc/images/large/10.jpg saved to cache
2026-03-26 22:53:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 47fff314-ef4f-5e31-bb30-6e5d411dc9a2
2026-03-26 22:53:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 47fff314-ef4f-5e31-bb30-6e5d411dc9a2, skipping ID generation
2026-03-26 22:53:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47fff314-ef4f-5e31-bb30-6e5d411dc9a2 with scrape type 1
2026-03-26 22:53:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 47fff314-ef4f-5e31-bb30-6e5d411dc9a2 sending to next pipeline
2026-03-26 22:53:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 47fff314-ef4f-5e31-bb30-6e5d411dc9a2, identifier: 1985492
2026-03-26 22:53:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 47fff314-ef4f-5e31-bb30-6e5d411dc9a2 with identifier: 1985492
2026-03-26 22:53:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 47fff314-ef4f-5e31-bb30-6e5d411dc9a2 with identifier: 1985492
2026-03-26 22:53:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 47fff314-ef4f-5e31-bb30-6e5d411dc9a2 with identifier: 1985492 to the API
2026-03-26 22:53:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:53:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:53:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1xj/7e9011ce113144a5ab44cd5ad049c9cc/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '47fff314-ef4f-5e31-bb30-6e5d411dc9a2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TRANSPORTER 1400 FOU LWB DSL -',
 'odometer': 142297,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47fff314-ef4f-5e31-bb30-6e5d411dc9a2/47fff314-ef4f-5e31-bb30-6e5d411dc9a2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 540876,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/7e9011ce113144a5ab44cd5ad049c9cc/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47fff314-ef4f-5e31-bb30-6e5d411dc9a2/47fff314-ef4f-5e31-bb30-6e5d411dc9a2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 500526,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/7e9011ce113144a5ab44cd5ad049c9cc/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47fff314-ef4f-5e31-bb30-6e5d411dc9a2/47fff314-ef4f-5e31-bb30-6e5d411dc9a2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 592655,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/7e9011ce113144a5ab44cd5ad049c9cc/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47fff314-ef4f-5e31-bb30-6e5d411dc9a2/47fff314-ef4f-5e31-bb30-6e5d411dc9a2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 516318,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/7e9011ce113144a5ab44cd5ad049c9cc/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47fff314-ef4f-5e31-bb30-6e5d411dc9a2/47fff314-ef4f-5e31-bb30-6e5d411dc9a2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 424864,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/7e9011ce113144a5ab44cd5ad049c9cc/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47fff314-ef4f-5e31-bb30-6e5d411dc9a2/47fff314-ef4f-5e31-bb30-6e5d411dc9a2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 575559,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/7e9011ce113144a5ab44cd5ad049c9cc/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47fff314-ef4f-5e31-bb30-6e5d411dc9a2/47fff314-ef4f-5e31-bb30-6e5d411dc9a2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 569204,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/7e9011ce113144a5ab44cd5ad049c9cc/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47fff314-ef4f-5e31-bb30-6e5d411dc9a2/47fff314-ef4f-5e31-bb30-6e5d411dc9a2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 553286,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/7e9011ce113144a5ab44cd5ad049c9cc/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47fff314-ef4f-5e31-bb30-6e5d411dc9a2/47fff314-ef4f-5e31-bb30-6e5d411dc9a2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 415177,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/7e9011ce113144a5ab44cd5ad049c9cc/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47fff314-ef4f-5e31-bb30-6e5d411dc9a2/47fff314-ef4f-5e31-bb30-6e5d411dc9a2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 652684,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/7e9011ce113144a5ab44cd5ad049c9cc/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-20',
 'seats_number': 3,
 'seller_name': None,
 'title': 'VOLKSWAGEN TRANSPORTER 1400 FOU LWB DSL - 2.0 TDi SCR BMT STOCK',
 'transmission': 'manual',
 'trim': '2.0 TDi SCR BMT STOCK',
 'vin': None,
 'year': 2020}
2026-03-26 22:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985492%27 HTTP/1.1" 200 None
2026-03-26 22:53:07 [ayvens.be] INFO: Saving data for 1985492: {'created_time': 1774565587.086083, 'last_price_update_time': 1774565587.086093, 'auction_closing_time': 1774958400.0}
2026-03-26 22:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985492') HTTP/1.1" 204 0
2026-03-26 22:53:07 [scrapy.extensions.logstats] INFO: Crawled 6 pages (at -6 pages/min), scraped 273 items (at 39 items/min)
2026-03-26 22:53:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 182MiB
2026-03-26 22:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F12fa7407c2154c478bac232277682adb%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/12fa7407c2154c478bac232277682adb/images/large/2.jpg not downloaded yet
2026-03-26 22:53:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd947b90>
2026-03-26 22:53:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_896ab42b-530f-5fb1-81d6-cb9f62e346c9/896ab42b-530f-5fb1-81d6-cb9f62e346c9_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F224d188996624d3e96cc0c5ff79157d5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/224d188996624d3e96cc0c5ff79157d5/images/large/1.jpg saved to cache
2026-03-26 22:53:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 896ab42b-530f-5fb1-81d6-cb9f62e346c9
2026-03-26 22:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F12fa7407c2154c478bac232277682adb%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/12fa7407c2154c478bac232277682adb/images/large/3.jpg not downloaded yet
2026-03-26 22:53:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/224d188996624d3e96cc0c5ff79157d5/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F12fa7407c2154c478bac232277682adb%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/12fa7407c2154c478bac232277682adb/images/large/4.jpg not downloaded yet
2026-03-26 22:53:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/224d188996624d3e96cc0c5ff79157d5/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/224d188996624d3e96cc0c5ff79157d5/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/224d188996624d3e96cc0c5ff79157d5/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F12fa7407c2154c478bac232277682adb%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/12fa7407c2154c478bac232277682adb/images/large/5.jpg not downloaded yet
2026-03-26 22:53:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/224d188996624d3e96cc0c5ff79157d5/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F12fa7407c2154c478bac232277682adb%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/12fa7407c2154c478bac232277682adb/images/large/6.jpg not downloaded yet
2026-03-26 22:53:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/224d188996624d3e96cc0c5ff79157d5/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F12fa7407c2154c478bac232277682adb%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/12fa7407c2154c478bac232277682adb/images/large/7.jpg not downloaded yet
2026-03-26 22:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F12fa7407c2154c478bac232277682adb%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/12fa7407c2154c478bac232277682adb/images/large/8.jpg not downloaded yet
2026-03-26 22:53:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/224d188996624d3e96cc0c5ff79157d5/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/224d188996624d3e96cc0c5ff79157d5/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F12fa7407c2154c478bac232277682adb%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/12fa7407c2154c478bac232277682adb/images/large/9.jpg not downloaded yet
2026-03-26 22:53:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cc9110>
2026-03-26 22:53:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_896ab42b-530f-5fb1-81d6-cb9f62e346c9/896ab42b-530f-5fb1-81d6-cb9f62e346c9_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F224d188996624d3e96cc0c5ff79157d5%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/224d188996624d3e96cc0c5ff79157d5/images/large/2.jpg saved to cache
2026-03-26 22:53:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 896ab42b-530f-5fb1-81d6-cb9f62e346c9
2026-03-26 22:53:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7407790>
2026-03-26 22:53:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_896ab42b-530f-5fb1-81d6-cb9f62e346c9/896ab42b-530f-5fb1-81d6-cb9f62e346c9_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F224d188996624d3e96cc0c5ff79157d5%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/224d188996624d3e96cc0c5ff79157d5/images/large/3.jpg saved to cache
2026-03-26 22:53:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 896ab42b-530f-5fb1-81d6-cb9f62e346c9
2026-03-26 22:53:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7a542d0>
2026-03-26 22:53:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_896ab42b-530f-5fb1-81d6-cb9f62e346c9/896ab42b-530f-5fb1-81d6-cb9f62e346c9_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F224d188996624d3e96cc0c5ff79157d5%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/224d188996624d3e96cc0c5ff79157d5/images/large/5.jpg saved to cache
2026-03-26 22:53:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 896ab42b-530f-5fb1-81d6-cb9f62e346c9
2026-03-26 22:53:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74bc890>
2026-03-26 22:53:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_896ab42b-530f-5fb1-81d6-cb9f62e346c9/896ab42b-530f-5fb1-81d6-cb9f62e346c9_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F224d188996624d3e96cc0c5ff79157d5%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/224d188996624d3e96cc0c5ff79157d5/images/large/7.jpg saved to cache
2026-03-26 22:53:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 896ab42b-530f-5fb1-81d6-cb9f62e346c9
2026-03-26 22:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F12fa7407c2154c478bac232277682adb%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/12fa7407c2154c478bac232277682adb/images/large/10.jpg not downloaded yet
2026-03-26 22:53:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74e4550>
2026-03-26 22:53:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_896ab42b-530f-5fb1-81d6-cb9f62e346c9/896ab42b-530f-5fb1-81d6-cb9f62e346c9_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F224d188996624d3e96cc0c5ff79157d5%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/224d188996624d3e96cc0c5ff79157d5/images/large/4.jpg saved to cache
2026-03-26 22:53:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 896ab42b-530f-5fb1-81d6-cb9f62e346c9
2026-03-26 22:53:08 [ayvens.be] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 400
2026-03-26 22:53:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79df190>
2026-03-26 22:53:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_896ab42b-530f-5fb1-81d6-cb9f62e346c9/896ab42b-530f-5fb1-81d6-cb9f62e346c9_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F224d188996624d3e96cc0c5ff79157d5%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/224d188996624d3e96cc0c5ff79157d5/images/large/6.jpg saved to cache
2026-03-26 22:53:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 896ab42b-530f-5fb1-81d6-cb9f62e346c9
2026-03-26 22:53:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6d83490>
2026-03-26 22:53:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_896ab42b-530f-5fb1-81d6-cb9f62e346c9/896ab42b-530f-5fb1-81d6-cb9f62e346c9_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F224d188996624d3e96cc0c5ff79157d5%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/224d188996624d3e96cc0c5ff79157d5/images/large/8.jpg saved to cache
2026-03-26 22:53:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 896ab42b-530f-5fb1-81d6-cb9f62e346c9
2026-03-26 22:53:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76e28d0>
2026-03-26 22:53:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_896ab42b-530f-5fb1-81d6-cb9f62e346c9/896ab42b-530f-5fb1-81d6-cb9f62e346c9_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F224d188996624d3e96cc0c5ff79157d5%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/224d188996624d3e96cc0c5ff79157d5/images/large/9.jpg saved to cache
2026-03-26 22:53:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 896ab42b-530f-5fb1-81d6-cb9f62e346c9
2026-03-26 22:53:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/12fa7407c2154c478bac232277682adb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/12fa7407c2154c478bac232277682adb/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/12fa7407c2154c478bac232277682adb/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-26 22:53:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/12fa7407c2154c478bac232277682adb/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/12fa7407c2154c478bac232277682adb/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/12fa7407c2154c478bac232277682adb/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/224d188996624d3e96cc0c5ff79157d5/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/12fa7407c2154c478bac232277682adb/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/12fa7407c2154c478bac232277682adb/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/12fa7407c2154c478bac232277682adb/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c61c50>
2026-03-26 22:53:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b6076ab-d217-582e-9c06-1ea0acaa8d72/8b6076ab-d217-582e-9c06-1ea0acaa8d72_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F12fa7407c2154c478bac232277682adb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/12fa7407c2154c478bac232277682adb/images/large/1.jpg saved to cache
2026-03-26 22:53:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8b6076ab-d217-582e-9c06-1ea0acaa8d72
2026-03-26 22:53:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/12fa7407c2154c478bac232277682adb/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77acb50>
2026-03-26 22:53:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b6076ab-d217-582e-9c06-1ea0acaa8d72/8b6076ab-d217-582e-9c06-1ea0acaa8d72_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F12fa7407c2154c478bac232277682adb%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/12fa7407c2154c478bac232277682adb/images/large/3.jpg saved to cache
2026-03-26 22:53:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8b6076ab-d217-582e-9c06-1ea0acaa8d72
2026-03-26 22:53:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7402f90>
2026-03-26 22:53:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b6076ab-d217-582e-9c06-1ea0acaa8d72/8b6076ab-d217-582e-9c06-1ea0acaa8d72_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F12fa7407c2154c478bac232277682adb%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/12fa7407c2154c478bac232277682adb/images/large/2.jpg saved to cache
2026-03-26 22:53:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8b6076ab-d217-582e-9c06-1ea0acaa8d72
2026-03-26 22:53:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e28e10>
2026-03-26 22:53:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b6076ab-d217-582e-9c06-1ea0acaa8d72/8b6076ab-d217-582e-9c06-1ea0acaa8d72_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F12fa7407c2154c478bac232277682adb%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/12fa7407c2154c478bac232277682adb/images/large/4.jpg saved to cache
2026-03-26 22:53:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8b6076ab-d217-582e-9c06-1ea0acaa8d72
2026-03-26 22:53:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7439a10>
2026-03-26 22:53:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b6076ab-d217-582e-9c06-1ea0acaa8d72/8b6076ab-d217-582e-9c06-1ea0acaa8d72_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F12fa7407c2154c478bac232277682adb%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/12fa7407c2154c478bac232277682adb/images/large/5.jpg saved to cache
2026-03-26 22:53:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8b6076ab-d217-582e-9c06-1ea0acaa8d72
2026-03-26 22:53:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e29050>
2026-03-26 22:53:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b6076ab-d217-582e-9c06-1ea0acaa8d72/8b6076ab-d217-582e-9c06-1ea0acaa8d72_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F12fa7407c2154c478bac232277682adb%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/12fa7407c2154c478bac232277682adb/images/large/6.jpg saved to cache
2026-03-26 22:53:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8b6076ab-d217-582e-9c06-1ea0acaa8d72
2026-03-26 22:53:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cbe050>
2026-03-26 22:53:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_896ab42b-530f-5fb1-81d6-cb9f62e346c9/896ab42b-530f-5fb1-81d6-cb9f62e346c9_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F224d188996624d3e96cc0c5ff79157d5%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/224d188996624d3e96cc0c5ff79157d5/images/large/10.jpg saved to cache
2026-03-26 22:53:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 896ab42b-530f-5fb1-81d6-cb9f62e346c9
2026-03-26 22:53:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 896ab42b-530f-5fb1-81d6-cb9f62e346c9, skipping ID generation
2026-03-26 22:53:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 896ab42b-530f-5fb1-81d6-cb9f62e346c9 with scrape type 1
2026-03-26 22:53:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 896ab42b-530f-5fb1-81d6-cb9f62e346c9 sending to next pipeline
2026-03-26 22:53:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 896ab42b-530f-5fb1-81d6-cb9f62e346c9, identifier: 1985493
2026-03-26 22:53:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7a60510>
2026-03-26 22:53:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b6076ab-d217-582e-9c06-1ea0acaa8d72/8b6076ab-d217-582e-9c06-1ea0acaa8d72_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F12fa7407c2154c478bac232277682adb%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/12fa7407c2154c478bac232277682adb/images/large/7.jpg saved to cache
2026-03-26 22:53:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8b6076ab-d217-582e-9c06-1ea0acaa8d72
2026-03-26 22:53:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 896ab42b-530f-5fb1-81d6-cb9f62e346c9 with identifier: 1985493
2026-03-26 22:53:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 896ab42b-530f-5fb1-81d6-cb9f62e346c9 with identifier: 1985493
2026-03-26 22:53:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 896ab42b-530f-5fb1-81d6-cb9f62e346c9 with identifier: 1985493 to the API
2026-03-26 22:53:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:53:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:53:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bp/224d188996624d3e96cc0c5ff79157d5/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'electric',
 'id': '896ab42b-530f-5fb1-81d6-cb9f62e346c9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q4 E-TRON',
 'odometer': 82972,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_896ab42b-530f-5fb1-81d6-cb9f62e346c9/896ab42b-530f-5fb1-81d6-cb9f62e346c9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 688631,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/224d188996624d3e96cc0c5ff79157d5/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_896ab42b-530f-5fb1-81d6-cb9f62e346c9/896ab42b-530f-5fb1-81d6-cb9f62e346c9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 714274,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/224d188996624d3e96cc0c5ff79157d5/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_896ab42b-530f-5fb1-81d6-cb9f62e346c9/896ab42b-530f-5fb1-81d6-cb9f62e346c9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 713472,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/224d188996624d3e96cc0c5ff79157d5/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_896ab42b-530f-5fb1-81d6-cb9f62e346c9/896ab42b-530f-5fb1-81d6-cb9f62e346c9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 737673,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/224d188996624d3e96cc0c5ff79157d5/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_896ab42b-530f-5fb1-81d6-cb9f62e346c9/896ab42b-530f-5fb1-81d6-cb9f62e346c9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 682577,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/224d188996624d3e96cc0c5ff79157d5/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_896ab42b-530f-5fb1-81d6-cb9f62e346c9/896ab42b-530f-5fb1-81d6-cb9f62e346c9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 807113,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/224d188996624d3e96cc0c5ff79157d5/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_896ab42b-530f-5fb1-81d6-cb9f62e346c9/896ab42b-530f-5fb1-81d6-cb9f62e346c9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 592099,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/224d188996624d3e96cc0c5ff79157d5/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_896ab42b-530f-5fb1-81d6-cb9f62e346c9/896ab42b-530f-5fb1-81d6-cb9f62e346c9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 922956,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/224d188996624d3e96cc0c5ff79157d5/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_896ab42b-530f-5fb1-81d6-cb9f62e346c9/896ab42b-530f-5fb1-81d6-cb9f62e346c9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 882109,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/224d188996624d3e96cc0c5ff79157d5/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_896ab42b-530f-5fb1-81d6-cb9f62e346c9/896ab42b-530f-5fb1-81d6-cb9f62e346c9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 895902,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/224d188996624d3e96cc0c5ff79157d5/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q4 E-TRON BEV 82KWH 40 ADVANCED AUTO',
 'transmission': 'automatic',
 'trim': 'BEV 82KWH 40 ADVANCED AUTO',
 'vin': None,
 'year': 2022}
2026-03-26 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985493%27 HTTP/1.1" 200 None
2026-03-26 22:53:09 [ayvens.be] INFO: Saving data for 1985493: {'created_time': 1774565589.513627, 'last_price_update_time': 1774565589.513636, 'auction_closing_time': 1774958400.0}
2026-03-26 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985493') HTTP/1.1" 204 0
2026-03-26 22:53:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b729ca90>
2026-03-26 22:53:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b6076ab-d217-582e-9c06-1ea0acaa8d72/8b6076ab-d217-582e-9c06-1ea0acaa8d72_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F12fa7407c2154c478bac232277682adb%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/12fa7407c2154c478bac232277682adb/images/large/8.jpg saved to cache
2026-03-26 22:53:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8b6076ab-d217-582e-9c06-1ea0acaa8d72
2026-03-26 22:53:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79fb7d0>
2026-03-26 22:53:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b6076ab-d217-582e-9c06-1ea0acaa8d72/8b6076ab-d217-582e-9c06-1ea0acaa8d72_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F12fa7407c2154c478bac232277682adb%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/12fa7407c2154c478bac232277682adb/images/large/9.jpg saved to cache
2026-03-26 22:53:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8b6076ab-d217-582e-9c06-1ea0acaa8d72
2026-03-26 22:53:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b727a0d0>
2026-03-26 22:53:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b6076ab-d217-582e-9c06-1ea0acaa8d72/8b6076ab-d217-582e-9c06-1ea0acaa8d72_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F12fa7407c2154c478bac232277682adb%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/12fa7407c2154c478bac232277682adb/images/large/10.jpg saved to cache
2026-03-26 22:53:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8b6076ab-d217-582e-9c06-1ea0acaa8d72
2026-03-26 22:53:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8b6076ab-d217-582e-9c06-1ea0acaa8d72, skipping ID generation
2026-03-26 22:53:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b6076ab-d217-582e-9c06-1ea0acaa8d72 with scrape type 1
2026-03-26 22:53:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8b6076ab-d217-582e-9c06-1ea0acaa8d72 sending to next pipeline
2026-03-26 22:53:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 8b6076ab-d217-582e-9c06-1ea0acaa8d72, identifier: 1985494
2026-03-26 22:53:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 8b6076ab-d217-582e-9c06-1ea0acaa8d72 with identifier: 1985494
2026-03-26 22:53:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 8b6076ab-d217-582e-9c06-1ea0acaa8d72 with identifier: 1985494
2026-03-26 22:53:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 8b6076ab-d217-582e-9c06-1ea0acaa8d72 with identifier: 1985494 to the API
2026-03-26 22:53:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:53:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:53:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bs/12fa7407c2154c478bac232277682adb/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '8b6076ab-d217-582e-9c06-1ea0acaa8d72',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '1 SERIES HATCH',
 'odometer': 60729,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b6076ab-d217-582e-9c06-1ea0acaa8d72/8b6076ab-d217-582e-9c06-1ea0acaa8d72_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 538664,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/12fa7407c2154c478bac232277682adb/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b6076ab-d217-582e-9c06-1ea0acaa8d72/8b6076ab-d217-582e-9c06-1ea0acaa8d72_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 416941,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/12fa7407c2154c478bac232277682adb/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b6076ab-d217-582e-9c06-1ea0acaa8d72/8b6076ab-d217-582e-9c06-1ea0acaa8d72_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 526150,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/12fa7407c2154c478bac232277682adb/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b6076ab-d217-582e-9c06-1ea0acaa8d72/8b6076ab-d217-582e-9c06-1ea0acaa8d72_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 492214,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/12fa7407c2154c478bac232277682adb/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b6076ab-d217-582e-9c06-1ea0acaa8d72/8b6076ab-d217-582e-9c06-1ea0acaa8d72_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 392204,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/12fa7407c2154c478bac232277682adb/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b6076ab-d217-582e-9c06-1ea0acaa8d72/8b6076ab-d217-582e-9c06-1ea0acaa8d72_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 351758,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/12fa7407c2154c478bac232277682adb/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b6076ab-d217-582e-9c06-1ea0acaa8d72/8b6076ab-d217-582e-9c06-1ea0acaa8d72_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 461023,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/12fa7407c2154c478bac232277682adb/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b6076ab-d217-582e-9c06-1ea0acaa8d72/8b6076ab-d217-582e-9c06-1ea0acaa8d72_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 314747,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/12fa7407c2154c478bac232277682adb/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b6076ab-d217-582e-9c06-1ea0acaa8d72/8b6076ab-d217-582e-9c06-1ea0acaa8d72_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 318035,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/12fa7407c2154c478bac232277682adb/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b6076ab-d217-582e-9c06-1ea0acaa8d72/8b6076ab-d217-582e-9c06-1ea0acaa8d72_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 397225,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/12fa7407c2154c478bac232277682adb/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1 SERIES HATCH 1.5 116DA (85KW)',
 'transmission': 'automatic',
 'trim': '1.5 116DA (85KW)',
 'vin': None,
 'year': 2022}
2026-03-26 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985494%27 HTTP/1.1" 200 None
2026-03-26 22:53:10 [ayvens.be] INFO: Saving data for 1985494: {'created_time': 1774565590.201762, 'last_price_update_time': 1774565590.201772, 'auction_closing_time': 1774958400.0}
2026-03-26 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985494') HTTP/1.1" 204 0
2026-03-26 22:53:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-03-26 22:53:11 [ayvens.be] INFO: Found listing with ID: 1985495
2026-03-26 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985495%27 HTTP/1.1" 200 None
2026-03-26 22:53:11 [ayvens.be] INFO: Scrape type for 1985495: 1
2026-03-26 22:53:11 [ayvens.be] INFO: Extracting data for car ID: 1985495
2026-03-26 22:53:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5829e4bb-924d-5088-83d1-8a694cecf4a5 with identifier: 1985495
2026-03-26 22:53:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5829e4bb-924d-5088-83d1-8a694cecf4a5 with scrape type 1
2026-03-26 22:53:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5829e4bb-924d-5088-83d1-8a694cecf4a5
2026-03-26 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F82e36bd9389040e99b1887b77e7c0a22%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/82e36bd9389040e99b1887b77e7c0a22/images/large/1.jpg not downloaded yet
2026-03-26 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F82e36bd9389040e99b1887b77e7c0a22%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/82e36bd9389040e99b1887b77e7c0a22/images/large/2.jpg not downloaded yet
2026-03-26 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F82e36bd9389040e99b1887b77e7c0a22%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/82e36bd9389040e99b1887b77e7c0a22/images/large/3.jpg not downloaded yet
2026-03-26 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F82e36bd9389040e99b1887b77e7c0a22%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/82e36bd9389040e99b1887b77e7c0a22/images/large/4.jpg not downloaded yet
2026-03-26 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F82e36bd9389040e99b1887b77e7c0a22%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/82e36bd9389040e99b1887b77e7c0a22/images/large/5.jpg not downloaded yet
2026-03-26 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F82e36bd9389040e99b1887b77e7c0a22%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/82e36bd9389040e99b1887b77e7c0a22/images/large/6.jpg not downloaded yet
2026-03-26 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F82e36bd9389040e99b1887b77e7c0a22%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/82e36bd9389040e99b1887b77e7c0a22/images/large/7.jpg not downloaded yet
2026-03-26 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F82e36bd9389040e99b1887b77e7c0a22%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/82e36bd9389040e99b1887b77e7c0a22/images/large/8.jpg not downloaded yet
2026-03-26 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F82e36bd9389040e99b1887b77e7c0a22%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/82e36bd9389040e99b1887b77e7c0a22/images/large/9.jpg not downloaded yet
2026-03-26 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F82e36bd9389040e99b1887b77e7c0a22%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/82e36bd9389040e99b1887b77e7c0a22/images/large/10.jpg not downloaded yet
2026-03-26 22:53:11 [ayvens.be] INFO: Found listing with ID: 1985496
2026-03-26 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985496%27 HTTP/1.1" 200 None
2026-03-26 22:53:11 [ayvens.be] INFO: Scrape type for 1985496: 1
2026-03-26 22:53:11 [ayvens.be] INFO: Extracting data for car ID: 1985496
2026-03-26 22:53:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 659df532-3246-5145-9f5b-706fe40e5b8c with identifier: 1985496
2026-03-26 22:53:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 659df532-3246-5145-9f5b-706fe40e5b8c with scrape type 1
2026-03-26 22:53:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 659df532-3246-5145-9f5b-706fe40e5b8c
2026-03-26 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F9616bf82acb04754aaa37cbe51082aa6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/9616bf82acb04754aaa37cbe51082aa6/images/large/1.jpg not downloaded yet
2026-03-26 22:53:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/82e36bd9389040e99b1887b77e7c0a22/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/82e36bd9389040e99b1887b77e7c0a22/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F9616bf82acb04754aaa37cbe51082aa6%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/9616bf82acb04754aaa37cbe51082aa6/images/large/2.jpg not downloaded yet
2026-03-26 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F9616bf82acb04754aaa37cbe51082aa6%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/9616bf82acb04754aaa37cbe51082aa6/images/large/3.jpg not downloaded yet
2026-03-26 22:53:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/82e36bd9389040e99b1887b77e7c0a22/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/82e36bd9389040e99b1887b77e7c0a22/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7438250>
2026-03-26 22:53:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5829e4bb-924d-5088-83d1-8a694cecf4a5/5829e4bb-924d-5088-83d1-8a694cecf4a5_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F82e36bd9389040e99b1887b77e7c0a22%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/82e36bd9389040e99b1887b77e7c0a22/images/large/2.jpg saved to cache
2026-03-26 22:53:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5829e4bb-924d-5088-83d1-8a694cecf4a5
2026-03-26 22:53:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6ded810>
2026-03-26 22:53:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5829e4bb-924d-5088-83d1-8a694cecf4a5/5829e4bb-924d-5088-83d1-8a694cecf4a5_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F82e36bd9389040e99b1887b77e7c0a22%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/82e36bd9389040e99b1887b77e7c0a22/images/large/1.jpg saved to cache
2026-03-26 22:53:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5829e4bb-924d-5088-83d1-8a694cecf4a5
2026-03-26 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F9616bf82acb04754aaa37cbe51082aa6%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/9616bf82acb04754aaa37cbe51082aa6/images/large/4.jpg not downloaded yet
2026-03-26 22:53:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/82e36bd9389040e99b1887b77e7c0a22/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/82e36bd9389040e99b1887b77e7c0a22/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F9616bf82acb04754aaa37cbe51082aa6%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/9616bf82acb04754aaa37cbe51082aa6/images/large/5.jpg not downloaded yet
2026-03-26 22:53:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7497ed0>
2026-03-26 22:53:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5829e4bb-924d-5088-83d1-8a694cecf4a5/5829e4bb-924d-5088-83d1-8a694cecf4a5_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F82e36bd9389040e99b1887b77e7c0a22%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/82e36bd9389040e99b1887b77e7c0a22/images/large/3.jpg saved to cache
2026-03-26 22:53:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5829e4bb-924d-5088-83d1-8a694cecf4a5
2026-03-26 22:53:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74b72d0>
2026-03-26 22:53:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5829e4bb-924d-5088-83d1-8a694cecf4a5/5829e4bb-924d-5088-83d1-8a694cecf4a5_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F82e36bd9389040e99b1887b77e7c0a22%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/82e36bd9389040e99b1887b77e7c0a22/images/large/5.jpg saved to cache
2026-03-26 22:53:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5829e4bb-924d-5088-83d1-8a694cecf4a5
2026-03-26 22:53:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/82e36bd9389040e99b1887b77e7c0a22/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/82e36bd9389040e99b1887b77e7c0a22/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F9616bf82acb04754aaa37cbe51082aa6%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/9616bf82acb04754aaa37cbe51082aa6/images/large/6.jpg not downloaded yet
2026-03-26 22:53:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/82e36bd9389040e99b1887b77e7c0a22/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7572850>
2026-03-26 22:53:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5829e4bb-924d-5088-83d1-8a694cecf4a5/5829e4bb-924d-5088-83d1-8a694cecf4a5_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F82e36bd9389040e99b1887b77e7c0a22%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/82e36bd9389040e99b1887b77e7c0a22/images/large/6.jpg saved to cache
2026-03-26 22:53:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5829e4bb-924d-5088-83d1-8a694cecf4a5
2026-03-26 22:53:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7573890>
2026-03-26 22:53:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5829e4bb-924d-5088-83d1-8a694cecf4a5/5829e4bb-924d-5088-83d1-8a694cecf4a5_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F82e36bd9389040e99b1887b77e7c0a22%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/82e36bd9389040e99b1887b77e7c0a22/images/large/4.jpg saved to cache
2026-03-26 22:53:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5829e4bb-924d-5088-83d1-8a694cecf4a5
2026-03-26 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F9616bf82acb04754aaa37cbe51082aa6%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/9616bf82acb04754aaa37cbe51082aa6/images/large/7.jpg not downloaded yet
2026-03-26 22:53:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/82e36bd9389040e99b1887b77e7c0a22/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F9616bf82acb04754aaa37cbe51082aa6%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/9616bf82acb04754aaa37cbe51082aa6/images/large/8.jpg not downloaded yet
2026-03-26 22:53:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e37550>
2026-03-26 22:53:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5829e4bb-924d-5088-83d1-8a694cecf4a5/5829e4bb-924d-5088-83d1-8a694cecf4a5_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F82e36bd9389040e99b1887b77e7c0a22%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/82e36bd9389040e99b1887b77e7c0a22/images/large/8.jpg saved to cache
2026-03-26 22:53:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5829e4bb-924d-5088-83d1-8a694cecf4a5
2026-03-26 22:53:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7400110>
2026-03-26 22:53:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5829e4bb-924d-5088-83d1-8a694cecf4a5/5829e4bb-924d-5088-83d1-8a694cecf4a5_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F82e36bd9389040e99b1887b77e7c0a22%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/82e36bd9389040e99b1887b77e7c0a22/images/large/9.jpg saved to cache
2026-03-26 22:53:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5829e4bb-924d-5088-83d1-8a694cecf4a5
2026-03-26 22:53:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79cdb90>
2026-03-26 22:53:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5829e4bb-924d-5088-83d1-8a694cecf4a5/5829e4bb-924d-5088-83d1-8a694cecf4a5_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F82e36bd9389040e99b1887b77e7c0a22%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/82e36bd9389040e99b1887b77e7c0a22/images/large/7.jpg saved to cache
2026-03-26 22:53:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5829e4bb-924d-5088-83d1-8a694cecf4a5
2026-03-26 22:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F9616bf82acb04754aaa37cbe51082aa6%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/9616bf82acb04754aaa37cbe51082aa6/images/large/9.jpg not downloaded yet
2026-03-26 22:53:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7a63d10>
2026-03-26 22:53:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5829e4bb-924d-5088-83d1-8a694cecf4a5/5829e4bb-924d-5088-83d1-8a694cecf4a5_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F82e36bd9389040e99b1887b77e7c0a22%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/82e36bd9389040e99b1887b77e7c0a22/images/large/10.jpg saved to cache
2026-03-26 22:53:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5829e4bb-924d-5088-83d1-8a694cecf4a5
2026-03-26 22:53:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5829e4bb-924d-5088-83d1-8a694cecf4a5, skipping ID generation
2026-03-26 22:53:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5829e4bb-924d-5088-83d1-8a694cecf4a5 with scrape type 1
2026-03-26 22:53:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5829e4bb-924d-5088-83d1-8a694cecf4a5 sending to next pipeline
2026-03-26 22:53:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 5829e4bb-924d-5088-83d1-8a694cecf4a5, identifier: 1985495
2026-03-26 22:53:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/9616bf82acb04754aaa37cbe51082aa6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/9616bf82acb04754aaa37cbe51082aa6/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F9616bf82acb04754aaa37cbe51082aa6%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/9616bf82acb04754aaa37cbe51082aa6/images/large/10.jpg not downloaded yet
2026-03-26 22:53:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 5829e4bb-924d-5088-83d1-8a694cecf4a5 with identifier: 1985495
2026-03-26 22:53:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 5829e4bb-924d-5088-83d1-8a694cecf4a5 with identifier: 1985495
2026-03-26 22:53:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 5829e4bb-924d-5088-83d1-8a694cecf4a5 with identifier: 1985495 to the API
2026-03-26 22:53:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:53:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:53:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bj/82e36bd9389040e99b1887b77e7c0a22/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '5829e4bb-924d-5088-83d1-8a694cecf4a5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A-CLASS',
 'odometer': 83090,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5829e4bb-924d-5088-83d1-8a694cecf4a5/5829e4bb-924d-5088-83d1-8a694cecf4a5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 395674,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/82e36bd9389040e99b1887b77e7c0a22/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5829e4bb-924d-5088-83d1-8a694cecf4a5/5829e4bb-924d-5088-83d1-8a694cecf4a5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 458244,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/82e36bd9389040e99b1887b77e7c0a22/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5829e4bb-924d-5088-83d1-8a694cecf4a5/5829e4bb-924d-5088-83d1-8a694cecf4a5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 456805,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/82e36bd9389040e99b1887b77e7c0a22/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5829e4bb-924d-5088-83d1-8a694cecf4a5/5829e4bb-924d-5088-83d1-8a694cecf4a5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 496419,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/82e36bd9389040e99b1887b77e7c0a22/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5829e4bb-924d-5088-83d1-8a694cecf4a5/5829e4bb-924d-5088-83d1-8a694cecf4a5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 259950,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/82e36bd9389040e99b1887b77e7c0a22/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5829e4bb-924d-5088-83d1-8a694cecf4a5/5829e4bb-924d-5088-83d1-8a694cecf4a5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 308066,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/82e36bd9389040e99b1887b77e7c0a22/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5829e4bb-924d-5088-83d1-8a694cecf4a5/5829e4bb-924d-5088-83d1-8a694cecf4a5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 473996,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/82e36bd9389040e99b1887b77e7c0a22/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5829e4bb-924d-5088-83d1-8a694cecf4a5/5829e4bb-924d-5088-83d1-8a694cecf4a5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 414272,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/82e36bd9389040e99b1887b77e7c0a22/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5829e4bb-924d-5088-83d1-8a694cecf4a5/5829e4bb-924d-5088-83d1-8a694cecf4a5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 361347,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/82e36bd9389040e99b1887b77e7c0a22/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5829e4bb-924d-5088-83d1-8a694cecf4a5/5829e4bb-924d-5088-83d1-8a694cecf4a5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 381339,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/82e36bd9389040e99b1887b77e7c0a22/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ A-CLASS 1.3 A 250 E DCT BUSINESS SOLUTION',
 'transmission': 'automatic',
 'trim': '1.3 A 250 E DCT BUSINESS SOLUTION',
 'vin': None,
 'year': 2021}
2026-03-26 22:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985495%27 HTTP/1.1" 200 None
2026-03-26 22:53:13 [ayvens.be] INFO: Saving data for 1985495: {'created_time': 1774565593.980251, 'last_price_update_time': 1774565593.98026, 'auction_closing_time': 1774958400.0}
2026-03-26 22:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985495') HTTP/1.1" 204 0
2026-03-26 22:53:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/9616bf82acb04754aaa37cbe51082aa6/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/9616bf82acb04754aaa37cbe51082aa6/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/9616bf82acb04754aaa37cbe51082aa6/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:14 [ayvens.be] INFO: Found listing with ID: 1985497
2026-03-26 22:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985497%27 HTTP/1.1" 200 None
2026-03-26 22:53:14 [ayvens.be] INFO: Scrape type for 1985497: 1
2026-03-26 22:53:14 [ayvens.be] INFO: Extracting data for car ID: 1985497
2026-03-26 22:53:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b66468c6-078d-5c53-8af1-7343a1dee843 with identifier: 1985497
2026-03-26 22:53:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b66468c6-078d-5c53-8af1-7343a1dee843 with scrape type 1
2026-03-26 22:53:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b66468c6-078d-5c53-8af1-7343a1dee843
2026-03-26 22:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F8f84abb1f60b4d11bd5f47622fd4bd87%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/8f84abb1f60b4d11bd5f47622fd4bd87/images/large/1.jpg not downloaded yet
2026-03-26 22:53:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/9616bf82acb04754aaa37cbe51082aa6/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e1f010>
2026-03-26 22:53:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_659df532-3246-5145-9f5b-706fe40e5b8c/659df532-3246-5145-9f5b-706fe40e5b8c_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F9616bf82acb04754aaa37cbe51082aa6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/9616bf82acb04754aaa37cbe51082aa6/images/large/1.jpg saved to cache
2026-03-26 22:53:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 659df532-3246-5145-9f5b-706fe40e5b8c
2026-03-26 22:53:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7981610>
2026-03-26 22:53:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_659df532-3246-5145-9f5b-706fe40e5b8c/659df532-3246-5145-9f5b-706fe40e5b8c_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F9616bf82acb04754aaa37cbe51082aa6%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/9616bf82acb04754aaa37cbe51082aa6/images/large/2.jpg saved to cache
2026-03-26 22:53:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 659df532-3246-5145-9f5b-706fe40e5b8c
2026-03-26 22:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F8f84abb1f60b4d11bd5f47622fd4bd87%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/8f84abb1f60b4d11bd5f47622fd4bd87/images/large/2.jpg not downloaded yet
2026-03-26 22:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F8f84abb1f60b4d11bd5f47622fd4bd87%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/8f84abb1f60b4d11bd5f47622fd4bd87/images/large/3.jpg not downloaded yet
2026-03-26 22:53:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e3da50>
2026-03-26 22:53:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_659df532-3246-5145-9f5b-706fe40e5b8c/659df532-3246-5145-9f5b-706fe40e5b8c_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F9616bf82acb04754aaa37cbe51082aa6%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/9616bf82acb04754aaa37cbe51082aa6/images/large/5.jpg saved to cache
2026-03-26 22:53:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 659df532-3246-5145-9f5b-706fe40e5b8c
2026-03-26 22:53:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7572dd0>
2026-03-26 22:53:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_659df532-3246-5145-9f5b-706fe40e5b8c/659df532-3246-5145-9f5b-706fe40e5b8c_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F9616bf82acb04754aaa37cbe51082aa6%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/9616bf82acb04754aaa37cbe51082aa6/images/large/3.jpg saved to cache
2026-03-26 22:53:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 659df532-3246-5145-9f5b-706fe40e5b8c
2026-03-26 22:53:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6d817d0>
2026-03-26 22:53:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_659df532-3246-5145-9f5b-706fe40e5b8c/659df532-3246-5145-9f5b-706fe40e5b8c_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F9616bf82acb04754aaa37cbe51082aa6%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/9616bf82acb04754aaa37cbe51082aa6/images/large/6.jpg saved to cache
2026-03-26 22:53:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 659df532-3246-5145-9f5b-706fe40e5b8c
2026-03-26 22:53:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e2ae50>
2026-03-26 22:53:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_659df532-3246-5145-9f5b-706fe40e5b8c/659df532-3246-5145-9f5b-706fe40e5b8c_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F9616bf82acb04754aaa37cbe51082aa6%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/9616bf82acb04754aaa37cbe51082aa6/images/large/4.jpg saved to cache
2026-03-26 22:53:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 659df532-3246-5145-9f5b-706fe40e5b8c
2026-03-26 22:53:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/9616bf82acb04754aaa37cbe51082aa6/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F8f84abb1f60b4d11bd5f47622fd4bd87%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/8f84abb1f60b4d11bd5f47622fd4bd87/images/large/4.jpg not downloaded yet
2026-03-26 22:53:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/9616bf82acb04754aaa37cbe51082aa6/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/9616bf82acb04754aaa37cbe51082aa6/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F8f84abb1f60b4d11bd5f47622fd4bd87%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/8f84abb1f60b4d11bd5f47622fd4bd87/images/large/5.jpg not downloaded yet
2026-03-26 22:53:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/9616bf82acb04754aaa37cbe51082aa6/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F8f84abb1f60b4d11bd5f47622fd4bd87%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/8f84abb1f60b4d11bd5f47622fd4bd87/images/large/6.jpg not downloaded yet
2026-03-26 22:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F8f84abb1f60b4d11bd5f47622fd4bd87%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/8f84abb1f60b4d11bd5f47622fd4bd87/images/large/7.jpg not downloaded yet
2026-03-26 22:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F8f84abb1f60b4d11bd5f47622fd4bd87%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/8f84abb1f60b4d11bd5f47622fd4bd87/images/large/8.jpg not downloaded yet
2026-03-26 22:53:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/8f84abb1f60b4d11bd5f47622fd4bd87/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F8f84abb1f60b4d11bd5f47622fd4bd87%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/8f84abb1f60b4d11bd5f47622fd4bd87/images/large/9.jpg not downloaded yet
2026-03-26 22:53:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74538d0>
2026-03-26 22:53:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_659df532-3246-5145-9f5b-706fe40e5b8c/659df532-3246-5145-9f5b-706fe40e5b8c_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F9616bf82acb04754aaa37cbe51082aa6%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/9616bf82acb04754aaa37cbe51082aa6/images/large/9.jpg saved to cache
2026-03-26 22:53:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 659df532-3246-5145-9f5b-706fe40e5b8c
2026-03-26 22:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F8f84abb1f60b4d11bd5f47622fd4bd87%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/8f84abb1f60b4d11bd5f47622fd4bd87/images/large/10.jpg not downloaded yet
2026-03-26 22:53:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79cd390>
2026-03-26 22:53:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_659df532-3246-5145-9f5b-706fe40e5b8c/659df532-3246-5145-9f5b-706fe40e5b8c_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F9616bf82acb04754aaa37cbe51082aa6%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/9616bf82acb04754aaa37cbe51082aa6/images/large/7.jpg saved to cache
2026-03-26 22:53:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 659df532-3246-5145-9f5b-706fe40e5b8c
2026-03-26 22:53:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74b4b50>
2026-03-26 22:53:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_659df532-3246-5145-9f5b-706fe40e5b8c/659df532-3246-5145-9f5b-706fe40e5b8c_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F9616bf82acb04754aaa37cbe51082aa6%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/9616bf82acb04754aaa37cbe51082aa6/images/large/8.jpg saved to cache
2026-03-26 22:53:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 659df532-3246-5145-9f5b-706fe40e5b8c
2026-03-26 22:53:15 [ayvens.be] INFO: Found listing with ID: 1985498
2026-03-26 22:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985498%27 HTTP/1.1" 200 None
2026-03-26 22:53:15 [ayvens.be] INFO: Scrape type for 1985498: 1
2026-03-26 22:53:15 [ayvens.be] INFO: Extracting data for car ID: 1985498
2026-03-26 22:53:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e7551471-f08e-501d-a622-73728074b450 with identifier: 1985498
2026-03-26 22:53:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7551471-f08e-501d-a622-73728074b450 with scrape type 1
2026-03-26 22:53:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e7551471-f08e-501d-a622-73728074b450
2026-03-26 22:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F740a84a0699945c0ac612d91b12dab8e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/740a84a0699945c0ac612d91b12dab8e/images/large/1.jpg not downloaded yet
2026-03-26 22:53:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/8f84abb1f60b4d11bd5f47622fd4bd87/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F740a84a0699945c0ac612d91b12dab8e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/740a84a0699945c0ac612d91b12dab8e/images/large/2.jpg not downloaded yet
2026-03-26 22:53:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e3f510>
2026-03-26 22:53:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_659df532-3246-5145-9f5b-706fe40e5b8c/659df532-3246-5145-9f5b-706fe40e5b8c_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F9616bf82acb04754aaa37cbe51082aa6%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/9616bf82acb04754aaa37cbe51082aa6/images/large/10.jpg saved to cache
2026-03-26 22:53:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 659df532-3246-5145-9f5b-706fe40e5b8c
2026-03-26 22:53:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 659df532-3246-5145-9f5b-706fe40e5b8c, skipping ID generation
2026-03-26 22:53:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 659df532-3246-5145-9f5b-706fe40e5b8c with scrape type 1
2026-03-26 22:53:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 659df532-3246-5145-9f5b-706fe40e5b8c sending to next pipeline
2026-03-26 22:53:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 659df532-3246-5145-9f5b-706fe40e5b8c, identifier: 1985496
2026-03-26 22:53:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b72907d0>
2026-03-26 22:53:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b66468c6-078d-5c53-8af1-7343a1dee843/b66468c6-078d-5c53-8af1-7343a1dee843_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F8f84abb1f60b4d11bd5f47622fd4bd87%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/8f84abb1f60b4d11bd5f47622fd4bd87/images/large/1.jpg saved to cache
2026-03-26 22:53:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b66468c6-078d-5c53-8af1-7343a1dee843
2026-03-26 22:53:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 659df532-3246-5145-9f5b-706fe40e5b8c with identifier: 1985496
2026-03-26 22:53:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 659df532-3246-5145-9f5b-706fe40e5b8c with identifier: 1985496
2026-03-26 22:53:15 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 659df532-3246-5145-9f5b-706fe40e5b8c with identifier: 1985496 to the API
2026-03-26 22:53:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:53:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:53:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bq/9616bf82acb04754aaa37cbe51082aa6/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '659df532-3246-5145-9f5b-706fe40e5b8c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A3 SPORTBACK',
 'odometer': 117199,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_659df532-3246-5145-9f5b-706fe40e5b8c/659df532-3246-5145-9f5b-706fe40e5b8c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 557071,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/9616bf82acb04754aaa37cbe51082aa6/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_659df532-3246-5145-9f5b-706fe40e5b8c/659df532-3246-5145-9f5b-706fe40e5b8c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 577383,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/9616bf82acb04754aaa37cbe51082aa6/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_659df532-3246-5145-9f5b-706fe40e5b8c/659df532-3246-5145-9f5b-706fe40e5b8c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 504242,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/9616bf82acb04754aaa37cbe51082aa6/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_659df532-3246-5145-9f5b-706fe40e5b8c/659df532-3246-5145-9f5b-706fe40e5b8c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 573240,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/9616bf82acb04754aaa37cbe51082aa6/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_659df532-3246-5145-9f5b-706fe40e5b8c/659df532-3246-5145-9f5b-706fe40e5b8c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 254450,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/9616bf82acb04754aaa37cbe51082aa6/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_659df532-3246-5145-9f5b-706fe40e5b8c/659df532-3246-5145-9f5b-706fe40e5b8c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 281875,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/9616bf82acb04754aaa37cbe51082aa6/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_659df532-3246-5145-9f5b-706fe40e5b8c/659df532-3246-5145-9f5b-706fe40e5b8c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 540139,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/9616bf82acb04754aaa37cbe51082aa6/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_659df532-3246-5145-9f5b-706fe40e5b8c/659df532-3246-5145-9f5b-706fe40e5b8c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 348139,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/9616bf82acb04754aaa37cbe51082aa6/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_659df532-3246-5145-9f5b-706fe40e5b8c/659df532-3246-5145-9f5b-706fe40e5b8c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 297578,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/9616bf82acb04754aaa37cbe51082aa6/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_659df532-3246-5145-9f5b-706fe40e5b8c/659df532-3246-5145-9f5b-706fe40e5b8c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 255701,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/9616bf82acb04754aaa37cbe51082aa6/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A3 SPORTBACK 1.4 40 TFSI E S TRONIC S LINE SPORTBACK',
 'transmission': 'automatic',
 'trim': '1.4 40 TFSI E S TRONIC S LINE SPORTBACK',
 'vin': None,
 'year': 2022}
2026-03-26 22:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985496%27 HTTP/1.1" 200 None
2026-03-26 22:53:15 [ayvens.be] INFO: Saving data for 1985496: {'created_time': 1774565595.831996, 'last_price_update_time': 1774565595.832008, 'auction_closing_time': 1774958400.0}
2026-03-26 22:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985496') HTTP/1.1" 204 0
2026-03-26 22:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F740a84a0699945c0ac612d91b12dab8e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/740a84a0699945c0ac612d91b12dab8e/images/large/3.jpg not downloaded yet
2026-03-26 22:53:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/8f84abb1f60b4d11bd5f47622fd4bd87/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/8f84abb1f60b4d11bd5f47622fd4bd87/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F740a84a0699945c0ac612d91b12dab8e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/740a84a0699945c0ac612d91b12dab8e/images/large/4.jpg not downloaded yet
2026-03-26 22:53:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7304310>
2026-03-26 22:53:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b66468c6-078d-5c53-8af1-7343a1dee843/b66468c6-078d-5c53-8af1-7343a1dee843_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F8f84abb1f60b4d11bd5f47622fd4bd87%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/8f84abb1f60b4d11bd5f47622fd4bd87/images/large/2.jpg saved to cache
2026-03-26 22:53:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b66468c6-078d-5c53-8af1-7343a1dee843
2026-03-26 22:53:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/8f84abb1f60b4d11bd5f47622fd4bd87/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/8f84abb1f60b4d11bd5f47622fd4bd87/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/8f84abb1f60b4d11bd5f47622fd4bd87/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F740a84a0699945c0ac612d91b12dab8e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/740a84a0699945c0ac612d91b12dab8e/images/large/5.jpg not downloaded yet
2026-03-26 22:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F740a84a0699945c0ac612d91b12dab8e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/740a84a0699945c0ac612d91b12dab8e/images/large/6.jpg not downloaded yet
2026-03-26 22:53:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b792e710>
2026-03-26 22:53:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b66468c6-078d-5c53-8af1-7343a1dee843/b66468c6-078d-5c53-8af1-7343a1dee843_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F8f84abb1f60b4d11bd5f47622fd4bd87%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/8f84abb1f60b4d11bd5f47622fd4bd87/images/large/3.jpg saved to cache
2026-03-26 22:53:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b66468c6-078d-5c53-8af1-7343a1dee843
2026-03-26 22:53:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7402310>
2026-03-26 22:53:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b66468c6-078d-5c53-8af1-7343a1dee843/b66468c6-078d-5c53-8af1-7343a1dee843_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F8f84abb1f60b4d11bd5f47622fd4bd87%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/8f84abb1f60b4d11bd5f47622fd4bd87/images/large/4.jpg saved to cache
2026-03-26 22:53:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b66468c6-078d-5c53-8af1-7343a1dee843
2026-03-26 22:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F740a84a0699945c0ac612d91b12dab8e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/740a84a0699945c0ac612d91b12dab8e/images/large/7.jpg not downloaded yet
2026-03-26 22:53:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/8f84abb1f60b4d11bd5f47622fd4bd87/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b744a350>
2026-03-26 22:53:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b66468c6-078d-5c53-8af1-7343a1dee843/b66468c6-078d-5c53-8af1-7343a1dee843_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F8f84abb1f60b4d11bd5f47622fd4bd87%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/8f84abb1f60b4d11bd5f47622fd4bd87/images/large/5.jpg saved to cache
2026-03-26 22:53:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b66468c6-078d-5c53-8af1-7343a1dee843
2026-03-26 22:53:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e36b50>
2026-03-26 22:53:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b66468c6-078d-5c53-8af1-7343a1dee843/b66468c6-078d-5c53-8af1-7343a1dee843_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F8f84abb1f60b4d11bd5f47622fd4bd87%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/8f84abb1f60b4d11bd5f47622fd4bd87/images/large/6.jpg saved to cache
2026-03-26 22:53:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b66468c6-078d-5c53-8af1-7343a1dee843
2026-03-26 22:53:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b746c710>
2026-03-26 22:53:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b66468c6-078d-5c53-8af1-7343a1dee843/b66468c6-078d-5c53-8af1-7343a1dee843_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F8f84abb1f60b4d11bd5f47622fd4bd87%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/8f84abb1f60b4d11bd5f47622fd4bd87/images/large/7.jpg saved to cache
2026-03-26 22:53:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b66468c6-078d-5c53-8af1-7343a1dee843
2026-03-26 22:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F740a84a0699945c0ac612d91b12dab8e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/740a84a0699945c0ac612d91b12dab8e/images/large/8.jpg not downloaded yet
2026-03-26 22:53:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/8f84abb1f60b4d11bd5f47622fd4bd87/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F740a84a0699945c0ac612d91b12dab8e%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/740a84a0699945c0ac612d91b12dab8e/images/large/9.jpg not downloaded yet
2026-03-26 22:53:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6dedf50>
2026-03-26 22:53:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b66468c6-078d-5c53-8af1-7343a1dee843/b66468c6-078d-5c53-8af1-7343a1dee843_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F8f84abb1f60b4d11bd5f47622fd4bd87%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/8f84abb1f60b4d11bd5f47622fd4bd87/images/large/8.jpg saved to cache
2026-03-26 22:53:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b66468c6-078d-5c53-8af1-7343a1dee843
2026-03-26 22:53:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/8f84abb1f60b4d11bd5f47622fd4bd87/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/740a84a0699945c0ac612d91b12dab8e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F740a84a0699945c0ac612d91b12dab8e%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/740a84a0699945c0ac612d91b12dab8e/images/large/10.jpg not downloaded yet
2026-03-26 22:53:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/740a84a0699945c0ac612d91b12dab8e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:16 [ayvens.be] INFO: Found listing with ID: 1985499
2026-03-26 22:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985499%27 HTTP/1.1" 200 None
2026-03-26 22:53:16 [ayvens.be] INFO: Scrape type for 1985499: 1
2026-03-26 22:53:16 [ayvens.be] INFO: Extracting data for car ID: 1985499
2026-03-26 22:53:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db6a9576-4990-54e1-bf3d-0584456e377f with identifier: 1985499
2026-03-26 22:53:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db6a9576-4990-54e1-bf3d-0584456e377f with scrape type 1
2026-03-26 22:53:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item db6a9576-4990-54e1-bf3d-0584456e377f
2026-03-26 22:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F1ec80db0fac44691824307dfef62112b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/1ec80db0fac44691824307dfef62112b/images/large/1.jpg not downloaded yet
2026-03-26 22:53:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/740a84a0699945c0ac612d91b12dab8e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/740a84a0699945c0ac612d91b12dab8e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7a63050>
2026-03-26 22:53:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b66468c6-078d-5c53-8af1-7343a1dee843/b66468c6-078d-5c53-8af1-7343a1dee843_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F8f84abb1f60b4d11bd5f47622fd4bd87%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/8f84abb1f60b4d11bd5f47622fd4bd87/images/large/9.jpg saved to cache
2026-03-26 22:53:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b66468c6-078d-5c53-8af1-7343a1dee843
2026-03-26 22:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F1ec80db0fac44691824307dfef62112b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/1ec80db0fac44691824307dfef62112b/images/large/2.jpg not downloaded yet
2026-03-26 22:53:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/740a84a0699945c0ac612d91b12dab8e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F1ec80db0fac44691824307dfef62112b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/1ec80db0fac44691824307dfef62112b/images/large/3.jpg not downloaded yet
2026-03-26 22:53:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79cf0d0>
2026-03-26 22:53:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b66468c6-078d-5c53-8af1-7343a1dee843/b66468c6-078d-5c53-8af1-7343a1dee843_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F8f84abb1f60b4d11bd5f47622fd4bd87%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/8f84abb1f60b4d11bd5f47622fd4bd87/images/large/10.jpg saved to cache
2026-03-26 22:53:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b66468c6-078d-5c53-8af1-7343a1dee843
2026-03-26 22:53:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b66468c6-078d-5c53-8af1-7343a1dee843, skipping ID generation
2026-03-26 22:53:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b66468c6-078d-5c53-8af1-7343a1dee843 with scrape type 1
2026-03-26 22:53:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b66468c6-078d-5c53-8af1-7343a1dee843 sending to next pipeline
2026-03-26 22:53:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b66468c6-078d-5c53-8af1-7343a1dee843, identifier: 1985497
2026-03-26 22:53:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e1e210>
2026-03-26 22:53:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7551471-f08e-501d-a622-73728074b450/e7551471-f08e-501d-a622-73728074b450_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F740a84a0699945c0ac612d91b12dab8e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/740a84a0699945c0ac612d91b12dab8e/images/large/2.jpg saved to cache
2026-03-26 22:53:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e7551471-f08e-501d-a622-73728074b450
2026-03-26 22:53:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76c65d0>
2026-03-26 22:53:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7551471-f08e-501d-a622-73728074b450/e7551471-f08e-501d-a622-73728074b450_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F740a84a0699945c0ac612d91b12dab8e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/740a84a0699945c0ac612d91b12dab8e/images/large/1.jpg saved to cache
2026-03-26 22:53:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e7551471-f08e-501d-a622-73728074b450
2026-03-26 22:53:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7572010>
2026-03-26 22:53:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7551471-f08e-501d-a622-73728074b450/e7551471-f08e-501d-a622-73728074b450_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F740a84a0699945c0ac612d91b12dab8e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/740a84a0699945c0ac612d91b12dab8e/images/large/3.jpg saved to cache
2026-03-26 22:53:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e7551471-f08e-501d-a622-73728074b450
2026-03-26 22:53:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c94750>
2026-03-26 22:53:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7551471-f08e-501d-a622-73728074b450/e7551471-f08e-501d-a622-73728074b450_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F740a84a0699945c0ac612d91b12dab8e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/740a84a0699945c0ac612d91b12dab8e/images/large/5.jpg saved to cache
2026-03-26 22:53:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e7551471-f08e-501d-a622-73728074b450
2026-03-26 22:53:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b66468c6-078d-5c53-8af1-7343a1dee843 with identifier: 1985497
2026-03-26 22:53:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b66468c6-078d-5c53-8af1-7343a1dee843 with identifier: 1985497
2026-03-26 22:53:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b66468c6-078d-5c53-8af1-7343a1dee843 with identifier: 1985497 to the API
2026-03-26 22:53:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:53:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:53:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bq/8f84abb1f60b4d11bd5f47622fd4bd87/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'b66468c6-078d-5c53-8af1-7343a1dee843',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLA - Klasse',
 'odometer': 92662,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b66468c6-078d-5c53-8af1-7343a1dee843/b66468c6-078d-5c53-8af1-7343a1dee843_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 626832,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/8f84abb1f60b4d11bd5f47622fd4bd87/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b66468c6-078d-5c53-8af1-7343a1dee843/b66468c6-078d-5c53-8af1-7343a1dee843_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 643164,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/8f84abb1f60b4d11bd5f47622fd4bd87/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b66468c6-078d-5c53-8af1-7343a1dee843/b66468c6-078d-5c53-8af1-7343a1dee843_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 623347,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/8f84abb1f60b4d11bd5f47622fd4bd87/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b66468c6-078d-5c53-8af1-7343a1dee843/b66468c6-078d-5c53-8af1-7343a1dee843_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 648485,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/8f84abb1f60b4d11bd5f47622fd4bd87/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b66468c6-078d-5c53-8af1-7343a1dee843/b66468c6-078d-5c53-8af1-7343a1dee843_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 664131,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/8f84abb1f60b4d11bd5f47622fd4bd87/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b66468c6-078d-5c53-8af1-7343a1dee843/b66468c6-078d-5c53-8af1-7343a1dee843_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 716465,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/8f84abb1f60b4d11bd5f47622fd4bd87/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b66468c6-078d-5c53-8af1-7343a1dee843/b66468c6-078d-5c53-8af1-7343a1dee843_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 648932,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/8f84abb1f60b4d11bd5f47622fd4bd87/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b66468c6-078d-5c53-8af1-7343a1dee843/b66468c6-078d-5c53-8af1-7343a1dee843_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 809227,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/8f84abb1f60b4d11bd5f47622fd4bd87/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b66468c6-078d-5c53-8af1-7343a1dee843/b66468c6-078d-5c53-8af1-7343a1dee843_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 843842,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/8f84abb1f60b4d11bd5f47622fd4bd87/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b66468c6-078d-5c53-8af1-7343a1dee843/b66468c6-078d-5c53-8af1-7343a1dee843_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 832963,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/8f84abb1f60b4d11bd5f47622fd4bd87/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLA - Klasse 1.3 CLA 180 BUSINESS SOLUTION ESSENTIAL',
 'transmission': 'automatic',
 'trim': '1.3 CLA 180 BUSINESS SOLUTION ESSENTIAL',
 'vin': None,
 'year': 2022}
2026-03-26 22:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985497%27 HTTP/1.1" 200 None
2026-03-26 22:53:17 [ayvens.be] INFO: Saving data for 1985497: {'created_time': 1774565597.804246, 'last_price_update_time': 1774565597.804256, 'auction_closing_time': 1774958400.0}
2026-03-26 22:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985497') HTTP/1.1" 204 0
2026-03-26 22:53:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/740a84a0699945c0ac612d91b12dab8e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F1ec80db0fac44691824307dfef62112b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/1ec80db0fac44691824307dfef62112b/images/large/4.jpg not downloaded yet
2026-03-26 22:53:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cb2250>
2026-03-26 22:53:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7551471-f08e-501d-a622-73728074b450/e7551471-f08e-501d-a622-73728074b450_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F740a84a0699945c0ac612d91b12dab8e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/740a84a0699945c0ac612d91b12dab8e/images/large/4.jpg saved to cache
2026-03-26 22:53:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e7551471-f08e-501d-a622-73728074b450
2026-03-26 22:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F1ec80db0fac44691824307dfef62112b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/1ec80db0fac44691824307dfef62112b/images/large/5.jpg not downloaded yet
2026-03-26 22:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F1ec80db0fac44691824307dfef62112b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/1ec80db0fac44691824307dfef62112b/images/large/6.jpg not downloaded yet
2026-03-26 22:53:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/740a84a0699945c0ac612d91b12dab8e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/740a84a0699945c0ac612d91b12dab8e/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F1ec80db0fac44691824307dfef62112b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/1ec80db0fac44691824307dfef62112b/images/large/7.jpg not downloaded yet
2026-03-26 22:53:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74e54d0>
2026-03-26 22:53:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7551471-f08e-501d-a622-73728074b450/e7551471-f08e-501d-a622-73728074b450_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F740a84a0699945c0ac612d91b12dab8e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/740a84a0699945c0ac612d91b12dab8e/images/large/6.jpg saved to cache
2026-03-26 22:53:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e7551471-f08e-501d-a622-73728074b450
2026-03-26 22:53:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/740a84a0699945c0ac612d91b12dab8e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/740a84a0699945c0ac612d91b12dab8e/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F1ec80db0fac44691824307dfef62112b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/1ec80db0fac44691824307dfef62112b/images/large/8.jpg not downloaded yet
2026-03-26 22:53:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/1ec80db0fac44691824307dfef62112b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F1ec80db0fac44691824307dfef62112b%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/1ec80db0fac44691824307dfef62112b/images/large/9.jpg not downloaded yet
2026-03-26 22:53:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74be210>
2026-03-26 22:53:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7551471-f08e-501d-a622-73728074b450/e7551471-f08e-501d-a622-73728074b450_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F740a84a0699945c0ac612d91b12dab8e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/740a84a0699945c0ac612d91b12dab8e/images/large/7.jpg saved to cache
2026-03-26 22:53:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e7551471-f08e-501d-a622-73728074b450
2026-03-26 22:53:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b727a190>
2026-03-26 22:53:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7551471-f08e-501d-a622-73728074b450/e7551471-f08e-501d-a622-73728074b450_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F740a84a0699945c0ac612d91b12dab8e%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/740a84a0699945c0ac612d91b12dab8e/images/large/9.jpg saved to cache
2026-03-26 22:53:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e7551471-f08e-501d-a622-73728074b450
2026-03-26 22:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F1ec80db0fac44691824307dfef62112b%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/1ec80db0fac44691824307dfef62112b/images/large/10.jpg not downloaded yet
2026-03-26 22:53:18 [ayvens.be] INFO: Found listing with ID: 1985500
2026-03-26 22:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985500%27 HTTP/1.1" 200 None
2026-03-26 22:53:18 [ayvens.be] INFO: Scrape type for 1985500: 1
2026-03-26 22:53:18 [ayvens.be] INFO: Extracting data for car ID: 1985500
2026-03-26 22:53:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82b27291-52b1-5bb8-8777-db035e76e519 with identifier: 1985500
2026-03-26 22:53:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82b27291-52b1-5bb8-8777-db035e76e519 with scrape type 1
2026-03-26 22:53:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 82b27291-52b1-5bb8-8777-db035e76e519
2026-03-26 22:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252Fcbcaa88e9c834cafad8031ccff12d317%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/cbcaa88e9c834cafad8031ccff12d317/images/large/1.jpg not downloaded yet
2026-03-26 22:53:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/1ec80db0fac44691824307dfef62112b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252Fcbcaa88e9c834cafad8031ccff12d317%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/cbcaa88e9c834cafad8031ccff12d317/images/large/2.jpg not downloaded yet
2026-03-26 22:53:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77caa10>
2026-03-26 22:53:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7551471-f08e-501d-a622-73728074b450/e7551471-f08e-501d-a622-73728074b450_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F740a84a0699945c0ac612d91b12dab8e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/740a84a0699945c0ac612d91b12dab8e/images/large/8.jpg saved to cache
2026-03-26 22:53:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e7551471-f08e-501d-a622-73728074b450
2026-03-26 22:53:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd0c5d10>
2026-03-26 22:53:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7551471-f08e-501d-a622-73728074b450/e7551471-f08e-501d-a622-73728074b450_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F740a84a0699945c0ac612d91b12dab8e%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/740a84a0699945c0ac612d91b12dab8e/images/large/10.jpg saved to cache
2026-03-26 22:53:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e7551471-f08e-501d-a622-73728074b450
2026-03-26 22:53:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e7551471-f08e-501d-a622-73728074b450, skipping ID generation
2026-03-26 22:53:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7551471-f08e-501d-a622-73728074b450 with scrape type 1
2026-03-26 22:53:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e7551471-f08e-501d-a622-73728074b450 sending to next pipeline
2026-03-26 22:53:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e7551471-f08e-501d-a622-73728074b450, identifier: 1985498
2026-03-26 22:53:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b72fd690>
2026-03-26 22:53:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db6a9576-4990-54e1-bf3d-0584456e377f/db6a9576-4990-54e1-bf3d-0584456e377f_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F1ec80db0fac44691824307dfef62112b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/1ec80db0fac44691824307dfef62112b/images/large/1.jpg saved to cache
2026-03-26 22:53:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item db6a9576-4990-54e1-bf3d-0584456e377f
2026-03-26 22:53:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e7551471-f08e-501d-a622-73728074b450 with identifier: 1985498
2026-03-26 22:53:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e7551471-f08e-501d-a622-73728074b450 with identifier: 1985498
2026-03-26 22:53:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e7551471-f08e-501d-a622-73728074b450 with identifier: 1985498 to the API
2026-03-26 22:53:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:53:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:53:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bq/740a84a0699945c0ac612d91b12dab8e/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'e7551471-f08e-501d-a622-73728074b450',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '3 SERIES TOURING',
 'odometer': 157440,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7551471-f08e-501d-a622-73728074b450/e7551471-f08e-501d-a622-73728074b450_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 610634,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/740a84a0699945c0ac612d91b12dab8e/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7551471-f08e-501d-a622-73728074b450/e7551471-f08e-501d-a622-73728074b450_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 574328,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/740a84a0699945c0ac612d91b12dab8e/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7551471-f08e-501d-a622-73728074b450/e7551471-f08e-501d-a622-73728074b450_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 630608,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/740a84a0699945c0ac612d91b12dab8e/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7551471-f08e-501d-a622-73728074b450/e7551471-f08e-501d-a622-73728074b450_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 729657,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/740a84a0699945c0ac612d91b12dab8e/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7551471-f08e-501d-a622-73728074b450/e7551471-f08e-501d-a622-73728074b450_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 436003,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/740a84a0699945c0ac612d91b12dab8e/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7551471-f08e-501d-a622-73728074b450/e7551471-f08e-501d-a622-73728074b450_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 568060,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/740a84a0699945c0ac612d91b12dab8e/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7551471-f08e-501d-a622-73728074b450/e7551471-f08e-501d-a622-73728074b450_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 621352,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/740a84a0699945c0ac612d91b12dab8e/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7551471-f08e-501d-a622-73728074b450/e7551471-f08e-501d-a622-73728074b450_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 698489,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/740a84a0699945c0ac612d91b12dab8e/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7551471-f08e-501d-a622-73728074b450/e7551471-f08e-501d-a622-73728074b450_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 565968,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/740a84a0699945c0ac612d91b12dab8e/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7551471-f08e-501d-a622-73728074b450/e7551471-f08e-501d-a622-73728074b450_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 562525,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/740a84a0699945c0ac612d91b12dab8e/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3 SERIES TOURING 2.0 320E TOURING',
 'transmission': 'automatic',
 'trim': '2.0 320E TOURING',
 'vin': None,
 'year': 2022}
2026-03-26 22:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985498%27 HTTP/1.1" 200 None
2026-03-26 22:53:19 [ayvens.be] INFO: Saving data for 1985498: {'created_time': 1774565599.134627, 'last_price_update_time': 1774565599.134637, 'auction_closing_time': 1774958400.0}
2026-03-26 22:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985498') HTTP/1.1" 204 0
2026-03-26 22:53:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/1ec80db0fac44691824307dfef62112b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252Fcbcaa88e9c834cafad8031ccff12d317%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/cbcaa88e9c834cafad8031ccff12d317/images/large/3.jpg not downloaded yet
2026-03-26 22:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252Fcbcaa88e9c834cafad8031ccff12d317%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/cbcaa88e9c834cafad8031ccff12d317/images/large/4.jpg not downloaded yet
2026-03-26 22:53:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/1ec80db0fac44691824307dfef62112b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76a5190>
2026-03-26 22:53:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db6a9576-4990-54e1-bf3d-0584456e377f/db6a9576-4990-54e1-bf3d-0584456e377f_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F1ec80db0fac44691824307dfef62112b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/1ec80db0fac44691824307dfef62112b/images/large/2.jpg saved to cache
2026-03-26 22:53:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item db6a9576-4990-54e1-bf3d-0584456e377f
2026-03-26 22:53:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/1ec80db0fac44691824307dfef62112b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/1ec80db0fac44691824307dfef62112b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252Fcbcaa88e9c834cafad8031ccff12d317%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/cbcaa88e9c834cafad8031ccff12d317/images/large/5.jpg not downloaded yet
2026-03-26 22:53:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/1ec80db0fac44691824307dfef62112b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252Fcbcaa88e9c834cafad8031ccff12d317%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/cbcaa88e9c834cafad8031ccff12d317/images/large/6.jpg not downloaded yet
2026-03-26 22:53:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74afb90>
2026-03-26 22:53:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db6a9576-4990-54e1-bf3d-0584456e377f/db6a9576-4990-54e1-bf3d-0584456e377f_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F1ec80db0fac44691824307dfef62112b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/1ec80db0fac44691824307dfef62112b/images/large/3.jpg saved to cache
2026-03-26 22:53:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item db6a9576-4990-54e1-bf3d-0584456e377f
2026-03-26 22:53:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74bd850>
2026-03-26 22:53:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db6a9576-4990-54e1-bf3d-0584456e377f/db6a9576-4990-54e1-bf3d-0584456e377f_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F1ec80db0fac44691824307dfef62112b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/1ec80db0fac44691824307dfef62112b/images/large/6.jpg saved to cache
2026-03-26 22:53:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item db6a9576-4990-54e1-bf3d-0584456e377f
2026-03-26 22:53:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/1ec80db0fac44691824307dfef62112b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252Fcbcaa88e9c834cafad8031ccff12d317%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/cbcaa88e9c834cafad8031ccff12d317/images/large/7.jpg not downloaded yet
2026-03-26 22:53:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/1ec80db0fac44691824307dfef62112b/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252Fcbcaa88e9c834cafad8031ccff12d317%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/cbcaa88e9c834cafad8031ccff12d317/images/large/8.jpg not downloaded yet
2026-03-26 22:53:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b741ee10>
2026-03-26 22:53:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db6a9576-4990-54e1-bf3d-0584456e377f/db6a9576-4990-54e1-bf3d-0584456e377f_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F1ec80db0fac44691824307dfef62112b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/1ec80db0fac44691824307dfef62112b/images/large/4.jpg saved to cache
2026-03-26 22:53:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item db6a9576-4990-54e1-bf3d-0584456e377f
2026-03-26 22:53:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e29d90>
2026-03-26 22:53:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db6a9576-4990-54e1-bf3d-0584456e377f/db6a9576-4990-54e1-bf3d-0584456e377f_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F1ec80db0fac44691824307dfef62112b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/1ec80db0fac44691824307dfef62112b/images/large/7.jpg saved to cache
2026-03-26 22:53:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item db6a9576-4990-54e1-bf3d-0584456e377f
2026-03-26 22:53:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cb3710>
2026-03-26 22:53:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db6a9576-4990-54e1-bf3d-0584456e377f/db6a9576-4990-54e1-bf3d-0584456e377f_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F1ec80db0fac44691824307dfef62112b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/1ec80db0fac44691824307dfef62112b/images/large/5.jpg saved to cache
2026-03-26 22:53:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item db6a9576-4990-54e1-bf3d-0584456e377f
2026-03-26 22:53:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/1ec80db0fac44691824307dfef62112b/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252Fcbcaa88e9c834cafad8031ccff12d317%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/cbcaa88e9c834cafad8031ccff12d317/images/large/9.jpg not downloaded yet
2026-03-26 22:53:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b746c890>
2026-03-26 22:53:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db6a9576-4990-54e1-bf3d-0584456e377f/db6a9576-4990-54e1-bf3d-0584456e377f_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F1ec80db0fac44691824307dfef62112b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/1ec80db0fac44691824307dfef62112b/images/large/8.jpg saved to cache
2026-03-26 22:53:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item db6a9576-4990-54e1-bf3d-0584456e377f
2026-03-26 22:53:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77bde90>
2026-03-26 22:53:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db6a9576-4990-54e1-bf3d-0584456e377f/db6a9576-4990-54e1-bf3d-0584456e377f_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F1ec80db0fac44691824307dfef62112b%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/1ec80db0fac44691824307dfef62112b/images/large/9.jpg saved to cache
2026-03-26 22:53:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item db6a9576-4990-54e1-bf3d-0584456e377f
2026-03-26 22:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252Fcbcaa88e9c834cafad8031ccff12d317%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/cbcaa88e9c834cafad8031ccff12d317/images/large/10.jpg not downloaded yet
2026-03-26 22:53:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/cbcaa88e9c834cafad8031ccff12d317/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:20 [ayvens.be] INFO: Found listing with ID: 1985501
2026-03-26 22:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985501%27 HTTP/1.1" 200 None
2026-03-26 22:53:20 [ayvens.be] INFO: Scrape type for 1985501: 1
2026-03-26 22:53:20 [ayvens.be] INFO: Extracting data for car ID: 1985501
2026-03-26 22:53:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 798339c6-1db7-59a9-a77e-53ec4e304705 with identifier: 1985501
2026-03-26 22:53:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 798339c6-1db7-59a9-a77e-53ec4e304705 with scrape type 1
2026-03-26 22:53:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 798339c6-1db7-59a9-a77e-53ec4e304705
2026-03-26 22:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F3f49c4971ac84bfabaa7bd49441d013e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/3f49c4971ac84bfabaa7bd49441d013e/images/large/1.jpg not downloaded yet
2026-03-26 22:53:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7773f50>
2026-03-26 22:53:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db6a9576-4990-54e1-bf3d-0584456e377f/db6a9576-4990-54e1-bf3d-0584456e377f_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F1ec80db0fac44691824307dfef62112b%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/1ec80db0fac44691824307dfef62112b/images/large/10.jpg saved to cache
2026-03-26 22:53:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item db6a9576-4990-54e1-bf3d-0584456e377f
2026-03-26 22:53:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: db6a9576-4990-54e1-bf3d-0584456e377f, skipping ID generation
2026-03-26 22:53:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db6a9576-4990-54e1-bf3d-0584456e377f with scrape type 1
2026-03-26 22:53:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item db6a9576-4990-54e1-bf3d-0584456e377f sending to next pipeline
2026-03-26 22:53:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: db6a9576-4990-54e1-bf3d-0584456e377f, identifier: 1985499
2026-03-26 22:53:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: db6a9576-4990-54e1-bf3d-0584456e377f with identifier: 1985499
2026-03-26 22:53:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: db6a9576-4990-54e1-bf3d-0584456e377f with identifier: 1985499
2026-03-26 22:53:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: db6a9576-4990-54e1-bf3d-0584456e377f with identifier: 1985499 to the API
2026-03-26 22:53:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:53:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:53:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bm/1ec80db0fac44691824307dfef62112b/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'db6a9576-4990-54e1-bf3d-0584456e377f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLASS A (W177)',
 'odometer': 147746,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db6a9576-4990-54e1-bf3d-0584456e377f/db6a9576-4990-54e1-bf3d-0584456e377f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 631652,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/1ec80db0fac44691824307dfef62112b/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db6a9576-4990-54e1-bf3d-0584456e377f/db6a9576-4990-54e1-bf3d-0584456e377f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 648067,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/1ec80db0fac44691824307dfef62112b/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db6a9576-4990-54e1-bf3d-0584456e377f/db6a9576-4990-54e1-bf3d-0584456e377f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 661616,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/1ec80db0fac44691824307dfef62112b/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db6a9576-4990-54e1-bf3d-0584456e377f/db6a9576-4990-54e1-bf3d-0584456e377f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 662254,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/1ec80db0fac44691824307dfef62112b/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db6a9576-4990-54e1-bf3d-0584456e377f/db6a9576-4990-54e1-bf3d-0584456e377f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 600912,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/1ec80db0fac44691824307dfef62112b/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db6a9576-4990-54e1-bf3d-0584456e377f/db6a9576-4990-54e1-bf3d-0584456e377f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 610288,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/1ec80db0fac44691824307dfef62112b/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db6a9576-4990-54e1-bf3d-0584456e377f/db6a9576-4990-54e1-bf3d-0584456e377f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 599062,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/1ec80db0fac44691824307dfef62112b/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db6a9576-4990-54e1-bf3d-0584456e377f/db6a9576-4990-54e1-bf3d-0584456e377f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 633797,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/1ec80db0fac44691824307dfef62112b/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db6a9576-4990-54e1-bf3d-0584456e377f/db6a9576-4990-54e1-bf3d-0584456e377f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 671931,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/1ec80db0fac44691824307dfef62112b/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db6a9576-4990-54e1-bf3d-0584456e377f/db6a9576-4990-54e1-bf3d-0584456e377f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 732307,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/1ec80db0fac44691824307dfef62112b/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLASS A (W177) A 250 e PHEV Business Solution',
 'transmission': 'automatic',
 'trim': 'A 250 e PHEV Business Solution',
 'vin': None,
 'year': 2022}
2026-03-26 22:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985499%27 HTTP/1.1" 200 None
2026-03-26 22:53:20 [ayvens.be] INFO: Saving data for 1985499: {'created_time': 1774565600.570744, 'last_price_update_time': 1774565600.570753, 'auction_closing_time': 1774958400.0}
2026-03-26 22:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985499') HTTP/1.1" 204 0
2026-03-26 22:53:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/cbcaa88e9c834cafad8031ccff12d317/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/cbcaa88e9c834cafad8031ccff12d317/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F3f49c4971ac84bfabaa7bd49441d013e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/3f49c4971ac84bfabaa7bd49441d013e/images/large/2.jpg not downloaded yet
2026-03-26 22:53:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/cbcaa88e9c834cafad8031ccff12d317/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F3f49c4971ac84bfabaa7bd49441d013e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/3f49c4971ac84bfabaa7bd49441d013e/images/large/3.jpg not downloaded yet
2026-03-26 22:53:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7402050>
2026-03-26 22:53:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82b27291-52b1-5bb8-8777-db035e76e519/82b27291-52b1-5bb8-8777-db035e76e519_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252Fcbcaa88e9c834cafad8031ccff12d317%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/cbcaa88e9c834cafad8031ccff12d317/images/large/1.jpg saved to cache
2026-03-26 22:53:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 82b27291-52b1-5bb8-8777-db035e76e519
2026-03-26 22:53:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/cbcaa88e9c834cafad8031ccff12d317/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F3f49c4971ac84bfabaa7bd49441d013e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/3f49c4971ac84bfabaa7bd49441d013e/images/large/4.jpg not downloaded yet
2026-03-26 22:53:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/cbcaa88e9c834cafad8031ccff12d317/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/cbcaa88e9c834cafad8031ccff12d317/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F3f49c4971ac84bfabaa7bd49441d013e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/3f49c4971ac84bfabaa7bd49441d013e/images/large/5.jpg not downloaded yet
2026-03-26 22:53:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b746f5d0>
2026-03-26 22:53:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82b27291-52b1-5bb8-8777-db035e76e519/82b27291-52b1-5bb8-8777-db035e76e519_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252Fcbcaa88e9c834cafad8031ccff12d317%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/cbcaa88e9c834cafad8031ccff12d317/images/large/2.jpg saved to cache
2026-03-26 22:53:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 82b27291-52b1-5bb8-8777-db035e76e519
2026-03-26 22:53:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c68c50>
2026-03-26 22:53:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82b27291-52b1-5bb8-8777-db035e76e519/82b27291-52b1-5bb8-8777-db035e76e519_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252Fcbcaa88e9c834cafad8031ccff12d317%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/cbcaa88e9c834cafad8031ccff12d317/images/large/3.jpg saved to cache
2026-03-26 22:53:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 82b27291-52b1-5bb8-8777-db035e76e519
2026-03-26 22:53:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6def510>
2026-03-26 22:53:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82b27291-52b1-5bb8-8777-db035e76e519/82b27291-52b1-5bb8-8777-db035e76e519_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252Fcbcaa88e9c834cafad8031ccff12d317%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/cbcaa88e9c834cafad8031ccff12d317/images/large/4.jpg saved to cache
2026-03-26 22:53:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 82b27291-52b1-5bb8-8777-db035e76e519
2026-03-26 22:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F3f49c4971ac84bfabaa7bd49441d013e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/3f49c4971ac84bfabaa7bd49441d013e/images/large/6.jpg not downloaded yet
2026-03-26 22:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F3f49c4971ac84bfabaa7bd49441d013e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/3f49c4971ac84bfabaa7bd49441d013e/images/large/7.jpg not downloaded yet
2026-03-26 22:53:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7aa0a90>
2026-03-26 22:53:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82b27291-52b1-5bb8-8777-db035e76e519/82b27291-52b1-5bb8-8777-db035e76e519_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252Fcbcaa88e9c834cafad8031ccff12d317%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/cbcaa88e9c834cafad8031ccff12d317/images/large/5.jpg saved to cache
2026-03-26 22:53:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 82b27291-52b1-5bb8-8777-db035e76e519
2026-03-26 22:53:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7490b10>
2026-03-26 22:53:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82b27291-52b1-5bb8-8777-db035e76e519/82b27291-52b1-5bb8-8777-db035e76e519_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252Fcbcaa88e9c834cafad8031ccff12d317%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/cbcaa88e9c834cafad8031ccff12d317/images/large/6.jpg saved to cache
2026-03-26 22:53:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 82b27291-52b1-5bb8-8777-db035e76e519
2026-03-26 22:53:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74ac290>
2026-03-26 22:53:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82b27291-52b1-5bb8-8777-db035e76e519/82b27291-52b1-5bb8-8777-db035e76e519_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252Fcbcaa88e9c834cafad8031ccff12d317%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/cbcaa88e9c834cafad8031ccff12d317/images/large/7.jpg saved to cache
2026-03-26 22:53:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 82b27291-52b1-5bb8-8777-db035e76e519
2026-03-26 22:53:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/cbcaa88e9c834cafad8031ccff12d317/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F3f49c4971ac84bfabaa7bd49441d013e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/3f49c4971ac84bfabaa7bd49441d013e/images/large/8.jpg not downloaded yet
2026-03-26 22:53:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/cbcaa88e9c834cafad8031ccff12d317/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F3f49c4971ac84bfabaa7bd49441d013e%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/3f49c4971ac84bfabaa7bd49441d013e/images/large/9.jpg not downloaded yet
2026-03-26 22:53:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/3f49c4971ac84bfabaa7bd49441d013e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F3f49c4971ac84bfabaa7bd49441d013e%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/3f49c4971ac84bfabaa7bd49441d013e/images/large/10.jpg not downloaded yet
2026-03-26 22:53:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/3f49c4971ac84bfabaa7bd49441d013e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/cbcaa88e9c834cafad8031ccff12d317/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/3f49c4971ac84bfabaa7bd49441d013e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:21 [ayvens.be] INFO: Found listing with ID: 1985502
2026-03-26 22:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985502%27 HTTP/1.1" 200 None
2026-03-26 22:53:21 [ayvens.be] INFO: Scrape type for 1985502: 1
2026-03-26 22:53:21 [ayvens.be] INFO: Extracting data for car ID: 1985502
2026-03-26 22:53:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8056c5c7-d393-5672-9245-8472e244201c with identifier: 1985502
2026-03-26 22:53:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8056c5c7-d393-5672-9245-8472e244201c with scrape type 1
2026-03-26 22:53:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8056c5c7-d393-5672-9245-8472e244201c
2026-03-26 22:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Ff650298e728141d28bfea8c656e55f61%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/f650298e728141d28bfea8c656e55f61/images/large/1.jpg not downloaded yet
2026-03-26 22:53:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/3f49c4971ac84bfabaa7bd49441d013e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Ff650298e728141d28bfea8c656e55f61%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/f650298e728141d28bfea8c656e55f61/images/large/2.jpg not downloaded yet
2026-03-26 22:53:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/3f49c4971ac84bfabaa7bd49441d013e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b792e210>
2026-03-26 22:53:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82b27291-52b1-5bb8-8777-db035e76e519/82b27291-52b1-5bb8-8777-db035e76e519_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252Fcbcaa88e9c834cafad8031ccff12d317%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/cbcaa88e9c834cafad8031ccff12d317/images/large/8.jpg saved to cache
2026-03-26 22:53:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 82b27291-52b1-5bb8-8777-db035e76e519
2026-03-26 22:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Ff650298e728141d28bfea8c656e55f61%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/f650298e728141d28bfea8c656e55f61/images/large/3.jpg not downloaded yet
2026-03-26 22:53:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7403b10>
2026-03-26 22:53:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82b27291-52b1-5bb8-8777-db035e76e519/82b27291-52b1-5bb8-8777-db035e76e519_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252Fcbcaa88e9c834cafad8031ccff12d317%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/cbcaa88e9c834cafad8031ccff12d317/images/large/9.jpg saved to cache
2026-03-26 22:53:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 82b27291-52b1-5bb8-8777-db035e76e519
2026-03-26 22:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Ff650298e728141d28bfea8c656e55f61%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/f650298e728141d28bfea8c656e55f61/images/large/4.jpg not downloaded yet
2026-03-26 22:53:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b727bad0>
2026-03-26 22:53:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_798339c6-1db7-59a9-a77e-53ec4e304705/798339c6-1db7-59a9-a77e-53ec4e304705_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F3f49c4971ac84bfabaa7bd49441d013e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/3f49c4971ac84bfabaa7bd49441d013e/images/large/1.jpg saved to cache
2026-03-26 22:53:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 798339c6-1db7-59a9-a77e-53ec4e304705
2026-03-26 22:53:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74e4450>
2026-03-26 22:53:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_798339c6-1db7-59a9-a77e-53ec4e304705/798339c6-1db7-59a9-a77e-53ec4e304705_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F3f49c4971ac84bfabaa7bd49441d013e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/3f49c4971ac84bfabaa7bd49441d013e/images/large/2.jpg saved to cache
2026-03-26 22:53:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 798339c6-1db7-59a9-a77e-53ec4e304705
2026-03-26 22:53:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cc2790>
2026-03-26 22:53:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82b27291-52b1-5bb8-8777-db035e76e519/82b27291-52b1-5bb8-8777-db035e76e519_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252Fcbcaa88e9c834cafad8031ccff12d317%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/cbcaa88e9c834cafad8031ccff12d317/images/large/10.jpg saved to cache
2026-03-26 22:53:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 82b27291-52b1-5bb8-8777-db035e76e519
2026-03-26 22:53:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 82b27291-52b1-5bb8-8777-db035e76e519, skipping ID generation
2026-03-26 22:53:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82b27291-52b1-5bb8-8777-db035e76e519 with scrape type 1
2026-03-26 22:53:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 82b27291-52b1-5bb8-8777-db035e76e519 sending to next pipeline
2026-03-26 22:53:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 82b27291-52b1-5bb8-8777-db035e76e519, identifier: 1985500
2026-03-26 22:53:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7490fd0>
2026-03-26 22:53:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_798339c6-1db7-59a9-a77e-53ec4e304705/798339c6-1db7-59a9-a77e-53ec4e304705_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F3f49c4971ac84bfabaa7bd49441d013e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/3f49c4971ac84bfabaa7bd49441d013e/images/large/3.jpg saved to cache
2026-03-26 22:53:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 798339c6-1db7-59a9-a77e-53ec4e304705
2026-03-26 22:53:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6ddb7d0>
2026-03-26 22:53:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_798339c6-1db7-59a9-a77e-53ec4e304705/798339c6-1db7-59a9-a77e-53ec4e304705_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F3f49c4971ac84bfabaa7bd49441d013e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/3f49c4971ac84bfabaa7bd49441d013e/images/large/5.jpg saved to cache
2026-03-26 22:53:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 798339c6-1db7-59a9-a77e-53ec4e304705
2026-03-26 22:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Ff650298e728141d28bfea8c656e55f61%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/f650298e728141d28bfea8c656e55f61/images/large/5.jpg not downloaded yet
2026-03-26 22:53:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 82b27291-52b1-5bb8-8777-db035e76e519 with identifier: 1985500
2026-03-26 22:53:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 82b27291-52b1-5bb8-8777-db035e76e519 with identifier: 1985500
2026-03-26 22:53:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 82b27291-52b1-5bb8-8777-db035e76e519 with identifier: 1985500 to the API
2026-03-26 22:53:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:53:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:53:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cp/cbcaa88e9c834cafad8031ccff12d317/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '82b27291-52b1-5bb8-8777-db035e76e519',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '5 SERIES TOURING',
 'odometer': 167994,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82b27291-52b1-5bb8-8777-db035e76e519/82b27291-52b1-5bb8-8777-db035e76e519_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 693439,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/cbcaa88e9c834cafad8031ccff12d317/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82b27291-52b1-5bb8-8777-db035e76e519/82b27291-52b1-5bb8-8777-db035e76e519_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 690352,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/cbcaa88e9c834cafad8031ccff12d317/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82b27291-52b1-5bb8-8777-db035e76e519/82b27291-52b1-5bb8-8777-db035e76e519_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 650806,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/cbcaa88e9c834cafad8031ccff12d317/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82b27291-52b1-5bb8-8777-db035e76e519/82b27291-52b1-5bb8-8777-db035e76e519_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 724698,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/cbcaa88e9c834cafad8031ccff12d317/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82b27291-52b1-5bb8-8777-db035e76e519/82b27291-52b1-5bb8-8777-db035e76e519_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 708552,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/cbcaa88e9c834cafad8031ccff12d317/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82b27291-52b1-5bb8-8777-db035e76e519/82b27291-52b1-5bb8-8777-db035e76e519_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 733209,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/cbcaa88e9c834cafad8031ccff12d317/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82b27291-52b1-5bb8-8777-db035e76e519/82b27291-52b1-5bb8-8777-db035e76e519_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 640691,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/cbcaa88e9c834cafad8031ccff12d317/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82b27291-52b1-5bb8-8777-db035e76e519/82b27291-52b1-5bb8-8777-db035e76e519_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 770697,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/cbcaa88e9c834cafad8031ccff12d317/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82b27291-52b1-5bb8-8777-db035e76e519/82b27291-52b1-5bb8-8777-db035e76e519_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 793156,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/cbcaa88e9c834cafad8031ccff12d317/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82b27291-52b1-5bb8-8777-db035e76e519/82b27291-52b1-5bb8-8777-db035e76e519_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 776695,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/cbcaa88e9c834cafad8031ccff12d317/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 5 SERIES TOURING 2.0 530E 200KW XDRIVE AUTO TOURING',
 'transmission': 'manual',
 'trim': '2.0 530E 200KW XDRIVE AUTO TOURING',
 'vin': None,
 'year': 2022}
2026-03-26 22:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985500%27 HTTP/1.1" 200 None
2026-03-26 22:53:22 [ayvens.be] INFO: Saving data for 1985500: {'created_time': 1774565602.808407, 'last_price_update_time': 1774565602.808418, 'auction_closing_time': 1774958400.0}
2026-03-26 22:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985500') HTTP/1.1" 204 0
2026-03-26 22:53:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cc0410>
2026-03-26 22:53:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_798339c6-1db7-59a9-a77e-53ec4e304705/798339c6-1db7-59a9-a77e-53ec4e304705_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F3f49c4971ac84bfabaa7bd49441d013e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/3f49c4971ac84bfabaa7bd49441d013e/images/large/4.jpg saved to cache
2026-03-26 22:53:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 798339c6-1db7-59a9-a77e-53ec4e304705
2026-03-26 22:53:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/3f49c4971ac84bfabaa7bd49441d013e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Ff650298e728141d28bfea8c656e55f61%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/f650298e728141d28bfea8c656e55f61/images/large/6.jpg not downloaded yet
2026-03-26 22:53:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/3f49c4971ac84bfabaa7bd49441d013e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/3f49c4971ac84bfabaa7bd49441d013e/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/3f49c4971ac84bfabaa7bd49441d013e/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Ff650298e728141d28bfea8c656e55f61%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/f650298e728141d28bfea8c656e55f61/images/large/7.jpg not downloaded yet
2026-03-26 22:53:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/3f49c4971ac84bfabaa7bd49441d013e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Ff650298e728141d28bfea8c656e55f61%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/f650298e728141d28bfea8c656e55f61/images/large/8.jpg not downloaded yet
2026-03-26 22:53:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/f650298e728141d28bfea8c656e55f61/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/f650298e728141d28bfea8c656e55f61/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Ff650298e728141d28bfea8c656e55f61%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/f650298e728141d28bfea8c656e55f61/images/large/9.jpg not downloaded yet
2026-03-26 22:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Ff650298e728141d28bfea8c656e55f61%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/f650298e728141d28bfea8c656e55f61/images/large/10.jpg not downloaded yet
2026-03-26 22:53:23 [ayvens.be] INFO: Found listing with ID: 1985503
2026-03-26 22:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985503%27 HTTP/1.1" 200 None
2026-03-26 22:53:23 [ayvens.be] INFO: Scrape type for 1985503: 1
2026-03-26 22:53:23 [ayvens.be] INFO: Extracting data for car ID: 1985503
2026-03-26 22:53:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc44d0a9-f1ab-5254-a16c-d37ec9f284b1 with identifier: 1985503
2026-03-26 22:53:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc44d0a9-f1ab-5254-a16c-d37ec9f284b1 with scrape type 1
2026-03-26 22:53:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bc44d0a9-f1ab-5254-a16c-d37ec9f284b1
2026-03-26 22:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252F2ccbe9d23ee74048beede05a59052c01%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/2ccbe9d23ee74048beede05a59052c01/images/large/1.jpg not downloaded yet
2026-03-26 22:53:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/f650298e728141d28bfea8c656e55f61/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7818350>
2026-03-26 22:53:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_798339c6-1db7-59a9-a77e-53ec4e304705/798339c6-1db7-59a9-a77e-53ec4e304705_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F3f49c4971ac84bfabaa7bd49441d013e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/3f49c4971ac84bfabaa7bd49441d013e/images/large/7.jpg saved to cache
2026-03-26 22:53:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 798339c6-1db7-59a9-a77e-53ec4e304705
2026-03-26 22:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252F2ccbe9d23ee74048beede05a59052c01%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/2ccbe9d23ee74048beede05a59052c01/images/large/2.jpg not downloaded yet
2026-03-26 22:53:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7291050>
2026-03-26 22:53:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_798339c6-1db7-59a9-a77e-53ec4e304705/798339c6-1db7-59a9-a77e-53ec4e304705_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F3f49c4971ac84bfabaa7bd49441d013e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/3f49c4971ac84bfabaa7bd49441d013e/images/large/6.jpg saved to cache
2026-03-26 22:53:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 798339c6-1db7-59a9-a77e-53ec4e304705
2026-03-26 22:53:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd3c6b90>
2026-03-26 22:53:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_798339c6-1db7-59a9-a77e-53ec4e304705/798339c6-1db7-59a9-a77e-53ec4e304705_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F3f49c4971ac84bfabaa7bd49441d013e%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/3f49c4971ac84bfabaa7bd49441d013e/images/large/9.jpg saved to cache
2026-03-26 22:53:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 798339c6-1db7-59a9-a77e-53ec4e304705
2026-03-26 22:53:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76cd910>
2026-03-26 22:53:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_798339c6-1db7-59a9-a77e-53ec4e304705/798339c6-1db7-59a9-a77e-53ec4e304705_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F3f49c4971ac84bfabaa7bd49441d013e%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/3f49c4971ac84bfabaa7bd49441d013e/images/large/10.jpg saved to cache
2026-03-26 22:53:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 798339c6-1db7-59a9-a77e-53ec4e304705
2026-03-26 22:53:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76edb90>
2026-03-26 22:53:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_798339c6-1db7-59a9-a77e-53ec4e304705/798339c6-1db7-59a9-a77e-53ec4e304705_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F3f49c4971ac84bfabaa7bd49441d013e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/3f49c4971ac84bfabaa7bd49441d013e/images/large/8.jpg saved to cache
2026-03-26 22:53:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 798339c6-1db7-59a9-a77e-53ec4e304705
2026-03-26 22:53:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 798339c6-1db7-59a9-a77e-53ec4e304705, skipping ID generation
2026-03-26 22:53:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 798339c6-1db7-59a9-a77e-53ec4e304705 with scrape type 1
2026-03-26 22:53:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 798339c6-1db7-59a9-a77e-53ec4e304705 sending to next pipeline
2026-03-26 22:53:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 798339c6-1db7-59a9-a77e-53ec4e304705, identifier: 1985501
2026-03-26 22:53:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/f650298e728141d28bfea8c656e55f61/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/f650298e728141d28bfea8c656e55f61/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252F2ccbe9d23ee74048beede05a59052c01%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/2ccbe9d23ee74048beede05a59052c01/images/large/3.jpg not downloaded yet
2026-03-26 22:53:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 798339c6-1db7-59a9-a77e-53ec4e304705 with identifier: 1985501
2026-03-26 22:53:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 798339c6-1db7-59a9-a77e-53ec4e304705 with identifier: 1985501
2026-03-26 22:53:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 798339c6-1db7-59a9-a77e-53ec4e304705 with identifier: 1985501 to the API
2026-03-26 22:53:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:53:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:53:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cr/3f49c4971ac84bfabaa7bd49441d013e/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '798339c6-1db7-59a9-a77e-53ec4e304705',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A3 SPORTBACK',
 'odometer': 100208,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_798339c6-1db7-59a9-a77e-53ec4e304705/798339c6-1db7-59a9-a77e-53ec4e304705_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 579329,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/3f49c4971ac84bfabaa7bd49441d013e/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_798339c6-1db7-59a9-a77e-53ec4e304705/798339c6-1db7-59a9-a77e-53ec4e304705_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 556541,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/3f49c4971ac84bfabaa7bd49441d013e/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_798339c6-1db7-59a9-a77e-53ec4e304705/798339c6-1db7-59a9-a77e-53ec4e304705_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 641230,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/3f49c4971ac84bfabaa7bd49441d013e/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_798339c6-1db7-59a9-a77e-53ec4e304705/798339c6-1db7-59a9-a77e-53ec4e304705_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 630805,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/3f49c4971ac84bfabaa7bd49441d013e/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_798339c6-1db7-59a9-a77e-53ec4e304705/798339c6-1db7-59a9-a77e-53ec4e304705_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 546250,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/3f49c4971ac84bfabaa7bd49441d013e/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_798339c6-1db7-59a9-a77e-53ec4e304705/798339c6-1db7-59a9-a77e-53ec4e304705_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 562750,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/3f49c4971ac84bfabaa7bd49441d013e/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_798339c6-1db7-59a9-a77e-53ec4e304705/798339c6-1db7-59a9-a77e-53ec4e304705_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 602453,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/3f49c4971ac84bfabaa7bd49441d013e/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_798339c6-1db7-59a9-a77e-53ec4e304705/798339c6-1db7-59a9-a77e-53ec4e304705_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 617190,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/3f49c4971ac84bfabaa7bd49441d013e/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_798339c6-1db7-59a9-a77e-53ec4e304705/798339c6-1db7-59a9-a77e-53ec4e304705_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 456729,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/3f49c4971ac84bfabaa7bd49441d013e/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_798339c6-1db7-59a9-a77e-53ec4e304705/798339c6-1db7-59a9-a77e-53ec4e304705_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 421183,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/3f49c4971ac84bfabaa7bd49441d013e/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A3 SPORTBACK 1.4 40 TFSI E S TRONIC SPORTB ATTRACTION',
 'transmission': 'automatic',
 'trim': '1.4 40 TFSI E S TRONIC SPORTB ATTRACTION',
 'vin': None,
 'year': 2022}
2026-03-26 22:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985501%27 HTTP/1.1" 200 None
2026-03-26 22:53:23 [ayvens.be] INFO: Saving data for 1985501: {'created_time': 1774565603.920755, 'last_price_update_time': 1774565603.920764, 'auction_closing_time': 1774958400.0}
2026-03-26 22:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985501') HTTP/1.1" 204 0
2026-03-26 22:53:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/f650298e728141d28bfea8c656e55f61/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b78c1750>
2026-03-26 22:53:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8056c5c7-d393-5672-9245-8472e244201c/8056c5c7-d393-5672-9245-8472e244201c_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Ff650298e728141d28bfea8c656e55f61%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/f650298e728141d28bfea8c656e55f61/images/large/2.jpg saved to cache
2026-03-26 22:53:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8056c5c7-d393-5672-9245-8472e244201c
2026-03-26 22:53:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e37990>
2026-03-26 22:53:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8056c5c7-d393-5672-9245-8472e244201c/8056c5c7-d393-5672-9245-8472e244201c_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Ff650298e728141d28bfea8c656e55f61%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/f650298e728141d28bfea8c656e55f61/images/large/1.jpg saved to cache
2026-03-26 22:53:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8056c5c7-d393-5672-9245-8472e244201c
2026-03-26 22:53:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77bee50>
2026-03-26 22:53:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8056c5c7-d393-5672-9245-8472e244201c/8056c5c7-d393-5672-9245-8472e244201c_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Ff650298e728141d28bfea8c656e55f61%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/f650298e728141d28bfea8c656e55f61/images/large/6.jpg saved to cache
2026-03-26 22:53:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8056c5c7-d393-5672-9245-8472e244201c
2026-03-26 22:53:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/f650298e728141d28bfea8c656e55f61/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252F2ccbe9d23ee74048beede05a59052c01%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/2ccbe9d23ee74048beede05a59052c01/images/large/4.jpg not downloaded yet
2026-03-26 22:53:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/f650298e728141d28bfea8c656e55f61/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/f650298e728141d28bfea8c656e55f61/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e2b150>
2026-03-26 22:53:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8056c5c7-d393-5672-9245-8472e244201c/8056c5c7-d393-5672-9245-8472e244201c_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Ff650298e728141d28bfea8c656e55f61%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/f650298e728141d28bfea8c656e55f61/images/large/5.jpg saved to cache
2026-03-26 22:53:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8056c5c7-d393-5672-9245-8472e244201c
2026-03-26 22:53:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b792fd10>
2026-03-26 22:53:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8056c5c7-d393-5672-9245-8472e244201c/8056c5c7-d393-5672-9245-8472e244201c_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Ff650298e728141d28bfea8c656e55f61%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/f650298e728141d28bfea8c656e55f61/images/large/4.jpg saved to cache
2026-03-26 22:53:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8056c5c7-d393-5672-9245-8472e244201c
2026-03-26 22:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252F2ccbe9d23ee74048beede05a59052c01%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/2ccbe9d23ee74048beede05a59052c01/images/large/5.jpg not downloaded yet
2026-03-26 22:53:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b36bd0>
2026-03-26 22:53:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8056c5c7-d393-5672-9245-8472e244201c/8056c5c7-d393-5672-9245-8472e244201c_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Ff650298e728141d28bfea8c656e55f61%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/f650298e728141d28bfea8c656e55f61/images/large/3.jpg saved to cache
2026-03-26 22:53:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8056c5c7-d393-5672-9245-8472e244201c
2026-03-26 22:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252F2ccbe9d23ee74048beede05a59052c01%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/2ccbe9d23ee74048beede05a59052c01/images/large/6.jpg not downloaded yet
2026-03-26 22:53:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7570250>
2026-03-26 22:53:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8056c5c7-d393-5672-9245-8472e244201c/8056c5c7-d393-5672-9245-8472e244201c_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Ff650298e728141d28bfea8c656e55f61%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/f650298e728141d28bfea8c656e55f61/images/large/7.jpg saved to cache
2026-03-26 22:53:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8056c5c7-d393-5672-9245-8472e244201c
2026-03-26 22:53:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7439c50>
2026-03-26 22:53:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8056c5c7-d393-5672-9245-8472e244201c/8056c5c7-d393-5672-9245-8472e244201c_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Ff650298e728141d28bfea8c656e55f61%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/f650298e728141d28bfea8c656e55f61/images/large/8.jpg saved to cache
2026-03-26 22:53:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8056c5c7-d393-5672-9245-8472e244201c
2026-03-26 22:53:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7586d10>
2026-03-26 22:53:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8056c5c7-d393-5672-9245-8472e244201c/8056c5c7-d393-5672-9245-8472e244201c_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Ff650298e728141d28bfea8c656e55f61%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/f650298e728141d28bfea8c656e55f61/images/large/9.jpg saved to cache
2026-03-26 22:53:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8056c5c7-d393-5672-9245-8472e244201c
2026-03-26 22:53:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/f650298e728141d28bfea8c656e55f61/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252F2ccbe9d23ee74048beede05a59052c01%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/2ccbe9d23ee74048beede05a59052c01/images/large/7.jpg not downloaded yet
2026-03-26 22:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252F2ccbe9d23ee74048beede05a59052c01%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/2ccbe9d23ee74048beede05a59052c01/images/large/8.jpg not downloaded yet
2026-03-26 22:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252F2ccbe9d23ee74048beede05a59052c01%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/2ccbe9d23ee74048beede05a59052c01/images/large/9.jpg not downloaded yet
2026-03-26 22:53:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ck/2ccbe9d23ee74048beede05a59052c01/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252F2ccbe9d23ee74048beede05a59052c01%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/2ccbe9d23ee74048beede05a59052c01/images/large/10.jpg not downloaded yet
2026-03-26 22:53:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ck/2ccbe9d23ee74048beede05a59052c01/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:24 [ayvens.be] INFO: Found listing with ID: 1985504
2026-03-26 22:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985504%27 HTTP/1.1" 200 None
2026-03-26 22:53:24 [ayvens.be] INFO: Scrape type for 1985504: 1
2026-03-26 22:53:24 [ayvens.be] INFO: Extracting data for car ID: 1985504
2026-03-26 22:53:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45f362f5-e8a6-53e4-8caa-f5b14f161748 with identifier: 1985504
2026-03-26 22:53:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45f362f5-e8a6-53e4-8caa-f5b14f161748 with scrape type 1
2026-03-26 22:53:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 45f362f5-e8a6-53e4-8caa-f5b14f161748
2026-03-26 22:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fa14f5d0a4ff144e8945ea4c025b5d8e2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/a14f5d0a4ff144e8945ea4c025b5d8e2/images/large/1.jpg not downloaded yet
2026-03-26 22:53:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ck/2ccbe9d23ee74048beede05a59052c01/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fa14f5d0a4ff144e8945ea4c025b5d8e2%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/a14f5d0a4ff144e8945ea4c025b5d8e2/images/large/2.jpg not downloaded yet
2026-03-26 22:53:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7449910>
2026-03-26 22:53:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8056c5c7-d393-5672-9245-8472e244201c/8056c5c7-d393-5672-9245-8472e244201c_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Ff650298e728141d28bfea8c656e55f61%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/f650298e728141d28bfea8c656e55f61/images/large/10.jpg saved to cache
2026-03-26 22:53:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8056c5c7-d393-5672-9245-8472e244201c
2026-03-26 22:53:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8056c5c7-d393-5672-9245-8472e244201c, skipping ID generation
2026-03-26 22:53:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8056c5c7-d393-5672-9245-8472e244201c with scrape type 1
2026-03-26 22:53:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8056c5c7-d393-5672-9245-8472e244201c sending to next pipeline
2026-03-26 22:53:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 8056c5c7-d393-5672-9245-8472e244201c, identifier: 1985502
2026-03-26 22:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fa14f5d0a4ff144e8945ea4c025b5d8e2%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/a14f5d0a4ff144e8945ea4c025b5d8e2/images/large/3.jpg not downloaded yet
2026-03-26 22:53:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 8056c5c7-d393-5672-9245-8472e244201c with identifier: 1985502
2026-03-26 22:53:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 8056c5c7-d393-5672-9245-8472e244201c with identifier: 1985502
2026-03-26 22:53:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 8056c5c7-d393-5672-9245-8472e244201c with identifier: 1985502 to the API
2026-03-26 22:53:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:53:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:53:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bl/f650298e728141d28bfea8c656e55f61/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '8056c5c7-d393-5672-9245-8472e244201c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '3 SERIES TOURING',
 'odometer': 123049,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8056c5c7-d393-5672-9245-8472e244201c/8056c5c7-d393-5672-9245-8472e244201c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 437592,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/f650298e728141d28bfea8c656e55f61/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8056c5c7-d393-5672-9245-8472e244201c/8056c5c7-d393-5672-9245-8472e244201c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 395608,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/f650298e728141d28bfea8c656e55f61/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8056c5c7-d393-5672-9245-8472e244201c/8056c5c7-d393-5672-9245-8472e244201c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 428512,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/f650298e728141d28bfea8c656e55f61/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8056c5c7-d393-5672-9245-8472e244201c/8056c5c7-d393-5672-9245-8472e244201c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 406685,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/f650298e728141d28bfea8c656e55f61/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8056c5c7-d393-5672-9245-8472e244201c/8056c5c7-d393-5672-9245-8472e244201c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 364989,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/f650298e728141d28bfea8c656e55f61/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8056c5c7-d393-5672-9245-8472e244201c/8056c5c7-d393-5672-9245-8472e244201c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 176226,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/f650298e728141d28bfea8c656e55f61/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8056c5c7-d393-5672-9245-8472e244201c/8056c5c7-d393-5672-9245-8472e244201c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 279943,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/f650298e728141d28bfea8c656e55f61/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8056c5c7-d393-5672-9245-8472e244201c/8056c5c7-d393-5672-9245-8472e244201c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 347350,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/f650298e728141d28bfea8c656e55f61/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8056c5c7-d393-5672-9245-8472e244201c/8056c5c7-d393-5672-9245-8472e244201c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 273867,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/f650298e728141d28bfea8c656e55f61/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8056c5c7-d393-5672-9245-8472e244201c/8056c5c7-d393-5672-9245-8472e244201c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 407961,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/f650298e728141d28bfea8c656e55f61/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3 SERIES TOURING 2.0 318IA (115KW) AUTO TOURING',
 'transmission': 'automatic',
 'trim': '2.0 318IA (115KW) AUTO TOURING',
 'vin': None,
 'year': 2022}
2026-03-26 22:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985502%27 HTTP/1.1" 200 None
2026-03-26 22:53:25 [ayvens.be] INFO: Saving data for 1985502: {'created_time': 1774565605.310044, 'last_price_update_time': 1774565605.310053, 'auction_closing_time': 1774958400.0}
2026-03-26 22:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985502') HTTP/1.1" 204 0
2026-03-26 22:53:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7a82c10>
2026-03-26 22:53:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc44d0a9-f1ab-5254-a16c-d37ec9f284b1/bc44d0a9-f1ab-5254-a16c-d37ec9f284b1_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252F2ccbe9d23ee74048beede05a59052c01%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/2ccbe9d23ee74048beede05a59052c01/images/large/1.jpg saved to cache
2026-03-26 22:53:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bc44d0a9-f1ab-5254-a16c-d37ec9f284b1
2026-03-26 22:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fa14f5d0a4ff144e8945ea4c025b5d8e2%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/a14f5d0a4ff144e8945ea4c025b5d8e2/images/large/4.jpg not downloaded yet
2026-03-26 22:53:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b782e390>
2026-03-26 22:53:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc44d0a9-f1ab-5254-a16c-d37ec9f284b1/bc44d0a9-f1ab-5254-a16c-d37ec9f284b1_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252F2ccbe9d23ee74048beede05a59052c01%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/2ccbe9d23ee74048beede05a59052c01/images/large/2.jpg saved to cache
2026-03-26 22:53:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bc44d0a9-f1ab-5254-a16c-d37ec9f284b1
2026-03-26 22:53:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7aa3e10>
2026-03-26 22:53:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc44d0a9-f1ab-5254-a16c-d37ec9f284b1/bc44d0a9-f1ab-5254-a16c-d37ec9f284b1_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252F2ccbe9d23ee74048beede05a59052c01%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/2ccbe9d23ee74048beede05a59052c01/images/large/3.jpg saved to cache
2026-03-26 22:53:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bc44d0a9-f1ab-5254-a16c-d37ec9f284b1
2026-03-26 22:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fa14f5d0a4ff144e8945ea4c025b5d8e2%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/a14f5d0a4ff144e8945ea4c025b5d8e2/images/large/5.jpg not downloaded yet
2026-03-26 22:53:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ck/2ccbe9d23ee74048beede05a59052c01/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fa14f5d0a4ff144e8945ea4c025b5d8e2%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/a14f5d0a4ff144e8945ea4c025b5d8e2/images/large/6.jpg not downloaded yet
2026-03-26 22:53:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ck/2ccbe9d23ee74048beede05a59052c01/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fa14f5d0a4ff144e8945ea4c025b5d8e2%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/a14f5d0a4ff144e8945ea4c025b5d8e2/images/large/7.jpg not downloaded yet
2026-03-26 22:53:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ck/2ccbe9d23ee74048beede05a59052c01/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/a14f5d0a4ff144e8945ea4c025b5d8e2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fa14f5d0a4ff144e8945ea4c025b5d8e2%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/a14f5d0a4ff144e8945ea4c025b5d8e2/images/large/8.jpg not downloaded yet
2026-03-26 22:53:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ck/2ccbe9d23ee74048beede05a59052c01/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ck/2ccbe9d23ee74048beede05a59052c01/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fa14f5d0a4ff144e8945ea4c025b5d8e2%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/a14f5d0a4ff144e8945ea4c025b5d8e2/images/large/9.jpg not downloaded yet
2026-03-26 22:53:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ck/2ccbe9d23ee74048beede05a59052c01/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fa14f5d0a4ff144e8945ea4c025b5d8e2%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/a14f5d0a4ff144e8945ea4c025b5d8e2/images/large/10.jpg not downloaded yet
2026-03-26 22:53:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ck/2ccbe9d23ee74048beede05a59052c01/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:25 [ayvens.be] INFO: Found listing with ID: 1985505
2026-03-26 22:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985505%27 HTTP/1.1" 200 None
2026-03-26 22:53:25 [ayvens.be] INFO: Scrape type for 1985505: 1
2026-03-26 22:53:25 [ayvens.be] INFO: Extracting data for car ID: 1985505
2026-03-26 22:53:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8418b0c-8e4b-50f5-ba81-68414125e1f9 with identifier: 1985505
2026-03-26 22:53:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8418b0c-8e4b-50f5-ba81-68414125e1f9 with scrape type 1
2026-03-26 22:53:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e8418b0c-8e4b-50f5-ba81-68414125e1f9
2026-03-26 22:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F68b47a8d69f14ae7898c72574afc6ff0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/68b47a8d69f14ae7898c72574afc6ff0/images/large/1.jpg not downloaded yet
2026-03-26 22:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F68b47a8d69f14ae7898c72574afc6ff0%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/68b47a8d69f14ae7898c72574afc6ff0/images/large/2.jpg not downloaded yet
2026-03-26 22:53:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e2ad10>
2026-03-26 22:53:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc44d0a9-f1ab-5254-a16c-d37ec9f284b1/bc44d0a9-f1ab-5254-a16c-d37ec9f284b1_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252F2ccbe9d23ee74048beede05a59052c01%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/2ccbe9d23ee74048beede05a59052c01/images/large/4.jpg saved to cache
2026-03-26 22:53:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bc44d0a9-f1ab-5254-a16c-d37ec9f284b1
2026-03-26 22:53:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7493f50>
2026-03-26 22:53:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc44d0a9-f1ab-5254-a16c-d37ec9f284b1/bc44d0a9-f1ab-5254-a16c-d37ec9f284b1_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252F2ccbe9d23ee74048beede05a59052c01%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/2ccbe9d23ee74048beede05a59052c01/images/large/5.jpg saved to cache
2026-03-26 22:53:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bc44d0a9-f1ab-5254-a16c-d37ec9f284b1
2026-03-26 22:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F68b47a8d69f14ae7898c72574afc6ff0%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/68b47a8d69f14ae7898c72574afc6ff0/images/large/3.jpg not downloaded yet
2026-03-26 22:53:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7ae8a50>
2026-03-26 22:53:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc44d0a9-f1ab-5254-a16c-d37ec9f284b1/bc44d0a9-f1ab-5254-a16c-d37ec9f284b1_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252F2ccbe9d23ee74048beede05a59052c01%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/2ccbe9d23ee74048beede05a59052c01/images/large/6.jpg saved to cache
2026-03-26 22:53:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bc44d0a9-f1ab-5254-a16c-d37ec9f284b1
2026-03-26 22:53:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b792ffd0>
2026-03-26 22:53:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45f362f5-e8a6-53e4-8caa-f5b14f161748/45f362f5-e8a6-53e4-8caa-f5b14f161748_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fa14f5d0a4ff144e8945ea4c025b5d8e2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/a14f5d0a4ff144e8945ea4c025b5d8e2/images/large/1.jpg saved to cache
2026-03-26 22:53:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 45f362f5-e8a6-53e4-8caa-f5b14f161748
2026-03-26 22:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F68b47a8d69f14ae7898c72574afc6ff0%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/68b47a8d69f14ae7898c72574afc6ff0/images/large/4.jpg not downloaded yet
2026-03-26 22:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F68b47a8d69f14ae7898c72574afc6ff0%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/68b47a8d69f14ae7898c72574afc6ff0/images/large/5.jpg not downloaded yet
2026-03-26 22:53:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b78c1a90>
2026-03-26 22:53:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc44d0a9-f1ab-5254-a16c-d37ec9f284b1/bc44d0a9-f1ab-5254-a16c-d37ec9f284b1_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252F2ccbe9d23ee74048beede05a59052c01%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/2ccbe9d23ee74048beede05a59052c01/images/large/7.jpg saved to cache
2026-03-26 22:53:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bc44d0a9-f1ab-5254-a16c-d37ec9f284b1
2026-03-26 22:53:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79f8f10>
2026-03-26 22:53:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc44d0a9-f1ab-5254-a16c-d37ec9f284b1/bc44d0a9-f1ab-5254-a16c-d37ec9f284b1_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252F2ccbe9d23ee74048beede05a59052c01%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/2ccbe9d23ee74048beede05a59052c01/images/large/9.jpg saved to cache
2026-03-26 22:53:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bc44d0a9-f1ab-5254-a16c-d37ec9f284b1
2026-03-26 22:53:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e1fc10>
2026-03-26 22:53:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc44d0a9-f1ab-5254-a16c-d37ec9f284b1/bc44d0a9-f1ab-5254-a16c-d37ec9f284b1_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252F2ccbe9d23ee74048beede05a59052c01%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/2ccbe9d23ee74048beede05a59052c01/images/large/10.jpg saved to cache
2026-03-26 22:53:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bc44d0a9-f1ab-5254-a16c-d37ec9f284b1
2026-03-26 22:53:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77ad010>
2026-03-26 22:53:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc44d0a9-f1ab-5254-a16c-d37ec9f284b1/bc44d0a9-f1ab-5254-a16c-d37ec9f284b1_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252F2ccbe9d23ee74048beede05a59052c01%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/2ccbe9d23ee74048beede05a59052c01/images/large/8.jpg saved to cache
2026-03-26 22:53:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bc44d0a9-f1ab-5254-a16c-d37ec9f284b1
2026-03-26 22:53:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bc44d0a9-f1ab-5254-a16c-d37ec9f284b1, skipping ID generation
2026-03-26 22:53:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc44d0a9-f1ab-5254-a16c-d37ec9f284b1 with scrape type 1
2026-03-26 22:53:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bc44d0a9-f1ab-5254-a16c-d37ec9f284b1 sending to next pipeline
2026-03-26 22:53:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: bc44d0a9-f1ab-5254-a16c-d37ec9f284b1, identifier: 1985503
2026-03-26 22:53:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/a14f5d0a4ff144e8945ea4c025b5d8e2/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: bc44d0a9-f1ab-5254-a16c-d37ec9f284b1 with identifier: 1985503
2026-03-26 22:53:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: bc44d0a9-f1ab-5254-a16c-d37ec9f284b1 with identifier: 1985503
2026-03-26 22:53:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: bc44d0a9-f1ab-5254-a16c-d37ec9f284b1 with identifier: 1985503 to the API
2026-03-26 22:53:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:53:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:53:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ck/2ccbe9d23ee74048beede05a59052c01/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'bc44d0a9-f1ab-5254-a16c-d37ec9f284b1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X2',
 'odometer': 61928,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc44d0a9-f1ab-5254-a16c-d37ec9f284b1/bc44d0a9-f1ab-5254-a16c-d37ec9f284b1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 712371,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ck/2ccbe9d23ee74048beede05a59052c01/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc44d0a9-f1ab-5254-a16c-d37ec9f284b1/bc44d0a9-f1ab-5254-a16c-d37ec9f284b1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 749582,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ck/2ccbe9d23ee74048beede05a59052c01/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc44d0a9-f1ab-5254-a16c-d37ec9f284b1/bc44d0a9-f1ab-5254-a16c-d37ec9f284b1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 701524,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ck/2ccbe9d23ee74048beede05a59052c01/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc44d0a9-f1ab-5254-a16c-d37ec9f284b1/bc44d0a9-f1ab-5254-a16c-d37ec9f284b1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 750111,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ck/2ccbe9d23ee74048beede05a59052c01/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc44d0a9-f1ab-5254-a16c-d37ec9f284b1/bc44d0a9-f1ab-5254-a16c-d37ec9f284b1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 745646,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ck/2ccbe9d23ee74048beede05a59052c01/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc44d0a9-f1ab-5254-a16c-d37ec9f284b1/bc44d0a9-f1ab-5254-a16c-d37ec9f284b1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 820843,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ck/2ccbe9d23ee74048beede05a59052c01/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc44d0a9-f1ab-5254-a16c-d37ec9f284b1/bc44d0a9-f1ab-5254-a16c-d37ec9f284b1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 674497,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ck/2ccbe9d23ee74048beede05a59052c01/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc44d0a9-f1ab-5254-a16c-d37ec9f284b1/bc44d0a9-f1ab-5254-a16c-d37ec9f284b1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 961723,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ck/2ccbe9d23ee74048beede05a59052c01/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc44d0a9-f1ab-5254-a16c-d37ec9f284b1/bc44d0a9-f1ab-5254-a16c-d37ec9f284b1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 917618,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ck/2ccbe9d23ee74048beede05a59052c01/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc44d0a9-f1ab-5254-a16c-d37ec9f284b1/bc44d0a9-f1ab-5254-a16c-d37ec9f284b1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 862145,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ck/2ccbe9d23ee74048beede05a59052c01/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X2 1.5 XDRIVE25E PHEV 162KW)',
 'transmission': 'automatic',
 'trim': '1.5 XDRIVE25E PHEV 162KW)',
 'vin': None,
 'year': 2022}
2026-03-26 22:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985503%27 HTTP/1.1" 200 None
2026-03-26 22:53:27 [ayvens.be] INFO: Saving data for 1985503: {'created_time': 1774565607.055112, 'last_price_update_time': 1774565607.055123, 'auction_closing_time': 1774958400.0}
2026-03-26 22:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985503') HTTP/1.1" 204 0
2026-03-26 22:53:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/a14f5d0a4ff144e8945ea4c025b5d8e2/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F68b47a8d69f14ae7898c72574afc6ff0%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/68b47a8d69f14ae7898c72574afc6ff0/images/large/6.jpg not downloaded yet
2026-03-26 22:53:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/a14f5d0a4ff144e8945ea4c025b5d8e2/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/a14f5d0a4ff144e8945ea4c025b5d8e2/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/a14f5d0a4ff144e8945ea4c025b5d8e2/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/a14f5d0a4ff144e8945ea4c025b5d8e2/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F68b47a8d69f14ae7898c72574afc6ff0%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/68b47a8d69f14ae7898c72574afc6ff0/images/large/7.jpg not downloaded yet
2026-03-26 22:53:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/a14f5d0a4ff144e8945ea4c025b5d8e2/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd3b9210>
2026-03-26 22:53:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45f362f5-e8a6-53e4-8caa-f5b14f161748/45f362f5-e8a6-53e4-8caa-f5b14f161748_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fa14f5d0a4ff144e8945ea4c025b5d8e2%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/a14f5d0a4ff144e8945ea4c025b5d8e2/images/large/5.jpg saved to cache
2026-03-26 22:53:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 45f362f5-e8a6-53e4-8caa-f5b14f161748
2026-03-26 22:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F68b47a8d69f14ae7898c72574afc6ff0%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/68b47a8d69f14ae7898c72574afc6ff0/images/large/8.jpg not downloaded yet
2026-03-26 22:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F68b47a8d69f14ae7898c72574afc6ff0%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/68b47a8d69f14ae7898c72574afc6ff0/images/large/9.jpg not downloaded yet
2026-03-26 22:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F68b47a8d69f14ae7898c72574afc6ff0%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/68b47a8d69f14ae7898c72574afc6ff0/images/large/10.jpg not downloaded yet
2026-03-26 22:53:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e3f390>
2026-03-26 22:53:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45f362f5-e8a6-53e4-8caa-f5b14f161748/45f362f5-e8a6-53e4-8caa-f5b14f161748_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fa14f5d0a4ff144e8945ea4c025b5d8e2%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/a14f5d0a4ff144e8945ea4c025b5d8e2/images/large/6.jpg saved to cache
2026-03-26 22:53:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 45f362f5-e8a6-53e4-8caa-f5b14f161748
2026-03-26 22:53:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b741ce50>
2026-03-26 22:53:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45f362f5-e8a6-53e4-8caa-f5b14f161748/45f362f5-e8a6-53e4-8caa-f5b14f161748_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fa14f5d0a4ff144e8945ea4c025b5d8e2%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/a14f5d0a4ff144e8945ea4c025b5d8e2/images/large/3.jpg saved to cache
2026-03-26 22:53:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 45f362f5-e8a6-53e4-8caa-f5b14f161748
2026-03-26 22:53:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74cd0d0>
2026-03-26 22:53:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45f362f5-e8a6-53e4-8caa-f5b14f161748/45f362f5-e8a6-53e4-8caa-f5b14f161748_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fa14f5d0a4ff144e8945ea4c025b5d8e2%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/a14f5d0a4ff144e8945ea4c025b5d8e2/images/large/7.jpg saved to cache
2026-03-26 22:53:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 45f362f5-e8a6-53e4-8caa-f5b14f161748
2026-03-26 22:53:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7404310>
2026-03-26 22:53:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45f362f5-e8a6-53e4-8caa-f5b14f161748/45f362f5-e8a6-53e4-8caa-f5b14f161748_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fa14f5d0a4ff144e8945ea4c025b5d8e2%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/a14f5d0a4ff144e8945ea4c025b5d8e2/images/large/2.jpg saved to cache
2026-03-26 22:53:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 45f362f5-e8a6-53e4-8caa-f5b14f161748
2026-03-26 22:53:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e374d0>
2026-03-26 22:53:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45f362f5-e8a6-53e4-8caa-f5b14f161748/45f362f5-e8a6-53e4-8caa-f5b14f161748_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fa14f5d0a4ff144e8945ea4c025b5d8e2%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/a14f5d0a4ff144e8945ea4c025b5d8e2/images/large/8.jpg saved to cache
2026-03-26 22:53:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 45f362f5-e8a6-53e4-8caa-f5b14f161748
2026-03-26 22:53:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/68b47a8d69f14ae7898c72574afc6ff0/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:27 [ayvens.be] INFO: Found listing with ID: 1985506
2026-03-26 22:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985506%27 HTTP/1.1" 200 None
2026-03-26 22:53:27 [ayvens.be] INFO: Scrape type for 1985506: 1
2026-03-26 22:53:27 [ayvens.be] INFO: Extracting data for car ID: 1985506
2026-03-26 22:53:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7daffc16-00ab-5d2a-b461-726a3cb29f81 with identifier: 1985506
2026-03-26 22:53:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7daffc16-00ab-5d2a-b461-726a3cb29f81 with scrape type 1
2026-03-26 22:53:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7daffc16-00ab-5d2a-b461-726a3cb29f81
2026-03-26 22:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F2790d81b3bea4a2f92cdd05ec8be71df%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/2790d81b3bea4a2f92cdd05ec8be71df/images/large/1.jpg not downloaded yet
2026-03-26 22:53:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/68b47a8d69f14ae7898c72574afc6ff0/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74b64d0>
2026-03-26 22:53:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45f362f5-e8a6-53e4-8caa-f5b14f161748/45f362f5-e8a6-53e4-8caa-f5b14f161748_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fa14f5d0a4ff144e8945ea4c025b5d8e2%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/a14f5d0a4ff144e8945ea4c025b5d8e2/images/large/4.jpg saved to cache
2026-03-26 22:53:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 45f362f5-e8a6-53e4-8caa-f5b14f161748
2026-03-26 22:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F2790d81b3bea4a2f92cdd05ec8be71df%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/2790d81b3bea4a2f92cdd05ec8be71df/images/large/2.jpg not downloaded yet
2026-03-26 22:53:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/68b47a8d69f14ae7898c72574afc6ff0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/68b47a8d69f14ae7898c72574afc6ff0/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/a14f5d0a4ff144e8945ea4c025b5d8e2/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/68b47a8d69f14ae7898c72574afc6ff0/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F2790d81b3bea4a2f92cdd05ec8be71df%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/2790d81b3bea4a2f92cdd05ec8be71df/images/large/3.jpg not downloaded yet
2026-03-26 22:53:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79d7b50>
2026-03-26 22:53:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8418b0c-8e4b-50f5-ba81-68414125e1f9/e8418b0c-8e4b-50f5-ba81-68414125e1f9_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F68b47a8d69f14ae7898c72574afc6ff0%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/68b47a8d69f14ae7898c72574afc6ff0/images/large/4.jpg saved to cache
2026-03-26 22:53:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e8418b0c-8e4b-50f5-ba81-68414125e1f9
2026-03-26 22:53:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/a14f5d0a4ff144e8945ea4c025b5d8e2/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/68b47a8d69f14ae7898c72574afc6ff0/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F2790d81b3bea4a2f92cdd05ec8be71df%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/2790d81b3bea4a2f92cdd05ec8be71df/images/large/4.jpg not downloaded yet
2026-03-26 22:53:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79d4dd0>
2026-03-26 22:53:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8418b0c-8e4b-50f5-ba81-68414125e1f9/e8418b0c-8e4b-50f5-ba81-68414125e1f9_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F68b47a8d69f14ae7898c72574afc6ff0%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/68b47a8d69f14ae7898c72574afc6ff0/images/large/3.jpg saved to cache
2026-03-26 22:53:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e8418b0c-8e4b-50f5-ba81-68414125e1f9
2026-03-26 22:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F2790d81b3bea4a2f92cdd05ec8be71df%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/2790d81b3bea4a2f92cdd05ec8be71df/images/large/5.jpg not downloaded yet
2026-03-26 22:53:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd4978d0>
2026-03-26 22:53:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8418b0c-8e4b-50f5-ba81-68414125e1f9/e8418b0c-8e4b-50f5-ba81-68414125e1f9_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F68b47a8d69f14ae7898c72574afc6ff0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/68b47a8d69f14ae7898c72574afc6ff0/images/large/1.jpg saved to cache
2026-03-26 22:53:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e8418b0c-8e4b-50f5-ba81-68414125e1f9
2026-03-26 22:53:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b792cc10>
2026-03-26 22:53:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8418b0c-8e4b-50f5-ba81-68414125e1f9/e8418b0c-8e4b-50f5-ba81-68414125e1f9_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F68b47a8d69f14ae7898c72574afc6ff0%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/68b47a8d69f14ae7898c72574afc6ff0/images/large/2.jpg saved to cache
2026-03-26 22:53:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e8418b0c-8e4b-50f5-ba81-68414125e1f9
2026-03-26 22:53:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77455d0>
2026-03-26 22:53:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45f362f5-e8a6-53e4-8caa-f5b14f161748/45f362f5-e8a6-53e4-8caa-f5b14f161748_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fa14f5d0a4ff144e8945ea4c025b5d8e2%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/a14f5d0a4ff144e8945ea4c025b5d8e2/images/large/9.jpg saved to cache
2026-03-26 22:53:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 45f362f5-e8a6-53e4-8caa-f5b14f161748
2026-03-26 22:53:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7493550>
2026-03-26 22:53:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8418b0c-8e4b-50f5-ba81-68414125e1f9/e8418b0c-8e4b-50f5-ba81-68414125e1f9_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F68b47a8d69f14ae7898c72574afc6ff0%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/68b47a8d69f14ae7898c72574afc6ff0/images/large/6.jpg saved to cache
2026-03-26 22:53:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e8418b0c-8e4b-50f5-ba81-68414125e1f9
2026-03-26 22:53:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/68b47a8d69f14ae7898c72574afc6ff0/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F2790d81b3bea4a2f92cdd05ec8be71df%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/2790d81b3bea4a2f92cdd05ec8be71df/images/large/6.jpg not downloaded yet
2026-03-26 22:53:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/68b47a8d69f14ae7898c72574afc6ff0/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b78c3810>
2026-03-26 22:53:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45f362f5-e8a6-53e4-8caa-f5b14f161748/45f362f5-e8a6-53e4-8caa-f5b14f161748_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fa14f5d0a4ff144e8945ea4c025b5d8e2%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/a14f5d0a4ff144e8945ea4c025b5d8e2/images/large/10.jpg saved to cache
2026-03-26 22:53:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 45f362f5-e8a6-53e4-8caa-f5b14f161748
2026-03-26 22:53:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 45f362f5-e8a6-53e4-8caa-f5b14f161748, skipping ID generation
2026-03-26 22:53:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45f362f5-e8a6-53e4-8caa-f5b14f161748 with scrape type 1
2026-03-26 22:53:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 45f362f5-e8a6-53e4-8caa-f5b14f161748 sending to next pipeline
2026-03-26 22:53:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 45f362f5-e8a6-53e4-8caa-f5b14f161748, identifier: 1985504
2026-03-26 22:53:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b745b590>
2026-03-26 22:53:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8418b0c-8e4b-50f5-ba81-68414125e1f9/e8418b0c-8e4b-50f5-ba81-68414125e1f9_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F68b47a8d69f14ae7898c72574afc6ff0%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/68b47a8d69f14ae7898c72574afc6ff0/images/large/5.jpg saved to cache
2026-03-26 22:53:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e8418b0c-8e4b-50f5-ba81-68414125e1f9
2026-03-26 22:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F2790d81b3bea4a2f92cdd05ec8be71df%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/2790d81b3bea4a2f92cdd05ec8be71df/images/large/7.jpg not downloaded yet
2026-03-26 22:53:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 45f362f5-e8a6-53e4-8caa-f5b14f161748 with identifier: 1985504
2026-03-26 22:53:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 45f362f5-e8a6-53e4-8caa-f5b14f161748 with identifier: 1985504
2026-03-26 22:53:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 45f362f5-e8a6-53e4-8caa-f5b14f161748 with identifier: 1985504 to the API
2026-03-26 22:53:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:53:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:53:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bh/a14f5d0a4ff144e8945ea4c025b5d8e2/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'electric',
 'id': '45f362f5-e8a6-53e4-8caa-f5b14f161748',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'POLESTAR',
 'model': '2',
 'odometer': 18362,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 20,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45f362f5-e8a6-53e4-8caa-f5b14f161748/45f362f5-e8a6-53e4-8caa-f5b14f161748_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 569639,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/a14f5d0a4ff144e8945ea4c025b5d8e2/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45f362f5-e8a6-53e4-8caa-f5b14f161748/45f362f5-e8a6-53e4-8caa-f5b14f161748_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 556038,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/a14f5d0a4ff144e8945ea4c025b5d8e2/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45f362f5-e8a6-53e4-8caa-f5b14f161748/45f362f5-e8a6-53e4-8caa-f5b14f161748_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 659781,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/a14f5d0a4ff144e8945ea4c025b5d8e2/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45f362f5-e8a6-53e4-8caa-f5b14f161748/45f362f5-e8a6-53e4-8caa-f5b14f161748_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 607790,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/a14f5d0a4ff144e8945ea4c025b5d8e2/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45f362f5-e8a6-53e4-8caa-f5b14f161748/45f362f5-e8a6-53e4-8caa-f5b14f161748_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 506699,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/a14f5d0a4ff144e8945ea4c025b5d8e2/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45f362f5-e8a6-53e4-8caa-f5b14f161748/45f362f5-e8a6-53e4-8caa-f5b14f161748_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 550305,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/a14f5d0a4ff144e8945ea4c025b5d8e2/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45f362f5-e8a6-53e4-8caa-f5b14f161748/45f362f5-e8a6-53e4-8caa-f5b14f161748_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 627366,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/a14f5d0a4ff144e8945ea4c025b5d8e2/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45f362f5-e8a6-53e4-8caa-f5b14f161748/45f362f5-e8a6-53e4-8caa-f5b14f161748_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 596402,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/a14f5d0a4ff144e8945ea4c025b5d8e2/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45f362f5-e8a6-53e4-8caa-f5b14f161748/45f362f5-e8a6-53e4-8caa-f5b14f161748_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 394534,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/a14f5d0a4ff144e8945ea4c025b5d8e2/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45f362f5-e8a6-53e4-8caa-f5b14f161748/45f362f5-e8a6-53e4-8caa-f5b14f161748_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 575887,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/a14f5d0a4ff144e8945ea4c025b5d8e2/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'POLESTAR 2 BEV 64KWH SINGLE MOTOR STANDARD RANGE',
 'transmission': 'automatic',
 'trim': 'BEV 64KWH SINGLE MOTOR STANDARD RANGE',
 'vin': None,
 'year': 2021}
2026-03-26 22:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985504%27 HTTP/1.1" 200 None
2026-03-26 22:53:29 [ayvens.be] INFO: Saving data for 1985504: {'created_time': 1774565609.375086, 'last_price_update_time': 1774565609.375095, 'auction_closing_time': 1774958400.0}
2026-03-26 22:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985504') HTTP/1.1" 204 0
2026-03-26 22:53:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/68b47a8d69f14ae7898c72574afc6ff0/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/68b47a8d69f14ae7898c72574afc6ff0/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F2790d81b3bea4a2f92cdd05ec8be71df%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/2790d81b3bea4a2f92cdd05ec8be71df/images/large/8.jpg not downloaded yet
2026-03-26 22:53:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7590650>
2026-03-26 22:53:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8418b0c-8e4b-50f5-ba81-68414125e1f9/e8418b0c-8e4b-50f5-ba81-68414125e1f9_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F68b47a8d69f14ae7898c72574afc6ff0%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/68b47a8d69f14ae7898c72574afc6ff0/images/large/8.jpg saved to cache
2026-03-26 22:53:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e8418b0c-8e4b-50f5-ba81-68414125e1f9
2026-03-26 22:53:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7425dd0>
2026-03-26 22:53:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8418b0c-8e4b-50f5-ba81-68414125e1f9/e8418b0c-8e4b-50f5-ba81-68414125e1f9_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F68b47a8d69f14ae7898c72574afc6ff0%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/68b47a8d69f14ae7898c72574afc6ff0/images/large/7.jpg saved to cache
2026-03-26 22:53:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e8418b0c-8e4b-50f5-ba81-68414125e1f9
2026-03-26 22:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F2790d81b3bea4a2f92cdd05ec8be71df%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/2790d81b3bea4a2f92cdd05ec8be71df/images/large/9.jpg not downloaded yet
2026-03-26 22:53:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/2790d81b3bea4a2f92cdd05ec8be71df/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F2790d81b3bea4a2f92cdd05ec8be71df%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/2790d81b3bea4a2f92cdd05ec8be71df/images/large/10.jpg not downloaded yet
2026-03-26 22:53:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7450a50>
2026-03-26 22:53:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8418b0c-8e4b-50f5-ba81-68414125e1f9/e8418b0c-8e4b-50f5-ba81-68414125e1f9_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F68b47a8d69f14ae7898c72574afc6ff0%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/68b47a8d69f14ae7898c72574afc6ff0/images/large/9.jpg saved to cache
2026-03-26 22:53:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e8418b0c-8e4b-50f5-ba81-68414125e1f9
2026-03-26 22:53:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79f1bd0>
2026-03-26 22:53:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8418b0c-8e4b-50f5-ba81-68414125e1f9/e8418b0c-8e4b-50f5-ba81-68414125e1f9_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F68b47a8d69f14ae7898c72574afc6ff0%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/68b47a8d69f14ae7898c72574afc6ff0/images/large/10.jpg saved to cache
2026-03-26 22:53:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e8418b0c-8e4b-50f5-ba81-68414125e1f9
2026-03-26 22:53:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e8418b0c-8e4b-50f5-ba81-68414125e1f9, skipping ID generation
2026-03-26 22:53:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8418b0c-8e4b-50f5-ba81-68414125e1f9 with scrape type 1
2026-03-26 22:53:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e8418b0c-8e4b-50f5-ba81-68414125e1f9 sending to next pipeline
2026-03-26 22:53:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e8418b0c-8e4b-50f5-ba81-68414125e1f9, identifier: 1985505
2026-03-26 22:53:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/2790d81b3bea4a2f92cdd05ec8be71df/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e8418b0c-8e4b-50f5-ba81-68414125e1f9 with identifier: 1985505
2026-03-26 22:53:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e8418b0c-8e4b-50f5-ba81-68414125e1f9 with identifier: 1985505
2026-03-26 22:53:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e8418b0c-8e4b-50f5-ba81-68414125e1f9 with identifier: 1985505 to the API
2026-03-26 22:53:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:53:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:53:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bq/68b47a8d69f14ae7898c72574afc6ff0/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'e8418b0c-8e4b-50f5-ba81-68414125e1f9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'ARKANA',
 'odometer': 35359,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8418b0c-8e4b-50f5-ba81-68414125e1f9/e8418b0c-8e4b-50f5-ba81-68414125e1f9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 538554,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/68b47a8d69f14ae7898c72574afc6ff0/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8418b0c-8e4b-50f5-ba81-68414125e1f9/e8418b0c-8e4b-50f5-ba81-68414125e1f9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 455300,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/68b47a8d69f14ae7898c72574afc6ff0/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8418b0c-8e4b-50f5-ba81-68414125e1f9/e8418b0c-8e4b-50f5-ba81-68414125e1f9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 467823,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/68b47a8d69f14ae7898c72574afc6ff0/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8418b0c-8e4b-50f5-ba81-68414125e1f9/e8418b0c-8e4b-50f5-ba81-68414125e1f9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 413283,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/68b47a8d69f14ae7898c72574afc6ff0/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8418b0c-8e4b-50f5-ba81-68414125e1f9/e8418b0c-8e4b-50f5-ba81-68414125e1f9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 351928,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/68b47a8d69f14ae7898c72574afc6ff0/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8418b0c-8e4b-50f5-ba81-68414125e1f9/e8418b0c-8e4b-50f5-ba81-68414125e1f9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 250236,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/68b47a8d69f14ae7898c72574afc6ff0/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8418b0c-8e4b-50f5-ba81-68414125e1f9/e8418b0c-8e4b-50f5-ba81-68414125e1f9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 368784,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/68b47a8d69f14ae7898c72574afc6ff0/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8418b0c-8e4b-50f5-ba81-68414125e1f9/e8418b0c-8e4b-50f5-ba81-68414125e1f9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 299413,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/68b47a8d69f14ae7898c72574afc6ff0/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8418b0c-8e4b-50f5-ba81-68414125e1f9/e8418b0c-8e4b-50f5-ba81-68414125e1f9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 287591,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/68b47a8d69f14ae7898c72574afc6ff0/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8418b0c-8e4b-50f5-ba81-68414125e1f9/e8418b0c-8e4b-50f5-ba81-68414125e1f9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 286979,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/68b47a8d69f14ae7898c72574afc6ff0/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT ARKANA 1.6 E-TECH 145 ZEN',
 'transmission': 'automatic',
 'trim': '1.6 E-TECH 145 ZEN',
 'vin': None,
 'year': 2022}
2026-03-26 22:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985505%27 HTTP/1.1" 200 None
2026-03-26 22:53:30 [ayvens.be] INFO: Saving data for 1985505: {'created_time': 1774565610.212903, 'last_price_update_time': 1774565610.212912, 'auction_closing_time': 1774958400.0}
2026-03-26 22:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985505') HTTP/1.1" 204 0
2026-03-26 22:53:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/2790d81b3bea4a2f92cdd05ec8be71df/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:30 [ayvens.be] INFO: Found listing with ID: 1985507
2026-03-26 22:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985507%27 HTTP/1.1" 200 None
2026-03-26 22:53:30 [ayvens.be] INFO: Scrape type for 1985507: 1
2026-03-26 22:53:30 [ayvens.be] INFO: Extracting data for car ID: 1985507
2026-03-26 22:53:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e89b0c35-1801-582d-a8b4-24273842471b with identifier: 1985507
2026-03-26 22:53:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e89b0c35-1801-582d-a8b4-24273842471b with scrape type 1
2026-03-26 22:53:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e89b0c35-1801-582d-a8b4-24273842471b
2026-03-26 22:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fd558c740a5464bd49a5d9b2bfcb2d67c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/d558c740a5464bd49a5d9b2bfcb2d67c/images/large/1.jpg not downloaded yet
2026-03-26 22:53:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd3b8fd0>
2026-03-26 22:53:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7daffc16-00ab-5d2a-b461-726a3cb29f81/7daffc16-00ab-5d2a-b461-726a3cb29f81_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F2790d81b3bea4a2f92cdd05ec8be71df%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/2790d81b3bea4a2f92cdd05ec8be71df/images/large/1.jpg saved to cache
2026-03-26 22:53:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7daffc16-00ab-5d2a-b461-726a3cb29f81
2026-03-26 22:53:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/2790d81b3bea4a2f92cdd05ec8be71df/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fd558c740a5464bd49a5d9b2bfcb2d67c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/d558c740a5464bd49a5d9b2bfcb2d67c/images/large/2.jpg not downloaded yet
2026-03-26 22:53:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b741f790>
2026-03-26 22:53:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7daffc16-00ab-5d2a-b461-726a3cb29f81/7daffc16-00ab-5d2a-b461-726a3cb29f81_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F2790d81b3bea4a2f92cdd05ec8be71df%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/2790d81b3bea4a2f92cdd05ec8be71df/images/large/2.jpg saved to cache
2026-03-26 22:53:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7daffc16-00ab-5d2a-b461-726a3cb29f81
2026-03-26 22:53:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/2790d81b3bea4a2f92cdd05ec8be71df/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fd558c740a5464bd49a5d9b2bfcb2d67c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/d558c740a5464bd49a5d9b2bfcb2d67c/images/large/3.jpg not downloaded yet
2026-03-26 22:53:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7aead10>
2026-03-26 22:53:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7daffc16-00ab-5d2a-b461-726a3cb29f81/7daffc16-00ab-5d2a-b461-726a3cb29f81_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F2790d81b3bea4a2f92cdd05ec8be71df%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/2790d81b3bea4a2f92cdd05ec8be71df/images/large/3.jpg saved to cache
2026-03-26 22:53:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7daffc16-00ab-5d2a-b461-726a3cb29f81
2026-03-26 22:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fd558c740a5464bd49a5d9b2bfcb2d67c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/d558c740a5464bd49a5d9b2bfcb2d67c/images/large/4.jpg not downloaded yet
2026-03-26 22:53:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7aa2210>
2026-03-26 22:53:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7daffc16-00ab-5d2a-b461-726a3cb29f81/7daffc16-00ab-5d2a-b461-726a3cb29f81_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F2790d81b3bea4a2f92cdd05ec8be71df%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/2790d81b3bea4a2f92cdd05ec8be71df/images/large/4.jpg saved to cache
2026-03-26 22:53:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7daffc16-00ab-5d2a-b461-726a3cb29f81
2026-03-26 22:53:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/2790d81b3bea4a2f92cdd05ec8be71df/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fd558c740a5464bd49a5d9b2bfcb2d67c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/d558c740a5464bd49a5d9b2bfcb2d67c/images/large/5.jpg not downloaded yet
2026-03-26 22:53:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/2790d81b3bea4a2f92cdd05ec8be71df/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7450c10>
2026-03-26 22:53:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7daffc16-00ab-5d2a-b461-726a3cb29f81/7daffc16-00ab-5d2a-b461-726a3cb29f81_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F2790d81b3bea4a2f92cdd05ec8be71df%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/2790d81b3bea4a2f92cdd05ec8be71df/images/large/5.jpg saved to cache
2026-03-26 22:53:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7daffc16-00ab-5d2a-b461-726a3cb29f81
2026-03-26 22:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fd558c740a5464bd49a5d9b2bfcb2d67c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/d558c740a5464bd49a5d9b2bfcb2d67c/images/large/6.jpg not downloaded yet
2026-03-26 22:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fd558c740a5464bd49a5d9b2bfcb2d67c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/d558c740a5464bd49a5d9b2bfcb2d67c/images/large/7.jpg not downloaded yet
2026-03-26 22:53:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74a4d50>
2026-03-26 22:53:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7daffc16-00ab-5d2a-b461-726a3cb29f81/7daffc16-00ab-5d2a-b461-726a3cb29f81_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F2790d81b3bea4a2f92cdd05ec8be71df%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/2790d81b3bea4a2f92cdd05ec8be71df/images/large/6.jpg saved to cache
2026-03-26 22:53:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7daffc16-00ab-5d2a-b461-726a3cb29f81
2026-03-26 22:53:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/2790d81b3bea4a2f92cdd05ec8be71df/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fd558c740a5464bd49a5d9b2bfcb2d67c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/d558c740a5464bd49a5d9b2bfcb2d67c/images/large/8.jpg not downloaded yet
2026-03-26 22:53:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b75929d0>
2026-03-26 22:53:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7daffc16-00ab-5d2a-b461-726a3cb29f81/7daffc16-00ab-5d2a-b461-726a3cb29f81_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F2790d81b3bea4a2f92cdd05ec8be71df%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/2790d81b3bea4a2f92cdd05ec8be71df/images/large/7.jpg saved to cache
2026-03-26 22:53:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7daffc16-00ab-5d2a-b461-726a3cb29f81
2026-03-26 22:53:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/2790d81b3bea4a2f92cdd05ec8be71df/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/2790d81b3bea4a2f92cdd05ec8be71df/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/d558c740a5464bd49a5d9b2bfcb2d67c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fd558c740a5464bd49a5d9b2bfcb2d67c%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/d558c740a5464bd49a5d9b2bfcb2d67c/images/large/9.jpg not downloaded yet
2026-03-26 22:53:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b72fd6d0>
2026-03-26 22:53:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7daffc16-00ab-5d2a-b461-726a3cb29f81/7daffc16-00ab-5d2a-b461-726a3cb29f81_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F2790d81b3bea4a2f92cdd05ec8be71df%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/2790d81b3bea4a2f92cdd05ec8be71df/images/large/8.jpg saved to cache
2026-03-26 22:53:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7daffc16-00ab-5d2a-b461-726a3cb29f81
2026-03-26 22:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fd558c740a5464bd49a5d9b2bfcb2d67c%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/d558c740a5464bd49a5d9b2bfcb2d67c/images/large/10.jpg not downloaded yet
2026-03-26 22:53:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/d558c740a5464bd49a5d9b2bfcb2d67c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:31 [ayvens.be] INFO: Found listing with ID: 1985508
2026-03-26 22:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985508%27 HTTP/1.1" 200 None
2026-03-26 22:53:31 [ayvens.be] INFO: Scrape type for 1985508: 1
2026-03-26 22:53:31 [ayvens.be] INFO: Extracting data for car ID: 1985508
2026-03-26 22:53:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72 with identifier: 1985508
2026-03-26 22:53:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72 with scrape type 1
2026-03-26 22:53:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72
2026-03-26 22:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ed%252Fd1deb72034a84f279bbe69de6b312504%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ed/d1deb72034a84f279bbe69de6b312504/images/large/1.jpg not downloaded yet
2026-03-26 22:53:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/d558c740a5464bd49a5d9b2bfcb2d67c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79f1a10>
2026-03-26 22:53:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7daffc16-00ab-5d2a-b461-726a3cb29f81/7daffc16-00ab-5d2a-b461-726a3cb29f81_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F2790d81b3bea4a2f92cdd05ec8be71df%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/2790d81b3bea4a2f92cdd05ec8be71df/images/large/9.jpg saved to cache
2026-03-26 22:53:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7daffc16-00ab-5d2a-b461-726a3cb29f81
2026-03-26 22:53:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c5ce10>
2026-03-26 22:53:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7daffc16-00ab-5d2a-b461-726a3cb29f81/7daffc16-00ab-5d2a-b461-726a3cb29f81_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F2790d81b3bea4a2f92cdd05ec8be71df%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/2790d81b3bea4a2f92cdd05ec8be71df/images/large/10.jpg saved to cache
2026-03-26 22:53:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7daffc16-00ab-5d2a-b461-726a3cb29f81
2026-03-26 22:53:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7daffc16-00ab-5d2a-b461-726a3cb29f81, skipping ID generation
2026-03-26 22:53:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7daffc16-00ab-5d2a-b461-726a3cb29f81 with scrape type 1
2026-03-26 22:53:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7daffc16-00ab-5d2a-b461-726a3cb29f81 sending to next pipeline
2026-03-26 22:53:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 7daffc16-00ab-5d2a-b461-726a3cb29f81, identifier: 1985506
2026-03-26 22:53:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd0cf990>
2026-03-26 22:53:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e89b0c35-1801-582d-a8b4-24273842471b/e89b0c35-1801-582d-a8b4-24273842471b_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fd558c740a5464bd49a5d9b2bfcb2d67c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/d558c740a5464bd49a5d9b2bfcb2d67c/images/large/1.jpg saved to cache
2026-03-26 22:53:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e89b0c35-1801-582d-a8b4-24273842471b
2026-03-26 22:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ed%252Fd1deb72034a84f279bbe69de6b312504%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ed/d1deb72034a84f279bbe69de6b312504/images/large/2.jpg not downloaded yet
2026-03-26 22:53:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 7daffc16-00ab-5d2a-b461-726a3cb29f81 with identifier: 1985506
2026-03-26 22:53:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 7daffc16-00ab-5d2a-b461-726a3cb29f81 with identifier: 1985506
2026-03-26 22:53:31 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 7daffc16-00ab-5d2a-b461-726a3cb29f81 with identifier: 1985506 to the API
2026-03-26 22:53:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:53:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:53:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2de/2790d81b3bea4a2f92cdd05ec8be71df/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '7daffc16-00ab-5d2a-b461-726a3cb29f81',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X2',
 'odometer': 29648,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7daffc16-00ab-5d2a-b461-726a3cb29f81/7daffc16-00ab-5d2a-b461-726a3cb29f81_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 706937,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/2790d81b3bea4a2f92cdd05ec8be71df/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7daffc16-00ab-5d2a-b461-726a3cb29f81/7daffc16-00ab-5d2a-b461-726a3cb29f81_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 711081,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/2790d81b3bea4a2f92cdd05ec8be71df/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7daffc16-00ab-5d2a-b461-726a3cb29f81/7daffc16-00ab-5d2a-b461-726a3cb29f81_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 632589,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/2790d81b3bea4a2f92cdd05ec8be71df/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7daffc16-00ab-5d2a-b461-726a3cb29f81/7daffc16-00ab-5d2a-b461-726a3cb29f81_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 713121,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/2790d81b3bea4a2f92cdd05ec8be71df/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7daffc16-00ab-5d2a-b461-726a3cb29f81/7daffc16-00ab-5d2a-b461-726a3cb29f81_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 681537,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/2790d81b3bea4a2f92cdd05ec8be71df/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7daffc16-00ab-5d2a-b461-726a3cb29f81/7daffc16-00ab-5d2a-b461-726a3cb29f81_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 722937,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/2790d81b3bea4a2f92cdd05ec8be71df/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7daffc16-00ab-5d2a-b461-726a3cb29f81/7daffc16-00ab-5d2a-b461-726a3cb29f81_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 633559,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/2790d81b3bea4a2f92cdd05ec8be71df/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7daffc16-00ab-5d2a-b461-726a3cb29f81/7daffc16-00ab-5d2a-b461-726a3cb29f81_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 851528,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/2790d81b3bea4a2f92cdd05ec8be71df/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7daffc16-00ab-5d2a-b461-726a3cb29f81/7daffc16-00ab-5d2a-b461-726a3cb29f81_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 828165,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/2790d81b3bea4a2f92cdd05ec8be71df/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7daffc16-00ab-5d2a-b461-726a3cb29f81/7daffc16-00ab-5d2a-b461-726a3cb29f81_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 716994,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/2790d81b3bea4a2f92cdd05ec8be71df/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X2 1.5 XDRIVE25E PHEV 162KW',
 'transmission': 'automatic',
 'trim': '1.5 XDRIVE25E PHEV 162KW',
 'vin': None,
 'year': 2023}
2026-03-26 22:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985506%27 HTTP/1.1" 200 None
2026-03-26 22:53:31 [ayvens.be] INFO: Saving data for 1985506: {'created_time': 1774565611.977284, 'last_price_update_time': 1774565611.977293, 'auction_closing_time': 1774958400.0}
2026-03-26 22:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985506') HTTP/1.1" 204 0
2026-03-26 22:53:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/d558c740a5464bd49a5d9b2bfcb2d67c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/d558c740a5464bd49a5d9b2bfcb2d67c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ed%252Fd1deb72034a84f279bbe69de6b312504%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ed/d1deb72034a84f279bbe69de6b312504/images/large/3.jpg not downloaded yet
2026-03-26 22:53:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e3d810>
2026-03-26 22:53:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e89b0c35-1801-582d-a8b4-24273842471b/e89b0c35-1801-582d-a8b4-24273842471b_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fd558c740a5464bd49a5d9b2bfcb2d67c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/d558c740a5464bd49a5d9b2bfcb2d67c/images/large/2.jpg saved to cache
2026-03-26 22:53:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e89b0c35-1801-582d-a8b4-24273842471b
2026-03-26 22:53:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76c4a10>
2026-03-26 22:53:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e89b0c35-1801-582d-a8b4-24273842471b/e89b0c35-1801-582d-a8b4-24273842471b_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fd558c740a5464bd49a5d9b2bfcb2d67c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/d558c740a5464bd49a5d9b2bfcb2d67c/images/large/3.jpg saved to cache
2026-03-26 22:53:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e89b0c35-1801-582d-a8b4-24273842471b
2026-03-26 22:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ed%252Fd1deb72034a84f279bbe69de6b312504%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ed/d1deb72034a84f279bbe69de6b312504/images/large/4.jpg not downloaded yet
2026-03-26 22:53:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77c8d10>
2026-03-26 22:53:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e89b0c35-1801-582d-a8b4-24273842471b/e89b0c35-1801-582d-a8b4-24273842471b_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fd558c740a5464bd49a5d9b2bfcb2d67c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/d558c740a5464bd49a5d9b2bfcb2d67c/images/large/4.jpg saved to cache
2026-03-26 22:53:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e89b0c35-1801-582d-a8b4-24273842471b
2026-03-26 22:53:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c6ac50>
2026-03-26 22:53:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e89b0c35-1801-582d-a8b4-24273842471b/e89b0c35-1801-582d-a8b4-24273842471b_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fd558c740a5464bd49a5d9b2bfcb2d67c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/d558c740a5464bd49a5d9b2bfcb2d67c/images/large/5.jpg saved to cache
2026-03-26 22:53:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e89b0c35-1801-582d-a8b4-24273842471b
2026-03-26 22:53:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/d558c740a5464bd49a5d9b2bfcb2d67c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ed%252Fd1deb72034a84f279bbe69de6b312504%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ed/d1deb72034a84f279bbe69de6b312504/images/large/5.jpg not downloaded yet
2026-03-26 22:53:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/d558c740a5464bd49a5d9b2bfcb2d67c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ed%252Fd1deb72034a84f279bbe69de6b312504%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ed/d1deb72034a84f279bbe69de6b312504/images/large/6.jpg not downloaded yet
2026-03-26 22:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ed%252Fd1deb72034a84f279bbe69de6b312504%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ed/d1deb72034a84f279bbe69de6b312504/images/large/7.jpg not downloaded yet
2026-03-26 22:53:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/d558c740a5464bd49a5d9b2bfcb2d67c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ed%252Fd1deb72034a84f279bbe69de6b312504%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ed/d1deb72034a84f279bbe69de6b312504/images/large/8.jpg not downloaded yet
2026-03-26 22:53:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/d558c740a5464bd49a5d9b2bfcb2d67c/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ed/d1deb72034a84f279bbe69de6b312504/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ed%252Fd1deb72034a84f279bbe69de6b312504%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ed/d1deb72034a84f279bbe69de6b312504/images/large/9.jpg not downloaded yet
2026-03-26 22:53:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/d558c740a5464bd49a5d9b2bfcb2d67c/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ed/d1deb72034a84f279bbe69de6b312504/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ed%252Fd1deb72034a84f279bbe69de6b312504%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ed/d1deb72034a84f279bbe69de6b312504/images/large/10.jpg not downloaded yet
2026-03-26 22:53:32 [ayvens.be] INFO: Found listing with ID: 1985509
2026-03-26 22:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985509%27 HTTP/1.1" 200 None
2026-03-26 22:53:32 [ayvens.be] INFO: Scrape type for 1985509: 1
2026-03-26 22:53:32 [ayvens.be] INFO: Extracting data for car ID: 1985509
2026-03-26 22:53:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 29499b34-8810-5b04-b474-a1d89d7eac20 with identifier: 1985509
2026-03-26 22:53:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29499b34-8810-5b04-b474-a1d89d7eac20 with scrape type 1
2026-03-26 22:53:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 29499b34-8810-5b04-b474-a1d89d7eac20
2026-03-26 22:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F97f8337acc494d6eba6aa113f6abecbb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/97f8337acc494d6eba6aa113f6abecbb/images/large/1.jpg not downloaded yet
2026-03-26 22:53:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b727a910>
2026-03-26 22:53:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e89b0c35-1801-582d-a8b4-24273842471b/e89b0c35-1801-582d-a8b4-24273842471b_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fd558c740a5464bd49a5d9b2bfcb2d67c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/d558c740a5464bd49a5d9b2bfcb2d67c/images/large/7.jpg saved to cache
2026-03-26 22:53:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e89b0c35-1801-582d-a8b4-24273842471b
2026-03-26 22:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F97f8337acc494d6eba6aa113f6abecbb%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/97f8337acc494d6eba6aa113f6abecbb/images/large/2.jpg not downloaded yet
2026-03-26 22:53:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7279610>
2026-03-26 22:53:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e89b0c35-1801-582d-a8b4-24273842471b/e89b0c35-1801-582d-a8b4-24273842471b_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fd558c740a5464bd49a5d9b2bfcb2d67c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/d558c740a5464bd49a5d9b2bfcb2d67c/images/large/6.jpg saved to cache
2026-03-26 22:53:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e89b0c35-1801-582d-a8b4-24273842471b
2026-03-26 22:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F97f8337acc494d6eba6aa113f6abecbb%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/97f8337acc494d6eba6aa113f6abecbb/images/large/3.jpg not downloaded yet
2026-03-26 22:53:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ed/d1deb72034a84f279bbe69de6b312504/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd48e850>
2026-03-26 22:53:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e89b0c35-1801-582d-a8b4-24273842471b/e89b0c35-1801-582d-a8b4-24273842471b_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fd558c740a5464bd49a5d9b2bfcb2d67c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/d558c740a5464bd49a5d9b2bfcb2d67c/images/large/8.jpg saved to cache
2026-03-26 22:53:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e89b0c35-1801-582d-a8b4-24273842471b
2026-03-26 22:53:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7aa34d0>
2026-03-26 22:53:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e89b0c35-1801-582d-a8b4-24273842471b/e89b0c35-1801-582d-a8b4-24273842471b_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fd558c740a5464bd49a5d9b2bfcb2d67c%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/d558c740a5464bd49a5d9b2bfcb2d67c/images/large/9.jpg saved to cache
2026-03-26 22:53:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e89b0c35-1801-582d-a8b4-24273842471b
2026-03-26 22:53:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7a55750>
2026-03-26 22:53:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72/e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ed%252Fd1deb72034a84f279bbe69de6b312504%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ed/d1deb72034a84f279bbe69de6b312504/images/large/1.jpg saved to cache
2026-03-26 22:53:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72
2026-03-26 22:53:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cbd010>
2026-03-26 22:53:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e89b0c35-1801-582d-a8b4-24273842471b/e89b0c35-1801-582d-a8b4-24273842471b_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fd558c740a5464bd49a5d9b2bfcb2d67c%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/d558c740a5464bd49a5d9b2bfcb2d67c/images/large/10.jpg saved to cache
2026-03-26 22:53:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e89b0c35-1801-582d-a8b4-24273842471b
2026-03-26 22:53:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e89b0c35-1801-582d-a8b4-24273842471b, skipping ID generation
2026-03-26 22:53:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e89b0c35-1801-582d-a8b4-24273842471b with scrape type 1
2026-03-26 22:53:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e89b0c35-1801-582d-a8b4-24273842471b sending to next pipeline
2026-03-26 22:53:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e89b0c35-1801-582d-a8b4-24273842471b, identifier: 1985507
2026-03-26 22:53:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7451810>
2026-03-26 22:53:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72/e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ed%252Fd1deb72034a84f279bbe69de6b312504%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ed/d1deb72034a84f279bbe69de6b312504/images/large/2.jpg saved to cache
2026-03-26 22:53:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72
2026-03-26 22:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F97f8337acc494d6eba6aa113f6abecbb%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/97f8337acc494d6eba6aa113f6abecbb/images/large/4.jpg not downloaded yet
2026-03-26 22:53:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e89b0c35-1801-582d-a8b4-24273842471b with identifier: 1985507
2026-03-26 22:53:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e89b0c35-1801-582d-a8b4-24273842471b with identifier: 1985507
2026-03-26 22:53:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e89b0c35-1801-582d-a8b4-24273842471b with identifier: 1985507 to the API
2026-03-26 22:53:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:53:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:53:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bj/d558c740a5464bd49a5d9b2bfcb2d67c/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'e89b0c35-1801-582d-a8b4-24273842471b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3 Sportback',
 'odometer': 95959,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e89b0c35-1801-582d-a8b4-24273842471b/e89b0c35-1801-582d-a8b4-24273842471b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 700861,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/d558c740a5464bd49a5d9b2bfcb2d67c/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e89b0c35-1801-582d-a8b4-24273842471b/e89b0c35-1801-582d-a8b4-24273842471b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 707760,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/d558c740a5464bd49a5d9b2bfcb2d67c/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e89b0c35-1801-582d-a8b4-24273842471b/e89b0c35-1801-582d-a8b4-24273842471b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 686032,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/d558c740a5464bd49a5d9b2bfcb2d67c/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e89b0c35-1801-582d-a8b4-24273842471b/e89b0c35-1801-582d-a8b4-24273842471b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 703788,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/d558c740a5464bd49a5d9b2bfcb2d67c/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e89b0c35-1801-582d-a8b4-24273842471b/e89b0c35-1801-582d-a8b4-24273842471b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 699496,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/d558c740a5464bd49a5d9b2bfcb2d67c/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e89b0c35-1801-582d-a8b4-24273842471b/e89b0c35-1801-582d-a8b4-24273842471b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 735110,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/d558c740a5464bd49a5d9b2bfcb2d67c/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e89b0c35-1801-582d-a8b4-24273842471b/e89b0c35-1801-582d-a8b4-24273842471b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 594849,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/d558c740a5464bd49a5d9b2bfcb2d67c/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e89b0c35-1801-582d-a8b4-24273842471b/e89b0c35-1801-582d-a8b4-24273842471b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 813008,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/d558c740a5464bd49a5d9b2bfcb2d67c/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e89b0c35-1801-582d-a8b4-24273842471b/e89b0c35-1801-582d-a8b4-24273842471b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 789623,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/d558c740a5464bd49a5d9b2bfcb2d67c/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e89b0c35-1801-582d-a8b4-24273842471b/e89b0c35-1801-582d-a8b4-24273842471b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 822205,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/d558c740a5464bd49a5d9b2bfcb2d67c/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 Sportback 1.4 45 TFSI E S TRONIC',
 'transmission': 'automatic',
 'trim': '1.4 45 TFSI E S TRONIC',
 'vin': None,
 'year': 2021}
2026-03-26 22:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985507%27 HTTP/1.1" 200 None
2026-03-26 22:53:33 [ayvens.be] INFO: Saving data for 1985507: {'created_time': 1774565613.559902, 'last_price_update_time': 1774565613.559911, 'auction_closing_time': 1774958400.0}
2026-03-26 22:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985507') HTTP/1.1" 204 0
2026-03-26 22:53:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ed/d1deb72034a84f279bbe69de6b312504/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ed/d1deb72034a84f279bbe69de6b312504/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F97f8337acc494d6eba6aa113f6abecbb%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/97f8337acc494d6eba6aa113f6abecbb/images/large/5.jpg not downloaded yet
2026-03-26 22:53:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ed/d1deb72034a84f279bbe69de6b312504/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F97f8337acc494d6eba6aa113f6abecbb%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/97f8337acc494d6eba6aa113f6abecbb/images/large/6.jpg not downloaded yet
2026-03-26 22:53:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c61b50>
2026-03-26 22:53:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72/e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ed%252Fd1deb72034a84f279bbe69de6b312504%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ed/d1deb72034a84f279bbe69de6b312504/images/large/3.jpg saved to cache
2026-03-26 22:53:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72
2026-03-26 22:53:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ed/d1deb72034a84f279bbe69de6b312504/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F97f8337acc494d6eba6aa113f6abecbb%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/97f8337acc494d6eba6aa113f6abecbb/images/large/7.jpg not downloaded yet
2026-03-26 22:53:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ed/d1deb72034a84f279bbe69de6b312504/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/97f8337acc494d6eba6aa113f6abecbb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F97f8337acc494d6eba6aa113f6abecbb%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/97f8337acc494d6eba6aa113f6abecbb/images/large/8.jpg not downloaded yet
2026-03-26 22:53:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/97f8337acc494d6eba6aa113f6abecbb/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7a82410>
2026-03-26 22:53:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72/e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ed%252Fd1deb72034a84f279bbe69de6b312504%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ed/d1deb72034a84f279bbe69de6b312504/images/large/4.jpg saved to cache
2026-03-26 22:53:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72
2026-03-26 22:53:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74ae9d0>
2026-03-26 22:53:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72/e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ed%252Fd1deb72034a84f279bbe69de6b312504%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ed/d1deb72034a84f279bbe69de6b312504/images/large/6.jpg saved to cache
2026-03-26 22:53:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72
2026-03-26 22:53:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b787d710>
2026-03-26 22:53:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72/e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ed%252Fd1deb72034a84f279bbe69de6b312504%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ed/d1deb72034a84f279bbe69de6b312504/images/large/5.jpg saved to cache
2026-03-26 22:53:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72
2026-03-26 22:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F97f8337acc494d6eba6aa113f6abecbb%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/97f8337acc494d6eba6aa113f6abecbb/images/large/9.jpg not downloaded yet
2026-03-26 22:53:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ed/d1deb72034a84f279bbe69de6b312504/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F97f8337acc494d6eba6aa113f6abecbb%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/97f8337acc494d6eba6aa113f6abecbb/images/large/10.jpg not downloaded yet
2026-03-26 22:53:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b782c450>
2026-03-26 22:53:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72/e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ed%252Fd1deb72034a84f279bbe69de6b312504%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ed/d1deb72034a84f279bbe69de6b312504/images/large/8.jpg saved to cache
2026-03-26 22:53:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72
2026-03-26 22:53:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7440c50>
2026-03-26 22:53:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72/e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ed%252Fd1deb72034a84f279bbe69de6b312504%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ed/d1deb72034a84f279bbe69de6b312504/images/large/7.jpg saved to cache
2026-03-26 22:53:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72
2026-03-26 22:53:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e139d0>
2026-03-26 22:53:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29499b34-8810-5b04-b474-a1d89d7eac20/29499b34-8810-5b04-b474-a1d89d7eac20_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F97f8337acc494d6eba6aa113f6abecbb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/97f8337acc494d6eba6aa113f6abecbb/images/large/1.jpg saved to cache
2026-03-26 22:53:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 29499b34-8810-5b04-b474-a1d89d7eac20
2026-03-26 22:53:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b727d390>
2026-03-26 22:53:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29499b34-8810-5b04-b474-a1d89d7eac20/29499b34-8810-5b04-b474-a1d89d7eac20_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F97f8337acc494d6eba6aa113f6abecbb%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/97f8337acc494d6eba6aa113f6abecbb/images/large/2.jpg saved to cache
2026-03-26 22:53:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 29499b34-8810-5b04-b474-a1d89d7eac20
2026-03-26 22:53:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/97f8337acc494d6eba6aa113f6abecbb/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ed/d1deb72034a84f279bbe69de6b312504/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:34 [ayvens.be] INFO: Found listing with ID: 1985510
2026-03-26 22:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985510%27 HTTP/1.1" 200 None
2026-03-26 22:53:34 [ayvens.be] INFO: Scrape type for 1985510: 1
2026-03-26 22:53:34 [ayvens.be] INFO: Extracting data for car ID: 1985510
2026-03-26 22:53:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b45ee0fe-0bda-5382-a96b-95465e7f768d with identifier: 1985510
2026-03-26 22:53:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b45ee0fe-0bda-5382-a96b-95465e7f768d with scrape type 1
2026-03-26 22:53:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b45ee0fe-0bda-5382-a96b-95465e7f768d
2026-03-26 22:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F6b0a0e99cb2d46febcc2905bed057a6e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/6b0a0e99cb2d46febcc2905bed057a6e/images/large/1.jpg not downloaded yet
2026-03-26 22:53:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79a4110>
2026-03-26 22:53:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72/e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ed%252Fd1deb72034a84f279bbe69de6b312504%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ed/d1deb72034a84f279bbe69de6b312504/images/large/10.jpg saved to cache
2026-03-26 22:53:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72
2026-03-26 22:53:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/97f8337acc494d6eba6aa113f6abecbb/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/97f8337acc494d6eba6aa113f6abecbb/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F6b0a0e99cb2d46febcc2905bed057a6e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/6b0a0e99cb2d46febcc2905bed057a6e/images/large/2.jpg not downloaded yet
2026-03-26 22:53:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/97f8337acc494d6eba6aa113f6abecbb/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F6b0a0e99cb2d46febcc2905bed057a6e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/6b0a0e99cb2d46febcc2905bed057a6e/images/large/3.jpg not downloaded yet
2026-03-26 22:53:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77ae7d0>
2026-03-26 22:53:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29499b34-8810-5b04-b474-a1d89d7eac20/29499b34-8810-5b04-b474-a1d89d7eac20_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F97f8337acc494d6eba6aa113f6abecbb%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/97f8337acc494d6eba6aa113f6abecbb/images/large/3.jpg saved to cache
2026-03-26 22:53:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 29499b34-8810-5b04-b474-a1d89d7eac20
2026-03-26 22:53:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b72eed90>
2026-03-26 22:53:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72/e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ed%252Fd1deb72034a84f279bbe69de6b312504%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ed/d1deb72034a84f279bbe69de6b312504/images/large/9.jpg saved to cache
2026-03-26 22:53:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72
2026-03-26 22:53:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72, skipping ID generation
2026-03-26 22:53:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72 with scrape type 1
2026-03-26 22:53:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72 sending to next pipeline
2026-03-26 22:53:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72, identifier: 1985508
2026-03-26 22:53:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/97f8337acc494d6eba6aa113f6abecbb/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/97f8337acc494d6eba6aa113f6abecbb/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72 with identifier: 1985508
2026-03-26 22:53:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72 with identifier: 1985508
2026-03-26 22:53:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72 with identifier: 1985508 to the API
2026-03-26 22:53:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:53:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:53:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ed/d1deb72034a84f279bbe69de6b312504/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A3',
 'odometer': 190942,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72/e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 597215,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ed/d1deb72034a84f279bbe69de6b312504/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72/e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 609439,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ed/d1deb72034a84f279bbe69de6b312504/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72/e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 642566,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ed/d1deb72034a84f279bbe69de6b312504/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72/e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 669285,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ed/d1deb72034a84f279bbe69de6b312504/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72/e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 517621,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ed/d1deb72034a84f279bbe69de6b312504/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72/e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 490115,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ed/d1deb72034a84f279bbe69de6b312504/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72/e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 605074,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ed/d1deb72034a84f279bbe69de6b312504/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72/e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 657411,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ed/d1deb72034a84f279bbe69de6b312504/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72/e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 429850,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ed/d1deb72034a84f279bbe69de6b312504/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72/e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 702744,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ed/d1deb72034a84f279bbe69de6b312504/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-09-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A3 1.4 40 TFSI E S TRONIC SPORTB ATTRACTION',
 'transmission': 'automatic',
 'trim': '1.4 40 TFSI E S TRONIC SPORTB ATTRACTION',
 'vin': None,
 'year': 2023}
2026-03-26 22:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985508%27 HTTP/1.1" 200 None
2026-03-26 22:53:35 [ayvens.be] INFO: Saving data for 1985508: {'created_time': 1774565615.129712, 'last_price_update_time': 1774565615.129721, 'auction_closing_time': 1774958400.0}
2026-03-26 22:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985508') HTTP/1.1" 204 0
2026-03-26 22:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F6b0a0e99cb2d46febcc2905bed057a6e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/6b0a0e99cb2d46febcc2905bed057a6e/images/large/4.jpg not downloaded yet
2026-03-26 22:53:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/97f8337acc494d6eba6aa113f6abecbb/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76c6690>
2026-03-26 22:53:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29499b34-8810-5b04-b474-a1d89d7eac20/29499b34-8810-5b04-b474-a1d89d7eac20_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F97f8337acc494d6eba6aa113f6abecbb%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/97f8337acc494d6eba6aa113f6abecbb/images/large/5.jpg saved to cache
2026-03-26 22:53:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 29499b34-8810-5b04-b474-a1d89d7eac20
2026-03-26 22:53:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7443bd0>
2026-03-26 22:53:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29499b34-8810-5b04-b474-a1d89d7eac20/29499b34-8810-5b04-b474-a1d89d7eac20_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F97f8337acc494d6eba6aa113f6abecbb%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/97f8337acc494d6eba6aa113f6abecbb/images/large/6.jpg saved to cache
2026-03-26 22:53:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 29499b34-8810-5b04-b474-a1d89d7eac20
2026-03-26 22:53:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79a5d90>
2026-03-26 22:53:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29499b34-8810-5b04-b474-a1d89d7eac20/29499b34-8810-5b04-b474-a1d89d7eac20_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F97f8337acc494d6eba6aa113f6abecbb%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/97f8337acc494d6eba6aa113f6abecbb/images/large/4.jpg saved to cache
2026-03-26 22:53:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 29499b34-8810-5b04-b474-a1d89d7eac20
2026-03-26 22:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F6b0a0e99cb2d46febcc2905bed057a6e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/6b0a0e99cb2d46febcc2905bed057a6e/images/large/5.jpg not downloaded yet
2026-03-26 22:53:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77e9c90>
2026-03-26 22:53:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29499b34-8810-5b04-b474-a1d89d7eac20/29499b34-8810-5b04-b474-a1d89d7eac20_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F97f8337acc494d6eba6aa113f6abecbb%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/97f8337acc494d6eba6aa113f6abecbb/images/large/8.jpg saved to cache
2026-03-26 22:53:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 29499b34-8810-5b04-b474-a1d89d7eac20
2026-03-26 22:53:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7a82ed0>
2026-03-26 22:53:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29499b34-8810-5b04-b474-a1d89d7eac20/29499b34-8810-5b04-b474-a1d89d7eac20_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F97f8337acc494d6eba6aa113f6abecbb%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/97f8337acc494d6eba6aa113f6abecbb/images/large/7.jpg saved to cache
2026-03-26 22:53:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 29499b34-8810-5b04-b474-a1d89d7eac20
2026-03-26 22:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F6b0a0e99cb2d46febcc2905bed057a6e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/6b0a0e99cb2d46febcc2905bed057a6e/images/large/6.jpg not downloaded yet
2026-03-26 22:53:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74b7ad0>
2026-03-26 22:53:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29499b34-8810-5b04-b474-a1d89d7eac20/29499b34-8810-5b04-b474-a1d89d7eac20_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F97f8337acc494d6eba6aa113f6abecbb%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/97f8337acc494d6eba6aa113f6abecbb/images/large/9.jpg saved to cache
2026-03-26 22:53:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 29499b34-8810-5b04-b474-a1d89d7eac20
2026-03-26 22:53:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/97f8337acc494d6eba6aa113f6abecbb/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F6b0a0e99cb2d46febcc2905bed057a6e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/6b0a0e99cb2d46febcc2905bed057a6e/images/large/7.jpg not downloaded yet
2026-03-26 22:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F6b0a0e99cb2d46febcc2905bed057a6e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/6b0a0e99cb2d46febcc2905bed057a6e/images/large/8.jpg not downloaded yet
2026-03-26 22:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F6b0a0e99cb2d46febcc2905bed057a6e%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/6b0a0e99cb2d46febcc2905bed057a6e/images/large/9.jpg not downloaded yet
2026-03-26 22:53:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/6b0a0e99cb2d46febcc2905bed057a6e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F6b0a0e99cb2d46febcc2905bed057a6e%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/6b0a0e99cb2d46febcc2905bed057a6e/images/large/10.jpg not downloaded yet
2026-03-26 22:53:35 [ayvens.be] INFO: Found listing with ID: 1985511
2026-03-26 22:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985511%27 HTTP/1.1" 200 None
2026-03-26 22:53:35 [ayvens.be] INFO: Scrape type for 1985511: 1
2026-03-26 22:53:35 [ayvens.be] INFO: Extracting data for car ID: 1985511
2026-03-26 22:53:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d63b12f7-960e-590b-8366-26d681e2e784 with identifier: 1985511
2026-03-26 22:53:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d63b12f7-960e-590b-8366-26d681e2e784 with scrape type 1
2026-03-26 22:53:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d63b12f7-960e-590b-8366-26d681e2e784
2026-03-26 22:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252Fb6ad09418a1f464c9a9233e9934a93bf%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/b6ad09418a1f464c9a9233e9934a93bf/images/large/1.jpg not downloaded yet
2026-03-26 22:53:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/6b0a0e99cb2d46febcc2905bed057a6e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/6b0a0e99cb2d46febcc2905bed057a6e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252Fb6ad09418a1f464c9a9233e9934a93bf%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/b6ad09418a1f464c9a9233e9934a93bf/images/large/2.jpg not downloaded yet
2026-03-26 22:53:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/6b0a0e99cb2d46febcc2905bed057a6e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252Fb6ad09418a1f464c9a9233e9934a93bf%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/b6ad09418a1f464c9a9233e9934a93bf/images/large/3.jpg not downloaded yet
2026-03-26 22:53:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7570910>
2026-03-26 22:53:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29499b34-8810-5b04-b474-a1d89d7eac20/29499b34-8810-5b04-b474-a1d89d7eac20_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F97f8337acc494d6eba6aa113f6abecbb%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/97f8337acc494d6eba6aa113f6abecbb/images/large/10.jpg saved to cache
2026-03-26 22:53:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 29499b34-8810-5b04-b474-a1d89d7eac20
2026-03-26 22:53:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 29499b34-8810-5b04-b474-a1d89d7eac20, skipping ID generation
2026-03-26 22:53:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29499b34-8810-5b04-b474-a1d89d7eac20 with scrape type 1
2026-03-26 22:53:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 29499b34-8810-5b04-b474-a1d89d7eac20 sending to next pipeline
2026-03-26 22:53:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 29499b34-8810-5b04-b474-a1d89d7eac20, identifier: 1985509
2026-03-26 22:53:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7304610>
2026-03-26 22:53:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b45ee0fe-0bda-5382-a96b-95465e7f768d/b45ee0fe-0bda-5382-a96b-95465e7f768d_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F6b0a0e99cb2d46febcc2905bed057a6e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/6b0a0e99cb2d46febcc2905bed057a6e/images/large/1.jpg saved to cache
2026-03-26 22:53:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b45ee0fe-0bda-5382-a96b-95465e7f768d
2026-03-26 22:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252Fb6ad09418a1f464c9a9233e9934a93bf%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/b6ad09418a1f464c9a9233e9934a93bf/images/large/4.jpg not downloaded yet
2026-03-26 22:53:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 29499b34-8810-5b04-b474-a1d89d7eac20 with identifier: 1985509
2026-03-26 22:53:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 29499b34-8810-5b04-b474-a1d89d7eac20 with identifier: 1985509
2026-03-26 22:53:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 29499b34-8810-5b04-b474-a1d89d7eac20 with identifier: 1985509 to the API
2026-03-26 22:53:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:53:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:53:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bp/97f8337acc494d6eba6aa113f6abecbb/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '29499b34-8810-5b04-b474-a1d89d7eac20',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLB',
 'odometer': 163279,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29499b34-8810-5b04-b474-a1d89d7eac20/29499b34-8810-5b04-b474-a1d89d7eac20_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 440638,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/97f8337acc494d6eba6aa113f6abecbb/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29499b34-8810-5b04-b474-a1d89d7eac20/29499b34-8810-5b04-b474-a1d89d7eac20_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 465966,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/97f8337acc494d6eba6aa113f6abecbb/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29499b34-8810-5b04-b474-a1d89d7eac20/29499b34-8810-5b04-b474-a1d89d7eac20_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 481355,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/97f8337acc494d6eba6aa113f6abecbb/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29499b34-8810-5b04-b474-a1d89d7eac20/29499b34-8810-5b04-b474-a1d89d7eac20_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 501481,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/97f8337acc494d6eba6aa113f6abecbb/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29499b34-8810-5b04-b474-a1d89d7eac20/29499b34-8810-5b04-b474-a1d89d7eac20_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 341499,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/97f8337acc494d6eba6aa113f6abecbb/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29499b34-8810-5b04-b474-a1d89d7eac20/29499b34-8810-5b04-b474-a1d89d7eac20_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 380106,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/97f8337acc494d6eba6aa113f6abecbb/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29499b34-8810-5b04-b474-a1d89d7eac20/29499b34-8810-5b04-b474-a1d89d7eac20_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 336343,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/97f8337acc494d6eba6aa113f6abecbb/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29499b34-8810-5b04-b474-a1d89d7eac20/29499b34-8810-5b04-b474-a1d89d7eac20_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 381283,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/97f8337acc494d6eba6aa113f6abecbb/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29499b34-8810-5b04-b474-a1d89d7eac20/29499b34-8810-5b04-b474-a1d89d7eac20_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 365256,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/97f8337acc494d6eba6aa113f6abecbb/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29499b34-8810-5b04-b474-a1d89d7eac20/29499b34-8810-5b04-b474-a1d89d7eac20_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 425715,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/97f8337acc494d6eba6aa113f6abecbb/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLB 2.0 GLB 200 D BUSINESS SOLUTION',
 'transmission': 'automatic',
 'trim': '2.0 GLB 200 D BUSINESS SOLUTION',
 'vin': None,
 'year': 2022}
2026-03-26 22:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985509%27 HTTP/1.1" 200 None
2026-03-26 22:53:36 [ayvens.be] INFO: Saving data for 1985509: {'created_time': 1774565616.489736, 'last_price_update_time': 1774565616.489745, 'auction_closing_time': 1774958400.0}
2026-03-26 22:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985509') HTTP/1.1" 204 0
2026-03-26 22:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252Fb6ad09418a1f464c9a9233e9934a93bf%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/b6ad09418a1f464c9a9233e9934a93bf/images/large/5.jpg not downloaded yet
2026-03-26 22:53:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79a6890>
2026-03-26 22:53:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b45ee0fe-0bda-5382-a96b-95465e7f768d/b45ee0fe-0bda-5382-a96b-95465e7f768d_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F6b0a0e99cb2d46febcc2905bed057a6e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/6b0a0e99cb2d46febcc2905bed057a6e/images/large/2.jpg saved to cache
2026-03-26 22:53:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b45ee0fe-0bda-5382-a96b-95465e7f768d
2026-03-26 22:53:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7427250>
2026-03-26 22:53:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b45ee0fe-0bda-5382-a96b-95465e7f768d/b45ee0fe-0bda-5382-a96b-95465e7f768d_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F6b0a0e99cb2d46febcc2905bed057a6e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/6b0a0e99cb2d46febcc2905bed057a6e/images/large/3.jpg saved to cache
2026-03-26 22:53:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b45ee0fe-0bda-5382-a96b-95465e7f768d
2026-03-26 22:53:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cbc810>
2026-03-26 22:53:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b45ee0fe-0bda-5382-a96b-95465e7f768d/b45ee0fe-0bda-5382-a96b-95465e7f768d_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F6b0a0e99cb2d46febcc2905bed057a6e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/6b0a0e99cb2d46febcc2905bed057a6e/images/large/4.jpg saved to cache
2026-03-26 22:53:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b45ee0fe-0bda-5382-a96b-95465e7f768d
2026-03-26 22:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252Fb6ad09418a1f464c9a9233e9934a93bf%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/b6ad09418a1f464c9a9233e9934a93bf/images/large/6.jpg not downloaded yet
2026-03-26 22:53:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/b6ad09418a1f464c9a9233e9934a93bf/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252Fb6ad09418a1f464c9a9233e9934a93bf%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/b6ad09418a1f464c9a9233e9934a93bf/images/large/7.jpg not downloaded yet
2026-03-26 22:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252Fb6ad09418a1f464c9a9233e9934a93bf%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/b6ad09418a1f464c9a9233e9934a93bf/images/large/8.jpg not downloaded yet
2026-03-26 22:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252Fb6ad09418a1f464c9a9233e9934a93bf%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/b6ad09418a1f464c9a9233e9934a93bf/images/large/9.jpg not downloaded yet
2026-03-26 22:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252Fb6ad09418a1f464c9a9233e9934a93bf%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/b6ad09418a1f464c9a9233e9934a93bf/images/large/10.jpg not downloaded yet
2026-03-26 22:53:36 [ayvens.be] INFO: Found listing with ID: 1985512
2026-03-26 22:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985512%27 HTTP/1.1" 200 None
2026-03-26 22:53:37 [ayvens.be] INFO: Scrape type for 1985512: 1
2026-03-26 22:53:37 [ayvens.be] INFO: Extracting data for car ID: 1985512
2026-03-26 22:53:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5542c022-0c6f-5d44-8629-abc499f014b9 with identifier: 1985512
2026-03-26 22:53:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5542c022-0c6f-5d44-8629-abc499f014b9 with scrape type 1
2026-03-26 22:53:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5542c022-0c6f-5d44-8629-abc499f014b9
2026-03-26 22:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F0387e2df02dc45589e890a6238a46318%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/0387e2df02dc45589e890a6238a46318/images/large/1.jpg not downloaded yet
2026-03-26 22:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F0387e2df02dc45589e890a6238a46318%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/0387e2df02dc45589e890a6238a46318/images/large/2.jpg not downloaded yet
2026-03-26 22:53:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b792fbd0>
2026-03-26 22:53:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d63b12f7-960e-590b-8366-26d681e2e784/d63b12f7-960e-590b-8366-26d681e2e784_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252Fb6ad09418a1f464c9a9233e9934a93bf%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/b6ad09418a1f464c9a9233e9934a93bf/images/large/2.jpg saved to cache
2026-03-26 22:53:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d63b12f7-960e-590b-8366-26d681e2e784
2026-03-26 22:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F0387e2df02dc45589e890a6238a46318%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/0387e2df02dc45589e890a6238a46318/images/large/3.jpg not downloaded yet
2026-03-26 22:53:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/b6ad09418a1f464c9a9233e9934a93bf/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F0387e2df02dc45589e890a6238a46318%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/0387e2df02dc45589e890a6238a46318/images/large/4.jpg not downloaded yet
2026-03-26 22:53:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/b6ad09418a1f464c9a9233e9934a93bf/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F0387e2df02dc45589e890a6238a46318%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/0387e2df02dc45589e890a6238a46318/images/large/5.jpg not downloaded yet
2026-03-26 22:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F0387e2df02dc45589e890a6238a46318%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/0387e2df02dc45589e890a6238a46318/images/large/6.jpg not downloaded yet
2026-03-26 22:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F0387e2df02dc45589e890a6238a46318%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/0387e2df02dc45589e890a6238a46318/images/large/7.jpg not downloaded yet
2026-03-26 22:53:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/6b0a0e99cb2d46febcc2905bed057a6e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/6b0a0e99cb2d46febcc2905bed057a6e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/6b0a0e99cb2d46febcc2905bed057a6e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F0387e2df02dc45589e890a6238a46318%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/0387e2df02dc45589e890a6238a46318/images/large/8.jpg not downloaded yet
2026-03-26 22:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F0387e2df02dc45589e890a6238a46318%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/0387e2df02dc45589e890a6238a46318/images/large/9.jpg not downloaded yet
2026-03-26 22:53:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/6b0a0e99cb2d46febcc2905bed057a6e/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F0387e2df02dc45589e890a6238a46318%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/0387e2df02dc45589e890a6238a46318/images/large/10.jpg not downloaded yet
2026-03-26 22:53:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/6b0a0e99cb2d46febcc2905bed057a6e/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74b4590>
2026-03-26 22:53:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d63b12f7-960e-590b-8366-26d681e2e784/d63b12f7-960e-590b-8366-26d681e2e784_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252Fb6ad09418a1f464c9a9233e9934a93bf%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/b6ad09418a1f464c9a9233e9934a93bf/images/large/3.jpg saved to cache
2026-03-26 22:53:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d63b12f7-960e-590b-8366-26d681e2e784
2026-03-26 22:53:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/b6ad09418a1f464c9a9233e9934a93bf/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:37 [ayvens.be] INFO: Found listing with ID: 1985513
2026-03-26 22:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985513%27 HTTP/1.1" 200 None
2026-03-26 22:53:37 [ayvens.be] INFO: Scrape type for 1985513: 1
2026-03-26 22:53:37 [ayvens.be] INFO: Extracting data for car ID: 1985513
2026-03-26 22:53:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54d369e5-2928-5f10-b01e-b85ea21d67cf with identifier: 1985513
2026-03-26 22:53:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54d369e5-2928-5f10-b01e-b85ea21d67cf with scrape type 1
2026-03-26 22:53:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 54d369e5-2928-5f10-b01e-b85ea21d67cf
2026-03-26 22:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vb%252Ff69f295a626043afbccfe7e3957f3e46%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vb/f69f295a626043afbccfe7e3957f3e46/images/large/1.jpg not downloaded yet
2026-03-26 22:53:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b72fd910>
2026-03-26 22:53:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d63b12f7-960e-590b-8366-26d681e2e784/d63b12f7-960e-590b-8366-26d681e2e784_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252Fb6ad09418a1f464c9a9233e9934a93bf%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/b6ad09418a1f464c9a9233e9934a93bf/images/large/1.jpg saved to cache
2026-03-26 22:53:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d63b12f7-960e-590b-8366-26d681e2e784
2026-03-26 22:53:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/b6ad09418a1f464c9a9233e9934a93bf/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vb%252Ff69f295a626043afbccfe7e3957f3e46%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vb/f69f295a626043afbccfe7e3957f3e46/images/large/2.jpg not downloaded yet
2026-03-26 22:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vb%252Ff69f295a626043afbccfe7e3957f3e46%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vb/f69f295a626043afbccfe7e3957f3e46/images/large/3.jpg not downloaded yet
2026-03-26 22:53:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74aeb10>
2026-03-26 22:53:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b45ee0fe-0bda-5382-a96b-95465e7f768d/b45ee0fe-0bda-5382-a96b-95465e7f768d_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F6b0a0e99cb2d46febcc2905bed057a6e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/6b0a0e99cb2d46febcc2905bed057a6e/images/large/6.jpg saved to cache
2026-03-26 22:53:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b45ee0fe-0bda-5382-a96b-95465e7f768d
2026-03-26 22:53:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7584710>
2026-03-26 22:53:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b45ee0fe-0bda-5382-a96b-95465e7f768d/b45ee0fe-0bda-5382-a96b-95465e7f768d_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F6b0a0e99cb2d46febcc2905bed057a6e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/6b0a0e99cb2d46febcc2905bed057a6e/images/large/7.jpg saved to cache
2026-03-26 22:53:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b45ee0fe-0bda-5382-a96b-95465e7f768d
2026-03-26 22:53:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79dc390>
2026-03-26 22:53:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b45ee0fe-0bda-5382-a96b-95465e7f768d/b45ee0fe-0bda-5382-a96b-95465e7f768d_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F6b0a0e99cb2d46febcc2905bed057a6e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/6b0a0e99cb2d46febcc2905bed057a6e/images/large/5.jpg saved to cache
2026-03-26 22:53:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b45ee0fe-0bda-5382-a96b-95465e7f768d
2026-03-26 22:53:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e34790>
2026-03-26 22:53:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b45ee0fe-0bda-5382-a96b-95465e7f768d/b45ee0fe-0bda-5382-a96b-95465e7f768d_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F6b0a0e99cb2d46febcc2905bed057a6e%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/6b0a0e99cb2d46febcc2905bed057a6e/images/large/9.jpg saved to cache
2026-03-26 22:53:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b45ee0fe-0bda-5382-a96b-95465e7f768d
2026-03-26 22:53:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b75727d0>
2026-03-26 22:53:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b45ee0fe-0bda-5382-a96b-95465e7f768d/b45ee0fe-0bda-5382-a96b-95465e7f768d_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F6b0a0e99cb2d46febcc2905bed057a6e%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/6b0a0e99cb2d46febcc2905bed057a6e/images/large/10.jpg saved to cache
2026-03-26 22:53:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b45ee0fe-0bda-5382-a96b-95465e7f768d
2026-03-26 22:53:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7415890>
2026-03-26 22:53:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d63b12f7-960e-590b-8366-26d681e2e784/d63b12f7-960e-590b-8366-26d681e2e784_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252Fb6ad09418a1f464c9a9233e9934a93bf%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/b6ad09418a1f464c9a9233e9934a93bf/images/large/4.jpg saved to cache
2026-03-26 22:53:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d63b12f7-960e-590b-8366-26d681e2e784
2026-03-26 22:53:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/b6ad09418a1f464c9a9233e9934a93bf/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/b6ad09418a1f464c9a9233e9934a93bf/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/b6ad09418a1f464c9a9233e9934a93bf/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vb%252Ff69f295a626043afbccfe7e3957f3e46%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vb/f69f295a626043afbccfe7e3957f3e46/images/large/4.jpg not downloaded yet
2026-03-26 22:53:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/b6ad09418a1f464c9a9233e9934a93bf/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/b6ad09418a1f464c9a9233e9934a93bf/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vb%252Ff69f295a626043afbccfe7e3957f3e46%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vb/f69f295a626043afbccfe7e3957f3e46/images/large/5.jpg not downloaded yet
2026-03-26 22:53:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7408f50>
2026-03-26 22:53:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d63b12f7-960e-590b-8366-26d681e2e784/d63b12f7-960e-590b-8366-26d681e2e784_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252Fb6ad09418a1f464c9a9233e9934a93bf%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/b6ad09418a1f464c9a9233e9934a93bf/images/large/5.jpg saved to cache
2026-03-26 22:53:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d63b12f7-960e-590b-8366-26d681e2e784
2026-03-26 22:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vb%252Ff69f295a626043afbccfe7e3957f3e46%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vb/f69f295a626043afbccfe7e3957f3e46/images/large/6.jpg not downloaded yet
2026-03-26 22:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vb%252Ff69f295a626043afbccfe7e3957f3e46%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vb/f69f295a626043afbccfe7e3957f3e46/images/large/7.jpg not downloaded yet
2026-03-26 22:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vb%252Ff69f295a626043afbccfe7e3957f3e46%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vb/f69f295a626043afbccfe7e3957f3e46/images/large/8.jpg not downloaded yet
2026-03-26 22:53:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7aa1150>
2026-03-26 22:53:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d63b12f7-960e-590b-8366-26d681e2e784/d63b12f7-960e-590b-8366-26d681e2e784_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252Fb6ad09418a1f464c9a9233e9934a93bf%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/b6ad09418a1f464c9a9233e9934a93bf/images/large/7.jpg saved to cache
2026-03-26 22:53:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d63b12f7-960e-590b-8366-26d681e2e784
2026-03-26 22:53:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7aa1190>
2026-03-26 22:53:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d63b12f7-960e-590b-8366-26d681e2e784/d63b12f7-960e-590b-8366-26d681e2e784_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252Fb6ad09418a1f464c9a9233e9934a93bf%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/b6ad09418a1f464c9a9233e9934a93bf/images/large/6.jpg saved to cache
2026-03-26 22:53:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d63b12f7-960e-590b-8366-26d681e2e784
2026-03-26 22:53:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c5d910>
2026-03-26 22:53:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d63b12f7-960e-590b-8366-26d681e2e784/d63b12f7-960e-590b-8366-26d681e2e784_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252Fb6ad09418a1f464c9a9233e9934a93bf%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/b6ad09418a1f464c9a9233e9934a93bf/images/large/8.jpg saved to cache
2026-03-26 22:53:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d63b12f7-960e-590b-8366-26d681e2e784
2026-03-26 22:53:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76c5190>
2026-03-26 22:53:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d63b12f7-960e-590b-8366-26d681e2e784/d63b12f7-960e-590b-8366-26d681e2e784_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252Fb6ad09418a1f464c9a9233e9934a93bf%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/b6ad09418a1f464c9a9233e9934a93bf/images/large/9.jpg saved to cache
2026-03-26 22:53:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d63b12f7-960e-590b-8366-26d681e2e784
2026-03-26 22:53:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b743b710>
2026-03-26 22:53:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d63b12f7-960e-590b-8366-26d681e2e784/d63b12f7-960e-590b-8366-26d681e2e784_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252Fb6ad09418a1f464c9a9233e9934a93bf%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/b6ad09418a1f464c9a9233e9934a93bf/images/large/10.jpg saved to cache
2026-03-26 22:53:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d63b12f7-960e-590b-8366-26d681e2e784
2026-03-26 22:53:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d63b12f7-960e-590b-8366-26d681e2e784, skipping ID generation
2026-03-26 22:53:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d63b12f7-960e-590b-8366-26d681e2e784 with scrape type 1
2026-03-26 22:53:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d63b12f7-960e-590b-8366-26d681e2e784 sending to next pipeline
2026-03-26 22:53:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d63b12f7-960e-590b-8366-26d681e2e784, identifier: 1985511
2026-03-26 22:53:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/6b0a0e99cb2d46febcc2905bed057a6e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/0387e2df02dc45589e890a6238a46318/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/0387e2df02dc45589e890a6238a46318/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d63b12f7-960e-590b-8366-26d681e2e784 with identifier: 1985511
2026-03-26 22:53:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d63b12f7-960e-590b-8366-26d681e2e784 with identifier: 1985511
2026-03-26 22:53:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d63b12f7-960e-590b-8366-26d681e2e784 with identifier: 1985511 to the API
2026-03-26 22:53:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:53:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:53:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yp/b6ad09418a1f464c9a9233e9934a93bf/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 36,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'd63b12f7-960e-590b-8366-26d681e2e784',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'C5 AIRCROSS',
 'odometer': 68337,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d63b12f7-960e-590b-8366-26d681e2e784/d63b12f7-960e-590b-8366-26d681e2e784_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 236675,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/b6ad09418a1f464c9a9233e9934a93bf/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d63b12f7-960e-590b-8366-26d681e2e784/d63b12f7-960e-590b-8366-26d681e2e784_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 254389,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/b6ad09418a1f464c9a9233e9934a93bf/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d63b12f7-960e-590b-8366-26d681e2e784/d63b12f7-960e-590b-8366-26d681e2e784_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 268486,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/b6ad09418a1f464c9a9233e9934a93bf/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d63b12f7-960e-590b-8366-26d681e2e784/d63b12f7-960e-590b-8366-26d681e2e784_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 277235,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/b6ad09418a1f464c9a9233e9934a93bf/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d63b12f7-960e-590b-8366-26d681e2e784/d63b12f7-960e-590b-8366-26d681e2e784_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 315996,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/b6ad09418a1f464c9a9233e9934a93bf/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d63b12f7-960e-590b-8366-26d681e2e784/d63b12f7-960e-590b-8366-26d681e2e784_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 296960,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/b6ad09418a1f464c9a9233e9934a93bf/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d63b12f7-960e-590b-8366-26d681e2e784/d63b12f7-960e-590b-8366-26d681e2e784_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 331610,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/b6ad09418a1f464c9a9233e9934a93bf/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d63b12f7-960e-590b-8366-26d681e2e784/d63b12f7-960e-590b-8366-26d681e2e784_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 260114,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/b6ad09418a1f464c9a9233e9934a93bf/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d63b12f7-960e-590b-8366-26d681e2e784/d63b12f7-960e-590b-8366-26d681e2e784_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 355730,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/b6ad09418a1f464c9a9233e9934a93bf/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d63b12f7-960e-590b-8366-26d681e2e784/d63b12f7-960e-590b-8366-26d681e2e784_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 336320,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/b6ad09418a1f464c9a9233e9934a93bf/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROËN C5 AIRCROSS 1.6 PureTech PHEV Feel S&S',
 'transmission': 'automatic',
 'trim': '1.6 PureTech PHEV Feel S&S',
 'vin': None,
 'year': 2020}
2026-03-26 22:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985511%27 HTTP/1.1" 200 None
2026-03-26 22:53:39 [ayvens.be] INFO: Saving data for 1985511: {'created_time': 1774565619.096805, 'last_price_update_time': 1774565619.096815, 'auction_closing_time': 1774958400.0}
2026-03-26 22:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985511') HTTP/1.1" 204 0
2026-03-26 22:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vb%252Ff69f295a626043afbccfe7e3957f3e46%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vb/f69f295a626043afbccfe7e3957f3e46/images/large/9.jpg not downloaded yet
2026-03-26 22:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vb%252Ff69f295a626043afbccfe7e3957f3e46%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vb/f69f295a626043afbccfe7e3957f3e46/images/large/10.jpg not downloaded yet
2026-03-26 22:53:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6da4e50>
2026-03-26 22:53:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b45ee0fe-0bda-5382-a96b-95465e7f768d/b45ee0fe-0bda-5382-a96b-95465e7f768d_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F6b0a0e99cb2d46febcc2905bed057a6e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/6b0a0e99cb2d46febcc2905bed057a6e/images/large/8.jpg saved to cache
2026-03-26 22:53:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b45ee0fe-0bda-5382-a96b-95465e7f768d
2026-03-26 22:53:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b45ee0fe-0bda-5382-a96b-95465e7f768d, skipping ID generation
2026-03-26 22:53:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b45ee0fe-0bda-5382-a96b-95465e7f768d with scrape type 1
2026-03-26 22:53:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b45ee0fe-0bda-5382-a96b-95465e7f768d sending to next pipeline
2026-03-26 22:53:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b45ee0fe-0bda-5382-a96b-95465e7f768d, identifier: 1985510
2026-03-26 22:53:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6dd8550>
2026-03-26 22:53:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5542c022-0c6f-5d44-8629-abc499f014b9/5542c022-0c6f-5d44-8629-abc499f014b9_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F0387e2df02dc45589e890a6238a46318%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/0387e2df02dc45589e890a6238a46318/images/large/1.jpg saved to cache
2026-03-26 22:53:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5542c022-0c6f-5d44-8629-abc499f014b9
2026-03-26 22:53:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79a2ad0>
2026-03-26 22:53:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5542c022-0c6f-5d44-8629-abc499f014b9/5542c022-0c6f-5d44-8629-abc499f014b9_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F0387e2df02dc45589e890a6238a46318%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/0387e2df02dc45589e890a6238a46318/images/large/3.jpg saved to cache
2026-03-26 22:53:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5542c022-0c6f-5d44-8629-abc499f014b9
2026-03-26 22:53:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/0387e2df02dc45589e890a6238a46318/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:39 [ayvens.be] INFO: Found listing with ID: 1985514
2026-03-26 22:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985514%27 HTTP/1.1" 200 None
2026-03-26 22:53:39 [ayvens.be] INFO: Scrape type for 1985514: 1
2026-03-26 22:53:39 [ayvens.be] INFO: Extracting data for car ID: 1985514
2026-03-26 22:53:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 448cd312-9185-5175-8e3f-fedb4a931e97 with identifier: 1985514
2026-03-26 22:53:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 448cd312-9185-5175-8e3f-fedb4a931e97 with scrape type 1
2026-03-26 22:53:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 448cd312-9185-5175-8e3f-fedb4a931e97
2026-03-26 22:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Fc5ecde8ac7f74136940ee32b477c1c8e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/c5ecde8ac7f74136940ee32b477c1c8e/images/large/1.jpg not downloaded yet
2026-03-26 22:53:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b45ee0fe-0bda-5382-a96b-95465e7f768d with identifier: 1985510
2026-03-26 22:53:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b45ee0fe-0bda-5382-a96b-95465e7f768d with identifier: 1985510
2026-03-26 22:53:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b45ee0fe-0bda-5382-a96b-95465e7f768d with identifier: 1985510 to the API
2026-03-26 22:53:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:53:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:53:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yq/6b0a0e99cb2d46febcc2905bed057a6e/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'b45ee0fe-0bda-5382-a96b-95465e7f768d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'MINI',
 'model': 'MINI COUNTRYMAN - 2017',
 'odometer': 129294,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b45ee0fe-0bda-5382-a96b-95465e7f768d/b45ee0fe-0bda-5382-a96b-95465e7f768d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 755258,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/6b0a0e99cb2d46febcc2905bed057a6e/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b45ee0fe-0bda-5382-a96b-95465e7f768d/b45ee0fe-0bda-5382-a96b-95465e7f768d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 792784,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/6b0a0e99cb2d46febcc2905bed057a6e/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b45ee0fe-0bda-5382-a96b-95465e7f768d/b45ee0fe-0bda-5382-a96b-95465e7f768d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 720862,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/6b0a0e99cb2d46febcc2905bed057a6e/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b45ee0fe-0bda-5382-a96b-95465e7f768d/b45ee0fe-0bda-5382-a96b-95465e7f768d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 773588,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/6b0a0e99cb2d46febcc2905bed057a6e/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b45ee0fe-0bda-5382-a96b-95465e7f768d/b45ee0fe-0bda-5382-a96b-95465e7f768d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 759133,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/6b0a0e99cb2d46febcc2905bed057a6e/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b45ee0fe-0bda-5382-a96b-95465e7f768d/b45ee0fe-0bda-5382-a96b-95465e7f768d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 793796,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/6b0a0e99cb2d46febcc2905bed057a6e/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b45ee0fe-0bda-5382-a96b-95465e7f768d/b45ee0fe-0bda-5382-a96b-95465e7f768d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 631827,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/6b0a0e99cb2d46febcc2905bed057a6e/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b45ee0fe-0bda-5382-a96b-95465e7f768d/b45ee0fe-0bda-5382-a96b-95465e7f768d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 918123,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/6b0a0e99cb2d46febcc2905bed057a6e/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b45ee0fe-0bda-5382-a96b-95465e7f768d/b45ee0fe-0bda-5382-a96b-95465e7f768d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 882935,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/6b0a0e99cb2d46febcc2905bed057a6e/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b45ee0fe-0bda-5382-a96b-95465e7f768d/b45ee0fe-0bda-5382-a96b-95465e7f768d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 869989,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/6b0a0e99cb2d46febcc2905bed057a6e/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI MINI COUNTRYMAN - 2017 1.5A PHEV Cooper SE ALL4 (EU6d-T.)',
 'transmission': 'automatic',
 'trim': '1.5A PHEV Cooper SE ALL4 (EU6d-T.)',
 'vin': None,
 'year': 2020}
2026-03-26 22:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985510%27 HTTP/1.1" 200 None
2026-03-26 22:53:39 [ayvens.be] INFO: Saving data for 1985510: {'created_time': 1774565619.822838, 'last_price_update_time': 1774565619.822848, 'auction_closing_time': 1774958400.0}
2026-03-26 22:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985510') HTTP/1.1" 204 0
2026-03-26 22:53:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/0387e2df02dc45589e890a6238a46318/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Fc5ecde8ac7f74136940ee32b477c1c8e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/c5ecde8ac7f74136940ee32b477c1c8e/images/large/2.jpg not downloaded yet
2026-03-26 22:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Fc5ecde8ac7f74136940ee32b477c1c8e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/c5ecde8ac7f74136940ee32b477c1c8e/images/large/3.jpg not downloaded yet
2026-03-26 22:53:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5ca4ed0>
2026-03-26 22:53:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5542c022-0c6f-5d44-8629-abc499f014b9/5542c022-0c6f-5d44-8629-abc499f014b9_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F0387e2df02dc45589e890a6238a46318%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/0387e2df02dc45589e890a6238a46318/images/large/5.jpg saved to cache
2026-03-26 22:53:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5542c022-0c6f-5d44-8629-abc499f014b9
2026-03-26 22:53:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/0387e2df02dc45589e890a6238a46318/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/0387e2df02dc45589e890a6238a46318/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1vb/f69f295a626043afbccfe7e3957f3e46/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Fc5ecde8ac7f74136940ee32b477c1c8e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/c5ecde8ac7f74136940ee32b477c1c8e/images/large/4.jpg not downloaded yet
2026-03-26 22:53:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/0387e2df02dc45589e890a6238a46318/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Fc5ecde8ac7f74136940ee32b477c1c8e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/c5ecde8ac7f74136940ee32b477c1c8e/images/large/5.jpg not downloaded yet
2026-03-26 22:53:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74a7190>
2026-03-26 22:53:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5542c022-0c6f-5d44-8629-abc499f014b9/5542c022-0c6f-5d44-8629-abc499f014b9_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F0387e2df02dc45589e890a6238a46318%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/0387e2df02dc45589e890a6238a46318/images/large/2.jpg saved to cache
2026-03-26 22:53:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5542c022-0c6f-5d44-8629-abc499f014b9
2026-03-26 22:53:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1vb/f69f295a626043afbccfe7e3957f3e46/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1vb/f69f295a626043afbccfe7e3957f3e46/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Fc5ecde8ac7f74136940ee32b477c1c8e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/c5ecde8ac7f74136940ee32b477c1c8e/images/large/6.jpg not downloaded yet
2026-03-26 22:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Fc5ecde8ac7f74136940ee32b477c1c8e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/c5ecde8ac7f74136940ee32b477c1c8e/images/large/7.jpg not downloaded yet
2026-03-26 22:53:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/0387e2df02dc45589e890a6238a46318/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Fc5ecde8ac7f74136940ee32b477c1c8e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/c5ecde8ac7f74136940ee32b477c1c8e/images/large/8.jpg not downloaded yet
2026-03-26 22:53:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74cc650>
2026-03-26 22:53:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5542c022-0c6f-5d44-8629-abc499f014b9/5542c022-0c6f-5d44-8629-abc499f014b9_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F0387e2df02dc45589e890a6238a46318%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/0387e2df02dc45589e890a6238a46318/images/large/4.jpg saved to cache
2026-03-26 22:53:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5542c022-0c6f-5d44-8629-abc499f014b9
2026-03-26 22:53:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b727e090>
2026-03-26 22:53:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5542c022-0c6f-5d44-8629-abc499f014b9/5542c022-0c6f-5d44-8629-abc499f014b9_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F0387e2df02dc45589e890a6238a46318%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/0387e2df02dc45589e890a6238a46318/images/large/6.jpg saved to cache
2026-03-26 22:53:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5542c022-0c6f-5d44-8629-abc499f014b9
2026-03-26 22:53:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7494ed0>
2026-03-26 22:53:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54d369e5-2928-5f10-b01e-b85ea21d67cf/54d369e5-2928-5f10-b01e-b85ea21d67cf_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vb%252Ff69f295a626043afbccfe7e3957f3e46%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vb/f69f295a626043afbccfe7e3957f3e46/images/large/2.jpg saved to cache
2026-03-26 22:53:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 54d369e5-2928-5f10-b01e-b85ea21d67cf
2026-03-26 22:53:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e15210>
2026-03-26 22:53:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5542c022-0c6f-5d44-8629-abc499f014b9/5542c022-0c6f-5d44-8629-abc499f014b9_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F0387e2df02dc45589e890a6238a46318%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/0387e2df02dc45589e890a6238a46318/images/large/9.jpg saved to cache
2026-03-26 22:53:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5542c022-0c6f-5d44-8629-abc499f014b9
2026-03-26 22:53:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/0387e2df02dc45589e890a6238a46318/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Fc5ecde8ac7f74136940ee32b477c1c8e%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/c5ecde8ac7f74136940ee32b477c1c8e/images/large/9.jpg not downloaded yet
2026-03-26 22:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Fc5ecde8ac7f74136940ee32b477c1c8e%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/c5ecde8ac7f74136940ee32b477c1c8e/images/large/10.jpg not downloaded yet
2026-03-26 22:53:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1vb/f69f295a626043afbccfe7e3957f3e46/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1vb/f69f295a626043afbccfe7e3957f3e46/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74979d0>
2026-03-26 22:53:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54d369e5-2928-5f10-b01e-b85ea21d67cf/54d369e5-2928-5f10-b01e-b85ea21d67cf_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vb%252Ff69f295a626043afbccfe7e3957f3e46%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vb/f69f295a626043afbccfe7e3957f3e46/images/large/3.jpg saved to cache
2026-03-26 22:53:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 54d369e5-2928-5f10-b01e-b85ea21d67cf
2026-03-26 22:53:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7cccdd0>
2026-03-26 22:53:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54d369e5-2928-5f10-b01e-b85ea21d67cf/54d369e5-2928-5f10-b01e-b85ea21d67cf_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vb%252Ff69f295a626043afbccfe7e3957f3e46%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vb/f69f295a626043afbccfe7e3957f3e46/images/large/1.jpg saved to cache
2026-03-26 22:53:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 54d369e5-2928-5f10-b01e-b85ea21d67cf
2026-03-26 22:53:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e29c10>
2026-03-26 22:53:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5542c022-0c6f-5d44-8629-abc499f014b9/5542c022-0c6f-5d44-8629-abc499f014b9_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F0387e2df02dc45589e890a6238a46318%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/0387e2df02dc45589e890a6238a46318/images/large/10.jpg saved to cache
2026-03-26 22:53:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5542c022-0c6f-5d44-8629-abc499f014b9
2026-03-26 22:53:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/0387e2df02dc45589e890a6238a46318/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1vb/f69f295a626043afbccfe7e3957f3e46/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:40 [ayvens.be] INFO: Found listing with ID: 1985515
2026-03-26 22:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985515%27 HTTP/1.1" 200 None
2026-03-26 22:53:40 [ayvens.be] INFO: Scrape type for 1985515: 1
2026-03-26 22:53:40 [ayvens.be] INFO: Extracting data for car ID: 1985515
2026-03-26 22:53:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6e0e20f3-1fe5-520c-9e99-c3c35316cc7a with identifier: 1985515
2026-03-26 22:53:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e0e20f3-1fe5-520c-9e99-c3c35316cc7a with scrape type 1
2026-03-26 22:53:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6e0e20f3-1fe5-520c-9e99-c3c35316cc7a
2026-03-26 22:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F7aa0d8fa70aa472f8662a29e48e5ba30%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/7aa0d8fa70aa472f8662a29e48e5ba30/images/large/1.jpg not downloaded yet
2026-03-26 22:53:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1vb/f69f295a626043afbccfe7e3957f3e46/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1vb/f69f295a626043afbccfe7e3957f3e46/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F7aa0d8fa70aa472f8662a29e48e5ba30%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/7aa0d8fa70aa472f8662a29e48e5ba30/images/large/2.jpg not downloaded yet
2026-03-26 22:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F7aa0d8fa70aa472f8662a29e48e5ba30%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/7aa0d8fa70aa472f8662a29e48e5ba30/images/large/3.jpg not downloaded yet
2026-03-26 22:53:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7ccfb50>
2026-03-26 22:53:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5542c022-0c6f-5d44-8629-abc499f014b9/5542c022-0c6f-5d44-8629-abc499f014b9_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F0387e2df02dc45589e890a6238a46318%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/0387e2df02dc45589e890a6238a46318/images/large/8.jpg saved to cache
2026-03-26 22:53:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5542c022-0c6f-5d44-8629-abc499f014b9
2026-03-26 22:53:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c69c90>
2026-03-26 22:53:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54d369e5-2928-5f10-b01e-b85ea21d67cf/54d369e5-2928-5f10-b01e-b85ea21d67cf_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vb%252Ff69f295a626043afbccfe7e3957f3e46%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vb/f69f295a626043afbccfe7e3957f3e46/images/large/5.jpg saved to cache
2026-03-26 22:53:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 54d369e5-2928-5f10-b01e-b85ea21d67cf
2026-03-26 22:53:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6dd9610>
2026-03-26 22:53:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54d369e5-2928-5f10-b01e-b85ea21d67cf/54d369e5-2928-5f10-b01e-b85ea21d67cf_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vb%252Ff69f295a626043afbccfe7e3957f3e46%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vb/f69f295a626043afbccfe7e3957f3e46/images/large/6.jpg saved to cache
2026-03-26 22:53:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 54d369e5-2928-5f10-b01e-b85ea21d67cf
2026-03-26 22:53:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1vb/f69f295a626043afbccfe7e3957f3e46/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F7aa0d8fa70aa472f8662a29e48e5ba30%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/7aa0d8fa70aa472f8662a29e48e5ba30/images/large/4.jpg not downloaded yet
2026-03-26 22:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F7aa0d8fa70aa472f8662a29e48e5ba30%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/7aa0d8fa70aa472f8662a29e48e5ba30/images/large/5.jpg not downloaded yet
2026-03-26 22:53:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e45250>
2026-03-26 22:53:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5542c022-0c6f-5d44-8629-abc499f014b9/5542c022-0c6f-5d44-8629-abc499f014b9_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F0387e2df02dc45589e890a6238a46318%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/0387e2df02dc45589e890a6238a46318/images/large/7.jpg saved to cache
2026-03-26 22:53:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5542c022-0c6f-5d44-8629-abc499f014b9
2026-03-26 22:53:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5542c022-0c6f-5d44-8629-abc499f014b9, skipping ID generation
2026-03-26 22:53:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5542c022-0c6f-5d44-8629-abc499f014b9 with scrape type 1
2026-03-26 22:53:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5542c022-0c6f-5d44-8629-abc499f014b9 sending to next pipeline
2026-03-26 22:53:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 5542c022-0c6f-5d44-8629-abc499f014b9, identifier: 1985512
2026-03-26 22:53:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b168d0>
2026-03-26 22:53:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54d369e5-2928-5f10-b01e-b85ea21d67cf/54d369e5-2928-5f10-b01e-b85ea21d67cf_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vb%252Ff69f295a626043afbccfe7e3957f3e46%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vb/f69f295a626043afbccfe7e3957f3e46/images/large/4.jpg saved to cache
2026-03-26 22:53:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 54d369e5-2928-5f10-b01e-b85ea21d67cf
2026-03-26 22:53:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6d81750>
2026-03-26 22:53:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54d369e5-2928-5f10-b01e-b85ea21d67cf/54d369e5-2928-5f10-b01e-b85ea21d67cf_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vb%252Ff69f295a626043afbccfe7e3957f3e46%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vb/f69f295a626043afbccfe7e3957f3e46/images/large/8.jpg saved to cache
2026-03-26 22:53:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 54d369e5-2928-5f10-b01e-b85ea21d67cf
2026-03-26 22:53:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7448210>
2026-03-26 22:53:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54d369e5-2928-5f10-b01e-b85ea21d67cf/54d369e5-2928-5f10-b01e-b85ea21d67cf_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vb%252Ff69f295a626043afbccfe7e3957f3e46%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vb/f69f295a626043afbccfe7e3957f3e46/images/large/7.jpg saved to cache
2026-03-26 22:53:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 54d369e5-2928-5f10-b01e-b85ea21d67cf
2026-03-26 22:53:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1vb/f69f295a626043afbccfe7e3957f3e46/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F7aa0d8fa70aa472f8662a29e48e5ba30%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/7aa0d8fa70aa472f8662a29e48e5ba30/images/large/6.jpg not downloaded yet
2026-03-26 22:53:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 5542c022-0c6f-5d44-8629-abc499f014b9 with identifier: 1985512
2026-03-26 22:53:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 5542c022-0c6f-5d44-8629-abc499f014b9 with identifier: 1985512
2026-03-26 22:53:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 5542c022-0c6f-5d44-8629-abc499f014b9 with identifier: 1985512 to the API
2026-03-26 22:53:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:53:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:53:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yv/0387e2df02dc45589e890a6238a46318/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '5542c022-0c6f-5d44-8629-abc499f014b9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 171531,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5542c022-0c6f-5d44-8629-abc499f014b9/5542c022-0c6f-5d44-8629-abc499f014b9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 627652,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/0387e2df02dc45589e890a6238a46318/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5542c022-0c6f-5d44-8629-abc499f014b9/5542c022-0c6f-5d44-8629-abc499f014b9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 658979,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/0387e2df02dc45589e890a6238a46318/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5542c022-0c6f-5d44-8629-abc499f014b9/5542c022-0c6f-5d44-8629-abc499f014b9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 630315,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/0387e2df02dc45589e890a6238a46318/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5542c022-0c6f-5d44-8629-abc499f014b9/5542c022-0c6f-5d44-8629-abc499f014b9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 681667,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/0387e2df02dc45589e890a6238a46318/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5542c022-0c6f-5d44-8629-abc499f014b9/5542c022-0c6f-5d44-8629-abc499f014b9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 632586,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/0387e2df02dc45589e890a6238a46318/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5542c022-0c6f-5d44-8629-abc499f014b9/5542c022-0c6f-5d44-8629-abc499f014b9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 678398,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/0387e2df02dc45589e890a6238a46318/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5542c022-0c6f-5d44-8629-abc499f014b9/5542c022-0c6f-5d44-8629-abc499f014b9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 611283,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/0387e2df02dc45589e890a6238a46318/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5542c022-0c6f-5d44-8629-abc499f014b9/5542c022-0c6f-5d44-8629-abc499f014b9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 923300,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/0387e2df02dc45589e890a6238a46318/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5542c022-0c6f-5d44-8629-abc499f014b9/5542c022-0c6f-5d44-8629-abc499f014b9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 834507,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/0387e2df02dc45589e890a6238a46318/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5542c022-0c6f-5d44-8629-abc499f014b9/5542c022-0c6f-5d44-8629-abc499f014b9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 833062,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/0387e2df02dc45589e890a6238a46318/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T5 RECHARGE GEARTR. INSCRIPTION EXPR',
 'transmission': 'automatic',
 'trim': '1.5 T5 RECHARGE GEARTR. INSCRIPTION EXPR',
 'vin': None,
 'year': 2021}
2026-03-26 22:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985512%27 HTTP/1.1" 200 None
2026-03-26 22:53:41 [ayvens.be] INFO: Saving data for 1985512: {'created_time': 1774565621.991675, 'last_price_update_time': 1774565621.991685, 'auction_closing_time': 1774958400.0}
2026-03-26 22:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985512') HTTP/1.1" 204 0
2026-03-26 22:53:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/c5ecde8ac7f74136940ee32b477c1c8e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F7aa0d8fa70aa472f8662a29e48e5ba30%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/7aa0d8fa70aa472f8662a29e48e5ba30/images/large/7.jpg not downloaded yet
2026-03-26 22:53:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/c5ecde8ac7f74136940ee32b477c1c8e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F7aa0d8fa70aa472f8662a29e48e5ba30%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/7aa0d8fa70aa472f8662a29e48e5ba30/images/large/8.jpg not downloaded yet
2026-03-26 22:53:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e28410>
2026-03-26 22:53:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54d369e5-2928-5f10-b01e-b85ea21d67cf/54d369e5-2928-5f10-b01e-b85ea21d67cf_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vb%252Ff69f295a626043afbccfe7e3957f3e46%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vb/f69f295a626043afbccfe7e3957f3e46/images/large/10.jpg saved to cache
2026-03-26 22:53:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 54d369e5-2928-5f10-b01e-b85ea21d67cf
2026-03-26 22:53:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7400dd0>
2026-03-26 22:53:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54d369e5-2928-5f10-b01e-b85ea21d67cf/54d369e5-2928-5f10-b01e-b85ea21d67cf_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vb%252Ff69f295a626043afbccfe7e3957f3e46%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vb/f69f295a626043afbccfe7e3957f3e46/images/large/9.jpg saved to cache
2026-03-26 22:53:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 54d369e5-2928-5f10-b01e-b85ea21d67cf
2026-03-26 22:53:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 54d369e5-2928-5f10-b01e-b85ea21d67cf, skipping ID generation
2026-03-26 22:53:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54d369e5-2928-5f10-b01e-b85ea21d67cf with scrape type 1
2026-03-26 22:53:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 54d369e5-2928-5f10-b01e-b85ea21d67cf sending to next pipeline
2026-03-26 22:53:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 54d369e5-2928-5f10-b01e-b85ea21d67cf, identifier: 1985513
2026-03-26 22:53:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/c5ecde8ac7f74136940ee32b477c1c8e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 54d369e5-2928-5f10-b01e-b85ea21d67cf with identifier: 1985513
2026-03-26 22:53:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 54d369e5-2928-5f10-b01e-b85ea21d67cf with identifier: 1985513
2026-03-26 22:53:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 54d369e5-2928-5f10-b01e-b85ea21d67cf with identifier: 1985513 to the API
2026-03-26 22:53:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:53:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:53:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1vb/f69f295a626043afbccfe7e3957f3e46/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '54d369e5-2928-5f10-b01e-b85ea21d67cf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT 2T 350M FOU MWB HR DSL',
 'odometer': 112829,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54d369e5-2928-5f10-b01e-b85ea21d67cf/54d369e5-2928-5f10-b01e-b85ea21d67cf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 264503,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1vb/f69f295a626043afbccfe7e3957f3e46/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54d369e5-2928-5f10-b01e-b85ea21d67cf/54d369e5-2928-5f10-b01e-b85ea21d67cf_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 269764,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1vb/f69f295a626043afbccfe7e3957f3e46/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54d369e5-2928-5f10-b01e-b85ea21d67cf/54d369e5-2928-5f10-b01e-b85ea21d67cf_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 289810,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1vb/f69f295a626043afbccfe7e3957f3e46/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54d369e5-2928-5f10-b01e-b85ea21d67cf/54d369e5-2928-5f10-b01e-b85ea21d67cf_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 277006,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1vb/f69f295a626043afbccfe7e3957f3e46/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54d369e5-2928-5f10-b01e-b85ea21d67cf/54d369e5-2928-5f10-b01e-b85ea21d67cf_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 267027,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1vb/f69f295a626043afbccfe7e3957f3e46/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54d369e5-2928-5f10-b01e-b85ea21d67cf/54d369e5-2928-5f10-b01e-b85ea21d67cf_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 257974,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1vb/f69f295a626043afbccfe7e3957f3e46/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54d369e5-2928-5f10-b01e-b85ea21d67cf/54d369e5-2928-5f10-b01e-b85ea21d67cf_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 352161,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1vb/f69f295a626043afbccfe7e3957f3e46/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54d369e5-2928-5f10-b01e-b85ea21d67cf/54d369e5-2928-5f10-b01e-b85ea21d67cf_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 328023,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1vb/f69f295a626043afbccfe7e3957f3e46/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54d369e5-2928-5f10-b01e-b85ea21d67cf/54d369e5-2928-5f10-b01e-b85ea21d67cf_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 323596,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1vb/f69f295a626043afbccfe7e3957f3e46/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54d369e5-2928-5f10-b01e-b85ea21d67cf/54d369e5-2928-5f10-b01e-b85ea21d67cf_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 307985,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1vb/f69f295a626043afbccfe7e3957f3e46/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-17',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FORD TRANSIT 2T 350M FOU MWB HR DSL 2.0 TDCi L2H2 Trend',
 'transmission': 'manual',
 'trim': '2.0 TDCi L2H2 Trend',
 'vin': None,
 'year': 2018}
2026-03-26 22:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985513%27 HTTP/1.1" 200 None
2026-03-26 22:53:42 [ayvens.be] INFO: Saving data for 1985513: {'created_time': 1774565622.573657, 'last_price_update_time': 1774565622.57367, 'auction_closing_time': 1774958400.0}
2026-03-26 22:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985513') HTTP/1.1" 204 0
2026-03-26 22:53:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/c5ecde8ac7f74136940ee32b477c1c8e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/c5ecde8ac7f74136940ee32b477c1c8e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F7aa0d8fa70aa472f8662a29e48e5ba30%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/7aa0d8fa70aa472f8662a29e48e5ba30/images/large/9.jpg not downloaded yet
2026-03-26 22:53:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/c5ecde8ac7f74136940ee32b477c1c8e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F7aa0d8fa70aa472f8662a29e48e5ba30%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/7aa0d8fa70aa472f8662a29e48e5ba30/images/large/10.jpg not downloaded yet
2026-03-26 22:53:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7440390>
2026-03-26 22:53:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_448cd312-9185-5175-8e3f-fedb4a931e97/448cd312-9185-5175-8e3f-fedb4a931e97_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Fc5ecde8ac7f74136940ee32b477c1c8e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/c5ecde8ac7f74136940ee32b477c1c8e/images/large/1.jpg saved to cache
2026-03-26 22:53:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 448cd312-9185-5175-8e3f-fedb4a931e97
2026-03-26 22:53:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b728f450>
2026-03-26 22:53:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_448cd312-9185-5175-8e3f-fedb4a931e97/448cd312-9185-5175-8e3f-fedb4a931e97_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Fc5ecde8ac7f74136940ee32b477c1c8e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/c5ecde8ac7f74136940ee32b477c1c8e/images/large/2.jpg saved to cache
2026-03-26 22:53:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 448cd312-9185-5175-8e3f-fedb4a931e97
2026-03-26 22:53:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e14ad0>
2026-03-26 22:53:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_448cd312-9185-5175-8e3f-fedb4a931e97/448cd312-9185-5175-8e3f-fedb4a931e97_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Fc5ecde8ac7f74136940ee32b477c1c8e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/c5ecde8ac7f74136940ee32b477c1c8e/images/large/5.jpg saved to cache
2026-03-26 22:53:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 448cd312-9185-5175-8e3f-fedb4a931e97
2026-03-26 22:53:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/c5ecde8ac7f74136940ee32b477c1c8e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:42 [ayvens.be] INFO: Found listing with ID: 1985516
2026-03-26 22:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985516%27 HTTP/1.1" 200 None
2026-03-26 22:53:42 [ayvens.be] INFO: Scrape type for 1985516: 1
2026-03-26 22:53:42 [ayvens.be] INFO: Extracting data for car ID: 1985516
2026-03-26 22:53:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 57825218-013e-5654-8146-543c9fee8899 with identifier: 1985516
2026-03-26 22:53:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57825218-013e-5654-8146-543c9fee8899 with scrape type 1
2026-03-26 22:53:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 57825218-013e-5654-8146-543c9fee8899
2026-03-26 22:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fdf60e10f0ee2444d9d543c4ad0d736dd%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/df60e10f0ee2444d9d543c4ad0d736dd/images/large/1.jpg not downloaded yet
2026-03-26 22:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fdf60e10f0ee2444d9d543c4ad0d736dd%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/df60e10f0ee2444d9d543c4ad0d736dd/images/large/2.jpg not downloaded yet
2026-03-26 22:53:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b9ba90>
2026-03-26 22:53:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_448cd312-9185-5175-8e3f-fedb4a931e97/448cd312-9185-5175-8e3f-fedb4a931e97_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Fc5ecde8ac7f74136940ee32b477c1c8e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/c5ecde8ac7f74136940ee32b477c1c8e/images/large/3.jpg saved to cache
2026-03-26 22:53:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 448cd312-9185-5175-8e3f-fedb4a931e97
2026-03-26 22:53:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cb1690>
2026-03-26 22:53:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_448cd312-9185-5175-8e3f-fedb4a931e97/448cd312-9185-5175-8e3f-fedb4a931e97_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Fc5ecde8ac7f74136940ee32b477c1c8e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/c5ecde8ac7f74136940ee32b477c1c8e/images/large/4.jpg saved to cache
2026-03-26 22:53:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 448cd312-9185-5175-8e3f-fedb4a931e97
2026-03-26 22:53:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7435e90>
2026-03-26 22:53:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_448cd312-9185-5175-8e3f-fedb4a931e97/448cd312-9185-5175-8e3f-fedb4a931e97_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Fc5ecde8ac7f74136940ee32b477c1c8e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/c5ecde8ac7f74136940ee32b477c1c8e/images/large/6.jpg saved to cache
2026-03-26 22:53:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 448cd312-9185-5175-8e3f-fedb4a931e97
2026-03-26 22:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fdf60e10f0ee2444d9d543c4ad0d736dd%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/df60e10f0ee2444d9d543c4ad0d736dd/images/large/3.jpg not downloaded yet
2026-03-26 22:53:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7452610>
2026-03-26 22:53:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_448cd312-9185-5175-8e3f-fedb4a931e97/448cd312-9185-5175-8e3f-fedb4a931e97_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Fc5ecde8ac7f74136940ee32b477c1c8e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/c5ecde8ac7f74136940ee32b477c1c8e/images/large/7.jpg saved to cache
2026-03-26 22:53:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 448cd312-9185-5175-8e3f-fedb4a931e97
2026-03-26 22:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fdf60e10f0ee2444d9d543c4ad0d736dd%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/df60e10f0ee2444d9d543c4ad0d736dd/images/large/4.jpg not downloaded yet
2026-03-26 22:53:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/c5ecde8ac7f74136940ee32b477c1c8e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/c5ecde8ac7f74136940ee32b477c1c8e/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/c5ecde8ac7f74136940ee32b477c1c8e/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fdf60e10f0ee2444d9d543c4ad0d736dd%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/df60e10f0ee2444d9d543c4ad0d736dd/images/large/5.jpg not downloaded yet
2026-03-26 22:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fdf60e10f0ee2444d9d543c4ad0d736dd%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/df60e10f0ee2444d9d543c4ad0d736dd/images/large/6.jpg not downloaded yet
2026-03-26 22:53:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/7aa0d8fa70aa472f8662a29e48e5ba30/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/7aa0d8fa70aa472f8662a29e48e5ba30/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/7aa0d8fa70aa472f8662a29e48e5ba30/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/7aa0d8fa70aa472f8662a29e48e5ba30/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fdf60e10f0ee2444d9d543c4ad0d736dd%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/df60e10f0ee2444d9d543c4ad0d736dd/images/large/7.jpg not downloaded yet
2026-03-26 22:53:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/7aa0d8fa70aa472f8662a29e48e5ba30/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fdf60e10f0ee2444d9d543c4ad0d736dd%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/df60e10f0ee2444d9d543c4ad0d736dd/images/large/8.jpg not downloaded yet
2026-03-26 22:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fdf60e10f0ee2444d9d543c4ad0d736dd%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/df60e10f0ee2444d9d543c4ad0d736dd/images/large/9.jpg not downloaded yet
2026-03-26 22:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fdf60e10f0ee2444d9d543c4ad0d736dd%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/df60e10f0ee2444d9d543c4ad0d736dd/images/large/10.jpg not downloaded yet
2026-03-26 22:53:43 [ayvens.be] INFO: Found listing with ID: 1985517
2026-03-26 22:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985517%27 HTTP/1.1" 200 None
2026-03-26 22:53:43 [ayvens.be] INFO: Scrape type for 1985517: 1
2026-03-26 22:53:43 [ayvens.be] INFO: Extracting data for car ID: 1985517
2026-03-26 22:53:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 743ab5aa-3ca7-595a-9611-e0a7ffd4376f with identifier: 1985517
2026-03-26 22:53:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 743ab5aa-3ca7-595a-9611-e0a7ffd4376f with scrape type 1
2026-03-26 22:53:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 743ab5aa-3ca7-595a-9611-e0a7ffd4376f
2026-03-26 22:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2er%252F9d73f7800ab041ab913bf5cdb25e46d0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2er/9d73f7800ab041ab913bf5cdb25e46d0/images/large/1.jpg not downloaded yet
2026-03-26 22:53:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c96c90>
2026-03-26 22:53:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_448cd312-9185-5175-8e3f-fedb4a931e97/448cd312-9185-5175-8e3f-fedb4a931e97_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Fc5ecde8ac7f74136940ee32b477c1c8e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/c5ecde8ac7f74136940ee32b477c1c8e/images/large/8.jpg saved to cache
2026-03-26 22:53:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 448cd312-9185-5175-8e3f-fedb4a931e97
2026-03-26 22:53:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cb37d0>
2026-03-26 22:53:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_448cd312-9185-5175-8e3f-fedb4a931e97/448cd312-9185-5175-8e3f-fedb4a931e97_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Fc5ecde8ac7f74136940ee32b477c1c8e%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/c5ecde8ac7f74136940ee32b477c1c8e/images/large/9.jpg saved to cache
2026-03-26 22:53:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 448cd312-9185-5175-8e3f-fedb4a931e97
2026-03-26 22:53:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b727c550>
2026-03-26 22:53:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_448cd312-9185-5175-8e3f-fedb4a931e97/448cd312-9185-5175-8e3f-fedb4a931e97_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Fc5ecde8ac7f74136940ee32b477c1c8e%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/c5ecde8ac7f74136940ee32b477c1c8e/images/large/10.jpg saved to cache
2026-03-26 22:53:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 448cd312-9185-5175-8e3f-fedb4a931e97
2026-03-26 22:53:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 448cd312-9185-5175-8e3f-fedb4a931e97, skipping ID generation
2026-03-26 22:53:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 448cd312-9185-5175-8e3f-fedb4a931e97 with scrape type 1
2026-03-26 22:53:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 448cd312-9185-5175-8e3f-fedb4a931e97 sending to next pipeline
2026-03-26 22:53:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 448cd312-9185-5175-8e3f-fedb4a931e97, identifier: 1985514
2026-03-26 22:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2er%252F9d73f7800ab041ab913bf5cdb25e46d0%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2er/9d73f7800ab041ab913bf5cdb25e46d0/images/large/2.jpg not downloaded yet
2026-03-26 22:53:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 448cd312-9185-5175-8e3f-fedb4a931e97 with identifier: 1985514
2026-03-26 22:53:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 448cd312-9185-5175-8e3f-fedb4a931e97 with identifier: 1985514
2026-03-26 22:53:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 448cd312-9185-5175-8e3f-fedb4a931e97 with identifier: 1985514 to the API
2026-03-26 22:53:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:53:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:53:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cr/c5ecde8ac7f74136940ee32b477c1c8e/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '448cd312-9185-5175-8e3f-fedb4a931e97',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '1 SERIES HATCH',
 'odometer': 59920,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 20,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_448cd312-9185-5175-8e3f-fedb4a931e97/448cd312-9185-5175-8e3f-fedb4a931e97_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 693021,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/c5ecde8ac7f74136940ee32b477c1c8e/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_448cd312-9185-5175-8e3f-fedb4a931e97/448cd312-9185-5175-8e3f-fedb4a931e97_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 679438,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/c5ecde8ac7f74136940ee32b477c1c8e/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_448cd312-9185-5175-8e3f-fedb4a931e97/448cd312-9185-5175-8e3f-fedb4a931e97_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 688642,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/c5ecde8ac7f74136940ee32b477c1c8e/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_448cd312-9185-5175-8e3f-fedb4a931e97/448cd312-9185-5175-8e3f-fedb4a931e97_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 674290,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/c5ecde8ac7f74136940ee32b477c1c8e/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_448cd312-9185-5175-8e3f-fedb4a931e97/448cd312-9185-5175-8e3f-fedb4a931e97_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 652689,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/c5ecde8ac7f74136940ee32b477c1c8e/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_448cd312-9185-5175-8e3f-fedb4a931e97/448cd312-9185-5175-8e3f-fedb4a931e97_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 751530,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/c5ecde8ac7f74136940ee32b477c1c8e/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_448cd312-9185-5175-8e3f-fedb4a931e97/448cd312-9185-5175-8e3f-fedb4a931e97_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 647302,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/c5ecde8ac7f74136940ee32b477c1c8e/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_448cd312-9185-5175-8e3f-fedb4a931e97/448cd312-9185-5175-8e3f-fedb4a931e97_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 844716,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/c5ecde8ac7f74136940ee32b477c1c8e/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_448cd312-9185-5175-8e3f-fedb4a931e97/448cd312-9185-5175-8e3f-fedb4a931e97_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 831137,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/c5ecde8ac7f74136940ee32b477c1c8e/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_448cd312-9185-5175-8e3f-fedb4a931e97/448cd312-9185-5175-8e3f-fedb4a931e97_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 781736,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/c5ecde8ac7f74136940ee32b477c1c8e/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1 SERIES HATCH 1.5 116D (85KW)',
 'transmission': 'manual',
 'trim': '1.5 116D (85KW)',
 'vin': None,
 'year': 2022}
2026-03-26 22:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985514%27 HTTP/1.1" 200 None
2026-03-26 22:53:44 [ayvens.be] INFO: Saving data for 1985514: {'created_time': 1774565624.317302, 'last_price_update_time': 1774565624.317311, 'auction_closing_time': 1774958400.0}
2026-03-26 22:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985514') HTTP/1.1" 204 0
2026-03-26 22:53:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/df60e10f0ee2444d9d543c4ad0d736dd/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5ccad50>
2026-03-26 22:53:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e0e20f3-1fe5-520c-9e99-c3c35316cc7a/6e0e20f3-1fe5-520c-9e99-c3c35316cc7a_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F7aa0d8fa70aa472f8662a29e48e5ba30%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/7aa0d8fa70aa472f8662a29e48e5ba30/images/large/2.jpg saved to cache
2026-03-26 22:53:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6e0e20f3-1fe5-520c-9e99-c3c35316cc7a
2026-03-26 22:53:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7ccf1d0>
2026-03-26 22:53:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e0e20f3-1fe5-520c-9e99-c3c35316cc7a/6e0e20f3-1fe5-520c-9e99-c3c35316cc7a_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F7aa0d8fa70aa472f8662a29e48e5ba30%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/7aa0d8fa70aa472f8662a29e48e5ba30/images/large/1.jpg saved to cache
2026-03-26 22:53:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6e0e20f3-1fe5-520c-9e99-c3c35316cc7a
2026-03-26 22:53:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e11b10>
2026-03-26 22:53:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e0e20f3-1fe5-520c-9e99-c3c35316cc7a/6e0e20f3-1fe5-520c-9e99-c3c35316cc7a_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F7aa0d8fa70aa472f8662a29e48e5ba30%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/7aa0d8fa70aa472f8662a29e48e5ba30/images/large/3.jpg saved to cache
2026-03-26 22:53:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6e0e20f3-1fe5-520c-9e99-c3c35316cc7a
2026-03-26 22:53:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7910f90>
2026-03-26 22:53:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e0e20f3-1fe5-520c-9e99-c3c35316cc7a/6e0e20f3-1fe5-520c-9e99-c3c35316cc7a_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F7aa0d8fa70aa472f8662a29e48e5ba30%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/7aa0d8fa70aa472f8662a29e48e5ba30/images/large/4.jpg saved to cache
2026-03-26 22:53:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6e0e20f3-1fe5-520c-9e99-c3c35316cc7a
2026-03-26 22:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2er%252F9d73f7800ab041ab913bf5cdb25e46d0%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2er/9d73f7800ab041ab913bf5cdb25e46d0/images/large/3.jpg not downloaded yet
2026-03-26 22:53:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/7aa0d8fa70aa472f8662a29e48e5ba30/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/df60e10f0ee2444d9d543c4ad0d736dd/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2er%252F9d73f7800ab041ab913bf5cdb25e46d0%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2er/9d73f7800ab041ab913bf5cdb25e46d0/images/large/4.jpg not downloaded yet
2026-03-26 22:53:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b78c1bd0>
2026-03-26 22:53:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e0e20f3-1fe5-520c-9e99-c3c35316cc7a/6e0e20f3-1fe5-520c-9e99-c3c35316cc7a_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F7aa0d8fa70aa472f8662a29e48e5ba30%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/7aa0d8fa70aa472f8662a29e48e5ba30/images/large/5.jpg saved to cache
2026-03-26 22:53:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6e0e20f3-1fe5-520c-9e99-c3c35316cc7a
2026-03-26 22:53:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76a5850>
2026-03-26 22:53:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57825218-013e-5654-8146-543c9fee8899/57825218-013e-5654-8146-543c9fee8899_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fdf60e10f0ee2444d9d543c4ad0d736dd%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/df60e10f0ee2444d9d543c4ad0d736dd/images/large/1.jpg saved to cache
2026-03-26 22:53:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 57825218-013e-5654-8146-543c9fee8899
2026-03-26 22:53:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/df60e10f0ee2444d9d543c4ad0d736dd/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2er%252F9d73f7800ab041ab913bf5cdb25e46d0%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2er/9d73f7800ab041ab913bf5cdb25e46d0/images/large/5.jpg not downloaded yet
2026-03-26 22:53:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/7aa0d8fa70aa472f8662a29e48e5ba30/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2er%252F9d73f7800ab041ab913bf5cdb25e46d0%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2er/9d73f7800ab041ab913bf5cdb25e46d0/images/large/6.jpg not downloaded yet
2026-03-26 22:53:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/7aa0d8fa70aa472f8662a29e48e5ba30/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74bf410>
2026-03-26 22:53:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e0e20f3-1fe5-520c-9e99-c3c35316cc7a/6e0e20f3-1fe5-520c-9e99-c3c35316cc7a_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F7aa0d8fa70aa472f8662a29e48e5ba30%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/7aa0d8fa70aa472f8662a29e48e5ba30/images/large/8.jpg saved to cache
2026-03-26 22:53:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6e0e20f3-1fe5-520c-9e99-c3c35316cc7a
2026-03-26 22:53:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7290110>
2026-03-26 22:53:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57825218-013e-5654-8146-543c9fee8899/57825218-013e-5654-8146-543c9fee8899_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fdf60e10f0ee2444d9d543c4ad0d736dd%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/df60e10f0ee2444d9d543c4ad0d736dd/images/large/2.jpg saved to cache
2026-03-26 22:53:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 57825218-013e-5654-8146-543c9fee8899
2026-03-26 22:53:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/df60e10f0ee2444d9d543c4ad0d736dd/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2er%252F9d73f7800ab041ab913bf5cdb25e46d0%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2er/9d73f7800ab041ab913bf5cdb25e46d0/images/large/7.jpg not downloaded yet
2026-03-26 22:53:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/7aa0d8fa70aa472f8662a29e48e5ba30/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/7aa0d8fa70aa472f8662a29e48e5ba30/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2er%252F9d73f7800ab041ab913bf5cdb25e46d0%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2er/9d73f7800ab041ab913bf5cdb25e46d0/images/large/8.jpg not downloaded yet
2026-03-26 22:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2er%252F9d73f7800ab041ab913bf5cdb25e46d0%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2er/9d73f7800ab041ab913bf5cdb25e46d0/images/large/9.jpg not downloaded yet
2026-03-26 22:53:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c5e310>
2026-03-26 22:53:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57825218-013e-5654-8146-543c9fee8899/57825218-013e-5654-8146-543c9fee8899_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fdf60e10f0ee2444d9d543c4ad0d736dd%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/df60e10f0ee2444d9d543c4ad0d736dd/images/large/3.jpg saved to cache
2026-03-26 22:53:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 57825218-013e-5654-8146-543c9fee8899
2026-03-26 22:53:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b745bd10>
2026-03-26 22:53:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e0e20f3-1fe5-520c-9e99-c3c35316cc7a/6e0e20f3-1fe5-520c-9e99-c3c35316cc7a_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F7aa0d8fa70aa472f8662a29e48e5ba30%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/7aa0d8fa70aa472f8662a29e48e5ba30/images/large/7.jpg saved to cache
2026-03-26 22:53:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6e0e20f3-1fe5-520c-9e99-c3c35316cc7a
2026-03-26 22:53:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd5b17d0>
2026-03-26 22:53:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e0e20f3-1fe5-520c-9e99-c3c35316cc7a/6e0e20f3-1fe5-520c-9e99-c3c35316cc7a_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F7aa0d8fa70aa472f8662a29e48e5ba30%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/7aa0d8fa70aa472f8662a29e48e5ba30/images/large/9.jpg saved to cache
2026-03-26 22:53:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6e0e20f3-1fe5-520c-9e99-c3c35316cc7a
2026-03-26 22:53:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/df60e10f0ee2444d9d543c4ad0d736dd/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/df60e10f0ee2444d9d543c4ad0d736dd/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2er%252F9d73f7800ab041ab913bf5cdb25e46d0%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2er/9d73f7800ab041ab913bf5cdb25e46d0/images/large/10.jpg not downloaded yet
2026-03-26 22:53:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2er/9d73f7800ab041ab913bf5cdb25e46d0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2er/9d73f7800ab041ab913bf5cdb25e46d0/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:45 [ayvens.be] INFO: Found listing with ID: 1985518
2026-03-26 22:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985518%27 HTTP/1.1" 200 None
2026-03-26 22:53:45 [ayvens.be] INFO: Scrape type for 1985518: 1
2026-03-26 22:53:45 [ayvens.be] INFO: Extracting data for car ID: 1985518
2026-03-26 22:53:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bdc66ceb-0cf1-570b-bcc5-e95140bdc710 with identifier: 1985518
2026-03-26 22:53:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bdc66ceb-0cf1-570b-bcc5-e95140bdc710 with scrape type 1
2026-03-26 22:53:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bdc66ceb-0cf1-570b-bcc5-e95140bdc710
2026-03-26 22:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F78d8f7f9a307410ab2549796e95af231%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/78d8f7f9a307410ab2549796e95af231/images/large/1.jpg not downloaded yet
2026-03-26 22:53:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7727b90>
2026-03-26 22:53:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57825218-013e-5654-8146-543c9fee8899/57825218-013e-5654-8146-543c9fee8899_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fdf60e10f0ee2444d9d543c4ad0d736dd%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/df60e10f0ee2444d9d543c4ad0d736dd/images/large/4.jpg saved to cache
2026-03-26 22:53:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 57825218-013e-5654-8146-543c9fee8899
2026-03-26 22:53:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77c9f10>
2026-03-26 22:53:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e0e20f3-1fe5-520c-9e99-c3c35316cc7a/6e0e20f3-1fe5-520c-9e99-c3c35316cc7a_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F7aa0d8fa70aa472f8662a29e48e5ba30%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/7aa0d8fa70aa472f8662a29e48e5ba30/images/large/6.jpg saved to cache
2026-03-26 22:53:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6e0e20f3-1fe5-520c-9e99-c3c35316cc7a
2026-03-26 22:53:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cc0a50>
2026-03-26 22:53:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e0e20f3-1fe5-520c-9e99-c3c35316cc7a/6e0e20f3-1fe5-520c-9e99-c3c35316cc7a_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F7aa0d8fa70aa472f8662a29e48e5ba30%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/7aa0d8fa70aa472f8662a29e48e5ba30/images/large/10.jpg saved to cache
2026-03-26 22:53:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6e0e20f3-1fe5-520c-9e99-c3c35316cc7a
2026-03-26 22:53:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6e0e20f3-1fe5-520c-9e99-c3c35316cc7a, skipping ID generation
2026-03-26 22:53:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e0e20f3-1fe5-520c-9e99-c3c35316cc7a with scrape type 1
2026-03-26 22:53:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6e0e20f3-1fe5-520c-9e99-c3c35316cc7a sending to next pipeline
2026-03-26 22:53:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 6e0e20f3-1fe5-520c-9e99-c3c35316cc7a, identifier: 1985515
2026-03-26 22:53:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/df60e10f0ee2444d9d543c4ad0d736dd/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/df60e10f0ee2444d9d543c4ad0d736dd/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F78d8f7f9a307410ab2549796e95af231%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/78d8f7f9a307410ab2549796e95af231/images/large/2.jpg not downloaded yet
2026-03-26 22:53:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 6e0e20f3-1fe5-520c-9e99-c3c35316cc7a with identifier: 1985515
2026-03-26 22:53:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 6e0e20f3-1fe5-520c-9e99-c3c35316cc7a with identifier: 1985515
2026-03-26 22:53:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 6e0e20f3-1fe5-520c-9e99-c3c35316cc7a with identifier: 1985515 to the API
2026-03-26 22:53:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:53:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:53:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yw/7aa0d8fa70aa472f8662a29e48e5ba30/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '6e0e20f3-1fe5-520c-9e99-c3c35316cc7a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TIGUAN ALLSPACE DIESEL',
 'odometer': 125434,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e0e20f3-1fe5-520c-9e99-c3c35316cc7a/6e0e20f3-1fe5-520c-9e99-c3c35316cc7a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 697758,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/7aa0d8fa70aa472f8662a29e48e5ba30/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e0e20f3-1fe5-520c-9e99-c3c35316cc7a/6e0e20f3-1fe5-520c-9e99-c3c35316cc7a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 665048,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/7aa0d8fa70aa472f8662a29e48e5ba30/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e0e20f3-1fe5-520c-9e99-c3c35316cc7a/6e0e20f3-1fe5-520c-9e99-c3c35316cc7a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 704458,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/7aa0d8fa70aa472f8662a29e48e5ba30/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e0e20f3-1fe5-520c-9e99-c3c35316cc7a/6e0e20f3-1fe5-520c-9e99-c3c35316cc7a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 729766,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/7aa0d8fa70aa472f8662a29e48e5ba30/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e0e20f3-1fe5-520c-9e99-c3c35316cc7a/6e0e20f3-1fe5-520c-9e99-c3c35316cc7a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 718940,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/7aa0d8fa70aa472f8662a29e48e5ba30/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e0e20f3-1fe5-520c-9e99-c3c35316cc7a/6e0e20f3-1fe5-520c-9e99-c3c35316cc7a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 713654,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/7aa0d8fa70aa472f8662a29e48e5ba30/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e0e20f3-1fe5-520c-9e99-c3c35316cc7a/6e0e20f3-1fe5-520c-9e99-c3c35316cc7a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 666928,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/7aa0d8fa70aa472f8662a29e48e5ba30/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e0e20f3-1fe5-520c-9e99-c3c35316cc7a/6e0e20f3-1fe5-520c-9e99-c3c35316cc7a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 633164,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/7aa0d8fa70aa472f8662a29e48e5ba30/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e0e20f3-1fe5-520c-9e99-c3c35316cc7a/6e0e20f3-1fe5-520c-9e99-c3c35316cc7a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 735360,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/7aa0d8fa70aa472f8662a29e48e5ba30/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e0e20f3-1fe5-520c-9e99-c3c35316cc7a/6e0e20f3-1fe5-520c-9e99-c3c35316cc7a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 742782,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/7aa0d8fa70aa472f8662a29e48e5ba30/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN TIGUAN ALLSPACE DIESEL 2.0 TDi SCR Comfortline (EU6.2) '
          'Premium Traval',
 'transmission': 'manual',
 'trim': '2.0 TDi SCR Comfortline (EU6.2) Premium Traval',
 'vin': None,
 'year': 2021}
2026-03-26 22:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985515%27 HTTP/1.1" 200 None
2026-03-26 22:53:46 [ayvens.be] INFO: Saving data for 1985515: {'created_time': 1774565626.42731, 'last_price_update_time': 1774565626.42732, 'auction_closing_time': 1774958400.0}
2026-03-26 22:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985515') HTTP/1.1" 204 0
2026-03-26 22:53:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/df60e10f0ee2444d9d543c4ad0d736dd/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/df60e10f0ee2444d9d543c4ad0d736dd/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F78d8f7f9a307410ab2549796e95af231%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/78d8f7f9a307410ab2549796e95af231/images/large/3.jpg not downloaded yet
2026-03-26 22:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F78d8f7f9a307410ab2549796e95af231%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/78d8f7f9a307410ab2549796e95af231/images/large/4.jpg not downloaded yet
2026-03-26 22:53:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5ccb710>
2026-03-26 22:53:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57825218-013e-5654-8146-543c9fee8899/57825218-013e-5654-8146-543c9fee8899_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fdf60e10f0ee2444d9d543c4ad0d736dd%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/df60e10f0ee2444d9d543c4ad0d736dd/images/large/5.jpg saved to cache
2026-03-26 22:53:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 57825218-013e-5654-8146-543c9fee8899
2026-03-26 22:53:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76e3390>
2026-03-26 22:53:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57825218-013e-5654-8146-543c9fee8899/57825218-013e-5654-8146-543c9fee8899_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fdf60e10f0ee2444d9d543c4ad0d736dd%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/df60e10f0ee2444d9d543c4ad0d736dd/images/large/10.jpg saved to cache
2026-03-26 22:53:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 57825218-013e-5654-8146-543c9fee8899
2026-03-26 22:53:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7586410>
2026-03-26 22:53:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_743ab5aa-3ca7-595a-9611-e0a7ffd4376f/743ab5aa-3ca7-595a-9611-e0a7ffd4376f_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2er%252F9d73f7800ab041ab913bf5cdb25e46d0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2er/9d73f7800ab041ab913bf5cdb25e46d0/images/large/1.jpg saved to cache
2026-03-26 22:53:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 743ab5aa-3ca7-595a-9611-e0a7ffd4376f
2026-03-26 22:53:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7450550>
2026-03-26 22:53:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_743ab5aa-3ca7-595a-9611-e0a7ffd4376f/743ab5aa-3ca7-595a-9611-e0a7ffd4376f_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2er%252F9d73f7800ab041ab913bf5cdb25e46d0%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2er/9d73f7800ab041ab913bf5cdb25e46d0/images/large/2.jpg saved to cache
2026-03-26 22:53:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 743ab5aa-3ca7-595a-9611-e0a7ffd4376f
2026-03-26 22:53:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7585f90>
2026-03-26 22:53:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57825218-013e-5654-8146-543c9fee8899/57825218-013e-5654-8146-543c9fee8899_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fdf60e10f0ee2444d9d543c4ad0d736dd%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/df60e10f0ee2444d9d543c4ad0d736dd/images/large/6.jpg saved to cache
2026-03-26 22:53:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 57825218-013e-5654-8146-543c9fee8899
2026-03-26 22:53:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74e4050>
2026-03-26 22:53:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57825218-013e-5654-8146-543c9fee8899/57825218-013e-5654-8146-543c9fee8899_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fdf60e10f0ee2444d9d543c4ad0d736dd%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/df60e10f0ee2444d9d543c4ad0d736dd/images/large/7.jpg saved to cache
2026-03-26 22:53:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 57825218-013e-5654-8146-543c9fee8899
2026-03-26 22:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F78d8f7f9a307410ab2549796e95af231%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/78d8f7f9a307410ab2549796e95af231/images/large/5.jpg not downloaded yet
2026-03-26 22:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F78d8f7f9a307410ab2549796e95af231%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/78d8f7f9a307410ab2549796e95af231/images/large/6.jpg not downloaded yet
2026-03-26 22:53:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2er/9d73f7800ab041ab913bf5cdb25e46d0/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2er/9d73f7800ab041ab913bf5cdb25e46d0/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2er/9d73f7800ab041ab913bf5cdb25e46d0/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b75a5750>
2026-03-26 22:53:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57825218-013e-5654-8146-543c9fee8899/57825218-013e-5654-8146-543c9fee8899_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fdf60e10f0ee2444d9d543c4ad0d736dd%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/df60e10f0ee2444d9d543c4ad0d736dd/images/large/9.jpg saved to cache
2026-03-26 22:53:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 57825218-013e-5654-8146-543c9fee8899
2026-03-26 22:53:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7769c90>
2026-03-26 22:53:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57825218-013e-5654-8146-543c9fee8899/57825218-013e-5654-8146-543c9fee8899_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fdf60e10f0ee2444d9d543c4ad0d736dd%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/df60e10f0ee2444d9d543c4ad0d736dd/images/large/8.jpg saved to cache
2026-03-26 22:53:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 57825218-013e-5654-8146-543c9fee8899
2026-03-26 22:53:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 57825218-013e-5654-8146-543c9fee8899, skipping ID generation
2026-03-26 22:53:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57825218-013e-5654-8146-543c9fee8899 with scrape type 1
2026-03-26 22:53:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 57825218-013e-5654-8146-543c9fee8899 sending to next pipeline
2026-03-26 22:53:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 57825218-013e-5654-8146-543c9fee8899, identifier: 1985516
2026-03-26 22:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F78d8f7f9a307410ab2549796e95af231%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/78d8f7f9a307410ab2549796e95af231/images/large/7.jpg not downloaded yet
2026-03-26 22:53:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 57825218-013e-5654-8146-543c9fee8899 with identifier: 1985516
2026-03-26 22:53:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 57825218-013e-5654-8146-543c9fee8899 with identifier: 1985516
2026-03-26 22:53:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 57825218-013e-5654-8146-543c9fee8899 with identifier: 1985516 to the API
2026-03-26 22:53:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:53:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:53:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bj/df60e10f0ee2444d9d543c4ad0d736dd/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'electric',
 'id': '57825218-013e-5654-8146-543c9fee8899',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'EQA',
 'odometer': 156052,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57825218-013e-5654-8146-543c9fee8899/57825218-013e-5654-8146-543c9fee8899_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 259510,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/df60e10f0ee2444d9d543c4ad0d736dd/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57825218-013e-5654-8146-543c9fee8899/57825218-013e-5654-8146-543c9fee8899_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 254370,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/df60e10f0ee2444d9d543c4ad0d736dd/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57825218-013e-5654-8146-543c9fee8899/57825218-013e-5654-8146-543c9fee8899_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 277618,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/df60e10f0ee2444d9d543c4ad0d736dd/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57825218-013e-5654-8146-543c9fee8899/57825218-013e-5654-8146-543c9fee8899_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 269663,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/df60e10f0ee2444d9d543c4ad0d736dd/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57825218-013e-5654-8146-543c9fee8899/57825218-013e-5654-8146-543c9fee8899_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 290871,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/df60e10f0ee2444d9d543c4ad0d736dd/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57825218-013e-5654-8146-543c9fee8899/57825218-013e-5654-8146-543c9fee8899_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 288411,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/df60e10f0ee2444d9d543c4ad0d736dd/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57825218-013e-5654-8146-543c9fee8899/57825218-013e-5654-8146-543c9fee8899_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 285154,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/df60e10f0ee2444d9d543c4ad0d736dd/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57825218-013e-5654-8146-543c9fee8899/57825218-013e-5654-8146-543c9fee8899_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 387747,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/df60e10f0ee2444d9d543c4ad0d736dd/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57825218-013e-5654-8146-543c9fee8899/57825218-013e-5654-8146-543c9fee8899_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 355331,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/df60e10f0ee2444d9d543c4ad0d736dd/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57825218-013e-5654-8146-543c9fee8899/57825218-013e-5654-8146-543c9fee8899_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 340000,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/df60e10f0ee2444d9d543c4ad0d736dd/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ EQA BEV 67KWH EQA 250 BUSINESS SOLUTION LUX',
 'transmission': 'automatic',
 'trim': 'BEV 67KWH EQA 250 BUSINESS SOLUTION LUX',
 'vin': None,
 'year': 2021}
2026-03-26 22:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985516%27 HTTP/1.1" 200 None
2026-03-26 22:53:47 [ayvens.be] INFO: Saving data for 1985516: {'created_time': 1774565627.617403, 'last_price_update_time': 1774565627.617412, 'auction_closing_time': 1774958400.0}
2026-03-26 22:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985516') HTTP/1.1" 204 0
2026-03-26 22:53:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2er/9d73f7800ab041ab913bf5cdb25e46d0/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F78d8f7f9a307410ab2549796e95af231%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/78d8f7f9a307410ab2549796e95af231/images/large/8.jpg not downloaded yet
2026-03-26 22:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F78d8f7f9a307410ab2549796e95af231%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/78d8f7f9a307410ab2549796e95af231/images/large/9.jpg not downloaded yet
2026-03-26 22:53:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c97f10>
2026-03-26 22:53:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_743ab5aa-3ca7-595a-9611-e0a7ffd4376f/743ab5aa-3ca7-595a-9611-e0a7ffd4376f_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2er%252F9d73f7800ab041ab913bf5cdb25e46d0%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2er/9d73f7800ab041ab913bf5cdb25e46d0/images/large/3.jpg saved to cache
2026-03-26 22:53:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 743ab5aa-3ca7-595a-9611-e0a7ffd4376f
2026-03-26 22:53:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b787c090>
2026-03-26 22:53:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_743ab5aa-3ca7-595a-9611-e0a7ffd4376f/743ab5aa-3ca7-595a-9611-e0a7ffd4376f_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2er%252F9d73f7800ab041ab913bf5cdb25e46d0%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2er/9d73f7800ab041ab913bf5cdb25e46d0/images/large/4.jpg saved to cache
2026-03-26 22:53:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 743ab5aa-3ca7-595a-9611-e0a7ffd4376f
2026-03-26 22:53:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79f3a10>
2026-03-26 22:53:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_743ab5aa-3ca7-595a-9611-e0a7ffd4376f/743ab5aa-3ca7-595a-9611-e0a7ffd4376f_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2er%252F9d73f7800ab041ab913bf5cdb25e46d0%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2er/9d73f7800ab041ab913bf5cdb25e46d0/images/large/5.jpg saved to cache
2026-03-26 22:53:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 743ab5aa-3ca7-595a-9611-e0a7ffd4376f
2026-03-26 22:53:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2er/9d73f7800ab041ab913bf5cdb25e46d0/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F78d8f7f9a307410ab2549796e95af231%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/78d8f7f9a307410ab2549796e95af231/images/large/10.jpg not downloaded yet
2026-03-26 22:53:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/78d8f7f9a307410ab2549796e95af231/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/78d8f7f9a307410ab2549796e95af231/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/78d8f7f9a307410ab2549796e95af231/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:47 [ayvens.be] INFO: Found listing with ID: 1985519
2026-03-26 22:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985519%27 HTTP/1.1" 200 None
2026-03-26 22:53:47 [ayvens.be] INFO: Scrape type for 1985519: 1
2026-03-26 22:53:47 [ayvens.be] INFO: Extracting data for car ID: 1985519
2026-03-26 22:53:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e732670e-563c-5163-874a-0d3d7a0beee3 with identifier: 1985519
2026-03-26 22:53:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e732670e-563c-5163-874a-0d3d7a0beee3 with scrape type 1
2026-03-26 22:53:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e732670e-563c-5163-874a-0d3d7a0beee3
2026-03-26 22:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Fdc28b8b2c5d048e9a644d3f64ffe50e7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/dc28b8b2c5d048e9a644d3f64ffe50e7/images/large/1.jpg not downloaded yet
2026-03-26 22:53:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2er/9d73f7800ab041ab913bf5cdb25e46d0/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2er/9d73f7800ab041ab913bf5cdb25e46d0/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6ddbe90>
2026-03-26 22:53:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_743ab5aa-3ca7-595a-9611-e0a7ffd4376f/743ab5aa-3ca7-595a-9611-e0a7ffd4376f_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2er%252F9d73f7800ab041ab913bf5cdb25e46d0%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2er/9d73f7800ab041ab913bf5cdb25e46d0/images/large/6.jpg saved to cache
2026-03-26 22:53:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 743ab5aa-3ca7-595a-9611-e0a7ffd4376f
2026-03-26 22:53:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2er/9d73f7800ab041ab913bf5cdb25e46d0/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Fdc28b8b2c5d048e9a644d3f64ffe50e7%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/dc28b8b2c5d048e9a644d3f64ffe50e7/images/large/2.jpg not downloaded yet
2026-03-26 22:53:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/78d8f7f9a307410ab2549796e95af231/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Fdc28b8b2c5d048e9a644d3f64ffe50e7%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/dc28b8b2c5d048e9a644d3f64ffe50e7/images/large/3.jpg not downloaded yet
2026-03-26 22:53:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76a7cd0>
2026-03-26 22:53:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_743ab5aa-3ca7-595a-9611-e0a7ffd4376f/743ab5aa-3ca7-595a-9611-e0a7ffd4376f_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2er%252F9d73f7800ab041ab913bf5cdb25e46d0%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2er/9d73f7800ab041ab913bf5cdb25e46d0/images/large/7.jpg saved to cache
2026-03-26 22:53:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 743ab5aa-3ca7-595a-9611-e0a7ffd4376f
2026-03-26 22:53:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77ad690>
2026-03-26 22:53:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdc66ceb-0cf1-570b-bcc5-e95140bdc710/bdc66ceb-0cf1-570b-bcc5-e95140bdc710_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F78d8f7f9a307410ab2549796e95af231%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/78d8f7f9a307410ab2549796e95af231/images/large/1.jpg saved to cache
2026-03-26 22:53:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bdc66ceb-0cf1-570b-bcc5-e95140bdc710
2026-03-26 22:53:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b729ca50>
2026-03-26 22:53:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdc66ceb-0cf1-570b-bcc5-e95140bdc710/bdc66ceb-0cf1-570b-bcc5-e95140bdc710_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F78d8f7f9a307410ab2549796e95af231%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/78d8f7f9a307410ab2549796e95af231/images/large/3.jpg saved to cache
2026-03-26 22:53:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bdc66ceb-0cf1-570b-bcc5-e95140bdc710
2026-03-26 22:53:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77ad890>
2026-03-26 22:53:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdc66ceb-0cf1-570b-bcc5-e95140bdc710/bdc66ceb-0cf1-570b-bcc5-e95140bdc710_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F78d8f7f9a307410ab2549796e95af231%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/78d8f7f9a307410ab2549796e95af231/images/large/2.jpg saved to cache
2026-03-26 22:53:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bdc66ceb-0cf1-570b-bcc5-e95140bdc710
2026-03-26 22:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Fdc28b8b2c5d048e9a644d3f64ffe50e7%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/dc28b8b2c5d048e9a644d3f64ffe50e7/images/large/4.jpg not downloaded yet
2026-03-26 22:53:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b745b350>
2026-03-26 22:53:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_743ab5aa-3ca7-595a-9611-e0a7ffd4376f/743ab5aa-3ca7-595a-9611-e0a7ffd4376f_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2er%252F9d73f7800ab041ab913bf5cdb25e46d0%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2er/9d73f7800ab041ab913bf5cdb25e46d0/images/large/9.jpg saved to cache
2026-03-26 22:53:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 743ab5aa-3ca7-595a-9611-e0a7ffd4376f
2026-03-26 22:53:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7573cd0>
2026-03-26 22:53:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_743ab5aa-3ca7-595a-9611-e0a7ffd4376f/743ab5aa-3ca7-595a-9611-e0a7ffd4376f_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2er%252F9d73f7800ab041ab913bf5cdb25e46d0%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2er/9d73f7800ab041ab913bf5cdb25e46d0/images/large/8.jpg saved to cache
2026-03-26 22:53:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 743ab5aa-3ca7-595a-9611-e0a7ffd4376f
2026-03-26 22:53:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/78d8f7f9a307410ab2549796e95af231/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/78d8f7f9a307410ab2549796e95af231/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Fdc28b8b2c5d048e9a644d3f64ffe50e7%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/dc28b8b2c5d048e9a644d3f64ffe50e7/images/large/5.jpg not downloaded yet
2026-03-26 22:53:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7417190>
2026-03-26 22:53:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_743ab5aa-3ca7-595a-9611-e0a7ffd4376f/743ab5aa-3ca7-595a-9611-e0a7ffd4376f_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2er%252F9d73f7800ab041ab913bf5cdb25e46d0%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2er/9d73f7800ab041ab913bf5cdb25e46d0/images/large/10.jpg saved to cache
2026-03-26 22:53:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 743ab5aa-3ca7-595a-9611-e0a7ffd4376f
2026-03-26 22:53:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 743ab5aa-3ca7-595a-9611-e0a7ffd4376f, skipping ID generation
2026-03-26 22:53:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 743ab5aa-3ca7-595a-9611-e0a7ffd4376f with scrape type 1
2026-03-26 22:53:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 743ab5aa-3ca7-595a-9611-e0a7ffd4376f sending to next pipeline
2026-03-26 22:53:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 743ab5aa-3ca7-595a-9611-e0a7ffd4376f, identifier: 1985517
2026-03-26 22:53:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74e5b10>
2026-03-26 22:53:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdc66ceb-0cf1-570b-bcc5-e95140bdc710/bdc66ceb-0cf1-570b-bcc5-e95140bdc710_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F78d8f7f9a307410ab2549796e95af231%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/78d8f7f9a307410ab2549796e95af231/images/large/4.jpg saved to cache
2026-03-26 22:53:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bdc66ceb-0cf1-570b-bcc5-e95140bdc710
2026-03-26 22:53:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/78d8f7f9a307410ab2549796e95af231/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 743ab5aa-3ca7-595a-9611-e0a7ffd4376f with identifier: 1985517
2026-03-26 22:53:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 743ab5aa-3ca7-595a-9611-e0a7ffd4376f with identifier: 1985517
2026-03-26 22:53:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 743ab5aa-3ca7-595a-9611-e0a7ffd4376f with identifier: 1985517 to the API
2026-03-26 22:53:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:53:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:53:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2er/9d73f7800ab041ab913bf5cdb25e46d0/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 23,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '743ab5aa-3ca7-595a-9611-e0a7ffd4376f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC60',
 'odometer': 115975,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_743ab5aa-3ca7-595a-9611-e0a7ffd4376f/743ab5aa-3ca7-595a-9611-e0a7ffd4376f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 487151,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2er/9d73f7800ab041ab913bf5cdb25e46d0/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_743ab5aa-3ca7-595a-9611-e0a7ffd4376f/743ab5aa-3ca7-595a-9611-e0a7ffd4376f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 487034,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2er/9d73f7800ab041ab913bf5cdb25e46d0/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_743ab5aa-3ca7-595a-9611-e0a7ffd4376f/743ab5aa-3ca7-595a-9611-e0a7ffd4376f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 552743,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2er/9d73f7800ab041ab913bf5cdb25e46d0/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_743ab5aa-3ca7-595a-9611-e0a7ffd4376f/743ab5aa-3ca7-595a-9611-e0a7ffd4376f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 532365,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2er/9d73f7800ab041ab913bf5cdb25e46d0/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_743ab5aa-3ca7-595a-9611-e0a7ffd4376f/743ab5aa-3ca7-595a-9611-e0a7ffd4376f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 508063,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2er/9d73f7800ab041ab913bf5cdb25e46d0/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_743ab5aa-3ca7-595a-9611-e0a7ffd4376f/743ab5aa-3ca7-595a-9611-e0a7ffd4376f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 704653,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2er/9d73f7800ab041ab913bf5cdb25e46d0/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_743ab5aa-3ca7-595a-9611-e0a7ffd4376f/743ab5aa-3ca7-595a-9611-e0a7ffd4376f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 714774,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2er/9d73f7800ab041ab913bf5cdb25e46d0/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_743ab5aa-3ca7-595a-9611-e0a7ffd4376f/743ab5aa-3ca7-595a-9611-e0a7ffd4376f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 851099,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2er/9d73f7800ab041ab913bf5cdb25e46d0/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_743ab5aa-3ca7-595a-9611-e0a7ffd4376f/743ab5aa-3ca7-595a-9611-e0a7ffd4376f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 906392,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2er/9d73f7800ab041ab913bf5cdb25e46d0/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_743ab5aa-3ca7-595a-9611-e0a7ffd4376f/743ab5aa-3ca7-595a-9611-e0a7ffd4376f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 929849,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2er/9d73f7800ab041ab913bf5cdb25e46d0/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-01-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC60 2.0 T6 PHEV CORE AUTO 4WD',
 'transmission': 'automatic',
 'trim': '2.0 T6 PHEV CORE AUTO 4WD',
 'vin': None,
 'year': 2024}
2026-03-26 22:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985517%27 HTTP/1.1" 200 None
2026-03-26 22:53:49 [ayvens.be] INFO: Saving data for 1985517: {'created_time': 1774565629.260327, 'last_price_update_time': 1774565629.260336, 'auction_closing_time': 1774958400.0}
2026-03-26 22:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985517') HTTP/1.1" 204 0
2026-03-26 22:53:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/78d8f7f9a307410ab2549796e95af231/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/78d8f7f9a307410ab2549796e95af231/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Fdc28b8b2c5d048e9a644d3f64ffe50e7%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/dc28b8b2c5d048e9a644d3f64ffe50e7/images/large/6.jpg not downloaded yet
2026-03-26 22:53:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/78d8f7f9a307410ab2549796e95af231/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7a569d0>
2026-03-26 22:53:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdc66ceb-0cf1-570b-bcc5-e95140bdc710/bdc66ceb-0cf1-570b-bcc5-e95140bdc710_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F78d8f7f9a307410ab2549796e95af231%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/78d8f7f9a307410ab2549796e95af231/images/large/5.jpg saved to cache
2026-03-26 22:53:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bdc66ceb-0cf1-570b-bcc5-e95140bdc710
2026-03-26 22:53:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b75a4890>
2026-03-26 22:53:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdc66ceb-0cf1-570b-bcc5-e95140bdc710/bdc66ceb-0cf1-570b-bcc5-e95140bdc710_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F78d8f7f9a307410ab2549796e95af231%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/78d8f7f9a307410ab2549796e95af231/images/large/6.jpg saved to cache
2026-03-26 22:53:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bdc66ceb-0cf1-570b-bcc5-e95140bdc710
2026-03-26 22:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Fdc28b8b2c5d048e9a644d3f64ffe50e7%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/dc28b8b2c5d048e9a644d3f64ffe50e7/images/large/7.jpg not downloaded yet
2026-03-26 22:53:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c5c350>
2026-03-26 22:53:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdc66ceb-0cf1-570b-bcc5-e95140bdc710/bdc66ceb-0cf1-570b-bcc5-e95140bdc710_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F78d8f7f9a307410ab2549796e95af231%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/78d8f7f9a307410ab2549796e95af231/images/large/7.jpg saved to cache
2026-03-26 22:53:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bdc66ceb-0cf1-570b-bcc5-e95140bdc710
2026-03-26 22:53:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e1eb90>
2026-03-26 22:53:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdc66ceb-0cf1-570b-bcc5-e95140bdc710/bdc66ceb-0cf1-570b-bcc5-e95140bdc710_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F78d8f7f9a307410ab2549796e95af231%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/78d8f7f9a307410ab2549796e95af231/images/large/9.jpg saved to cache
2026-03-26 22:53:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bdc66ceb-0cf1-570b-bcc5-e95140bdc710
2026-03-26 22:53:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74b7e50>
2026-03-26 22:53:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdc66ceb-0cf1-570b-bcc5-e95140bdc710/bdc66ceb-0cf1-570b-bcc5-e95140bdc710_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F78d8f7f9a307410ab2549796e95af231%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/78d8f7f9a307410ab2549796e95af231/images/large/10.jpg saved to cache
2026-03-26 22:53:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bdc66ceb-0cf1-570b-bcc5-e95140bdc710
2026-03-26 22:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Fdc28b8b2c5d048e9a644d3f64ffe50e7%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/dc28b8b2c5d048e9a644d3f64ffe50e7/images/large/8.jpg not downloaded yet
2026-03-26 22:53:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79a3310>
2026-03-26 22:53:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdc66ceb-0cf1-570b-bcc5-e95140bdc710/bdc66ceb-0cf1-570b-bcc5-e95140bdc710_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F78d8f7f9a307410ab2549796e95af231%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/78d8f7f9a307410ab2549796e95af231/images/large/8.jpg saved to cache
2026-03-26 22:53:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bdc66ceb-0cf1-570b-bcc5-e95140bdc710
2026-03-26 22:53:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bdc66ceb-0cf1-570b-bcc5-e95140bdc710, skipping ID generation
2026-03-26 22:53:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bdc66ceb-0cf1-570b-bcc5-e95140bdc710 with scrape type 1
2026-03-26 22:53:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bdc66ceb-0cf1-570b-bcc5-e95140bdc710 sending to next pipeline
2026-03-26 22:53:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: bdc66ceb-0cf1-570b-bcc5-e95140bdc710, identifier: 1985518
2026-03-26 22:53:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: bdc66ceb-0cf1-570b-bcc5-e95140bdc710 with identifier: 1985518
2026-03-26 22:53:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: bdc66ceb-0cf1-570b-bcc5-e95140bdc710 with identifier: 1985518
2026-03-26 22:53:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: bdc66ceb-0cf1-570b-bcc5-e95140bdc710 with identifier: 1985518 to the API
2026-03-26 22:53:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:53:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:53:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bh/78d8f7f9a307410ab2549796e95af231/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'bdc66ceb-0cf1-570b-bcc5-e95140bdc710',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 158805,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdc66ceb-0cf1-570b-bcc5-e95140bdc710/bdc66ceb-0cf1-570b-bcc5-e95140bdc710_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 348322,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/78d8f7f9a307410ab2549796e95af231/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdc66ceb-0cf1-570b-bcc5-e95140bdc710/bdc66ceb-0cf1-570b-bcc5-e95140bdc710_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 336598,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/78d8f7f9a307410ab2549796e95af231/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdc66ceb-0cf1-570b-bcc5-e95140bdc710/bdc66ceb-0cf1-570b-bcc5-e95140bdc710_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 345946,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/78d8f7f9a307410ab2549796e95af231/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdc66ceb-0cf1-570b-bcc5-e95140bdc710/bdc66ceb-0cf1-570b-bcc5-e95140bdc710_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 347409,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/78d8f7f9a307410ab2549796e95af231/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdc66ceb-0cf1-570b-bcc5-e95140bdc710/bdc66ceb-0cf1-570b-bcc5-e95140bdc710_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 284142,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/78d8f7f9a307410ab2549796e95af231/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdc66ceb-0cf1-570b-bcc5-e95140bdc710/bdc66ceb-0cf1-570b-bcc5-e95140bdc710_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 285145,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/78d8f7f9a307410ab2549796e95af231/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdc66ceb-0cf1-570b-bcc5-e95140bdc710/bdc66ceb-0cf1-570b-bcc5-e95140bdc710_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 378878,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/78d8f7f9a307410ab2549796e95af231/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdc66ceb-0cf1-570b-bcc5-e95140bdc710/bdc66ceb-0cf1-570b-bcc5-e95140bdc710_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 350253,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/78d8f7f9a307410ab2549796e95af231/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdc66ceb-0cf1-570b-bcc5-e95140bdc710/bdc66ceb-0cf1-570b-bcc5-e95140bdc710_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 297492,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/78d8f7f9a307410ab2549796e95af231/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdc66ceb-0cf1-570b-bcc5-e95140bdc710/bdc66ceb-0cf1-570b-bcc5-e95140bdc710_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 318108,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/78d8f7f9a307410ab2549796e95af231/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 1.5 XDRIVE25E PHEV 162KW)',
 'transmission': 'automatic',
 'trim': '1.5 XDRIVE25E PHEV 162KW)',
 'vin': None,
 'year': 2021}
2026-03-26 22:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985518%27 HTTP/1.1" 200 None
2026-03-26 22:53:50 [ayvens.be] INFO: Saving data for 1985518: {'created_time': 1774565630.412369, 'last_price_update_time': 1774565630.412379, 'auction_closing_time': 1774958400.0}
2026-03-26 22:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985518') HTTP/1.1" 204 0
2026-03-26 22:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Fdc28b8b2c5d048e9a644d3f64ffe50e7%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/dc28b8b2c5d048e9a644d3f64ffe50e7/images/large/9.jpg not downloaded yet
2026-03-26 22:53:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/dc28b8b2c5d048e9a644d3f64ffe50e7/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/dc28b8b2c5d048e9a644d3f64ffe50e7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Fdc28b8b2c5d048e9a644d3f64ffe50e7%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/dc28b8b2c5d048e9a644d3f64ffe50e7/images/large/10.jpg not downloaded yet
2026-03-26 22:53:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/dc28b8b2c5d048e9a644d3f64ffe50e7/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/dc28b8b2c5d048e9a644d3f64ffe50e7/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:50 [ayvens.be] INFO: Found listing with ID: 1985520
2026-03-26 22:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985520%27 HTTP/1.1" 200 None
2026-03-26 22:53:50 [ayvens.be] INFO: Scrape type for 1985520: 1
2026-03-26 22:53:50 [ayvens.be] INFO: Extracting data for car ID: 1985520
2026-03-26 22:53:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1b32218-266b-566a-b43d-7beff4118cd2 with identifier: 1985520
2026-03-26 22:53:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1b32218-266b-566a-b43d-7beff4118cd2 with scrape type 1
2026-03-26 22:53:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d1b32218-266b-566a-b43d-7beff4118cd2
2026-03-26 22:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F93fdb9953cb5408d903ddb627b33e440%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/93fdb9953cb5408d903ddb627b33e440/images/large/1.jpg not downloaded yet
2026-03-26 22:53:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/dc28b8b2c5d048e9a644d3f64ffe50e7/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F93fdb9953cb5408d903ddb627b33e440%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/93fdb9953cb5408d903ddb627b33e440/images/large/2.jpg not downloaded yet
2026-03-26 22:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F93fdb9953cb5408d903ddb627b33e440%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/93fdb9953cb5408d903ddb627b33e440/images/large/3.jpg not downloaded yet
2026-03-26 22:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F93fdb9953cb5408d903ddb627b33e440%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/93fdb9953cb5408d903ddb627b33e440/images/large/4.jpg not downloaded yet
2026-03-26 22:53:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/dc28b8b2c5d048e9a644d3f64ffe50e7/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F93fdb9953cb5408d903ddb627b33e440%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/93fdb9953cb5408d903ddb627b33e440/images/large/5.jpg not downloaded yet
2026-03-26 22:53:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd48f690>
2026-03-26 22:53:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e732670e-563c-5163-874a-0d3d7a0beee3/e732670e-563c-5163-874a-0d3d7a0beee3_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Fdc28b8b2c5d048e9a644d3f64ffe50e7%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/dc28b8b2c5d048e9a644d3f64ffe50e7/images/large/2.jpg saved to cache
2026-03-26 22:53:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e732670e-563c-5163-874a-0d3d7a0beee3
2026-03-26 22:53:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7a62c90>
2026-03-26 22:53:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e732670e-563c-5163-874a-0d3d7a0beee3/e732670e-563c-5163-874a-0d3d7a0beee3_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Fdc28b8b2c5d048e9a644d3f64ffe50e7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/dc28b8b2c5d048e9a644d3f64ffe50e7/images/large/1.jpg saved to cache
2026-03-26 22:53:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e732670e-563c-5163-874a-0d3d7a0beee3
2026-03-26 22:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F93fdb9953cb5408d903ddb627b33e440%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/93fdb9953cb5408d903ddb627b33e440/images/large/6.jpg not downloaded yet
2026-03-26 22:53:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b787e5d0>
2026-03-26 22:53:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e732670e-563c-5163-874a-0d3d7a0beee3/e732670e-563c-5163-874a-0d3d7a0beee3_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Fdc28b8b2c5d048e9a644d3f64ffe50e7%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/dc28b8b2c5d048e9a644d3f64ffe50e7/images/large/3.jpg saved to cache
2026-03-26 22:53:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e732670e-563c-5163-874a-0d3d7a0beee3
2026-03-26 22:53:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b741d610>
2026-03-26 22:53:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e732670e-563c-5163-874a-0d3d7a0beee3/e732670e-563c-5163-874a-0d3d7a0beee3_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Fdc28b8b2c5d048e9a644d3f64ffe50e7%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/dc28b8b2c5d048e9a644d3f64ffe50e7/images/large/4.jpg saved to cache
2026-03-26 22:53:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e732670e-563c-5163-874a-0d3d7a0beee3
2026-03-26 22:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F93fdb9953cb5408d903ddb627b33e440%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/93fdb9953cb5408d903ddb627b33e440/images/large/7.jpg not downloaded yet
2026-03-26 22:53:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/dc28b8b2c5d048e9a644d3f64ffe50e7/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F93fdb9953cb5408d903ddb627b33e440%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/93fdb9953cb5408d903ddb627b33e440/images/large/8.jpg not downloaded yet
2026-03-26 22:53:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c6b410>
2026-03-26 22:53:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e732670e-563c-5163-874a-0d3d7a0beee3/e732670e-563c-5163-874a-0d3d7a0beee3_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Fdc28b8b2c5d048e9a644d3f64ffe50e7%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/dc28b8b2c5d048e9a644d3f64ffe50e7/images/large/5.jpg saved to cache
2026-03-26 22:53:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e732670e-563c-5163-874a-0d3d7a0beee3
2026-03-26 22:53:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79f2b50>
2026-03-26 22:53:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e732670e-563c-5163-874a-0d3d7a0beee3/e732670e-563c-5163-874a-0d3d7a0beee3_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Fdc28b8b2c5d048e9a644d3f64ffe50e7%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/dc28b8b2c5d048e9a644d3f64ffe50e7/images/large/6.jpg saved to cache
2026-03-26 22:53:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e732670e-563c-5163-874a-0d3d7a0beee3
2026-03-26 22:53:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/93fdb9953cb5408d903ddb627b33e440/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/93fdb9953cb5408d903ddb627b33e440/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F93fdb9953cb5408d903ddb627b33e440%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/93fdb9953cb5408d903ddb627b33e440/images/large/9.jpg not downloaded yet
2026-03-26 22:53:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/93fdb9953cb5408d903ddb627b33e440/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/93fdb9953cb5408d903ddb627b33e440/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F93fdb9953cb5408d903ddb627b33e440%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/93fdb9953cb5408d903ddb627b33e440/images/large/10.jpg not downloaded yet
2026-03-26 22:53:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74432d0>
2026-03-26 22:53:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e732670e-563c-5163-874a-0d3d7a0beee3/e732670e-563c-5163-874a-0d3d7a0beee3_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Fdc28b8b2c5d048e9a644d3f64ffe50e7%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/dc28b8b2c5d048e9a644d3f64ffe50e7/images/large/7.jpg saved to cache
2026-03-26 22:53:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e732670e-563c-5163-874a-0d3d7a0beee3
2026-03-26 22:53:51 [ayvens.be] INFO: Found listing with ID: 1985521
2026-03-26 22:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985521%27 HTTP/1.1" 200 None
2026-03-26 22:53:51 [ayvens.be] INFO: Scrape type for 1985521: 1
2026-03-26 22:53:51 [ayvens.be] INFO: Extracting data for car ID: 1985521
2026-03-26 22:53:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 09bb2fdb-822d-5f2b-9f33-6cf05107e48e with identifier: 1985521
2026-03-26 22:53:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09bb2fdb-822d-5f2b-9f33-6cf05107e48e with scrape type 1
2026-03-26 22:53:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 09bb2fdb-822d-5f2b-9f33-6cf05107e48e
2026-03-26 22:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252Fb2d52c7ec046476baf1a36fd30d39954%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/b2d52c7ec046476baf1a36fd30d39954/images/large/1.jpg not downloaded yet
2026-03-26 22:53:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/dc28b8b2c5d048e9a644d3f64ffe50e7/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252Fb2d52c7ec046476baf1a36fd30d39954%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/b2d52c7ec046476baf1a36fd30d39954/images/large/2.jpg not downloaded yet
2026-03-26 22:53:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b743b0d0>
2026-03-26 22:53:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1b32218-266b-566a-b43d-7beff4118cd2/d1b32218-266b-566a-b43d-7beff4118cd2_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F93fdb9953cb5408d903ddb627b33e440%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/93fdb9953cb5408d903ddb627b33e440/images/large/3.jpg saved to cache
2026-03-26 22:53:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d1b32218-266b-566a-b43d-7beff4118cd2
2026-03-26 22:53:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7a56450>
2026-03-26 22:53:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1b32218-266b-566a-b43d-7beff4118cd2/d1b32218-266b-566a-b43d-7beff4118cd2_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F93fdb9953cb5408d903ddb627b33e440%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/93fdb9953cb5408d903ddb627b33e440/images/large/1.jpg saved to cache
2026-03-26 22:53:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d1b32218-266b-566a-b43d-7beff4118cd2
2026-03-26 22:53:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/dc28b8b2c5d048e9a644d3f64ffe50e7/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/dc28b8b2c5d048e9a644d3f64ffe50e7/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252Fb2d52c7ec046476baf1a36fd30d39954%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/b2d52c7ec046476baf1a36fd30d39954/images/large/3.jpg not downloaded yet
2026-03-26 22:53:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6d80350>
2026-03-26 22:53:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1b32218-266b-566a-b43d-7beff4118cd2/d1b32218-266b-566a-b43d-7beff4118cd2_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F93fdb9953cb5408d903ddb627b33e440%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/93fdb9953cb5408d903ddb627b33e440/images/large/2.jpg saved to cache
2026-03-26 22:53:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d1b32218-266b-566a-b43d-7beff4118cd2
2026-03-26 22:53:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b776bed0>
2026-03-26 22:53:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1b32218-266b-566a-b43d-7beff4118cd2/d1b32218-266b-566a-b43d-7beff4118cd2_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F93fdb9953cb5408d903ddb627b33e440%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/93fdb9953cb5408d903ddb627b33e440/images/large/4.jpg saved to cache
2026-03-26 22:53:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d1b32218-266b-566a-b43d-7beff4118cd2
2026-03-26 22:53:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/93fdb9953cb5408d903ddb627b33e440/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/93fdb9953cb5408d903ddb627b33e440/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/93fdb9953cb5408d903ddb627b33e440/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252Fb2d52c7ec046476baf1a36fd30d39954%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/b2d52c7ec046476baf1a36fd30d39954/images/large/4.jpg not downloaded yet
2026-03-26 22:53:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/93fdb9953cb5408d903ddb627b33e440/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7768350>
2026-03-26 22:53:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e732670e-563c-5163-874a-0d3d7a0beee3/e732670e-563c-5163-874a-0d3d7a0beee3_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Fdc28b8b2c5d048e9a644d3f64ffe50e7%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/dc28b8b2c5d048e9a644d3f64ffe50e7/images/large/10.jpg saved to cache
2026-03-26 22:53:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e732670e-563c-5163-874a-0d3d7a0beee3
2026-03-26 22:53:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79a3dd0>
2026-03-26 22:53:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e732670e-563c-5163-874a-0d3d7a0beee3/e732670e-563c-5163-874a-0d3d7a0beee3_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Fdc28b8b2c5d048e9a644d3f64ffe50e7%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/dc28b8b2c5d048e9a644d3f64ffe50e7/images/large/9.jpg saved to cache
2026-03-26 22:53:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e732670e-563c-5163-874a-0d3d7a0beee3
2026-03-26 22:53:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74bc9d0>
2026-03-26 22:53:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e732670e-563c-5163-874a-0d3d7a0beee3/e732670e-563c-5163-874a-0d3d7a0beee3_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Fdc28b8b2c5d048e9a644d3f64ffe50e7%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/dc28b8b2c5d048e9a644d3f64ffe50e7/images/large/8.jpg saved to cache
2026-03-26 22:53:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e732670e-563c-5163-874a-0d3d7a0beee3
2026-03-26 22:53:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e732670e-563c-5163-874a-0d3d7a0beee3, skipping ID generation
2026-03-26 22:53:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e732670e-563c-5163-874a-0d3d7a0beee3 with scrape type 1
2026-03-26 22:53:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e732670e-563c-5163-874a-0d3d7a0beee3 sending to next pipeline
2026-03-26 22:53:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e732670e-563c-5163-874a-0d3d7a0beee3, identifier: 1985519
2026-03-26 22:53:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/93fdb9953cb5408d903ddb627b33e440/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252Fb2d52c7ec046476baf1a36fd30d39954%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/b2d52c7ec046476baf1a36fd30d39954/images/large/5.jpg not downloaded yet
2026-03-26 22:53:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e732670e-563c-5163-874a-0d3d7a0beee3 with identifier: 1985519
2026-03-26 22:53:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e732670e-563c-5163-874a-0d3d7a0beee3 with identifier: 1985519
2026-03-26 22:53:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e732670e-563c-5163-874a-0d3d7a0beee3 with identifier: 1985519 to the API
2026-03-26 22:53:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:53:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:53:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cr/dc28b8b2c5d048e9a644d3f64ffe50e7/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'electric',
 'id': 'e732670e-563c-5163-874a-0d3d7a0beee3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'EQB',
 'odometer': 71471,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 24,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e732670e-563c-5163-874a-0d3d7a0beee3/e732670e-563c-5163-874a-0d3d7a0beee3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 516967,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/dc28b8b2c5d048e9a644d3f64ffe50e7/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e732670e-563c-5163-874a-0d3d7a0beee3/e732670e-563c-5163-874a-0d3d7a0beee3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 464442,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/dc28b8b2c5d048e9a644d3f64ffe50e7/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e732670e-563c-5163-874a-0d3d7a0beee3/e732670e-563c-5163-874a-0d3d7a0beee3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 566629,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/dc28b8b2c5d048e9a644d3f64ffe50e7/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e732670e-563c-5163-874a-0d3d7a0beee3/e732670e-563c-5163-874a-0d3d7a0beee3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 551585,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/dc28b8b2c5d048e9a644d3f64ffe50e7/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e732670e-563c-5163-874a-0d3d7a0beee3/e732670e-563c-5163-874a-0d3d7a0beee3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 502211,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/dc28b8b2c5d048e9a644d3f64ffe50e7/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e732670e-563c-5163-874a-0d3d7a0beee3/e732670e-563c-5163-874a-0d3d7a0beee3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 793029,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/dc28b8b2c5d048e9a644d3f64ffe50e7/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e732670e-563c-5163-874a-0d3d7a0beee3/e732670e-563c-5163-874a-0d3d7a0beee3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 652169,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/dc28b8b2c5d048e9a644d3f64ffe50e7/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e732670e-563c-5163-874a-0d3d7a0beee3/e732670e-563c-5163-874a-0d3d7a0beee3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 904371,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/dc28b8b2c5d048e9a644d3f64ffe50e7/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e732670e-563c-5163-874a-0d3d7a0beee3/e732670e-563c-5163-874a-0d3d7a0beee3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 867411,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/dc28b8b2c5d048e9a644d3f64ffe50e7/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e732670e-563c-5163-874a-0d3d7a0beee3/e732670e-563c-5163-874a-0d3d7a0beee3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 826865,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/dc28b8b2c5d048e9a644d3f64ffe50e7/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ EQB BEV 67KWH EQB 250 BUSINESS LINE AUTO',
 'transmission': 'automatic',
 'trim': 'BEV 67KWH EQB 250 BUSINESS LINE AUTO',
 'vin': None,
 'year': 2022}
2026-03-26 22:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985519%27 HTTP/1.1" 200 None
2026-03-26 22:53:53 [ayvens.be] INFO: Saving data for 1985519: {'created_time': 1774565633.039442, 'last_price_update_time': 1774565633.039452, 'auction_closing_time': 1774958400.0}
2026-03-26 22:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985519') HTTP/1.1" 204 0
2026-03-26 22:53:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/93fdb9953cb5408d903ddb627b33e440/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252Fb2d52c7ec046476baf1a36fd30d39954%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/b2d52c7ec046476baf1a36fd30d39954/images/large/6.jpg not downloaded yet
2026-03-26 22:53:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c94410>
2026-03-26 22:53:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1b32218-266b-566a-b43d-7beff4118cd2/d1b32218-266b-566a-b43d-7beff4118cd2_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F93fdb9953cb5408d903ddb627b33e440%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/93fdb9953cb5408d903ddb627b33e440/images/large/5.jpg saved to cache
2026-03-26 22:53:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d1b32218-266b-566a-b43d-7beff4118cd2
2026-03-26 22:53:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7ae9d10>
2026-03-26 22:53:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1b32218-266b-566a-b43d-7beff4118cd2/d1b32218-266b-566a-b43d-7beff4118cd2_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F93fdb9953cb5408d903ddb627b33e440%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/93fdb9953cb5408d903ddb627b33e440/images/large/6.jpg saved to cache
2026-03-26 22:53:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d1b32218-266b-566a-b43d-7beff4118cd2
2026-03-26 22:53:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76ee250>
2026-03-26 22:53:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1b32218-266b-566a-b43d-7beff4118cd2/d1b32218-266b-566a-b43d-7beff4118cd2_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F93fdb9953cb5408d903ddb627b33e440%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/93fdb9953cb5408d903ddb627b33e440/images/large/8.jpg saved to cache
2026-03-26 22:53:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d1b32218-266b-566a-b43d-7beff4118cd2
2026-03-26 22:53:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7ae94d0>
2026-03-26 22:53:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1b32218-266b-566a-b43d-7beff4118cd2/d1b32218-266b-566a-b43d-7beff4118cd2_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F93fdb9953cb5408d903ddb627b33e440%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/93fdb9953cb5408d903ddb627b33e440/images/large/7.jpg saved to cache
2026-03-26 22:53:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d1b32218-266b-566a-b43d-7beff4118cd2
2026-03-26 22:53:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd0c5f10>
2026-03-26 22:53:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1b32218-266b-566a-b43d-7beff4118cd2/d1b32218-266b-566a-b43d-7beff4118cd2_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F93fdb9953cb5408d903ddb627b33e440%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/93fdb9953cb5408d903ddb627b33e440/images/large/9.jpg saved to cache
2026-03-26 22:53:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d1b32218-266b-566a-b43d-7beff4118cd2
2026-03-26 22:53:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/b2d52c7ec046476baf1a36fd30d39954/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252Fb2d52c7ec046476baf1a36fd30d39954%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/b2d52c7ec046476baf1a36fd30d39954/images/large/7.jpg not downloaded yet
2026-03-26 22:53:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/b2d52c7ec046476baf1a36fd30d39954/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74cc610>
2026-03-26 22:53:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1b32218-266b-566a-b43d-7beff4118cd2/d1b32218-266b-566a-b43d-7beff4118cd2_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F93fdb9953cb5408d903ddb627b33e440%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/93fdb9953cb5408d903ddb627b33e440/images/large/10.jpg saved to cache
2026-03-26 22:53:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d1b32218-266b-566a-b43d-7beff4118cd2
2026-03-26 22:53:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d1b32218-266b-566a-b43d-7beff4118cd2, skipping ID generation
2026-03-26 22:53:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1b32218-266b-566a-b43d-7beff4118cd2 with scrape type 1
2026-03-26 22:53:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d1b32218-266b-566a-b43d-7beff4118cd2 sending to next pipeline
2026-03-26 22:53:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d1b32218-266b-566a-b43d-7beff4118cd2, identifier: 1985520
2026-03-26 22:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252Fb2d52c7ec046476baf1a36fd30d39954%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/b2d52c7ec046476baf1a36fd30d39954/images/large/8.jpg not downloaded yet
2026-03-26 22:53:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d1b32218-266b-566a-b43d-7beff4118cd2 with identifier: 1985520
2026-03-26 22:53:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d1b32218-266b-566a-b43d-7beff4118cd2 with identifier: 1985520
2026-03-26 22:53:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d1b32218-266b-566a-b43d-7beff4118cd2 with identifier: 1985520 to the API
2026-03-26 22:53:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:53:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:53:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cm/93fdb9953cb5408d903ddb627b33e440/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'd1b32218-266b-566a-b43d-7beff4118cd2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLA SHOOTING BRAKE',
 'odometer': 139745,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1b32218-266b-566a-b43d-7beff4118cd2/d1b32218-266b-566a-b43d-7beff4118cd2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 361783,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/93fdb9953cb5408d903ddb627b33e440/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1b32218-266b-566a-b43d-7beff4118cd2/d1b32218-266b-566a-b43d-7beff4118cd2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 424630,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/93fdb9953cb5408d903ddb627b33e440/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1b32218-266b-566a-b43d-7beff4118cd2/d1b32218-266b-566a-b43d-7beff4118cd2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 325556,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/93fdb9953cb5408d903ddb627b33e440/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1b32218-266b-566a-b43d-7beff4118cd2/d1b32218-266b-566a-b43d-7beff4118cd2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 348793,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/93fdb9953cb5408d903ddb627b33e440/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1b32218-266b-566a-b43d-7beff4118cd2/d1b32218-266b-566a-b43d-7beff4118cd2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 322200,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/93fdb9953cb5408d903ddb627b33e440/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1b32218-266b-566a-b43d-7beff4118cd2/d1b32218-266b-566a-b43d-7beff4118cd2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 299883,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/93fdb9953cb5408d903ddb627b33e440/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1b32218-266b-566a-b43d-7beff4118cd2/d1b32218-266b-566a-b43d-7beff4118cd2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 419109,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/93fdb9953cb5408d903ddb627b33e440/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1b32218-266b-566a-b43d-7beff4118cd2/d1b32218-266b-566a-b43d-7beff4118cd2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 333249,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/93fdb9953cb5408d903ddb627b33e440/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1b32218-266b-566a-b43d-7beff4118cd2/d1b32218-266b-566a-b43d-7beff4118cd2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 291920,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/93fdb9953cb5408d903ddb627b33e440/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1b32218-266b-566a-b43d-7beff4118cd2/d1b32218-266b-566a-b43d-7beff4118cd2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 274383,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/93fdb9953cb5408d903ddb627b33e440/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLA SHOOTING BRAKE 1.3 CLA 250 E BUSINESS SOLUTION '
          'DCT',
 'transmission': 'automatic',
 'trim': '1.3 CLA 250 E BUSINESS SOLUTION DCT',
 'vin': None,
 'year': 2022}
2026-03-26 22:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985520%27 HTTP/1.1" 200 None
2026-03-26 22:53:54 [ayvens.be] INFO: Saving data for 1985520: {'created_time': 1774565634.17818, 'last_price_update_time': 1774565634.178193, 'auction_closing_time': 1774958400.0}
2026-03-26 22:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985520') HTTP/1.1" 204 0
2026-03-26 22:53:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/b2d52c7ec046476baf1a36fd30d39954/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/b2d52c7ec046476baf1a36fd30d39954/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252Fb2d52c7ec046476baf1a36fd30d39954%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/b2d52c7ec046476baf1a36fd30d39954/images/large/9.jpg not downloaded yet
2026-03-26 22:53:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79fac10>
2026-03-26 22:53:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09bb2fdb-822d-5f2b-9f33-6cf05107e48e/09bb2fdb-822d-5f2b-9f33-6cf05107e48e_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252Fb2d52c7ec046476baf1a36fd30d39954%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/b2d52c7ec046476baf1a36fd30d39954/images/large/2.jpg saved to cache
2026-03-26 22:53:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 09bb2fdb-822d-5f2b-9f33-6cf05107e48e
2026-03-26 22:53:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80cad3ec10>
2026-03-26 22:53:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09bb2fdb-822d-5f2b-9f33-6cf05107e48e/09bb2fdb-822d-5f2b-9f33-6cf05107e48e_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252Fb2d52c7ec046476baf1a36fd30d39954%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/b2d52c7ec046476baf1a36fd30d39954/images/large/1.jpg saved to cache
2026-03-26 22:53:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 09bb2fdb-822d-5f2b-9f33-6cf05107e48e
2026-03-26 22:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252Fb2d52c7ec046476baf1a36fd30d39954%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/b2d52c7ec046476baf1a36fd30d39954/images/large/10.jpg not downloaded yet
2026-03-26 22:53:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/b2d52c7ec046476baf1a36fd30d39954/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/b2d52c7ec046476baf1a36fd30d39954/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:54 [ayvens.be] INFO: Found listing with ID: 1985522
2026-03-26 22:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985522%27 HTTP/1.1" 200 None
2026-03-26 22:53:54 [ayvens.be] INFO: Scrape type for 1985522: 1
2026-03-26 22:53:54 [ayvens.be] INFO: Extracting data for car ID: 1985522
2026-03-26 22:53:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 531f8a05-552a-579e-a2ec-7042eca47608 with identifier: 1985522
2026-03-26 22:53:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 531f8a05-552a-579e-a2ec-7042eca47608 with scrape type 1
2026-03-26 22:53:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 531f8a05-552a-579e-a2ec-7042eca47608
2026-03-26 22:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Ff768b5a939504e6d8942502e7f736732%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/f768b5a939504e6d8942502e7f736732/images/large/1.jpg not downloaded yet
2026-03-26 22:53:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7a60410>
2026-03-26 22:53:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09bb2fdb-822d-5f2b-9f33-6cf05107e48e/09bb2fdb-822d-5f2b-9f33-6cf05107e48e_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252Fb2d52c7ec046476baf1a36fd30d39954%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/b2d52c7ec046476baf1a36fd30d39954/images/large/4.jpg saved to cache
2026-03-26 22:53:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 09bb2fdb-822d-5f2b-9f33-6cf05107e48e
2026-03-26 22:53:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7a55a10>
2026-03-26 22:53:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09bb2fdb-822d-5f2b-9f33-6cf05107e48e/09bb2fdb-822d-5f2b-9f33-6cf05107e48e_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252Fb2d52c7ec046476baf1a36fd30d39954%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/b2d52c7ec046476baf1a36fd30d39954/images/large/3.jpg saved to cache
2026-03-26 22:53:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 09bb2fdb-822d-5f2b-9f33-6cf05107e48e
2026-03-26 22:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Ff768b5a939504e6d8942502e7f736732%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/f768b5a939504e6d8942502e7f736732/images/large/2.jpg not downloaded yet
2026-03-26 22:53:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/b2d52c7ec046476baf1a36fd30d39954/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Ff768b5a939504e6d8942502e7f736732%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/f768b5a939504e6d8942502e7f736732/images/large/3.jpg not downloaded yet
2026-03-26 22:53:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e13f50>
2026-03-26 22:53:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09bb2fdb-822d-5f2b-9f33-6cf05107e48e/09bb2fdb-822d-5f2b-9f33-6cf05107e48e_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252Fb2d52c7ec046476baf1a36fd30d39954%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/b2d52c7ec046476baf1a36fd30d39954/images/large/5.jpg saved to cache
2026-03-26 22:53:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 09bb2fdb-822d-5f2b-9f33-6cf05107e48e
2026-03-26 22:53:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7726d90>
2026-03-26 22:53:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09bb2fdb-822d-5f2b-9f33-6cf05107e48e/09bb2fdb-822d-5f2b-9f33-6cf05107e48e_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252Fb2d52c7ec046476baf1a36fd30d39954%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/b2d52c7ec046476baf1a36fd30d39954/images/large/6.jpg saved to cache
2026-03-26 22:53:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 09bb2fdb-822d-5f2b-9f33-6cf05107e48e
2026-03-26 22:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Ff768b5a939504e6d8942502e7f736732%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/f768b5a939504e6d8942502e7f736732/images/large/4.jpg not downloaded yet
2026-03-26 22:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Ff768b5a939504e6d8942502e7f736732%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/f768b5a939504e6d8942502e7f736732/images/large/5.jpg not downloaded yet
2026-03-26 22:53:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7912950>
2026-03-26 22:53:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09bb2fdb-822d-5f2b-9f33-6cf05107e48e/09bb2fdb-822d-5f2b-9f33-6cf05107e48e_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252Fb2d52c7ec046476baf1a36fd30d39954%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/b2d52c7ec046476baf1a36fd30d39954/images/large/7.jpg saved to cache
2026-03-26 22:53:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 09bb2fdb-822d-5f2b-9f33-6cf05107e48e
2026-03-26 22:53:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/b2d52c7ec046476baf1a36fd30d39954/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Ff768b5a939504e6d8942502e7f736732%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/f768b5a939504e6d8942502e7f736732/images/large/6.jpg not downloaded yet
2026-03-26 22:53:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/b2d52c7ec046476baf1a36fd30d39954/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/b2d52c7ec046476baf1a36fd30d39954/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Ff768b5a939504e6d8942502e7f736732%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/f768b5a939504e6d8942502e7f736732/images/large/7.jpg not downloaded yet
2026-03-26 22:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Ff768b5a939504e6d8942502e7f736732%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/f768b5a939504e6d8942502e7f736732/images/large/8.jpg not downloaded yet
2026-03-26 22:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Ff768b5a939504e6d8942502e7f736732%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/f768b5a939504e6d8942502e7f736732/images/large/9.jpg not downloaded yet
2026-03-26 22:53:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/f768b5a939504e6d8942502e7f736732/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Ff768b5a939504e6d8942502e7f736732%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/f768b5a939504e6d8942502e7f736732/images/large/10.jpg not downloaded yet
2026-03-26 22:53:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/f768b5a939504e6d8942502e7f736732/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/f768b5a939504e6d8942502e7f736732/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:54 [ayvens.be] INFO: Found listing with ID: 1985523
2026-03-26 22:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985523%27 HTTP/1.1" 200 None
2026-03-26 22:53:54 [ayvens.be] INFO: Scrape type for 1985523: 1
2026-03-26 22:53:54 [ayvens.be] INFO: Extracting data for car ID: 1985523
2026-03-26 22:53:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e6a832f-1230-5bff-acc6-21ed6777f720 with identifier: 1985523
2026-03-26 22:53:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e6a832f-1230-5bff-acc6-21ed6777f720 with scrape type 1
2026-03-26 22:53:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8e6a832f-1230-5bff-acc6-21ed6777f720
2026-03-26 22:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252Fdb0f079680eb44f3bf891d9282c03069%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/db0f079680eb44f3bf891d9282c03069/images/large/1.jpg not downloaded yet
2026-03-26 22:53:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7a55810>
2026-03-26 22:53:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09bb2fdb-822d-5f2b-9f33-6cf05107e48e/09bb2fdb-822d-5f2b-9f33-6cf05107e48e_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252Fb2d52c7ec046476baf1a36fd30d39954%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/b2d52c7ec046476baf1a36fd30d39954/images/large/9.jpg saved to cache
2026-03-26 22:53:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 09bb2fdb-822d-5f2b-9f33-6cf05107e48e
2026-03-26 22:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252Fdb0f079680eb44f3bf891d9282c03069%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/db0f079680eb44f3bf891d9282c03069/images/large/2.jpg not downloaded yet
2026-03-26 22:53:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6dee990>
2026-03-26 22:53:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09bb2fdb-822d-5f2b-9f33-6cf05107e48e/09bb2fdb-822d-5f2b-9f33-6cf05107e48e_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252Fb2d52c7ec046476baf1a36fd30d39954%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/b2d52c7ec046476baf1a36fd30d39954/images/large/8.jpg saved to cache
2026-03-26 22:53:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 09bb2fdb-822d-5f2b-9f33-6cf05107e48e
2026-03-26 22:53:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74cc090>
2026-03-26 22:53:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09bb2fdb-822d-5f2b-9f33-6cf05107e48e/09bb2fdb-822d-5f2b-9f33-6cf05107e48e_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252Fb2d52c7ec046476baf1a36fd30d39954%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/b2d52c7ec046476baf1a36fd30d39954/images/large/10.jpg saved to cache
2026-03-26 22:53:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 09bb2fdb-822d-5f2b-9f33-6cf05107e48e
2026-03-26 22:53:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 09bb2fdb-822d-5f2b-9f33-6cf05107e48e, skipping ID generation
2026-03-26 22:53:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09bb2fdb-822d-5f2b-9f33-6cf05107e48e with scrape type 1
2026-03-26 22:53:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 09bb2fdb-822d-5f2b-9f33-6cf05107e48e sending to next pipeline
2026-03-26 22:53:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 09bb2fdb-822d-5f2b-9f33-6cf05107e48e, identifier: 1985521
2026-03-26 22:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252Fdb0f079680eb44f3bf891d9282c03069%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/db0f079680eb44f3bf891d9282c03069/images/large/3.jpg not downloaded yet
2026-03-26 22:53:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 09bb2fdb-822d-5f2b-9f33-6cf05107e48e with identifier: 1985521
2026-03-26 22:53:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 09bb2fdb-822d-5f2b-9f33-6cf05107e48e with identifier: 1985521
2026-03-26 22:53:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 09bb2fdb-822d-5f2b-9f33-6cf05107e48e with identifier: 1985521 to the API
2026-03-26 22:53:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:53:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:53:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yr/b2d52c7ec046476baf1a36fd30d39954/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 31,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.3L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '09bb2fdb-822d-5f2b-9f33-6cf05107e48e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A-CLASS LIMOUSINE',
 'odometer': 64294,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09bb2fdb-822d-5f2b-9f33-6cf05107e48e/09bb2fdb-822d-5f2b-9f33-6cf05107e48e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 262211,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/b2d52c7ec046476baf1a36fd30d39954/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09bb2fdb-822d-5f2b-9f33-6cf05107e48e/09bb2fdb-822d-5f2b-9f33-6cf05107e48e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 258752,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/b2d52c7ec046476baf1a36fd30d39954/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09bb2fdb-822d-5f2b-9f33-6cf05107e48e/09bb2fdb-822d-5f2b-9f33-6cf05107e48e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 269834,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/b2d52c7ec046476baf1a36fd30d39954/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09bb2fdb-822d-5f2b-9f33-6cf05107e48e/09bb2fdb-822d-5f2b-9f33-6cf05107e48e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 268216,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/b2d52c7ec046476baf1a36fd30d39954/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09bb2fdb-822d-5f2b-9f33-6cf05107e48e/09bb2fdb-822d-5f2b-9f33-6cf05107e48e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 264604,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/b2d52c7ec046476baf1a36fd30d39954/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09bb2fdb-822d-5f2b-9f33-6cf05107e48e/09bb2fdb-822d-5f2b-9f33-6cf05107e48e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 244713,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/b2d52c7ec046476baf1a36fd30d39954/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09bb2fdb-822d-5f2b-9f33-6cf05107e48e/09bb2fdb-822d-5f2b-9f33-6cf05107e48e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 283398,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/b2d52c7ec046476baf1a36fd30d39954/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09bb2fdb-822d-5f2b-9f33-6cf05107e48e/09bb2fdb-822d-5f2b-9f33-6cf05107e48e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 369092,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/b2d52c7ec046476baf1a36fd30d39954/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09bb2fdb-822d-5f2b-9f33-6cf05107e48e/09bb2fdb-822d-5f2b-9f33-6cf05107e48e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 396301,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/b2d52c7ec046476baf1a36fd30d39954/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09bb2fdb-822d-5f2b-9f33-6cf05107e48e/09bb2fdb-822d-5f2b-9f33-6cf05107e48e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 339440,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/b2d52c7ec046476baf1a36fd30d39954/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ A-CLASS LIMOUSINE 1.3 A 250 E BUSINESS SOLUTION DCT',
 'transmission': 'automatic',
 'trim': '1.3 A 250 E BUSINESS SOLUTION DCT',
 'vin': None,
 'year': 2020}
2026-03-26 22:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985521%27 HTTP/1.1" 200 None
2026-03-26 22:53:55 [ayvens.be] INFO: Saving data for 1985521: {'created_time': 1774565635.60032, 'last_price_update_time': 1774565635.600329, 'auction_closing_time': 1774958400.0}
2026-03-26 22:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985521') HTTP/1.1" 204 0
2026-03-26 22:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252Fdb0f079680eb44f3bf891d9282c03069%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/db0f079680eb44f3bf891d9282c03069/images/large/4.jpg not downloaded yet
2026-03-26 22:53:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7442010>
2026-03-26 22:53:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_531f8a05-552a-579e-a2ec-7042eca47608/531f8a05-552a-579e-a2ec-7042eca47608_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Ff768b5a939504e6d8942502e7f736732%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/f768b5a939504e6d8942502e7f736732/images/large/1.jpg saved to cache
2026-03-26 22:53:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 531f8a05-552a-579e-a2ec-7042eca47608
2026-03-26 22:53:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6d801d0>
2026-03-26 22:53:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_531f8a05-552a-579e-a2ec-7042eca47608/531f8a05-552a-579e-a2ec-7042eca47608_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Ff768b5a939504e6d8942502e7f736732%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/f768b5a939504e6d8942502e7f736732/images/large/2.jpg saved to cache
2026-03-26 22:53:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 531f8a05-552a-579e-a2ec-7042eca47608
2026-03-26 22:53:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6df0450>
2026-03-26 22:53:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_531f8a05-552a-579e-a2ec-7042eca47608/531f8a05-552a-579e-a2ec-7042eca47608_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Ff768b5a939504e6d8942502e7f736732%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/f768b5a939504e6d8942502e7f736732/images/large/3.jpg saved to cache
2026-03-26 22:53:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 531f8a05-552a-579e-a2ec-7042eca47608
2026-03-26 22:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252Fdb0f079680eb44f3bf891d9282c03069%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/db0f079680eb44f3bf891d9282c03069/images/large/5.jpg not downloaded yet
2026-03-26 22:53:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/f768b5a939504e6d8942502e7f736732/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252Fdb0f079680eb44f3bf891d9282c03069%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/db0f079680eb44f3bf891d9282c03069/images/large/6.jpg not downloaded yet
2026-03-26 22:53:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/f768b5a939504e6d8942502e7f736732/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/f768b5a939504e6d8942502e7f736732/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/f768b5a939504e6d8942502e7f736732/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252Fdb0f079680eb44f3bf891d9282c03069%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/db0f079680eb44f3bf891d9282c03069/images/large/7.jpg not downloaded yet
2026-03-26 22:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252Fdb0f079680eb44f3bf891d9282c03069%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/db0f079680eb44f3bf891d9282c03069/images/large/8.jpg not downloaded yet
2026-03-26 22:53:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/f768b5a939504e6d8942502e7f736732/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/f768b5a939504e6d8942502e7f736732/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ym/db0f079680eb44f3bf891d9282c03069/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252Fdb0f079680eb44f3bf891d9282c03069%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/db0f079680eb44f3bf891d9282c03069/images/large/9.jpg not downloaded yet
2026-03-26 22:53:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/f768b5a939504e6d8942502e7f736732/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252Fdb0f079680eb44f3bf891d9282c03069%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/db0f079680eb44f3bf891d9282c03069/images/large/10.jpg not downloaded yet
2026-03-26 22:53:55 [ayvens.be] INFO: Found listing with ID: 1985524
2026-03-26 22:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985524%27 HTTP/1.1" 200 None
2026-03-26 22:53:55 [ayvens.be] INFO: Scrape type for 1985524: 1
2026-03-26 22:53:55 [ayvens.be] INFO: Extracting data for car ID: 1985524
2026-03-26 22:53:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee3085e8-c9ce-5699-aee1-9123a41beb5e with identifier: 1985524
2026-03-26 22:53:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee3085e8-c9ce-5699-aee1-9123a41beb5e with scrape type 1
2026-03-26 22:53:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ee3085e8-c9ce-5699-aee1-9123a41beb5e
2026-03-26 22:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F5bc2ff7d3be8415fbb7f9372307b90e6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/5bc2ff7d3be8415fbb7f9372307b90e6/images/large/1.jpg not downloaded yet
2026-03-26 22:53:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7477350>
2026-03-26 22:53:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_531f8a05-552a-579e-a2ec-7042eca47608/531f8a05-552a-579e-a2ec-7042eca47608_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:53:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Ff768b5a939504e6d8942502e7f736732%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/f768b5a939504e6d8942502e7f736732/images/large/4.jpg saved to cache
2026-03-26 22:53:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 531f8a05-552a-579e-a2ec-7042eca47608
2026-03-26 22:53:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F5bc2ff7d3be8415fbb7f9372307b90e6%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/5bc2ff7d3be8415fbb7f9372307b90e6/images/large/2.jpg not downloaded yet
2026-03-26 22:53:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ym/db0f079680eb44f3bf891d9282c03069/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ym/db0f079680eb44f3bf891d9282c03069/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c80350>
2026-03-26 22:53:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_531f8a05-552a-579e-a2ec-7042eca47608/531f8a05-552a-579e-a2ec-7042eca47608_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:53:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Ff768b5a939504e6d8942502e7f736732%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/f768b5a939504e6d8942502e7f736732/images/large/5.jpg saved to cache
2026-03-26 22:53:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 531f8a05-552a-579e-a2ec-7042eca47608
2026-03-26 22:53:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79f92d0>
2026-03-26 22:53:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_531f8a05-552a-579e-a2ec-7042eca47608/531f8a05-552a-579e-a2ec-7042eca47608_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:53:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Ff768b5a939504e6d8942502e7f736732%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/f768b5a939504e6d8942502e7f736732/images/large/7.jpg saved to cache
2026-03-26 22:53:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 531f8a05-552a-579e-a2ec-7042eca47608
2026-03-26 22:53:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77ca6d0>
2026-03-26 22:53:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_531f8a05-552a-579e-a2ec-7042eca47608/531f8a05-552a-579e-a2ec-7042eca47608_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:53:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Ff768b5a939504e6d8942502e7f736732%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/f768b5a939504e6d8942502e7f736732/images/large/6.jpg saved to cache
2026-03-26 22:53:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 531f8a05-552a-579e-a2ec-7042eca47608
2026-03-26 22:53:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ym/db0f079680eb44f3bf891d9282c03069/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F5bc2ff7d3be8415fbb7f9372307b90e6%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/5bc2ff7d3be8415fbb7f9372307b90e6/images/large/3.jpg not downloaded yet
2026-03-26 22:53:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F5bc2ff7d3be8415fbb7f9372307b90e6%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/5bc2ff7d3be8415fbb7f9372307b90e6/images/large/4.jpg not downloaded yet
2026-03-26 22:53:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b745a490>
2026-03-26 22:53:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_531f8a05-552a-579e-a2ec-7042eca47608/531f8a05-552a-579e-a2ec-7042eca47608_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:53:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Ff768b5a939504e6d8942502e7f736732%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/f768b5a939504e6d8942502e7f736732/images/large/8.jpg saved to cache
2026-03-26 22:53:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 531f8a05-552a-579e-a2ec-7042eca47608
2026-03-26 22:53:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cb3d50>
2026-03-26 22:53:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_531f8a05-552a-579e-a2ec-7042eca47608/531f8a05-552a-579e-a2ec-7042eca47608_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:53:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Ff768b5a939504e6d8942502e7f736732%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/f768b5a939504e6d8942502e7f736732/images/large/9.jpg saved to cache
2026-03-26 22:53:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 531f8a05-552a-579e-a2ec-7042eca47608
2026-03-26 22:53:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7911ed0>
2026-03-26 22:53:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e6a832f-1230-5bff-acc6-21ed6777f720/8e6a832f-1230-5bff-acc6-21ed6777f720_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:53:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252Fdb0f079680eb44f3bf891d9282c03069%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/db0f079680eb44f3bf891d9282c03069/images/large/1.jpg saved to cache
2026-03-26 22:53:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8e6a832f-1230-5bff-acc6-21ed6777f720
2026-03-26 22:53:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7819950>
2026-03-26 22:53:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_531f8a05-552a-579e-a2ec-7042eca47608/531f8a05-552a-579e-a2ec-7042eca47608_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:53:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Ff768b5a939504e6d8942502e7f736732%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/f768b5a939504e6d8942502e7f736732/images/large/10.jpg saved to cache
2026-03-26 22:53:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 531f8a05-552a-579e-a2ec-7042eca47608
2026-03-26 22:53:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 531f8a05-552a-579e-a2ec-7042eca47608, skipping ID generation
2026-03-26 22:53:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 531f8a05-552a-579e-a2ec-7042eca47608 with scrape type 1
2026-03-26 22:53:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 531f8a05-552a-579e-a2ec-7042eca47608 sending to next pipeline
2026-03-26 22:53:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 531f8a05-552a-579e-a2ec-7042eca47608, identifier: 1985522
2026-03-26 22:53:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7417550>
2026-03-26 22:53:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e6a832f-1230-5bff-acc6-21ed6777f720/8e6a832f-1230-5bff-acc6-21ed6777f720_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252Fdb0f079680eb44f3bf891d9282c03069%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/db0f079680eb44f3bf891d9282c03069/images/large/3.jpg saved to cache
2026-03-26 22:53:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8e6a832f-1230-5bff-acc6-21ed6777f720
2026-03-26 22:53:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd3c4450>
2026-03-26 22:53:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e6a832f-1230-5bff-acc6-21ed6777f720/8e6a832f-1230-5bff-acc6-21ed6777f720_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252Fdb0f079680eb44f3bf891d9282c03069%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/db0f079680eb44f3bf891d9282c03069/images/large/2.jpg saved to cache
2026-03-26 22:53:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8e6a832f-1230-5bff-acc6-21ed6777f720
2026-03-26 22:53:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ym/db0f079680eb44f3bf891d9282c03069/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ym/db0f079680eb44f3bf891d9282c03069/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 531f8a05-552a-579e-a2ec-7042eca47608 with identifier: 1985522
2026-03-26 22:53:57 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 22:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 22:53:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 531f8a05-552a-579e-a2ec-7042eca47608 with identifier: 1985522
2026-03-26 22:53:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 531f8a05-552a-579e-a2ec-7042eca47608 with identifier: 1985522 to the API
2026-03-26 22:53:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:53:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:53:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bk/f768b5a939504e6d8942502e7f736732/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 31,
 'color': 'MINERALWEISS',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '531f8a05-552a-579e-a2ec-7042eca47608',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '3 SERIES BERLINE',
 'odometer': 157144,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_531f8a05-552a-579e-a2ec-7042eca47608/531f8a05-552a-579e-a2ec-7042eca47608_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 662572,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/f768b5a939504e6d8942502e7f736732/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_531f8a05-552a-579e-a2ec-7042eca47608/531f8a05-552a-579e-a2ec-7042eca47608_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 626589,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/f768b5a939504e6d8942502e7f736732/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_531f8a05-552a-579e-a2ec-7042eca47608/531f8a05-552a-579e-a2ec-7042eca47608_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 623324,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/f768b5a939504e6d8942502e7f736732/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_531f8a05-552a-579e-a2ec-7042eca47608/531f8a05-552a-579e-a2ec-7042eca47608_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 639165,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/f768b5a939504e6d8942502e7f736732/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_531f8a05-552a-579e-a2ec-7042eca47608/531f8a05-552a-579e-a2ec-7042eca47608_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 634862,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/f768b5a939504e6d8942502e7f736732/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_531f8a05-552a-579e-a2ec-7042eca47608/531f8a05-552a-579e-a2ec-7042eca47608_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 747362,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/f768b5a939504e6d8942502e7f736732/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_531f8a05-552a-579e-a2ec-7042eca47608/531f8a05-552a-579e-a2ec-7042eca47608_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 648988,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/f768b5a939504e6d8942502e7f736732/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_531f8a05-552a-579e-a2ec-7042eca47608/531f8a05-552a-579e-a2ec-7042eca47608_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 897532,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/f768b5a939504e6d8942502e7f736732/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_531f8a05-552a-579e-a2ec-7042eca47608/531f8a05-552a-579e-a2ec-7042eca47608_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 863260,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/f768b5a939504e6d8942502e7f736732/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_531f8a05-552a-579e-a2ec-7042eca47608/531f8a05-552a-579e-a2ec-7042eca47608_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 846174,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/f768b5a939504e6d8942502e7f736732/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3 SERIES BERLINE 2.0 320E BERLINE',
 'transmission': 'automatic',
 'trim': '2.0 320E BERLINE',
 'vin': None,
 'year': 2021}
2026-03-26 22:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985522%27 HTTP/1.1" 200 None
2026-03-26 22:53:57 [ayvens.be] INFO: Saving data for 1985522: {'created_time': 1774565637.461783, 'last_price_update_time': 1774565637.461792, 'auction_closing_time': 1774958400.0}
2026-03-26 22:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985522') HTTP/1.1" 204 0
2026-03-26 22:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F5bc2ff7d3be8415fbb7f9372307b90e6%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/5bc2ff7d3be8415fbb7f9372307b90e6/images/large/5.jpg not downloaded yet
2026-03-26 22:53:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ym/db0f079680eb44f3bf891d9282c03069/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c63090>
2026-03-26 22:53:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e6a832f-1230-5bff-acc6-21ed6777f720/8e6a832f-1230-5bff-acc6-21ed6777f720_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252Fdb0f079680eb44f3bf891d9282c03069%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/db0f079680eb44f3bf891d9282c03069/images/large/4.jpg saved to cache
2026-03-26 22:53:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8e6a832f-1230-5bff-acc6-21ed6777f720
2026-03-26 22:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F5bc2ff7d3be8415fbb7f9372307b90e6%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/5bc2ff7d3be8415fbb7f9372307b90e6/images/large/6.jpg not downloaded yet
2026-03-26 22:53:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c637d0>
2026-03-26 22:53:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e6a832f-1230-5bff-acc6-21ed6777f720/8e6a832f-1230-5bff-acc6-21ed6777f720_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252Fdb0f079680eb44f3bf891d9282c03069%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/db0f079680eb44f3bf891d9282c03069/images/large/5.jpg saved to cache
2026-03-26 22:53:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8e6a832f-1230-5bff-acc6-21ed6777f720
2026-03-26 22:53:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6dd8f90>
2026-03-26 22:53:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e6a832f-1230-5bff-acc6-21ed6777f720/8e6a832f-1230-5bff-acc6-21ed6777f720_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252Fdb0f079680eb44f3bf891d9282c03069%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/db0f079680eb44f3bf891d9282c03069/images/large/7.jpg saved to cache
2026-03-26 22:53:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8e6a832f-1230-5bff-acc6-21ed6777f720
2026-03-26 22:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F5bc2ff7d3be8415fbb7f9372307b90e6%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/5bc2ff7d3be8415fbb7f9372307b90e6/images/large/7.jpg not downloaded yet
2026-03-26 22:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F5bc2ff7d3be8415fbb7f9372307b90e6%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/5bc2ff7d3be8415fbb7f9372307b90e6/images/large/8.jpg not downloaded yet
2026-03-26 22:53:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7ccce90>
2026-03-26 22:53:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e6a832f-1230-5bff-acc6-21ed6777f720/8e6a832f-1230-5bff-acc6-21ed6777f720_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252Fdb0f079680eb44f3bf891d9282c03069%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/db0f079680eb44f3bf891d9282c03069/images/large/6.jpg saved to cache
2026-03-26 22:53:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8e6a832f-1230-5bff-acc6-21ed6777f720
2026-03-26 22:53:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ym/db0f079680eb44f3bf891d9282c03069/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ym/db0f079680eb44f3bf891d9282c03069/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F5bc2ff7d3be8415fbb7f9372307b90e6%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/5bc2ff7d3be8415fbb7f9372307b90e6/images/large/9.jpg not downloaded yet
2026-03-26 22:53:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ym/db0f079680eb44f3bf891d9282c03069/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F5bc2ff7d3be8415fbb7f9372307b90e6%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/5bc2ff7d3be8415fbb7f9372307b90e6/images/large/10.jpg not downloaded yet
2026-03-26 22:53:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/5bc2ff7d3be8415fbb7f9372307b90e6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/5bc2ff7d3be8415fbb7f9372307b90e6/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:57 [ayvens.be] INFO: Found listing with ID: 1985525
2026-03-26 22:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985525%27 HTTP/1.1" 200 None
2026-03-26 22:53:57 [ayvens.be] INFO: Scrape type for 1985525: 1
2026-03-26 22:53:57 [ayvens.be] INFO: Extracting data for car ID: 1985525
2026-03-26 22:53:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5fcacad-3aa7-52cc-8512-022af3058dd6 with identifier: 1985525
2026-03-26 22:53:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5fcacad-3aa7-52cc-8512-022af3058dd6 with scrape type 1
2026-03-26 22:53:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f5fcacad-3aa7-52cc-8512-022af3058dd6
2026-03-26 22:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F62975f0e776945de91bb22f1371cc30a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/62975f0e776945de91bb22f1371cc30a/images/large/1.jpg not downloaded yet
2026-03-26 22:53:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/5bc2ff7d3be8415fbb7f9372307b90e6/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F62975f0e776945de91bb22f1371cc30a%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/62975f0e776945de91bb22f1371cc30a/images/large/2.jpg not downloaded yet
2026-03-26 22:53:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74adb90>
2026-03-26 22:53:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e6a832f-1230-5bff-acc6-21ed6777f720/8e6a832f-1230-5bff-acc6-21ed6777f720_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252Fdb0f079680eb44f3bf891d9282c03069%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/db0f079680eb44f3bf891d9282c03069/images/large/10.jpg saved to cache
2026-03-26 22:53:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8e6a832f-1230-5bff-acc6-21ed6777f720
2026-03-26 22:53:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd3b9bd0>
2026-03-26 22:53:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e6a832f-1230-5bff-acc6-21ed6777f720/8e6a832f-1230-5bff-acc6-21ed6777f720_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252Fdb0f079680eb44f3bf891d9282c03069%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/db0f079680eb44f3bf891d9282c03069/images/large/9.jpg saved to cache
2026-03-26 22:53:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8e6a832f-1230-5bff-acc6-21ed6777f720
2026-03-26 22:53:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/5bc2ff7d3be8415fbb7f9372307b90e6/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F62975f0e776945de91bb22f1371cc30a%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/62975f0e776945de91bb22f1371cc30a/images/large/3.jpg not downloaded yet
2026-03-26 22:53:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/5bc2ff7d3be8415fbb7f9372307b90e6/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7413890>
2026-03-26 22:53:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e6a832f-1230-5bff-acc6-21ed6777f720/8e6a832f-1230-5bff-acc6-21ed6777f720_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252Fdb0f079680eb44f3bf891d9282c03069%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/db0f079680eb44f3bf891d9282c03069/images/large/8.jpg saved to cache
2026-03-26 22:53:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8e6a832f-1230-5bff-acc6-21ed6777f720
2026-03-26 22:53:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8e6a832f-1230-5bff-acc6-21ed6777f720, skipping ID generation
2026-03-26 22:53:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e6a832f-1230-5bff-acc6-21ed6777f720 with scrape type 1
2026-03-26 22:53:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8e6a832f-1230-5bff-acc6-21ed6777f720 sending to next pipeline
2026-03-26 22:53:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 8e6a832f-1230-5bff-acc6-21ed6777f720, identifier: 1985523
2026-03-26 22:53:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd844990>
2026-03-26 22:53:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee3085e8-c9ce-5699-aee1-9123a41beb5e/ee3085e8-c9ce-5699-aee1-9123a41beb5e_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F5bc2ff7d3be8415fbb7f9372307b90e6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/5bc2ff7d3be8415fbb7f9372307b90e6/images/large/1.jpg saved to cache
2026-03-26 22:53:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ee3085e8-c9ce-5699-aee1-9123a41beb5e
2026-03-26 22:53:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79a7490>
2026-03-26 22:53:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee3085e8-c9ce-5699-aee1-9123a41beb5e/ee3085e8-c9ce-5699-aee1-9123a41beb5e_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F5bc2ff7d3be8415fbb7f9372307b90e6%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/5bc2ff7d3be8415fbb7f9372307b90e6/images/large/2.jpg saved to cache
2026-03-26 22:53:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ee3085e8-c9ce-5699-aee1-9123a41beb5e
2026-03-26 22:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F62975f0e776945de91bb22f1371cc30a%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/62975f0e776945de91bb22f1371cc30a/images/large/4.jpg not downloaded yet
2026-03-26 22:53:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 8e6a832f-1230-5bff-acc6-21ed6777f720 with identifier: 1985523
2026-03-26 22:53:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 8e6a832f-1230-5bff-acc6-21ed6777f720 with identifier: 1985523
2026-03-26 22:53:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 8e6a832f-1230-5bff-acc6-21ed6777f720 with identifier: 1985523 to the API
2026-03-26 22:53:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:53:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:53:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1ym/db0f079680eb44f3bf891d9282c03069/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '8e6a832f-1230-5bff-acc6-21ed6777f720',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'LAND ROVER',
 'model': 'DISCOVERY SPORT DIESEL - 2019',
 'odometer': 159854,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e6a832f-1230-5bff-acc6-21ed6777f720/8e6a832f-1230-5bff-acc6-21ed6777f720_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 553291,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ym/db0f079680eb44f3bf891d9282c03069/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e6a832f-1230-5bff-acc6-21ed6777f720/8e6a832f-1230-5bff-acc6-21ed6777f720_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 489880,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ym/db0f079680eb44f3bf891d9282c03069/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e6a832f-1230-5bff-acc6-21ed6777f720/8e6a832f-1230-5bff-acc6-21ed6777f720_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 457535,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ym/db0f079680eb44f3bf891d9282c03069/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e6a832f-1230-5bff-acc6-21ed6777f720/8e6a832f-1230-5bff-acc6-21ed6777f720_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 457914,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ym/db0f079680eb44f3bf891d9282c03069/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e6a832f-1230-5bff-acc6-21ed6777f720/8e6a832f-1230-5bff-acc6-21ed6777f720_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 358774,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ym/db0f079680eb44f3bf891d9282c03069/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e6a832f-1230-5bff-acc6-21ed6777f720/8e6a832f-1230-5bff-acc6-21ed6777f720_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 372144,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ym/db0f079680eb44f3bf891d9282c03069/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e6a832f-1230-5bff-acc6-21ed6777f720/8e6a832f-1230-5bff-acc6-21ed6777f720_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 383030,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ym/db0f079680eb44f3bf891d9282c03069/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e6a832f-1230-5bff-acc6-21ed6777f720/8e6a832f-1230-5bff-acc6-21ed6777f720_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 433667,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ym/db0f079680eb44f3bf891d9282c03069/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e6a832f-1230-5bff-acc6-21ed6777f720/8e6a832f-1230-5bff-acc6-21ed6777f720_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 372110,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ym/db0f079680eb44f3bf891d9282c03069/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e6a832f-1230-5bff-acc6-21ed6777f720/8e6a832f-1230-5bff-acc6-21ed6777f720_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 294110,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ym/db0f079680eb44f3bf891d9282c03069/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-08',
 'seats_number': 7,
 'seller_name': None,
 'title': 'LAND ROVER DISCOVERY SPORT DIESEL - 2019 2.0 TD4 4WD SE',
 'transmission': 'automatic',
 'trim': '2.0 TD4 4WD SE',
 'vin': None,
 'year': 2020}
2026-03-26 22:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985523%27 HTTP/1.1" 200 None
2026-03-26 22:53:59 [ayvens.be] INFO: Saving data for 1985523: {'created_time': 1774565639.540221, 'last_price_update_time': 1774565639.540233, 'auction_closing_time': 1774958400.0}
2026-03-26 22:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985523') HTTP/1.1" 204 0
2026-03-26 22:53:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7744490>
2026-03-26 22:53:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee3085e8-c9ce-5699-aee1-9123a41beb5e/ee3085e8-c9ce-5699-aee1-9123a41beb5e_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F5bc2ff7d3be8415fbb7f9372307b90e6%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/5bc2ff7d3be8415fbb7f9372307b90e6/images/large/3.jpg saved to cache
2026-03-26 22:53:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ee3085e8-c9ce-5699-aee1-9123a41beb5e
2026-03-26 22:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F62975f0e776945de91bb22f1371cc30a%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/62975f0e776945de91bb22f1371cc30a/images/large/5.jpg not downloaded yet
2026-03-26 22:53:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7982850>
2026-03-26 22:53:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee3085e8-c9ce-5699-aee1-9123a41beb5e/ee3085e8-c9ce-5699-aee1-9123a41beb5e_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F5bc2ff7d3be8415fbb7f9372307b90e6%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/5bc2ff7d3be8415fbb7f9372307b90e6/images/large/5.jpg saved to cache
2026-03-26 22:53:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ee3085e8-c9ce-5699-aee1-9123a41beb5e
2026-03-26 22:53:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:53:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7876dd0>
2026-03-26 22:53:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:53:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:53:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:53:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee3085e8-c9ce-5699-aee1-9123a41beb5e/ee3085e8-c9ce-5699-aee1-9123a41beb5e_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F5bc2ff7d3be8415fbb7f9372307b90e6%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:53:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/5bc2ff7d3be8415fbb7f9372307b90e6/images/large/4.jpg saved to cache
2026-03-26 22:53:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ee3085e8-c9ce-5699-aee1-9123a41beb5e
2026-03-26 22:53:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/5bc2ff7d3be8415fbb7f9372307b90e6/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F62975f0e776945de91bb22f1371cc30a%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/62975f0e776945de91bb22f1371cc30a/images/large/6.jpg not downloaded yet
2026-03-26 22:53:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/5bc2ff7d3be8415fbb7f9372307b90e6/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/5bc2ff7d3be8415fbb7f9372307b90e6/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F62975f0e776945de91bb22f1371cc30a%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:53:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/62975f0e776945de91bb22f1371cc30a/images/large/7.jpg not downloaded yet
2026-03-26 22:53:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/5bc2ff7d3be8415fbb7f9372307b90e6/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:53:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/5bc2ff7d3be8415fbb7f9372307b90e6/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F62975f0e776945de91bb22f1371cc30a%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/62975f0e776945de91bb22f1371cc30a/images/large/8.jpg not downloaded yet
2026-03-26 22:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F62975f0e776945de91bb22f1371cc30a%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/62975f0e776945de91bb22f1371cc30a/images/large/9.jpg not downloaded yet
2026-03-26 22:54:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/62975f0e776945de91bb22f1371cc30a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/62975f0e776945de91bb22f1371cc30a/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F62975f0e776945de91bb22f1371cc30a%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/62975f0e776945de91bb22f1371cc30a/images/large/10.jpg not downloaded yet
2026-03-26 22:54:00 [ayvens.be] INFO: Found listing with ID: 1985526
2026-03-26 22:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985526%27 HTTP/1.1" 200 None
2026-03-26 22:54:00 [ayvens.be] INFO: Scrape type for 1985526: 1
2026-03-26 22:54:00 [ayvens.be] INFO: Extracting data for car ID: 1985526
2026-03-26 22:54:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb with identifier: 1985526
2026-03-26 22:54:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb with scrape type 1
2026-03-26 22:54:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb
2026-03-26 22:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F3dfb1a8c91b34780b309e9fdca5c1cfe%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/3dfb1a8c91b34780b309e9fdca5c1cfe/images/large/1.jpg not downloaded yet
2026-03-26 22:54:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b744a5d0>
2026-03-26 22:54:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee3085e8-c9ce-5699-aee1-9123a41beb5e/ee3085e8-c9ce-5699-aee1-9123a41beb5e_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F5bc2ff7d3be8415fbb7f9372307b90e6%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/5bc2ff7d3be8415fbb7f9372307b90e6/images/large/6.jpg saved to cache
2026-03-26 22:54:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ee3085e8-c9ce-5699-aee1-9123a41beb5e
2026-03-26 22:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F3dfb1a8c91b34780b309e9fdca5c1cfe%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/3dfb1a8c91b34780b309e9fdca5c1cfe/images/large/2.jpg not downloaded yet
2026-03-26 22:54:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/62975f0e776945de91bb22f1371cc30a/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F3dfb1a8c91b34780b309e9fdca5c1cfe%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/3dfb1a8c91b34780b309e9fdca5c1cfe/images/large/3.jpg not downloaded yet
2026-03-26 22:54:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7aa0410>
2026-03-26 22:54:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee3085e8-c9ce-5699-aee1-9123a41beb5e/ee3085e8-c9ce-5699-aee1-9123a41beb5e_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F5bc2ff7d3be8415fbb7f9372307b90e6%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/5bc2ff7d3be8415fbb7f9372307b90e6/images/large/7.jpg saved to cache
2026-03-26 22:54:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ee3085e8-c9ce-5699-aee1-9123a41beb5e
2026-03-26 22:54:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b792c390>
2026-03-26 22:54:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee3085e8-c9ce-5699-aee1-9123a41beb5e/ee3085e8-c9ce-5699-aee1-9123a41beb5e_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F5bc2ff7d3be8415fbb7f9372307b90e6%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/5bc2ff7d3be8415fbb7f9372307b90e6/images/large/8.jpg saved to cache
2026-03-26 22:54:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ee3085e8-c9ce-5699-aee1-9123a41beb5e
2026-03-26 22:54:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74cd290>
2026-03-26 22:54:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee3085e8-c9ce-5699-aee1-9123a41beb5e/ee3085e8-c9ce-5699-aee1-9123a41beb5e_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F5bc2ff7d3be8415fbb7f9372307b90e6%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/5bc2ff7d3be8415fbb7f9372307b90e6/images/large/9.jpg saved to cache
2026-03-26 22:54:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ee3085e8-c9ce-5699-aee1-9123a41beb5e
2026-03-26 22:54:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7483e50>
2026-03-26 22:54:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee3085e8-c9ce-5699-aee1-9123a41beb5e/ee3085e8-c9ce-5699-aee1-9123a41beb5e_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F5bc2ff7d3be8415fbb7f9372307b90e6%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/5bc2ff7d3be8415fbb7f9372307b90e6/images/large/10.jpg saved to cache
2026-03-26 22:54:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ee3085e8-c9ce-5699-aee1-9123a41beb5e
2026-03-26 22:54:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ee3085e8-c9ce-5699-aee1-9123a41beb5e, skipping ID generation
2026-03-26 22:54:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee3085e8-c9ce-5699-aee1-9123a41beb5e with scrape type 1
2026-03-26 22:54:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ee3085e8-c9ce-5699-aee1-9123a41beb5e sending to next pipeline
2026-03-26 22:54:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: ee3085e8-c9ce-5699-aee1-9123a41beb5e, identifier: 1985524
2026-03-26 22:54:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e131d0>
2026-03-26 22:54:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5fcacad-3aa7-52cc-8512-022af3058dd6/f5fcacad-3aa7-52cc-8512-022af3058dd6_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F62975f0e776945de91bb22f1371cc30a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/62975f0e776945de91bb22f1371cc30a/images/large/1.jpg saved to cache
2026-03-26 22:54:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f5fcacad-3aa7-52cc-8512-022af3058dd6
2026-03-26 22:54:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7493a90>
2026-03-26 22:54:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5fcacad-3aa7-52cc-8512-022af3058dd6/f5fcacad-3aa7-52cc-8512-022af3058dd6_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F62975f0e776945de91bb22f1371cc30a%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/62975f0e776945de91bb22f1371cc30a/images/large/2.jpg saved to cache
2026-03-26 22:54:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f5fcacad-3aa7-52cc-8512-022af3058dd6
2026-03-26 22:54:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: ee3085e8-c9ce-5699-aee1-9123a41beb5e with identifier: 1985524
2026-03-26 22:54:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: ee3085e8-c9ce-5699-aee1-9123a41beb5e with identifier: 1985524
2026-03-26 22:54:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: ee3085e8-c9ce-5699-aee1-9123a41beb5e with identifier: 1985524 to the API
2026-03-26 22:54:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:54:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:54:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yq/5bc2ff7d3be8415fbb7f9372307b90e6/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'ee3085e8-c9ce-5699-aee1-9123a41beb5e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '3 SERIES TOURING',
 'odometer': 175784,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee3085e8-c9ce-5699-aee1-9123a41beb5e/ee3085e8-c9ce-5699-aee1-9123a41beb5e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 593531,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/5bc2ff7d3be8415fbb7f9372307b90e6/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee3085e8-c9ce-5699-aee1-9123a41beb5e/ee3085e8-c9ce-5699-aee1-9123a41beb5e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 598310,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/5bc2ff7d3be8415fbb7f9372307b90e6/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee3085e8-c9ce-5699-aee1-9123a41beb5e/ee3085e8-c9ce-5699-aee1-9123a41beb5e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 569551,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/5bc2ff7d3be8415fbb7f9372307b90e6/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee3085e8-c9ce-5699-aee1-9123a41beb5e/ee3085e8-c9ce-5699-aee1-9123a41beb5e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 643746,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/5bc2ff7d3be8415fbb7f9372307b90e6/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee3085e8-c9ce-5699-aee1-9123a41beb5e/ee3085e8-c9ce-5699-aee1-9123a41beb5e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 581907,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/5bc2ff7d3be8415fbb7f9372307b90e6/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee3085e8-c9ce-5699-aee1-9123a41beb5e/ee3085e8-c9ce-5699-aee1-9123a41beb5e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 541378,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/5bc2ff7d3be8415fbb7f9372307b90e6/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee3085e8-c9ce-5699-aee1-9123a41beb5e/ee3085e8-c9ce-5699-aee1-9123a41beb5e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 642003,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/5bc2ff7d3be8415fbb7f9372307b90e6/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee3085e8-c9ce-5699-aee1-9123a41beb5e/ee3085e8-c9ce-5699-aee1-9123a41beb5e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 604990,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/5bc2ff7d3be8415fbb7f9372307b90e6/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee3085e8-c9ce-5699-aee1-9123a41beb5e/ee3085e8-c9ce-5699-aee1-9123a41beb5e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 567312,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/5bc2ff7d3be8415fbb7f9372307b90e6/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee3085e8-c9ce-5699-aee1-9123a41beb5e/ee3085e8-c9ce-5699-aee1-9123a41beb5e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 571181,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/5bc2ff7d3be8415fbb7f9372307b90e6/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3 SERIES TOURING 2.0 330E (215KW) TOURING',
 'transmission': 'automatic',
 'trim': '2.0 330E (215KW) TOURING',
 'vin': None,
 'year': 2020}
2026-03-26 22:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985524%27 HTTP/1.1" 200 None
2026-03-26 22:54:01 [ayvens.be] INFO: Saving data for 1985524: {'created_time': 1774565641.151135, 'last_price_update_time': 1774565641.151147, 'auction_closing_time': 1774958400.0}
2026-03-26 22:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985524') HTTP/1.1" 204 0
2026-03-26 22:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F3dfb1a8c91b34780b309e9fdca5c1cfe%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/3dfb1a8c91b34780b309e9fdca5c1cfe/images/large/4.jpg not downloaded yet
2026-03-26 22:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F3dfb1a8c91b34780b309e9fdca5c1cfe%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/3dfb1a8c91b34780b309e9fdca5c1cfe/images/large/5.jpg not downloaded yet
2026-03-26 22:54:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/62975f0e776945de91bb22f1371cc30a/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7494a90>
2026-03-26 22:54:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5fcacad-3aa7-52cc-8512-022af3058dd6/f5fcacad-3aa7-52cc-8512-022af3058dd6_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F62975f0e776945de91bb22f1371cc30a%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/62975f0e776945de91bb22f1371cc30a/images/large/3.jpg saved to cache
2026-03-26 22:54:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f5fcacad-3aa7-52cc-8512-022af3058dd6
2026-03-26 22:54:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/62975f0e776945de91bb22f1371cc30a/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F3dfb1a8c91b34780b309e9fdca5c1cfe%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/3dfb1a8c91b34780b309e9fdca5c1cfe/images/large/6.jpg not downloaded yet
2026-03-26 22:54:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/62975f0e776945de91bb22f1371cc30a/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/62975f0e776945de91bb22f1371cc30a/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/62975f0e776945de91bb22f1371cc30a/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F3dfb1a8c91b34780b309e9fdca5c1cfe%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/3dfb1a8c91b34780b309e9fdca5c1cfe/images/large/7.jpg not downloaded yet
2026-03-26 22:54:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/62975f0e776945de91bb22f1371cc30a/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/62975f0e776945de91bb22f1371cc30a/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F3dfb1a8c91b34780b309e9fdca5c1cfe%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/3dfb1a8c91b34780b309e9fdca5c1cfe/images/large/8.jpg not downloaded yet
2026-03-26 22:54:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/3dfb1a8c91b34780b309e9fdca5c1cfe/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7571b10>
2026-03-26 22:54:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5fcacad-3aa7-52cc-8512-022af3058dd6/f5fcacad-3aa7-52cc-8512-022af3058dd6_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F62975f0e776945de91bb22f1371cc30a%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/62975f0e776945de91bb22f1371cc30a/images/large/4.jpg saved to cache
2026-03-26 22:54:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f5fcacad-3aa7-52cc-8512-022af3058dd6
2026-03-26 22:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F3dfb1a8c91b34780b309e9fdca5c1cfe%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/3dfb1a8c91b34780b309e9fdca5c1cfe/images/large/9.jpg not downloaded yet
2026-03-26 22:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F3dfb1a8c91b34780b309e9fdca5c1cfe%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/3dfb1a8c91b34780b309e9fdca5c1cfe/images/large/10.jpg not downloaded yet
2026-03-26 22:54:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7770790>
2026-03-26 22:54:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5fcacad-3aa7-52cc-8512-022af3058dd6/f5fcacad-3aa7-52cc-8512-022af3058dd6_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F62975f0e776945de91bb22f1371cc30a%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/62975f0e776945de91bb22f1371cc30a/images/large/6.jpg saved to cache
2026-03-26 22:54:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f5fcacad-3aa7-52cc-8512-022af3058dd6
2026-03-26 22:54:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd3bbbd0>
2026-03-26 22:54:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5fcacad-3aa7-52cc-8512-022af3058dd6/f5fcacad-3aa7-52cc-8512-022af3058dd6_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F62975f0e776945de91bb22f1371cc30a%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/62975f0e776945de91bb22f1371cc30a/images/large/5.jpg saved to cache
2026-03-26 22:54:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f5fcacad-3aa7-52cc-8512-022af3058dd6
2026-03-26 22:54:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cc17d0>
2026-03-26 22:54:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5fcacad-3aa7-52cc-8512-022af3058dd6/f5fcacad-3aa7-52cc-8512-022af3058dd6_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F62975f0e776945de91bb22f1371cc30a%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/62975f0e776945de91bb22f1371cc30a/images/large/9.jpg saved to cache
2026-03-26 22:54:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f5fcacad-3aa7-52cc-8512-022af3058dd6
2026-03-26 22:54:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76e1590>
2026-03-26 22:54:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5fcacad-3aa7-52cc-8512-022af3058dd6/f5fcacad-3aa7-52cc-8512-022af3058dd6_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F62975f0e776945de91bb22f1371cc30a%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/62975f0e776945de91bb22f1371cc30a/images/large/7.jpg saved to cache
2026-03-26 22:54:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f5fcacad-3aa7-52cc-8512-022af3058dd6
2026-03-26 22:54:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cc38d0>
2026-03-26 22:54:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5fcacad-3aa7-52cc-8512-022af3058dd6/f5fcacad-3aa7-52cc-8512-022af3058dd6_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F62975f0e776945de91bb22f1371cc30a%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/62975f0e776945de91bb22f1371cc30a/images/large/8.jpg saved to cache
2026-03-26 22:54:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f5fcacad-3aa7-52cc-8512-022af3058dd6
2026-03-26 22:54:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd3bb250>
2026-03-26 22:54:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5fcacad-3aa7-52cc-8512-022af3058dd6/f5fcacad-3aa7-52cc-8512-022af3058dd6_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F62975f0e776945de91bb22f1371cc30a%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/62975f0e776945de91bb22f1371cc30a/images/large/10.jpg saved to cache
2026-03-26 22:54:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f5fcacad-3aa7-52cc-8512-022af3058dd6
2026-03-26 22:54:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f5fcacad-3aa7-52cc-8512-022af3058dd6, skipping ID generation
2026-03-26 22:54:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5fcacad-3aa7-52cc-8512-022af3058dd6 with scrape type 1
2026-03-26 22:54:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f5fcacad-3aa7-52cc-8512-022af3058dd6 sending to next pipeline
2026-03-26 22:54:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f5fcacad-3aa7-52cc-8512-022af3058dd6, identifier: 1985525
2026-03-26 22:54:02 [ayvens.be] INFO: Found listing with ID: 1985527
2026-03-26 22:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985527%27 HTTP/1.1" 200 None
2026-03-26 22:54:02 [ayvens.be] INFO: Scrape type for 1985527: 1
2026-03-26 22:54:02 [ayvens.be] INFO: Extracting data for car ID: 1985527
2026-03-26 22:54:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b38844c-bcca-5b09-a0a3-8a407706a5e1 with identifier: 1985527
2026-03-26 22:54:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b38844c-bcca-5b09-a0a3-8a407706a5e1 with scrape type 1
2026-03-26 22:54:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7b38844c-bcca-5b09-a0a3-8a407706a5e1
2026-03-26 22:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2am%252F1527965bcb8e40f7bc4edebae282b0d0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2am/1527965bcb8e40f7bc4edebae282b0d0/images/large/1.jpg not downloaded yet
2026-03-26 22:54:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f5fcacad-3aa7-52cc-8512-022af3058dd6 with identifier: 1985525
2026-03-26 22:54:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f5fcacad-3aa7-52cc-8512-022af3058dd6 with identifier: 1985525
2026-03-26 22:54:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f5fcacad-3aa7-52cc-8512-022af3058dd6 with identifier: 1985525 to the API
2026-03-26 22:54:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:54:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:54:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bg/62975f0e776945de91bb22f1371cc30a/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'f5fcacad-3aa7-52cc-8512-022af3058dd6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X2',
 'odometer': 98914,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5fcacad-3aa7-52cc-8512-022af3058dd6/f5fcacad-3aa7-52cc-8512-022af3058dd6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 655711,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/62975f0e776945de91bb22f1371cc30a/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5fcacad-3aa7-52cc-8512-022af3058dd6/f5fcacad-3aa7-52cc-8512-022af3058dd6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 625727,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/62975f0e776945de91bb22f1371cc30a/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5fcacad-3aa7-52cc-8512-022af3058dd6/f5fcacad-3aa7-52cc-8512-022af3058dd6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 715941,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/62975f0e776945de91bb22f1371cc30a/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5fcacad-3aa7-52cc-8512-022af3058dd6/f5fcacad-3aa7-52cc-8512-022af3058dd6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 662246,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/62975f0e776945de91bb22f1371cc30a/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5fcacad-3aa7-52cc-8512-022af3058dd6/f5fcacad-3aa7-52cc-8512-022af3058dd6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 642366,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/62975f0e776945de91bb22f1371cc30a/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5fcacad-3aa7-52cc-8512-022af3058dd6/f5fcacad-3aa7-52cc-8512-022af3058dd6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 578227,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/62975f0e776945de91bb22f1371cc30a/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5fcacad-3aa7-52cc-8512-022af3058dd6/f5fcacad-3aa7-52cc-8512-022af3058dd6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 698293,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/62975f0e776945de91bb22f1371cc30a/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5fcacad-3aa7-52cc-8512-022af3058dd6/f5fcacad-3aa7-52cc-8512-022af3058dd6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 672930,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/62975f0e776945de91bb22f1371cc30a/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5fcacad-3aa7-52cc-8512-022af3058dd6/f5fcacad-3aa7-52cc-8512-022af3058dd6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 568380,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/62975f0e776945de91bb22f1371cc30a/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5fcacad-3aa7-52cc-8512-022af3058dd6/f5fcacad-3aa7-52cc-8512-022af3058dd6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 561563,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/62975f0e776945de91bb22f1371cc30a/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X2 1.5 SDRIVE18I 100KW',
 'transmission': 'manual',
 'trim': '1.5 SDRIVE18I 100KW',
 'vin': None,
 'year': 2021}
2026-03-26 22:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985525%27 HTTP/1.1" 200 None
2026-03-26 22:54:02 [ayvens.be] INFO: Saving data for 1985525: {'created_time': 1774565642.74045, 'last_price_update_time': 1774565642.740459, 'auction_closing_time': 1774958400.0}
2026-03-26 22:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985525') HTTP/1.1" 204 0
2026-03-26 22:54:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b741ce50>
2026-03-26 22:54:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb/1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F3dfb1a8c91b34780b309e9fdca5c1cfe%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/3dfb1a8c91b34780b309e9fdca5c1cfe/images/large/1.jpg saved to cache
2026-03-26 22:54:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb
2026-03-26 22:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2am%252F1527965bcb8e40f7bc4edebae282b0d0%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2am/1527965bcb8e40f7bc4edebae282b0d0/images/large/2.jpg not downloaded yet
2026-03-26 22:54:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/3dfb1a8c91b34780b309e9fdca5c1cfe/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2am%252F1527965bcb8e40f7bc4edebae282b0d0%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2am/1527965bcb8e40f7bc4edebae282b0d0/images/large/3.jpg not downloaded yet
2026-03-26 22:54:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/3dfb1a8c91b34780b309e9fdca5c1cfe/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2am%252F1527965bcb8e40f7bc4edebae282b0d0%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2am/1527965bcb8e40f7bc4edebae282b0d0/images/large/4.jpg not downloaded yet
2026-03-26 22:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2am%252F1527965bcb8e40f7bc4edebae282b0d0%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2am/1527965bcb8e40f7bc4edebae282b0d0/images/large/5.jpg not downloaded yet
2026-03-26 22:54:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/3dfb1a8c91b34780b309e9fdca5c1cfe/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/3dfb1a8c91b34780b309e9fdca5c1cfe/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/3dfb1a8c91b34780b309e9fdca5c1cfe/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2am%252F1527965bcb8e40f7bc4edebae282b0d0%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2am/1527965bcb8e40f7bc4edebae282b0d0/images/large/6.jpg not downloaded yet
2026-03-26 22:54:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/3dfb1a8c91b34780b309e9fdca5c1cfe/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/3dfb1a8c91b34780b309e9fdca5c1cfe/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2am%252F1527965bcb8e40f7bc4edebae282b0d0%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2am/1527965bcb8e40f7bc4edebae282b0d0/images/large/7.jpg not downloaded yet
2026-03-26 22:54:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/3dfb1a8c91b34780b309e9fdca5c1cfe/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2am%252F1527965bcb8e40f7bc4edebae282b0d0%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2am/1527965bcb8e40f7bc4edebae282b0d0/images/large/8.jpg not downloaded yet
2026-03-26 22:54:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77eba90>
2026-03-26 22:54:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb/1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F3dfb1a8c91b34780b309e9fdca5c1cfe%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/3dfb1a8c91b34780b309e9fdca5c1cfe/images/large/2.jpg saved to cache
2026-03-26 22:54:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb
2026-03-26 22:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2am%252F1527965bcb8e40f7bc4edebae282b0d0%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2am/1527965bcb8e40f7bc4edebae282b0d0/images/large/9.jpg not downloaded yet
2026-03-26 22:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2am%252F1527965bcb8e40f7bc4edebae282b0d0%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2am/1527965bcb8e40f7bc4edebae282b0d0/images/large/10.jpg not downloaded yet
2026-03-26 22:54:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7ae9f90>
2026-03-26 22:54:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb/1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F3dfb1a8c91b34780b309e9fdca5c1cfe%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/3dfb1a8c91b34780b309e9fdca5c1cfe/images/large/4.jpg saved to cache
2026-03-26 22:54:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb
2026-03-26 22:54:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b741ccd0>
2026-03-26 22:54:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb/1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F3dfb1a8c91b34780b309e9fdca5c1cfe%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/3dfb1a8c91b34780b309e9fdca5c1cfe/images/large/3.jpg saved to cache
2026-03-26 22:54:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb
2026-03-26 22:54:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e1de10>
2026-03-26 22:54:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb/1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F3dfb1a8c91b34780b309e9fdca5c1cfe%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/3dfb1a8c91b34780b309e9fdca5c1cfe/images/large/5.jpg saved to cache
2026-03-26 22:54:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb
2026-03-26 22:54:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b78ab390>
2026-03-26 22:54:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb/1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F3dfb1a8c91b34780b309e9fdca5c1cfe%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/3dfb1a8c91b34780b309e9fdca5c1cfe/images/large/6.jpg saved to cache
2026-03-26 22:54:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb
2026-03-26 22:54:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b741ea90>
2026-03-26 22:54:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb/1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F3dfb1a8c91b34780b309e9fdca5c1cfe%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/3dfb1a8c91b34780b309e9fdca5c1cfe/images/large/7.jpg saved to cache
2026-03-26 22:54:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb
2026-03-26 22:54:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79f9150>
2026-03-26 22:54:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb/1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F3dfb1a8c91b34780b309e9fdca5c1cfe%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/3dfb1a8c91b34780b309e9fdca5c1cfe/images/large/8.jpg saved to cache
2026-03-26 22:54:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb
2026-03-26 22:54:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74957d0>
2026-03-26 22:54:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb/1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F3dfb1a8c91b34780b309e9fdca5c1cfe%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/3dfb1a8c91b34780b309e9fdca5c1cfe/images/large/9.jpg saved to cache
2026-03-26 22:54:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb
2026-03-26 22:54:03 [ayvens.be] INFO: Found listing with ID: 1985528
2026-03-26 22:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985528%27 HTTP/1.1" 200 None
2026-03-26 22:54:03 [ayvens.be] INFO: Scrape type for 1985528: 1
2026-03-26 22:54:03 [ayvens.be] INFO: Extracting data for car ID: 1985528
2026-03-26 22:54:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2c7514b-09d5-589b-9f34-16877c439323 with identifier: 1985528
2026-03-26 22:54:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2c7514b-09d5-589b-9f34-16877c439323 with scrape type 1
2026-03-26 22:54:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d2c7514b-09d5-589b-9f34-16877c439323
2026-03-26 22:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ww%252F7ef38d41ab854b93a4a617275f14c7e6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ww/7ef38d41ab854b93a4a617275f14c7e6/images/large/1.jpg not downloaded yet
2026-03-26 22:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ww%252F7ef38d41ab854b93a4a617275f14c7e6%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ww/7ef38d41ab854b93a4a617275f14c7e6/images/large/2.jpg not downloaded yet
2026-03-26 22:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ww%252F7ef38d41ab854b93a4a617275f14c7e6%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ww/7ef38d41ab854b93a4a617275f14c7e6/images/large/3.jpg not downloaded yet
2026-03-26 22:54:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2am/1527965bcb8e40f7bc4edebae282b0d0/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2am/1527965bcb8e40f7bc4edebae282b0d0/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ww%252F7ef38d41ab854b93a4a617275f14c7e6%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ww/7ef38d41ab854b93a4a617275f14c7e6/images/large/4.jpg not downloaded yet
2026-03-26 22:54:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2am/1527965bcb8e40f7bc4edebae282b0d0/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2am/1527965bcb8e40f7bc4edebae282b0d0/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2am/1527965bcb8e40f7bc4edebae282b0d0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2am/1527965bcb8e40f7bc4edebae282b0d0/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ww%252F7ef38d41ab854b93a4a617275f14c7e6%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ww/7ef38d41ab854b93a4a617275f14c7e6/images/large/5.jpg not downloaded yet
2026-03-26 22:54:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/3dfb1a8c91b34780b309e9fdca5c1cfe/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ww%252F7ef38d41ab854b93a4a617275f14c7e6%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ww/7ef38d41ab854b93a4a617275f14c7e6/images/large/6.jpg not downloaded yet
2026-03-26 22:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ww%252F7ef38d41ab854b93a4a617275f14c7e6%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ww/7ef38d41ab854b93a4a617275f14c7e6/images/large/7.jpg not downloaded yet
2026-03-26 22:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ww%252F7ef38d41ab854b93a4a617275f14c7e6%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ww/7ef38d41ab854b93a4a617275f14c7e6/images/large/8.jpg not downloaded yet
2026-03-26 22:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ww%252F7ef38d41ab854b93a4a617275f14c7e6%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ww/7ef38d41ab854b93a4a617275f14c7e6/images/large/9.jpg not downloaded yet
2026-03-26 22:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ww%252F7ef38d41ab854b93a4a617275f14c7e6%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ww/7ef38d41ab854b93a4a617275f14c7e6/images/large/10.jpg not downloaded yet
2026-03-26 22:54:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ww/7ef38d41ab854b93a4a617275f14c7e6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b745b050>
2026-03-26 22:54:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b38844c-bcca-5b09-a0a3-8a407706a5e1/7b38844c-bcca-5b09-a0a3-8a407706a5e1_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2am%252F1527965bcb8e40f7bc4edebae282b0d0%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2am/1527965bcb8e40f7bc4edebae282b0d0/images/large/4.jpg saved to cache
2026-03-26 22:54:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7b38844c-bcca-5b09-a0a3-8a407706a5e1
2026-03-26 22:54:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76e0350>
2026-03-26 22:54:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b38844c-bcca-5b09-a0a3-8a407706a5e1/7b38844c-bcca-5b09-a0a3-8a407706a5e1_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2am%252F1527965bcb8e40f7bc4edebae282b0d0%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2am/1527965bcb8e40f7bc4edebae282b0d0/images/large/5.jpg saved to cache
2026-03-26 22:54:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7b38844c-bcca-5b09-a0a3-8a407706a5e1
2026-03-26 22:54:04 [ayvens.be] INFO: Found listing with ID: 1985529
2026-03-26 22:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985529%27 HTTP/1.1" 200 None
2026-03-26 22:54:04 [ayvens.be] INFO: Scrape type for 1985529: 1
2026-03-26 22:54:04 [ayvens.be] INFO: Extracting data for car ID: 1985529
2026-03-26 22:54:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bce4c819-f0b8-5c83-9a10-a643842c4e5e with identifier: 1985529
2026-03-26 22:54:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bce4c819-f0b8-5c83-9a10-a643842c4e5e with scrape type 1
2026-03-26 22:54:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bce4c819-f0b8-5c83-9a10-a643842c4e5e
2026-03-26 22:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F21a0211cf6a6404c9018a4a20cb107a9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/21a0211cf6a6404c9018a4a20cb107a9/images/large/1.jpg not downloaded yet
2026-03-26 22:54:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b745a2d0>
2026-03-26 22:54:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b38844c-bcca-5b09-a0a3-8a407706a5e1/7b38844c-bcca-5b09-a0a3-8a407706a5e1_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2am%252F1527965bcb8e40f7bc4edebae282b0d0%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2am/1527965bcb8e40f7bc4edebae282b0d0/images/large/3.jpg saved to cache
2026-03-26 22:54:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7b38844c-bcca-5b09-a0a3-8a407706a5e1
2026-03-26 22:54:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79f1410>
2026-03-26 22:54:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b38844c-bcca-5b09-a0a3-8a407706a5e1/7b38844c-bcca-5b09-a0a3-8a407706a5e1_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2am%252F1527965bcb8e40f7bc4edebae282b0d0%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2am/1527965bcb8e40f7bc4edebae282b0d0/images/large/6.jpg saved to cache
2026-03-26 22:54:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7b38844c-bcca-5b09-a0a3-8a407706a5e1
2026-03-26 22:54:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd3ba8d0>
2026-03-26 22:54:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b38844c-bcca-5b09-a0a3-8a407706a5e1/7b38844c-bcca-5b09-a0a3-8a407706a5e1_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2am%252F1527965bcb8e40f7bc4edebae282b0d0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2am/1527965bcb8e40f7bc4edebae282b0d0/images/large/1.jpg saved to cache
2026-03-26 22:54:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7b38844c-bcca-5b09-a0a3-8a407706a5e1
2026-03-26 22:54:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b745bc90>
2026-03-26 22:54:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b38844c-bcca-5b09-a0a3-8a407706a5e1/7b38844c-bcca-5b09-a0a3-8a407706a5e1_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2am%252F1527965bcb8e40f7bc4edebae282b0d0%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2am/1527965bcb8e40f7bc4edebae282b0d0/images/large/2.jpg saved to cache
2026-03-26 22:54:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7b38844c-bcca-5b09-a0a3-8a407706a5e1
2026-03-26 22:54:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ww/7ef38d41ab854b93a4a617275f14c7e6/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F21a0211cf6a6404c9018a4a20cb107a9%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/21a0211cf6a6404c9018a4a20cb107a9/images/large/2.jpg not downloaded yet
2026-03-26 22:54:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ww/7ef38d41ab854b93a4a617275f14c7e6/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ww/7ef38d41ab854b93a4a617275f14c7e6/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F21a0211cf6a6404c9018a4a20cb107a9%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/21a0211cf6a6404c9018a4a20cb107a9/images/large/3.jpg not downloaded yet
2026-03-26 22:54:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b787f990>
2026-03-26 22:54:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb/1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F3dfb1a8c91b34780b309e9fdca5c1cfe%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/3dfb1a8c91b34780b309e9fdca5c1cfe/images/large/10.jpg saved to cache
2026-03-26 22:54:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb
2026-03-26 22:54:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb, skipping ID generation
2026-03-26 22:54:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb with scrape type 1
2026-03-26 22:54:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb sending to next pipeline
2026-03-26 22:54:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb, identifier: 1985526
2026-03-26 22:54:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b727add0>
2026-03-26 22:54:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2c7514b-09d5-589b-9f34-16877c439323/d2c7514b-09d5-589b-9f34-16877c439323_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ww%252F7ef38d41ab854b93a4a617275f14c7e6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ww/7ef38d41ab854b93a4a617275f14c7e6/images/large/1.jpg saved to cache
2026-03-26 22:54:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d2c7514b-09d5-589b-9f34-16877c439323
2026-03-26 22:54:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb with identifier: 1985526
2026-03-26 22:54:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb with identifier: 1985526
2026-03-26 22:54:05 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb with identifier: 1985526 to the API
2026-03-26 22:54:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:54:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:54:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bl/3dfb1a8c91b34780b309e9fdca5c1cfe/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'MEGANE BERLINE',
 'odometer': 68306,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb/1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 573565,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/3dfb1a8c91b34780b309e9fdca5c1cfe/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb/1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 520655,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/3dfb1a8c91b34780b309e9fdca5c1cfe/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb/1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 573017,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/3dfb1a8c91b34780b309e9fdca5c1cfe/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb/1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 576820,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/3dfb1a8c91b34780b309e9fdca5c1cfe/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb/1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 548147,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/3dfb1a8c91b34780b309e9fdca5c1cfe/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb/1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 619340,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/3dfb1a8c91b34780b309e9fdca5c1cfe/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb/1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 634601,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/3dfb1a8c91b34780b309e9fdca5c1cfe/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb/1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 700885,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/3dfb1a8c91b34780b309e9fdca5c1cfe/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb/1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 750345,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/3dfb1a8c91b34780b309e9fdca5c1cfe/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb/1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 756330,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/3dfb1a8c91b34780b309e9fdca5c1cfe/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT MEGANE BERLINE 1.6 E-TECH 160 PHEV INTENS',
 'transmission': 'automatic',
 'trim': '1.6 E-TECH 160 PHEV INTENS',
 'vin': None,
 'year': 2021}
2026-03-26 22:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985526%27 HTTP/1.1" 200 None
2026-03-26 22:54:05 [ayvens.be] INFO: Saving data for 1985526: {'created_time': 1774565645.449418, 'last_price_update_time': 1774565645.449428, 'auction_closing_time': 1774958400.0}
2026-03-26 22:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985526') HTTP/1.1" 204 0
2026-03-26 22:54:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ww/7ef38d41ab854b93a4a617275f14c7e6/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F21a0211cf6a6404c9018a4a20cb107a9%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/21a0211cf6a6404c9018a4a20cb107a9/images/large/4.jpg not downloaded yet
2026-03-26 22:54:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2am/1527965bcb8e40f7bc4edebae282b0d0/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2am/1527965bcb8e40f7bc4edebae282b0d0/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2am/1527965bcb8e40f7bc4edebae282b0d0/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F21a0211cf6a6404c9018a4a20cb107a9%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/21a0211cf6a6404c9018a4a20cb107a9/images/large/5.jpg not downloaded yet
2026-03-26 22:54:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7caa710>
2026-03-26 22:54:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2c7514b-09d5-589b-9f34-16877c439323/d2c7514b-09d5-589b-9f34-16877c439323_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ww%252F7ef38d41ab854b93a4a617275f14c7e6%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ww/7ef38d41ab854b93a4a617275f14c7e6/images/large/2.jpg saved to cache
2026-03-26 22:54:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d2c7514b-09d5-589b-9f34-16877c439323
2026-03-26 22:54:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7911590>
2026-03-26 22:54:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2c7514b-09d5-589b-9f34-16877c439323/d2c7514b-09d5-589b-9f34-16877c439323_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ww%252F7ef38d41ab854b93a4a617275f14c7e6%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ww/7ef38d41ab854b93a4a617275f14c7e6/images/large/3.jpg saved to cache
2026-03-26 22:54:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d2c7514b-09d5-589b-9f34-16877c439323
2026-03-26 22:54:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6defb10>
2026-03-26 22:54:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2c7514b-09d5-589b-9f34-16877c439323/d2c7514b-09d5-589b-9f34-16877c439323_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ww%252F7ef38d41ab854b93a4a617275f14c7e6%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ww/7ef38d41ab854b93a4a617275f14c7e6/images/large/4.jpg saved to cache
2026-03-26 22:54:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d2c7514b-09d5-589b-9f34-16877c439323
2026-03-26 22:54:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ww/7ef38d41ab854b93a4a617275f14c7e6/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F21a0211cf6a6404c9018a4a20cb107a9%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/21a0211cf6a6404c9018a4a20cb107a9/images/large/6.jpg not downloaded yet
2026-03-26 22:54:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2am/1527965bcb8e40f7bc4edebae282b0d0/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ww/7ef38d41ab854b93a4a617275f14c7e6/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ww/7ef38d41ab854b93a4a617275f14c7e6/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F21a0211cf6a6404c9018a4a20cb107a9%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/21a0211cf6a6404c9018a4a20cb107a9/images/large/7.jpg not downloaded yet
2026-03-26 22:54:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c5ffd0>
2026-03-26 22:54:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2c7514b-09d5-589b-9f34-16877c439323/d2c7514b-09d5-589b-9f34-16877c439323_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ww%252F7ef38d41ab854b93a4a617275f14c7e6%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ww/7ef38d41ab854b93a4a617275f14c7e6/images/large/5.jpg saved to cache
2026-03-26 22:54:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d2c7514b-09d5-589b-9f34-16877c439323
2026-03-26 22:54:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7410250>
2026-03-26 22:54:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b38844c-bcca-5b09-a0a3-8a407706a5e1/7b38844c-bcca-5b09-a0a3-8a407706a5e1_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2am%252F1527965bcb8e40f7bc4edebae282b0d0%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2am/1527965bcb8e40f7bc4edebae282b0d0/images/large/8.jpg saved to cache
2026-03-26 22:54:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7b38844c-bcca-5b09-a0a3-8a407706a5e1
2026-03-26 22:54:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b72ecdd0>
2026-03-26 22:54:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b38844c-bcca-5b09-a0a3-8a407706a5e1/7b38844c-bcca-5b09-a0a3-8a407706a5e1_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2am%252F1527965bcb8e40f7bc4edebae282b0d0%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2am/1527965bcb8e40f7bc4edebae282b0d0/images/large/7.jpg saved to cache
2026-03-26 22:54:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7b38844c-bcca-5b09-a0a3-8a407706a5e1
2026-03-26 22:54:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7412090>
2026-03-26 22:54:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b38844c-bcca-5b09-a0a3-8a407706a5e1/7b38844c-bcca-5b09-a0a3-8a407706a5e1_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2am%252F1527965bcb8e40f7bc4edebae282b0d0%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2am/1527965bcb8e40f7bc4edebae282b0d0/images/large/9.jpg saved to cache
2026-03-26 22:54:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7b38844c-bcca-5b09-a0a3-8a407706a5e1
2026-03-26 22:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F21a0211cf6a6404c9018a4a20cb107a9%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/21a0211cf6a6404c9018a4a20cb107a9/images/large/8.jpg not downloaded yet
2026-03-26 22:54:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6dda350>
2026-03-26 22:54:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2c7514b-09d5-589b-9f34-16877c439323/d2c7514b-09d5-589b-9f34-16877c439323_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ww%252F7ef38d41ab854b93a4a617275f14c7e6%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ww/7ef38d41ab854b93a4a617275f14c7e6/images/large/6.jpg saved to cache
2026-03-26 22:54:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d2c7514b-09d5-589b-9f34-16877c439323
2026-03-26 22:54:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7453dd0>
2026-03-26 22:54:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b38844c-bcca-5b09-a0a3-8a407706a5e1/7b38844c-bcca-5b09-a0a3-8a407706a5e1_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2am%252F1527965bcb8e40f7bc4edebae282b0d0%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2am/1527965bcb8e40f7bc4edebae282b0d0/images/large/10.jpg saved to cache
2026-03-26 22:54:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7b38844c-bcca-5b09-a0a3-8a407706a5e1
2026-03-26 22:54:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7b38844c-bcca-5b09-a0a3-8a407706a5e1, skipping ID generation
2026-03-26 22:54:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b38844c-bcca-5b09-a0a3-8a407706a5e1 with scrape type 1
2026-03-26 22:54:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7b38844c-bcca-5b09-a0a3-8a407706a5e1 sending to next pipeline
2026-03-26 22:54:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 7b38844c-bcca-5b09-a0a3-8a407706a5e1, identifier: 1985527
2026-03-26 22:54:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c6a410>
2026-03-26 22:54:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2c7514b-09d5-589b-9f34-16877c439323/d2c7514b-09d5-589b-9f34-16877c439323_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ww%252F7ef38d41ab854b93a4a617275f14c7e6%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ww/7ef38d41ab854b93a4a617275f14c7e6/images/large/7.jpg saved to cache
2026-03-26 22:54:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d2c7514b-09d5-589b-9f34-16877c439323
2026-03-26 22:54:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd3bab50>
2026-03-26 22:54:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2c7514b-09d5-589b-9f34-16877c439323/d2c7514b-09d5-589b-9f34-16877c439323_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ww%252F7ef38d41ab854b93a4a617275f14c7e6%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ww/7ef38d41ab854b93a4a617275f14c7e6/images/large/8.jpg saved to cache
2026-03-26 22:54:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d2c7514b-09d5-589b-9f34-16877c439323
2026-03-26 22:54:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ww/7ef38d41ab854b93a4a617275f14c7e6/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ww/7ef38d41ab854b93a4a617275f14c7e6/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F21a0211cf6a6404c9018a4a20cb107a9%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/21a0211cf6a6404c9018a4a20cb107a9/images/large/9.jpg not downloaded yet
2026-03-26 22:54:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 7b38844c-bcca-5b09-a0a3-8a407706a5e1 with identifier: 1985527
2026-03-26 22:54:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 7b38844c-bcca-5b09-a0a3-8a407706a5e1 with identifier: 1985527
2026-03-26 22:54:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 7b38844c-bcca-5b09-a0a3-8a407706a5e1 with identifier: 1985527 to the API
2026-03-26 22:54:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:54:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:54:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2am/1527965bcb8e40f7bc4edebae282b0d0/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '7b38844c-bcca-5b09-a0a3-8a407706a5e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'RANGER',
 'odometer': 86144,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b38844c-bcca-5b09-a0a3-8a407706a5e1/7b38844c-bcca-5b09-a0a3-8a407706a5e1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 657648,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2am/1527965bcb8e40f7bc4edebae282b0d0/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b38844c-bcca-5b09-a0a3-8a407706a5e1/7b38844c-bcca-5b09-a0a3-8a407706a5e1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 626270,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2am/1527965bcb8e40f7bc4edebae282b0d0/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b38844c-bcca-5b09-a0a3-8a407706a5e1/7b38844c-bcca-5b09-a0a3-8a407706a5e1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 662817,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2am/1527965bcb8e40f7bc4edebae282b0d0/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b38844c-bcca-5b09-a0a3-8a407706a5e1/7b38844c-bcca-5b09-a0a3-8a407706a5e1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 650753,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2am/1527965bcb8e40f7bc4edebae282b0d0/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b38844c-bcca-5b09-a0a3-8a407706a5e1/7b38844c-bcca-5b09-a0a3-8a407706a5e1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 640328,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2am/1527965bcb8e40f7bc4edebae282b0d0/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b38844c-bcca-5b09-a0a3-8a407706a5e1/7b38844c-bcca-5b09-a0a3-8a407706a5e1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 699640,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2am/1527965bcb8e40f7bc4edebae282b0d0/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b38844c-bcca-5b09-a0a3-8a407706a5e1/7b38844c-bcca-5b09-a0a3-8a407706a5e1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 607114,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2am/1527965bcb8e40f7bc4edebae282b0d0/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b38844c-bcca-5b09-a0a3-8a407706a5e1/7b38844c-bcca-5b09-a0a3-8a407706a5e1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 674223,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2am/1527965bcb8e40f7bc4edebae282b0d0/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b38844c-bcca-5b09-a0a3-8a407706a5e1/7b38844c-bcca-5b09-a0a3-8a407706a5e1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 568609,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2am/1527965bcb8e40f7bc4edebae282b0d0/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b38844c-bcca-5b09-a0a3-8a407706a5e1/7b38844c-bcca-5b09-a0a3-8a407706a5e1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 693143,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2am/1527965bcb8e40f7bc4edebae282b0d0/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD RANGER 2.0 BIT 156KW 4WD D-CAB WILDTRAK AUTO',
 'transmission': 'automatic',
 'trim': '2.0 BIT 156KW 4WD D-CAB WILDTRAK AUTO',
 'vin': None,
 'year': 2021}
2026-03-26 22:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985527%27 HTTP/1.1" 200 None
2026-03-26 22:54:06 [ayvens.be] INFO: Saving data for 1985527: {'created_time': 1774565646.899756, 'last_price_update_time': 1774565646.89977, 'auction_closing_time': 1774958400.0}
2026-03-26 22:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985527') HTTP/1.1" 204 0
2026-03-26 22:54:06 [scrapy.extensions.logstats] INFO: Crawled 8 pages (at 2 pages/min), scraped 308 items (at 35 items/min)
2026-03-26 22:54:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 182MiB
2026-03-26 22:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F21a0211cf6a6404c9018a4a20cb107a9%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/21a0211cf6a6404c9018a4a20cb107a9/images/large/10.jpg not downloaded yet
2026-03-26 22:54:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/21a0211cf6a6404c9018a4a20cb107a9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/21a0211cf6a6404c9018a4a20cb107a9/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:06 [ayvens.be] INFO: Found listing with ID: 1985530
2026-03-26 22:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985530%27 HTTP/1.1" 200 None
2026-03-26 22:54:06 [ayvens.be] INFO: Scrape type for 1985530: 1
2026-03-26 22:54:06 [ayvens.be] INFO: Extracting data for car ID: 1985530
2026-03-26 22:54:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d1e7030-034b-5260-97c9-95ac6c87a369 with identifier: 1985530
2026-03-26 22:54:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d1e7030-034b-5260-97c9-95ac6c87a369 with scrape type 1
2026-03-26 22:54:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8d1e7030-034b-5260-97c9-95ac6c87a369
2026-03-26 22:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F5759686beeed4ffbb40277c44151ccb6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/5759686beeed4ffbb40277c44151ccb6/images/large/1.jpg not downloaded yet
2026-03-26 22:54:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6ddb310>
2026-03-26 22:54:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2c7514b-09d5-589b-9f34-16877c439323/d2c7514b-09d5-589b-9f34-16877c439323_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ww%252F7ef38d41ab854b93a4a617275f14c7e6%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ww/7ef38d41ab854b93a4a617275f14c7e6/images/large/10.jpg saved to cache
2026-03-26 22:54:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d2c7514b-09d5-589b-9f34-16877c439323
2026-03-26 22:54:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b782f610>
2026-03-26 22:54:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2c7514b-09d5-589b-9f34-16877c439323/d2c7514b-09d5-589b-9f34-16877c439323_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ww%252F7ef38d41ab854b93a4a617275f14c7e6%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ww/7ef38d41ab854b93a4a617275f14c7e6/images/large/9.jpg saved to cache
2026-03-26 22:54:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d2c7514b-09d5-589b-9f34-16877c439323
2026-03-26 22:54:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d2c7514b-09d5-589b-9f34-16877c439323, skipping ID generation
2026-03-26 22:54:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2c7514b-09d5-589b-9f34-16877c439323 with scrape type 1
2026-03-26 22:54:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d2c7514b-09d5-589b-9f34-16877c439323 sending to next pipeline
2026-03-26 22:54:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d2c7514b-09d5-589b-9f34-16877c439323, identifier: 1985528
2026-03-26 22:54:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d2c7514b-09d5-589b-9f34-16877c439323 with identifier: 1985528
2026-03-26 22:54:07 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 22:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 22:54:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d2c7514b-09d5-589b-9f34-16877c439323 with identifier: 1985528
2026-03-26 22:54:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d2c7514b-09d5-589b-9f34-16877c439323 with identifier: 1985528 to the API
2026-03-26 22:54:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:54:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:54:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1ww/7ef38d41ab854b93a4a617275f14c7e6/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'color': 'DARK MOON BLUE',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd2c7514b-09d5-589b-9f34-16877c439323',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'INSIGNIA GRAND SPORT DIESEL',
 'odometer': 164248,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2c7514b-09d5-589b-9f34-16877c439323/d2c7514b-09d5-589b-9f34-16877c439323_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 260834,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ww/7ef38d41ab854b93a4a617275f14c7e6/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2c7514b-09d5-589b-9f34-16877c439323/d2c7514b-09d5-589b-9f34-16877c439323_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 280815,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ww/7ef38d41ab854b93a4a617275f14c7e6/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2c7514b-09d5-589b-9f34-16877c439323/d2c7514b-09d5-589b-9f34-16877c439323_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 333992,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ww/7ef38d41ab854b93a4a617275f14c7e6/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2c7514b-09d5-589b-9f34-16877c439323/d2c7514b-09d5-589b-9f34-16877c439323_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 319196,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ww/7ef38d41ab854b93a4a617275f14c7e6/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2c7514b-09d5-589b-9f34-16877c439323/d2c7514b-09d5-589b-9f34-16877c439323_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 277831,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ww/7ef38d41ab854b93a4a617275f14c7e6/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2c7514b-09d5-589b-9f34-16877c439323/d2c7514b-09d5-589b-9f34-16877c439323_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 286445,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ww/7ef38d41ab854b93a4a617275f14c7e6/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2c7514b-09d5-589b-9f34-16877c439323/d2c7514b-09d5-589b-9f34-16877c439323_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 287430,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ww/7ef38d41ab854b93a4a617275f14c7e6/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2c7514b-09d5-589b-9f34-16877c439323/d2c7514b-09d5-589b-9f34-16877c439323_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 347256,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ww/7ef38d41ab854b93a4a617275f14c7e6/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2c7514b-09d5-589b-9f34-16877c439323/d2c7514b-09d5-589b-9f34-16877c439323_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 328966,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ww/7ef38d41ab854b93a4a617275f14c7e6/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2c7514b-09d5-589b-9f34-16877c439323/d2c7514b-09d5-589b-9f34-16877c439323_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 376753,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ww/7ef38d41ab854b93a4a617275f14c7e6/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL INSIGNIA GRAND SPORT DIESEL 1.6 CDTI Edition (EU6.2) STOCK',
 'transmission': 'manual',
 'trim': '1.6 CDTI Edition (EU6.2) STOCK',
 'vin': None,
 'year': 2019}
2026-03-26 22:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985528%27 HTTP/1.1" 200 None
2026-03-26 22:54:07 [ayvens.be] INFO: Saving data for 1985528: {'created_time': 1774565647.565163, 'last_price_update_time': 1774565647.565172, 'auction_closing_time': 1774958400.0}
2026-03-26 22:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985528') HTTP/1.1" 204 0
2026-03-26 22:54:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/21a0211cf6a6404c9018a4a20cb107a9/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F5759686beeed4ffbb40277c44151ccb6%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/5759686beeed4ffbb40277c44151ccb6/images/large/2.jpg not downloaded yet
2026-03-26 22:54:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c69210>
2026-03-26 22:54:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bce4c819-f0b8-5c83-9a10-a643842c4e5e/bce4c819-f0b8-5c83-9a10-a643842c4e5e_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F21a0211cf6a6404c9018a4a20cb107a9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/21a0211cf6a6404c9018a4a20cb107a9/images/large/1.jpg saved to cache
2026-03-26 22:54:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bce4c819-f0b8-5c83-9a10-a643842c4e5e
2026-03-26 22:54:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cbd3d0>
2026-03-26 22:54:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bce4c819-f0b8-5c83-9a10-a643842c4e5e/bce4c819-f0b8-5c83-9a10-a643842c4e5e_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F21a0211cf6a6404c9018a4a20cb107a9%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/21a0211cf6a6404c9018a4a20cb107a9/images/large/2.jpg saved to cache
2026-03-26 22:54:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bce4c819-f0b8-5c83-9a10-a643842c4e5e
2026-03-26 22:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F5759686beeed4ffbb40277c44151ccb6%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/5759686beeed4ffbb40277c44151ccb6/images/large/3.jpg not downloaded yet
2026-03-26 22:54:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/21a0211cf6a6404c9018a4a20cb107a9/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F5759686beeed4ffbb40277c44151ccb6%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/5759686beeed4ffbb40277c44151ccb6/images/large/4.jpg not downloaded yet
2026-03-26 22:54:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd3bbb10>
2026-03-26 22:54:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bce4c819-f0b8-5c83-9a10-a643842c4e5e/bce4c819-f0b8-5c83-9a10-a643842c4e5e_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F21a0211cf6a6404c9018a4a20cb107a9%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/21a0211cf6a6404c9018a4a20cb107a9/images/large/3.jpg saved to cache
2026-03-26 22:54:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bce4c819-f0b8-5c83-9a10-a643842c4e5e
2026-03-26 22:54:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/21a0211cf6a6404c9018a4a20cb107a9/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F5759686beeed4ffbb40277c44151ccb6%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/5759686beeed4ffbb40277c44151ccb6/images/large/5.jpg not downloaded yet
2026-03-26 22:54:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/21a0211cf6a6404c9018a4a20cb107a9/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F5759686beeed4ffbb40277c44151ccb6%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/5759686beeed4ffbb40277c44151ccb6/images/large/6.jpg not downloaded yet
2026-03-26 22:54:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/21a0211cf6a6404c9018a4a20cb107a9/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/5759686beeed4ffbb40277c44151ccb6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/21a0211cf6a6404c9018a4a20cb107a9/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F5759686beeed4ffbb40277c44151ccb6%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/5759686beeed4ffbb40277c44151ccb6/images/large/7.jpg not downloaded yet
2026-03-26 22:54:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6d823d0>
2026-03-26 22:54:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bce4c819-f0b8-5c83-9a10-a643842c4e5e/bce4c819-f0b8-5c83-9a10-a643842c4e5e_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F21a0211cf6a6404c9018a4a20cb107a9%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/21a0211cf6a6404c9018a4a20cb107a9/images/large/5.jpg saved to cache
2026-03-26 22:54:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bce4c819-f0b8-5c83-9a10-a643842c4e5e
2026-03-26 22:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F5759686beeed4ffbb40277c44151ccb6%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/5759686beeed4ffbb40277c44151ccb6/images/large/8.jpg not downloaded yet
2026-03-26 22:54:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/21a0211cf6a6404c9018a4a20cb107a9/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/21a0211cf6a6404c9018a4a20cb107a9/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7768210>
2026-03-26 22:54:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bce4c819-f0b8-5c83-9a10-a643842c4e5e/bce4c819-f0b8-5c83-9a10-a643842c4e5e_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F21a0211cf6a6404c9018a4a20cb107a9%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/21a0211cf6a6404c9018a4a20cb107a9/images/large/4.jpg saved to cache
2026-03-26 22:54:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bce4c819-f0b8-5c83-9a10-a643842c4e5e
2026-03-26 22:54:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c95ed0>
2026-03-26 22:54:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bce4c819-f0b8-5c83-9a10-a643842c4e5e/bce4c819-f0b8-5c83-9a10-a643842c4e5e_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F21a0211cf6a6404c9018a4a20cb107a9%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/21a0211cf6a6404c9018a4a20cb107a9/images/large/6.jpg saved to cache
2026-03-26 22:54:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bce4c819-f0b8-5c83-9a10-a643842c4e5e
2026-03-26 22:54:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79a0410>
2026-03-26 22:54:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bce4c819-f0b8-5c83-9a10-a643842c4e5e/bce4c819-f0b8-5c83-9a10-a643842c4e5e_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F21a0211cf6a6404c9018a4a20cb107a9%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/21a0211cf6a6404c9018a4a20cb107a9/images/large/8.jpg saved to cache
2026-03-26 22:54:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bce4c819-f0b8-5c83-9a10-a643842c4e5e
2026-03-26 22:54:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7aa0410>
2026-03-26 22:54:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d1e7030-034b-5260-97c9-95ac6c87a369/8d1e7030-034b-5260-97c9-95ac6c87a369_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F5759686beeed4ffbb40277c44151ccb6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/5759686beeed4ffbb40277c44151ccb6/images/large/1.jpg saved to cache
2026-03-26 22:54:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8d1e7030-034b-5260-97c9-95ac6c87a369
2026-03-26 22:54:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79a2850>
2026-03-26 22:54:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bce4c819-f0b8-5c83-9a10-a643842c4e5e/bce4c819-f0b8-5c83-9a10-a643842c4e5e_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F21a0211cf6a6404c9018a4a20cb107a9%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/21a0211cf6a6404c9018a4a20cb107a9/images/large/9.jpg saved to cache
2026-03-26 22:54:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bce4c819-f0b8-5c83-9a10-a643842c4e5e
2026-03-26 22:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F5759686beeed4ffbb40277c44151ccb6%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/5759686beeed4ffbb40277c44151ccb6/images/large/9.jpg not downloaded yet
2026-03-26 22:54:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/5759686beeed4ffbb40277c44151ccb6/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/5759686beeed4ffbb40277c44151ccb6/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/5759686beeed4ffbb40277c44151ccb6/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F5759686beeed4ffbb40277c44151ccb6%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/5759686beeed4ffbb40277c44151ccb6/images/large/10.jpg not downloaded yet
2026-03-26 22:54:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7688b90>
2026-03-26 22:54:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bce4c819-f0b8-5c83-9a10-a643842c4e5e/bce4c819-f0b8-5c83-9a10-a643842c4e5e_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F21a0211cf6a6404c9018a4a20cb107a9%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/21a0211cf6a6404c9018a4a20cb107a9/images/large/7.jpg saved to cache
2026-03-26 22:54:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bce4c819-f0b8-5c83-9a10-a643842c4e5e
2026-03-26 22:54:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76a50d0>
2026-03-26 22:54:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bce4c819-f0b8-5c83-9a10-a643842c4e5e/bce4c819-f0b8-5c83-9a10-a643842c4e5e_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F21a0211cf6a6404c9018a4a20cb107a9%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/21a0211cf6a6404c9018a4a20cb107a9/images/large/10.jpg saved to cache
2026-03-26 22:54:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bce4c819-f0b8-5c83-9a10-a643842c4e5e
2026-03-26 22:54:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bce4c819-f0b8-5c83-9a10-a643842c4e5e, skipping ID generation
2026-03-26 22:54:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bce4c819-f0b8-5c83-9a10-a643842c4e5e with scrape type 1
2026-03-26 22:54:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bce4c819-f0b8-5c83-9a10-a643842c4e5e sending to next pipeline
2026-03-26 22:54:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: bce4c819-f0b8-5c83-9a10-a643842c4e5e, identifier: 1985529
2026-03-26 22:54:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/5759686beeed4ffbb40277c44151ccb6/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:08 [ayvens.be] INFO: Found listing with ID: 1985531
2026-03-26 22:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985531%27 HTTP/1.1" 200 None
2026-03-26 22:54:08 [ayvens.be] INFO: Scrape type for 1985531: 1
2026-03-26 22:54:08 [ayvens.be] INFO: Extracting data for car ID: 1985531
2026-03-26 22:54:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd347170-1c5d-5705-a41d-ca213afde7f0 with identifier: 1985531
2026-03-26 22:54:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd347170-1c5d-5705-a41d-ca213afde7f0 with scrape type 1
2026-03-26 22:54:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bd347170-1c5d-5705-a41d-ca213afde7f0
2026-03-26 22:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F9ff3ba9bfcb348109cfa074222d529e9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/9ff3ba9bfcb348109cfa074222d529e9/images/large/1.jpg not downloaded yet
2026-03-26 22:54:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: bce4c819-f0b8-5c83-9a10-a643842c4e5e with identifier: 1985529
2026-03-26 22:54:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: bce4c819-f0b8-5c83-9a10-a643842c4e5e with identifier: 1985529
2026-03-26 22:54:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: bce4c819-f0b8-5c83-9a10-a643842c4e5e with identifier: 1985529 to the API
2026-03-26 22:54:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:54:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:54:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bl/21a0211cf6a6404c9018a4a20cb107a9/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'bce4c819-f0b8-5c83-9a10-a643842c4e5e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 92887,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 18,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bce4c819-f0b8-5c83-9a10-a643842c4e5e/bce4c819-f0b8-5c83-9a10-a643842c4e5e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 579088,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/21a0211cf6a6404c9018a4a20cb107a9/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bce4c819-f0b8-5c83-9a10-a643842c4e5e/bce4c819-f0b8-5c83-9a10-a643842c4e5e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 592629,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/21a0211cf6a6404c9018a4a20cb107a9/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bce4c819-f0b8-5c83-9a10-a643842c4e5e/bce4c819-f0b8-5c83-9a10-a643842c4e5e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 578138,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/21a0211cf6a6404c9018a4a20cb107a9/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bce4c819-f0b8-5c83-9a10-a643842c4e5e/bce4c819-f0b8-5c83-9a10-a643842c4e5e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 736778,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/21a0211cf6a6404c9018a4a20cb107a9/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bce4c819-f0b8-5c83-9a10-a643842c4e5e/bce4c819-f0b8-5c83-9a10-a643842c4e5e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 609157,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/21a0211cf6a6404c9018a4a20cb107a9/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bce4c819-f0b8-5c83-9a10-a643842c4e5e/bce4c819-f0b8-5c83-9a10-a643842c4e5e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 902011,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/21a0211cf6a6404c9018a4a20cb107a9/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bce4c819-f0b8-5c83-9a10-a643842c4e5e/bce4c819-f0b8-5c83-9a10-a643842c4e5e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 877712,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/21a0211cf6a6404c9018a4a20cb107a9/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bce4c819-f0b8-5c83-9a10-a643842c4e5e/bce4c819-f0b8-5c83-9a10-a643842c4e5e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 596107,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/21a0211cf6a6404c9018a4a20cb107a9/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bce4c819-f0b8-5c83-9a10-a643842c4e5e/bce4c819-f0b8-5c83-9a10-a643842c4e5e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 601208,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/21a0211cf6a6404c9018a4a20cb107a9/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bce4c819-f0b8-5c83-9a10-a643842c4e5e/bce4c819-f0b8-5c83-9a10-a643842c4e5e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 682288,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/21a0211cf6a6404c9018a4a20cb107a9/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 1.5 SDRIVE16DA',
 'transmission': 'automatic',
 'trim': '1.5 SDRIVE16DA',
 'vin': None,
 'year': 2022}
2026-03-26 22:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985529%27 HTTP/1.1" 200 None
2026-03-26 22:54:09 [ayvens.be] INFO: Saving data for 1985529: {'created_time': 1774565649.294866, 'last_price_update_time': 1774565649.294876, 'auction_closing_time': 1774958400.0}
2026-03-26 22:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985529') HTTP/1.1" 204 0
2026-03-26 22:54:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/5759686beeed4ffbb40277c44151ccb6/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F9ff3ba9bfcb348109cfa074222d529e9%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/9ff3ba9bfcb348109cfa074222d529e9/images/large/2.jpg not downloaded yet
2026-03-26 22:54:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e11850>
2026-03-26 22:54:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d1e7030-034b-5260-97c9-95ac6c87a369/8d1e7030-034b-5260-97c9-95ac6c87a369_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F5759686beeed4ffbb40277c44151ccb6%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/5759686beeed4ffbb40277c44151ccb6/images/large/2.jpg saved to cache
2026-03-26 22:54:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8d1e7030-034b-5260-97c9-95ac6c87a369
2026-03-26 22:54:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd0afe50>
2026-03-26 22:54:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d1e7030-034b-5260-97c9-95ac6c87a369/8d1e7030-034b-5260-97c9-95ac6c87a369_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F5759686beeed4ffbb40277c44151ccb6%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/5759686beeed4ffbb40277c44151ccb6/images/large/3.jpg saved to cache
2026-03-26 22:54:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8d1e7030-034b-5260-97c9-95ac6c87a369
2026-03-26 22:54:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7496b90>
2026-03-26 22:54:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d1e7030-034b-5260-97c9-95ac6c87a369/8d1e7030-034b-5260-97c9-95ac6c87a369_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F5759686beeed4ffbb40277c44151ccb6%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/5759686beeed4ffbb40277c44151ccb6/images/large/4.jpg saved to cache
2026-03-26 22:54:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8d1e7030-034b-5260-97c9-95ac6c87a369
2026-03-26 22:54:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b792d250>
2026-03-26 22:54:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d1e7030-034b-5260-97c9-95ac6c87a369/8d1e7030-034b-5260-97c9-95ac6c87a369_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F5759686beeed4ffbb40277c44151ccb6%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/5759686beeed4ffbb40277c44151ccb6/images/large/5.jpg saved to cache
2026-03-26 22:54:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8d1e7030-034b-5260-97c9-95ac6c87a369
2026-03-26 22:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F9ff3ba9bfcb348109cfa074222d529e9%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/9ff3ba9bfcb348109cfa074222d529e9/images/large/3.jpg not downloaded yet
2026-03-26 22:54:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/5759686beeed4ffbb40277c44151ccb6/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/5759686beeed4ffbb40277c44151ccb6/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F9ff3ba9bfcb348109cfa074222d529e9%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/9ff3ba9bfcb348109cfa074222d529e9/images/large/4.jpg not downloaded yet
2026-03-26 22:54:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7278a10>
2026-03-26 22:54:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d1e7030-034b-5260-97c9-95ac6c87a369/8d1e7030-034b-5260-97c9-95ac6c87a369_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F5759686beeed4ffbb40277c44151ccb6%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/5759686beeed4ffbb40277c44151ccb6/images/large/6.jpg saved to cache
2026-03-26 22:54:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8d1e7030-034b-5260-97c9-95ac6c87a369
2026-03-26 22:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F9ff3ba9bfcb348109cfa074222d529e9%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/9ff3ba9bfcb348109cfa074222d529e9/images/large/5.jpg not downloaded yet
2026-03-26 22:54:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/5759686beeed4ffbb40277c44151ccb6/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/5759686beeed4ffbb40277c44151ccb6/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F9ff3ba9bfcb348109cfa074222d529e9%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/9ff3ba9bfcb348109cfa074222d529e9/images/large/6.jpg not downloaded yet
2026-03-26 22:54:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7427e10>
2026-03-26 22:54:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d1e7030-034b-5260-97c9-95ac6c87a369/8d1e7030-034b-5260-97c9-95ac6c87a369_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F5759686beeed4ffbb40277c44151ccb6%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/5759686beeed4ffbb40277c44151ccb6/images/large/7.jpg saved to cache
2026-03-26 22:54:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8d1e7030-034b-5260-97c9-95ac6c87a369
2026-03-26 22:54:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7268d90>
2026-03-26 22:54:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d1e7030-034b-5260-97c9-95ac6c87a369/8d1e7030-034b-5260-97c9-95ac6c87a369_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F5759686beeed4ffbb40277c44151ccb6%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/5759686beeed4ffbb40277c44151ccb6/images/large/8.jpg saved to cache
2026-03-26 22:54:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8d1e7030-034b-5260-97c9-95ac6c87a369
2026-03-26 22:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F9ff3ba9bfcb348109cfa074222d529e9%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/9ff3ba9bfcb348109cfa074222d529e9/images/large/7.jpg not downloaded yet
2026-03-26 22:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F9ff3ba9bfcb348109cfa074222d529e9%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/9ff3ba9bfcb348109cfa074222d529e9/images/large/8.jpg not downloaded yet
2026-03-26 22:54:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7496ed0>
2026-03-26 22:54:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d1e7030-034b-5260-97c9-95ac6c87a369/8d1e7030-034b-5260-97c9-95ac6c87a369_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F5759686beeed4ffbb40277c44151ccb6%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/5759686beeed4ffbb40277c44151ccb6/images/large/9.jpg saved to cache
2026-03-26 22:54:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8d1e7030-034b-5260-97c9-95ac6c87a369
2026-03-26 22:54:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e14310>
2026-03-26 22:54:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d1e7030-034b-5260-97c9-95ac6c87a369/8d1e7030-034b-5260-97c9-95ac6c87a369_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F5759686beeed4ffbb40277c44151ccb6%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/5759686beeed4ffbb40277c44151ccb6/images/large/10.jpg saved to cache
2026-03-26 22:54:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8d1e7030-034b-5260-97c9-95ac6c87a369
2026-03-26 22:54:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8d1e7030-034b-5260-97c9-95ac6c87a369, skipping ID generation
2026-03-26 22:54:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d1e7030-034b-5260-97c9-95ac6c87a369 with scrape type 1
2026-03-26 22:54:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8d1e7030-034b-5260-97c9-95ac6c87a369 sending to next pipeline
2026-03-26 22:54:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 8d1e7030-034b-5260-97c9-95ac6c87a369, identifier: 1985530
2026-03-26 22:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F9ff3ba9bfcb348109cfa074222d529e9%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/9ff3ba9bfcb348109cfa074222d529e9/images/large/9.jpg not downloaded yet
2026-03-26 22:54:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 8d1e7030-034b-5260-97c9-95ac6c87a369 with identifier: 1985530
2026-03-26 22:54:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 8d1e7030-034b-5260-97c9-95ac6c87a369 with identifier: 1985530
2026-03-26 22:54:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 8d1e7030-034b-5260-97c9-95ac6c87a369 with identifier: 1985530 to the API
2026-03-26 22:54:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:54:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:54:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cp/5759686beeed4ffbb40277c44151ccb6/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '8d1e7030-034b-5260-97c9-95ac6c87a369',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT CUSTOM',
 'odometer': 127584,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d1e7030-034b-5260-97c9-95ac6c87a369/8d1e7030-034b-5260-97c9-95ac6c87a369_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 252119,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/5759686beeed4ffbb40277c44151ccb6/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d1e7030-034b-5260-97c9-95ac6c87a369/8d1e7030-034b-5260-97c9-95ac6c87a369_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 244505,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/5759686beeed4ffbb40277c44151ccb6/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d1e7030-034b-5260-97c9-95ac6c87a369/8d1e7030-034b-5260-97c9-95ac6c87a369_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 249501,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/5759686beeed4ffbb40277c44151ccb6/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d1e7030-034b-5260-97c9-95ac6c87a369/8d1e7030-034b-5260-97c9-95ac6c87a369_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 268045,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/5759686beeed4ffbb40277c44151ccb6/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d1e7030-034b-5260-97c9-95ac6c87a369/8d1e7030-034b-5260-97c9-95ac6c87a369_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 258115,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/5759686beeed4ffbb40277c44151ccb6/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d1e7030-034b-5260-97c9-95ac6c87a369/8d1e7030-034b-5260-97c9-95ac6c87a369_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 283173,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/5759686beeed4ffbb40277c44151ccb6/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d1e7030-034b-5260-97c9-95ac6c87a369/8d1e7030-034b-5260-97c9-95ac6c87a369_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 334971,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/5759686beeed4ffbb40277c44151ccb6/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d1e7030-034b-5260-97c9-95ac6c87a369/8d1e7030-034b-5260-97c9-95ac6c87a369_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 330299,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/5759686beeed4ffbb40277c44151ccb6/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d1e7030-034b-5260-97c9-95ac6c87a369/8d1e7030-034b-5260-97c9-95ac6c87a369_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 370395,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/5759686beeed4ffbb40277c44151ccb6/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d1e7030-034b-5260-97c9-95ac6c87a369/8d1e7030-034b-5260-97c9-95ac6c87a369_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 330461,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/5759686beeed4ffbb40277c44151ccb6/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-04',
 'seats_number': 2,
 'seller_name': None,
 'title': 'FORD TRANSIT CUSTOM 2.0TD 130PS MHEV TREND FWD 340 LWB',
 'transmission': 'manual',
 'trim': '2.0TD 130PS MHEV TREND FWD 340 LWB',
 'vin': None,
 'year': 2022}
2026-03-26 22:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985530%27 HTTP/1.1" 200 None
2026-03-26 22:54:10 [ayvens.be] INFO: Saving data for 1985530: {'created_time': 1774565650.595807, 'last_price_update_time': 1774565650.59582, 'auction_closing_time': 1774958400.0}
2026-03-26 22:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985530') HTTP/1.1" 204 0
2026-03-26 22:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F9ff3ba9bfcb348109cfa074222d529e9%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/9ff3ba9bfcb348109cfa074222d529e9/images/large/10.jpg not downloaded yet
2026-03-26 22:54:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/9ff3ba9bfcb348109cfa074222d529e9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:10 [ayvens.be] INFO: Found listing with ID: 1985532
2026-03-26 22:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985532%27 HTTP/1.1" 200 None
2026-03-26 22:54:10 [ayvens.be] INFO: Scrape type for 1985532: 1
2026-03-26 22:54:10 [ayvens.be] INFO: Extracting data for car ID: 1985532
2026-03-26 22:54:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd with identifier: 1985532
2026-03-26 22:54:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd with scrape type 1
2026-03-26 22:54:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd
2026-03-26 22:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F8f1789cd82714b77b0449107cc0bbb1b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/8f1789cd82714b77b0449107cc0bbb1b/images/large/1.jpg not downloaded yet
2026-03-26 22:54:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/9ff3ba9bfcb348109cfa074222d529e9/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F8f1789cd82714b77b0449107cc0bbb1b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/8f1789cd82714b77b0449107cc0bbb1b/images/large/2.jpg not downloaded yet
2026-03-26 22:54:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/9ff3ba9bfcb348109cfa074222d529e9/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/9ff3ba9bfcb348109cfa074222d529e9/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F8f1789cd82714b77b0449107cc0bbb1b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/8f1789cd82714b77b0449107cc0bbb1b/images/large/3.jpg not downloaded yet
2026-03-26 22:54:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/9ff3ba9bfcb348109cfa074222d529e9/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/9ff3ba9bfcb348109cfa074222d529e9/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F8f1789cd82714b77b0449107cc0bbb1b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/8f1789cd82714b77b0449107cc0bbb1b/images/large/4.jpg not downloaded yet
2026-03-26 22:54:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/9ff3ba9bfcb348109cfa074222d529e9/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F8f1789cd82714b77b0449107cc0bbb1b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/8f1789cd82714b77b0449107cc0bbb1b/images/large/5.jpg not downloaded yet
2026-03-26 22:54:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b743ab90>
2026-03-26 22:54:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd347170-1c5d-5705-a41d-ca213afde7f0/bd347170-1c5d-5705-a41d-ca213afde7f0_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F9ff3ba9bfcb348109cfa074222d529e9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/9ff3ba9bfcb348109cfa074222d529e9/images/large/1.jpg saved to cache
2026-03-26 22:54:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bd347170-1c5d-5705-a41d-ca213afde7f0
2026-03-26 22:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F8f1789cd82714b77b0449107cc0bbb1b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/8f1789cd82714b77b0449107cc0bbb1b/images/large/6.jpg not downloaded yet
2026-03-26 22:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F8f1789cd82714b77b0449107cc0bbb1b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/8f1789cd82714b77b0449107cc0bbb1b/images/large/7.jpg not downloaded yet
2026-03-26 22:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F8f1789cd82714b77b0449107cc0bbb1b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/8f1789cd82714b77b0449107cc0bbb1b/images/large/8.jpg not downloaded yet
2026-03-26 22:54:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74afb10>
2026-03-26 22:54:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd347170-1c5d-5705-a41d-ca213afde7f0/bd347170-1c5d-5705-a41d-ca213afde7f0_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F9ff3ba9bfcb348109cfa074222d529e9%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/9ff3ba9bfcb348109cfa074222d529e9/images/large/2.jpg saved to cache
2026-03-26 22:54:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bd347170-1c5d-5705-a41d-ca213afde7f0
2026-03-26 22:54:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b746e550>
2026-03-26 22:54:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd347170-1c5d-5705-a41d-ca213afde7f0/bd347170-1c5d-5705-a41d-ca213afde7f0_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:54:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F9ff3ba9bfcb348109cfa074222d529e9%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/9ff3ba9bfcb348109cfa074222d529e9/images/large/3.jpg saved to cache
2026-03-26 22:54:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bd347170-1c5d-5705-a41d-ca213afde7f0
2026-03-26 22:54:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7ccc210>
2026-03-26 22:54:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd347170-1c5d-5705-a41d-ca213afde7f0/bd347170-1c5d-5705-a41d-ca213afde7f0_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:54:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F9ff3ba9bfcb348109cfa074222d529e9%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/9ff3ba9bfcb348109cfa074222d529e9/images/large/4.jpg saved to cache
2026-03-26 22:54:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bd347170-1c5d-5705-a41d-ca213afde7f0
2026-03-26 22:54:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7cce690>
2026-03-26 22:54:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd347170-1c5d-5705-a41d-ca213afde7f0/bd347170-1c5d-5705-a41d-ca213afde7f0_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:54:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F9ff3ba9bfcb348109cfa074222d529e9%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/9ff3ba9bfcb348109cfa074222d529e9/images/large/5.jpg saved to cache
2026-03-26 22:54:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bd347170-1c5d-5705-a41d-ca213afde7f0
2026-03-26 22:54:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7982b90>
2026-03-26 22:54:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd347170-1c5d-5705-a41d-ca213afde7f0/bd347170-1c5d-5705-a41d-ca213afde7f0_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:54:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F9ff3ba9bfcb348109cfa074222d529e9%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/9ff3ba9bfcb348109cfa074222d529e9/images/large/6.jpg saved to cache
2026-03-26 22:54:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bd347170-1c5d-5705-a41d-ca213afde7f0
2026-03-26 22:54:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b746f650>
2026-03-26 22:54:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd347170-1c5d-5705-a41d-ca213afde7f0/bd347170-1c5d-5705-a41d-ca213afde7f0_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:54:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F9ff3ba9bfcb348109cfa074222d529e9%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/9ff3ba9bfcb348109cfa074222d529e9/images/large/7.jpg saved to cache
2026-03-26 22:54:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bd347170-1c5d-5705-a41d-ca213afde7f0
2026-03-26 22:54:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aa/8f1789cd82714b77b0449107cc0bbb1b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F8f1789cd82714b77b0449107cc0bbb1b%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/8f1789cd82714b77b0449107cc0bbb1b/images/large/9.jpg not downloaded yet
2026-03-26 22:54:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/9ff3ba9bfcb348109cfa074222d529e9/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/9ff3ba9bfcb348109cfa074222d529e9/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aa/8f1789cd82714b77b0449107cc0bbb1b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F8f1789cd82714b77b0449107cc0bbb1b%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/8f1789cd82714b77b0449107cc0bbb1b/images/large/10.jpg not downloaded yet
2026-03-26 22:54:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/9ff3ba9bfcb348109cfa074222d529e9/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aa/8f1789cd82714b77b0449107cc0bbb1b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aa/8f1789cd82714b77b0449107cc0bbb1b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:11 [ayvens.be] INFO: Found listing with ID: 1985533
2026-03-26 22:54:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985533%27 HTTP/1.1" 200 None
2026-03-26 22:54:11 [ayvens.be] INFO: Scrape type for 1985533: 1
2026-03-26 22:54:11 [ayvens.be] INFO: Extracting data for car ID: 1985533
2026-03-26 22:54:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b0a2bd87-4ad2-5dd8-ac63-c2572d48520a with identifier: 1985533
2026-03-26 22:54:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0a2bd87-4ad2-5dd8-ac63-c2572d48520a with scrape type 1
2026-03-26 22:54:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b0a2bd87-4ad2-5dd8-ac63-c2572d48520a
2026-03-26 22:54:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F6c06de12636e440792f432537e6b1ace%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/6c06de12636e440792f432537e6b1ace/images/large/1.jpg not downloaded yet
2026-03-26 22:54:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aa/8f1789cd82714b77b0449107cc0bbb1b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F6c06de12636e440792f432537e6b1ace%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/6c06de12636e440792f432537e6b1ace/images/large/2.jpg not downloaded yet
2026-03-26 22:54:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F6c06de12636e440792f432537e6b1ace%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/6c06de12636e440792f432537e6b1ace/images/large/3.jpg not downloaded yet
2026-03-26 22:54:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c967d0>
2026-03-26 22:54:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd/4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:54:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F8f1789cd82714b77b0449107cc0bbb1b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/8f1789cd82714b77b0449107cc0bbb1b/images/large/1.jpg saved to cache
2026-03-26 22:54:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd
2026-03-26 22:54:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F6c06de12636e440792f432537e6b1ace%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/6c06de12636e440792f432537e6b1ace/images/large/4.jpg not downloaded yet
2026-03-26 22:54:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aa/8f1789cd82714b77b0449107cc0bbb1b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aa/8f1789cd82714b77b0449107cc0bbb1b/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c95190>
2026-03-26 22:54:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd347170-1c5d-5705-a41d-ca213afde7f0/bd347170-1c5d-5705-a41d-ca213afde7f0_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:54:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F9ff3ba9bfcb348109cfa074222d529e9%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/9ff3ba9bfcb348109cfa074222d529e9/images/large/8.jpg saved to cache
2026-03-26 22:54:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bd347170-1c5d-5705-a41d-ca213afde7f0
2026-03-26 22:54:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F6c06de12636e440792f432537e6b1ace%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/6c06de12636e440792f432537e6b1ace/images/large/5.jpg not downloaded yet
2026-03-26 22:54:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aa/8f1789cd82714b77b0449107cc0bbb1b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aa/8f1789cd82714b77b0449107cc0bbb1b/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7490650>
2026-03-26 22:54:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd347170-1c5d-5705-a41d-ca213afde7f0/bd347170-1c5d-5705-a41d-ca213afde7f0_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:54:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F9ff3ba9bfcb348109cfa074222d529e9%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/9ff3ba9bfcb348109cfa074222d529e9/images/large/10.jpg saved to cache
2026-03-26 22:54:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bd347170-1c5d-5705-a41d-ca213afde7f0
2026-03-26 22:54:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6da6750>
2026-03-26 22:54:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd/4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:54:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F8f1789cd82714b77b0449107cc0bbb1b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/8f1789cd82714b77b0449107cc0bbb1b/images/large/3.jpg saved to cache
2026-03-26 22:54:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd
2026-03-26 22:54:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7571890>
2026-03-26 22:54:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd347170-1c5d-5705-a41d-ca213afde7f0/bd347170-1c5d-5705-a41d-ca213afde7f0_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:54:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F9ff3ba9bfcb348109cfa074222d529e9%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/9ff3ba9bfcb348109cfa074222d529e9/images/large/9.jpg saved to cache
2026-03-26 22:54:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bd347170-1c5d-5705-a41d-ca213afde7f0
2026-03-26 22:54:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bd347170-1c5d-5705-a41d-ca213afde7f0, skipping ID generation
2026-03-26 22:54:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd347170-1c5d-5705-a41d-ca213afde7f0 with scrape type 1
2026-03-26 22:54:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bd347170-1c5d-5705-a41d-ca213afde7f0 sending to next pipeline
2026-03-26 22:54:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: bd347170-1c5d-5705-a41d-ca213afde7f0, identifier: 1985531
2026-03-26 22:54:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b727af10>
2026-03-26 22:54:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd/4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:54:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F8f1789cd82714b77b0449107cc0bbb1b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/8f1789cd82714b77b0449107cc0bbb1b/images/large/2.jpg saved to cache
2026-03-26 22:54:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd
2026-03-26 22:54:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7449f50>
2026-03-26 22:54:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd/4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:54:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F8f1789cd82714b77b0449107cc0bbb1b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/8f1789cd82714b77b0449107cc0bbb1b/images/large/5.jpg saved to cache
2026-03-26 22:54:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd
2026-03-26 22:54:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7437ad0>
2026-03-26 22:54:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd/4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:54:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F8f1789cd82714b77b0449107cc0bbb1b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/8f1789cd82714b77b0449107cc0bbb1b/images/large/4.jpg saved to cache
2026-03-26 22:54:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd
2026-03-26 22:54:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F6c06de12636e440792f432537e6b1ace%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/6c06de12636e440792f432537e6b1ace/images/large/6.jpg not downloaded yet
2026-03-26 22:54:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: bd347170-1c5d-5705-a41d-ca213afde7f0 with identifier: 1985531
2026-03-26 22:54:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: bd347170-1c5d-5705-a41d-ca213afde7f0 with identifier: 1985531
2026-03-26 22:54:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: bd347170-1c5d-5705-a41d-ca213afde7f0 with identifier: 1985531 to the API
2026-03-26 22:54:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:54:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:54:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cq/9ff3ba9bfcb348109cfa074222d529e9/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'bd347170-1c5d-5705-a41d-ca213afde7f0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '1 SERIES HATCH',
 'odometer': 48037,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd347170-1c5d-5705-a41d-ca213afde7f0/bd347170-1c5d-5705-a41d-ca213afde7f0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 656119,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/9ff3ba9bfcb348109cfa074222d529e9/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd347170-1c5d-5705-a41d-ca213afde7f0/bd347170-1c5d-5705-a41d-ca213afde7f0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 661500,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/9ff3ba9bfcb348109cfa074222d529e9/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd347170-1c5d-5705-a41d-ca213afde7f0/bd347170-1c5d-5705-a41d-ca213afde7f0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 665806,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/9ff3ba9bfcb348109cfa074222d529e9/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd347170-1c5d-5705-a41d-ca213afde7f0/bd347170-1c5d-5705-a41d-ca213afde7f0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 677905,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/9ff3ba9bfcb348109cfa074222d529e9/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd347170-1c5d-5705-a41d-ca213afde7f0/bd347170-1c5d-5705-a41d-ca213afde7f0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 689846,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/9ff3ba9bfcb348109cfa074222d529e9/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd347170-1c5d-5705-a41d-ca213afde7f0/bd347170-1c5d-5705-a41d-ca213afde7f0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 651496,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/9ff3ba9bfcb348109cfa074222d529e9/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd347170-1c5d-5705-a41d-ca213afde7f0/bd347170-1c5d-5705-a41d-ca213afde7f0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 708057,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/9ff3ba9bfcb348109cfa074222d529e9/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd347170-1c5d-5705-a41d-ca213afde7f0/bd347170-1c5d-5705-a41d-ca213afde7f0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 690434,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/9ff3ba9bfcb348109cfa074222d529e9/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd347170-1c5d-5705-a41d-ca213afde7f0/bd347170-1c5d-5705-a41d-ca213afde7f0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 613290,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/9ff3ba9bfcb348109cfa074222d529e9/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd347170-1c5d-5705-a41d-ca213afde7f0/bd347170-1c5d-5705-a41d-ca213afde7f0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 533245,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/9ff3ba9bfcb348109cfa074222d529e9/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1 SERIES HATCH 1.5 116D (85KW)',
 'transmission': 'manual',
 'trim': '1.5 116D (85KW)',
 'vin': None,
 'year': 2022}
2026-03-26 22:54:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985531%27 HTTP/1.1" 200 None
2026-03-26 22:54:12 [ayvens.be] INFO: Saving data for 1985531: {'created_time': 1774565652.725439, 'last_price_update_time': 1774565652.725448, 'auction_closing_time': 1774958400.0}
2026-03-26 22:54:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985531') HTTP/1.1" 204 0
2026-03-26 22:54:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b764b590>
2026-03-26 22:54:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd/4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:54:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F8f1789cd82714b77b0449107cc0bbb1b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/8f1789cd82714b77b0449107cc0bbb1b/images/large/8.jpg saved to cache
2026-03-26 22:54:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd
2026-03-26 22:54:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e3cd10>
2026-03-26 22:54:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd/4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:54:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F8f1789cd82714b77b0449107cc0bbb1b%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/8f1789cd82714b77b0449107cc0bbb1b/images/large/9.jpg saved to cache
2026-03-26 22:54:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd
2026-03-26 22:54:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aa/8f1789cd82714b77b0449107cc0bbb1b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F6c06de12636e440792f432537e6b1ace%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/6c06de12636e440792f432537e6b1ace/images/large/7.jpg not downloaded yet
2026-03-26 22:54:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7482410>
2026-03-26 22:54:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd/4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:54:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F8f1789cd82714b77b0449107cc0bbb1b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/8f1789cd82714b77b0449107cc0bbb1b/images/large/6.jpg saved to cache
2026-03-26 22:54:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd
2026-03-26 22:54:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7768290>
2026-03-26 22:54:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd/4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:54:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F8f1789cd82714b77b0449107cc0bbb1b%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/8f1789cd82714b77b0449107cc0bbb1b/images/large/10.jpg saved to cache
2026-03-26 22:54:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd
2026-03-26 22:54:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F6c06de12636e440792f432537e6b1ace%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/6c06de12636e440792f432537e6b1ace/images/large/8.jpg not downloaded yet
2026-03-26 22:54:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74b61d0>
2026-03-26 22:54:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd/4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:54:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F8f1789cd82714b77b0449107cc0bbb1b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/8f1789cd82714b77b0449107cc0bbb1b/images/large/7.jpg saved to cache
2026-03-26 22:54:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd
2026-03-26 22:54:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd, skipping ID generation
2026-03-26 22:54:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd with scrape type 1
2026-03-26 22:54:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd sending to next pipeline
2026-03-26 22:54:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd, identifier: 1985532
2026-03-26 22:54:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/6c06de12636e440792f432537e6b1ace/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F6c06de12636e440792f432537e6b1ace%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/6c06de12636e440792f432537e6b1ace/images/large/9.jpg not downloaded yet
2026-03-26 22:54:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd with identifier: 1985532
2026-03-26 22:54:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd with identifier: 1985532
2026-03-26 22:54:13 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd with identifier: 1985532 to the API
2026-03-26 22:54:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:54:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:54:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2aa/8f1789cd82714b77b0449107cc0bbb1b/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'electric',
 'id': '4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'POLESTAR',
 'model': 'POLESTAR 2',
 'odometer': 212214,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd/4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 390023,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aa/8f1789cd82714b77b0449107cc0bbb1b/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd/4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 612512,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aa/8f1789cd82714b77b0449107cc0bbb1b/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd/4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 482382,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aa/8f1789cd82714b77b0449107cc0bbb1b/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd/4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 448853,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aa/8f1789cd82714b77b0449107cc0bbb1b/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd/4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 311136,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aa/8f1789cd82714b77b0449107cc0bbb1b/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd/4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 316731,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aa/8f1789cd82714b77b0449107cc0bbb1b/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd/4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 467447,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aa/8f1789cd82714b77b0449107cc0bbb1b/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd/4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 353809,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aa/8f1789cd82714b77b0449107cc0bbb1b/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd/4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 334721,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aa/8f1789cd82714b77b0449107cc0bbb1b/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd/4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 170980,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aa/8f1789cd82714b77b0449107cc0bbb1b/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'POLESTAR POLESTAR 2 78 kWh Dual Motor Launch',
 'transmission': 'automatic',
 'trim': '78 kWh Dual Motor Launch',
 'vin': None,
 'year': 2021}
2026-03-26 22:54:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985532%27 HTTP/1.1" 200 None
2026-03-26 22:54:13 [ayvens.be] INFO: Saving data for 1985532: {'created_time': 1774565653.596644, 'last_price_update_time': 1774565653.596656, 'auction_closing_time': 1774958400.0}
2026-03-26 22:54:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985532') HTTP/1.1" 204 0
2026-03-26 22:54:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/6c06de12636e440792f432537e6b1ace/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F6c06de12636e440792f432537e6b1ace%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/6c06de12636e440792f432537e6b1ace/images/large/10.jpg not downloaded yet
2026-03-26 22:54:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77e8550>
2026-03-26 22:54:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0a2bd87-4ad2-5dd8-ac63-c2572d48520a/b0a2bd87-4ad2-5dd8-ac63-c2572d48520a_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:54:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F6c06de12636e440792f432537e6b1ace%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/6c06de12636e440792f432537e6b1ace/images/large/1.jpg saved to cache
2026-03-26 22:54:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b0a2bd87-4ad2-5dd8-ac63-c2572d48520a
2026-03-26 22:54:13 [ayvens.be] INFO: Found listing with ID: 1985534
2026-03-26 22:54:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985534%27 HTTP/1.1" 200 None
2026-03-26 22:54:13 [ayvens.be] INFO: Scrape type for 1985534: 1
2026-03-26 22:54:13 [ayvens.be] INFO: Extracting data for car ID: 1985534
2026-03-26 22:54:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e63084ba-d397-5197-aa10-870246624827 with identifier: 1985534
2026-03-26 22:54:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e63084ba-d397-5197-aa10-870246624827 with scrape type 1
2026-03-26 22:54:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e63084ba-d397-5197-aa10-870246624827
2026-03-26 22:54:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F32b82d21bbaf4555a6e64d121ae4cf6e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/32b82d21bbaf4555a6e64d121ae4cf6e/images/large/1.jpg not downloaded yet
2026-03-26 22:54:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/6c06de12636e440792f432537e6b1ace/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F32b82d21bbaf4555a6e64d121ae4cf6e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/32b82d21bbaf4555a6e64d121ae4cf6e/images/large/2.jpg not downloaded yet
2026-03-26 22:54:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/6c06de12636e440792f432537e6b1ace/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7495850>
2026-03-26 22:54:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0a2bd87-4ad2-5dd8-ac63-c2572d48520a/b0a2bd87-4ad2-5dd8-ac63-c2572d48520a_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F6c06de12636e440792f432537e6b1ace%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/6c06de12636e440792f432537e6b1ace/images/large/2.jpg saved to cache
2026-03-26 22:54:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b0a2bd87-4ad2-5dd8-ac63-c2572d48520a
2026-03-26 22:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F32b82d21bbaf4555a6e64d121ae4cf6e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/32b82d21bbaf4555a6e64d121ae4cf6e/images/large/3.jpg not downloaded yet
2026-03-26 22:54:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/6c06de12636e440792f432537e6b1ace/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/6c06de12636e440792f432537e6b1ace/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F32b82d21bbaf4555a6e64d121ae4cf6e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/32b82d21bbaf4555a6e64d121ae4cf6e/images/large/4.jpg not downloaded yet
2026-03-26 22:54:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/6c06de12636e440792f432537e6b1ace/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7924410>
2026-03-26 22:54:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0a2bd87-4ad2-5dd8-ac63-c2572d48520a/b0a2bd87-4ad2-5dd8-ac63-c2572d48520a_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F6c06de12636e440792f432537e6b1ace%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/6c06de12636e440792f432537e6b1ace/images/large/3.jpg saved to cache
2026-03-26 22:54:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b0a2bd87-4ad2-5dd8-ac63-c2572d48520a
2026-03-26 22:54:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b78c2c50>
2026-03-26 22:54:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0a2bd87-4ad2-5dd8-ac63-c2572d48520a/b0a2bd87-4ad2-5dd8-ac63-c2572d48520a_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F6c06de12636e440792f432537e6b1ace%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/6c06de12636e440792f432537e6b1ace/images/large/5.jpg saved to cache
2026-03-26 22:54:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b0a2bd87-4ad2-5dd8-ac63-c2572d48520a
2026-03-26 22:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F32b82d21bbaf4555a6e64d121ae4cf6e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/32b82d21bbaf4555a6e64d121ae4cf6e/images/large/5.jpg not downloaded yet
2026-03-26 22:54:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/6c06de12636e440792f432537e6b1ace/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F32b82d21bbaf4555a6e64d121ae4cf6e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/32b82d21bbaf4555a6e64d121ae4cf6e/images/large/6.jpg not downloaded yet
2026-03-26 22:54:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b72ec850>
2026-03-26 22:54:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0a2bd87-4ad2-5dd8-ac63-c2572d48520a/b0a2bd87-4ad2-5dd8-ac63-c2572d48520a_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F6c06de12636e440792f432537e6b1ace%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/6c06de12636e440792f432537e6b1ace/images/large/4.jpg saved to cache
2026-03-26 22:54:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b0a2bd87-4ad2-5dd8-ac63-c2572d48520a
2026-03-26 22:54:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e4c150>
2026-03-26 22:54:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0a2bd87-4ad2-5dd8-ac63-c2572d48520a/b0a2bd87-4ad2-5dd8-ac63-c2572d48520a_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F6c06de12636e440792f432537e6b1ace%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/6c06de12636e440792f432537e6b1ace/images/large/6.jpg saved to cache
2026-03-26 22:54:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b0a2bd87-4ad2-5dd8-ac63-c2572d48520a
2026-03-26 22:54:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b726b390>
2026-03-26 22:54:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0a2bd87-4ad2-5dd8-ac63-c2572d48520a/b0a2bd87-4ad2-5dd8-ac63-c2572d48520a_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F6c06de12636e440792f432537e6b1ace%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/6c06de12636e440792f432537e6b1ace/images/large/7.jpg saved to cache
2026-03-26 22:54:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b0a2bd87-4ad2-5dd8-ac63-c2572d48520a
2026-03-26 22:54:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/6c06de12636e440792f432537e6b1ace/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/6c06de12636e440792f432537e6b1ace/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F32b82d21bbaf4555a6e64d121ae4cf6e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/32b82d21bbaf4555a6e64d121ae4cf6e/images/large/7.jpg not downloaded yet
2026-03-26 22:54:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b782f410>
2026-03-26 22:54:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0a2bd87-4ad2-5dd8-ac63-c2572d48520a/b0a2bd87-4ad2-5dd8-ac63-c2572d48520a_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F6c06de12636e440792f432537e6b1ace%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/6c06de12636e440792f432537e6b1ace/images/large/10.jpg saved to cache
2026-03-26 22:54:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b0a2bd87-4ad2-5dd8-ac63-c2572d48520a
2026-03-26 22:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F32b82d21bbaf4555a6e64d121ae4cf6e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/32b82d21bbaf4555a6e64d121ae4cf6e/images/large/8.jpg not downloaded yet
2026-03-26 22:54:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/32b82d21bbaf4555a6e64d121ae4cf6e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/32b82d21bbaf4555a6e64d121ae4cf6e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F32b82d21bbaf4555a6e64d121ae4cf6e%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/32b82d21bbaf4555a6e64d121ae4cf6e/images/large/9.jpg not downloaded yet
2026-03-26 22:54:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b782e1d0>
2026-03-26 22:54:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0a2bd87-4ad2-5dd8-ac63-c2572d48520a/b0a2bd87-4ad2-5dd8-ac63-c2572d48520a_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F6c06de12636e440792f432537e6b1ace%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/6c06de12636e440792f432537e6b1ace/images/large/8.jpg saved to cache
2026-03-26 22:54:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b0a2bd87-4ad2-5dd8-ac63-c2572d48520a
2026-03-26 22:54:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/32b82d21bbaf4555a6e64d121ae4cf6e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e3ded0>
2026-03-26 22:54:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0a2bd87-4ad2-5dd8-ac63-c2572d48520a/b0a2bd87-4ad2-5dd8-ac63-c2572d48520a_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F6c06de12636e440792f432537e6b1ace%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/6c06de12636e440792f432537e6b1ace/images/large/9.jpg saved to cache
2026-03-26 22:54:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b0a2bd87-4ad2-5dd8-ac63-c2572d48520a
2026-03-26 22:54:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b0a2bd87-4ad2-5dd8-ac63-c2572d48520a, skipping ID generation
2026-03-26 22:54:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0a2bd87-4ad2-5dd8-ac63-c2572d48520a with scrape type 1
2026-03-26 22:54:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b0a2bd87-4ad2-5dd8-ac63-c2572d48520a sending to next pipeline
2026-03-26 22:54:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b0a2bd87-4ad2-5dd8-ac63-c2572d48520a, identifier: 1985533
2026-03-26 22:54:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/32b82d21bbaf4555a6e64d121ae4cf6e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F32b82d21bbaf4555a6e64d121ae4cf6e%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/32b82d21bbaf4555a6e64d121ae4cf6e/images/large/10.jpg not downloaded yet
2026-03-26 22:54:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b0a2bd87-4ad2-5dd8-ac63-c2572d48520a with identifier: 1985533
2026-03-26 22:54:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b0a2bd87-4ad2-5dd8-ac63-c2572d48520a with identifier: 1985533
2026-03-26 22:54:15 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b0a2bd87-4ad2-5dd8-ac63-c2572d48520a with identifier: 1985533 to the API
2026-03-26 22:54:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:54:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:54:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bw/6c06de12636e440792f432537e6b1ace/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'b0a2bd87-4ad2-5dd8-ac63-c2572d48520a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X2',
 'odometer': 77004,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 19,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0a2bd87-4ad2-5dd8-ac63-c2572d48520a/b0a2bd87-4ad2-5dd8-ac63-c2572d48520a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 639833,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/6c06de12636e440792f432537e6b1ace/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0a2bd87-4ad2-5dd8-ac63-c2572d48520a/b0a2bd87-4ad2-5dd8-ac63-c2572d48520a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 609385,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/6c06de12636e440792f432537e6b1ace/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0a2bd87-4ad2-5dd8-ac63-c2572d48520a/b0a2bd87-4ad2-5dd8-ac63-c2572d48520a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 653979,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/6c06de12636e440792f432537e6b1ace/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0a2bd87-4ad2-5dd8-ac63-c2572d48520a/b0a2bd87-4ad2-5dd8-ac63-c2572d48520a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 668939,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/6c06de12636e440792f432537e6b1ace/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0a2bd87-4ad2-5dd8-ac63-c2572d48520a/b0a2bd87-4ad2-5dd8-ac63-c2572d48520a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 651084,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/6c06de12636e440792f432537e6b1ace/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0a2bd87-4ad2-5dd8-ac63-c2572d48520a/b0a2bd87-4ad2-5dd8-ac63-c2572d48520a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 630193,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/6c06de12636e440792f432537e6b1ace/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0a2bd87-4ad2-5dd8-ac63-c2572d48520a/b0a2bd87-4ad2-5dd8-ac63-c2572d48520a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 646738,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/6c06de12636e440792f432537e6b1ace/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0a2bd87-4ad2-5dd8-ac63-c2572d48520a/b0a2bd87-4ad2-5dd8-ac63-c2572d48520a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 669147,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/6c06de12636e440792f432537e6b1ace/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0a2bd87-4ad2-5dd8-ac63-c2572d48520a/b0a2bd87-4ad2-5dd8-ac63-c2572d48520a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 566945,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/6c06de12636e440792f432537e6b1ace/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0a2bd87-4ad2-5dd8-ac63-c2572d48520a/b0a2bd87-4ad2-5dd8-ac63-c2572d48520a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 455016,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/6c06de12636e440792f432537e6b1ace/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X2 1.5 XDRIVE25E PHEV 162KW)',
 'transmission': 'automatic',
 'trim': '1.5 XDRIVE25E PHEV 162KW)',
 'vin': None,
 'year': 2022}
2026-03-26 22:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985533%27 HTTP/1.1" 200 None
2026-03-26 22:54:15 [ayvens.be] INFO: Saving data for 1985533: {'created_time': 1774565655.346102, 'last_price_update_time': 1774565655.346111, 'auction_closing_time': 1774958400.0}
2026-03-26 22:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985533') HTTP/1.1" 204 0
2026-03-26 22:54:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7476890>
2026-03-26 22:54:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e63084ba-d397-5197-aa10-870246624827/e63084ba-d397-5197-aa10-870246624827_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F32b82d21bbaf4555a6e64d121ae4cf6e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/32b82d21bbaf4555a6e64d121ae4cf6e/images/large/1.jpg saved to cache
2026-03-26 22:54:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e63084ba-d397-5197-aa10-870246624827
2026-03-26 22:54:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7497c10>
2026-03-26 22:54:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e63084ba-d397-5197-aa10-870246624827/e63084ba-d397-5197-aa10-870246624827_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F32b82d21bbaf4555a6e64d121ae4cf6e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/32b82d21bbaf4555a6e64d121ae4cf6e/images/large/2.jpg saved to cache
2026-03-26 22:54:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e63084ba-d397-5197-aa10-870246624827
2026-03-26 22:54:15 [ayvens.be] INFO: Found listing with ID: 1985535
2026-03-26 22:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985535%27 HTTP/1.1" 200 None
2026-03-26 22:54:15 [ayvens.be] INFO: Scrape type for 1985535: 1
2026-03-26 22:54:15 [ayvens.be] INFO: Extracting data for car ID: 1985535
2026-03-26 22:54:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 09175781-0ea9-54ed-8020-069176c2cbcf with identifier: 1985535
2026-03-26 22:54:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09175781-0ea9-54ed-8020-069176c2cbcf with scrape type 1
2026-03-26 22:54:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 09175781-0ea9-54ed-8020-069176c2cbcf
2026-03-26 22:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eu%252F452429e6a18e4069b9e9ea67ae084a83%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eu/452429e6a18e4069b9e9ea67ae084a83/images/large/1.jpg not downloaded yet
2026-03-26 22:54:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/32b82d21bbaf4555a6e64d121ae4cf6e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e2a510>
2026-03-26 22:54:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e63084ba-d397-5197-aa10-870246624827/e63084ba-d397-5197-aa10-870246624827_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F32b82d21bbaf4555a6e64d121ae4cf6e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/32b82d21bbaf4555a6e64d121ae4cf6e/images/large/3.jpg saved to cache
2026-03-26 22:54:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e63084ba-d397-5197-aa10-870246624827
2026-03-26 22:54:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b72ede90>
2026-03-26 22:54:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e63084ba-d397-5197-aa10-870246624827/e63084ba-d397-5197-aa10-870246624827_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F32b82d21bbaf4555a6e64d121ae4cf6e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/32b82d21bbaf4555a6e64d121ae4cf6e/images/large/4.jpg saved to cache
2026-03-26 22:54:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e63084ba-d397-5197-aa10-870246624827
2026-03-26 22:54:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/32b82d21bbaf4555a6e64d121ae4cf6e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eu%252F452429e6a18e4069b9e9ea67ae084a83%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eu/452429e6a18e4069b9e9ea67ae084a83/images/large/2.jpg not downloaded yet
2026-03-26 22:54:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/32b82d21bbaf4555a6e64d121ae4cf6e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eu%252F452429e6a18e4069b9e9ea67ae084a83%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eu/452429e6a18e4069b9e9ea67ae084a83/images/large/3.jpg not downloaded yet
2026-03-26 22:54:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/32b82d21bbaf4555a6e64d121ae4cf6e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7400f10>
2026-03-26 22:54:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e63084ba-d397-5197-aa10-870246624827/e63084ba-d397-5197-aa10-870246624827_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F32b82d21bbaf4555a6e64d121ae4cf6e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/32b82d21bbaf4555a6e64d121ae4cf6e/images/large/7.jpg saved to cache
2026-03-26 22:54:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e63084ba-d397-5197-aa10-870246624827
2026-03-26 22:54:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/32b82d21bbaf4555a6e64d121ae4cf6e/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eu%252F452429e6a18e4069b9e9ea67ae084a83%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eu/452429e6a18e4069b9e9ea67ae084a83/images/large/4.jpg not downloaded yet
2026-03-26 22:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eu%252F452429e6a18e4069b9e9ea67ae084a83%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eu/452429e6a18e4069b9e9ea67ae084a83/images/large/5.jpg not downloaded yet
2026-03-26 22:54:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cb0810>
2026-03-26 22:54:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e63084ba-d397-5197-aa10-870246624827/e63084ba-d397-5197-aa10-870246624827_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F32b82d21bbaf4555a6e64d121ae4cf6e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/32b82d21bbaf4555a6e64d121ae4cf6e/images/large/5.jpg saved to cache
2026-03-26 22:54:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e63084ba-d397-5197-aa10-870246624827
2026-03-26 22:54:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7477850>
2026-03-26 22:54:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e63084ba-d397-5197-aa10-870246624827/e63084ba-d397-5197-aa10-870246624827_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F32b82d21bbaf4555a6e64d121ae4cf6e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/32b82d21bbaf4555a6e64d121ae4cf6e/images/large/6.jpg saved to cache
2026-03-26 22:54:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e63084ba-d397-5197-aa10-870246624827
2026-03-26 22:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eu%252F452429e6a18e4069b9e9ea67ae084a83%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eu/452429e6a18e4069b9e9ea67ae084a83/images/large/6.jpg not downloaded yet
2026-03-26 22:54:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/32b82d21bbaf4555a6e64d121ae4cf6e/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b729ee90>
2026-03-26 22:54:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e63084ba-d397-5197-aa10-870246624827/e63084ba-d397-5197-aa10-870246624827_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F32b82d21bbaf4555a6e64d121ae4cf6e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/32b82d21bbaf4555a6e64d121ae4cf6e/images/large/8.jpg saved to cache
2026-03-26 22:54:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e63084ba-d397-5197-aa10-870246624827
2026-03-26 22:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eu%252F452429e6a18e4069b9e9ea67ae084a83%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eu/452429e6a18e4069b9e9ea67ae084a83/images/large/7.jpg not downloaded yet
2026-03-26 22:54:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79dfed0>
2026-03-26 22:54:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e63084ba-d397-5197-aa10-870246624827/e63084ba-d397-5197-aa10-870246624827_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F32b82d21bbaf4555a6e64d121ae4cf6e%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/32b82d21bbaf4555a6e64d121ae4cf6e/images/large/9.jpg saved to cache
2026-03-26 22:54:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e63084ba-d397-5197-aa10-870246624827
2026-03-26 22:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eu%252F452429e6a18e4069b9e9ea67ae084a83%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eu/452429e6a18e4069b9e9ea67ae084a83/images/large/8.jpg not downloaded yet
2026-03-26 22:54:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7925510>
2026-03-26 22:54:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e63084ba-d397-5197-aa10-870246624827/e63084ba-d397-5197-aa10-870246624827_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F32b82d21bbaf4555a6e64d121ae4cf6e%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/32b82d21bbaf4555a6e64d121ae4cf6e/images/large/10.jpg saved to cache
2026-03-26 22:54:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e63084ba-d397-5197-aa10-870246624827
2026-03-26 22:54:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e63084ba-d397-5197-aa10-870246624827, skipping ID generation
2026-03-26 22:54:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e63084ba-d397-5197-aa10-870246624827 with scrape type 1
2026-03-26 22:54:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e63084ba-d397-5197-aa10-870246624827 sending to next pipeline
2026-03-26 22:54:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e63084ba-d397-5197-aa10-870246624827, identifier: 1985534
2026-03-26 22:54:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e63084ba-d397-5197-aa10-870246624827 with identifier: 1985534
2026-03-26 22:54:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e63084ba-d397-5197-aa10-870246624827 with identifier: 1985534
2026-03-26 22:54:16 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e63084ba-d397-5197-aa10-870246624827 with identifier: 1985534 to the API
2026-03-26 22:54:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:54:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:54:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bp/32b82d21bbaf4555a6e64d121ae4cf6e/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.3L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'e63084ba-d397-5197-aa10-870246624827',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A-CLASS LIMOUSINE',
 'odometer': 145151,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e63084ba-d397-5197-aa10-870246624827/e63084ba-d397-5197-aa10-870246624827_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 481886,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/32b82d21bbaf4555a6e64d121ae4cf6e/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e63084ba-d397-5197-aa10-870246624827/e63084ba-d397-5197-aa10-870246624827_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 505493,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/32b82d21bbaf4555a6e64d121ae4cf6e/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e63084ba-d397-5197-aa10-870246624827/e63084ba-d397-5197-aa10-870246624827_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 355083,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/32b82d21bbaf4555a6e64d121ae4cf6e/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e63084ba-d397-5197-aa10-870246624827/e63084ba-d397-5197-aa10-870246624827_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 442502,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/32b82d21bbaf4555a6e64d121ae4cf6e/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e63084ba-d397-5197-aa10-870246624827/e63084ba-d397-5197-aa10-870246624827_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 340538,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/32b82d21bbaf4555a6e64d121ae4cf6e/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e63084ba-d397-5197-aa10-870246624827/e63084ba-d397-5197-aa10-870246624827_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 329538,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/32b82d21bbaf4555a6e64d121ae4cf6e/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e63084ba-d397-5197-aa10-870246624827/e63084ba-d397-5197-aa10-870246624827_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 260423,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/32b82d21bbaf4555a6e64d121ae4cf6e/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e63084ba-d397-5197-aa10-870246624827/e63084ba-d397-5197-aa10-870246624827_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 327708,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/32b82d21bbaf4555a6e64d121ae4cf6e/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e63084ba-d397-5197-aa10-870246624827/e63084ba-d397-5197-aa10-870246624827_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 205534,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/32b82d21bbaf4555a6e64d121ae4cf6e/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e63084ba-d397-5197-aa10-870246624827/e63084ba-d397-5197-aa10-870246624827_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 276463,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/32b82d21bbaf4555a6e64d121ae4cf6e/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ A-CLASS LIMOUSINE 1.3 A 180 BUSINESS SOLUTION',
 'transmission': 'manual',
 'trim': '1.3 A 180 BUSINESS SOLUTION',
 'vin': None,
 'year': 2022}
2026-03-26 22:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985534%27 HTTP/1.1" 200 None
2026-03-26 22:54:16 [ayvens.be] INFO: Saving data for 1985534: {'created_time': 1774565656.877795, 'last_price_update_time': 1774565656.877804, 'auction_closing_time': 1774958400.0}
2026-03-26 22:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985534') HTTP/1.1" 204 0
2026-03-26 22:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eu%252F452429e6a18e4069b9e9ea67ae084a83%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eu/452429e6a18e4069b9e9ea67ae084a83/images/large/9.jpg not downloaded yet
2026-03-26 22:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eu%252F452429e6a18e4069b9e9ea67ae084a83%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eu/452429e6a18e4069b9e9ea67ae084a83/images/large/10.jpg not downloaded yet
2026-03-26 22:54:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2eu/452429e6a18e4069b9e9ea67ae084a83/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2eu/452429e6a18e4069b9e9ea67ae084a83/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2eu/452429e6a18e4069b9e9ea67ae084a83/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:16 [ayvens.be] INFO: Found listing with ID: 1985536
2026-03-26 22:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985536%27 HTTP/1.1" 200 None
2026-03-26 22:54:16 [ayvens.be] INFO: Scrape type for 1985536: 1
2026-03-26 22:54:16 [ayvens.be] INFO: Extracting data for car ID: 1985536
2026-03-26 22:54:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ac6c500-e226-5658-a462-5e46731c9c8a with identifier: 1985536
2026-03-26 22:54:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ac6c500-e226-5658-a462-5e46731c9c8a with scrape type 1
2026-03-26 22:54:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3ac6c500-e226-5658-a462-5e46731c9c8a
2026-03-26 22:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fb632fb8474c84e64a4dc99623fcb66a5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/b632fb8474c84e64a4dc99623fcb66a5/images/large/1.jpg not downloaded yet
2026-03-26 22:54:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2eu/452429e6a18e4069b9e9ea67ae084a83/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fb632fb8474c84e64a4dc99623fcb66a5%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/b632fb8474c84e64a4dc99623fcb66a5/images/large/2.jpg not downloaded yet
2026-03-26 22:54:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2eu/452429e6a18e4069b9e9ea67ae084a83/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2eu/452429e6a18e4069b9e9ea67ae084a83/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fb632fb8474c84e64a4dc99623fcb66a5%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/b632fb8474c84e64a4dc99623fcb66a5/images/large/3.jpg not downloaded yet
2026-03-26 22:54:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fb632fb8474c84e64a4dc99623fcb66a5%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/b632fb8474c84e64a4dc99623fcb66a5/images/large/4.jpg not downloaded yet
2026-03-26 22:54:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fb632fb8474c84e64a4dc99623fcb66a5%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/b632fb8474c84e64a4dc99623fcb66a5/images/large/5.jpg not downloaded yet
2026-03-26 22:54:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fb632fb8474c84e64a4dc99623fcb66a5%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/b632fb8474c84e64a4dc99623fcb66a5/images/large/6.jpg not downloaded yet
2026-03-26 22:54:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2eu/452429e6a18e4069b9e9ea67ae084a83/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e10410>
2026-03-26 22:54:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09175781-0ea9-54ed-8020-069176c2cbcf/09175781-0ea9-54ed-8020-069176c2cbcf_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:54:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eu%252F452429e6a18e4069b9e9ea67ae084a83%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eu/452429e6a18e4069b9e9ea67ae084a83/images/large/1.jpg saved to cache
2026-03-26 22:54:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 09175781-0ea9-54ed-8020-069176c2cbcf
2026-03-26 22:54:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74b5a90>
2026-03-26 22:54:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09175781-0ea9-54ed-8020-069176c2cbcf/09175781-0ea9-54ed-8020-069176c2cbcf_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:54:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eu%252F452429e6a18e4069b9e9ea67ae084a83%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eu/452429e6a18e4069b9e9ea67ae084a83/images/large/3.jpg saved to cache
2026-03-26 22:54:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 09175781-0ea9-54ed-8020-069176c2cbcf
2026-03-26 22:54:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7724e50>
2026-03-26 22:54:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09175781-0ea9-54ed-8020-069176c2cbcf/09175781-0ea9-54ed-8020-069176c2cbcf_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:54:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eu%252F452429e6a18e4069b9e9ea67ae084a83%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eu/452429e6a18e4069b9e9ea67ae084a83/images/large/2.jpg saved to cache
2026-03-26 22:54:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 09175781-0ea9-54ed-8020-069176c2cbcf
2026-03-26 22:54:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fb632fb8474c84e64a4dc99623fcb66a5%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/b632fb8474c84e64a4dc99623fcb66a5/images/large/7.jpg not downloaded yet
2026-03-26 22:54:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fb632fb8474c84e64a4dc99623fcb66a5%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/b632fb8474c84e64a4dc99623fcb66a5/images/large/8.jpg not downloaded yet
2026-03-26 22:54:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7474110>
2026-03-26 22:54:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09175781-0ea9-54ed-8020-069176c2cbcf/09175781-0ea9-54ed-8020-069176c2cbcf_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:54:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eu%252F452429e6a18e4069b9e9ea67ae084a83%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eu/452429e6a18e4069b9e9ea67ae084a83/images/large/4.jpg saved to cache
2026-03-26 22:54:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 09175781-0ea9-54ed-8020-069176c2cbcf
2026-03-26 22:54:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b17910>
2026-03-26 22:54:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09175781-0ea9-54ed-8020-069176c2cbcf/09175781-0ea9-54ed-8020-069176c2cbcf_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:54:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eu%252F452429e6a18e4069b9e9ea67ae084a83%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eu/452429e6a18e4069b9e9ea67ae084a83/images/large/6.jpg saved to cache
2026-03-26 22:54:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 09175781-0ea9-54ed-8020-069176c2cbcf
2026-03-26 22:54:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b727a290>
2026-03-26 22:54:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09175781-0ea9-54ed-8020-069176c2cbcf/09175781-0ea9-54ed-8020-069176c2cbcf_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:54:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eu%252F452429e6a18e4069b9e9ea67ae084a83%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eu/452429e6a18e4069b9e9ea67ae084a83/images/large/5.jpg saved to cache
2026-03-26 22:54:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 09175781-0ea9-54ed-8020-069176c2cbcf
2026-03-26 22:54:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b75a7710>
2026-03-26 22:54:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09175781-0ea9-54ed-8020-069176c2cbcf/09175781-0ea9-54ed-8020-069176c2cbcf_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:54:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eu%252F452429e6a18e4069b9e9ea67ae084a83%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eu/452429e6a18e4069b9e9ea67ae084a83/images/large/7.jpg saved to cache
2026-03-26 22:54:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 09175781-0ea9-54ed-8020-069176c2cbcf
2026-03-26 22:54:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fb632fb8474c84e64a4dc99623fcb66a5%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/b632fb8474c84e64a4dc99623fcb66a5/images/large/9.jpg not downloaded yet
2026-03-26 22:54:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2eu/452429e6a18e4069b9e9ea67ae084a83/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fb632fb8474c84e64a4dc99623fcb66a5%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/b632fb8474c84e64a4dc99623fcb66a5/images/large/10.jpg not downloaded yet
2026-03-26 22:54:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2eu/452429e6a18e4069b9e9ea67ae084a83/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:17 [ayvens.be] INFO: Found listing with ID: 1985537
2026-03-26 22:54:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985537%27 HTTP/1.1" 200 None
2026-03-26 22:54:17 [ayvens.be] INFO: Scrape type for 1985537: 1
2026-03-26 22:54:17 [ayvens.be] INFO: Extracting data for car ID: 1985537
2026-03-26 22:54:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8049419-67c0-5a32-90f9-13be3f9a8ad0 with identifier: 1985537
2026-03-26 22:54:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8049419-67c0-5a32-90f9-13be3f9a8ad0 with scrape type 1
2026-03-26 22:54:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e8049419-67c0-5a32-90f9-13be3f9a8ad0
2026-03-26 22:54:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F0197747466364a1a99efa5fc81023eeb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/0197747466364a1a99efa5fc81023eeb/images/large/1.jpg not downloaded yet
2026-03-26 22:54:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2eu/452429e6a18e4069b9e9ea67ae084a83/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/b632fb8474c84e64a4dc99623fcb66a5/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/b632fb8474c84e64a4dc99623fcb66a5/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F0197747466364a1a99efa5fc81023eeb%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/0197747466364a1a99efa5fc81023eeb/images/large/2.jpg not downloaded yet
2026-03-26 22:54:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/b632fb8474c84e64a4dc99623fcb66a5/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/b632fb8474c84e64a4dc99623fcb66a5/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/b632fb8474c84e64a4dc99623fcb66a5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F0197747466364a1a99efa5fc81023eeb%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/0197747466364a1a99efa5fc81023eeb/images/large/3.jpg not downloaded yet
2026-03-26 22:54:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e3e910>
2026-03-26 22:54:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09175781-0ea9-54ed-8020-069176c2cbcf/09175781-0ea9-54ed-8020-069176c2cbcf_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eu%252F452429e6a18e4069b9e9ea67ae084a83%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eu/452429e6a18e4069b9e9ea67ae084a83/images/large/10.jpg saved to cache
2026-03-26 22:54:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 09175781-0ea9-54ed-8020-069176c2cbcf
2026-03-26 22:54:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77e8b50>
2026-03-26 22:54:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09175781-0ea9-54ed-8020-069176c2cbcf/09175781-0ea9-54ed-8020-069176c2cbcf_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eu%252F452429e6a18e4069b9e9ea67ae084a83%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eu/452429e6a18e4069b9e9ea67ae084a83/images/large/8.jpg saved to cache
2026-03-26 22:54:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 09175781-0ea9-54ed-8020-069176c2cbcf
2026-03-26 22:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F0197747466364a1a99efa5fc81023eeb%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/0197747466364a1a99efa5fc81023eeb/images/large/4.jpg not downloaded yet
2026-03-26 22:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F0197747466364a1a99efa5fc81023eeb%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/0197747466364a1a99efa5fc81023eeb/images/large/5.jpg not downloaded yet
2026-03-26 22:54:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7770f90>
2026-03-26 22:54:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09175781-0ea9-54ed-8020-069176c2cbcf/09175781-0ea9-54ed-8020-069176c2cbcf_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eu%252F452429e6a18e4069b9e9ea67ae084a83%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eu/452429e6a18e4069b9e9ea67ae084a83/images/large/9.jpg saved to cache
2026-03-26 22:54:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 09175781-0ea9-54ed-8020-069176c2cbcf
2026-03-26 22:54:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 09175781-0ea9-54ed-8020-069176c2cbcf, skipping ID generation
2026-03-26 22:54:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09175781-0ea9-54ed-8020-069176c2cbcf with scrape type 1
2026-03-26 22:54:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 09175781-0ea9-54ed-8020-069176c2cbcf sending to next pipeline
2026-03-26 22:54:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 09175781-0ea9-54ed-8020-069176c2cbcf, identifier: 1985535
2026-03-26 22:54:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e123d0>
2026-03-26 22:54:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ac6c500-e226-5658-a462-5e46731c9c8a/3ac6c500-e226-5658-a462-5e46731c9c8a_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fb632fb8474c84e64a4dc99623fcb66a5%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/b632fb8474c84e64a4dc99623fcb66a5/images/large/2.jpg saved to cache
2026-03-26 22:54:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3ac6c500-e226-5658-a462-5e46731c9c8a
2026-03-26 22:54:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77cb250>
2026-03-26 22:54:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ac6c500-e226-5658-a462-5e46731c9c8a/3ac6c500-e226-5658-a462-5e46731c9c8a_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fb632fb8474c84e64a4dc99623fcb66a5%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/b632fb8474c84e64a4dc99623fcb66a5/images/large/5.jpg saved to cache
2026-03-26 22:54:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3ac6c500-e226-5658-a462-5e46731c9c8a
2026-03-26 22:54:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76a6d50>
2026-03-26 22:54:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ac6c500-e226-5658-a462-5e46731c9c8a/3ac6c500-e226-5658-a462-5e46731c9c8a_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fb632fb8474c84e64a4dc99623fcb66a5%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/b632fb8474c84e64a4dc99623fcb66a5/images/large/3.jpg saved to cache
2026-03-26 22:54:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3ac6c500-e226-5658-a462-5e46731c9c8a
2026-03-26 22:54:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b75a7890>
2026-03-26 22:54:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ac6c500-e226-5658-a462-5e46731c9c8a/3ac6c500-e226-5658-a462-5e46731c9c8a_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fb632fb8474c84e64a4dc99623fcb66a5%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/b632fb8474c84e64a4dc99623fcb66a5/images/large/4.jpg saved to cache
2026-03-26 22:54:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3ac6c500-e226-5658-a462-5e46731c9c8a
2026-03-26 22:54:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e4dd50>
2026-03-26 22:54:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ac6c500-e226-5658-a462-5e46731c9c8a/3ac6c500-e226-5658-a462-5e46731c9c8a_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fb632fb8474c84e64a4dc99623fcb66a5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/b632fb8474c84e64a4dc99623fcb66a5/images/large/1.jpg saved to cache
2026-03-26 22:54:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3ac6c500-e226-5658-a462-5e46731c9c8a
2026-03-26 22:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F0197747466364a1a99efa5fc81023eeb%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/0197747466364a1a99efa5fc81023eeb/images/large/6.jpg not downloaded yet
2026-03-26 22:54:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 09175781-0ea9-54ed-8020-069176c2cbcf with identifier: 1985535
2026-03-26 22:54:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 09175781-0ea9-54ed-8020-069176c2cbcf with identifier: 1985535
2026-03-26 22:54:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 09175781-0ea9-54ed-8020-069176c2cbcf with identifier: 1985535 to the API
2026-03-26 22:54:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:54:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:54:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2eu/452429e6a18e4069b9e9ea67ae084a83/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '09175781-0ea9-54ed-8020-069176c2cbcf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3',
 'odometer': 35227,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09175781-0ea9-54ed-8020-069176c2cbcf/09175781-0ea9-54ed-8020-069176c2cbcf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 638303,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2eu/452429e6a18e4069b9e9ea67ae084a83/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09175781-0ea9-54ed-8020-069176c2cbcf/09175781-0ea9-54ed-8020-069176c2cbcf_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 647531,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2eu/452429e6a18e4069b9e9ea67ae084a83/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09175781-0ea9-54ed-8020-069176c2cbcf/09175781-0ea9-54ed-8020-069176c2cbcf_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 590040,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2eu/452429e6a18e4069b9e9ea67ae084a83/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09175781-0ea9-54ed-8020-069176c2cbcf/09175781-0ea9-54ed-8020-069176c2cbcf_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 644383,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2eu/452429e6a18e4069b9e9ea67ae084a83/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09175781-0ea9-54ed-8020-069176c2cbcf/09175781-0ea9-54ed-8020-069176c2cbcf_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 523957,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2eu/452429e6a18e4069b9e9ea67ae084a83/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09175781-0ea9-54ed-8020-069176c2cbcf/09175781-0ea9-54ed-8020-069176c2cbcf_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 557961,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2eu/452429e6a18e4069b9e9ea67ae084a83/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09175781-0ea9-54ed-8020-069176c2cbcf/09175781-0ea9-54ed-8020-069176c2cbcf_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 604039,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2eu/452429e6a18e4069b9e9ea67ae084a83/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09175781-0ea9-54ed-8020-069176c2cbcf/09175781-0ea9-54ed-8020-069176c2cbcf_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 640545,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2eu/452429e6a18e4069b9e9ea67ae084a83/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09175781-0ea9-54ed-8020-069176c2cbcf/09175781-0ea9-54ed-8020-069176c2cbcf_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 560777,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2eu/452429e6a18e4069b9e9ea67ae084a83/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09175781-0ea9-54ed-8020-069176c2cbcf/09175781-0ea9-54ed-8020-069176c2cbcf_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 545053,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2eu/452429e6a18e4069b9e9ea67ae084a83/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-02-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 2.0 35 TDI S TRONIC ADVANCED BUSINESS ED',
 'transmission': 'automatic',
 'trim': '2.0 35 TDI S TRONIC ADVANCED BUSINESS ED',
 'vin': None,
 'year': 2024}
2026-03-26 22:54:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985535%27 HTTP/1.1" 200 None
2026-03-26 22:54:19 [ayvens.be] INFO: Saving data for 1985535: {'created_time': 1774565659.107725, 'last_price_update_time': 1774565659.107734, 'auction_closing_time': 1774958400.0}
2026-03-26 22:54:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985535') HTTP/1.1" 204 0
2026-03-26 22:54:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/b632fb8474c84e64a4dc99623fcb66a5/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/b632fb8474c84e64a4dc99623fcb66a5/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F0197747466364a1a99efa5fc81023eeb%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/0197747466364a1a99efa5fc81023eeb/images/large/7.jpg not downloaded yet
2026-03-26 22:54:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/b632fb8474c84e64a4dc99623fcb66a5/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/b632fb8474c84e64a4dc99623fcb66a5/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F0197747466364a1a99efa5fc81023eeb%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/0197747466364a1a99efa5fc81023eeb/images/large/8.jpg not downloaded yet
2026-03-26 22:54:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/b632fb8474c84e64a4dc99623fcb66a5/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F0197747466364a1a99efa5fc81023eeb%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/0197747466364a1a99efa5fc81023eeb/images/large/9.jpg not downloaded yet
2026-03-26 22:54:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F0197747466364a1a99efa5fc81023eeb%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/0197747466364a1a99efa5fc81023eeb/images/large/10.jpg not downloaded yet
2026-03-26 22:54:19 [ayvens.be] INFO: Found listing with ID: 1985538
2026-03-26 22:54:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985538%27 HTTP/1.1" 200 None
2026-03-26 22:54:19 [ayvens.be] INFO: Scrape type for 1985538: 1
2026-03-26 22:54:19 [ayvens.be] INFO: Extracting data for car ID: 1985538
2026-03-26 22:54:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02602273-374d-59c0-8940-51e50b8740ed with identifier: 1985538
2026-03-26 22:54:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02602273-374d-59c0-8940-51e50b8740ed with scrape type 1
2026-03-26 22:54:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 02602273-374d-59c0-8940-51e50b8740ed
2026-03-26 22:54:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F8a49c00a2e3a48809c68c90e9cbf142e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/8a49c00a2e3a48809c68c90e9cbf142e/images/large/1.jpg not downloaded yet
2026-03-26 22:54:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/0197747466364a1a99efa5fc81023eeb/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/0197747466364a1a99efa5fc81023eeb/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F8a49c00a2e3a48809c68c90e9cbf142e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/8a49c00a2e3a48809c68c90e9cbf142e/images/large/2.jpg not downloaded yet
2026-03-26 22:54:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/0197747466364a1a99efa5fc81023eeb/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F8a49c00a2e3a48809c68c90e9cbf142e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/8a49c00a2e3a48809c68c90e9cbf142e/images/large/3.jpg not downloaded yet
2026-03-26 22:54:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7573610>
2026-03-26 22:54:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ac6c500-e226-5658-a462-5e46731c9c8a/3ac6c500-e226-5658-a462-5e46731c9c8a_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:54:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fb632fb8474c84e64a4dc99623fcb66a5%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/b632fb8474c84e64a4dc99623fcb66a5/images/large/6.jpg saved to cache
2026-03-26 22:54:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3ac6c500-e226-5658-a462-5e46731c9c8a
2026-03-26 22:54:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7ca8050>
2026-03-26 22:54:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ac6c500-e226-5658-a462-5e46731c9c8a/3ac6c500-e226-5658-a462-5e46731c9c8a_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:54:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fb632fb8474c84e64a4dc99623fcb66a5%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/b632fb8474c84e64a4dc99623fcb66a5/images/large/10.jpg saved to cache
2026-03-26 22:54:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3ac6c500-e226-5658-a462-5e46731c9c8a
2026-03-26 22:54:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F8a49c00a2e3a48809c68c90e9cbf142e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/8a49c00a2e3a48809c68c90e9cbf142e/images/large/4.jpg not downloaded yet
2026-03-26 22:54:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74ce1d0>
2026-03-26 22:54:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ac6c500-e226-5658-a462-5e46731c9c8a/3ac6c500-e226-5658-a462-5e46731c9c8a_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:54:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fb632fb8474c84e64a4dc99623fcb66a5%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/b632fb8474c84e64a4dc99623fcb66a5/images/large/8.jpg saved to cache
2026-03-26 22:54:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3ac6c500-e226-5658-a462-5e46731c9c8a
2026-03-26 22:54:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7573110>
2026-03-26 22:54:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ac6c500-e226-5658-a462-5e46731c9c8a/3ac6c500-e226-5658-a462-5e46731c9c8a_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:54:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fb632fb8474c84e64a4dc99623fcb66a5%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/b632fb8474c84e64a4dc99623fcb66a5/images/large/9.jpg saved to cache
2026-03-26 22:54:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3ac6c500-e226-5658-a462-5e46731c9c8a
2026-03-26 22:54:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F8a49c00a2e3a48809c68c90e9cbf142e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/8a49c00a2e3a48809c68c90e9cbf142e/images/large/5.jpg not downloaded yet
2026-03-26 22:54:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b727d590>
2026-03-26 22:54:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ac6c500-e226-5658-a462-5e46731c9c8a/3ac6c500-e226-5658-a462-5e46731c9c8a_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:54:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fb632fb8474c84e64a4dc99623fcb66a5%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/b632fb8474c84e64a4dc99623fcb66a5/images/large/7.jpg saved to cache
2026-03-26 22:54:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3ac6c500-e226-5658-a462-5e46731c9c8a
2026-03-26 22:54:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3ac6c500-e226-5658-a462-5e46731c9c8a, skipping ID generation
2026-03-26 22:54:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ac6c500-e226-5658-a462-5e46731c9c8a with scrape type 1
2026-03-26 22:54:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3ac6c500-e226-5658-a462-5e46731c9c8a sending to next pipeline
2026-03-26 22:54:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 3ac6c500-e226-5658-a462-5e46731c9c8a, identifier: 1985536
2026-03-26 22:54:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b35d90>
2026-03-26 22:54:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8049419-67c0-5a32-90f9-13be3f9a8ad0/e8049419-67c0-5a32-90f9-13be3f9a8ad0_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:54:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F0197747466364a1a99efa5fc81023eeb%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/0197747466364a1a99efa5fc81023eeb/images/large/3.jpg saved to cache
2026-03-26 22:54:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e8049419-67c0-5a32-90f9-13be3f9a8ad0
2026-03-26 22:54:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76a5850>
2026-03-26 22:54:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8049419-67c0-5a32-90f9-13be3f9a8ad0/e8049419-67c0-5a32-90f9-13be3f9a8ad0_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:54:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F0197747466364a1a99efa5fc81023eeb%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/0197747466364a1a99efa5fc81023eeb/images/large/2.jpg saved to cache
2026-03-26 22:54:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e8049419-67c0-5a32-90f9-13be3f9a8ad0
2026-03-26 22:54:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7290e50>
2026-03-26 22:54:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8049419-67c0-5a32-90f9-13be3f9a8ad0/e8049419-67c0-5a32-90f9-13be3f9a8ad0_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F0197747466364a1a99efa5fc81023eeb%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/0197747466364a1a99efa5fc81023eeb/images/large/4.jpg saved to cache
2026-03-26 22:54:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e8049419-67c0-5a32-90f9-13be3f9a8ad0
2026-03-26 22:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F8a49c00a2e3a48809c68c90e9cbf142e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/8a49c00a2e3a48809c68c90e9cbf142e/images/large/6.jpg not downloaded yet
2026-03-26 22:54:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 3ac6c500-e226-5658-a462-5e46731c9c8a with identifier: 1985536
2026-03-26 22:54:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 3ac6c500-e226-5658-a462-5e46731c9c8a with identifier: 1985536
2026-03-26 22:54:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 3ac6c500-e226-5658-a462-5e46731c9c8a with identifier: 1985536 to the API
2026-03-26 22:54:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:54:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:54:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bq/b632fb8474c84e64a4dc99623fcb66a5/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '3ac6c500-e226-5658-a462-5e46731c9c8a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A4',
 'odometer': 156507,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ac6c500-e226-5658-a462-5e46731c9c8a/3ac6c500-e226-5658-a462-5e46731c9c8a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 698087,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/b632fb8474c84e64a4dc99623fcb66a5/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ac6c500-e226-5658-a462-5e46731c9c8a/3ac6c500-e226-5658-a462-5e46731c9c8a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 566915,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/b632fb8474c84e64a4dc99623fcb66a5/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ac6c500-e226-5658-a462-5e46731c9c8a/3ac6c500-e226-5658-a462-5e46731c9c8a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 711174,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/b632fb8474c84e64a4dc99623fcb66a5/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ac6c500-e226-5658-a462-5e46731c9c8a/3ac6c500-e226-5658-a462-5e46731c9c8a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 705795,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/b632fb8474c84e64a4dc99623fcb66a5/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ac6c500-e226-5658-a462-5e46731c9c8a/3ac6c500-e226-5658-a462-5e46731c9c8a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 456804,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/b632fb8474c84e64a4dc99623fcb66a5/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ac6c500-e226-5658-a462-5e46731c9c8a/3ac6c500-e226-5658-a462-5e46731c9c8a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 322454,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/b632fb8474c84e64a4dc99623fcb66a5/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ac6c500-e226-5658-a462-5e46731c9c8a/3ac6c500-e226-5658-a462-5e46731c9c8a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 544665,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/b632fb8474c84e64a4dc99623fcb66a5/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ac6c500-e226-5658-a462-5e46731c9c8a/3ac6c500-e226-5658-a462-5e46731c9c8a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 456695,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/b632fb8474c84e64a4dc99623fcb66a5/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ac6c500-e226-5658-a462-5e46731c9c8a/3ac6c500-e226-5658-a462-5e46731c9c8a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 405048,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/b632fb8474c84e64a4dc99623fcb66a5/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ac6c500-e226-5658-a462-5e46731c9c8a/3ac6c500-e226-5658-a462-5e46731c9c8a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 321542,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/b632fb8474c84e64a4dc99623fcb66a5/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A4 2.0 30 TDI 100KW S TR ATTRACTION BE',
 'transmission': 'automatic',
 'trim': '2.0 30 TDI 100KW S TR ATTRACTION BE',
 'vin': None,
 'year': 2022}
2026-03-26 22:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985536%27 HTTP/1.1" 200 None
2026-03-26 22:54:20 [ayvens.be] INFO: Saving data for 1985536: {'created_time': 1774565660.419462, 'last_price_update_time': 1774565660.419471, 'auction_closing_time': 1774958400.0}
2026-03-26 22:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985536') HTTP/1.1" 204 0
2026-03-26 22:54:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/0197747466364a1a99efa5fc81023eeb/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/0197747466364a1a99efa5fc81023eeb/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/0197747466364a1a99efa5fc81023eeb/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F8a49c00a2e3a48809c68c90e9cbf142e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/8a49c00a2e3a48809c68c90e9cbf142e/images/large/7.jpg not downloaded yet
2026-03-26 22:54:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/0197747466364a1a99efa5fc81023eeb/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F8a49c00a2e3a48809c68c90e9cbf142e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/8a49c00a2e3a48809c68c90e9cbf142e/images/large/8.jpg not downloaded yet
2026-03-26 22:54:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/0197747466364a1a99efa5fc81023eeb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/0197747466364a1a99efa5fc81023eeb/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/0197747466364a1a99efa5fc81023eeb/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F8a49c00a2e3a48809c68c90e9cbf142e%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/8a49c00a2e3a48809c68c90e9cbf142e/images/large/9.jpg not downloaded yet
2026-03-26 22:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F8a49c00a2e3a48809c68c90e9cbf142e%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/8a49c00a2e3a48809c68c90e9cbf142e/images/large/10.jpg not downloaded yet
2026-03-26 22:54:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/8a49c00a2e3a48809c68c90e9cbf142e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:20 [ayvens.be] INFO: Found listing with ID: 1985539
2026-03-26 22:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985539%27 HTTP/1.1" 200 None
2026-03-26 22:54:20 [ayvens.be] INFO: Scrape type for 1985539: 1
2026-03-26 22:54:20 [ayvens.be] INFO: Extracting data for car ID: 1985539
2026-03-26 22:54:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 137c0adf-7bc5-5006-8a80-389121a630c5 with identifier: 1985539
2026-03-26 22:54:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 137c0adf-7bc5-5006-8a80-389121a630c5 with scrape type 1
2026-03-26 22:54:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 137c0adf-7bc5-5006-8a80-389121a630c5
2026-03-26 22:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F2e159d25ef7c4077b78d6b7a8a1a257f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/2e159d25ef7c4077b78d6b7a8a1a257f/images/large/1.jpg not downloaded yet
2026-03-26 22:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F2e159d25ef7c4077b78d6b7a8a1a257f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/2e159d25ef7c4077b78d6b7a8a1a257f/images/large/2.jpg not downloaded yet
2026-03-26 22:54:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b792da50>
2026-03-26 22:54:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8049419-67c0-5a32-90f9-13be3f9a8ad0/e8049419-67c0-5a32-90f9-13be3f9a8ad0_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F0197747466364a1a99efa5fc81023eeb%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/0197747466364a1a99efa5fc81023eeb/images/large/6.jpg saved to cache
2026-03-26 22:54:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e8049419-67c0-5a32-90f9-13be3f9a8ad0
2026-03-26 22:54:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79a28d0>
2026-03-26 22:54:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8049419-67c0-5a32-90f9-13be3f9a8ad0/e8049419-67c0-5a32-90f9-13be3f9a8ad0_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F0197747466364a1a99efa5fc81023eeb%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/0197747466364a1a99efa5fc81023eeb/images/large/5.jpg saved to cache
2026-03-26 22:54:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e8049419-67c0-5a32-90f9-13be3f9a8ad0
2026-03-26 22:54:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76e1310>
2026-03-26 22:54:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8049419-67c0-5a32-90f9-13be3f9a8ad0/e8049419-67c0-5a32-90f9-13be3f9a8ad0_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F0197747466364a1a99efa5fc81023eeb%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/0197747466364a1a99efa5fc81023eeb/images/large/10.jpg saved to cache
2026-03-26 22:54:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e8049419-67c0-5a32-90f9-13be3f9a8ad0
2026-03-26 22:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F2e159d25ef7c4077b78d6b7a8a1a257f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/2e159d25ef7c4077b78d6b7a8a1a257f/images/large/3.jpg not downloaded yet
2026-03-26 22:54:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7458610>
2026-03-26 22:54:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8049419-67c0-5a32-90f9-13be3f9a8ad0/e8049419-67c0-5a32-90f9-13be3f9a8ad0_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F0197747466364a1a99efa5fc81023eeb%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/0197747466364a1a99efa5fc81023eeb/images/large/9.jpg saved to cache
2026-03-26 22:54:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e8049419-67c0-5a32-90f9-13be3f9a8ad0
2026-03-26 22:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F2e159d25ef7c4077b78d6b7a8a1a257f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/2e159d25ef7c4077b78d6b7a8a1a257f/images/large/4.jpg not downloaded yet
2026-03-26 22:54:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7458390>
2026-03-26 22:54:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8049419-67c0-5a32-90f9-13be3f9a8ad0/e8049419-67c0-5a32-90f9-13be3f9a8ad0_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:54:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F0197747466364a1a99efa5fc81023eeb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/0197747466364a1a99efa5fc81023eeb/images/large/1.jpg saved to cache
2026-03-26 22:54:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e8049419-67c0-5a32-90f9-13be3f9a8ad0
2026-03-26 22:54:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7ccc290>
2026-03-26 22:54:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8049419-67c0-5a32-90f9-13be3f9a8ad0/e8049419-67c0-5a32-90f9-13be3f9a8ad0_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:54:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F0197747466364a1a99efa5fc81023eeb%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/0197747466364a1a99efa5fc81023eeb/images/large/7.jpg saved to cache
2026-03-26 22:54:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e8049419-67c0-5a32-90f9-13be3f9a8ad0
2026-03-26 22:54:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e3de10>
2026-03-26 22:54:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8049419-67c0-5a32-90f9-13be3f9a8ad0/e8049419-67c0-5a32-90f9-13be3f9a8ad0_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:54:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F0197747466364a1a99efa5fc81023eeb%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/0197747466364a1a99efa5fc81023eeb/images/large/8.jpg saved to cache
2026-03-26 22:54:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e8049419-67c0-5a32-90f9-13be3f9a8ad0
2026-03-26 22:54:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e8049419-67c0-5a32-90f9-13be3f9a8ad0, skipping ID generation
2026-03-26 22:54:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8049419-67c0-5a32-90f9-13be3f9a8ad0 with scrape type 1
2026-03-26 22:54:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e8049419-67c0-5a32-90f9-13be3f9a8ad0 sending to next pipeline
2026-03-26 22:54:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e8049419-67c0-5a32-90f9-13be3f9a8ad0, identifier: 1985537
2026-03-26 22:54:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7689890>
2026-03-26 22:54:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02602273-374d-59c0-8940-51e50b8740ed/02602273-374d-59c0-8940-51e50b8740ed_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:54:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F8a49c00a2e3a48809c68c90e9cbf142e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/8a49c00a2e3a48809c68c90e9cbf142e/images/large/1.jpg saved to cache
2026-03-26 22:54:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 02602273-374d-59c0-8940-51e50b8740ed
2026-03-26 22:54:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F2e159d25ef7c4077b78d6b7a8a1a257f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/2e159d25ef7c4077b78d6b7a8a1a257f/images/large/5.jpg not downloaded yet
2026-03-26 22:54:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e8049419-67c0-5a32-90f9-13be3f9a8ad0 with identifier: 1985537
2026-03-26 22:54:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e8049419-67c0-5a32-90f9-13be3f9a8ad0 with identifier: 1985537
2026-03-26 22:54:21 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e8049419-67c0-5a32-90f9-13be3f9a8ad0 with identifier: 1985537 to the API
2026-03-26 22:54:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:54:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:54:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ct/0197747466364a1a99efa5fc81023eeb/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'e8049419-67c0-5a32-90f9-13be3f9a8ad0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '508 SW',
 'odometer': 127193,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8049419-67c0-5a32-90f9-13be3f9a8ad0/e8049419-67c0-5a32-90f9-13be3f9a8ad0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 655734,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/0197747466364a1a99efa5fc81023eeb/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8049419-67c0-5a32-90f9-13be3f9a8ad0/e8049419-67c0-5a32-90f9-13be3f9a8ad0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 653431,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/0197747466364a1a99efa5fc81023eeb/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8049419-67c0-5a32-90f9-13be3f9a8ad0/e8049419-67c0-5a32-90f9-13be3f9a8ad0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 627123,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/0197747466364a1a99efa5fc81023eeb/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8049419-67c0-5a32-90f9-13be3f9a8ad0/e8049419-67c0-5a32-90f9-13be3f9a8ad0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 722586,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/0197747466364a1a99efa5fc81023eeb/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8049419-67c0-5a32-90f9-13be3f9a8ad0/e8049419-67c0-5a32-90f9-13be3f9a8ad0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 611507,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/0197747466364a1a99efa5fc81023eeb/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8049419-67c0-5a32-90f9-13be3f9a8ad0/e8049419-67c0-5a32-90f9-13be3f9a8ad0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 615556,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/0197747466364a1a99efa5fc81023eeb/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8049419-67c0-5a32-90f9-13be3f9a8ad0/e8049419-67c0-5a32-90f9-13be3f9a8ad0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 652544,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/0197747466364a1a99efa5fc81023eeb/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8049419-67c0-5a32-90f9-13be3f9a8ad0/e8049419-67c0-5a32-90f9-13be3f9a8ad0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 685768,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/0197747466364a1a99efa5fc81023eeb/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8049419-67c0-5a32-90f9-13be3f9a8ad0/e8049419-67c0-5a32-90f9-13be3f9a8ad0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 444303,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/0197747466364a1a99efa5fc81023eeb/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8049419-67c0-5a32-90f9-13be3f9a8ad0/e8049419-67c0-5a32-90f9-13be3f9a8ad0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 393387,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/0197747466364a1a99efa5fc81023eeb/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 508 SW 1.5 BLUEHDI 130 S&S AUTO ALLURE PACK',
 'transmission': 'automatic',
 'trim': '1.5 BLUEHDI 130 S&S AUTO ALLURE PACK',
 'vin': None,
 'year': 2022}
2026-03-26 22:54:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985537%27 HTTP/1.1" 200 None
2026-03-26 22:54:21 [ayvens.be] INFO: Saving data for 1985537: {'created_time': 1774565661.744055, 'last_price_update_time': 1774565661.744064, 'auction_closing_time': 1774958400.0}
2026-03-26 22:54:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985537') HTTP/1.1" 204 0
2026-03-26 22:54:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F2e159d25ef7c4077b78d6b7a8a1a257f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/2e159d25ef7c4077b78d6b7a8a1a257f/images/large/6.jpg not downloaded yet
2026-03-26 22:54:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/8a49c00a2e3a48809c68c90e9cbf142e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F2e159d25ef7c4077b78d6b7a8a1a257f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/2e159d25ef7c4077b78d6b7a8a1a257f/images/large/7.jpg not downloaded yet
2026-03-26 22:54:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/8a49c00a2e3a48809c68c90e9cbf142e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/8a49c00a2e3a48809c68c90e9cbf142e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/8a49c00a2e3a48809c68c90e9cbf142e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F2e159d25ef7c4077b78d6b7a8a1a257f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/2e159d25ef7c4077b78d6b7a8a1a257f/images/large/8.jpg not downloaded yet
2026-03-26 22:54:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/8a49c00a2e3a48809c68c90e9cbf142e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/8a49c00a2e3a48809c68c90e9cbf142e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F2e159d25ef7c4077b78d6b7a8a1a257f%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/2e159d25ef7c4077b78d6b7a8a1a257f/images/large/9.jpg not downloaded yet
2026-03-26 22:54:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/8a49c00a2e3a48809c68c90e9cbf142e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F2e159d25ef7c4077b78d6b7a8a1a257f%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/2e159d25ef7c4077b78d6b7a8a1a257f/images/large/10.jpg not downloaded yet
2026-03-26 22:54:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/2e159d25ef7c4077b78d6b7a8a1a257f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:21 [ayvens.be] INFO: Found listing with ID: 1985540
2026-03-26 22:54:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985540%27 HTTP/1.1" 200 None
2026-03-26 22:54:21 [ayvens.be] INFO: Scrape type for 1985540: 1
2026-03-26 22:54:21 [ayvens.be] INFO: Extracting data for car ID: 1985540
2026-03-26 22:54:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c7920fc-e9bf-5130-8ddf-61283075c353 with identifier: 1985540
2026-03-26 22:54:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c7920fc-e9bf-5130-8ddf-61283075c353 with scrape type 1
2026-03-26 22:54:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5c7920fc-e9bf-5130-8ddf-61283075c353
2026-03-26 22:54:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F0ca1e55053384ced819f7ec36b00cc3c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/0ca1e55053384ced819f7ec36b00cc3c/images/large/1.jpg not downloaded yet
2026-03-26 22:54:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F0ca1e55053384ced819f7ec36b00cc3c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/0ca1e55053384ced819f7ec36b00cc3c/images/large/2.jpg not downloaded yet
2026-03-26 22:54:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F0ca1e55053384ced819f7ec36b00cc3c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/0ca1e55053384ced819f7ec36b00cc3c/images/large/3.jpg not downloaded yet
2026-03-26 22:54:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7593350>
2026-03-26 22:54:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02602273-374d-59c0-8940-51e50b8740ed/02602273-374d-59c0-8940-51e50b8740ed_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F8a49c00a2e3a48809c68c90e9cbf142e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/8a49c00a2e3a48809c68c90e9cbf142e/images/large/3.jpg saved to cache
2026-03-26 22:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 02602273-374d-59c0-8940-51e50b8740ed
2026-03-26 22:54:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6df1990>
2026-03-26 22:54:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02602273-374d-59c0-8940-51e50b8740ed/02602273-374d-59c0-8940-51e50b8740ed_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F8a49c00a2e3a48809c68c90e9cbf142e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/8a49c00a2e3a48809c68c90e9cbf142e/images/large/4.jpg saved to cache
2026-03-26 22:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 02602273-374d-59c0-8940-51e50b8740ed
2026-03-26 22:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F0ca1e55053384ced819f7ec36b00cc3c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/0ca1e55053384ced819f7ec36b00cc3c/images/large/4.jpg not downloaded yet
2026-03-26 22:54:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7689e10>
2026-03-26 22:54:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02602273-374d-59c0-8940-51e50b8740ed/02602273-374d-59c0-8940-51e50b8740ed_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F8a49c00a2e3a48809c68c90e9cbf142e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/8a49c00a2e3a48809c68c90e9cbf142e/images/large/5.jpg saved to cache
2026-03-26 22:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 02602273-374d-59c0-8940-51e50b8740ed
2026-03-26 22:54:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7584b50>
2026-03-26 22:54:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02602273-374d-59c0-8940-51e50b8740ed/02602273-374d-59c0-8940-51e50b8740ed_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F8a49c00a2e3a48809c68c90e9cbf142e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/8a49c00a2e3a48809c68c90e9cbf142e/images/large/7.jpg saved to cache
2026-03-26 22:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 02602273-374d-59c0-8940-51e50b8740ed
2026-03-26 22:54:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd3c4590>
2026-03-26 22:54:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02602273-374d-59c0-8940-51e50b8740ed/02602273-374d-59c0-8940-51e50b8740ed_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F8a49c00a2e3a48809c68c90e9cbf142e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/8a49c00a2e3a48809c68c90e9cbf142e/images/large/2.jpg saved to cache
2026-03-26 22:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 02602273-374d-59c0-8940-51e50b8740ed
2026-03-26 22:54:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b78c3ed0>
2026-03-26 22:54:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02602273-374d-59c0-8940-51e50b8740ed/02602273-374d-59c0-8940-51e50b8740ed_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F8a49c00a2e3a48809c68c90e9cbf142e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/8a49c00a2e3a48809c68c90e9cbf142e/images/large/6.jpg saved to cache
2026-03-26 22:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 02602273-374d-59c0-8940-51e50b8740ed
2026-03-26 22:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F0ca1e55053384ced819f7ec36b00cc3c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/0ca1e55053384ced819f7ec36b00cc3c/images/large/5.jpg not downloaded yet
2026-03-26 22:54:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77ebfd0>
2026-03-26 22:54:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02602273-374d-59c0-8940-51e50b8740ed/02602273-374d-59c0-8940-51e50b8740ed_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F8a49c00a2e3a48809c68c90e9cbf142e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/8a49c00a2e3a48809c68c90e9cbf142e/images/large/8.jpg saved to cache
2026-03-26 22:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 02602273-374d-59c0-8940-51e50b8740ed
2026-03-26 22:54:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76a7950>
2026-03-26 22:54:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_137c0adf-7bc5-5006-8a80-389121a630c5/137c0adf-7bc5-5006-8a80-389121a630c5_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F2e159d25ef7c4077b78d6b7a8a1a257f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/2e159d25ef7c4077b78d6b7a8a1a257f/images/large/3.jpg saved to cache
2026-03-26 22:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 137c0adf-7bc5-5006-8a80-389121a630c5
2026-03-26 22:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F0ca1e55053384ced819f7ec36b00cc3c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/0ca1e55053384ced819f7ec36b00cc3c/images/large/6.jpg not downloaded yet
2026-03-26 22:54:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/2e159d25ef7c4077b78d6b7a8a1a257f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F0ca1e55053384ced819f7ec36b00cc3c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/0ca1e55053384ced819f7ec36b00cc3c/images/large/7.jpg not downloaded yet
2026-03-26 22:54:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/8a49c00a2e3a48809c68c90e9cbf142e/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/2e159d25ef7c4077b78d6b7a8a1a257f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/2e159d25ef7c4077b78d6b7a8a1a257f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F0ca1e55053384ced819f7ec36b00cc3c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/0ca1e55053384ced819f7ec36b00cc3c/images/large/8.jpg not downloaded yet
2026-03-26 22:54:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/2e159d25ef7c4077b78d6b7a8a1a257f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/2e159d25ef7c4077b78d6b7a8a1a257f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/2e159d25ef7c4077b78d6b7a8a1a257f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F0ca1e55053384ced819f7ec36b00cc3c%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/0ca1e55053384ced819f7ec36b00cc3c/images/large/9.jpg not downloaded yet
2026-03-26 22:54:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/8a49c00a2e3a48809c68c90e9cbf142e/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F0ca1e55053384ced819f7ec36b00cc3c%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/0ca1e55053384ced819f7ec36b00cc3c/images/large/10.jpg not downloaded yet
2026-03-26 22:54:22 [ayvens.be] INFO: Found listing with ID: 1985541
2026-03-26 22:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985541%27 HTTP/1.1" 200 None
2026-03-26 22:54:22 [ayvens.be] INFO: Scrape type for 1985541: 1
2026-03-26 22:54:22 [ayvens.be] INFO: Extracting data for car ID: 1985541
2026-03-26 22:54:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467 with identifier: 1985541
2026-03-26 22:54:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467 with scrape type 1
2026-03-26 22:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467
2026-03-26 22:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Ffab560d7db274c89bbca40c9b2ed0861%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/fab560d7db274c89bbca40c9b2ed0861/images/large/1.jpg not downloaded yet
2026-03-26 22:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Ffab560d7db274c89bbca40c9b2ed0861%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/fab560d7db274c89bbca40c9b2ed0861/images/large/2.jpg not downloaded yet
2026-03-26 22:54:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79dc090>
2026-03-26 22:54:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_137c0adf-7bc5-5006-8a80-389121a630c5/137c0adf-7bc5-5006-8a80-389121a630c5_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:54:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F2e159d25ef7c4077b78d6b7a8a1a257f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/2e159d25ef7c4077b78d6b7a8a1a257f/images/large/2.jpg saved to cache
2026-03-26 22:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 137c0adf-7bc5-5006-8a80-389121a630c5
2026-03-26 22:54:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Ffab560d7db274c89bbca40c9b2ed0861%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/fab560d7db274c89bbca40c9b2ed0861/images/large/3.jpg not downloaded yet
2026-03-26 22:54:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77ea0d0>
2026-03-26 22:54:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02602273-374d-59c0-8940-51e50b8740ed/02602273-374d-59c0-8940-51e50b8740ed_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:54:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F8a49c00a2e3a48809c68c90e9cbf142e%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/8a49c00a2e3a48809c68c90e9cbf142e/images/large/10.jpg saved to cache
2026-03-26 22:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 02602273-374d-59c0-8940-51e50b8740ed
2026-03-26 22:54:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b740ac90>
2026-03-26 22:54:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_137c0adf-7bc5-5006-8a80-389121a630c5/137c0adf-7bc5-5006-8a80-389121a630c5_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:54:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F2e159d25ef7c4077b78d6b7a8a1a257f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/2e159d25ef7c4077b78d6b7a8a1a257f/images/large/4.jpg saved to cache
2026-03-26 22:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 137c0adf-7bc5-5006-8a80-389121a630c5
2026-03-26 22:54:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c5f450>
2026-03-26 22:54:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_137c0adf-7bc5-5006-8a80-389121a630c5/137c0adf-7bc5-5006-8a80-389121a630c5_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:54:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F2e159d25ef7c4077b78d6b7a8a1a257f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/2e159d25ef7c4077b78d6b7a8a1a257f/images/large/1.jpg saved to cache
2026-03-26 22:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 137c0adf-7bc5-5006-8a80-389121a630c5
2026-03-26 22:54:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Ffab560d7db274c89bbca40c9b2ed0861%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/fab560d7db274c89bbca40c9b2ed0861/images/large/4.jpg not downloaded yet
2026-03-26 22:54:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Ffab560d7db274c89bbca40c9b2ed0861%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/fab560d7db274c89bbca40c9b2ed0861/images/large/5.jpg not downloaded yet
2026-03-26 22:54:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c5e5d0>
2026-03-26 22:54:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_137c0adf-7bc5-5006-8a80-389121a630c5/137c0adf-7bc5-5006-8a80-389121a630c5_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:54:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F2e159d25ef7c4077b78d6b7a8a1a257f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/2e159d25ef7c4077b78d6b7a8a1a257f/images/large/6.jpg saved to cache
2026-03-26 22:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 137c0adf-7bc5-5006-8a80-389121a630c5
2026-03-26 22:54:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e2a590>
2026-03-26 22:54:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_137c0adf-7bc5-5006-8a80-389121a630c5/137c0adf-7bc5-5006-8a80-389121a630c5_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:54:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F2e159d25ef7c4077b78d6b7a8a1a257f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/2e159d25ef7c4077b78d6b7a8a1a257f/images/large/7.jpg saved to cache
2026-03-26 22:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 137c0adf-7bc5-5006-8a80-389121a630c5
2026-03-26 22:54:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74499d0>
2026-03-26 22:54:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_137c0adf-7bc5-5006-8a80-389121a630c5/137c0adf-7bc5-5006-8a80-389121a630c5_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:54:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F2e159d25ef7c4077b78d6b7a8a1a257f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/2e159d25ef7c4077b78d6b7a8a1a257f/images/large/5.jpg saved to cache
2026-03-26 22:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 137c0adf-7bc5-5006-8a80-389121a630c5
2026-03-26 22:54:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c62190>
2026-03-26 22:54:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02602273-374d-59c0-8940-51e50b8740ed/02602273-374d-59c0-8940-51e50b8740ed_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:54:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F8a49c00a2e3a48809c68c90e9cbf142e%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/8a49c00a2e3a48809c68c90e9cbf142e/images/large/9.jpg saved to cache
2026-03-26 22:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 02602273-374d-59c0-8940-51e50b8740ed
2026-03-26 22:54:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 02602273-374d-59c0-8940-51e50b8740ed, skipping ID generation
2026-03-26 22:54:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02602273-374d-59c0-8940-51e50b8740ed with scrape type 1
2026-03-26 22:54:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 02602273-374d-59c0-8940-51e50b8740ed sending to next pipeline
2026-03-26 22:54:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 02602273-374d-59c0-8940-51e50b8740ed, identifier: 1985538
2026-03-26 22:54:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 02602273-374d-59c0-8940-51e50b8740ed with identifier: 1985538
2026-03-26 22:54:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 02602273-374d-59c0-8940-51e50b8740ed with identifier: 1985538
2026-03-26 22:54:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 02602273-374d-59c0-8940-51e50b8740ed with identifier: 1985538 to the API
2026-03-26 22:54:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:54:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:54:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bp/8a49c00a2e3a48809c68c90e9cbf142e/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '02602273-374d-59c0-8940-51e50b8740ed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A4',
 'odometer': 150035,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02602273-374d-59c0-8940-51e50b8740ed/02602273-374d-59c0-8940-51e50b8740ed_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 756997,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/8a49c00a2e3a48809c68c90e9cbf142e/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02602273-374d-59c0-8940-51e50b8740ed/02602273-374d-59c0-8940-51e50b8740ed_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 765128,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/8a49c00a2e3a48809c68c90e9cbf142e/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02602273-374d-59c0-8940-51e50b8740ed/02602273-374d-59c0-8940-51e50b8740ed_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 752558,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/8a49c00a2e3a48809c68c90e9cbf142e/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02602273-374d-59c0-8940-51e50b8740ed/02602273-374d-59c0-8940-51e50b8740ed_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 771452,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/8a49c00a2e3a48809c68c90e9cbf142e/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02602273-374d-59c0-8940-51e50b8740ed/02602273-374d-59c0-8940-51e50b8740ed_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 751555,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/8a49c00a2e3a48809c68c90e9cbf142e/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02602273-374d-59c0-8940-51e50b8740ed/02602273-374d-59c0-8940-51e50b8740ed_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 785824,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/8a49c00a2e3a48809c68c90e9cbf142e/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02602273-374d-59c0-8940-51e50b8740ed/02602273-374d-59c0-8940-51e50b8740ed_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 620863,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/8a49c00a2e3a48809c68c90e9cbf142e/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02602273-374d-59c0-8940-51e50b8740ed/02602273-374d-59c0-8940-51e50b8740ed_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 897300,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/8a49c00a2e3a48809c68c90e9cbf142e/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02602273-374d-59c0-8940-51e50b8740ed/02602273-374d-59c0-8940-51e50b8740ed_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 808119,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/8a49c00a2e3a48809c68c90e9cbf142e/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02602273-374d-59c0-8940-51e50b8740ed/02602273-374d-59c0-8940-51e50b8740ed_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 823064,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/8a49c00a2e3a48809c68c90e9cbf142e/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A4 2.0 35 TDI 120KW S TR S LINE BUSINESS ED',
 'transmission': 'automatic',
 'trim': '2.0 35 TDI 120KW S TR S LINE BUSINESS ED',
 'vin': None,
 'year': 2022}
2026-03-26 22:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985538%27 HTTP/1.1" 200 None
2026-03-26 22:54:24 [ayvens.be] INFO: Saving data for 1985538: {'created_time': 1774565664.233275, 'last_price_update_time': 1774565664.233285, 'auction_closing_time': 1774958400.0}
2026-03-26 22:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985538') HTTP/1.1" 204 0
2026-03-26 22:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Ffab560d7db274c89bbca40c9b2ed0861%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/fab560d7db274c89bbca40c9b2ed0861/images/large/6.jpg not downloaded yet
2026-03-26 22:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Ffab560d7db274c89bbca40c9b2ed0861%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/fab560d7db274c89bbca40c9b2ed0861/images/large/7.jpg not downloaded yet
2026-03-26 22:54:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/2e159d25ef7c4077b78d6b7a8a1a257f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Ffab560d7db274c89bbca40c9b2ed0861%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/fab560d7db274c89bbca40c9b2ed0861/images/large/8.jpg not downloaded yet
2026-03-26 22:54:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/0ca1e55053384ced819f7ec36b00cc3c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/0ca1e55053384ced819f7ec36b00cc3c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Ffab560d7db274c89bbca40c9b2ed0861%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/fab560d7db274c89bbca40c9b2ed0861/images/large/9.jpg not downloaded yet
2026-03-26 22:54:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/2e159d25ef7c4077b78d6b7a8a1a257f/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/0ca1e55053384ced819f7ec36b00cc3c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/0ca1e55053384ced819f7ec36b00cc3c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/0ca1e55053384ced819f7ec36b00cc3c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Ffab560d7db274c89bbca40c9b2ed0861%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/fab560d7db274c89bbca40c9b2ed0861/images/large/10.jpg not downloaded yet
2026-03-26 22:54:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/2e159d25ef7c4077b78d6b7a8a1a257f/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:24 [ayvens.be] INFO: Found listing with ID: 1985542
2026-03-26 22:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985542%27 HTTP/1.1" 200 None
2026-03-26 22:54:24 [ayvens.be] INFO: Scrape type for 1985542: 1
2026-03-26 22:54:24 [ayvens.be] INFO: Extracting data for car ID: 1985542
2026-03-26 22:54:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f9c68b3-6983-5ac0-8bcd-39735c55a15c with identifier: 1985542
2026-03-26 22:54:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f9c68b3-6983-5ac0-8bcd-39735c55a15c with scrape type 1
2026-03-26 22:54:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4f9c68b3-6983-5ac0-8bcd-39735c55a15c
2026-03-26 22:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fa718a1748e264e61815cba78469913db%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/a718a1748e264e61815cba78469913db/images/large/1.jpg not downloaded yet
2026-03-26 22:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fa718a1748e264e61815cba78469913db%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/a718a1748e264e61815cba78469913db/images/large/2.jpg not downloaded yet
2026-03-26 22:54:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e45350>
2026-03-26 22:54:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_137c0adf-7bc5-5006-8a80-389121a630c5/137c0adf-7bc5-5006-8a80-389121a630c5_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F2e159d25ef7c4077b78d6b7a8a1a257f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/2e159d25ef7c4077b78d6b7a8a1a257f/images/large/8.jpg saved to cache
2026-03-26 22:54:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 137c0adf-7bc5-5006-8a80-389121a630c5
2026-03-26 22:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fa718a1748e264e61815cba78469913db%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/a718a1748e264e61815cba78469913db/images/large/3.jpg not downloaded yet
2026-03-26 22:54:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e448d0>
2026-03-26 22:54:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c7920fc-e9bf-5130-8ddf-61283075c353/5c7920fc-e9bf-5130-8ddf-61283075c353_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F0ca1e55053384ced819f7ec36b00cc3c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/0ca1e55053384ced819f7ec36b00cc3c/images/large/2.jpg saved to cache
2026-03-26 22:54:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5c7920fc-e9bf-5130-8ddf-61283075c353
2026-03-26 22:54:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7477890>
2026-03-26 22:54:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c7920fc-e9bf-5130-8ddf-61283075c353/5c7920fc-e9bf-5130-8ddf-61283075c353_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F0ca1e55053384ced819f7ec36b00cc3c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/0ca1e55053384ced819f7ec36b00cc3c/images/large/4.jpg saved to cache
2026-03-26 22:54:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5c7920fc-e9bf-5130-8ddf-61283075c353
2026-03-26 22:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fa718a1748e264e61815cba78469913db%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/a718a1748e264e61815cba78469913db/images/large/4.jpg not downloaded yet
2026-03-26 22:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fa718a1748e264e61815cba78469913db%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/a718a1748e264e61815cba78469913db/images/large/5.jpg not downloaded yet
2026-03-26 22:54:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b98dd0>
2026-03-26 22:54:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_137c0adf-7bc5-5006-8a80-389121a630c5/137c0adf-7bc5-5006-8a80-389121a630c5_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F2e159d25ef7c4077b78d6b7a8a1a257f%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/2e159d25ef7c4077b78d6b7a8a1a257f/images/large/9.jpg saved to cache
2026-03-26 22:54:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 137c0adf-7bc5-5006-8a80-389121a630c5
2026-03-26 22:54:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74930d0>
2026-03-26 22:54:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c7920fc-e9bf-5130-8ddf-61283075c353/5c7920fc-e9bf-5130-8ddf-61283075c353_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:54:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F0ca1e55053384ced819f7ec36b00cc3c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/0ca1e55053384ced819f7ec36b00cc3c/images/large/1.jpg saved to cache
2026-03-26 22:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5c7920fc-e9bf-5130-8ddf-61283075c353
2026-03-26 22:54:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7910890>
2026-03-26 22:54:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c7920fc-e9bf-5130-8ddf-61283075c353/5c7920fc-e9bf-5130-8ddf-61283075c353_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:54:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F0ca1e55053384ced819f7ec36b00cc3c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/0ca1e55053384ced819f7ec36b00cc3c/images/large/5.jpg saved to cache
2026-03-26 22:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5c7920fc-e9bf-5130-8ddf-61283075c353
2026-03-26 22:54:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c94c90>
2026-03-26 22:54:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c7920fc-e9bf-5130-8ddf-61283075c353/5c7920fc-e9bf-5130-8ddf-61283075c353_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:54:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F0ca1e55053384ced819f7ec36b00cc3c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/0ca1e55053384ced819f7ec36b00cc3c/images/large/3.jpg saved to cache
2026-03-26 22:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5c7920fc-e9bf-5130-8ddf-61283075c353
2026-03-26 22:54:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b16590>
2026-03-26 22:54:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_137c0adf-7bc5-5006-8a80-389121a630c5/137c0adf-7bc5-5006-8a80-389121a630c5_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:54:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F2e159d25ef7c4077b78d6b7a8a1a257f%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/2e159d25ef7c4077b78d6b7a8a1a257f/images/large/10.jpg saved to cache
2026-03-26 22:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 137c0adf-7bc5-5006-8a80-389121a630c5
2026-03-26 22:54:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 137c0adf-7bc5-5006-8a80-389121a630c5, skipping ID generation
2026-03-26 22:54:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 137c0adf-7bc5-5006-8a80-389121a630c5 with scrape type 1
2026-03-26 22:54:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 137c0adf-7bc5-5006-8a80-389121a630c5 sending to next pipeline
2026-03-26 22:54:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 137c0adf-7bc5-5006-8a80-389121a630c5, identifier: 1985539
2026-03-26 22:54:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 137c0adf-7bc5-5006-8a80-389121a630c5 with identifier: 1985539
2026-03-26 22:54:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 137c0adf-7bc5-5006-8a80-389121a630c5 with identifier: 1985539
2026-03-26 22:54:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 137c0adf-7bc5-5006-8a80-389121a630c5 with identifier: 1985539 to the API
2026-03-26 22:54:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:54:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:54:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2dl/2e159d25ef7c4077b78d6b7a8a1a257f/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '137c0adf-7bc5-5006-8a80-389121a630c5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A-CLASS',
 'odometer': 29940,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_137c0adf-7bc5-5006-8a80-389121a630c5/137c0adf-7bc5-5006-8a80-389121a630c5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 644337,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/2e159d25ef7c4077b78d6b7a8a1a257f/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_137c0adf-7bc5-5006-8a80-389121a630c5/137c0adf-7bc5-5006-8a80-389121a630c5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 664754,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/2e159d25ef7c4077b78d6b7a8a1a257f/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_137c0adf-7bc5-5006-8a80-389121a630c5/137c0adf-7bc5-5006-8a80-389121a630c5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 626722,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/2e159d25ef7c4077b78d6b7a8a1a257f/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_137c0adf-7bc5-5006-8a80-389121a630c5/137c0adf-7bc5-5006-8a80-389121a630c5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 658350,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/2e159d25ef7c4077b78d6b7a8a1a257f/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_137c0adf-7bc5-5006-8a80-389121a630c5/137c0adf-7bc5-5006-8a80-389121a630c5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 674873,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/2e159d25ef7c4077b78d6b7a8a1a257f/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_137c0adf-7bc5-5006-8a80-389121a630c5/137c0adf-7bc5-5006-8a80-389121a630c5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 760162,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/2e159d25ef7c4077b78d6b7a8a1a257f/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_137c0adf-7bc5-5006-8a80-389121a630c5/137c0adf-7bc5-5006-8a80-389121a630c5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 663314,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/2e159d25ef7c4077b78d6b7a8a1a257f/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_137c0adf-7bc5-5006-8a80-389121a630c5/137c0adf-7bc5-5006-8a80-389121a630c5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 889217,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/2e159d25ef7c4077b78d6b7a8a1a257f/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_137c0adf-7bc5-5006-8a80-389121a630c5/137c0adf-7bc5-5006-8a80-389121a630c5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 867629,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/2e159d25ef7c4077b78d6b7a8a1a257f/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_137c0adf-7bc5-5006-8a80-389121a630c5/137c0adf-7bc5-5006-8a80-389121a630c5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 825676,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/2e159d25ef7c4077b78d6b7a8a1a257f/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-04-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ A-CLASS 1.3 A 250 E LUXURY LINE DCT',
 'transmission': 'automatic',
 'trim': '1.3 A 250 E LUXURY LINE DCT',
 'vin': None,
 'year': 2023}
2026-03-26 22:54:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985539%27 HTTP/1.1" 200 None
2026-03-26 22:54:25 [ayvens.be] INFO: Saving data for 1985539: {'created_time': 1774565665.849712, 'last_price_update_time': 1774565665.849722, 'auction_closing_time': 1774958400.0}
2026-03-26 22:54:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985539') HTTP/1.1" 204 0
2026-03-26 22:54:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fa718a1748e264e61815cba78469913db%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/a718a1748e264e61815cba78469913db/images/large/6.jpg not downloaded yet
2026-03-26 22:54:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fa718a1748e264e61815cba78469913db%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/a718a1748e264e61815cba78469913db/images/large/7.jpg not downloaded yet
2026-03-26 22:54:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/fab560d7db274c89bbca40c9b2ed0861/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/0ca1e55053384ced819f7ec36b00cc3c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/fab560d7db274c89bbca40c9b2ed0861/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fa718a1748e264e61815cba78469913db%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/a718a1748e264e61815cba78469913db/images/large/8.jpg not downloaded yet
2026-03-26 22:54:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/0ca1e55053384ced819f7ec36b00cc3c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/0ca1e55053384ced819f7ec36b00cc3c/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/fab560d7db274c89bbca40c9b2ed0861/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/0ca1e55053384ced819f7ec36b00cc3c/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fa718a1748e264e61815cba78469913db%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/a718a1748e264e61815cba78469913db/images/large/9.jpg not downloaded yet
2026-03-26 22:54:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/fab560d7db274c89bbca40c9b2ed0861/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fa718a1748e264e61815cba78469913db%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/a718a1748e264e61815cba78469913db/images/large/10.jpg not downloaded yet
2026-03-26 22:54:25 [ayvens.be] INFO: Found listing with ID: 1985543
2026-03-26 22:54:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985543%27 HTTP/1.1" 200 None
2026-03-26 22:54:26 [ayvens.be] INFO: Scrape type for 1985543: 1
2026-03-26 22:54:26 [ayvens.be] INFO: Extracting data for car ID: 1985543
2026-03-26 22:54:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d0b083bf-6e40-5b10-aa61-972197b7bf06 with identifier: 1985543
2026-03-26 22:54:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0b083bf-6e40-5b10-aa61-972197b7bf06 with scrape type 1
2026-03-26 22:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d0b083bf-6e40-5b10-aa61-972197b7bf06
2026-03-26 22:54:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fea5cfa38bbc54015876c3e35e7fa5766%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/ea5cfa38bbc54015876c3e35e7fa5766/images/large/1.jpg not downloaded yet
2026-03-26 22:54:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fea5cfa38bbc54015876c3e35e7fa5766%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/ea5cfa38bbc54015876c3e35e7fa5766/images/large/2.jpg not downloaded yet
2026-03-26 22:54:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74bcd90>
2026-03-26 22:54:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467/8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:54:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Ffab560d7db274c89bbca40c9b2ed0861%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/fab560d7db274c89bbca40c9b2ed0861/images/large/3.jpg saved to cache
2026-03-26 22:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467
2026-03-26 22:54:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76a4110>
2026-03-26 22:54:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c7920fc-e9bf-5130-8ddf-61283075c353/5c7920fc-e9bf-5130-8ddf-61283075c353_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:54:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F0ca1e55053384ced819f7ec36b00cc3c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/0ca1e55053384ced819f7ec36b00cc3c/images/large/7.jpg saved to cache
2026-03-26 22:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5c7920fc-e9bf-5130-8ddf-61283075c353
2026-03-26 22:54:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fea5cfa38bbc54015876c3e35e7fa5766%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/ea5cfa38bbc54015876c3e35e7fa5766/images/large/3.jpg not downloaded yet
2026-03-26 22:54:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7448f50>
2026-03-26 22:54:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467/8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:54:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Ffab560d7db274c89bbca40c9b2ed0861%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/fab560d7db274c89bbca40c9b2ed0861/images/large/1.jpg saved to cache
2026-03-26 22:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467
2026-03-26 22:54:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fea5cfa38bbc54015876c3e35e7fa5766%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/ea5cfa38bbc54015876c3e35e7fa5766/images/large/4.jpg not downloaded yet
2026-03-26 22:54:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fea5cfa38bbc54015876c3e35e7fa5766%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/ea5cfa38bbc54015876c3e35e7fa5766/images/large/5.jpg not downloaded yet
2026-03-26 22:54:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b72ca550>
2026-03-26 22:54:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c7920fc-e9bf-5130-8ddf-61283075c353/5c7920fc-e9bf-5130-8ddf-61283075c353_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:54:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F0ca1e55053384ced819f7ec36b00cc3c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/0ca1e55053384ced819f7ec36b00cc3c/images/large/6.jpg saved to cache
2026-03-26 22:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5c7920fc-e9bf-5130-8ddf-61283075c353
2026-03-26 22:54:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c61e10>
2026-03-26 22:54:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c7920fc-e9bf-5130-8ddf-61283075c353/5c7920fc-e9bf-5130-8ddf-61283075c353_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:54:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F0ca1e55053384ced819f7ec36b00cc3c%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/0ca1e55053384ced819f7ec36b00cc3c/images/large/9.jpg saved to cache
2026-03-26 22:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5c7920fc-e9bf-5130-8ddf-61283075c353
2026-03-26 22:54:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79dc490>
2026-03-26 22:54:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467/8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:54:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Ffab560d7db274c89bbca40c9b2ed0861%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/fab560d7db274c89bbca40c9b2ed0861/images/large/2.jpg saved to cache
2026-03-26 22:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467
2026-03-26 22:54:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b776a790>
2026-03-26 22:54:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c7920fc-e9bf-5130-8ddf-61283075c353/5c7920fc-e9bf-5130-8ddf-61283075c353_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:54:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F0ca1e55053384ced819f7ec36b00cc3c%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/0ca1e55053384ced819f7ec36b00cc3c/images/large/10.jpg saved to cache
2026-03-26 22:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5c7920fc-e9bf-5130-8ddf-61283075c353
2026-03-26 22:54:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7426110>
2026-03-26 22:54:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467/8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:54:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Ffab560d7db274c89bbca40c9b2ed0861%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/fab560d7db274c89bbca40c9b2ed0861/images/large/4.jpg saved to cache
2026-03-26 22:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467
2026-03-26 22:54:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/fab560d7db274c89bbca40c9b2ed0861/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/fab560d7db274c89bbca40c9b2ed0861/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fea5cfa38bbc54015876c3e35e7fa5766%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/ea5cfa38bbc54015876c3e35e7fa5766/images/large/6.jpg not downloaded yet
2026-03-26 22:54:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/fab560d7db274c89bbca40c9b2ed0861/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fea5cfa38bbc54015876c3e35e7fa5766%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/ea5cfa38bbc54015876c3e35e7fa5766/images/large/7.jpg not downloaded yet
2026-03-26 22:54:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/a718a1748e264e61815cba78469913db/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/a718a1748e264e61815cba78469913db/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/a718a1748e264e61815cba78469913db/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fea5cfa38bbc54015876c3e35e7fa5766%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/ea5cfa38bbc54015876c3e35e7fa5766/images/large/8.jpg not downloaded yet
2026-03-26 22:54:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/a718a1748e264e61815cba78469913db/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/fab560d7db274c89bbca40c9b2ed0861/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fea5cfa38bbc54015876c3e35e7fa5766%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/ea5cfa38bbc54015876c3e35e7fa5766/images/large/9.jpg not downloaded yet
2026-03-26 22:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fea5cfa38bbc54015876c3e35e7fa5766%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/ea5cfa38bbc54015876c3e35e7fa5766/images/large/10.jpg not downloaded yet
2026-03-26 22:54:27 [ayvens.be] INFO: Found listing with ID: 1985544
2026-03-26 22:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985544%27 HTTP/1.1" 200 None
2026-03-26 22:54:27 [ayvens.be] INFO: Scrape type for 1985544: 1
2026-03-26 22:54:27 [ayvens.be] INFO: Extracting data for car ID: 1985544
2026-03-26 22:54:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 20b96f03-39fa-5bd4-85b8-d927562d4040 with identifier: 1985544
2026-03-26 22:54:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20b96f03-39fa-5bd4-85b8-d927562d4040 with scrape type 1
2026-03-26 22:54:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 20b96f03-39fa-5bd4-85b8-d927562d4040
2026-03-26 22:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Fdb68418ba78f4105ae59b9cfcd873d9d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/db68418ba78f4105ae59b9cfcd873d9d/images/large/1.jpg not downloaded yet
2026-03-26 22:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Fdb68418ba78f4105ae59b9cfcd873d9d%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/db68418ba78f4105ae59b9cfcd873d9d/images/large/2.jpg not downloaded yet
2026-03-26 22:54:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7ae8450>
2026-03-26 22:54:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467/8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Ffab560d7db274c89bbca40c9b2ed0861%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/fab560d7db274c89bbca40c9b2ed0861/images/large/6.jpg saved to cache
2026-03-26 22:54:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467
2026-03-26 22:54:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b741ec90>
2026-03-26 22:54:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467/8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Ffab560d7db274c89bbca40c9b2ed0861%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/fab560d7db274c89bbca40c9b2ed0861/images/large/5.jpg saved to cache
2026-03-26 22:54:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467
2026-03-26 22:54:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74e7050>
2026-03-26 22:54:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467/8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Ffab560d7db274c89bbca40c9b2ed0861%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/fab560d7db274c89bbca40c9b2ed0861/images/large/7.jpg saved to cache
2026-03-26 22:54:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467
2026-03-26 22:54:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b741f3d0>
2026-03-26 22:54:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f9c68b3-6983-5ac0-8bcd-39735c55a15c/4f9c68b3-6983-5ac0-8bcd-39735c55a15c_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fa718a1748e264e61815cba78469913db%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/a718a1748e264e61815cba78469913db/images/large/4.jpg saved to cache
2026-03-26 22:54:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4f9c68b3-6983-5ac0-8bcd-39735c55a15c
2026-03-26 22:54:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7a83150>
2026-03-26 22:54:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f9c68b3-6983-5ac0-8bcd-39735c55a15c/4f9c68b3-6983-5ac0-8bcd-39735c55a15c_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fa718a1748e264e61815cba78469913db%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/a718a1748e264e61815cba78469913db/images/large/2.jpg saved to cache
2026-03-26 22:54:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4f9c68b3-6983-5ac0-8bcd-39735c55a15c
2026-03-26 22:54:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cc8650>
2026-03-26 22:54:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f9c68b3-6983-5ac0-8bcd-39735c55a15c/4f9c68b3-6983-5ac0-8bcd-39735c55a15c_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fa718a1748e264e61815cba78469913db%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/a718a1748e264e61815cba78469913db/images/large/3.jpg saved to cache
2026-03-26 22:54:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4f9c68b3-6983-5ac0-8bcd-39735c55a15c
2026-03-26 22:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Fdb68418ba78f4105ae59b9cfcd873d9d%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/db68418ba78f4105ae59b9cfcd873d9d/images/large/3.jpg not downloaded yet
2026-03-26 22:54:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/ea5cfa38bbc54015876c3e35e7fa5766/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b728df90>
2026-03-26 22:54:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f9c68b3-6983-5ac0-8bcd-39735c55a15c/4f9c68b3-6983-5ac0-8bcd-39735c55a15c_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fa718a1748e264e61815cba78469913db%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/a718a1748e264e61815cba78469913db/images/large/1.jpg saved to cache
2026-03-26 22:54:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4f9c68b3-6983-5ac0-8bcd-39735c55a15c
2026-03-26 22:54:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6df0710>
2026-03-26 22:54:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467/8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Ffab560d7db274c89bbca40c9b2ed0861%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/fab560d7db274c89bbca40c9b2ed0861/images/large/8.jpg saved to cache
2026-03-26 22:54:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467
2026-03-26 22:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Fdb68418ba78f4105ae59b9cfcd873d9d%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/db68418ba78f4105ae59b9cfcd873d9d/images/large/4.jpg not downloaded yet
2026-03-26 22:54:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/fab560d7db274c89bbca40c9b2ed0861/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/ea5cfa38bbc54015876c3e35e7fa5766/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Fdb68418ba78f4105ae59b9cfcd873d9d%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/db68418ba78f4105ae59b9cfcd873d9d/images/large/5.jpg not downloaded yet
2026-03-26 22:54:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b742a050>
2026-03-26 22:54:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0b083bf-6e40-5b10-aa61-972197b7bf06/d0b083bf-6e40-5b10-aa61-972197b7bf06_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fea5cfa38bbc54015876c3e35e7fa5766%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/ea5cfa38bbc54015876c3e35e7fa5766/images/large/3.jpg saved to cache
2026-03-26 22:54:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d0b083bf-6e40-5b10-aa61-972197b7bf06
2026-03-26 22:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Fdb68418ba78f4105ae59b9cfcd873d9d%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/db68418ba78f4105ae59b9cfcd873d9d/images/large/6.jpg not downloaded yet
2026-03-26 22:54:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/a718a1748e264e61815cba78469913db/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Fdb68418ba78f4105ae59b9cfcd873d9d%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/db68418ba78f4105ae59b9cfcd873d9d/images/large/7.jpg not downloaded yet
2026-03-26 22:54:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/a718a1748e264e61815cba78469913db/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/fab560d7db274c89bbca40c9b2ed0861/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Fdb68418ba78f4105ae59b9cfcd873d9d%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/db68418ba78f4105ae59b9cfcd873d9d/images/large/8.jpg not downloaded yet
2026-03-26 22:54:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/ea5cfa38bbc54015876c3e35e7fa5766/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Fdb68418ba78f4105ae59b9cfcd873d9d%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/db68418ba78f4105ae59b9cfcd873d9d/images/large/9.jpg not downloaded yet
2026-03-26 22:54:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7778f10>
2026-03-26 22:54:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467/8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:54:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Ffab560d7db274c89bbca40c9b2ed0861%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/fab560d7db274c89bbca40c9b2ed0861/images/large/10.jpg saved to cache
2026-03-26 22:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467
2026-03-26 22:54:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76cc8d0>
2026-03-26 22:54:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0b083bf-6e40-5b10-aa61-972197b7bf06/d0b083bf-6e40-5b10-aa61-972197b7bf06_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:54:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fea5cfa38bbc54015876c3e35e7fa5766%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/ea5cfa38bbc54015876c3e35e7fa5766/images/large/2.jpg saved to cache
2026-03-26 22:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d0b083bf-6e40-5b10-aa61-972197b7bf06
2026-03-26 22:54:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/0ca1e55053384ced819f7ec36b00cc3c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Fdb68418ba78f4105ae59b9cfcd873d9d%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/db68418ba78f4105ae59b9cfcd873d9d/images/large/10.jpg not downloaded yet
2026-03-26 22:54:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/ea5cfa38bbc54015876c3e35e7fa5766/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/ea5cfa38bbc54015876c3e35e7fa5766/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:28 [ayvens.be] INFO: Found listing with ID: 1985545
2026-03-26 22:54:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985545%27 HTTP/1.1" 200 None
2026-03-26 22:54:28 [ayvens.be] INFO: Scrape type for 1985545: 1
2026-03-26 22:54:28 [ayvens.be] INFO: Extracting data for car ID: 1985545
2026-03-26 22:54:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 585391de-3103-5b60-94d9-9311ab472214 with identifier: 1985545
2026-03-26 22:54:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 585391de-3103-5b60-94d9-9311ab472214 with scrape type 1
2026-03-26 22:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 585391de-3103-5b60-94d9-9311ab472214
2026-03-26 22:54:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fcc6e938998e846f78160b7ebcfbb0e0e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/cc6e938998e846f78160b7ebcfbb0e0e/images/large/1.jpg not downloaded yet
2026-03-26 22:54:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7439c10>
2026-03-26 22:54:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f9c68b3-6983-5ac0-8bcd-39735c55a15c/4f9c68b3-6983-5ac0-8bcd-39735c55a15c_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:54:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fa718a1748e264e61815cba78469913db%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/a718a1748e264e61815cba78469913db/images/large/6.jpg saved to cache
2026-03-26 22:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4f9c68b3-6983-5ac0-8bcd-39735c55a15c
2026-03-26 22:54:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c5f090>
2026-03-26 22:54:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f9c68b3-6983-5ac0-8bcd-39735c55a15c/4f9c68b3-6983-5ac0-8bcd-39735c55a15c_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:54:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fa718a1748e264e61815cba78469913db%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/a718a1748e264e61815cba78469913db/images/large/7.jpg saved to cache
2026-03-26 22:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4f9c68b3-6983-5ac0-8bcd-39735c55a15c
2026-03-26 22:54:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76ecf50>
2026-03-26 22:54:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467/8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:54:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Ffab560d7db274c89bbca40c9b2ed0861%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/fab560d7db274c89bbca40c9b2ed0861/images/large/9.jpg saved to cache
2026-03-26 22:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467
2026-03-26 22:54:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467, skipping ID generation
2026-03-26 22:54:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467 with scrape type 1
2026-03-26 22:54:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467 sending to next pipeline
2026-03-26 22:54:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467, identifier: 1985541
2026-03-26 22:54:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7429f90>
2026-03-26 22:54:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0b083bf-6e40-5b10-aa61-972197b7bf06/d0b083bf-6e40-5b10-aa61-972197b7bf06_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:54:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fea5cfa38bbc54015876c3e35e7fa5766%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/ea5cfa38bbc54015876c3e35e7fa5766/images/large/5.jpg saved to cache
2026-03-26 22:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d0b083bf-6e40-5b10-aa61-972197b7bf06
2026-03-26 22:54:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/ea5cfa38bbc54015876c3e35e7fa5766/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fcc6e938998e846f78160b7ebcfbb0e0e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/cc6e938998e846f78160b7ebcfbb0e0e/images/large/2.jpg not downloaded yet
2026-03-26 22:54:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467 with identifier: 1985541
2026-03-26 22:54:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467 with identifier: 1985541
2026-03-26 22:54:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467 with identifier: 1985541 to the API
2026-03-26 22:54:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:54:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:54:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2br/fab560d7db274c89bbca40c9b2ed0861/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 169483,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467/8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 661585,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/fab560d7db274c89bbca40c9b2ed0861/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467/8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 665653,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/fab560d7db274c89bbca40c9b2ed0861/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467/8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 652332,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/fab560d7db274c89bbca40c9b2ed0861/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467/8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 699208,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/fab560d7db274c89bbca40c9b2ed0861/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467/8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 567902,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/fab560d7db274c89bbca40c9b2ed0861/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467/8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 536700,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/fab560d7db274c89bbca40c9b2ed0861/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467/8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 604053,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/fab560d7db274c89bbca40c9b2ed0861/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467/8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 712557,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/fab560d7db274c89bbca40c9b2ed0861/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467/8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 617094,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/fab560d7db274c89bbca40c9b2ed0861/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467/8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 409771,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/fab560d7db274c89bbca40c9b2ed0861/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 1.5 XDRIVE25E (162KW)',
 'transmission': 'automatic',
 'trim': '1.5 XDRIVE25E (162KW)',
 'vin': None,
 'year': 2022}
2026-03-26 22:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985541%27 HTTP/1.1" 200 None
2026-03-26 22:54:29 [ayvens.be] INFO: Saving data for 1985541: {'created_time': 1774565669.068038, 'last_price_update_time': 1774565669.068049, 'auction_closing_time': 1774958400.0}
2026-03-26 22:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985541') HTTP/1.1" 204 0
2026-03-26 22:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fcc6e938998e846f78160b7ebcfbb0e0e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/cc6e938998e846f78160b7ebcfbb0e0e/images/large/3.jpg not downloaded yet
2026-03-26 22:54:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b15f10>
2026-03-26 22:54:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c7920fc-e9bf-5130-8ddf-61283075c353/5c7920fc-e9bf-5130-8ddf-61283075c353_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F0ca1e55053384ced819f7ec36b00cc3c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/0ca1e55053384ced819f7ec36b00cc3c/images/large/8.jpg saved to cache
2026-03-26 22:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5c7920fc-e9bf-5130-8ddf-61283075c353
2026-03-26 22:54:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5c7920fc-e9bf-5130-8ddf-61283075c353, skipping ID generation
2026-03-26 22:54:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c7920fc-e9bf-5130-8ddf-61283075c353 with scrape type 1
2026-03-26 22:54:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5c7920fc-e9bf-5130-8ddf-61283075c353 sending to next pipeline
2026-03-26 22:54:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 5c7920fc-e9bf-5130-8ddf-61283075c353, identifier: 1985540
2026-03-26 22:54:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b746dc90>
2026-03-26 22:54:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0b083bf-6e40-5b10-aa61-972197b7bf06/d0b083bf-6e40-5b10-aa61-972197b7bf06_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fea5cfa38bbc54015876c3e35e7fa5766%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/ea5cfa38bbc54015876c3e35e7fa5766/images/large/1.jpg saved to cache
2026-03-26 22:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d0b083bf-6e40-5b10-aa61-972197b7bf06
2026-03-26 22:54:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e2be10>
2026-03-26 22:54:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0b083bf-6e40-5b10-aa61-972197b7bf06/d0b083bf-6e40-5b10-aa61-972197b7bf06_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fea5cfa38bbc54015876c3e35e7fa5766%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/ea5cfa38bbc54015876c3e35e7fa5766/images/large/4.jpg saved to cache
2026-03-26 22:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d0b083bf-6e40-5b10-aa61-972197b7bf06
2026-03-26 22:54:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 5c7920fc-e9bf-5130-8ddf-61283075c353 with identifier: 1985540
2026-03-26 22:54:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 5c7920fc-e9bf-5130-8ddf-61283075c353 with identifier: 1985540
2026-03-26 22:54:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 5c7920fc-e9bf-5130-8ddf-61283075c353 with identifier: 1985540 to the API
2026-03-26 22:54:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:54:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:54:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bq/0ca1e55053384ced819f7ec36b00cc3c/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '5c7920fc-e9bf-5130-8ddf-61283075c353',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 145068,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 20,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c7920fc-e9bf-5130-8ddf-61283075c353/5c7920fc-e9bf-5130-8ddf-61283075c353_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 855817,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/0ca1e55053384ced819f7ec36b00cc3c/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c7920fc-e9bf-5130-8ddf-61283075c353/5c7920fc-e9bf-5130-8ddf-61283075c353_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 797284,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/0ca1e55053384ced819f7ec36b00cc3c/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c7920fc-e9bf-5130-8ddf-61283075c353/5c7920fc-e9bf-5130-8ddf-61283075c353_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 832581,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/0ca1e55053384ced819f7ec36b00cc3c/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c7920fc-e9bf-5130-8ddf-61283075c353/5c7920fc-e9bf-5130-8ddf-61283075c353_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 809291,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/0ca1e55053384ced819f7ec36b00cc3c/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c7920fc-e9bf-5130-8ddf-61283075c353/5c7920fc-e9bf-5130-8ddf-61283075c353_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 859367,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/0ca1e55053384ced819f7ec36b00cc3c/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c7920fc-e9bf-5130-8ddf-61283075c353/5c7920fc-e9bf-5130-8ddf-61283075c353_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 873915,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/0ca1e55053384ced819f7ec36b00cc3c/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c7920fc-e9bf-5130-8ddf-61283075c353/5c7920fc-e9bf-5130-8ddf-61283075c353_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 656786,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/0ca1e55053384ced819f7ec36b00cc3c/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c7920fc-e9bf-5130-8ddf-61283075c353/5c7920fc-e9bf-5130-8ddf-61283075c353_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 851317,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/0ca1e55053384ced819f7ec36b00cc3c/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c7920fc-e9bf-5130-8ddf-61283075c353/5c7920fc-e9bf-5130-8ddf-61283075c353_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 784340,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/0ca1e55053384ced819f7ec36b00cc3c/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c7920fc-e9bf-5130-8ddf-61283075c353/5c7920fc-e9bf-5130-8ddf-61283075c353_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 770722,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/0ca1e55053384ced819f7ec36b00cc3c/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 1.5 SDRIVE16DA',
 'transmission': 'automatic',
 'trim': '1.5 SDRIVE16DA',
 'vin': None,
 'year': 2022}
2026-03-26 22:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985540%27 HTTP/1.1" 200 None
2026-03-26 22:54:29 [ayvens.be] INFO: Saving data for 1985540: {'created_time': 1774565669.679677, 'last_price_update_time': 1774565669.679687, 'auction_closing_time': 1774958400.0}
2026-03-26 22:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985540') HTTP/1.1" 204 0
2026-03-26 22:54:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/db68418ba78f4105ae59b9cfcd873d9d/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fcc6e938998e846f78160b7ebcfbb0e0e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/cc6e938998e846f78160b7ebcfbb0e0e/images/large/4.jpg not downloaded yet
2026-03-26 22:54:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6df3a50>
2026-03-26 22:54:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0b083bf-6e40-5b10-aa61-972197b7bf06/d0b083bf-6e40-5b10-aa61-972197b7bf06_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fea5cfa38bbc54015876c3e35e7fa5766%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/ea5cfa38bbc54015876c3e35e7fa5766/images/large/6.jpg saved to cache
2026-03-26 22:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d0b083bf-6e40-5b10-aa61-972197b7bf06
2026-03-26 22:54:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/db68418ba78f4105ae59b9cfcd873d9d/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/ea5cfa38bbc54015876c3e35e7fa5766/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fcc6e938998e846f78160b7ebcfbb0e0e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/cc6e938998e846f78160b7ebcfbb0e0e/images/large/5.jpg not downloaded yet
2026-03-26 22:54:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/ea5cfa38bbc54015876c3e35e7fa5766/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74cf950>
2026-03-26 22:54:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20b96f03-39fa-5bd4-85b8-d927562d4040/20b96f03-39fa-5bd4-85b8-d927562d4040_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Fdb68418ba78f4105ae59b9cfcd873d9d%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/db68418ba78f4105ae59b9cfcd873d9d/images/large/2.jpg saved to cache
2026-03-26 22:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 20b96f03-39fa-5bd4-85b8-d927562d4040
2026-03-26 22:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fcc6e938998e846f78160b7ebcfbb0e0e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/cc6e938998e846f78160b7ebcfbb0e0e/images/large/6.jpg not downloaded yet
2026-03-26 22:54:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/ea5cfa38bbc54015876c3e35e7fa5766/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/a718a1748e264e61815cba78469913db/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fcc6e938998e846f78160b7ebcfbb0e0e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/cc6e938998e846f78160b7ebcfbb0e0e/images/large/7.jpg not downloaded yet
2026-03-26 22:54:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/db68418ba78f4105ae59b9cfcd873d9d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fcc6e938998e846f78160b7ebcfbb0e0e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/cc6e938998e846f78160b7ebcfbb0e0e/images/large/8.jpg not downloaded yet
2026-03-26 22:54:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c81e10>
2026-03-26 22:54:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20b96f03-39fa-5bd4-85b8-d927562d4040/20b96f03-39fa-5bd4-85b8-d927562d4040_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:54:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Fdb68418ba78f4105ae59b9cfcd873d9d%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/db68418ba78f4105ae59b9cfcd873d9d/images/large/3.jpg saved to cache
2026-03-26 22:54:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 20b96f03-39fa-5bd4-85b8-d927562d4040
2026-03-26 22:54:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7ccea10>
2026-03-26 22:54:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0b083bf-6e40-5b10-aa61-972197b7bf06/d0b083bf-6e40-5b10-aa61-972197b7bf06_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:54:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fea5cfa38bbc54015876c3e35e7fa5766%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/ea5cfa38bbc54015876c3e35e7fa5766/images/large/10.jpg saved to cache
2026-03-26 22:54:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d0b083bf-6e40-5b10-aa61-972197b7bf06
2026-03-26 22:54:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/db68418ba78f4105ae59b9cfcd873d9d/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/db68418ba78f4105ae59b9cfcd873d9d/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fcc6e938998e846f78160b7ebcfbb0e0e%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/cc6e938998e846f78160b7ebcfbb0e0e/images/large/9.jpg not downloaded yet
2026-03-26 22:54:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b36b90>
2026-03-26 22:54:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0b083bf-6e40-5b10-aa61-972197b7bf06/d0b083bf-6e40-5b10-aa61-972197b7bf06_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:54:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fea5cfa38bbc54015876c3e35e7fa5766%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/ea5cfa38bbc54015876c3e35e7fa5766/images/large/9.jpg saved to cache
2026-03-26 22:54:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d0b083bf-6e40-5b10-aa61-972197b7bf06
2026-03-26 22:54:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fcc6e938998e846f78160b7ebcfbb0e0e%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/cc6e938998e846f78160b7ebcfbb0e0e/images/large/10.jpg not downloaded yet
2026-03-26 22:54:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b768a350>
2026-03-26 22:54:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0b083bf-6e40-5b10-aa61-972197b7bf06/d0b083bf-6e40-5b10-aa61-972197b7bf06_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:54:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fea5cfa38bbc54015876c3e35e7fa5766%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/ea5cfa38bbc54015876c3e35e7fa5766/images/large/8.jpg saved to cache
2026-03-26 22:54:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d0b083bf-6e40-5b10-aa61-972197b7bf06
2026-03-26 22:54:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77ad390>
2026-03-26 22:54:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f9c68b3-6983-5ac0-8bcd-39735c55a15c/4f9c68b3-6983-5ac0-8bcd-39735c55a15c_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:54:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fa718a1748e264e61815cba78469913db%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/a718a1748e264e61815cba78469913db/images/large/5.jpg saved to cache
2026-03-26 22:54:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4f9c68b3-6983-5ac0-8bcd-39735c55a15c
2026-03-26 22:54:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e15690>
2026-03-26 22:54:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20b96f03-39fa-5bd4-85b8-d927562d4040/20b96f03-39fa-5bd4-85b8-d927562d4040_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:54:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Fdb68418ba78f4105ae59b9cfcd873d9d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/db68418ba78f4105ae59b9cfcd873d9d/images/large/1.jpg saved to cache
2026-03-26 22:54:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 20b96f03-39fa-5bd4-85b8-d927562d4040
2026-03-26 22:54:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b740ba90>
2026-03-26 22:54:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20b96f03-39fa-5bd4-85b8-d927562d4040/20b96f03-39fa-5bd4-85b8-d927562d4040_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:54:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Fdb68418ba78f4105ae59b9cfcd873d9d%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/db68418ba78f4105ae59b9cfcd873d9d/images/large/4.jpg saved to cache
2026-03-26 22:54:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 20b96f03-39fa-5bd4-85b8-d927562d4040
2026-03-26 22:54:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74370d0>
2026-03-26 22:54:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20b96f03-39fa-5bd4-85b8-d927562d4040/20b96f03-39fa-5bd4-85b8-d927562d4040_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:54:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Fdb68418ba78f4105ae59b9cfcd873d9d%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/db68418ba78f4105ae59b9cfcd873d9d/images/large/6.jpg saved to cache
2026-03-26 22:54:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 20b96f03-39fa-5bd4-85b8-d927562d4040
2026-03-26 22:54:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/db68418ba78f4105ae59b9cfcd873d9d/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/ea5cfa38bbc54015876c3e35e7fa5766/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:30 [ayvens.be] INFO: Found listing with ID: 1985546
2026-03-26 22:54:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985546%27 HTTP/1.1" 200 None
2026-03-26 22:54:30 [ayvens.be] INFO: Scrape type for 1985546: 1
2026-03-26 22:54:30 [ayvens.be] INFO: Extracting data for car ID: 1985546
2026-03-26 22:54:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 053c27bf-20c6-52f1-897d-b564c8a68ac2 with identifier: 1985546
2026-03-26 22:54:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 053c27bf-20c6-52f1-897d-b564c8a68ac2 with scrape type 1
2026-03-26 22:54:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 053c27bf-20c6-52f1-897d-b564c8a68ac2
2026-03-26 22:54:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F1eed4ec7652546aa9bcf1f9df4246dc9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/1eed4ec7652546aa9bcf1f9df4246dc9/images/large/1.jpg not downloaded yet
2026-03-26 22:54:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/db68418ba78f4105ae59b9cfcd873d9d/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/db68418ba78f4105ae59b9cfcd873d9d/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/db68418ba78f4105ae59b9cfcd873d9d/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F1eed4ec7652546aa9bcf1f9df4246dc9%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/1eed4ec7652546aa9bcf1f9df4246dc9/images/large/2.jpg not downloaded yet
2026-03-26 22:54:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F1eed4ec7652546aa9bcf1f9df4246dc9%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/1eed4ec7652546aa9bcf1f9df4246dc9/images/large/3.jpg not downloaded yet
2026-03-26 22:54:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/db68418ba78f4105ae59b9cfcd873d9d/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F1eed4ec7652546aa9bcf1f9df4246dc9%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/1eed4ec7652546aa9bcf1f9df4246dc9/images/large/4.jpg not downloaded yet
2026-03-26 22:54:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F1eed4ec7652546aa9bcf1f9df4246dc9%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/1eed4ec7652546aa9bcf1f9df4246dc9/images/large/5.jpg not downloaded yet
2026-03-26 22:54:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7451d50>
2026-03-26 22:54:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20b96f03-39fa-5bd4-85b8-d927562d4040/20b96f03-39fa-5bd4-85b8-d927562d4040_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:54:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Fdb68418ba78f4105ae59b9cfcd873d9d%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/db68418ba78f4105ae59b9cfcd873d9d/images/large/7.jpg saved to cache
2026-03-26 22:54:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 20b96f03-39fa-5bd4-85b8-d927562d4040
2026-03-26 22:54:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7410110>
2026-03-26 22:54:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0b083bf-6e40-5b10-aa61-972197b7bf06/d0b083bf-6e40-5b10-aa61-972197b7bf06_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:54:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fea5cfa38bbc54015876c3e35e7fa5766%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/ea5cfa38bbc54015876c3e35e7fa5766/images/large/7.jpg saved to cache
2026-03-26 22:54:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d0b083bf-6e40-5b10-aa61-972197b7bf06
2026-03-26 22:54:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d0b083bf-6e40-5b10-aa61-972197b7bf06, skipping ID generation
2026-03-26 22:54:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0b083bf-6e40-5b10-aa61-972197b7bf06 with scrape type 1
2026-03-26 22:54:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d0b083bf-6e40-5b10-aa61-972197b7bf06 sending to next pipeline
2026-03-26 22:54:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d0b083bf-6e40-5b10-aa61-972197b7bf06, identifier: 1985543
2026-03-26 22:54:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F1eed4ec7652546aa9bcf1f9df4246dc9%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/1eed4ec7652546aa9bcf1f9df4246dc9/images/large/6.jpg not downloaded yet
2026-03-26 22:54:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d0b083bf-6e40-5b10-aa61-972197b7bf06 with identifier: 1985543
2026-03-26 22:54:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d0b083bf-6e40-5b10-aa61-972197b7bf06 with identifier: 1985543
2026-03-26 22:54:31 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d0b083bf-6e40-5b10-aa61-972197b7bf06 with identifier: 1985543 to the API
2026-03-26 22:54:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:54:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:54:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bv/ea5cfa38bbc54015876c3e35e7fa5766/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd0b083bf-6e40-5b10-aa61-972197b7bf06',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'B-CLASS',
 'odometer': 188787,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0b083bf-6e40-5b10-aa61-972197b7bf06/d0b083bf-6e40-5b10-aa61-972197b7bf06_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 210711,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/ea5cfa38bbc54015876c3e35e7fa5766/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0b083bf-6e40-5b10-aa61-972197b7bf06/d0b083bf-6e40-5b10-aa61-972197b7bf06_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 206083,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/ea5cfa38bbc54015876c3e35e7fa5766/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0b083bf-6e40-5b10-aa61-972197b7bf06/d0b083bf-6e40-5b10-aa61-972197b7bf06_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 232026,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/ea5cfa38bbc54015876c3e35e7fa5766/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0b083bf-6e40-5b10-aa61-972197b7bf06/d0b083bf-6e40-5b10-aa61-972197b7bf06_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 232058,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/ea5cfa38bbc54015876c3e35e7fa5766/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0b083bf-6e40-5b10-aa61-972197b7bf06/d0b083bf-6e40-5b10-aa61-972197b7bf06_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 330868,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/ea5cfa38bbc54015876c3e35e7fa5766/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0b083bf-6e40-5b10-aa61-972197b7bf06/d0b083bf-6e40-5b10-aa61-972197b7bf06_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 290502,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/ea5cfa38bbc54015876c3e35e7fa5766/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0b083bf-6e40-5b10-aa61-972197b7bf06/d0b083bf-6e40-5b10-aa61-972197b7bf06_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 271625,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/ea5cfa38bbc54015876c3e35e7fa5766/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0b083bf-6e40-5b10-aa61-972197b7bf06/d0b083bf-6e40-5b10-aa61-972197b7bf06_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 347112,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/ea5cfa38bbc54015876c3e35e7fa5766/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0b083bf-6e40-5b10-aa61-972197b7bf06/d0b083bf-6e40-5b10-aa61-972197b7bf06_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 412715,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/ea5cfa38bbc54015876c3e35e7fa5766/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0b083bf-6e40-5b10-aa61-972197b7bf06/d0b083bf-6e40-5b10-aa61-972197b7bf06_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 373594,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/ea5cfa38bbc54015876c3e35e7fa5766/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ B-CLASS 2.0 B 200 D BUSINESS SOLUTION DCT',
 'transmission': 'automatic',
 'trim': '2.0 B 200 D BUSINESS SOLUTION DCT',
 'vin': None,
 'year': 2022}
2026-03-26 22:54:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985543%27 HTTP/1.1" 200 None
2026-03-26 22:54:32 [ayvens.be] INFO: Saving data for 1985543: {'created_time': 1774565672.580783, 'last_price_update_time': 1774565672.580792, 'auction_closing_time': 1774958400.0}
2026-03-26 22:54:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985543') HTTP/1.1" 204 0
2026-03-26 22:54:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b78ab1d0>
2026-03-26 22:54:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20b96f03-39fa-5bd4-85b8-d927562d4040/20b96f03-39fa-5bd4-85b8-d927562d4040_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:54:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Fdb68418ba78f4105ae59b9cfcd873d9d%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/db68418ba78f4105ae59b9cfcd873d9d/images/large/5.jpg saved to cache
2026-03-26 22:54:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 20b96f03-39fa-5bd4-85b8-d927562d4040
2026-03-26 22:54:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/cc6e938998e846f78160b7ebcfbb0e0e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/cc6e938998e846f78160b7ebcfbb0e0e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F1eed4ec7652546aa9bcf1f9df4246dc9%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/1eed4ec7652546aa9bcf1f9df4246dc9/images/large/7.jpg not downloaded yet
2026-03-26 22:54:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F1eed4ec7652546aa9bcf1f9df4246dc9%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/1eed4ec7652546aa9bcf1f9df4246dc9/images/large/8.jpg not downloaded yet
2026-03-26 22:54:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7947410>
2026-03-26 22:54:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20b96f03-39fa-5bd4-85b8-d927562d4040/20b96f03-39fa-5bd4-85b8-d927562d4040_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:54:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Fdb68418ba78f4105ae59b9cfcd873d9d%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/db68418ba78f4105ae59b9cfcd873d9d/images/large/8.jpg saved to cache
2026-03-26 22:54:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 20b96f03-39fa-5bd4-85b8-d927562d4040
2026-03-26 22:54:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e165d0>
2026-03-26 22:54:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20b96f03-39fa-5bd4-85b8-d927562d4040/20b96f03-39fa-5bd4-85b8-d927562d4040_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:54:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Fdb68418ba78f4105ae59b9cfcd873d9d%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/db68418ba78f4105ae59b9cfcd873d9d/images/large/9.jpg saved to cache
2026-03-26 22:54:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 20b96f03-39fa-5bd4-85b8-d927562d4040
2026-03-26 22:54:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7662dd0>
2026-03-26 22:54:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20b96f03-39fa-5bd4-85b8-d927562d4040/20b96f03-39fa-5bd4-85b8-d927562d4040_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:54:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Fdb68418ba78f4105ae59b9cfcd873d9d%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/db68418ba78f4105ae59b9cfcd873d9d/images/large/10.jpg saved to cache
2026-03-26 22:54:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 20b96f03-39fa-5bd4-85b8-d927562d4040
2026-03-26 22:54:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 20b96f03-39fa-5bd4-85b8-d927562d4040, skipping ID generation
2026-03-26 22:54:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20b96f03-39fa-5bd4-85b8-d927562d4040 with scrape type 1
2026-03-26 22:54:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 20b96f03-39fa-5bd4-85b8-d927562d4040 sending to next pipeline
2026-03-26 22:54:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 20b96f03-39fa-5bd4-85b8-d927562d4040, identifier: 1985544
2026-03-26 22:54:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 20b96f03-39fa-5bd4-85b8-d927562d4040 with identifier: 1985544
2026-03-26 22:54:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 20b96f03-39fa-5bd4-85b8-d927562d4040 with identifier: 1985544
2026-03-26 22:54:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 20b96f03-39fa-5bd4-85b8-d927562d4040 with identifier: 1985544 to the API
2026-03-26 22:54:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:54:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:54:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ae/db68418ba78f4105ae59b9cfcd873d9d/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '20b96f03-39fa-5bd4-85b8-d927562d4040',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A3',
 'odometer': 91807,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20b96f03-39fa-5bd4-85b8-d927562d4040/20b96f03-39fa-5bd4-85b8-d927562d4040_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 784808,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/db68418ba78f4105ae59b9cfcd873d9d/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20b96f03-39fa-5bd4-85b8-d927562d4040/20b96f03-39fa-5bd4-85b8-d927562d4040_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 563860,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/db68418ba78f4105ae59b9cfcd873d9d/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20b96f03-39fa-5bd4-85b8-d927562d4040/20b96f03-39fa-5bd4-85b8-d927562d4040_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 644828,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/db68418ba78f4105ae59b9cfcd873d9d/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20b96f03-39fa-5bd4-85b8-d927562d4040/20b96f03-39fa-5bd4-85b8-d927562d4040_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 796231,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/db68418ba78f4105ae59b9cfcd873d9d/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20b96f03-39fa-5bd4-85b8-d927562d4040/20b96f03-39fa-5bd4-85b8-d927562d4040_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 589470,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/db68418ba78f4105ae59b9cfcd873d9d/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20b96f03-39fa-5bd4-85b8-d927562d4040/20b96f03-39fa-5bd4-85b8-d927562d4040_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 297710,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/db68418ba78f4105ae59b9cfcd873d9d/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20b96f03-39fa-5bd4-85b8-d927562d4040/20b96f03-39fa-5bd4-85b8-d927562d4040_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 502899,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/db68418ba78f4105ae59b9cfcd873d9d/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20b96f03-39fa-5bd4-85b8-d927562d4040/20b96f03-39fa-5bd4-85b8-d927562d4040_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 418317,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/db68418ba78f4105ae59b9cfcd873d9d/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20b96f03-39fa-5bd4-85b8-d927562d4040/20b96f03-39fa-5bd4-85b8-d927562d4040_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 407053,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/db68418ba78f4105ae59b9cfcd873d9d/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20b96f03-39fa-5bd4-85b8-d927562d4040/20b96f03-39fa-5bd4-85b8-d927562d4040_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 321433,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/db68418ba78f4105ae59b9cfcd873d9d/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A3 1.0 30 TFSI 81KW',
 'transmission': 'manual',
 'trim': '1.0 30 TFSI 81KW',
 'vin': None,
 'year': 2021}
2026-03-26 22:54:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985544%27 HTTP/1.1" 200 None
2026-03-26 22:54:33 [ayvens.be] INFO: Saving data for 1985544: {'created_time': 1774565673.284855, 'last_price_update_time': 1774565673.284865, 'auction_closing_time': 1774958400.0}
2026-03-26 22:54:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985544') HTTP/1.1" 204 0
2026-03-26 22:54:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F1eed4ec7652546aa9bcf1f9df4246dc9%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/1eed4ec7652546aa9bcf1f9df4246dc9/images/large/9.jpg not downloaded yet
2026-03-26 22:54:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/cc6e938998e846f78160b7ebcfbb0e0e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F1eed4ec7652546aa9bcf1f9df4246dc9%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/1eed4ec7652546aa9bcf1f9df4246dc9/images/large/10.jpg not downloaded yet
2026-03-26 22:54:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6d73390>
2026-03-26 22:54:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_585391de-3103-5b60-94d9-9311ab472214/585391de-3103-5b60-94d9-9311ab472214_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:54:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fcc6e938998e846f78160b7ebcfbb0e0e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/cc6e938998e846f78160b7ebcfbb0e0e/images/large/3.jpg saved to cache
2026-03-26 22:54:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 585391de-3103-5b60-94d9-9311ab472214
2026-03-26 22:54:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c6a250>
2026-03-26 22:54:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_585391de-3103-5b60-94d9-9311ab472214/585391de-3103-5b60-94d9-9311ab472214_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:54:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fcc6e938998e846f78160b7ebcfbb0e0e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/cc6e938998e846f78160b7ebcfbb0e0e/images/large/1.jpg saved to cache
2026-03-26 22:54:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 585391de-3103-5b60-94d9-9311ab472214
2026-03-26 22:54:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/cc6e938998e846f78160b7ebcfbb0e0e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/a718a1748e264e61815cba78469913db/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:33 [ayvens.be] INFO: Found listing with ID: 1985547
2026-03-26 22:54:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985547%27 HTTP/1.1" 200 None
2026-03-26 22:54:33 [ayvens.be] INFO: Scrape type for 1985547: 1
2026-03-26 22:54:33 [ayvens.be] INFO: Extracting data for car ID: 1985547
2026-03-26 22:54:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b02a049f-23ad-52f2-a198-bcbf99a914dd with identifier: 1985547
2026-03-26 22:54:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b02a049f-23ad-52f2-a198-bcbf99a914dd with scrape type 1
2026-03-26 22:54:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b02a049f-23ad-52f2-a198-bcbf99a914dd
2026-03-26 22:54:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F6f56d36068aa4302a3f6f80e14903b6d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/6f56d36068aa4302a3f6f80e14903b6d/images/large/1.jpg not downloaded yet
2026-03-26 22:54:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/cc6e938998e846f78160b7ebcfbb0e0e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/cc6e938998e846f78160b7ebcfbb0e0e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/cc6e938998e846f78160b7ebcfbb0e0e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F6f56d36068aa4302a3f6f80e14903b6d%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/6f56d36068aa4302a3f6f80e14903b6d/images/large/2.jpg not downloaded yet
2026-03-26 22:54:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b728cc90>
2026-03-26 22:54:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_585391de-3103-5b60-94d9-9311ab472214/585391de-3103-5b60-94d9-9311ab472214_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:54:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fcc6e938998e846f78160b7ebcfbb0e0e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/cc6e938998e846f78160b7ebcfbb0e0e/images/large/2.jpg saved to cache
2026-03-26 22:54:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 585391de-3103-5b60-94d9-9311ab472214
2026-03-26 22:54:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F6f56d36068aa4302a3f6f80e14903b6d%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/6f56d36068aa4302a3f6f80e14903b6d/images/large/3.jpg not downloaded yet
2026-03-26 22:54:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/a718a1748e264e61815cba78469913db/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F6f56d36068aa4302a3f6f80e14903b6d%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/6f56d36068aa4302a3f6f80e14903b6d/images/large/4.jpg not downloaded yet
2026-03-26 22:54:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b744a850>
2026-03-26 22:54:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_585391de-3103-5b60-94d9-9311ab472214/585391de-3103-5b60-94d9-9311ab472214_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:54:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fcc6e938998e846f78160b7ebcfbb0e0e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/cc6e938998e846f78160b7ebcfbb0e0e/images/large/5.jpg saved to cache
2026-03-26 22:54:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 585391de-3103-5b60-94d9-9311ab472214
2026-03-26 22:54:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7587510>
2026-03-26 22:54:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f9c68b3-6983-5ac0-8bcd-39735c55a15c/4f9c68b3-6983-5ac0-8bcd-39735c55a15c_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:54:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fa718a1748e264e61815cba78469913db%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/a718a1748e264e61815cba78469913db/images/large/10.jpg saved to cache
2026-03-26 22:54:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4f9c68b3-6983-5ac0-8bcd-39735c55a15c
2026-03-26 22:54:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7493210>
2026-03-26 22:54:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_585391de-3103-5b60-94d9-9311ab472214/585391de-3103-5b60-94d9-9311ab472214_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:54:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fcc6e938998e846f78160b7ebcfbb0e0e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/cc6e938998e846f78160b7ebcfbb0e0e/images/large/7.jpg saved to cache
2026-03-26 22:54:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 585391de-3103-5b60-94d9-9311ab472214
2026-03-26 22:54:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76489d0>
2026-03-26 22:54:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_585391de-3103-5b60-94d9-9311ab472214/585391de-3103-5b60-94d9-9311ab472214_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:54:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fcc6e938998e846f78160b7ebcfbb0e0e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/cc6e938998e846f78160b7ebcfbb0e0e/images/large/6.jpg saved to cache
2026-03-26 22:54:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 585391de-3103-5b60-94d9-9311ab472214
2026-03-26 22:54:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76a5450>
2026-03-26 22:54:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_585391de-3103-5b60-94d9-9311ab472214/585391de-3103-5b60-94d9-9311ab472214_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:54:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fcc6e938998e846f78160b7ebcfbb0e0e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/cc6e938998e846f78160b7ebcfbb0e0e/images/large/4.jpg saved to cache
2026-03-26 22:54:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 585391de-3103-5b60-94d9-9311ab472214
2026-03-26 22:54:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/cc6e938998e846f78160b7ebcfbb0e0e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F6f56d36068aa4302a3f6f80e14903b6d%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/6f56d36068aa4302a3f6f80e14903b6d/images/large/5.jpg not downloaded yet
2026-03-26 22:54:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F6f56d36068aa4302a3f6f80e14903b6d%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/6f56d36068aa4302a3f6f80e14903b6d/images/large/6.jpg not downloaded yet
2026-03-26 22:54:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F6f56d36068aa4302a3f6f80e14903b6d%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/6f56d36068aa4302a3f6f80e14903b6d/images/large/7.jpg not downloaded yet
2026-03-26 22:54:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7586450>
2026-03-26 22:54:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f9c68b3-6983-5ac0-8bcd-39735c55a15c/4f9c68b3-6983-5ac0-8bcd-39735c55a15c_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:54:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fa718a1748e264e61815cba78469913db%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/a718a1748e264e61815cba78469913db/images/large/9.jpg saved to cache
2026-03-26 22:54:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4f9c68b3-6983-5ac0-8bcd-39735c55a15c
2026-03-26 22:54:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F6f56d36068aa4302a3f6f80e14903b6d%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/6f56d36068aa4302a3f6f80e14903b6d/images/large/8.jpg not downloaded yet
2026-03-26 22:54:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/cc6e938998e846f78160b7ebcfbb0e0e/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/cc6e938998e846f78160b7ebcfbb0e0e/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F6f56d36068aa4302a3f6f80e14903b6d%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/6f56d36068aa4302a3f6f80e14903b6d/images/large/9.jpg not downloaded yet
2026-03-26 22:54:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7cce350>
2026-03-26 22:54:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_585391de-3103-5b60-94d9-9311ab472214/585391de-3103-5b60-94d9-9311ab472214_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:54:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fcc6e938998e846f78160b7ebcfbb0e0e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/cc6e938998e846f78160b7ebcfbb0e0e/images/large/8.jpg saved to cache
2026-03-26 22:54:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 585391de-3103-5b60-94d9-9311ab472214
2026-03-26 22:54:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F6f56d36068aa4302a3f6f80e14903b6d%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/6f56d36068aa4302a3f6f80e14903b6d/images/large/10.jpg not downloaded yet
2026-03-26 22:54:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/1eed4ec7652546aa9bcf1f9df4246dc9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/1eed4ec7652546aa9bcf1f9df4246dc9/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/1eed4ec7652546aa9bcf1f9df4246dc9/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:34 [ayvens.be] INFO: Found listing with ID: 1985548
2026-03-26 22:54:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985548%27 HTTP/1.1" 200 None
2026-03-26 22:54:34 [ayvens.be] INFO: Scrape type for 1985548: 1
2026-03-26 22:54:34 [ayvens.be] INFO: Extracting data for car ID: 1985548
2026-03-26 22:54:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0475d773-c9bd-57d9-92ba-2afdf730d633 with identifier: 1985548
2026-03-26 22:54:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0475d773-c9bd-57d9-92ba-2afdf730d633 with scrape type 1
2026-03-26 22:54:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0475d773-c9bd-57d9-92ba-2afdf730d633
2026-03-26 22:54:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F7c200c5dcb27436990b5d7f488403672%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/7c200c5dcb27436990b5d7f488403672/images/large/1.jpg not downloaded yet
2026-03-26 22:54:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/a718a1748e264e61815cba78469913db/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/1eed4ec7652546aa9bcf1f9df4246dc9/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F7c200c5dcb27436990b5d7f488403672%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/7c200c5dcb27436990b5d7f488403672/images/large/2.jpg not downloaded yet
2026-03-26 22:54:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b72ffb90>
2026-03-26 22:54:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_585391de-3103-5b60-94d9-9311ab472214/585391de-3103-5b60-94d9-9311ab472214_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:54:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fcc6e938998e846f78160b7ebcfbb0e0e%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/cc6e938998e846f78160b7ebcfbb0e0e/images/large/10.jpg saved to cache
2026-03-26 22:54:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 585391de-3103-5b60-94d9-9311ab472214
2026-03-26 22:54:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7415990>
2026-03-26 22:54:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_585391de-3103-5b60-94d9-9311ab472214/585391de-3103-5b60-94d9-9311ab472214_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:54:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fcc6e938998e846f78160b7ebcfbb0e0e%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/cc6e938998e846f78160b7ebcfbb0e0e/images/large/9.jpg saved to cache
2026-03-26 22:54:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 585391de-3103-5b60-94d9-9311ab472214
2026-03-26 22:54:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 585391de-3103-5b60-94d9-9311ab472214, skipping ID generation
2026-03-26 22:54:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 585391de-3103-5b60-94d9-9311ab472214 with scrape type 1
2026-03-26 22:54:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 585391de-3103-5b60-94d9-9311ab472214 sending to next pipeline
2026-03-26 22:54:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 585391de-3103-5b60-94d9-9311ab472214, identifier: 1985545
2026-03-26 22:54:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 585391de-3103-5b60-94d9-9311ab472214 with identifier: 1985545
2026-03-26 22:54:34 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 22:54:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 22:54:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 585391de-3103-5b60-94d9-9311ab472214 with identifier: 1985545
2026-03-26 22:54:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 585391de-3103-5b60-94d9-9311ab472214 with identifier: 1985545 to the API
2026-03-26 22:54:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:54:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:54:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2br/cc6e938998e846f78160b7ebcfbb0e0e/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'color': 'PHYTONICBLAU METALLIC',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '585391de-3103-5b60-94d9-9311ab472214',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 114666,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_585391de-3103-5b60-94d9-9311ab472214/585391de-3103-5b60-94d9-9311ab472214_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 741447,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/cc6e938998e846f78160b7ebcfbb0e0e/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_585391de-3103-5b60-94d9-9311ab472214/585391de-3103-5b60-94d9-9311ab472214_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 744275,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/cc6e938998e846f78160b7ebcfbb0e0e/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_585391de-3103-5b60-94d9-9311ab472214/585391de-3103-5b60-94d9-9311ab472214_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 736863,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/cc6e938998e846f78160b7ebcfbb0e0e/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_585391de-3103-5b60-94d9-9311ab472214/585391de-3103-5b60-94d9-9311ab472214_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 755331,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/cc6e938998e846f78160b7ebcfbb0e0e/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_585391de-3103-5b60-94d9-9311ab472214/585391de-3103-5b60-94d9-9311ab472214_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 734787,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/cc6e938998e846f78160b7ebcfbb0e0e/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_585391de-3103-5b60-94d9-9311ab472214/585391de-3103-5b60-94d9-9311ab472214_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 797562,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/cc6e938998e846f78160b7ebcfbb0e0e/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_585391de-3103-5b60-94d9-9311ab472214/585391de-3103-5b60-94d9-9311ab472214_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 655600,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/cc6e938998e846f78160b7ebcfbb0e0e/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_585391de-3103-5b60-94d9-9311ab472214/585391de-3103-5b60-94d9-9311ab472214_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 849702,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/cc6e938998e846f78160b7ebcfbb0e0e/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_585391de-3103-5b60-94d9-9311ab472214/585391de-3103-5b60-94d9-9311ab472214_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 795132,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/cc6e938998e846f78160b7ebcfbb0e0e/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_585391de-3103-5b60-94d9-9311ab472214/585391de-3103-5b60-94d9-9311ab472214_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 739101,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/cc6e938998e846f78160b7ebcfbb0e0e/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 1.5 SDRIVE16DA',
 'transmission': 'automatic',
 'trim': '1.5 SDRIVE16DA',
 'vin': None,
 'year': 2022}
2026-03-26 22:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985545%27 HTTP/1.1" 200 None
2026-03-26 22:54:35 [ayvens.be] INFO: Saving data for 1985545: {'created_time': 1774565675.203003, 'last_price_update_time': 1774565675.203012, 'auction_closing_time': 1774958400.0}
2026-03-26 22:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985545') HTTP/1.1" 204 0
2026-03-26 22:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F7c200c5dcb27436990b5d7f488403672%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/7c200c5dcb27436990b5d7f488403672/images/large/3.jpg not downloaded yet
2026-03-26 22:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F7c200c5dcb27436990b5d7f488403672%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/7c200c5dcb27436990b5d7f488403672/images/large/4.jpg not downloaded yet
2026-03-26 22:54:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77aead0>
2026-03-26 22:54:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_053c27bf-20c6-52f1-897d-b564c8a68ac2/053c27bf-20c6-52f1-897d-b564c8a68ac2_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F1eed4ec7652546aa9bcf1f9df4246dc9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/1eed4ec7652546aa9bcf1f9df4246dc9/images/large/1.jpg saved to cache
2026-03-26 22:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 053c27bf-20c6-52f1-897d-b564c8a68ac2
2026-03-26 22:54:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74a5950>
2026-03-26 22:54:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_053c27bf-20c6-52f1-897d-b564c8a68ac2/053c27bf-20c6-52f1-897d-b564c8a68ac2_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F1eed4ec7652546aa9bcf1f9df4246dc9%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/1eed4ec7652546aa9bcf1f9df4246dc9/images/large/2.jpg saved to cache
2026-03-26 22:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 053c27bf-20c6-52f1-897d-b564c8a68ac2
2026-03-26 22:54:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77eb7d0>
2026-03-26 22:54:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_053c27bf-20c6-52f1-897d-b564c8a68ac2/053c27bf-20c6-52f1-897d-b564c8a68ac2_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F1eed4ec7652546aa9bcf1f9df4246dc9%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/1eed4ec7652546aa9bcf1f9df4246dc9/images/large/3.jpg saved to cache
2026-03-26 22:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 053c27bf-20c6-52f1-897d-b564c8a68ac2
2026-03-26 22:54:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7a82c50>
2026-03-26 22:54:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f9c68b3-6983-5ac0-8bcd-39735c55a15c/4f9c68b3-6983-5ac0-8bcd-39735c55a15c_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fa718a1748e264e61815cba78469913db%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/a718a1748e264e61815cba78469913db/images/large/8.jpg saved to cache
2026-03-26 22:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4f9c68b3-6983-5ac0-8bcd-39735c55a15c
2026-03-26 22:54:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4f9c68b3-6983-5ac0-8bcd-39735c55a15c, skipping ID generation
2026-03-26 22:54:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f9c68b3-6983-5ac0-8bcd-39735c55a15c with scrape type 1
2026-03-26 22:54:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4f9c68b3-6983-5ac0-8bcd-39735c55a15c sending to next pipeline
2026-03-26 22:54:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 4f9c68b3-6983-5ac0-8bcd-39735c55a15c, identifier: 1985542
2026-03-26 22:54:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7475b10>
2026-03-26 22:54:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_053c27bf-20c6-52f1-897d-b564c8a68ac2/053c27bf-20c6-52f1-897d-b564c8a68ac2_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F1eed4ec7652546aa9bcf1f9df4246dc9%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/1eed4ec7652546aa9bcf1f9df4246dc9/images/large/6.jpg saved to cache
2026-03-26 22:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 053c27bf-20c6-52f1-897d-b564c8a68ac2
2026-03-26 22:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F7c200c5dcb27436990b5d7f488403672%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/7c200c5dcb27436990b5d7f488403672/images/large/5.jpg not downloaded yet
2026-03-26 22:54:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 4f9c68b3-6983-5ac0-8bcd-39735c55a15c with identifier: 1985542
2026-03-26 22:54:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 4f9c68b3-6983-5ac0-8bcd-39735c55a15c with identifier: 1985542
2026-03-26 22:54:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 4f9c68b3-6983-5ac0-8bcd-39735c55a15c with identifier: 1985542 to the API
2026-03-26 22:54:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:54:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:54:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2br/a718a1748e264e61815cba78469913db/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '4f9c68b3-6983-5ac0-8bcd-39735c55a15c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'SUPERB COMBI',
 'odometer': 105953,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f9c68b3-6983-5ac0-8bcd-39735c55a15c/4f9c68b3-6983-5ac0-8bcd-39735c55a15c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 774958,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/a718a1748e264e61815cba78469913db/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f9c68b3-6983-5ac0-8bcd-39735c55a15c/4f9c68b3-6983-5ac0-8bcd-39735c55a15c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 737456,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/a718a1748e264e61815cba78469913db/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f9c68b3-6983-5ac0-8bcd-39735c55a15c/4f9c68b3-6983-5ac0-8bcd-39735c55a15c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 717522,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/a718a1748e264e61815cba78469913db/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f9c68b3-6983-5ac0-8bcd-39735c55a15c/4f9c68b3-6983-5ac0-8bcd-39735c55a15c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 745175,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/a718a1748e264e61815cba78469913db/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f9c68b3-6983-5ac0-8bcd-39735c55a15c/4f9c68b3-6983-5ac0-8bcd-39735c55a15c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 715340,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/a718a1748e264e61815cba78469913db/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f9c68b3-6983-5ac0-8bcd-39735c55a15c/4f9c68b3-6983-5ac0-8bcd-39735c55a15c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 848095,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/a718a1748e264e61815cba78469913db/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f9c68b3-6983-5ac0-8bcd-39735c55a15c/4f9c68b3-6983-5ac0-8bcd-39735c55a15c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 696561,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/a718a1748e264e61815cba78469913db/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f9c68b3-6983-5ac0-8bcd-39735c55a15c/4f9c68b3-6983-5ac0-8bcd-39735c55a15c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 787247,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/a718a1748e264e61815cba78469913db/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f9c68b3-6983-5ac0-8bcd-39735c55a15c/4f9c68b3-6983-5ac0-8bcd-39735c55a15c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 647785,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/a718a1748e264e61815cba78469913db/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f9c68b3-6983-5ac0-8bcd-39735c55a15c/4f9c68b3-6983-5ac0-8bcd-39735c55a15c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 733522,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/a718a1748e264e61815cba78469913db/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA SUPERB COMBI 1.4 TSI PHEV 160KW DSG6 CLEVER',
 'transmission': 'automatic',
 'trim': '1.4 TSI PHEV 160KW DSG6 CLEVER',
 'vin': None,
 'year': 2022}
2026-03-26 22:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985542%27 HTTP/1.1" 200 None
2026-03-26 22:54:36 [ayvens.be] INFO: Saving data for 1985542: {'created_time': 1774565676.098366, 'last_price_update_time': 1774565676.098375, 'auction_closing_time': 1774958400.0}
2026-03-26 22:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985542') HTTP/1.1" 204 0
2026-03-26 22:54:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/1eed4ec7652546aa9bcf1f9df4246dc9/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F7c200c5dcb27436990b5d7f488403672%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/7c200c5dcb27436990b5d7f488403672/images/large/6.jpg not downloaded yet
2026-03-26 22:54:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/6f56d36068aa4302a3f6f80e14903b6d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/1eed4ec7652546aa9bcf1f9df4246dc9/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/6f56d36068aa4302a3f6f80e14903b6d/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F7c200c5dcb27436990b5d7f488403672%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/7c200c5dcb27436990b5d7f488403672/images/large/7.jpg not downloaded yet
2026-03-26 22:54:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/1eed4ec7652546aa9bcf1f9df4246dc9/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F7c200c5dcb27436990b5d7f488403672%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/7c200c5dcb27436990b5d7f488403672/images/large/8.jpg not downloaded yet
2026-03-26 22:54:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/1eed4ec7652546aa9bcf1f9df4246dc9/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/1eed4ec7652546aa9bcf1f9df4246dc9/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/1eed4ec7652546aa9bcf1f9df4246dc9/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F7c200c5dcb27436990b5d7f488403672%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/7c200c5dcb27436990b5d7f488403672/images/large/9.jpg not downloaded yet
2026-03-26 22:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F7c200c5dcb27436990b5d7f488403672%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/7c200c5dcb27436990b5d7f488403672/images/large/10.jpg not downloaded yet
2026-03-26 22:54:36 [ayvens.be] INFO: Found listing with ID: 1985549
2026-03-26 22:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985549%27 HTTP/1.1" 200 None
2026-03-26 22:54:36 [ayvens.be] INFO: Scrape type for 1985549: 1
2026-03-26 22:54:36 [ayvens.be] INFO: Extracting data for car ID: 1985549
2026-03-26 22:54:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7e69776c-945b-5aab-a92a-06594b48f9b9 with identifier: 1985549
2026-03-26 22:54:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e69776c-945b-5aab-a92a-06594b48f9b9 with scrape type 1
2026-03-26 22:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7e69776c-945b-5aab-a92a-06594b48f9b9
2026-03-26 22:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F561de957f1244852a0c403cc854eec14%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/561de957f1244852a0c403cc854eec14/images/large/1.jpg not downloaded yet
2026-03-26 22:54:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74fb7d0>
2026-03-26 22:54:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_053c27bf-20c6-52f1-897d-b564c8a68ac2/053c27bf-20c6-52f1-897d-b564c8a68ac2_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F1eed4ec7652546aa9bcf1f9df4246dc9%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/1eed4ec7652546aa9bcf1f9df4246dc9/images/large/5.jpg saved to cache
2026-03-26 22:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 053c27bf-20c6-52f1-897d-b564c8a68ac2
2026-03-26 22:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F561de957f1244852a0c403cc854eec14%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/561de957f1244852a0c403cc854eec14/images/large/2.jpg not downloaded yet
2026-03-26 22:54:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76ef750>
2026-03-26 22:54:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b02a049f-23ad-52f2-a198-bcbf99a914dd/b02a049f-23ad-52f2-a198-bcbf99a914dd_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F6f56d36068aa4302a3f6f80e14903b6d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/6f56d36068aa4302a3f6f80e14903b6d/images/large/1.jpg saved to cache
2026-03-26 22:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b02a049f-23ad-52f2-a198-bcbf99a914dd
2026-03-26 22:54:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b16250>
2026-03-26 22:54:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_053c27bf-20c6-52f1-897d-b564c8a68ac2/053c27bf-20c6-52f1-897d-b564c8a68ac2_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F1eed4ec7652546aa9bcf1f9df4246dc9%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/1eed4ec7652546aa9bcf1f9df4246dc9/images/large/7.jpg saved to cache
2026-03-26 22:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 053c27bf-20c6-52f1-897d-b564c8a68ac2
2026-03-26 22:54:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74b4990>
2026-03-26 22:54:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b02a049f-23ad-52f2-a198-bcbf99a914dd/b02a049f-23ad-52f2-a198-bcbf99a914dd_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F6f56d36068aa4302a3f6f80e14903b6d%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/6f56d36068aa4302a3f6f80e14903b6d/images/large/2.jpg saved to cache
2026-03-26 22:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b02a049f-23ad-52f2-a198-bcbf99a914dd
2026-03-26 22:54:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74404d0>
2026-03-26 22:54:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_053c27bf-20c6-52f1-897d-b564c8a68ac2/053c27bf-20c6-52f1-897d-b564c8a68ac2_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F1eed4ec7652546aa9bcf1f9df4246dc9%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/1eed4ec7652546aa9bcf1f9df4246dc9/images/large/10.jpg saved to cache
2026-03-26 22:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 053c27bf-20c6-52f1-897d-b564c8a68ac2
2026-03-26 22:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F561de957f1244852a0c403cc854eec14%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/561de957f1244852a0c403cc854eec14/images/large/3.jpg not downloaded yet
2026-03-26 22:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F561de957f1244852a0c403cc854eec14%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/561de957f1244852a0c403cc854eec14/images/large/4.jpg not downloaded yet
2026-03-26 22:54:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7945250>
2026-03-26 22:54:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_053c27bf-20c6-52f1-897d-b564c8a68ac2/053c27bf-20c6-52f1-897d-b564c8a68ac2_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F1eed4ec7652546aa9bcf1f9df4246dc9%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/1eed4ec7652546aa9bcf1f9df4246dc9/images/large/9.jpg saved to cache
2026-03-26 22:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 053c27bf-20c6-52f1-897d-b564c8a68ac2
2026-03-26 22:54:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7cab3d0>
2026-03-26 22:54:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_053c27bf-20c6-52f1-897d-b564c8a68ac2/053c27bf-20c6-52f1-897d-b564c8a68ac2_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F1eed4ec7652546aa9bcf1f9df4246dc9%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/1eed4ec7652546aa9bcf1f9df4246dc9/images/large/8.jpg saved to cache
2026-03-26 22:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 053c27bf-20c6-52f1-897d-b564c8a68ac2
2026-03-26 22:54:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7924b50>
2026-03-26 22:54:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_053c27bf-20c6-52f1-897d-b564c8a68ac2/053c27bf-20c6-52f1-897d-b564c8a68ac2_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F1eed4ec7652546aa9bcf1f9df4246dc9%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/1eed4ec7652546aa9bcf1f9df4246dc9/images/large/4.jpg saved to cache
2026-03-26 22:54:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 053c27bf-20c6-52f1-897d-b564c8a68ac2
2026-03-26 22:54:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 053c27bf-20c6-52f1-897d-b564c8a68ac2, skipping ID generation
2026-03-26 22:54:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 053c27bf-20c6-52f1-897d-b564c8a68ac2 with scrape type 1
2026-03-26 22:54:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 053c27bf-20c6-52f1-897d-b564c8a68ac2 sending to next pipeline
2026-03-26 22:54:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 053c27bf-20c6-52f1-897d-b564c8a68ac2, identifier: 1985546
2026-03-26 22:54:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 053c27bf-20c6-52f1-897d-b564c8a68ac2 with identifier: 1985546
2026-03-26 22:54:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 053c27bf-20c6-52f1-897d-b564c8a68ac2 with identifier: 1985546
2026-03-26 22:54:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 053c27bf-20c6-52f1-897d-b564c8a68ac2 with identifier: 1985546 to the API
2026-03-26 22:54:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:54:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:54:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bm/1eed4ec7652546aa9bcf1f9df4246dc9/images/large/4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '053c27bf-20c6-52f1-897d-b564c8a68ac2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLASS A (W177)',
 'odometer': 33578,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 24,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_053c27bf-20c6-52f1-897d-b564c8a68ac2/053c27bf-20c6-52f1-897d-b564c8a68ac2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 769224,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/1eed4ec7652546aa9bcf1f9df4246dc9/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_053c27bf-20c6-52f1-897d-b564c8a68ac2/053c27bf-20c6-52f1-897d-b564c8a68ac2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 776008,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/1eed4ec7652546aa9bcf1f9df4246dc9/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_053c27bf-20c6-52f1-897d-b564c8a68ac2/053c27bf-20c6-52f1-897d-b564c8a68ac2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 754623,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/1eed4ec7652546aa9bcf1f9df4246dc9/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_053c27bf-20c6-52f1-897d-b564c8a68ac2/053c27bf-20c6-52f1-897d-b564c8a68ac2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 765303,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/1eed4ec7652546aa9bcf1f9df4246dc9/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_053c27bf-20c6-52f1-897d-b564c8a68ac2/053c27bf-20c6-52f1-897d-b564c8a68ac2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 725635,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/1eed4ec7652546aa9bcf1f9df4246dc9/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_053c27bf-20c6-52f1-897d-b564c8a68ac2/053c27bf-20c6-52f1-897d-b564c8a68ac2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 813383,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/1eed4ec7652546aa9bcf1f9df4246dc9/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_053c27bf-20c6-52f1-897d-b564c8a68ac2/053c27bf-20c6-52f1-897d-b564c8a68ac2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 579477,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/1eed4ec7652546aa9bcf1f9df4246dc9/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_053c27bf-20c6-52f1-897d-b564c8a68ac2/053c27bf-20c6-52f1-897d-b564c8a68ac2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 761966,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/1eed4ec7652546aa9bcf1f9df4246dc9/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_053c27bf-20c6-52f1-897d-b564c8a68ac2/053c27bf-20c6-52f1-897d-b564c8a68ac2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 773933,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/1eed4ec7652546aa9bcf1f9df4246dc9/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_053c27bf-20c6-52f1-897d-b564c8a68ac2/053c27bf-20c6-52f1-897d-b564c8a68ac2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 733604,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/1eed4ec7652546aa9bcf1f9df4246dc9/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLASS A (W177) A 250 e PHEV Business Solution',
 'transmission': 'automatic',
 'trim': 'A 250 e PHEV Business Solution',
 'vin': None,
 'year': 2022}
2026-03-26 22:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985546%27 HTTP/1.1" 200 None
2026-03-26 22:54:37 [ayvens.be] INFO: Saving data for 1985546: {'created_time': 1774565677.565031, 'last_price_update_time': 1774565677.565042, 'auction_closing_time': 1774958400.0}
2026-03-26 22:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985546') HTTP/1.1" 204 0
2026-03-26 22:54:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/7c200c5dcb27436990b5d7f488403672/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F561de957f1244852a0c403cc854eec14%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/561de957f1244852a0c403cc854eec14/images/large/5.jpg not downloaded yet
2026-03-26 22:54:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/6f56d36068aa4302a3f6f80e14903b6d/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/7c200c5dcb27436990b5d7f488403672/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/6f56d36068aa4302a3f6f80e14903b6d/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F561de957f1244852a0c403cc854eec14%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/561de957f1244852a0c403cc854eec14/images/large/6.jpg not downloaded yet
2026-03-26 22:54:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/6f56d36068aa4302a3f6f80e14903b6d/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/6f56d36068aa4302a3f6f80e14903b6d/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/6f56d36068aa4302a3f6f80e14903b6d/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F561de957f1244852a0c403cc854eec14%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/561de957f1244852a0c403cc854eec14/images/large/7.jpg not downloaded yet
2026-03-26 22:54:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/6f56d36068aa4302a3f6f80e14903b6d/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F561de957f1244852a0c403cc854eec14%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/561de957f1244852a0c403cc854eec14/images/large/8.jpg not downloaded yet
2026-03-26 22:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F561de957f1244852a0c403cc854eec14%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/561de957f1244852a0c403cc854eec14/images/large/9.jpg not downloaded yet
2026-03-26 22:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F561de957f1244852a0c403cc854eec14%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/561de957f1244852a0c403cc854eec14/images/large/10.jpg not downloaded yet
2026-03-26 22:54:37 [ayvens.be] INFO: Found listing with ID: 1985550
2026-03-26 22:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985550%27 HTTP/1.1" 200 None
2026-03-26 22:54:37 [ayvens.be] INFO: Scrape type for 1985550: 1
2026-03-26 22:54:37 [ayvens.be] INFO: Extracting data for car ID: 1985550
2026-03-26 22:54:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c31d14e-586c-5631-8915-23d5ef030f15 with identifier: 1985550
2026-03-26 22:54:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c31d14e-586c-5631-8915-23d5ef030f15 with scrape type 1
2026-03-26 22:54:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3c31d14e-586c-5631-8915-23d5ef030f15
2026-03-26 22:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252Fdab24e46ede34f4081f5284fa2b7df3e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/dab24e46ede34f4081f5284fa2b7df3e/images/large/1.jpg not downloaded yet
2026-03-26 22:54:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79cc910>
2026-03-26 22:54:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0475d773-c9bd-57d9-92ba-2afdf730d633/0475d773-c9bd-57d9-92ba-2afdf730d633_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F7c200c5dcb27436990b5d7f488403672%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/7c200c5dcb27436990b5d7f488403672/images/large/2.jpg saved to cache
2026-03-26 22:54:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0475d773-c9bd-57d9-92ba-2afdf730d633
2026-03-26 22:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252Fdab24e46ede34f4081f5284fa2b7df3e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/dab24e46ede34f4081f5284fa2b7df3e/images/large/2.jpg not downloaded yet
2026-03-26 22:54:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74978d0>
2026-03-26 22:54:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b02a049f-23ad-52f2-a198-bcbf99a914dd/b02a049f-23ad-52f2-a198-bcbf99a914dd_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F6f56d36068aa4302a3f6f80e14903b6d%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/6f56d36068aa4302a3f6f80e14903b6d/images/large/9.jpg saved to cache
2026-03-26 22:54:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b02a049f-23ad-52f2-a198-bcbf99a914dd
2026-03-26 22:54:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76a4990>
2026-03-26 22:54:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0475d773-c9bd-57d9-92ba-2afdf730d633/0475d773-c9bd-57d9-92ba-2afdf730d633_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F7c200c5dcb27436990b5d7f488403672%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/7c200c5dcb27436990b5d7f488403672/images/large/1.jpg saved to cache
2026-03-26 22:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0475d773-c9bd-57d9-92ba-2afdf730d633
2026-03-26 22:54:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c6b010>
2026-03-26 22:54:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b02a049f-23ad-52f2-a198-bcbf99a914dd/b02a049f-23ad-52f2-a198-bcbf99a914dd_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F6f56d36068aa4302a3f6f80e14903b6d%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/6f56d36068aa4302a3f6f80e14903b6d/images/large/5.jpg saved to cache
2026-03-26 22:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b02a049f-23ad-52f2-a198-bcbf99a914dd
2026-03-26 22:54:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74ae350>
2026-03-26 22:54:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b02a049f-23ad-52f2-a198-bcbf99a914dd/b02a049f-23ad-52f2-a198-bcbf99a914dd_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F6f56d36068aa4302a3f6f80e14903b6d%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/6f56d36068aa4302a3f6f80e14903b6d/images/large/8.jpg saved to cache
2026-03-26 22:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b02a049f-23ad-52f2-a198-bcbf99a914dd
2026-03-26 22:54:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7661b50>
2026-03-26 22:54:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b02a049f-23ad-52f2-a198-bcbf99a914dd/b02a049f-23ad-52f2-a198-bcbf99a914dd_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F6f56d36068aa4302a3f6f80e14903b6d%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/6f56d36068aa4302a3f6f80e14903b6d/images/large/6.jpg saved to cache
2026-03-26 22:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b02a049f-23ad-52f2-a198-bcbf99a914dd
2026-03-26 22:54:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79df350>
2026-03-26 22:54:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b02a049f-23ad-52f2-a198-bcbf99a914dd/b02a049f-23ad-52f2-a198-bcbf99a914dd_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F6f56d36068aa4302a3f6f80e14903b6d%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/6f56d36068aa4302a3f6f80e14903b6d/images/large/7.jpg saved to cache
2026-03-26 22:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b02a049f-23ad-52f2-a198-bcbf99a914dd
2026-03-26 22:54:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74e63d0>
2026-03-26 22:54:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b02a049f-23ad-52f2-a198-bcbf99a914dd/b02a049f-23ad-52f2-a198-bcbf99a914dd_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F6f56d36068aa4302a3f6f80e14903b6d%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/6f56d36068aa4302a3f6f80e14903b6d/images/large/10.jpg saved to cache
2026-03-26 22:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b02a049f-23ad-52f2-a198-bcbf99a914dd
2026-03-26 22:54:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/7c200c5dcb27436990b5d7f488403672/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252Fdab24e46ede34f4081f5284fa2b7df3e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/dab24e46ede34f4081f5284fa2b7df3e/images/large/3.jpg not downloaded yet
2026-03-26 22:54:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/7c200c5dcb27436990b5d7f488403672/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252Fdab24e46ede34f4081f5284fa2b7df3e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/dab24e46ede34f4081f5284fa2b7df3e/images/large/4.jpg not downloaded yet
2026-03-26 22:54:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/7c200c5dcb27436990b5d7f488403672/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/7c200c5dcb27436990b5d7f488403672/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252Fdab24e46ede34f4081f5284fa2b7df3e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/dab24e46ede34f4081f5284fa2b7df3e/images/large/5.jpg not downloaded yet
2026-03-26 22:54:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/7c200c5dcb27436990b5d7f488403672/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/6f56d36068aa4302a3f6f80e14903b6d/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/561de957f1244852a0c403cc854eec14/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252Fdab24e46ede34f4081f5284fa2b7df3e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/dab24e46ede34f4081f5284fa2b7df3e/images/large/6.jpg not downloaded yet
2026-03-26 22:54:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/6f56d36068aa4302a3f6f80e14903b6d/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252Fdab24e46ede34f4081f5284fa2b7df3e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/dab24e46ede34f4081f5284fa2b7df3e/images/large/7.jpg not downloaded yet
2026-03-26 22:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252Fdab24e46ede34f4081f5284fa2b7df3e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/dab24e46ede34f4081f5284fa2b7df3e/images/large/8.jpg not downloaded yet
2026-03-26 22:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252Fdab24e46ede34f4081f5284fa2b7df3e%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/dab24e46ede34f4081f5284fa2b7df3e/images/large/9.jpg not downloaded yet
2026-03-26 22:54:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cbed50>
2026-03-26 22:54:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0475d773-c9bd-57d9-92ba-2afdf730d633/0475d773-c9bd-57d9-92ba-2afdf730d633_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F7c200c5dcb27436990b5d7f488403672%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/7c200c5dcb27436990b5d7f488403672/images/large/6.jpg saved to cache
2026-03-26 22:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0475d773-c9bd-57d9-92ba-2afdf730d633
2026-03-26 22:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252Fdab24e46ede34f4081f5284fa2b7df3e%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/dab24e46ede34f4081f5284fa2b7df3e/images/large/10.jpg not downloaded yet
2026-03-26 22:54:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b746fc10>
2026-03-26 22:54:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0475d773-c9bd-57d9-92ba-2afdf730d633/0475d773-c9bd-57d9-92ba-2afdf730d633_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F7c200c5dcb27436990b5d7f488403672%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/7c200c5dcb27436990b5d7f488403672/images/large/3.jpg saved to cache
2026-03-26 22:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0475d773-c9bd-57d9-92ba-2afdf730d633
2026-03-26 22:54:38 [ayvens.be] INFO: Found listing with ID: 1985551
2026-03-26 22:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985551%27 HTTP/1.1" 200 None
2026-03-26 22:54:38 [ayvens.be] INFO: Scrape type for 1985551: 1
2026-03-26 22:54:38 [ayvens.be] INFO: Extracting data for car ID: 1985551
2026-03-26 22:54:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1631eb65-126f-594d-a66e-5f4946f4eb27 with identifier: 1985551
2026-03-26 22:54:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1631eb65-126f-594d-a66e-5f4946f4eb27 with scrape type 1
2026-03-26 22:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1631eb65-126f-594d-a66e-5f4946f4eb27
2026-03-26 22:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252F85ae05962dff419a93c8db5d0473b4ce%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/85ae05962dff419a93c8db5d0473b4ce/images/large/1.jpg not downloaded yet
2026-03-26 22:54:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/561de957f1244852a0c403cc854eec14/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252F85ae05962dff419a93c8db5d0473b4ce%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/85ae05962dff419a93c8db5d0473b4ce/images/large/2.jpg not downloaded yet
2026-03-26 22:54:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76a5610>
2026-03-26 22:54:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0475d773-c9bd-57d9-92ba-2afdf730d633/0475d773-c9bd-57d9-92ba-2afdf730d633_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F7c200c5dcb27436990b5d7f488403672%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/7c200c5dcb27436990b5d7f488403672/images/large/7.jpg saved to cache
2026-03-26 22:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0475d773-c9bd-57d9-92ba-2afdf730d633
2026-03-26 22:54:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e4fcd0>
2026-03-26 22:54:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0475d773-c9bd-57d9-92ba-2afdf730d633/0475d773-c9bd-57d9-92ba-2afdf730d633_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F7c200c5dcb27436990b5d7f488403672%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/7c200c5dcb27436990b5d7f488403672/images/large/5.jpg saved to cache
2026-03-26 22:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0475d773-c9bd-57d9-92ba-2afdf730d633
2026-03-26 22:54:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7a80ed0>
2026-03-26 22:54:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0475d773-c9bd-57d9-92ba-2afdf730d633/0475d773-c9bd-57d9-92ba-2afdf730d633_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F7c200c5dcb27436990b5d7f488403672%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/7c200c5dcb27436990b5d7f488403672/images/large/4.jpg saved to cache
2026-03-26 22:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0475d773-c9bd-57d9-92ba-2afdf730d633
2026-03-26 22:54:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b75a5d90>
2026-03-26 22:54:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b02a049f-23ad-52f2-a198-bcbf99a914dd/b02a049f-23ad-52f2-a198-bcbf99a914dd_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F6f56d36068aa4302a3f6f80e14903b6d%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/6f56d36068aa4302a3f6f80e14903b6d/images/large/4.jpg saved to cache
2026-03-26 22:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b02a049f-23ad-52f2-a198-bcbf99a914dd
2026-03-26 22:54:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b746d290>
2026-03-26 22:54:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e69776c-945b-5aab-a92a-06594b48f9b9/7e69776c-945b-5aab-a92a-06594b48f9b9_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F561de957f1244852a0c403cc854eec14%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/561de957f1244852a0c403cc854eec14/images/large/2.jpg saved to cache
2026-03-26 22:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7e69776c-945b-5aab-a92a-06594b48f9b9
2026-03-26 22:54:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6d82650>
2026-03-26 22:54:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b02a049f-23ad-52f2-a198-bcbf99a914dd/b02a049f-23ad-52f2-a198-bcbf99a914dd_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F6f56d36068aa4302a3f6f80e14903b6d%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/6f56d36068aa4302a3f6f80e14903b6d/images/large/3.jpg saved to cache
2026-03-26 22:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b02a049f-23ad-52f2-a198-bcbf99a914dd
2026-03-26 22:54:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b02a049f-23ad-52f2-a198-bcbf99a914dd, skipping ID generation
2026-03-26 22:54:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b02a049f-23ad-52f2-a198-bcbf99a914dd with scrape type 1
2026-03-26 22:54:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b02a049f-23ad-52f2-a198-bcbf99a914dd sending to next pipeline
2026-03-26 22:54:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b02a049f-23ad-52f2-a198-bcbf99a914dd, identifier: 1985547
2026-03-26 22:54:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/7c200c5dcb27436990b5d7f488403672/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b02a049f-23ad-52f2-a198-bcbf99a914dd with identifier: 1985547
2026-03-26 22:54:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b02a049f-23ad-52f2-a198-bcbf99a914dd with identifier: 1985547
2026-03-26 22:54:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b02a049f-23ad-52f2-a198-bcbf99a914dd with identifier: 1985547 to the API
2026-03-26 22:54:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:54:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:54:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2be/6f56d36068aa4302a3f6f80e14903b6d/images/large/3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b02a049f-23ad-52f2-a198-bcbf99a914dd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLB',
 'odometer': 116175,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 20,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b02a049f-23ad-52f2-a198-bcbf99a914dd/b02a049f-23ad-52f2-a198-bcbf99a914dd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 529425,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/6f56d36068aa4302a3f6f80e14903b6d/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b02a049f-23ad-52f2-a198-bcbf99a914dd/b02a049f-23ad-52f2-a198-bcbf99a914dd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 494252,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/6f56d36068aa4302a3f6f80e14903b6d/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b02a049f-23ad-52f2-a198-bcbf99a914dd/b02a049f-23ad-52f2-a198-bcbf99a914dd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 602159,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/6f56d36068aa4302a3f6f80e14903b6d/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b02a049f-23ad-52f2-a198-bcbf99a914dd/b02a049f-23ad-52f2-a198-bcbf99a914dd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 587210,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/6f56d36068aa4302a3f6f80e14903b6d/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b02a049f-23ad-52f2-a198-bcbf99a914dd/b02a049f-23ad-52f2-a198-bcbf99a914dd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 557977,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/6f56d36068aa4302a3f6f80e14903b6d/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b02a049f-23ad-52f2-a198-bcbf99a914dd/b02a049f-23ad-52f2-a198-bcbf99a914dd_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 698811,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/6f56d36068aa4302a3f6f80e14903b6d/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b02a049f-23ad-52f2-a198-bcbf99a914dd/b02a049f-23ad-52f2-a198-bcbf99a914dd_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 589057,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/6f56d36068aa4302a3f6f80e14903b6d/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b02a049f-23ad-52f2-a198-bcbf99a914dd/b02a049f-23ad-52f2-a198-bcbf99a914dd_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 617228,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/6f56d36068aa4302a3f6f80e14903b6d/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b02a049f-23ad-52f2-a198-bcbf99a914dd/b02a049f-23ad-52f2-a198-bcbf99a914dd_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 488855,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/6f56d36068aa4302a3f6f80e14903b6d/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b02a049f-23ad-52f2-a198-bcbf99a914dd/b02a049f-23ad-52f2-a198-bcbf99a914dd_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 745402,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/6f56d36068aa4302a3f6f80e14903b6d/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLB 2.0 GLB 180 D BUSINESS SOLUTION',
 'transmission': 'automatic',
 'trim': '2.0 GLB 180 D BUSINESS SOLUTION',
 'vin': None,
 'year': 2021}
2026-03-26 22:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985547%27 HTTP/1.1" 200 None
2026-03-26 22:54:39 [ayvens.be] INFO: Saving data for 1985547: {'created_time': 1774565679.938127, 'last_price_update_time': 1774565679.938137, 'auction_closing_time': 1774958400.0}
2026-03-26 22:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985547') HTTP/1.1" 204 0
2026-03-26 22:54:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/7c200c5dcb27436990b5d7f488403672/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252F85ae05962dff419a93c8db5d0473b4ce%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/85ae05962dff419a93c8db5d0473b4ce/images/large/3.jpg not downloaded yet
2026-03-26 22:54:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/561de957f1244852a0c403cc854eec14/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252F85ae05962dff419a93c8db5d0473b4ce%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/85ae05962dff419a93c8db5d0473b4ce/images/large/4.jpg not downloaded yet
2026-03-26 22:54:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/561de957f1244852a0c403cc854eec14/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/561de957f1244852a0c403cc854eec14/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77af6d0>
2026-03-26 22:54:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e69776c-945b-5aab-a92a-06594b48f9b9/7e69776c-945b-5aab-a92a-06594b48f9b9_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F561de957f1244852a0c403cc854eec14%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/561de957f1244852a0c403cc854eec14/images/large/4.jpg saved to cache
2026-03-26 22:54:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7e69776c-945b-5aab-a92a-06594b48f9b9
2026-03-26 22:54:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b742a9d0>
2026-03-26 22:54:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0475d773-c9bd-57d9-92ba-2afdf730d633/0475d773-c9bd-57d9-92ba-2afdf730d633_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F7c200c5dcb27436990b5d7f488403672%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/7c200c5dcb27436990b5d7f488403672/images/large/10.jpg saved to cache
2026-03-26 22:54:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0475d773-c9bd-57d9-92ba-2afdf730d633
2026-03-26 22:54:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/dab24e46ede34f4081f5284fa2b7df3e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252F85ae05962dff419a93c8db5d0473b4ce%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/85ae05962dff419a93c8db5d0473b4ce/images/large/5.jpg not downloaded yet
2026-03-26 22:54:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/561de957f1244852a0c403cc854eec14/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/561de957f1244852a0c403cc854eec14/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252F85ae05962dff419a93c8db5d0473b4ce%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/85ae05962dff419a93c8db5d0473b4ce/images/large/6.jpg not downloaded yet
2026-03-26 22:54:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7492fd0>
2026-03-26 22:54:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0475d773-c9bd-57d9-92ba-2afdf730d633/0475d773-c9bd-57d9-92ba-2afdf730d633_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F7c200c5dcb27436990b5d7f488403672%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/7c200c5dcb27436990b5d7f488403672/images/large/9.jpg saved to cache
2026-03-26 22:54:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0475d773-c9bd-57d9-92ba-2afdf730d633
2026-03-26 22:54:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76ec110>
2026-03-26 22:54:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e69776c-945b-5aab-a92a-06594b48f9b9/7e69776c-945b-5aab-a92a-06594b48f9b9_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F561de957f1244852a0c403cc854eec14%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/561de957f1244852a0c403cc854eec14/images/large/5.jpg saved to cache
2026-03-26 22:54:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7e69776c-945b-5aab-a92a-06594b48f9b9
2026-03-26 22:54:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7688390>
2026-03-26 22:54:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e69776c-945b-5aab-a92a-06594b48f9b9/7e69776c-945b-5aab-a92a-06594b48f9b9_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F561de957f1244852a0c403cc854eec14%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/561de957f1244852a0c403cc854eec14/images/large/1.jpg saved to cache
2026-03-26 22:54:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7e69776c-945b-5aab-a92a-06594b48f9b9
2026-03-26 22:54:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74cff10>
2026-03-26 22:54:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e69776c-945b-5aab-a92a-06594b48f9b9/7e69776c-945b-5aab-a92a-06594b48f9b9_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F561de957f1244852a0c403cc854eec14%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/561de957f1244852a0c403cc854eec14/images/large/3.jpg saved to cache
2026-03-26 22:54:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7e69776c-945b-5aab-a92a-06594b48f9b9
2026-03-26 22:54:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/dab24e46ede34f4081f5284fa2b7df3e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/dab24e46ede34f4081f5284fa2b7df3e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252F85ae05962dff419a93c8db5d0473b4ce%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/85ae05962dff419a93c8db5d0473b4ce/images/large/7.jpg not downloaded yet
2026-03-26 22:54:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/dab24e46ede34f4081f5284fa2b7df3e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252F85ae05962dff419a93c8db5d0473b4ce%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/85ae05962dff419a93c8db5d0473b4ce/images/large/8.jpg not downloaded yet
2026-03-26 22:54:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7590dd0>
2026-03-26 22:54:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c31d14e-586c-5631-8915-23d5ef030f15/3c31d14e-586c-5631-8915-23d5ef030f15_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252Fdab24e46ede34f4081f5284fa2b7df3e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/dab24e46ede34f4081f5284fa2b7df3e/images/large/2.jpg saved to cache
2026-03-26 22:54:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3c31d14e-586c-5631-8915-23d5ef030f15
2026-03-26 22:54:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b78c3110>
2026-03-26 22:54:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e69776c-945b-5aab-a92a-06594b48f9b9/7e69776c-945b-5aab-a92a-06594b48f9b9_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F561de957f1244852a0c403cc854eec14%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/561de957f1244852a0c403cc854eec14/images/large/6.jpg saved to cache
2026-03-26 22:54:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7e69776c-945b-5aab-a92a-06594b48f9b9
2026-03-26 22:54:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77ae8d0>
2026-03-26 22:54:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e69776c-945b-5aab-a92a-06594b48f9b9/7e69776c-945b-5aab-a92a-06594b48f9b9_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F561de957f1244852a0c403cc854eec14%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/561de957f1244852a0c403cc854eec14/images/large/7.jpg saved to cache
2026-03-26 22:54:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7e69776c-945b-5aab-a92a-06594b48f9b9
2026-03-26 22:54:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/dab24e46ede34f4081f5284fa2b7df3e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252F85ae05962dff419a93c8db5d0473b4ce%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/85ae05962dff419a93c8db5d0473b4ce/images/large/9.jpg not downloaded yet
2026-03-26 22:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252F85ae05962dff419a93c8db5d0473b4ce%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/85ae05962dff419a93c8db5d0473b4ce/images/large/10.jpg not downloaded yet
2026-03-26 22:54:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/561de957f1244852a0c403cc854eec14/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:40 [ayvens.be] INFO: Found listing with ID: 1985552
2026-03-26 22:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985552%27 HTTP/1.1" 200 None
2026-03-26 22:54:40 [ayvens.be] INFO: Scrape type for 1985552: 1
2026-03-26 22:54:40 [ayvens.be] INFO: Extracting data for car ID: 1985552
2026-03-26 22:54:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4d21a3c6-1f65-5cd1-b250-9745fef5b789 with identifier: 1985552
2026-03-26 22:54:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d21a3c6-1f65-5cd1-b250-9745fef5b789 with scrape type 1
2026-03-26 22:54:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4d21a3c6-1f65-5cd1-b250-9745fef5b789
2026-03-26 22:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F253f952821384bc8820abea27482bda6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/253f952821384bc8820abea27482bda6/images/large/1.jpg not downloaded yet
2026-03-26 22:54:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7442c50>
2026-03-26 22:54:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c31d14e-586c-5631-8915-23d5ef030f15/3c31d14e-586c-5631-8915-23d5ef030f15_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252Fdab24e46ede34f4081f5284fa2b7df3e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/dab24e46ede34f4081f5284fa2b7df3e/images/large/1.jpg saved to cache
2026-03-26 22:54:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3c31d14e-586c-5631-8915-23d5ef030f15
2026-03-26 22:54:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7aea0d0>
2026-03-26 22:54:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c31d14e-586c-5631-8915-23d5ef030f15/3c31d14e-586c-5631-8915-23d5ef030f15_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252Fdab24e46ede34f4081f5284fa2b7df3e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/dab24e46ede34f4081f5284fa2b7df3e/images/large/3.jpg saved to cache
2026-03-26 22:54:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3c31d14e-586c-5631-8915-23d5ef030f15
2026-03-26 22:54:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6df3f90>
2026-03-26 22:54:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c31d14e-586c-5631-8915-23d5ef030f15/3c31d14e-586c-5631-8915-23d5ef030f15_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252Fdab24e46ede34f4081f5284fa2b7df3e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/dab24e46ede34f4081f5284fa2b7df3e/images/large/4.jpg saved to cache
2026-03-26 22:54:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3c31d14e-586c-5631-8915-23d5ef030f15
2026-03-26 22:54:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/561de957f1244852a0c403cc854eec14/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/dab24e46ede34f4081f5284fa2b7df3e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/dab24e46ede34f4081f5284fa2b7df3e/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/dab24e46ede34f4081f5284fa2b7df3e/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F253f952821384bc8820abea27482bda6%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/253f952821384bc8820abea27482bda6/images/large/2.jpg not downloaded yet
2026-03-26 22:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F253f952821384bc8820abea27482bda6%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/253f952821384bc8820abea27482bda6/images/large/3.jpg not downloaded yet
2026-03-26 22:54:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e16ad0>
2026-03-26 22:54:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c31d14e-586c-5631-8915-23d5ef030f15/3c31d14e-586c-5631-8915-23d5ef030f15_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252Fdab24e46ede34f4081f5284fa2b7df3e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/dab24e46ede34f4081f5284fa2b7df3e/images/large/5.jpg saved to cache
2026-03-26 22:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3c31d14e-586c-5631-8915-23d5ef030f15
2026-03-26 22:54:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b78a8f50>
2026-03-26 22:54:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e69776c-945b-5aab-a92a-06594b48f9b9/7e69776c-945b-5aab-a92a-06594b48f9b9_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F561de957f1244852a0c403cc854eec14%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/561de957f1244852a0c403cc854eec14/images/large/10.jpg saved to cache
2026-03-26 22:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7e69776c-945b-5aab-a92a-06594b48f9b9
2026-03-26 22:54:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1uq/85ae05962dff419a93c8db5d0473b4ce/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1uq/85ae05962dff419a93c8db5d0473b4ce/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F253f952821384bc8820abea27482bda6%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/253f952821384bc8820abea27482bda6/images/large/4.jpg not downloaded yet
2026-03-26 22:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F253f952821384bc8820abea27482bda6%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/253f952821384bc8820abea27482bda6/images/large/5.jpg not downloaded yet
2026-03-26 22:54:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/dab24e46ede34f4081f5284fa2b7df3e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F253f952821384bc8820abea27482bda6%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/253f952821384bc8820abea27482bda6/images/large/6.jpg not downloaded yet
2026-03-26 22:54:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7aea250>
2026-03-26 22:54:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e69776c-945b-5aab-a92a-06594b48f9b9/7e69776c-945b-5aab-a92a-06594b48f9b9_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F561de957f1244852a0c403cc854eec14%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/561de957f1244852a0c403cc854eec14/images/large/9.jpg saved to cache
2026-03-26 22:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7e69776c-945b-5aab-a92a-06594b48f9b9
2026-03-26 22:54:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7482790>
2026-03-26 22:54:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c31d14e-586c-5631-8915-23d5ef030f15/3c31d14e-586c-5631-8915-23d5ef030f15_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252Fdab24e46ede34f4081f5284fa2b7df3e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/dab24e46ede34f4081f5284fa2b7df3e/images/large/6.jpg saved to cache
2026-03-26 22:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3c31d14e-586c-5631-8915-23d5ef030f15
2026-03-26 22:54:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd496910>
2026-03-26 22:54:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c31d14e-586c-5631-8915-23d5ef030f15/3c31d14e-586c-5631-8915-23d5ef030f15_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252Fdab24e46ede34f4081f5284fa2b7df3e%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/dab24e46ede34f4081f5284fa2b7df3e/images/large/10.jpg saved to cache
2026-03-26 22:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3c31d14e-586c-5631-8915-23d5ef030f15
2026-03-26 22:54:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7497250>
2026-03-26 22:54:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c31d14e-586c-5631-8915-23d5ef030f15/3c31d14e-586c-5631-8915-23d5ef030f15_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252Fdab24e46ede34f4081f5284fa2b7df3e%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/dab24e46ede34f4081f5284fa2b7df3e/images/large/9.jpg saved to cache
2026-03-26 22:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3c31d14e-586c-5631-8915-23d5ef030f15
2026-03-26 22:54:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1uq/85ae05962dff419a93c8db5d0473b4ce/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/dab24e46ede34f4081f5284fa2b7df3e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F253f952821384bc8820abea27482bda6%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/253f952821384bc8820abea27482bda6/images/large/7.jpg not downloaded yet
2026-03-26 22:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F253f952821384bc8820abea27482bda6%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/253f952821384bc8820abea27482bda6/images/large/8.jpg not downloaded yet
2026-03-26 22:54:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7945fd0>
2026-03-26 22:54:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1631eb65-126f-594d-a66e-5f4946f4eb27/1631eb65-126f-594d-a66e-5f4946f4eb27_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252F85ae05962dff419a93c8db5d0473b4ce%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/85ae05962dff419a93c8db5d0473b4ce/images/large/1.jpg saved to cache
2026-03-26 22:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1631eb65-126f-594d-a66e-5f4946f4eb27
2026-03-26 22:54:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cb11d0>
2026-03-26 22:54:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1631eb65-126f-594d-a66e-5f4946f4eb27/1631eb65-126f-594d-a66e-5f4946f4eb27_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252F85ae05962dff419a93c8db5d0473b4ce%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/85ae05962dff419a93c8db5d0473b4ce/images/large/2.jpg saved to cache
2026-03-26 22:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1631eb65-126f-594d-a66e-5f4946f4eb27
2026-03-26 22:54:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b78c3e10>
2026-03-26 22:54:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c31d14e-586c-5631-8915-23d5ef030f15/3c31d14e-586c-5631-8915-23d5ef030f15_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252Fdab24e46ede34f4081f5284fa2b7df3e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/dab24e46ede34f4081f5284fa2b7df3e/images/large/8.jpg saved to cache
2026-03-26 22:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3c31d14e-586c-5631-8915-23d5ef030f15
2026-03-26 22:54:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1uq/85ae05962dff419a93c8db5d0473b4ce/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F253f952821384bc8820abea27482bda6%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/253f952821384bc8820abea27482bda6/images/large/9.jpg not downloaded yet
2026-03-26 22:54:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1uq/85ae05962dff419a93c8db5d0473b4ce/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/7c200c5dcb27436990b5d7f488403672/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F253f952821384bc8820abea27482bda6%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/253f952821384bc8820abea27482bda6/images/large/10.jpg not downloaded yet
2026-03-26 22:54:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7ca99d0>
2026-03-26 22:54:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1631eb65-126f-594d-a66e-5f4946f4eb27/1631eb65-126f-594d-a66e-5f4946f4eb27_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252F85ae05962dff419a93c8db5d0473b4ce%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/85ae05962dff419a93c8db5d0473b4ce/images/large/3.jpg saved to cache
2026-03-26 22:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1631eb65-126f-594d-a66e-5f4946f4eb27
2026-03-26 22:54:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74fa250>
2026-03-26 22:54:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c31d14e-586c-5631-8915-23d5ef030f15/3c31d14e-586c-5631-8915-23d5ef030f15_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252Fdab24e46ede34f4081f5284fa2b7df3e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/dab24e46ede34f4081f5284fa2b7df3e/images/large/7.jpg saved to cache
2026-03-26 22:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3c31d14e-586c-5631-8915-23d5ef030f15
2026-03-26 22:54:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3c31d14e-586c-5631-8915-23d5ef030f15, skipping ID generation
2026-03-26 22:54:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c31d14e-586c-5631-8915-23d5ef030f15 with scrape type 1
2026-03-26 22:54:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3c31d14e-586c-5631-8915-23d5ef030f15 sending to next pipeline
2026-03-26 22:54:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 3c31d14e-586c-5631-8915-23d5ef030f15, identifier: 1985550
2026-03-26 22:54:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1uq/85ae05962dff419a93c8db5d0473b4ce/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 3c31d14e-586c-5631-8915-23d5ef030f15 with identifier: 1985550
2026-03-26 22:54:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 3c31d14e-586c-5631-8915-23d5ef030f15 with identifier: 1985550
2026-03-26 22:54:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 3c31d14e-586c-5631-8915-23d5ef030f15 with identifier: 1985550 to the API
2026-03-26 22:54:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:54:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:54:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2av/dab24e46ede34f4081f5284fa2b7df3e/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 37,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '3c31d14e-586c-5631-8915-23d5ef030f15',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '3 SERIES TOURING',
 'odometer': 102982,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c31d14e-586c-5631-8915-23d5ef030f15/3c31d14e-586c-5631-8915-23d5ef030f15_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 214478,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/dab24e46ede34f4081f5284fa2b7df3e/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c31d14e-586c-5631-8915-23d5ef030f15/3c31d14e-586c-5631-8915-23d5ef030f15_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 208435,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/dab24e46ede34f4081f5284fa2b7df3e/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c31d14e-586c-5631-8915-23d5ef030f15/3c31d14e-586c-5631-8915-23d5ef030f15_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 232107,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/dab24e46ede34f4081f5284fa2b7df3e/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c31d14e-586c-5631-8915-23d5ef030f15/3c31d14e-586c-5631-8915-23d5ef030f15_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 229132,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/dab24e46ede34f4081f5284fa2b7df3e/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c31d14e-586c-5631-8915-23d5ef030f15/3c31d14e-586c-5631-8915-23d5ef030f15_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 275328,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/dab24e46ede34f4081f5284fa2b7df3e/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c31d14e-586c-5631-8915-23d5ef030f15/3c31d14e-586c-5631-8915-23d5ef030f15_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 265275,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/dab24e46ede34f4081f5284fa2b7df3e/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c31d14e-586c-5631-8915-23d5ef030f15/3c31d14e-586c-5631-8915-23d5ef030f15_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 303405,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/dab24e46ede34f4081f5284fa2b7df3e/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c31d14e-586c-5631-8915-23d5ef030f15/3c31d14e-586c-5631-8915-23d5ef030f15_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 245410,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/dab24e46ede34f4081f5284fa2b7df3e/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c31d14e-586c-5631-8915-23d5ef030f15/3c31d14e-586c-5631-8915-23d5ef030f15_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 331944,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/dab24e46ede34f4081f5284fa2b7df3e/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c31d14e-586c-5631-8915-23d5ef030f15/3c31d14e-586c-5631-8915-23d5ef030f15_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 381273,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/dab24e46ede34f4081f5284fa2b7df3e/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3 SERIES TOURING 2.0 320E XDRIVE TOURING',
 'transmission': 'automatic',
 'trim': '2.0 320E XDRIVE TOURING',
 'vin': None,
 'year': 2021}
2026-03-26 22:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985550%27 HTTP/1.1" 200 None
2026-03-26 22:54:42 [ayvens.be] INFO: Saving data for 1985550: {'created_time': 1774565682.74951, 'last_price_update_time': 1774565682.74952, 'auction_closing_time': 1774958400.0}
2026-03-26 22:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985550') HTTP/1.1" 204 0
2026-03-26 22:54:42 [ayvens.be] INFO: Found listing with ID: 1985553
2026-03-26 22:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985553%27 HTTP/1.1" 200 None
2026-03-26 22:54:42 [ayvens.be] INFO: Scrape type for 1985553: 1
2026-03-26 22:54:42 [ayvens.be] INFO: Extracting data for car ID: 1985553
2026-03-26 22:54:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f19dff6-09d0-5024-b64c-2157ab8048d4 with identifier: 1985553
2026-03-26 22:54:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f19dff6-09d0-5024-b64c-2157ab8048d4 with scrape type 1
2026-03-26 22:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7f19dff6-09d0-5024-b64c-2157ab8048d4
2026-03-26 22:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252Fdbfa9f3e6a674da3b86d17cb81860c57%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/dbfa9f3e6a674da3b86d17cb81860c57/images/large/1.jpg not downloaded yet
2026-03-26 22:54:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/561de957f1244852a0c403cc854eec14/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252Fdbfa9f3e6a674da3b86d17cb81860c57%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/dbfa9f3e6a674da3b86d17cb81860c57/images/large/2.jpg not downloaded yet
2026-03-26 22:54:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7660290>
2026-03-26 22:54:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1631eb65-126f-594d-a66e-5f4946f4eb27/1631eb65-126f-594d-a66e-5f4946f4eb27_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252F85ae05962dff419a93c8db5d0473b4ce%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/85ae05962dff419a93c8db5d0473b4ce/images/large/4.jpg saved to cache
2026-03-26 22:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1631eb65-126f-594d-a66e-5f4946f4eb27
2026-03-26 22:54:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7268c10>
2026-03-26 22:54:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1631eb65-126f-594d-a66e-5f4946f4eb27/1631eb65-126f-594d-a66e-5f4946f4eb27_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252F85ae05962dff419a93c8db5d0473b4ce%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/85ae05962dff419a93c8db5d0473b4ce/images/large/6.jpg saved to cache
2026-03-26 22:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1631eb65-126f-594d-a66e-5f4946f4eb27
2026-03-26 22:54:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b78a8310>
2026-03-26 22:54:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0475d773-c9bd-57d9-92ba-2afdf730d633/0475d773-c9bd-57d9-92ba-2afdf730d633_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F7c200c5dcb27436990b5d7f488403672%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/7c200c5dcb27436990b5d7f488403672/images/large/8.jpg saved to cache
2026-03-26 22:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0475d773-c9bd-57d9-92ba-2afdf730d633
2026-03-26 22:54:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0475d773-c9bd-57d9-92ba-2afdf730d633, skipping ID generation
2026-03-26 22:54:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0475d773-c9bd-57d9-92ba-2afdf730d633 with scrape type 1
2026-03-26 22:54:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0475d773-c9bd-57d9-92ba-2afdf730d633 sending to next pipeline
2026-03-26 22:54:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 0475d773-c9bd-57d9-92ba-2afdf730d633, identifier: 1985548
2026-03-26 22:54:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e12890>
2026-03-26 22:54:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1631eb65-126f-594d-a66e-5f4946f4eb27/1631eb65-126f-594d-a66e-5f4946f4eb27_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252F85ae05962dff419a93c8db5d0473b4ce%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/85ae05962dff419a93c8db5d0473b4ce/images/large/5.jpg saved to cache
2026-03-26 22:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1631eb65-126f-594d-a66e-5f4946f4eb27
2026-03-26 22:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252Fdbfa9f3e6a674da3b86d17cb81860c57%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/dbfa9f3e6a674da3b86d17cb81860c57/images/large/3.jpg not downloaded yet
2026-03-26 22:54:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 0475d773-c9bd-57d9-92ba-2afdf730d633 with identifier: 1985548
2026-03-26 22:54:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 0475d773-c9bd-57d9-92ba-2afdf730d633 with identifier: 1985548
2026-03-26 22:54:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 0475d773-c9bd-57d9-92ba-2afdf730d633 with identifier: 1985548 to the API
2026-03-26 22:54:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:54:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:54:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bj/7c200c5dcb27436990b5d7f488403672/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '0475d773-c9bd-57d9-92ba-2afdf730d633',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLA - Klasse',
 'odometer': 89787,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0475d773-c9bd-57d9-92ba-2afdf730d633/0475d773-c9bd-57d9-92ba-2afdf730d633_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 476072,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/7c200c5dcb27436990b5d7f488403672/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0475d773-c9bd-57d9-92ba-2afdf730d633/0475d773-c9bd-57d9-92ba-2afdf730d633_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 431231,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/7c200c5dcb27436990b5d7f488403672/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0475d773-c9bd-57d9-92ba-2afdf730d633/0475d773-c9bd-57d9-92ba-2afdf730d633_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 460508,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/7c200c5dcb27436990b5d7f488403672/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0475d773-c9bd-57d9-92ba-2afdf730d633/0475d773-c9bd-57d9-92ba-2afdf730d633_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 462811,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/7c200c5dcb27436990b5d7f488403672/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0475d773-c9bd-57d9-92ba-2afdf730d633/0475d773-c9bd-57d9-92ba-2afdf730d633_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 367437,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/7c200c5dcb27436990b5d7f488403672/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0475d773-c9bd-57d9-92ba-2afdf730d633/0475d773-c9bd-57d9-92ba-2afdf730d633_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 277468,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/7c200c5dcb27436990b5d7f488403672/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0475d773-c9bd-57d9-92ba-2afdf730d633/0475d773-c9bd-57d9-92ba-2afdf730d633_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 411989,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/7c200c5dcb27436990b5d7f488403672/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0475d773-c9bd-57d9-92ba-2afdf730d633/0475d773-c9bd-57d9-92ba-2afdf730d633_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 364861,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/7c200c5dcb27436990b5d7f488403672/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0475d773-c9bd-57d9-92ba-2afdf730d633/0475d773-c9bd-57d9-92ba-2afdf730d633_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 380262,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/7c200c5dcb27436990b5d7f488403672/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0475d773-c9bd-57d9-92ba-2afdf730d633/0475d773-c9bd-57d9-92ba-2afdf730d633_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 355786,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/7c200c5dcb27436990b5d7f488403672/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLA - Klasse 2.0 CLA 180 D BUS SOLUTION ESSENTIAL',
 'transmission': 'manual',
 'trim': '2.0 CLA 180 D BUS SOLUTION ESSENTIAL',
 'vin': None,
 'year': 2021}
2026-03-26 22:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985548%27 HTTP/1.1" 200 None
2026-03-26 22:54:43 [ayvens.be] INFO: Saving data for 1985548: {'created_time': 1774565683.706872, 'last_price_update_time': 1774565683.706881, 'auction_closing_time': 1774958400.0}
2026-03-26 22:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985548') HTTP/1.1" 204 0
2026-03-26 22:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252Fdbfa9f3e6a674da3b86d17cb81860c57%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/dbfa9f3e6a674da3b86d17cb81860c57/images/large/4.jpg not downloaded yet
2026-03-26 22:54:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79cd310>
2026-03-26 22:54:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e69776c-945b-5aab-a92a-06594b48f9b9/7e69776c-945b-5aab-a92a-06594b48f9b9_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F561de957f1244852a0c403cc854eec14%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/561de957f1244852a0c403cc854eec14/images/large/8.jpg saved to cache
2026-03-26 22:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7e69776c-945b-5aab-a92a-06594b48f9b9
2026-03-26 22:54:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7e69776c-945b-5aab-a92a-06594b48f9b9, skipping ID generation
2026-03-26 22:54:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e69776c-945b-5aab-a92a-06594b48f9b9 with scrape type 1
2026-03-26 22:54:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7e69776c-945b-5aab-a92a-06594b48f9b9 sending to next pipeline
2026-03-26 22:54:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 7e69776c-945b-5aab-a92a-06594b48f9b9, identifier: 1985549
2026-03-26 22:54:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/253f952821384bc8820abea27482bda6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 7e69776c-945b-5aab-a92a-06594b48f9b9 with identifier: 1985549
2026-03-26 22:54:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 7e69776c-945b-5aab-a92a-06594b48f9b9 with identifier: 1985549
2026-03-26 22:54:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 7e69776c-945b-5aab-a92a-06594b48f9b9 with identifier: 1985549 to the API
2026-03-26 22:54:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:54:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:54:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yl/561de957f1244852a0c403cc854eec14/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '7e69776c-945b-5aab-a92a-06594b48f9b9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '5008 DIESEL - 2020',
 'odometer': 150283,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 20,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e69776c-945b-5aab-a92a-06594b48f9b9/7e69776c-945b-5aab-a92a-06594b48f9b9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 561532,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/561de957f1244852a0c403cc854eec14/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e69776c-945b-5aab-a92a-06594b48f9b9/7e69776c-945b-5aab-a92a-06594b48f9b9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 526597,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/561de957f1244852a0c403cc854eec14/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e69776c-945b-5aab-a92a-06594b48f9b9/7e69776c-945b-5aab-a92a-06594b48f9b9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 565379,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/561de957f1244852a0c403cc854eec14/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e69776c-945b-5aab-a92a-06594b48f9b9/7e69776c-945b-5aab-a92a-06594b48f9b9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 549826,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/561de957f1244852a0c403cc854eec14/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e69776c-945b-5aab-a92a-06594b48f9b9/7e69776c-945b-5aab-a92a-06594b48f9b9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 522359,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/561de957f1244852a0c403cc854eec14/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e69776c-945b-5aab-a92a-06594b48f9b9/7e69776c-945b-5aab-a92a-06594b48f9b9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 680239,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/561de957f1244852a0c403cc854eec14/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e69776c-945b-5aab-a92a-06594b48f9b9/7e69776c-945b-5aab-a92a-06594b48f9b9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 595933,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/561de957f1244852a0c403cc854eec14/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e69776c-945b-5aab-a92a-06594b48f9b9/7e69776c-945b-5aab-a92a-06594b48f9b9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 640650,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/561de957f1244852a0c403cc854eec14/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e69776c-945b-5aab-a92a-06594b48f9b9/7e69776c-945b-5aab-a92a-06594b48f9b9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 652327,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/561de957f1244852a0c403cc854eec14/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e69776c-945b-5aab-a92a-06594b48f9b9/7e69776c-945b-5aab-a92a-06594b48f9b9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 546452,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/561de957f1244852a0c403cc854eec14/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 5008 DIESEL - 2020 1.5 BlueHDi GT Line',
 'transmission': 'automatic',
 'trim': '1.5 BlueHDi GT Line',
 'vin': None,
 'year': 2020}
2026-03-26 22:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985549%27 HTTP/1.1" 200 None
2026-03-26 22:54:44 [ayvens.be] INFO: Saving data for 1985549: {'created_time': 1774565684.195827, 'last_price_update_time': 1774565684.195836, 'auction_closing_time': 1774958400.0}
2026-03-26 22:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985549') HTTP/1.1" 204 0
2026-03-26 22:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252Fdbfa9f3e6a674da3b86d17cb81860c57%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/dbfa9f3e6a674da3b86d17cb81860c57/images/large/5.jpg not downloaded yet
2026-03-26 22:54:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1uq/85ae05962dff419a93c8db5d0473b4ce/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1uq/85ae05962dff419a93c8db5d0473b4ce/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1uq/85ae05962dff419a93c8db5d0473b4ce/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252Fdbfa9f3e6a674da3b86d17cb81860c57%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/dbfa9f3e6a674da3b86d17cb81860c57/images/large/6.jpg not downloaded yet
2026-03-26 22:54:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7428510>
2026-03-26 22:54:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d21a3c6-1f65-5cd1-b250-9745fef5b789/4d21a3c6-1f65-5cd1-b250-9745fef5b789_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F253f952821384bc8820abea27482bda6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/253f952821384bc8820abea27482bda6/images/large/1.jpg saved to cache
2026-03-26 22:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4d21a3c6-1f65-5cd1-b250-9745fef5b789
2026-03-26 22:54:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/253f952821384bc8820abea27482bda6/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252Fdbfa9f3e6a674da3b86d17cb81860c57%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/dbfa9f3e6a674da3b86d17cb81860c57/images/large/7.jpg not downloaded yet
2026-03-26 22:54:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1uq/85ae05962dff419a93c8db5d0473b4ce/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7947bd0>
2026-03-26 22:54:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1631eb65-126f-594d-a66e-5f4946f4eb27/1631eb65-126f-594d-a66e-5f4946f4eb27_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252F85ae05962dff419a93c8db5d0473b4ce%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/85ae05962dff419a93c8db5d0473b4ce/images/large/7.jpg saved to cache
2026-03-26 22:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1631eb65-126f-594d-a66e-5f4946f4eb27
2026-03-26 22:54:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7a55890>
2026-03-26 22:54:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1631eb65-126f-594d-a66e-5f4946f4eb27/1631eb65-126f-594d-a66e-5f4946f4eb27_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252F85ae05962dff419a93c8db5d0473b4ce%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/85ae05962dff419a93c8db5d0473b4ce/images/large/8.jpg saved to cache
2026-03-26 22:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1631eb65-126f-594d-a66e-5f4946f4eb27
2026-03-26 22:54:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7ae8f10>
2026-03-26 22:54:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1631eb65-126f-594d-a66e-5f4946f4eb27/1631eb65-126f-594d-a66e-5f4946f4eb27_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252F85ae05962dff419a93c8db5d0473b4ce%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/85ae05962dff419a93c8db5d0473b4ce/images/large/10.jpg saved to cache
2026-03-26 22:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1631eb65-126f-594d-a66e-5f4946f4eb27
2026-03-26 22:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252Fdbfa9f3e6a674da3b86d17cb81860c57%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/dbfa9f3e6a674da3b86d17cb81860c57/images/large/8.jpg not downloaded yet
2026-03-26 22:54:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/253f952821384bc8820abea27482bda6/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/253f952821384bc8820abea27482bda6/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252Fdbfa9f3e6a674da3b86d17cb81860c57%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/dbfa9f3e6a674da3b86d17cb81860c57/images/large/9.jpg not downloaded yet
2026-03-26 22:54:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b776a0d0>
2026-03-26 22:54:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d21a3c6-1f65-5cd1-b250-9745fef5b789/4d21a3c6-1f65-5cd1-b250-9745fef5b789_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F253f952821384bc8820abea27482bda6%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/253f952821384bc8820abea27482bda6/images/large/2.jpg saved to cache
2026-03-26 22:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4d21a3c6-1f65-5cd1-b250-9745fef5b789
2026-03-26 22:54:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7482290>
2026-03-26 22:54:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1631eb65-126f-594d-a66e-5f4946f4eb27/1631eb65-126f-594d-a66e-5f4946f4eb27_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252F85ae05962dff419a93c8db5d0473b4ce%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/85ae05962dff419a93c8db5d0473b4ce/images/large/9.jpg saved to cache
2026-03-26 22:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1631eb65-126f-594d-a66e-5f4946f4eb27
2026-03-26 22:54:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1631eb65-126f-594d-a66e-5f4946f4eb27, skipping ID generation
2026-03-26 22:54:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1631eb65-126f-594d-a66e-5f4946f4eb27 with scrape type 1
2026-03-26 22:54:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1631eb65-126f-594d-a66e-5f4946f4eb27 sending to next pipeline
2026-03-26 22:54:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 1631eb65-126f-594d-a66e-5f4946f4eb27, identifier: 1985551
2026-03-26 22:54:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 1631eb65-126f-594d-a66e-5f4946f4eb27 with identifier: 1985551
2026-03-26 22:54:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 1631eb65-126f-594d-a66e-5f4946f4eb27 with identifier: 1985551
2026-03-26 22:54:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 1631eb65-126f-594d-a66e-5f4946f4eb27 with identifier: 1985551 to the API
2026-03-26 22:54:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:54:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:54:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1uq/85ae05962dff419a93c8db5d0473b4ce/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '1631eb65-126f-594d-a66e-5f4946f4eb27',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT 2T 350M FOU MWB HR DSL',
 'odometer': 40862,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1631eb65-126f-594d-a66e-5f4946f4eb27/1631eb65-126f-594d-a66e-5f4946f4eb27_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 638433,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1uq/85ae05962dff419a93c8db5d0473b4ce/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1631eb65-126f-594d-a66e-5f4946f4eb27/1631eb65-126f-594d-a66e-5f4946f4eb27_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 651578,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1uq/85ae05962dff419a93c8db5d0473b4ce/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1631eb65-126f-594d-a66e-5f4946f4eb27/1631eb65-126f-594d-a66e-5f4946f4eb27_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 602642,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1uq/85ae05962dff419a93c8db5d0473b4ce/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1631eb65-126f-594d-a66e-5f4946f4eb27/1631eb65-126f-594d-a66e-5f4946f4eb27_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 609060,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1uq/85ae05962dff419a93c8db5d0473b4ce/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1631eb65-126f-594d-a66e-5f4946f4eb27/1631eb65-126f-594d-a66e-5f4946f4eb27_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 631454,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1uq/85ae05962dff419a93c8db5d0473b4ce/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1631eb65-126f-594d-a66e-5f4946f4eb27/1631eb65-126f-594d-a66e-5f4946f4eb27_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 691416,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1uq/85ae05962dff419a93c8db5d0473b4ce/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1631eb65-126f-594d-a66e-5f4946f4eb27/1631eb65-126f-594d-a66e-5f4946f4eb27_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 608645,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1uq/85ae05962dff419a93c8db5d0473b4ce/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1631eb65-126f-594d-a66e-5f4946f4eb27/1631eb65-126f-594d-a66e-5f4946f4eb27_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 928358,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1uq/85ae05962dff419a93c8db5d0473b4ce/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1631eb65-126f-594d-a66e-5f4946f4eb27/1631eb65-126f-594d-a66e-5f4946f4eb27_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 889311,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1uq/85ae05962dff419a93c8db5d0473b4ce/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1631eb65-126f-594d-a66e-5f4946f4eb27/1631eb65-126f-594d-a66e-5f4946f4eb27_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 924101,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1uq/85ae05962dff419a93c8db5d0473b4ce/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-10',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FORD TRANSIT 2T 350M FOU MWB HR DSL 2.0 TDCi L2H2 Trend STOCK',
 'transmission': 'manual',
 'trim': '2.0 TDCi L2H2 Trend STOCK',
 'vin': None,
 'year': 2018}
2026-03-26 22:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985551%27 HTTP/1.1" 200 None
2026-03-26 22:54:45 [ayvens.be] INFO: Saving data for 1985551: {'created_time': 1774565685.366327, 'last_price_update_time': 1774565685.366336, 'auction_closing_time': 1774958400.0}
2026-03-26 22:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985551') HTTP/1.1" 204 0
2026-03-26 22:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252Fdbfa9f3e6a674da3b86d17cb81860c57%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/dbfa9f3e6a674da3b86d17cb81860c57/images/large/10.jpg not downloaded yet
2026-03-26 22:54:45 [ayvens.be] INFO: Found listing with ID: 1985554
2026-03-26 22:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985554%27 HTTP/1.1" 200 None
2026-03-26 22:54:45 [ayvens.be] INFO: Scrape type for 1985554: 1
2026-03-26 22:54:45 [ayvens.be] INFO: Extracting data for car ID: 1985554
2026-03-26 22:54:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 71689947-0945-541e-84e9-3ae7080dcfea with identifier: 1985554
2026-03-26 22:54:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71689947-0945-541e-84e9-3ae7080dcfea with scrape type 1
2026-03-26 22:54:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 71689947-0945-541e-84e9-3ae7080dcfea
2026-03-26 22:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F6e078c09ad4b4122b05ed4a4d20ad32c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/6e078c09ad4b4122b05ed4a4d20ad32c/images/large/1.jpg not downloaded yet
2026-03-26 22:54:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79fa4d0>
2026-03-26 22:54:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d21a3c6-1f65-5cd1-b250-9745fef5b789/4d21a3c6-1f65-5cd1-b250-9745fef5b789_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F253f952821384bc8820abea27482bda6%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/253f952821384bc8820abea27482bda6/images/large/3.jpg saved to cache
2026-03-26 22:54:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4d21a3c6-1f65-5cd1-b250-9745fef5b789
2026-03-26 22:54:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b787d110>
2026-03-26 22:54:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d21a3c6-1f65-5cd1-b250-9745fef5b789/4d21a3c6-1f65-5cd1-b250-9745fef5b789_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F253f952821384bc8820abea27482bda6%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/253f952821384bc8820abea27482bda6/images/large/4.jpg saved to cache
2026-03-26 22:54:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4d21a3c6-1f65-5cd1-b250-9745fef5b789
2026-03-26 22:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F6e078c09ad4b4122b05ed4a4d20ad32c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/6e078c09ad4b4122b05ed4a4d20ad32c/images/large/2.jpg not downloaded yet
2026-03-26 22:54:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/253f952821384bc8820abea27482bda6/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F6e078c09ad4b4122b05ed4a4d20ad32c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/6e078c09ad4b4122b05ed4a4d20ad32c/images/large/3.jpg not downloaded yet
2026-03-26 22:54:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/253f952821384bc8820abea27482bda6/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/253f952821384bc8820abea27482bda6/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/dbfa9f3e6a674da3b86d17cb81860c57/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F6e078c09ad4b4122b05ed4a4d20ad32c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/6e078c09ad4b4122b05ed4a4d20ad32c/images/large/4.jpg not downloaded yet
2026-03-26 22:54:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/253f952821384bc8820abea27482bda6/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/dbfa9f3e6a674da3b86d17cb81860c57/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/253f952821384bc8820abea27482bda6/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/253f952821384bc8820abea27482bda6/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F6e078c09ad4b4122b05ed4a4d20ad32c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/6e078c09ad4b4122b05ed4a4d20ad32c/images/large/5.jpg not downloaded yet
2026-03-26 22:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F6e078c09ad4b4122b05ed4a4d20ad32c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/6e078c09ad4b4122b05ed4a4d20ad32c/images/large/6.jpg not downloaded yet
2026-03-26 22:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F6e078c09ad4b4122b05ed4a4d20ad32c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/6e078c09ad4b4122b05ed4a4d20ad32c/images/large/7.jpg not downloaded yet
2026-03-26 22:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F6e078c09ad4b4122b05ed4a4d20ad32c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/6e078c09ad4b4122b05ed4a4d20ad32c/images/large/8.jpg not downloaded yet
2026-03-26 22:54:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7450410>
2026-03-26 22:54:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d21a3c6-1f65-5cd1-b250-9745fef5b789/4d21a3c6-1f65-5cd1-b250-9745fef5b789_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F253f952821384bc8820abea27482bda6%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/253f952821384bc8820abea27482bda6/images/large/7.jpg saved to cache
2026-03-26 22:54:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4d21a3c6-1f65-5cd1-b250-9745fef5b789
2026-03-26 22:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F6e078c09ad4b4122b05ed4a4d20ad32c%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/6e078c09ad4b4122b05ed4a4d20ad32c/images/large/9.jpg not downloaded yet
2026-03-26 22:54:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c5d950>
2026-03-26 22:54:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d21a3c6-1f65-5cd1-b250-9745fef5b789/4d21a3c6-1f65-5cd1-b250-9745fef5b789_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F253f952821384bc8820abea27482bda6%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/253f952821384bc8820abea27482bda6/images/large/5.jpg saved to cache
2026-03-26 22:54:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4d21a3c6-1f65-5cd1-b250-9745fef5b789
2026-03-26 22:54:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7400b50>
2026-03-26 22:54:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d21a3c6-1f65-5cd1-b250-9745fef5b789/4d21a3c6-1f65-5cd1-b250-9745fef5b789_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F253f952821384bc8820abea27482bda6%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/253f952821384bc8820abea27482bda6/images/large/6.jpg saved to cache
2026-03-26 22:54:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4d21a3c6-1f65-5cd1-b250-9745fef5b789
2026-03-26 22:54:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7688890>
2026-03-26 22:54:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f19dff6-09d0-5024-b64c-2157ab8048d4/7f19dff6-09d0-5024-b64c-2157ab8048d4_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252Fdbfa9f3e6a674da3b86d17cb81860c57%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/dbfa9f3e6a674da3b86d17cb81860c57/images/large/2.jpg saved to cache
2026-03-26 22:54:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7f19dff6-09d0-5024-b64c-2157ab8048d4
2026-03-26 22:54:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e4e610>
2026-03-26 22:54:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d21a3c6-1f65-5cd1-b250-9745fef5b789/4d21a3c6-1f65-5cd1-b250-9745fef5b789_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F253f952821384bc8820abea27482bda6%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/253f952821384bc8820abea27482bda6/images/large/10.jpg saved to cache
2026-03-26 22:54:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4d21a3c6-1f65-5cd1-b250-9745fef5b789
2026-03-26 22:54:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd46d850>
2026-03-26 22:54:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f19dff6-09d0-5024-b64c-2157ab8048d4/7f19dff6-09d0-5024-b64c-2157ab8048d4_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252Fdbfa9f3e6a674da3b86d17cb81860c57%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/dbfa9f3e6a674da3b86d17cb81860c57/images/large/1.jpg saved to cache
2026-03-26 22:54:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7f19dff6-09d0-5024-b64c-2157ab8048d4
2026-03-26 22:54:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74cfd90>
2026-03-26 22:54:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d21a3c6-1f65-5cd1-b250-9745fef5b789/4d21a3c6-1f65-5cd1-b250-9745fef5b789_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F253f952821384bc8820abea27482bda6%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/253f952821384bc8820abea27482bda6/images/large/9.jpg saved to cache
2026-03-26 22:54:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4d21a3c6-1f65-5cd1-b250-9745fef5b789
2026-03-26 22:54:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e1e650>
2026-03-26 22:54:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d21a3c6-1f65-5cd1-b250-9745fef5b789/4d21a3c6-1f65-5cd1-b250-9745fef5b789_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F253f952821384bc8820abea27482bda6%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/253f952821384bc8820abea27482bda6/images/large/8.jpg saved to cache
2026-03-26 22:54:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4d21a3c6-1f65-5cd1-b250-9745fef5b789
2026-03-26 22:54:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4d21a3c6-1f65-5cd1-b250-9745fef5b789, skipping ID generation
2026-03-26 22:54:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d21a3c6-1f65-5cd1-b250-9745fef5b789 with scrape type 1
2026-03-26 22:54:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4d21a3c6-1f65-5cd1-b250-9745fef5b789 sending to next pipeline
2026-03-26 22:54:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 4d21a3c6-1f65-5cd1-b250-9745fef5b789, identifier: 1985552
2026-03-26 22:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F6e078c09ad4b4122b05ed4a4d20ad32c%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/6e078c09ad4b4122b05ed4a4d20ad32c/images/large/10.jpg not downloaded yet
2026-03-26 22:54:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 4d21a3c6-1f65-5cd1-b250-9745fef5b789 with identifier: 1985552
2026-03-26 22:54:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 4d21a3c6-1f65-5cd1-b250-9745fef5b789 with identifier: 1985552
2026-03-26 22:54:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 4d21a3c6-1f65-5cd1-b250-9745fef5b789 with identifier: 1985552 to the API
2026-03-26 22:54:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:54:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:54:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yx/253f952821384bc8820abea27482bda6/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '4d21a3c6-1f65-5cd1-b250-9745fef5b789',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X3 - 2018',
 'odometer': 192617,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d21a3c6-1f65-5cd1-b250-9745fef5b789/4d21a3c6-1f65-5cd1-b250-9745fef5b789_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 678052,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/253f952821384bc8820abea27482bda6/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d21a3c6-1f65-5cd1-b250-9745fef5b789/4d21a3c6-1f65-5cd1-b250-9745fef5b789_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 731218,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/253f952821384bc8820abea27482bda6/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d21a3c6-1f65-5cd1-b250-9745fef5b789/4d21a3c6-1f65-5cd1-b250-9745fef5b789_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 730342,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/253f952821384bc8820abea27482bda6/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d21a3c6-1f65-5cd1-b250-9745fef5b789/4d21a3c6-1f65-5cd1-b250-9745fef5b789_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 783363,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/253f952821384bc8820abea27482bda6/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d21a3c6-1f65-5cd1-b250-9745fef5b789/4d21a3c6-1f65-5cd1-b250-9745fef5b789_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 731234,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/253f952821384bc8820abea27482bda6/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d21a3c6-1f65-5cd1-b250-9745fef5b789/4d21a3c6-1f65-5cd1-b250-9745fef5b789_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 741416,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/253f952821384bc8820abea27482bda6/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d21a3c6-1f65-5cd1-b250-9745fef5b789/4d21a3c6-1f65-5cd1-b250-9745fef5b789_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 568968,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/253f952821384bc8820abea27482bda6/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d21a3c6-1f65-5cd1-b250-9745fef5b789/4d21a3c6-1f65-5cd1-b250-9745fef5b789_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 865804,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/253f952821384bc8820abea27482bda6/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d21a3c6-1f65-5cd1-b250-9745fef5b789/4d21a3c6-1f65-5cd1-b250-9745fef5b789_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 857095,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/253f952821384bc8820abea27482bda6/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d21a3c6-1f65-5cd1-b250-9745fef5b789/4d21a3c6-1f65-5cd1-b250-9745fef5b789_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 611956,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/253f952821384bc8820abea27482bda6/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X3 - 2018 2.0iA xDrive30e PHEV OPF',
 'transmission': 'automatic',
 'trim': '2.0iA xDrive30e PHEV OPF',
 'vin': None,
 'year': 2021}
2026-03-26 22:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985552%27 HTTP/1.1" 200 None
2026-03-26 22:54:46 [ayvens.be] INFO: Saving data for 1985552: {'created_time': 1774565686.977869, 'last_price_update_time': 1774565686.977878, 'auction_closing_time': 1774958400.0}
2026-03-26 22:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985552') HTTP/1.1" 204 0
2026-03-26 22:54:47 [ayvens.be] INFO: Found listing with ID: 1985555
2026-03-26 22:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985555%27 HTTP/1.1" 200 None
2026-03-26 22:54:47 [ayvens.be] INFO: Scrape type for 1985555: 1
2026-03-26 22:54:47 [ayvens.be] INFO: Extracting data for car ID: 1985555
2026-03-26 22:54:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ec46de6-e866-5be7-9224-6fd57651e59d with identifier: 1985555
2026-03-26 22:54:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ec46de6-e866-5be7-9224-6fd57651e59d with scrape type 1
2026-03-26 22:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4ec46de6-e866-5be7-9224-6fd57651e59d
2026-03-26 22:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252F29f6cb8f2c174d0ebdf8b91d7b4d4575%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/29f6cb8f2c174d0ebdf8b91d7b4d4575/images/large/1.jpg not downloaded yet
2026-03-26 22:54:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/dbfa9f3e6a674da3b86d17cb81860c57/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252F29f6cb8f2c174d0ebdf8b91d7b4d4575%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/29f6cb8f2c174d0ebdf8b91d7b4d4575/images/large/2.jpg not downloaded yet
2026-03-26 22:54:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/dbfa9f3e6a674da3b86d17cb81860c57/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/dbfa9f3e6a674da3b86d17cb81860c57/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252F29f6cb8f2c174d0ebdf8b91d7b4d4575%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/29f6cb8f2c174d0ebdf8b91d7b4d4575/images/large/3.jpg not downloaded yet
2026-03-26 22:54:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/dbfa9f3e6a674da3b86d17cb81860c57/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/dbfa9f3e6a674da3b86d17cb81860c57/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252F29f6cb8f2c174d0ebdf8b91d7b4d4575%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/29f6cb8f2c174d0ebdf8b91d7b4d4575/images/large/4.jpg not downloaded yet
2026-03-26 22:54:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/dbfa9f3e6a674da3b86d17cb81860c57/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252F29f6cb8f2c174d0ebdf8b91d7b4d4575%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/29f6cb8f2c174d0ebdf8b91d7b4d4575/images/large/5.jpg not downloaded yet
2026-03-26 22:54:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/dbfa9f3e6a674da3b86d17cb81860c57/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/dbfa9f3e6a674da3b86d17cb81860c57/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252F29f6cb8f2c174d0ebdf8b91d7b4d4575%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/29f6cb8f2c174d0ebdf8b91d7b4d4575/images/large/6.jpg not downloaded yet
2026-03-26 22:54:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b75a7150>
2026-03-26 22:54:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f19dff6-09d0-5024-b64c-2157ab8048d4/7f19dff6-09d0-5024-b64c-2157ab8048d4_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252Fdbfa9f3e6a674da3b86d17cb81860c57%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/dbfa9f3e6a674da3b86d17cb81860c57/images/large/3.jpg saved to cache
2026-03-26 22:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7f19dff6-09d0-5024-b64c-2157ab8048d4
2026-03-26 22:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252F29f6cb8f2c174d0ebdf8b91d7b4d4575%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/29f6cb8f2c174d0ebdf8b91d7b4d4575/images/large/7.jpg not downloaded yet
2026-03-26 22:54:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b75a4650>
2026-03-26 22:54:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f19dff6-09d0-5024-b64c-2157ab8048d4/7f19dff6-09d0-5024-b64c-2157ab8048d4_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252Fdbfa9f3e6a674da3b86d17cb81860c57%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/dbfa9f3e6a674da3b86d17cb81860c57/images/large/4.jpg saved to cache
2026-03-26 22:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7f19dff6-09d0-5024-b64c-2157ab8048d4
2026-03-26 22:54:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c68a50>
2026-03-26 22:54:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f19dff6-09d0-5024-b64c-2157ab8048d4/7f19dff6-09d0-5024-b64c-2157ab8048d4_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252Fdbfa9f3e6a674da3b86d17cb81860c57%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/dbfa9f3e6a674da3b86d17cb81860c57/images/large/5.jpg saved to cache
2026-03-26 22:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7f19dff6-09d0-5024-b64c-2157ab8048d4
2026-03-26 22:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252F29f6cb8f2c174d0ebdf8b91d7b4d4575%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/29f6cb8f2c174d0ebdf8b91d7b4d4575/images/large/8.jpg not downloaded yet
2026-03-26 22:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252F29f6cb8f2c174d0ebdf8b91d7b4d4575%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/29f6cb8f2c174d0ebdf8b91d7b4d4575/images/large/9.jpg not downloaded yet
2026-03-26 22:54:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74e74d0>
2026-03-26 22:54:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f19dff6-09d0-5024-b64c-2157ab8048d4/7f19dff6-09d0-5024-b64c-2157ab8048d4_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252Fdbfa9f3e6a674da3b86d17cb81860c57%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/dbfa9f3e6a674da3b86d17cb81860c57/images/large/7.jpg saved to cache
2026-03-26 22:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7f19dff6-09d0-5024-b64c-2157ab8048d4
2026-03-26 22:54:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7aa3850>
2026-03-26 22:54:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f19dff6-09d0-5024-b64c-2157ab8048d4/7f19dff6-09d0-5024-b64c-2157ab8048d4_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252Fdbfa9f3e6a674da3b86d17cb81860c57%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/dbfa9f3e6a674da3b86d17cb81860c57/images/large/10.jpg saved to cache
2026-03-26 22:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7f19dff6-09d0-5024-b64c-2157ab8048d4
2026-03-26 22:54:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b15f10>
2026-03-26 22:54:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f19dff6-09d0-5024-b64c-2157ab8048d4/7f19dff6-09d0-5024-b64c-2157ab8048d4_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252Fdbfa9f3e6a674da3b86d17cb81860c57%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/dbfa9f3e6a674da3b86d17cb81860c57/images/large/6.jpg saved to cache
2026-03-26 22:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7f19dff6-09d0-5024-b64c-2157ab8048d4
2026-03-26 22:54:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd5b2dd0>
2026-03-26 22:54:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f19dff6-09d0-5024-b64c-2157ab8048d4/7f19dff6-09d0-5024-b64c-2157ab8048d4_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252Fdbfa9f3e6a674da3b86d17cb81860c57%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/dbfa9f3e6a674da3b86d17cb81860c57/images/large/8.jpg saved to cache
2026-03-26 22:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7f19dff6-09d0-5024-b64c-2157ab8048d4
2026-03-26 22:54:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7429e50>
2026-03-26 22:54:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f19dff6-09d0-5024-b64c-2157ab8048d4/7f19dff6-09d0-5024-b64c-2157ab8048d4_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252Fdbfa9f3e6a674da3b86d17cb81860c57%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/dbfa9f3e6a674da3b86d17cb81860c57/images/large/9.jpg saved to cache
2026-03-26 22:54:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7f19dff6-09d0-5024-b64c-2157ab8048d4
2026-03-26 22:54:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7f19dff6-09d0-5024-b64c-2157ab8048d4, skipping ID generation
2026-03-26 22:54:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f19dff6-09d0-5024-b64c-2157ab8048d4 with scrape type 1
2026-03-26 22:54:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7f19dff6-09d0-5024-b64c-2157ab8048d4 sending to next pipeline
2026-03-26 22:54:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 7f19dff6-09d0-5024-b64c-2157ab8048d4, identifier: 1985553
2026-03-26 22:54:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/6e078c09ad4b4122b05ed4a4d20ad32c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 7f19dff6-09d0-5024-b64c-2157ab8048d4 with identifier: 1985553
2026-03-26 22:54:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 7f19dff6-09d0-5024-b64c-2157ab8048d4 with identifier: 1985553
2026-03-26 22:54:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 7f19dff6-09d0-5024-b64c-2157ab8048d4 with identifier: 1985553 to the API
2026-03-26 22:54:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:54:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:54:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cp/dbfa9f3e6a674da3b86d17cb81860c57/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '7f19dff6-09d0-5024-b64c-2157ab8048d4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLA SHOOTING BRAKE',
 'odometer': 47509,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 19,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f19dff6-09d0-5024-b64c-2157ab8048d4/7f19dff6-09d0-5024-b64c-2157ab8048d4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 526327,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/dbfa9f3e6a674da3b86d17cb81860c57/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f19dff6-09d0-5024-b64c-2157ab8048d4/7f19dff6-09d0-5024-b64c-2157ab8048d4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 489973,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/dbfa9f3e6a674da3b86d17cb81860c57/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f19dff6-09d0-5024-b64c-2157ab8048d4/7f19dff6-09d0-5024-b64c-2157ab8048d4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 560683,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/dbfa9f3e6a674da3b86d17cb81860c57/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f19dff6-09d0-5024-b64c-2157ab8048d4/7f19dff6-09d0-5024-b64c-2157ab8048d4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 550904,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/dbfa9f3e6a674da3b86d17cb81860c57/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f19dff6-09d0-5024-b64c-2157ab8048d4/7f19dff6-09d0-5024-b64c-2157ab8048d4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 564281,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/dbfa9f3e6a674da3b86d17cb81860c57/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f19dff6-09d0-5024-b64c-2157ab8048d4/7f19dff6-09d0-5024-b64c-2157ab8048d4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 764713,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/dbfa9f3e6a674da3b86d17cb81860c57/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f19dff6-09d0-5024-b64c-2157ab8048d4/7f19dff6-09d0-5024-b64c-2157ab8048d4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 738979,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/dbfa9f3e6a674da3b86d17cb81860c57/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f19dff6-09d0-5024-b64c-2157ab8048d4/7f19dff6-09d0-5024-b64c-2157ab8048d4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 869082,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/dbfa9f3e6a674da3b86d17cb81860c57/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f19dff6-09d0-5024-b64c-2157ab8048d4/7f19dff6-09d0-5024-b64c-2157ab8048d4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 887547,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/dbfa9f3e6a674da3b86d17cb81860c57/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f19dff6-09d0-5024-b64c-2157ab8048d4/7f19dff6-09d0-5024-b64c-2157ab8048d4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 654011,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/dbfa9f3e6a674da3b86d17cb81860c57/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLA SHOOTING BRAKE 2.0 CLA 180 D BUS SOLUTION '
          'ESSENTIAL',
 'transmission': 'manual',
 'trim': '2.0 CLA 180 D BUS SOLUTION ESSENTIAL',
 'vin': None,
 'year': 2022}
2026-03-26 22:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985553%27 HTTP/1.1" 200 None
2026-03-26 22:54:48 [ayvens.be] INFO: Saving data for 1985553: {'created_time': 1774565688.427289, 'last_price_update_time': 1774565688.427299, 'auction_closing_time': 1774958400.0}
2026-03-26 22:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985553') HTTP/1.1" 204 0
2026-03-26 22:54:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/6e078c09ad4b4122b05ed4a4d20ad32c/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/6e078c09ad4b4122b05ed4a4d20ad32c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/6e078c09ad4b4122b05ed4a4d20ad32c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252F29f6cb8f2c174d0ebdf8b91d7b4d4575%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/29f6cb8f2c174d0ebdf8b91d7b4d4575/images/large/10.jpg not downloaded yet
2026-03-26 22:54:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/6e078c09ad4b4122b05ed4a4d20ad32c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/6e078c09ad4b4122b05ed4a4d20ad32c/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:48 [ayvens.be] INFO: Found listing with ID: 1985556
2026-03-26 22:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985556%27 HTTP/1.1" 200 None
2026-03-26 22:54:48 [ayvens.be] INFO: Scrape type for 1985556: 1
2026-03-26 22:54:48 [ayvens.be] INFO: Extracting data for car ID: 1985556
2026-03-26 22:54:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0bc6fecf-167b-51eb-acbf-41d488f8f507 with identifier: 1985556
2026-03-26 22:54:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0bc6fecf-167b-51eb-acbf-41d488f8f507 with scrape type 1
2026-03-26 22:54:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0bc6fecf-167b-51eb-acbf-41d488f8f507
2026-03-26 22:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F6ec3973bf16841ad9239e14dcdaf2fcd%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/6ec3973bf16841ad9239e14dcdaf2fcd/images/large/1.jpg not downloaded yet
2026-03-26 22:54:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/6e078c09ad4b4122b05ed4a4d20ad32c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/6e078c09ad4b4122b05ed4a4d20ad32c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76492d0>
2026-03-26 22:54:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71689947-0945-541e-84e9-3ae7080dcfea/71689947-0945-541e-84e9-3ae7080dcfea_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F6e078c09ad4b4122b05ed4a4d20ad32c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/6e078c09ad4b4122b05ed4a4d20ad32c/images/large/2.jpg saved to cache
2026-03-26 22:54:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 71689947-0945-541e-84e9-3ae7080dcfea
2026-03-26 22:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F6ec3973bf16841ad9239e14dcdaf2fcd%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/6ec3973bf16841ad9239e14dcdaf2fcd/images/large/2.jpg not downloaded yet
2026-03-26 22:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F6ec3973bf16841ad9239e14dcdaf2fcd%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/6ec3973bf16841ad9239e14dcdaf2fcd/images/large/3.jpg not downloaded yet
2026-03-26 22:54:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b792d250>
2026-03-26 22:54:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71689947-0945-541e-84e9-3ae7080dcfea/71689947-0945-541e-84e9-3ae7080dcfea_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F6e078c09ad4b4122b05ed4a4d20ad32c%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/6e078c09ad4b4122b05ed4a4d20ad32c/images/large/9.jpg saved to cache
2026-03-26 22:54:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 71689947-0945-541e-84e9-3ae7080dcfea
2026-03-26 22:54:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b78a9290>
2026-03-26 22:54:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71689947-0945-541e-84e9-3ae7080dcfea/71689947-0945-541e-84e9-3ae7080dcfea_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F6e078c09ad4b4122b05ed4a4d20ad32c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/6e078c09ad4b4122b05ed4a4d20ad32c/images/large/8.jpg saved to cache
2026-03-26 22:54:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 71689947-0945-541e-84e9-3ae7080dcfea
2026-03-26 22:54:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7662bd0>
2026-03-26 22:54:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71689947-0945-541e-84e9-3ae7080dcfea/71689947-0945-541e-84e9-3ae7080dcfea_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F6e078c09ad4b4122b05ed4a4d20ad32c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/6e078c09ad4b4122b05ed4a4d20ad32c/images/large/6.jpg saved to cache
2026-03-26 22:54:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 71689947-0945-541e-84e9-3ae7080dcfea
2026-03-26 22:54:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79a5510>
2026-03-26 22:54:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71689947-0945-541e-84e9-3ae7080dcfea/71689947-0945-541e-84e9-3ae7080dcfea_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F6e078c09ad4b4122b05ed4a4d20ad32c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/6e078c09ad4b4122b05ed4a4d20ad32c/images/large/3.jpg saved to cache
2026-03-26 22:54:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 71689947-0945-541e-84e9-3ae7080dcfea
2026-03-26 22:54:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6dd9dd0>
2026-03-26 22:54:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71689947-0945-541e-84e9-3ae7080dcfea/71689947-0945-541e-84e9-3ae7080dcfea_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F6e078c09ad4b4122b05ed4a4d20ad32c%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/6e078c09ad4b4122b05ed4a4d20ad32c/images/large/10.jpg saved to cache
2026-03-26 22:54:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 71689947-0945-541e-84e9-3ae7080dcfea
2026-03-26 22:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F6ec3973bf16841ad9239e14dcdaf2fcd%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/6ec3973bf16841ad9239e14dcdaf2fcd/images/large/4.jpg not downloaded yet
2026-03-26 22:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F6ec3973bf16841ad9239e14dcdaf2fcd%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/6ec3973bf16841ad9239e14dcdaf2fcd/images/large/5.jpg not downloaded yet
2026-03-26 22:54:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6d73350>
2026-03-26 22:54:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71689947-0945-541e-84e9-3ae7080dcfea/71689947-0945-541e-84e9-3ae7080dcfea_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F6e078c09ad4b4122b05ed4a4d20ad32c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/6e078c09ad4b4122b05ed4a4d20ad32c/images/large/1.jpg saved to cache
2026-03-26 22:54:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 71689947-0945-541e-84e9-3ae7080dcfea
2026-03-26 22:54:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77ad850>
2026-03-26 22:54:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71689947-0945-541e-84e9-3ae7080dcfea/71689947-0945-541e-84e9-3ae7080dcfea_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F6e078c09ad4b4122b05ed4a4d20ad32c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/6e078c09ad4b4122b05ed4a4d20ad32c/images/large/7.jpg saved to cache
2026-03-26 22:54:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 71689947-0945-541e-84e9-3ae7080dcfea
2026-03-26 22:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F6ec3973bf16841ad9239e14dcdaf2fcd%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/6ec3973bf16841ad9239e14dcdaf2fcd/images/large/6.jpg not downloaded yet
2026-03-26 22:54:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/6e078c09ad4b4122b05ed4a4d20ad32c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/6e078c09ad4b4122b05ed4a4d20ad32c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F6ec3973bf16841ad9239e14dcdaf2fcd%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/6ec3973bf16841ad9239e14dcdaf2fcd/images/large/7.jpg not downloaded yet
2026-03-26 22:54:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ds/29f6cb8f2c174d0ebdf8b91d7b4d4575/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F6ec3973bf16841ad9239e14dcdaf2fcd%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/6ec3973bf16841ad9239e14dcdaf2fcd/images/large/8.jpg not downloaded yet
2026-03-26 22:54:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ds/29f6cb8f2c174d0ebdf8b91d7b4d4575/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ds/29f6cb8f2c174d0ebdf8b91d7b4d4575/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ds/29f6cb8f2c174d0ebdf8b91d7b4d4575/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F6ec3973bf16841ad9239e14dcdaf2fcd%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/6ec3973bf16841ad9239e14dcdaf2fcd/images/large/9.jpg not downloaded yet
2026-03-26 22:54:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ds/29f6cb8f2c174d0ebdf8b91d7b4d4575/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ds/29f6cb8f2c174d0ebdf8b91d7b4d4575/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F6ec3973bf16841ad9239e14dcdaf2fcd%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/6ec3973bf16841ad9239e14dcdaf2fcd/images/large/10.jpg not downloaded yet
2026-03-26 22:54:49 [ayvens.be] INFO: Found listing with ID: 1985557
2026-03-26 22:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985557%27 HTTP/1.1" 200 None
2026-03-26 22:54:49 [ayvens.be] INFO: Scrape type for 1985557: 1
2026-03-26 22:54:49 [ayvens.be] INFO: Extracting data for car ID: 1985557
2026-03-26 22:54:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e64cf68-a5f0-53b0-94d5-05c292bbbcea with identifier: 1985557
2026-03-26 22:54:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e64cf68-a5f0-53b0-94d5-05c292bbbcea with scrape type 1
2026-03-26 22:54:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1e64cf68-a5f0-53b0-94d5-05c292bbbcea
2026-03-26 22:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F1b708eb7ee0d4b2d942b83723313d2eb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/1b708eb7ee0d4b2d942b83723313d2eb/images/large/1.jpg not downloaded yet
2026-03-26 22:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F1b708eb7ee0d4b2d942b83723313d2eb%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/1b708eb7ee0d4b2d942b83723313d2eb/images/large/2.jpg not downloaded yet
2026-03-26 22:54:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b740b710>
2026-03-26 22:54:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71689947-0945-541e-84e9-3ae7080dcfea/71689947-0945-541e-84e9-3ae7080dcfea_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F6e078c09ad4b4122b05ed4a4d20ad32c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/6e078c09ad4b4122b05ed4a4d20ad32c/images/large/4.jpg saved to cache
2026-03-26 22:54:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 71689947-0945-541e-84e9-3ae7080dcfea
2026-03-26 22:54:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b788c2d0>
2026-03-26 22:54:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71689947-0945-541e-84e9-3ae7080dcfea/71689947-0945-541e-84e9-3ae7080dcfea_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F6e078c09ad4b4122b05ed4a4d20ad32c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/6e078c09ad4b4122b05ed4a4d20ad32c/images/large/5.jpg saved to cache
2026-03-26 22:54:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 71689947-0945-541e-84e9-3ae7080dcfea
2026-03-26 22:54:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 71689947-0945-541e-84e9-3ae7080dcfea, skipping ID generation
2026-03-26 22:54:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71689947-0945-541e-84e9-3ae7080dcfea with scrape type 1
2026-03-26 22:54:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 71689947-0945-541e-84e9-3ae7080dcfea sending to next pipeline
2026-03-26 22:54:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 71689947-0945-541e-84e9-3ae7080dcfea, identifier: 1985554
2026-03-26 22:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F1b708eb7ee0d4b2d942b83723313d2eb%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/1b708eb7ee0d4b2d942b83723313d2eb/images/large/3.jpg not downloaded yet
2026-03-26 22:54:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 71689947-0945-541e-84e9-3ae7080dcfea with identifier: 1985554
2026-03-26 22:54:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 71689947-0945-541e-84e9-3ae7080dcfea with identifier: 1985554
2026-03-26 22:54:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 71689947-0945-541e-84e9-3ae7080dcfea with identifier: 1985554 to the API
2026-03-26 22:54:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:54:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:54:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bk/6e078c09ad4b4122b05ed4a4d20ad32c/images/large/5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '71689947-0945-541e-84e9-3ae7080dcfea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A5 SPORTBACK',
 'odometer': 144429,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71689947-0945-541e-84e9-3ae7080dcfea/71689947-0945-541e-84e9-3ae7080dcfea_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 616532,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/6e078c09ad4b4122b05ed4a4d20ad32c/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71689947-0945-541e-84e9-3ae7080dcfea/71689947-0945-541e-84e9-3ae7080dcfea_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 493599,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/6e078c09ad4b4122b05ed4a4d20ad32c/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71689947-0945-541e-84e9-3ae7080dcfea/71689947-0945-541e-84e9-3ae7080dcfea_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 543438,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/6e078c09ad4b4122b05ed4a4d20ad32c/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71689947-0945-541e-84e9-3ae7080dcfea/71689947-0945-541e-84e9-3ae7080dcfea_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 572301,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/6e078c09ad4b4122b05ed4a4d20ad32c/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71689947-0945-541e-84e9-3ae7080dcfea/71689947-0945-541e-84e9-3ae7080dcfea_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 477467,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/6e078c09ad4b4122b05ed4a4d20ad32c/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71689947-0945-541e-84e9-3ae7080dcfea/71689947-0945-541e-84e9-3ae7080dcfea_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 376034,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/6e078c09ad4b4122b05ed4a4d20ad32c/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71689947-0945-541e-84e9-3ae7080dcfea/71689947-0945-541e-84e9-3ae7080dcfea_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 569699,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/6e078c09ad4b4122b05ed4a4d20ad32c/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71689947-0945-541e-84e9-3ae7080dcfea/71689947-0945-541e-84e9-3ae7080dcfea_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 381726,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/6e078c09ad4b4122b05ed4a4d20ad32c/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71689947-0945-541e-84e9-3ae7080dcfea/71689947-0945-541e-84e9-3ae7080dcfea_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 338589,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/6e078c09ad4b4122b05ed4a4d20ad32c/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71689947-0945-541e-84e9-3ae7080dcfea/71689947-0945-541e-84e9-3ae7080dcfea_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 453752,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/6e078c09ad4b4122b05ed4a4d20ad32c/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-21',
 'seats_number': 4,
 'seller_name': None,
 'title': 'AUDI A5 SPORTBACK 2.0 30 TDI S TRONIC BUS. ED.',
 'transmission': 'automatic',
 'trim': '2.0 30 TDI S TRONIC BUS. ED.',
 'vin': None,
 'year': 2021}
2026-03-26 22:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985554%27 HTTP/1.1" 200 None
2026-03-26 22:54:49 [ayvens.be] INFO: Saving data for 1985554: {'created_time': 1774565689.997854, 'last_price_update_time': 1774565689.997863, 'auction_closing_time': 1774958400.0}
2026-03-26 22:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985554') HTTP/1.1" 204 0
2026-03-26 22:54:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6d83a10>
2026-03-26 22:54:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ec46de6-e866-5be7-9224-6fd57651e59d/4ec46de6-e866-5be7-9224-6fd57651e59d_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252F29f6cb8f2c174d0ebdf8b91d7b4d4575%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/29f6cb8f2c174d0ebdf8b91d7b4d4575/images/large/3.jpg saved to cache
2026-03-26 22:54:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4ec46de6-e866-5be7-9224-6fd57651e59d
2026-03-26 22:54:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6d80c10>
2026-03-26 22:54:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ec46de6-e866-5be7-9224-6fd57651e59d/4ec46de6-e866-5be7-9224-6fd57651e59d_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252F29f6cb8f2c174d0ebdf8b91d7b4d4575%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/29f6cb8f2c174d0ebdf8b91d7b4d4575/images/large/2.jpg saved to cache
2026-03-26 22:54:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4ec46de6-e866-5be7-9224-6fd57651e59d
2026-03-26 22:54:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76891d0>
2026-03-26 22:54:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ec46de6-e866-5be7-9224-6fd57651e59d/4ec46de6-e866-5be7-9224-6fd57651e59d_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252F29f6cb8f2c174d0ebdf8b91d7b4d4575%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/29f6cb8f2c174d0ebdf8b91d7b4d4575/images/large/1.jpg saved to cache
2026-03-26 22:54:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4ec46de6-e866-5be7-9224-6fd57651e59d
2026-03-26 22:54:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e1e410>
2026-03-26 22:54:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ec46de6-e866-5be7-9224-6fd57651e59d/4ec46de6-e866-5be7-9224-6fd57651e59d_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252F29f6cb8f2c174d0ebdf8b91d7b4d4575%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/29f6cb8f2c174d0ebdf8b91d7b4d4575/images/large/7.jpg saved to cache
2026-03-26 22:54:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4ec46de6-e866-5be7-9224-6fd57651e59d
2026-03-26 22:54:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7689c10>
2026-03-26 22:54:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ec46de6-e866-5be7-9224-6fd57651e59d/4ec46de6-e866-5be7-9224-6fd57651e59d_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252F29f6cb8f2c174d0ebdf8b91d7b4d4575%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/29f6cb8f2c174d0ebdf8b91d7b4d4575/images/large/8.jpg saved to cache
2026-03-26 22:54:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4ec46de6-e866-5be7-9224-6fd57651e59d
2026-03-26 22:54:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6da7350>
2026-03-26 22:54:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ec46de6-e866-5be7-9224-6fd57651e59d/4ec46de6-e866-5be7-9224-6fd57651e59d_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252F29f6cb8f2c174d0ebdf8b91d7b4d4575%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/29f6cb8f2c174d0ebdf8b91d7b4d4575/images/large/6.jpg saved to cache
2026-03-26 22:54:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4ec46de6-e866-5be7-9224-6fd57651e59d
2026-03-26 22:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F1b708eb7ee0d4b2d942b83723313d2eb%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/1b708eb7ee0d4b2d942b83723313d2eb/images/large/4.jpg not downloaded yet
2026-03-26 22:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F1b708eb7ee0d4b2d942b83723313d2eb%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/1b708eb7ee0d4b2d942b83723313d2eb/images/large/5.jpg not downloaded yet
2026-03-26 22:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F1b708eb7ee0d4b2d942b83723313d2eb%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/1b708eb7ee0d4b2d942b83723313d2eb/images/large/6.jpg not downloaded yet
2026-03-26 22:54:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ds/29f6cb8f2c174d0ebdf8b91d7b4d4575/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F1b708eb7ee0d4b2d942b83723313d2eb%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/1b708eb7ee0d4b2d942b83723313d2eb/images/large/7.jpg not downloaded yet
2026-03-26 22:54:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ds/29f6cb8f2c174d0ebdf8b91d7b4d4575/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ds/29f6cb8f2c174d0ebdf8b91d7b4d4575/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/6ec3973bf16841ad9239e14dcdaf2fcd/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/6ec3973bf16841ad9239e14dcdaf2fcd/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F1b708eb7ee0d4b2d942b83723313d2eb%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/1b708eb7ee0d4b2d942b83723313d2eb/images/large/8.jpg not downloaded yet
2026-03-26 22:54:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ds/29f6cb8f2c174d0ebdf8b91d7b4d4575/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/6ec3973bf16841ad9239e14dcdaf2fcd/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F1b708eb7ee0d4b2d942b83723313d2eb%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/1b708eb7ee0d4b2d942b83723313d2eb/images/large/9.jpg not downloaded yet
2026-03-26 22:54:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/6ec3973bf16841ad9239e14dcdaf2fcd/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F1b708eb7ee0d4b2d942b83723313d2eb%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/1b708eb7ee0d4b2d942b83723313d2eb/images/large/10.jpg not downloaded yet
2026-03-26 22:54:50 [ayvens.be] INFO: Found listing with ID: 1985558
2026-03-26 22:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985558%27 HTTP/1.1" 200 None
2026-03-26 22:54:50 [ayvens.be] INFO: Scrape type for 1985558: 1
2026-03-26 22:54:50 [ayvens.be] INFO: Extracting data for car ID: 1985558
2026-03-26 22:54:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 09004bbc-6359-535b-a99e-b8b1fb675399 with identifier: 1985558
2026-03-26 22:54:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09004bbc-6359-535b-a99e-b8b1fb675399 with scrape type 1
2026-03-26 22:54:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 09004bbc-6359-535b-a99e-b8b1fb675399
2026-03-26 22:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F3d81ea4c2f094feca79443de9ceb5b82%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/3d81ea4c2f094feca79443de9ceb5b82/images/large/1.jpg not downloaded yet
2026-03-26 22:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F3d81ea4c2f094feca79443de9ceb5b82%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/3d81ea4c2f094feca79443de9ceb5b82/images/large/2.jpg not downloaded yet
2026-03-26 22:54:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77ad690>
2026-03-26 22:54:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ec46de6-e866-5be7-9224-6fd57651e59d/4ec46de6-e866-5be7-9224-6fd57651e59d_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252F29f6cb8f2c174d0ebdf8b91d7b4d4575%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/29f6cb8f2c174d0ebdf8b91d7b4d4575/images/large/5.jpg saved to cache
2026-03-26 22:54:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4ec46de6-e866-5be7-9224-6fd57651e59d
2026-03-26 22:54:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b75914d0>
2026-03-26 22:54:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ec46de6-e866-5be7-9224-6fd57651e59d/4ec46de6-e866-5be7-9224-6fd57651e59d_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252F29f6cb8f2c174d0ebdf8b91d7b4d4575%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/29f6cb8f2c174d0ebdf8b91d7b4d4575/images/large/4.jpg saved to cache
2026-03-26 22:54:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4ec46de6-e866-5be7-9224-6fd57651e59d
2026-03-26 22:54:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b792da10>
2026-03-26 22:54:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ec46de6-e866-5be7-9224-6fd57651e59d/4ec46de6-e866-5be7-9224-6fd57651e59d_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252F29f6cb8f2c174d0ebdf8b91d7b4d4575%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/29f6cb8f2c174d0ebdf8b91d7b4d4575/images/large/10.jpg saved to cache
2026-03-26 22:54:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4ec46de6-e866-5be7-9224-6fd57651e59d
2026-03-26 22:54:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b792d950>
2026-03-26 22:54:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0bc6fecf-167b-51eb-acbf-41d488f8f507/0bc6fecf-167b-51eb-acbf-41d488f8f507_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F6ec3973bf16841ad9239e14dcdaf2fcd%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/6ec3973bf16841ad9239e14dcdaf2fcd/images/large/1.jpg saved to cache
2026-03-26 22:54:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0bc6fecf-167b-51eb-acbf-41d488f8f507
2026-03-26 22:54:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7494a50>
2026-03-26 22:54:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0bc6fecf-167b-51eb-acbf-41d488f8f507/0bc6fecf-167b-51eb-acbf-41d488f8f507_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F6ec3973bf16841ad9239e14dcdaf2fcd%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/6ec3973bf16841ad9239e14dcdaf2fcd/images/large/2.jpg saved to cache
2026-03-26 22:54:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0bc6fecf-167b-51eb-acbf-41d488f8f507
2026-03-26 22:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F3d81ea4c2f094feca79443de9ceb5b82%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/3d81ea4c2f094feca79443de9ceb5b82/images/large/3.jpg not downloaded yet
2026-03-26 22:54:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd497510>
2026-03-26 22:54:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ec46de6-e866-5be7-9224-6fd57651e59d/4ec46de6-e866-5be7-9224-6fd57651e59d_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252F29f6cb8f2c174d0ebdf8b91d7b4d4575%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/29f6cb8f2c174d0ebdf8b91d7b4d4575/images/large/9.jpg saved to cache
2026-03-26 22:54:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4ec46de6-e866-5be7-9224-6fd57651e59d
2026-03-26 22:54:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4ec46de6-e866-5be7-9224-6fd57651e59d, skipping ID generation
2026-03-26 22:54:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ec46de6-e866-5be7-9224-6fd57651e59d with scrape type 1
2026-03-26 22:54:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4ec46de6-e866-5be7-9224-6fd57651e59d sending to next pipeline
2026-03-26 22:54:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 4ec46de6-e866-5be7-9224-6fd57651e59d, identifier: 1985555
2026-03-26 22:54:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74ce050>
2026-03-26 22:54:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0bc6fecf-167b-51eb-acbf-41d488f8f507/0bc6fecf-167b-51eb-acbf-41d488f8f507_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F6ec3973bf16841ad9239e14dcdaf2fcd%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/6ec3973bf16841ad9239e14dcdaf2fcd/images/large/3.jpg saved to cache
2026-03-26 22:54:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0bc6fecf-167b-51eb-acbf-41d488f8f507
2026-03-26 22:54:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/1b708eb7ee0d4b2d942b83723313d2eb/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F3d81ea4c2f094feca79443de9ceb5b82%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/3d81ea4c2f094feca79443de9ceb5b82/images/large/4.jpg not downloaded yet
2026-03-26 22:54:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 4ec46de6-e866-5be7-9224-6fd57651e59d with identifier: 1985555
2026-03-26 22:54:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 4ec46de6-e866-5be7-9224-6fd57651e59d with identifier: 1985555
2026-03-26 22:54:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 4ec46de6-e866-5be7-9224-6fd57651e59d with identifier: 1985555 to the API
2026-03-26 22:54:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:54:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:54:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ds/29f6cb8f2c174d0ebdf8b91d7b4d4575/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '4ec46de6-e866-5be7-9224-6fd57651e59d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'PASSAT VARIANT',
 'odometer': 60599,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ec46de6-e866-5be7-9224-6fd57651e59d/4ec46de6-e866-5be7-9224-6fd57651e59d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 725819,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ds/29f6cb8f2c174d0ebdf8b91d7b4d4575/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ec46de6-e866-5be7-9224-6fd57651e59d/4ec46de6-e866-5be7-9224-6fd57651e59d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 698802,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ds/29f6cb8f2c174d0ebdf8b91d7b4d4575/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ec46de6-e866-5be7-9224-6fd57651e59d/4ec46de6-e866-5be7-9224-6fd57651e59d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 693974,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ds/29f6cb8f2c174d0ebdf8b91d7b4d4575/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ec46de6-e866-5be7-9224-6fd57651e59d/4ec46de6-e866-5be7-9224-6fd57651e59d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 744810,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ds/29f6cb8f2c174d0ebdf8b91d7b4d4575/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ec46de6-e866-5be7-9224-6fd57651e59d/4ec46de6-e866-5be7-9224-6fd57651e59d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 747302,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ds/29f6cb8f2c174d0ebdf8b91d7b4d4575/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ec46de6-e866-5be7-9224-6fd57651e59d/4ec46de6-e866-5be7-9224-6fd57651e59d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 768565,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ds/29f6cb8f2c174d0ebdf8b91d7b4d4575/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ec46de6-e866-5be7-9224-6fd57651e59d/4ec46de6-e866-5be7-9224-6fd57651e59d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 641834,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ds/29f6cb8f2c174d0ebdf8b91d7b4d4575/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ec46de6-e866-5be7-9224-6fd57651e59d/4ec46de6-e866-5be7-9224-6fd57651e59d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 731570,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ds/29f6cb8f2c174d0ebdf8b91d7b4d4575/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ec46de6-e866-5be7-9224-6fd57651e59d/4ec46de6-e866-5be7-9224-6fd57651e59d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 738714,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ds/29f6cb8f2c174d0ebdf8b91d7b4d4575/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ec46de6-e866-5be7-9224-6fd57651e59d/4ec46de6-e866-5be7-9224-6fd57651e59d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 658170,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ds/29f6cb8f2c174d0ebdf8b91d7b4d4575/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN PASSAT VARIANT 1.4 TSI MSQ VARIANT GTE BUSINESS',
 'transmission': 'automatic',
 'trim': '1.4 TSI MSQ VARIANT GTE BUSINESS',
 'vin': None,
 'year': 2023}
2026-03-26 22:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985555%27 HTTP/1.1" 200 None
2026-03-26 22:54:51 [ayvens.be] INFO: Saving data for 1985555: {'created_time': 1774565691.91071, 'last_price_update_time': 1774565691.910719, 'auction_closing_time': 1774958400.0}
2026-03-26 22:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985555') HTTP/1.1" 204 0
2026-03-26 22:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F3d81ea4c2f094feca79443de9ceb5b82%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/3d81ea4c2f094feca79443de9ceb5b82/images/large/5.jpg not downloaded yet
2026-03-26 22:54:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6d81ed0>
2026-03-26 22:54:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0bc6fecf-167b-51eb-acbf-41d488f8f507/0bc6fecf-167b-51eb-acbf-41d488f8f507_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F6ec3973bf16841ad9239e14dcdaf2fcd%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/6ec3973bf16841ad9239e14dcdaf2fcd/images/large/4.jpg saved to cache
2026-03-26 22:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0bc6fecf-167b-51eb-acbf-41d488f8f507
2026-03-26 22:54:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/6ec3973bf16841ad9239e14dcdaf2fcd/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/1b708eb7ee0d4b2d942b83723313d2eb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/1b708eb7ee0d4b2d942b83723313d2eb/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F3d81ea4c2f094feca79443de9ceb5b82%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/3d81ea4c2f094feca79443de9ceb5b82/images/large/6.jpg not downloaded yet
2026-03-26 22:54:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd3ac250>
2026-03-26 22:54:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e64cf68-a5f0-53b0-94d5-05c292bbbcea/1e64cf68-a5f0-53b0-94d5-05c292bbbcea_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F1b708eb7ee0d4b2d942b83723313d2eb%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/1b708eb7ee0d4b2d942b83723313d2eb/images/large/2.jpg saved to cache
2026-03-26 22:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1e64cf68-a5f0-53b0-94d5-05c292bbbcea
2026-03-26 22:54:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/6ec3973bf16841ad9239e14dcdaf2fcd/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F3d81ea4c2f094feca79443de9ceb5b82%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/3d81ea4c2f094feca79443de9ceb5b82/images/large/7.jpg not downloaded yet
2026-03-26 22:54:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74769d0>
2026-03-26 22:54:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0bc6fecf-167b-51eb-acbf-41d488f8f507/0bc6fecf-167b-51eb-acbf-41d488f8f507_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F6ec3973bf16841ad9239e14dcdaf2fcd%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/6ec3973bf16841ad9239e14dcdaf2fcd/images/large/5.jpg saved to cache
2026-03-26 22:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0bc6fecf-167b-51eb-acbf-41d488f8f507
2026-03-26 22:54:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79f9fd0>
2026-03-26 22:54:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e64cf68-a5f0-53b0-94d5-05c292bbbcea/1e64cf68-a5f0-53b0-94d5-05c292bbbcea_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F1b708eb7ee0d4b2d942b83723313d2eb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/1b708eb7ee0d4b2d942b83723313d2eb/images/large/1.jpg saved to cache
2026-03-26 22:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1e64cf68-a5f0-53b0-94d5-05c292bbbcea
2026-03-26 22:54:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c62710>
2026-03-26 22:54:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e64cf68-a5f0-53b0-94d5-05c292bbbcea/1e64cf68-a5f0-53b0-94d5-05c292bbbcea_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F1b708eb7ee0d4b2d942b83723313d2eb%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/1b708eb7ee0d4b2d942b83723313d2eb/images/large/3.jpg saved to cache
2026-03-26 22:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1e64cf68-a5f0-53b0-94d5-05c292bbbcea
2026-03-26 22:54:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/6ec3973bf16841ad9239e14dcdaf2fcd/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/1b708eb7ee0d4b2d942b83723313d2eb/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F3d81ea4c2f094feca79443de9ceb5b82%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/3d81ea4c2f094feca79443de9ceb5b82/images/large/8.jpg not downloaded yet
2026-03-26 22:54:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/6ec3973bf16841ad9239e14dcdaf2fcd/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/6ec3973bf16841ad9239e14dcdaf2fcd/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F3d81ea4c2f094feca79443de9ceb5b82%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/3d81ea4c2f094feca79443de9ceb5b82/images/large/9.jpg not downloaded yet
2026-03-26 22:54:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7448e10>
2026-03-26 22:54:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0bc6fecf-167b-51eb-acbf-41d488f8f507/0bc6fecf-167b-51eb-acbf-41d488f8f507_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F6ec3973bf16841ad9239e14dcdaf2fcd%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/6ec3973bf16841ad9239e14dcdaf2fcd/images/large/6.jpg saved to cache
2026-03-26 22:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0bc6fecf-167b-51eb-acbf-41d488f8f507
2026-03-26 22:54:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/1b708eb7ee0d4b2d942b83723313d2eb/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F3d81ea4c2f094feca79443de9ceb5b82%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/3d81ea4c2f094feca79443de9ceb5b82/images/large/10.jpg not downloaded yet
2026-03-26 22:54:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/1b708eb7ee0d4b2d942b83723313d2eb/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/1b708eb7ee0d4b2d942b83723313d2eb/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:52 [ayvens.be] INFO: Found listing with ID: 1985559
2026-03-26 22:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985559%27 HTTP/1.1" 200 None
2026-03-26 22:54:52 [ayvens.be] INFO: Scrape type for 1985559: 1
2026-03-26 22:54:52 [ayvens.be] INFO: Extracting data for car ID: 1985559
2026-03-26 22:54:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3 with identifier: 1985559
2026-03-26 22:54:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3 with scrape type 1
2026-03-26 22:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3
2026-03-26 22:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F13b01915d64448b99ced549262709cea%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/13b01915d64448b99ced549262709cea/images/large/1.jpg not downloaded yet
2026-03-26 22:54:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7876a90>
2026-03-26 22:54:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0bc6fecf-167b-51eb-acbf-41d488f8f507/0bc6fecf-167b-51eb-acbf-41d488f8f507_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F6ec3973bf16841ad9239e14dcdaf2fcd%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/6ec3973bf16841ad9239e14dcdaf2fcd/images/large/7.jpg saved to cache
2026-03-26 22:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0bc6fecf-167b-51eb-acbf-41d488f8f507
2026-03-26 22:54:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c5e790>
2026-03-26 22:54:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e64cf68-a5f0-53b0-94d5-05c292bbbcea/1e64cf68-a5f0-53b0-94d5-05c292bbbcea_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F1b708eb7ee0d4b2d942b83723313d2eb%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/1b708eb7ee0d4b2d942b83723313d2eb/images/large/5.jpg saved to cache
2026-03-26 22:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1e64cf68-a5f0-53b0-94d5-05c292bbbcea
2026-03-26 22:54:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b792d850>
2026-03-26 22:54:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0bc6fecf-167b-51eb-acbf-41d488f8f507/0bc6fecf-167b-51eb-acbf-41d488f8f507_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F6ec3973bf16841ad9239e14dcdaf2fcd%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/6ec3973bf16841ad9239e14dcdaf2fcd/images/large/9.jpg saved to cache
2026-03-26 22:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0bc6fecf-167b-51eb-acbf-41d488f8f507
2026-03-26 22:54:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74bffd0>
2026-03-26 22:54:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0bc6fecf-167b-51eb-acbf-41d488f8f507/0bc6fecf-167b-51eb-acbf-41d488f8f507_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F6ec3973bf16841ad9239e14dcdaf2fcd%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/6ec3973bf16841ad9239e14dcdaf2fcd/images/large/10.jpg saved to cache
2026-03-26 22:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0bc6fecf-167b-51eb-acbf-41d488f8f507
2026-03-26 22:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F13b01915d64448b99ced549262709cea%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/13b01915d64448b99ced549262709cea/images/large/2.jpg not downloaded yet
2026-03-26 22:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F13b01915d64448b99ced549262709cea%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/13b01915d64448b99ced549262709cea/images/large/3.jpg not downloaded yet
2026-03-26 22:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F13b01915d64448b99ced549262709cea%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/13b01915d64448b99ced549262709cea/images/large/4.jpg not downloaded yet
2026-03-26 22:54:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b792e590>
2026-03-26 22:54:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e64cf68-a5f0-53b0-94d5-05c292bbbcea/1e64cf68-a5f0-53b0-94d5-05c292bbbcea_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F1b708eb7ee0d4b2d942b83723313d2eb%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/1b708eb7ee0d4b2d942b83723313d2eb/images/large/6.jpg saved to cache
2026-03-26 22:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1e64cf68-a5f0-53b0-94d5-05c292bbbcea
2026-03-26 22:54:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b78a8610>
2026-03-26 22:54:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e64cf68-a5f0-53b0-94d5-05c292bbbcea/1e64cf68-a5f0-53b0-94d5-05c292bbbcea_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F1b708eb7ee0d4b2d942b83723313d2eb%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/1b708eb7ee0d4b2d942b83723313d2eb/images/large/4.jpg saved to cache
2026-03-26 22:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1e64cf68-a5f0-53b0-94d5-05c292bbbcea
2026-03-26 22:54:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7442d90>
2026-03-26 22:54:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e64cf68-a5f0-53b0-94d5-05c292bbbcea/1e64cf68-a5f0-53b0-94d5-05c292bbbcea_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F1b708eb7ee0d4b2d942b83723313d2eb%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/1b708eb7ee0d4b2d942b83723313d2eb/images/large/7.jpg saved to cache
2026-03-26 22:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1e64cf68-a5f0-53b0-94d5-05c292bbbcea
2026-03-26 22:54:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/1b708eb7ee0d4b2d942b83723313d2eb/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F13b01915d64448b99ced549262709cea%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/13b01915d64448b99ced549262709cea/images/large/5.jpg not downloaded yet
2026-03-26 22:54:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/6ec3973bf16841ad9239e14dcdaf2fcd/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/1b708eb7ee0d4b2d942b83723313d2eb/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F13b01915d64448b99ced549262709cea%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/13b01915d64448b99ced549262709cea/images/large/6.jpg not downloaded yet
2026-03-26 22:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F13b01915d64448b99ced549262709cea%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/13b01915d64448b99ced549262709cea/images/large/7.jpg not downloaded yet
2026-03-26 22:54:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/3d81ea4c2f094feca79443de9ceb5b82/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/3d81ea4c2f094feca79443de9ceb5b82/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F13b01915d64448b99ced549262709cea%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/13b01915d64448b99ced549262709cea/images/large/8.jpg not downloaded yet
2026-03-26 22:54:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/3d81ea4c2f094feca79443de9ceb5b82/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/3d81ea4c2f094feca79443de9ceb5b82/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/3d81ea4c2f094feca79443de9ceb5b82/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F13b01915d64448b99ced549262709cea%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/13b01915d64448b99ced549262709cea/images/large/9.jpg not downloaded yet
2026-03-26 22:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F13b01915d64448b99ced549262709cea%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/13b01915d64448b99ced549262709cea/images/large/10.jpg not downloaded yet
2026-03-26 22:54:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7440490>
2026-03-26 22:54:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e64cf68-a5f0-53b0-94d5-05c292bbbcea/1e64cf68-a5f0-53b0-94d5-05c292bbbcea_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F1b708eb7ee0d4b2d942b83723313d2eb%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/1b708eb7ee0d4b2d942b83723313d2eb/images/large/9.jpg saved to cache
2026-03-26 22:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1e64cf68-a5f0-53b0-94d5-05c292bbbcea
2026-03-26 22:54:53 [ayvens.be] INFO: Found listing with ID: 1985560
2026-03-26 22:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985560%27 HTTP/1.1" 200 None
2026-03-26 22:54:53 [ayvens.be] INFO: Scrape type for 1985560: 1
2026-03-26 22:54:53 [ayvens.be] INFO: Extracting data for car ID: 1985560
2026-03-26 22:54:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 10f6b86a-64a3-5986-ae46-4ef20370de69 with identifier: 1985560
2026-03-26 22:54:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10f6b86a-64a3-5986-ae46-4ef20370de69 with scrape type 1
2026-03-26 22:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 10f6b86a-64a3-5986-ae46-4ef20370de69
2026-03-26 22:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F15af1a5160134307ae3024f3dd47858b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/15af1a5160134307ae3024f3dd47858b/images/large/1.jpg not downloaded yet
2026-03-26 22:54:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/1b708eb7ee0d4b2d942b83723313d2eb/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6d81c10>
2026-03-26 22:54:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0bc6fecf-167b-51eb-acbf-41d488f8f507/0bc6fecf-167b-51eb-acbf-41d488f8f507_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F6ec3973bf16841ad9239e14dcdaf2fcd%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/6ec3973bf16841ad9239e14dcdaf2fcd/images/large/8.jpg saved to cache
2026-03-26 22:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0bc6fecf-167b-51eb-acbf-41d488f8f507
2026-03-26 22:54:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0bc6fecf-167b-51eb-acbf-41d488f8f507, skipping ID generation
2026-03-26 22:54:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0bc6fecf-167b-51eb-acbf-41d488f8f507 with scrape type 1
2026-03-26 22:54:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0bc6fecf-167b-51eb-acbf-41d488f8f507 sending to next pipeline
2026-03-26 22:54:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 0bc6fecf-167b-51eb-acbf-41d488f8f507, identifier: 1985556
2026-03-26 22:54:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74b57d0>
2026-03-26 22:54:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e64cf68-a5f0-53b0-94d5-05c292bbbcea/1e64cf68-a5f0-53b0-94d5-05c292bbbcea_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F1b708eb7ee0d4b2d942b83723313d2eb%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/1b708eb7ee0d4b2d942b83723313d2eb/images/large/10.jpg saved to cache
2026-03-26 22:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1e64cf68-a5f0-53b0-94d5-05c292bbbcea
2026-03-26 22:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F15af1a5160134307ae3024f3dd47858b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/15af1a5160134307ae3024f3dd47858b/images/large/2.jpg not downloaded yet
2026-03-26 22:54:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 0bc6fecf-167b-51eb-acbf-41d488f8f507 with identifier: 1985556
2026-03-26 22:54:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 0bc6fecf-167b-51eb-acbf-41d488f8f507 with identifier: 1985556
2026-03-26 22:54:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 0bc6fecf-167b-51eb-acbf-41d488f8f507 with identifier: 1985556 to the API
2026-03-26 22:54:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:54:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:54:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bp/6ec3973bf16841ad9239e14dcdaf2fcd/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '0bc6fecf-167b-51eb-acbf-41d488f8f507',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLC COUPE',
 'odometer': 111879,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc6fecf-167b-51eb-acbf-41d488f8f507/0bc6fecf-167b-51eb-acbf-41d488f8f507_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 789365,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/6ec3973bf16841ad9239e14dcdaf2fcd/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc6fecf-167b-51eb-acbf-41d488f8f507/0bc6fecf-167b-51eb-acbf-41d488f8f507_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 789090,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/6ec3973bf16841ad9239e14dcdaf2fcd/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc6fecf-167b-51eb-acbf-41d488f8f507/0bc6fecf-167b-51eb-acbf-41d488f8f507_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 786463,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/6ec3973bf16841ad9239e14dcdaf2fcd/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc6fecf-167b-51eb-acbf-41d488f8f507/0bc6fecf-167b-51eb-acbf-41d488f8f507_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 838015,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/6ec3973bf16841ad9239e14dcdaf2fcd/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc6fecf-167b-51eb-acbf-41d488f8f507/0bc6fecf-167b-51eb-acbf-41d488f8f507_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 796948,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/6ec3973bf16841ad9239e14dcdaf2fcd/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc6fecf-167b-51eb-acbf-41d488f8f507/0bc6fecf-167b-51eb-acbf-41d488f8f507_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 725536,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/6ec3973bf16841ad9239e14dcdaf2fcd/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc6fecf-167b-51eb-acbf-41d488f8f507/0bc6fecf-167b-51eb-acbf-41d488f8f507_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 610249,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/6ec3973bf16841ad9239e14dcdaf2fcd/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc6fecf-167b-51eb-acbf-41d488f8f507/0bc6fecf-167b-51eb-acbf-41d488f8f507_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 779324,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/6ec3973bf16841ad9239e14dcdaf2fcd/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc6fecf-167b-51eb-acbf-41d488f8f507/0bc6fecf-167b-51eb-acbf-41d488f8f507_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 760767,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/6ec3973bf16841ad9239e14dcdaf2fcd/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc6fecf-167b-51eb-acbf-41d488f8f507/0bc6fecf-167b-51eb-acbf-41d488f8f507_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 740115,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/6ec3973bf16841ad9239e14dcdaf2fcd/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLC COUPE 2.0 GLC 300 DE PHEV 4MATIC 4WD AUTO',
 'transmission': 'automatic',
 'trim': '2.0 GLC 300 DE PHEV 4MATIC 4WD AUTO',
 'vin': None,
 'year': 2022}
2026-03-26 22:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985556%27 HTTP/1.1" 200 None
2026-03-26 22:54:54 [ayvens.be] INFO: Saving data for 1985556: {'created_time': 1774565694.214404, 'last_price_update_time': 1774565694.214413, 'auction_closing_time': 1774958400.0}
2026-03-26 22:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985556') HTTP/1.1" 204 0
2026-03-26 22:54:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/13b01915d64448b99ced549262709cea/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/13b01915d64448b99ced549262709cea/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F15af1a5160134307ae3024f3dd47858b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/15af1a5160134307ae3024f3dd47858b/images/large/3.jpg not downloaded yet
2026-03-26 22:54:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c5d950>
2026-03-26 22:54:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09004bbc-6359-535b-a99e-b8b1fb675399/09004bbc-6359-535b-a99e-b8b1fb675399_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F3d81ea4c2f094feca79443de9ceb5b82%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/3d81ea4c2f094feca79443de9ceb5b82/images/large/5.jpg saved to cache
2026-03-26 22:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 09004bbc-6359-535b-a99e-b8b1fb675399
2026-03-26 22:54:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79270d0>
2026-03-26 22:54:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09004bbc-6359-535b-a99e-b8b1fb675399/09004bbc-6359-535b-a99e-b8b1fb675399_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F3d81ea4c2f094feca79443de9ceb5b82%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/3d81ea4c2f094feca79443de9ceb5b82/images/large/2.jpg saved to cache
2026-03-26 22:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 09004bbc-6359-535b-a99e-b8b1fb675399
2026-03-26 22:54:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74add90>
2026-03-26 22:54:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09004bbc-6359-535b-a99e-b8b1fb675399/09004bbc-6359-535b-a99e-b8b1fb675399_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F3d81ea4c2f094feca79443de9ceb5b82%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/3d81ea4c2f094feca79443de9ceb5b82/images/large/3.jpg saved to cache
2026-03-26 22:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 09004bbc-6359-535b-a99e-b8b1fb675399
2026-03-26 22:54:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b98a90>
2026-03-26 22:54:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09004bbc-6359-535b-a99e-b8b1fb675399/09004bbc-6359-535b-a99e-b8b1fb675399_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F3d81ea4c2f094feca79443de9ceb5b82%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/3d81ea4c2f094feca79443de9ceb5b82/images/large/1.jpg saved to cache
2026-03-26 22:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 09004bbc-6359-535b-a99e-b8b1fb675399
2026-03-26 22:54:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76ef250>
2026-03-26 22:54:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09004bbc-6359-535b-a99e-b8b1fb675399/09004bbc-6359-535b-a99e-b8b1fb675399_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F3d81ea4c2f094feca79443de9ceb5b82%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/3d81ea4c2f094feca79443de9ceb5b82/images/large/4.jpg saved to cache
2026-03-26 22:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 09004bbc-6359-535b-a99e-b8b1fb675399
2026-03-26 22:54:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd8d2fd0>
2026-03-26 22:54:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e64cf68-a5f0-53b0-94d5-05c292bbbcea/1e64cf68-a5f0-53b0-94d5-05c292bbbcea_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F1b708eb7ee0d4b2d942b83723313d2eb%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/1b708eb7ee0d4b2d942b83723313d2eb/images/large/8.jpg saved to cache
2026-03-26 22:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1e64cf68-a5f0-53b0-94d5-05c292bbbcea
2026-03-26 22:54:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1e64cf68-a5f0-53b0-94d5-05c292bbbcea, skipping ID generation
2026-03-26 22:54:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e64cf68-a5f0-53b0-94d5-05c292bbbcea with scrape type 1
2026-03-26 22:54:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1e64cf68-a5f0-53b0-94d5-05c292bbbcea sending to next pipeline
2026-03-26 22:54:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 1e64cf68-a5f0-53b0-94d5-05c292bbbcea, identifier: 1985557
2026-03-26 22:54:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 1e64cf68-a5f0-53b0-94d5-05c292bbbcea with identifier: 1985557
2026-03-26 22:54:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 1e64cf68-a5f0-53b0-94d5-05c292bbbcea with identifier: 1985557
2026-03-26 22:54:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 1e64cf68-a5f0-53b0-94d5-05c292bbbcea with identifier: 1985557 to the API
2026-03-26 22:54:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:54:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:54:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yv/1b708eb7ee0d4b2d942b83723313d2eb/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '1e64cf68-a5f0-53b0-94d5-05c292bbbcea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'MINI',
 'model': 'COUNTRYMAN',
 'odometer': 147558,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e64cf68-a5f0-53b0-94d5-05c292bbbcea/1e64cf68-a5f0-53b0-94d5-05c292bbbcea_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 272338,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/1b708eb7ee0d4b2d942b83723313d2eb/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e64cf68-a5f0-53b0-94d5-05c292bbbcea/1e64cf68-a5f0-53b0-94d5-05c292bbbcea_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 264433,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/1b708eb7ee0d4b2d942b83723313d2eb/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e64cf68-a5f0-53b0-94d5-05c292bbbcea/1e64cf68-a5f0-53b0-94d5-05c292bbbcea_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 291263,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/1b708eb7ee0d4b2d942b83723313d2eb/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e64cf68-a5f0-53b0-94d5-05c292bbbcea/1e64cf68-a5f0-53b0-94d5-05c292bbbcea_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 271216,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/1b708eb7ee0d4b2d942b83723313d2eb/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e64cf68-a5f0-53b0-94d5-05c292bbbcea/1e64cf68-a5f0-53b0-94d5-05c292bbbcea_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 294206,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/1b708eb7ee0d4b2d942b83723313d2eb/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e64cf68-a5f0-53b0-94d5-05c292bbbcea/1e64cf68-a5f0-53b0-94d5-05c292bbbcea_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 257967,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/1b708eb7ee0d4b2d942b83723313d2eb/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e64cf68-a5f0-53b0-94d5-05c292bbbcea/1e64cf68-a5f0-53b0-94d5-05c292bbbcea_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 288680,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/1b708eb7ee0d4b2d942b83723313d2eb/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e64cf68-a5f0-53b0-94d5-05c292bbbcea/1e64cf68-a5f0-53b0-94d5-05c292bbbcea_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 372907,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/1b708eb7ee0d4b2d942b83723313d2eb/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e64cf68-a5f0-53b0-94d5-05c292bbbcea/1e64cf68-a5f0-53b0-94d5-05c292bbbcea_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 390767,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/1b708eb7ee0d4b2d942b83723313d2eb/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e64cf68-a5f0-53b0-94d5-05c292bbbcea/1e64cf68-a5f0-53b0-94d5-05c292bbbcea_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 420047,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/1b708eb7ee0d4b2d942b83723313d2eb/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI COUNTRYMAN 1.5 COOPER S E 4WD AUTO',
 'transmission': 'automatic',
 'trim': '1.5 COOPER S E 4WD AUTO',
 'vin': None,
 'year': 2021}
2026-03-26 22:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985557%27 HTTP/1.1" 200 None
2026-03-26 22:54:55 [ayvens.be] INFO: Saving data for 1985557: {'created_time': 1774565695.220216, 'last_price_update_time': 1774565695.220224, 'auction_closing_time': 1774958400.0}
2026-03-26 22:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985557') HTTP/1.1" 204 0
2026-03-26 22:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F15af1a5160134307ae3024f3dd47858b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/15af1a5160134307ae3024f3dd47858b/images/large/4.jpg not downloaded yet
2026-03-26 22:54:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/3d81ea4c2f094feca79443de9ceb5b82/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/3d81ea4c2f094feca79443de9ceb5b82/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/13b01915d64448b99ced549262709cea/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F15af1a5160134307ae3024f3dd47858b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/15af1a5160134307ae3024f3dd47858b/images/large/5.jpg not downloaded yet
2026-03-26 22:54:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79f9ad0>
2026-03-26 22:54:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3/ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F13b01915d64448b99ced549262709cea%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/13b01915d64448b99ced549262709cea/images/large/1.jpg saved to cache
2026-03-26 22:54:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3
2026-03-26 22:54:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c94110>
2026-03-26 22:54:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3/ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F13b01915d64448b99ced549262709cea%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/13b01915d64448b99ced549262709cea/images/large/2.jpg saved to cache
2026-03-26 22:54:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3
2026-03-26 22:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F15af1a5160134307ae3024f3dd47858b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/15af1a5160134307ae3024f3dd47858b/images/large/6.jpg not downloaded yet
2026-03-26 22:54:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/13b01915d64448b99ced549262709cea/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/13b01915d64448b99ced549262709cea/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b787cc90>
2026-03-26 22:54:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09004bbc-6359-535b-a99e-b8b1fb675399/09004bbc-6359-535b-a99e-b8b1fb675399_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F3d81ea4c2f094feca79443de9ceb5b82%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/3d81ea4c2f094feca79443de9ceb5b82/images/large/7.jpg saved to cache
2026-03-26 22:54:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 09004bbc-6359-535b-a99e-b8b1fb675399
2026-03-26 22:54:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77bc790>
2026-03-26 22:54:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09004bbc-6359-535b-a99e-b8b1fb675399/09004bbc-6359-535b-a99e-b8b1fb675399_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F3d81ea4c2f094feca79443de9ceb5b82%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/3d81ea4c2f094feca79443de9ceb5b82/images/large/6.jpg saved to cache
2026-03-26 22:54:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 09004bbc-6359-535b-a99e-b8b1fb675399
2026-03-26 22:54:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74fa690>
2026-03-26 22:54:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3/ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F13b01915d64448b99ced549262709cea%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/13b01915d64448b99ced549262709cea/images/large/4.jpg saved to cache
2026-03-26 22:54:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3
2026-03-26 22:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F15af1a5160134307ae3024f3dd47858b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/15af1a5160134307ae3024f3dd47858b/images/large/7.jpg not downloaded yet
2026-03-26 22:54:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/3d81ea4c2f094feca79443de9ceb5b82/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F15af1a5160134307ae3024f3dd47858b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/15af1a5160134307ae3024f3dd47858b/images/large/8.jpg not downloaded yet
2026-03-26 22:54:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c80510>
2026-03-26 22:54:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3/ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F13b01915d64448b99ced549262709cea%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/13b01915d64448b99ced549262709cea/images/large/3.jpg saved to cache
2026-03-26 22:54:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3
2026-03-26 22:54:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b75a7e50>
2026-03-26 22:54:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3/ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F13b01915d64448b99ced549262709cea%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/13b01915d64448b99ced549262709cea/images/large/5.jpg saved to cache
2026-03-26 22:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3
2026-03-26 22:54:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/3d81ea4c2f094feca79443de9ceb5b82/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/3d81ea4c2f094feca79443de9ceb5b82/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/15af1a5160134307ae3024f3dd47858b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/15af1a5160134307ae3024f3dd47858b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F15af1a5160134307ae3024f3dd47858b%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/15af1a5160134307ae3024f3dd47858b/images/large/9.jpg not downloaded yet
2026-03-26 22:54:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/15af1a5160134307ae3024f3dd47858b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F15af1a5160134307ae3024f3dd47858b%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/15af1a5160134307ae3024f3dd47858b/images/large/10.jpg not downloaded yet
2026-03-26 22:54:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79a4bd0>
2026-03-26 22:54:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09004bbc-6359-535b-a99e-b8b1fb675399/09004bbc-6359-535b-a99e-b8b1fb675399_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F3d81ea4c2f094feca79443de9ceb5b82%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/3d81ea4c2f094feca79443de9ceb5b82/images/large/8.jpg saved to cache
2026-03-26 22:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 09004bbc-6359-535b-a99e-b8b1fb675399
2026-03-26 22:54:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/13b01915d64448b99ced549262709cea/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/13b01915d64448b99ced549262709cea/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:56 [ayvens.be] INFO: Found listing with ID: 1985561
2026-03-26 22:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985561%27 HTTP/1.1" 200 None
2026-03-26 22:54:56 [ayvens.be] INFO: Scrape type for 1985561: 1
2026-03-26 22:54:56 [ayvens.be] INFO: Extracting data for car ID: 1985561
2026-03-26 22:54:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a3ccbd74-4d59-5303-8962-b8d5e8bed838 with identifier: 1985561
2026-03-26 22:54:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3ccbd74-4d59-5303-8962-b8d5e8bed838 with scrape type 1
2026-03-26 22:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a3ccbd74-4d59-5303-8962-b8d5e8bed838
2026-03-26 22:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F593ae5bfab714932913e3c53e266955e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/593ae5bfab714932913e3c53e266955e/images/large/1.jpg not downloaded yet
2026-03-26 22:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F593ae5bfab714932913e3c53e266955e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/593ae5bfab714932913e3c53e266955e/images/large/2.jpg not downloaded yet
2026-03-26 22:54:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/13b01915d64448b99ced549262709cea/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/15af1a5160134307ae3024f3dd47858b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F593ae5bfab714932913e3c53e266955e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/593ae5bfab714932913e3c53e266955e/images/large/3.jpg not downloaded yet
2026-03-26 22:54:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd3bb210>
2026-03-26 22:54:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09004bbc-6359-535b-a99e-b8b1fb675399/09004bbc-6359-535b-a99e-b8b1fb675399_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F3d81ea4c2f094feca79443de9ceb5b82%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/3d81ea4c2f094feca79443de9ceb5b82/images/large/9.jpg saved to cache
2026-03-26 22:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 09004bbc-6359-535b-a99e-b8b1fb675399
2026-03-26 22:54:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b78c3cd0>
2026-03-26 22:54:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09004bbc-6359-535b-a99e-b8b1fb675399/09004bbc-6359-535b-a99e-b8b1fb675399_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F3d81ea4c2f094feca79443de9ceb5b82%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/3d81ea4c2f094feca79443de9ceb5b82/images/large/10.jpg saved to cache
2026-03-26 22:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 09004bbc-6359-535b-a99e-b8b1fb675399
2026-03-26 22:54:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 09004bbc-6359-535b-a99e-b8b1fb675399, skipping ID generation
2026-03-26 22:54:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09004bbc-6359-535b-a99e-b8b1fb675399 with scrape type 1
2026-03-26 22:54:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 09004bbc-6359-535b-a99e-b8b1fb675399 sending to next pipeline
2026-03-26 22:54:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 09004bbc-6359-535b-a99e-b8b1fb675399, identifier: 1985558
2026-03-26 22:54:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79f9650>
2026-03-26 22:54:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10f6b86a-64a3-5986-ae46-4ef20370de69/10f6b86a-64a3-5986-ae46-4ef20370de69_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F15af1a5160134307ae3024f3dd47858b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/15af1a5160134307ae3024f3dd47858b/images/large/2.jpg saved to cache
2026-03-26 22:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 10f6b86a-64a3-5986-ae46-4ef20370de69
2026-03-26 22:54:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b72eff10>
2026-03-26 22:54:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10f6b86a-64a3-5986-ae46-4ef20370de69/10f6b86a-64a3-5986-ae46-4ef20370de69_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F15af1a5160134307ae3024f3dd47858b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/15af1a5160134307ae3024f3dd47858b/images/large/3.jpg saved to cache
2026-03-26 22:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 10f6b86a-64a3-5986-ae46-4ef20370de69
2026-03-26 22:54:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77ebe50>
2026-03-26 22:54:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10f6b86a-64a3-5986-ae46-4ef20370de69/10f6b86a-64a3-5986-ae46-4ef20370de69_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F15af1a5160134307ae3024f3dd47858b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/15af1a5160134307ae3024f3dd47858b/images/large/1.jpg saved to cache
2026-03-26 22:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 10f6b86a-64a3-5986-ae46-4ef20370de69
2026-03-26 22:54:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/15af1a5160134307ae3024f3dd47858b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/15af1a5160134307ae3024f3dd47858b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 09004bbc-6359-535b-a99e-b8b1fb675399 with identifier: 1985558
2026-03-26 22:54:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 09004bbc-6359-535b-a99e-b8b1fb675399 with identifier: 1985558
2026-03-26 22:54:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 09004bbc-6359-535b-a99e-b8b1fb675399 with identifier: 1985558 to the API
2026-03-26 22:54:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:54:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:54:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bs/3d81ea4c2f094feca79443de9ceb5b82/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '09004bbc-6359-535b-a99e-b8b1fb675399',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X2',
 'odometer': 111269,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 24,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09004bbc-6359-535b-a99e-b8b1fb675399/09004bbc-6359-535b-a99e-b8b1fb675399_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 801997,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/3d81ea4c2f094feca79443de9ceb5b82/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09004bbc-6359-535b-a99e-b8b1fb675399/09004bbc-6359-535b-a99e-b8b1fb675399_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 783793,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/3d81ea4c2f094feca79443de9ceb5b82/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09004bbc-6359-535b-a99e-b8b1fb675399/09004bbc-6359-535b-a99e-b8b1fb675399_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 806215,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/3d81ea4c2f094feca79443de9ceb5b82/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09004bbc-6359-535b-a99e-b8b1fb675399/09004bbc-6359-535b-a99e-b8b1fb675399_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 835955,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/3d81ea4c2f094feca79443de9ceb5b82/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09004bbc-6359-535b-a99e-b8b1fb675399/09004bbc-6359-535b-a99e-b8b1fb675399_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 773377,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/3d81ea4c2f094feca79443de9ceb5b82/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09004bbc-6359-535b-a99e-b8b1fb675399/09004bbc-6359-535b-a99e-b8b1fb675399_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 802807,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/3d81ea4c2f094feca79443de9ceb5b82/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09004bbc-6359-535b-a99e-b8b1fb675399/09004bbc-6359-535b-a99e-b8b1fb675399_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 624605,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/3d81ea4c2f094feca79443de9ceb5b82/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09004bbc-6359-535b-a99e-b8b1fb675399/09004bbc-6359-535b-a99e-b8b1fb675399_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 900257,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/3d81ea4c2f094feca79443de9ceb5b82/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09004bbc-6359-535b-a99e-b8b1fb675399/09004bbc-6359-535b-a99e-b8b1fb675399_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 857947,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/3d81ea4c2f094feca79443de9ceb5b82/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09004bbc-6359-535b-a99e-b8b1fb675399/09004bbc-6359-535b-a99e-b8b1fb675399_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 869576,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/3d81ea4c2f094feca79443de9ceb5b82/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X2 1.5 XDRIVE25E PHEV 162KW)',
 'transmission': 'automatic',
 'trim': '1.5 XDRIVE25E PHEV 162KW)',
 'vin': None,
 'year': 2022}
2026-03-26 22:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985558%27 HTTP/1.1" 200 None
2026-03-26 22:54:57 [ayvens.be] INFO: Saving data for 1985558: {'created_time': 1774565697.398228, 'last_price_update_time': 1774565697.39824, 'auction_closing_time': 1774958400.0}
2026-03-26 22:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985558') HTTP/1.1" 204 0
2026-03-26 22:54:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/13b01915d64448b99ced549262709cea/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F593ae5bfab714932913e3c53e266955e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/593ae5bfab714932913e3c53e266955e/images/large/4.jpg not downloaded yet
2026-03-26 22:54:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79df690>
2026-03-26 22:54:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3/ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F13b01915d64448b99ced549262709cea%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/13b01915d64448b99ced549262709cea/images/large/10.jpg saved to cache
2026-03-26 22:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3
2026-03-26 22:54:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74acc10>
2026-03-26 22:54:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3/ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F13b01915d64448b99ced549262709cea%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/13b01915d64448b99ced549262709cea/images/large/9.jpg saved to cache
2026-03-26 22:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3
2026-03-26 22:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F593ae5bfab714932913e3c53e266955e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/593ae5bfab714932913e3c53e266955e/images/large/5.jpg not downloaded yet
2026-03-26 22:54:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/13b01915d64448b99ced549262709cea/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7426650>
2026-03-26 22:54:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3/ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F13b01915d64448b99ced549262709cea%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/13b01915d64448b99ced549262709cea/images/large/8.jpg saved to cache
2026-03-26 22:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3
2026-03-26 22:54:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7452c90>
2026-03-26 22:54:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10f6b86a-64a3-5986-ae46-4ef20370de69/10f6b86a-64a3-5986-ae46-4ef20370de69_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F15af1a5160134307ae3024f3dd47858b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/15af1a5160134307ae3024f3dd47858b/images/large/6.jpg saved to cache
2026-03-26 22:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 10f6b86a-64a3-5986-ae46-4ef20370de69
2026-03-26 22:54:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7725e50>
2026-03-26 22:54:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10f6b86a-64a3-5986-ae46-4ef20370de69/10f6b86a-64a3-5986-ae46-4ef20370de69_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F15af1a5160134307ae3024f3dd47858b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/15af1a5160134307ae3024f3dd47858b/images/large/4.jpg saved to cache
2026-03-26 22:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 10f6b86a-64a3-5986-ae46-4ef20370de69
2026-03-26 22:54:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7944f10>
2026-03-26 22:54:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10f6b86a-64a3-5986-ae46-4ef20370de69/10f6b86a-64a3-5986-ae46-4ef20370de69_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:54:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F15af1a5160134307ae3024f3dd47858b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/15af1a5160134307ae3024f3dd47858b/images/large/5.jpg saved to cache
2026-03-26 22:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 10f6b86a-64a3-5986-ae46-4ef20370de69
2026-03-26 22:54:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74fac50>
2026-03-26 22:54:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3/ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:54:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F13b01915d64448b99ced549262709cea%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/13b01915d64448b99ced549262709cea/images/large/7.jpg saved to cache
2026-03-26 22:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3
2026-03-26 22:54:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/15af1a5160134307ae3024f3dd47858b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/15af1a5160134307ae3024f3dd47858b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F593ae5bfab714932913e3c53e266955e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/593ae5bfab714932913e3c53e266955e/images/large/6.jpg not downloaded yet
2026-03-26 22:54:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/15af1a5160134307ae3024f3dd47858b/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/15af1a5160134307ae3024f3dd47858b/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F593ae5bfab714932913e3c53e266955e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/593ae5bfab714932913e3c53e266955e/images/large/7.jpg not downloaded yet
2026-03-26 22:54:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76a5d90>
2026-03-26 22:54:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3/ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:54:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F13b01915d64448b99ced549262709cea%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/13b01915d64448b99ced549262709cea/images/large/6.jpg saved to cache
2026-03-26 22:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3
2026-03-26 22:54:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3, skipping ID generation
2026-03-26 22:54:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3 with scrape type 1
2026-03-26 22:54:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3 sending to next pipeline
2026-03-26 22:54:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3, identifier: 1985559
2026-03-26 22:54:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F593ae5bfab714932913e3c53e266955e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/593ae5bfab714932913e3c53e266955e/images/large/8.jpg not downloaded yet
2026-03-26 22:54:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3 with identifier: 1985559
2026-03-26 22:54:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3 with identifier: 1985559
2026-03-26 22:54:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3 with identifier: 1985559 to the API
2026-03-26 22:54:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:54:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:54:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1xj/13b01915d64448b99ced549262709cea/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'electric',
 'id': 'ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'E-TRON',
 'odometer': 180008,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3/ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 257494,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/13b01915d64448b99ced549262709cea/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3/ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 247375,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/13b01915d64448b99ced549262709cea/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3/ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 285372,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/13b01915d64448b99ced549262709cea/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3/ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 278336,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/13b01915d64448b99ced549262709cea/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3/ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 323194,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/13b01915d64448b99ced549262709cea/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3/ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 311063,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/13b01915d64448b99ced549262709cea/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3/ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 326822,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/13b01915d64448b99ced549262709cea/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3/ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 308317,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/13b01915d64448b99ced549262709cea/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3/ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 325670,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/13b01915d64448b99ced549262709cea/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3/ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 287122,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/13b01915d64448b99ced549262709cea/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI E-TRON 95 kWh 55 Quattro Advanced',
 'transmission': 'automatic',
 'trim': '95 kWh 55 Quattro Advanced',
 'vin': None,
 'year': 2020}
2026-03-26 22:54:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985559%27 HTTP/1.1" 200 None
2026-03-26 22:54:58 [ayvens.be] INFO: Saving data for 1985559: {'created_time': 1774565698.84847, 'last_price_update_time': 1774565698.848483, 'auction_closing_time': 1774958400.0}
2026-03-26 22:54:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985559') HTTP/1.1" 204 0
2026-03-26 22:54:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F593ae5bfab714932913e3c53e266955e%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/593ae5bfab714932913e3c53e266955e/images/large/9.jpg not downloaded yet
2026-03-26 22:54:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/593ae5bfab714932913e3c53e266955e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/593ae5bfab714932913e3c53e266955e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79f08d0>
2026-03-26 22:54:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10f6b86a-64a3-5986-ae46-4ef20370de69/10f6b86a-64a3-5986-ae46-4ef20370de69_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:54:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F15af1a5160134307ae3024f3dd47858b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/15af1a5160134307ae3024f3dd47858b/images/large/7.jpg saved to cache
2026-03-26 22:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 10f6b86a-64a3-5986-ae46-4ef20370de69
2026-03-26 22:54:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c83990>
2026-03-26 22:54:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10f6b86a-64a3-5986-ae46-4ef20370de69/10f6b86a-64a3-5986-ae46-4ef20370de69_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F15af1a5160134307ae3024f3dd47858b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/15af1a5160134307ae3024f3dd47858b/images/large/8.jpg saved to cache
2026-03-26 22:54:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 10f6b86a-64a3-5986-ae46-4ef20370de69
2026-03-26 22:54:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80c986be90>
2026-03-26 22:54:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10f6b86a-64a3-5986-ae46-4ef20370de69/10f6b86a-64a3-5986-ae46-4ef20370de69_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F15af1a5160134307ae3024f3dd47858b%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/15af1a5160134307ae3024f3dd47858b/images/large/10.jpg saved to cache
2026-03-26 22:54:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 10f6b86a-64a3-5986-ae46-4ef20370de69
2026-03-26 22:54:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7778550>
2026-03-26 22:54:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10f6b86a-64a3-5986-ae46-4ef20370de69/10f6b86a-64a3-5986-ae46-4ef20370de69_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F15af1a5160134307ae3024f3dd47858b%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/15af1a5160134307ae3024f3dd47858b/images/large/9.jpg saved to cache
2026-03-26 22:54:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 10f6b86a-64a3-5986-ae46-4ef20370de69
2026-03-26 22:54:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 10f6b86a-64a3-5986-ae46-4ef20370de69, skipping ID generation
2026-03-26 22:54:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10f6b86a-64a3-5986-ae46-4ef20370de69 with scrape type 1
2026-03-26 22:54:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 10f6b86a-64a3-5986-ae46-4ef20370de69 sending to next pipeline
2026-03-26 22:54:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 10f6b86a-64a3-5986-ae46-4ef20370de69, identifier: 1985560
2026-03-26 22:54:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/593ae5bfab714932913e3c53e266955e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F593ae5bfab714932913e3c53e266955e%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/593ae5bfab714932913e3c53e266955e/images/large/10.jpg not downloaded yet
2026-03-26 22:54:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 10f6b86a-64a3-5986-ae46-4ef20370de69 with identifier: 1985560
2026-03-26 22:54:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 10f6b86a-64a3-5986-ae46-4ef20370de69 with identifier: 1985560
2026-03-26 22:54:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 10f6b86a-64a3-5986-ae46-4ef20370de69 with identifier: 1985560 to the API
2026-03-26 22:54:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:54:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:54:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bq/15af1a5160134307ae3024f3dd47858b/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '10f6b86a-64a3-5986-ae46-4ef20370de69',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'CITROAu2039N',
 'model': 'GRAND C4 SPACETOURER',
 'odometer': 89827,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10f6b86a-64a3-5986-ae46-4ef20370de69/10f6b86a-64a3-5986-ae46-4ef20370de69_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 269888,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/15af1a5160134307ae3024f3dd47858b/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10f6b86a-64a3-5986-ae46-4ef20370de69/10f6b86a-64a3-5986-ae46-4ef20370de69_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 266893,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/15af1a5160134307ae3024f3dd47858b/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10f6b86a-64a3-5986-ae46-4ef20370de69/10f6b86a-64a3-5986-ae46-4ef20370de69_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 262501,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/15af1a5160134307ae3024f3dd47858b/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10f6b86a-64a3-5986-ae46-4ef20370de69/10f6b86a-64a3-5986-ae46-4ef20370de69_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 261772,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/15af1a5160134307ae3024f3dd47858b/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10f6b86a-64a3-5986-ae46-4ef20370de69/10f6b86a-64a3-5986-ae46-4ef20370de69_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 269407,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/15af1a5160134307ae3024f3dd47858b/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10f6b86a-64a3-5986-ae46-4ef20370de69/10f6b86a-64a3-5986-ae46-4ef20370de69_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 237586,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/15af1a5160134307ae3024f3dd47858b/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10f6b86a-64a3-5986-ae46-4ef20370de69/10f6b86a-64a3-5986-ae46-4ef20370de69_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 281621,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/15af1a5160134307ae3024f3dd47858b/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10f6b86a-64a3-5986-ae46-4ef20370de69/10f6b86a-64a3-5986-ae46-4ef20370de69_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 319266,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/15af1a5160134307ae3024f3dd47858b/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10f6b86a-64a3-5986-ae46-4ef20370de69/10f6b86a-64a3-5986-ae46-4ef20370de69_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 329382,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/15af1a5160134307ae3024f3dd47858b/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10f6b86a-64a3-5986-ae46-4ef20370de69/10f6b86a-64a3-5986-ae46-4ef20370de69_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 324351,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/15af1a5160134307ae3024f3dd47858b/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-18',
 'seats_number': 7,
 'seller_name': None,
 'title': 'CITROAu2039N GRAND C4 SPACETOURER 1.2 PURETECH 130 S-S SHINE',
 'transmission': 'manual',
 'trim': '1.2 PURETECH 130 S-S SHINE',
 'vin': None,
 'year': 2022}
2026-03-26 22:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985560%27 HTTP/1.1" 200 None
2026-03-26 22:54:59 [ayvens.be] INFO: Saving data for 1985560: {'created_time': 1774565699.58776, 'last_price_update_time': 1774565699.587769, 'auction_closing_time': 1774958400.0}
2026-03-26 22:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985560') HTTP/1.1" 204 0
2026-03-26 22:54:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/593ae5bfab714932913e3c53e266955e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:59 [ayvens.be] INFO: Found listing with ID: 1985562
2026-03-26 22:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985562%27 HTTP/1.1" 200 None
2026-03-26 22:54:59 [ayvens.be] INFO: Scrape type for 1985562: 1
2026-03-26 22:54:59 [ayvens.be] INFO: Extracting data for car ID: 1985562
2026-03-26 22:54:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: def2c99e-3f4a-58de-ac43-9de97793e71f with identifier: 1985562
2026-03-26 22:54:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item def2c99e-3f4a-58de-ac43-9de97793e71f with scrape type 1
2026-03-26 22:54:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item def2c99e-3f4a-58de-ac43-9de97793e71f
2026-03-26 22:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F8673b3f7eb724e3ebfd86cb72312a5ab%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/8673b3f7eb724e3ebfd86cb72312a5ab/images/large/1.jpg not downloaded yet
2026-03-26 22:54:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7571bd0>
2026-03-26 22:54:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3ccbd74-4d59-5303-8962-b8d5e8bed838/a3ccbd74-4d59-5303-8962-b8d5e8bed838_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F593ae5bfab714932913e3c53e266955e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/593ae5bfab714932913e3c53e266955e/images/large/1.jpg saved to cache
2026-03-26 22:54:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a3ccbd74-4d59-5303-8962-b8d5e8bed838
2026-03-26 22:54:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74fa9d0>
2026-03-26 22:54:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3ccbd74-4d59-5303-8962-b8d5e8bed838/a3ccbd74-4d59-5303-8962-b8d5e8bed838_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F593ae5bfab714932913e3c53e266955e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/593ae5bfab714932913e3c53e266955e/images/large/3.jpg saved to cache
2026-03-26 22:54:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a3ccbd74-4d59-5303-8962-b8d5e8bed838
2026-03-26 22:54:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79dc910>
2026-03-26 22:54:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3ccbd74-4d59-5303-8962-b8d5e8bed838/a3ccbd74-4d59-5303-8962-b8d5e8bed838_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F593ae5bfab714932913e3c53e266955e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/593ae5bfab714932913e3c53e266955e/images/large/2.jpg saved to cache
2026-03-26 22:54:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a3ccbd74-4d59-5303-8962-b8d5e8bed838
2026-03-26 22:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F8673b3f7eb724e3ebfd86cb72312a5ab%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/8673b3f7eb724e3ebfd86cb72312a5ab/images/large/2.jpg not downloaded yet
2026-03-26 22:54:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/593ae5bfab714932913e3c53e266955e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/593ae5bfab714932913e3c53e266955e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/593ae5bfab714932913e3c53e266955e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F8673b3f7eb724e3ebfd86cb72312a5ab%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/8673b3f7eb724e3ebfd86cb72312a5ab/images/large/3.jpg not downloaded yet
2026-03-26 22:54:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7946fd0>
2026-03-26 22:54:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:54:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:54:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:54:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3ccbd74-4d59-5303-8962-b8d5e8bed838/a3ccbd74-4d59-5303-8962-b8d5e8bed838_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F593ae5bfab714932913e3c53e266955e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:54:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/593ae5bfab714932913e3c53e266955e/images/large/5.jpg saved to cache
2026-03-26 22:54:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a3ccbd74-4d59-5303-8962-b8d5e8bed838
2026-03-26 22:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F8673b3f7eb724e3ebfd86cb72312a5ab%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/8673b3f7eb724e3ebfd86cb72312a5ab/images/large/4.jpg not downloaded yet
2026-03-26 22:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F8673b3f7eb724e3ebfd86cb72312a5ab%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/8673b3f7eb724e3ebfd86cb72312a5ab/images/large/5.jpg not downloaded yet
2026-03-26 22:54:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/593ae5bfab714932913e3c53e266955e/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/593ae5bfab714932913e3c53e266955e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F8673b3f7eb724e3ebfd86cb72312a5ab%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:54:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/8673b3f7eb724e3ebfd86cb72312a5ab/images/large/6.jpg not downloaded yet
2026-03-26 22:54:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:54:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7745fd0>
2026-03-26 22:54:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3ccbd74-4d59-5303-8962-b8d5e8bed838/a3ccbd74-4d59-5303-8962-b8d5e8bed838_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F593ae5bfab714932913e3c53e266955e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/593ae5bfab714932913e3c53e266955e/images/large/4.jpg saved to cache
2026-03-26 22:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a3ccbd74-4d59-5303-8962-b8d5e8bed838
2026-03-26 22:55:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cbc850>
2026-03-26 22:55:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3ccbd74-4d59-5303-8962-b8d5e8bed838/a3ccbd74-4d59-5303-8962-b8d5e8bed838_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F593ae5bfab714932913e3c53e266955e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/593ae5bfab714932913e3c53e266955e/images/large/7.jpg saved to cache
2026-03-26 22:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a3ccbd74-4d59-5303-8962-b8d5e8bed838
2026-03-26 22:55:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c5cd50>
2026-03-26 22:55:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3ccbd74-4d59-5303-8962-b8d5e8bed838/a3ccbd74-4d59-5303-8962-b8d5e8bed838_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F593ae5bfab714932913e3c53e266955e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/593ae5bfab714932913e3c53e266955e/images/large/6.jpg saved to cache
2026-03-26 22:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a3ccbd74-4d59-5303-8962-b8d5e8bed838
2026-03-26 22:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F8673b3f7eb724e3ebfd86cb72312a5ab%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/8673b3f7eb724e3ebfd86cb72312a5ab/images/large/7.jpg not downloaded yet
2026-03-26 22:55:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/593ae5bfab714932913e3c53e266955e/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F8673b3f7eb724e3ebfd86cb72312a5ab%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/8673b3f7eb724e3ebfd86cb72312a5ab/images/large/8.jpg not downloaded yet
2026-03-26 22:55:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77e8410>
2026-03-26 22:55:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3ccbd74-4d59-5303-8962-b8d5e8bed838/a3ccbd74-4d59-5303-8962-b8d5e8bed838_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F593ae5bfab714932913e3c53e266955e%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/593ae5bfab714932913e3c53e266955e/images/large/9.jpg saved to cache
2026-03-26 22:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a3ccbd74-4d59-5303-8962-b8d5e8bed838
2026-03-26 22:55:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cc8690>
2026-03-26 22:55:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3ccbd74-4d59-5303-8962-b8d5e8bed838/a3ccbd74-4d59-5303-8962-b8d5e8bed838_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F593ae5bfab714932913e3c53e266955e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/593ae5bfab714932913e3c53e266955e/images/large/8.jpg saved to cache
2026-03-26 22:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a3ccbd74-4d59-5303-8962-b8d5e8bed838
2026-03-26 22:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F8673b3f7eb724e3ebfd86cb72312a5ab%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/8673b3f7eb724e3ebfd86cb72312a5ab/images/large/9.jpg not downloaded yet
2026-03-26 22:55:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e1f390>
2026-03-26 22:55:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3ccbd74-4d59-5303-8962-b8d5e8bed838/a3ccbd74-4d59-5303-8962-b8d5e8bed838_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F593ae5bfab714932913e3c53e266955e%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/593ae5bfab714932913e3c53e266955e/images/large/10.jpg saved to cache
2026-03-26 22:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a3ccbd74-4d59-5303-8962-b8d5e8bed838
2026-03-26 22:55:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a3ccbd74-4d59-5303-8962-b8d5e8bed838, skipping ID generation
2026-03-26 22:55:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3ccbd74-4d59-5303-8962-b8d5e8bed838 with scrape type 1
2026-03-26 22:55:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a3ccbd74-4d59-5303-8962-b8d5e8bed838 sending to next pipeline
2026-03-26 22:55:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a3ccbd74-4d59-5303-8962-b8d5e8bed838, identifier: 1985561
2026-03-26 22:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F8673b3f7eb724e3ebfd86cb72312a5ab%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/8673b3f7eb724e3ebfd86cb72312a5ab/images/large/10.jpg not downloaded yet
2026-03-26 22:55:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a3ccbd74-4d59-5303-8962-b8d5e8bed838 with identifier: 1985561
2026-03-26 22:55:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a3ccbd74-4d59-5303-8962-b8d5e8bed838 with identifier: 1985561
2026-03-26 22:55:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a3ccbd74-4d59-5303-8962-b8d5e8bed838 with identifier: 1985561 to the API
2026-03-26 22:55:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:55:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:55:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bp/593ae5bfab714932913e3c53e266955e/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'a3ccbd74-4d59-5303-8962-b8d5e8bed838',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q2',
 'odometer': 52536,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3ccbd74-4d59-5303-8962-b8d5e8bed838/a3ccbd74-4d59-5303-8962-b8d5e8bed838_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 448855,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/593ae5bfab714932913e3c53e266955e/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3ccbd74-4d59-5303-8962-b8d5e8bed838/a3ccbd74-4d59-5303-8962-b8d5e8bed838_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 489534,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/593ae5bfab714932913e3c53e266955e/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3ccbd74-4d59-5303-8962-b8d5e8bed838/a3ccbd74-4d59-5303-8962-b8d5e8bed838_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 432606,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/593ae5bfab714932913e3c53e266955e/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3ccbd74-4d59-5303-8962-b8d5e8bed838/a3ccbd74-4d59-5303-8962-b8d5e8bed838_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 527243,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/593ae5bfab714932913e3c53e266955e/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3ccbd74-4d59-5303-8962-b8d5e8bed838/a3ccbd74-4d59-5303-8962-b8d5e8bed838_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 314140,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/593ae5bfab714932913e3c53e266955e/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3ccbd74-4d59-5303-8962-b8d5e8bed838/a3ccbd74-4d59-5303-8962-b8d5e8bed838_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 361961,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/593ae5bfab714932913e3c53e266955e/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3ccbd74-4d59-5303-8962-b8d5e8bed838/a3ccbd74-4d59-5303-8962-b8d5e8bed838_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 272819,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/593ae5bfab714932913e3c53e266955e/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3ccbd74-4d59-5303-8962-b8d5e8bed838/a3ccbd74-4d59-5303-8962-b8d5e8bed838_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 382062,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/593ae5bfab714932913e3c53e266955e/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3ccbd74-4d59-5303-8962-b8d5e8bed838/a3ccbd74-4d59-5303-8962-b8d5e8bed838_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 458482,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/593ae5bfab714932913e3c53e266955e/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3ccbd74-4d59-5303-8962-b8d5e8bed838/a3ccbd74-4d59-5303-8962-b8d5e8bed838_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 254548,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/593ae5bfab714932913e3c53e266955e/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q2 1.5 35 TFSI ADVANCED',
 'transmission': 'manual',
 'trim': '1.5 35 TFSI ADVANCED',
 'vin': None,
 'year': 2022}
2026-03-26 22:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985561%27 HTTP/1.1" 200 None
2026-03-26 22:55:01 [ayvens.be] INFO: Saving data for 1985561: {'created_time': 1774565701.076662, 'last_price_update_time': 1774565701.076673, 'auction_closing_time': 1774958400.0}
2026-03-26 22:55:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985561') HTTP/1.1" 204 0
2026-03-26 22:55:01 [ayvens.be] INFO: Found listing with ID: 1985563
2026-03-26 22:55:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985563%27 HTTP/1.1" 200 None
2026-03-26 22:55:01 [ayvens.be] INFO: Scrape type for 1985563: 1
2026-03-26 22:55:01 [ayvens.be] INFO: Extracting data for car ID: 1985563
2026-03-26 22:55:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7bf6eef3-8789-54b4-b1b1-35ea4c56a479 with identifier: 1985563
2026-03-26 22:55:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7bf6eef3-8789-54b4-b1b1-35ea4c56a479 with scrape type 1
2026-03-26 22:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7bf6eef3-8789-54b4-b1b1-35ea4c56a479
2026-03-26 22:55:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fd05d1015c6d848b7aa2c16239070c7b2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/d05d1015c6d848b7aa2c16239070c7b2/images/large/1.jpg not downloaded yet
2026-03-26 22:55:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/8673b3f7eb724e3ebfd86cb72312a5ab/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fd05d1015c6d848b7aa2c16239070c7b2%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/d05d1015c6d848b7aa2c16239070c7b2/images/large/2.jpg not downloaded yet
2026-03-26 22:55:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/8673b3f7eb724e3ebfd86cb72312a5ab/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/8673b3f7eb724e3ebfd86cb72312a5ab/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/8673b3f7eb724e3ebfd86cb72312a5ab/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fd05d1015c6d848b7aa2c16239070c7b2%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/d05d1015c6d848b7aa2c16239070c7b2/images/large/3.jpg not downloaded yet
2026-03-26 22:55:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/8673b3f7eb724e3ebfd86cb72312a5ab/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fd05d1015c6d848b7aa2c16239070c7b2%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/d05d1015c6d848b7aa2c16239070c7b2/images/large/4.jpg not downloaded yet
2026-03-26 22:55:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/8673b3f7eb724e3ebfd86cb72312a5ab/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/8673b3f7eb724e3ebfd86cb72312a5ab/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fd05d1015c6d848b7aa2c16239070c7b2%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/d05d1015c6d848b7aa2c16239070c7b2/images/large/5.jpg not downloaded yet
2026-03-26 22:55:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fd05d1015c6d848b7aa2c16239070c7b2%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/d05d1015c6d848b7aa2c16239070c7b2/images/large/6.jpg not downloaded yet
2026-03-26 22:55:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fd05d1015c6d848b7aa2c16239070c7b2%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/d05d1015c6d848b7aa2c16239070c7b2/images/large/7.jpg not downloaded yet
2026-03-26 22:55:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79cdad0>
2026-03-26 22:55:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_def2c99e-3f4a-58de-ac43-9de97793e71f/def2c99e-3f4a-58de-ac43-9de97793e71f_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:55:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F8673b3f7eb724e3ebfd86cb72312a5ab%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/8673b3f7eb724e3ebfd86cb72312a5ab/images/large/1.jpg saved to cache
2026-03-26 22:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item def2c99e-3f4a-58de-ac43-9de97793e71f
2026-03-26 22:55:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fd05d1015c6d848b7aa2c16239070c7b2%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/d05d1015c6d848b7aa2c16239070c7b2/images/large/8.jpg not downloaded yet
2026-03-26 22:55:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fd05d1015c6d848b7aa2c16239070c7b2%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/d05d1015c6d848b7aa2c16239070c7b2/images/large/9.jpg not downloaded yet
2026-03-26 22:55:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7727410>
2026-03-26 22:55:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_def2c99e-3f4a-58de-ac43-9de97793e71f/def2c99e-3f4a-58de-ac43-9de97793e71f_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:55:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F8673b3f7eb724e3ebfd86cb72312a5ab%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/8673b3f7eb724e3ebfd86cb72312a5ab/images/large/2.jpg saved to cache
2026-03-26 22:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item def2c99e-3f4a-58de-ac43-9de97793e71f
2026-03-26 22:55:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd8d3010>
2026-03-26 22:55:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_def2c99e-3f4a-58de-ac43-9de97793e71f/def2c99e-3f4a-58de-ac43-9de97793e71f_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:55:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F8673b3f7eb724e3ebfd86cb72312a5ab%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/8673b3f7eb724e3ebfd86cb72312a5ab/images/large/4.jpg saved to cache
2026-03-26 22:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item def2c99e-3f4a-58de-ac43-9de97793e71f
2026-03-26 22:55:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b728fe90>
2026-03-26 22:55:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_def2c99e-3f4a-58de-ac43-9de97793e71f/def2c99e-3f4a-58de-ac43-9de97793e71f_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:55:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F8673b3f7eb724e3ebfd86cb72312a5ab%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/8673b3f7eb724e3ebfd86cb72312a5ab/images/large/3.jpg saved to cache
2026-03-26 22:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item def2c99e-3f4a-58de-ac43-9de97793e71f
2026-03-26 22:55:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7268fd0>
2026-03-26 22:55:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_def2c99e-3f4a-58de-ac43-9de97793e71f/def2c99e-3f4a-58de-ac43-9de97793e71f_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:55:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F8673b3f7eb724e3ebfd86cb72312a5ab%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/8673b3f7eb724e3ebfd86cb72312a5ab/images/large/5.jpg saved to cache
2026-03-26 22:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item def2c99e-3f4a-58de-ac43-9de97793e71f
2026-03-26 22:55:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd3bb310>
2026-03-26 22:55:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_def2c99e-3f4a-58de-ac43-9de97793e71f/def2c99e-3f4a-58de-ac43-9de97793e71f_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:55:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F8673b3f7eb724e3ebfd86cb72312a5ab%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/8673b3f7eb724e3ebfd86cb72312a5ab/images/large/6.jpg saved to cache
2026-03-26 22:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item def2c99e-3f4a-58de-ac43-9de97793e71f
2026-03-26 22:55:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c60190>
2026-03-26 22:55:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_def2c99e-3f4a-58de-ac43-9de97793e71f/def2c99e-3f4a-58de-ac43-9de97793e71f_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:55:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F8673b3f7eb724e3ebfd86cb72312a5ab%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/8673b3f7eb724e3ebfd86cb72312a5ab/images/large/7.jpg saved to cache
2026-03-26 22:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item def2c99e-3f4a-58de-ac43-9de97793e71f
2026-03-26 22:55:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fd05d1015c6d848b7aa2c16239070c7b2%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/d05d1015c6d848b7aa2c16239070c7b2/images/large/10.jpg not downloaded yet
2026-03-26 22:55:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/8673b3f7eb724e3ebfd86cb72312a5ab/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/d05d1015c6d848b7aa2c16239070c7b2/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:01 [ayvens.be] INFO: Found listing with ID: 1985564
2026-03-26 22:55:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985564%27 HTTP/1.1" 200 None
2026-03-26 22:55:01 [ayvens.be] INFO: Scrape type for 1985564: 1
2026-03-26 22:55:01 [ayvens.be] INFO: Extracting data for car ID: 1985564
2026-03-26 22:55:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2e328d8-b8fa-5e9a-aacc-ce7d1babb380 with identifier: 1985564
2026-03-26 22:55:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2e328d8-b8fa-5e9a-aacc-ce7d1babb380 with scrape type 1
2026-03-26 22:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e2e328d8-b8fa-5e9a-aacc-ce7d1babb380
2026-03-26 22:55:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fb363bb4c9a02456088903e6bc701a19e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/b363bb4c9a02456088903e6bc701a19e/images/large/1.jpg not downloaded yet
2026-03-26 22:55:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fb363bb4c9a02456088903e6bc701a19e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/b363bb4c9a02456088903e6bc701a19e/images/large/2.jpg not downloaded yet
2026-03-26 22:55:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/8673b3f7eb724e3ebfd86cb72312a5ab/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fb363bb4c9a02456088903e6bc701a19e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/b363bb4c9a02456088903e6bc701a19e/images/large/3.jpg not downloaded yet
2026-03-26 22:55:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/d05d1015c6d848b7aa2c16239070c7b2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/8673b3f7eb724e3ebfd86cb72312a5ab/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fb363bb4c9a02456088903e6bc701a19e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/b363bb4c9a02456088903e6bc701a19e/images/large/4.jpg not downloaded yet
2026-03-26 22:55:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fb363bb4c9a02456088903e6bc701a19e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/b363bb4c9a02456088903e6bc701a19e/images/large/5.jpg not downloaded yet
2026-03-26 22:55:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77c8410>
2026-03-26 22:55:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_def2c99e-3f4a-58de-ac43-9de97793e71f/def2c99e-3f4a-58de-ac43-9de97793e71f_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:55:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F8673b3f7eb724e3ebfd86cb72312a5ab%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/8673b3f7eb724e3ebfd86cb72312a5ab/images/large/9.jpg saved to cache
2026-03-26 22:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item def2c99e-3f4a-58de-ac43-9de97793e71f
2026-03-26 22:55:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b78a99d0>
2026-03-26 22:55:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bf6eef3-8789-54b4-b1b1-35ea4c56a479/7bf6eef3-8789-54b4-b1b1-35ea4c56a479_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:55:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fd05d1015c6d848b7aa2c16239070c7b2%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/d05d1015c6d848b7aa2c16239070c7b2/images/large/2.jpg saved to cache
2026-03-26 22:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7bf6eef3-8789-54b4-b1b1-35ea4c56a479
2026-03-26 22:55:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/d05d1015c6d848b7aa2c16239070c7b2/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/d05d1015c6d848b7aa2c16239070c7b2/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fb363bb4c9a02456088903e6bc701a19e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/b363bb4c9a02456088903e6bc701a19e/images/large/6.jpg not downloaded yet
2026-03-26 22:55:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/d05d1015c6d848b7aa2c16239070c7b2/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/d05d1015c6d848b7aa2c16239070c7b2/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fb363bb4c9a02456088903e6bc701a19e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/b363bb4c9a02456088903e6bc701a19e/images/large/7.jpg not downloaded yet
2026-03-26 22:55:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fb363bb4c9a02456088903e6bc701a19e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/b363bb4c9a02456088903e6bc701a19e/images/large/8.jpg not downloaded yet
2026-03-26 22:55:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79a4c10>
2026-03-26 22:55:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_def2c99e-3f4a-58de-ac43-9de97793e71f/def2c99e-3f4a-58de-ac43-9de97793e71f_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:55:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F8673b3f7eb724e3ebfd86cb72312a5ab%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/8673b3f7eb724e3ebfd86cb72312a5ab/images/large/10.jpg saved to cache
2026-03-26 22:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item def2c99e-3f4a-58de-ac43-9de97793e71f
2026-03-26 22:55:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76ec850>
2026-03-26 22:55:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bf6eef3-8789-54b4-b1b1-35ea4c56a479/7bf6eef3-8789-54b4-b1b1-35ea4c56a479_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:55:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fd05d1015c6d848b7aa2c16239070c7b2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/d05d1015c6d848b7aa2c16239070c7b2/images/large/1.jpg saved to cache
2026-03-26 22:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7bf6eef3-8789-54b4-b1b1-35ea4c56a479
2026-03-26 22:55:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7571590>
2026-03-26 22:55:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_def2c99e-3f4a-58de-ac43-9de97793e71f/def2c99e-3f4a-58de-ac43-9de97793e71f_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:55:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F8673b3f7eb724e3ebfd86cb72312a5ab%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/8673b3f7eb724e3ebfd86cb72312a5ab/images/large/8.jpg saved to cache
2026-03-26 22:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item def2c99e-3f4a-58de-ac43-9de97793e71f
2026-03-26 22:55:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: def2c99e-3f4a-58de-ac43-9de97793e71f, skipping ID generation
2026-03-26 22:55:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item def2c99e-3f4a-58de-ac43-9de97793e71f with scrape type 1
2026-03-26 22:55:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item def2c99e-3f4a-58de-ac43-9de97793e71f sending to next pipeline
2026-03-26 22:55:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: def2c99e-3f4a-58de-ac43-9de97793e71f, identifier: 1985562
2026-03-26 22:55:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: def2c99e-3f4a-58de-ac43-9de97793e71f with identifier: 1985562
2026-03-26 22:55:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: def2c99e-3f4a-58de-ac43-9de97793e71f with identifier: 1985562
2026-03-26 22:55:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: def2c99e-3f4a-58de-ac43-9de97793e71f with identifier: 1985562 to the API
2026-03-26 22:55:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:55:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:55:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ct/8673b3f7eb724e3ebfd86cb72312a5ab/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'def2c99e-3f4a-58de-ac43-9de97793e71f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3',
 'odometer': 42279,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 19,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_def2c99e-3f4a-58de-ac43-9de97793e71f/def2c99e-3f4a-58de-ac43-9de97793e71f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 701459,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/8673b3f7eb724e3ebfd86cb72312a5ab/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_def2c99e-3f4a-58de-ac43-9de97793e71f/def2c99e-3f4a-58de-ac43-9de97793e71f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 696027,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/8673b3f7eb724e3ebfd86cb72312a5ab/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_def2c99e-3f4a-58de-ac43-9de97793e71f/def2c99e-3f4a-58de-ac43-9de97793e71f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 690882,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/8673b3f7eb724e3ebfd86cb72312a5ab/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_def2c99e-3f4a-58de-ac43-9de97793e71f/def2c99e-3f4a-58de-ac43-9de97793e71f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 706526,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/8673b3f7eb724e3ebfd86cb72312a5ab/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_def2c99e-3f4a-58de-ac43-9de97793e71f/def2c99e-3f4a-58de-ac43-9de97793e71f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 702410,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/8673b3f7eb724e3ebfd86cb72312a5ab/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_def2c99e-3f4a-58de-ac43-9de97793e71f/def2c99e-3f4a-58de-ac43-9de97793e71f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 760335,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/8673b3f7eb724e3ebfd86cb72312a5ab/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_def2c99e-3f4a-58de-ac43-9de97793e71f/def2c99e-3f4a-58de-ac43-9de97793e71f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 559202,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/8673b3f7eb724e3ebfd86cb72312a5ab/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_def2c99e-3f4a-58de-ac43-9de97793e71f/def2c99e-3f4a-58de-ac43-9de97793e71f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 733872,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/8673b3f7eb724e3ebfd86cb72312a5ab/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_def2c99e-3f4a-58de-ac43-9de97793e71f/def2c99e-3f4a-58de-ac43-9de97793e71f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 744233,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/8673b3f7eb724e3ebfd86cb72312a5ab/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_def2c99e-3f4a-58de-ac43-9de97793e71f/def2c99e-3f4a-58de-ac43-9de97793e71f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 609838,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/8673b3f7eb724e3ebfd86cb72312a5ab/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 1.4 45 TFSI E S TRONIC',
 'transmission': 'automatic',
 'trim': '1.4 45 TFSI E S TRONIC',
 'vin': None,
 'year': 2022}
2026-03-26 22:55:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985562%27 HTTP/1.1" 200 None
2026-03-26 22:55:03 [ayvens.be] INFO: Saving data for 1985562: {'created_time': 1774565703.108921, 'last_price_update_time': 1774565703.108931, 'auction_closing_time': 1774958400.0}
2026-03-26 22:55:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985562') HTTP/1.1" 204 0
2026-03-26 22:55:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/d05d1015c6d848b7aa2c16239070c7b2/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/d05d1015c6d848b7aa2c16239070c7b2/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/d05d1015c6d848b7aa2c16239070c7b2/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fb363bb4c9a02456088903e6bc701a19e%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/b363bb4c9a02456088903e6bc701a19e/images/large/9.jpg not downloaded yet
2026-03-26 22:55:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b742bc50>
2026-03-26 22:55:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bf6eef3-8789-54b4-b1b1-35ea4c56a479/7bf6eef3-8789-54b4-b1b1-35ea4c56a479_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:55:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fd05d1015c6d848b7aa2c16239070c7b2%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/d05d1015c6d848b7aa2c16239070c7b2/images/large/8.jpg saved to cache
2026-03-26 22:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7bf6eef3-8789-54b4-b1b1-35ea4c56a479
2026-03-26 22:55:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7428290>
2026-03-26 22:55:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bf6eef3-8789-54b4-b1b1-35ea4c56a479/7bf6eef3-8789-54b4-b1b1-35ea4c56a479_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:55:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fd05d1015c6d848b7aa2c16239070c7b2%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/d05d1015c6d848b7aa2c16239070c7b2/images/large/6.jpg saved to cache
2026-03-26 22:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7bf6eef3-8789-54b4-b1b1-35ea4c56a479
2026-03-26 22:55:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/d05d1015c6d848b7aa2c16239070c7b2/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fb363bb4c9a02456088903e6bc701a19e%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/b363bb4c9a02456088903e6bc701a19e/images/large/10.jpg not downloaded yet
2026-03-26 22:55:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7428e90>
2026-03-26 22:55:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bf6eef3-8789-54b4-b1b1-35ea4c56a479/7bf6eef3-8789-54b4-b1b1-35ea4c56a479_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:55:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fd05d1015c6d848b7aa2c16239070c7b2%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/d05d1015c6d848b7aa2c16239070c7b2/images/large/7.jpg saved to cache
2026-03-26 22:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7bf6eef3-8789-54b4-b1b1-35ea4c56a479
2026-03-26 22:55:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c80310>
2026-03-26 22:55:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bf6eef3-8789-54b4-b1b1-35ea4c56a479/7bf6eef3-8789-54b4-b1b1-35ea4c56a479_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:55:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fd05d1015c6d848b7aa2c16239070c7b2%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/d05d1015c6d848b7aa2c16239070c7b2/images/large/10.jpg saved to cache
2026-03-26 22:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7bf6eef3-8789-54b4-b1b1-35ea4c56a479
2026-03-26 22:55:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79f2790>
2026-03-26 22:55:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bf6eef3-8789-54b4-b1b1-35ea4c56a479/7bf6eef3-8789-54b4-b1b1-35ea4c56a479_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:55:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fd05d1015c6d848b7aa2c16239070c7b2%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/d05d1015c6d848b7aa2c16239070c7b2/images/large/4.jpg saved to cache
2026-03-26 22:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7bf6eef3-8789-54b4-b1b1-35ea4c56a479
2026-03-26 22:55:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7268090>
2026-03-26 22:55:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bf6eef3-8789-54b4-b1b1-35ea4c56a479/7bf6eef3-8789-54b4-b1b1-35ea4c56a479_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:55:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fd05d1015c6d848b7aa2c16239070c7b2%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/d05d1015c6d848b7aa2c16239070c7b2/images/large/5.jpg saved to cache
2026-03-26 22:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7bf6eef3-8789-54b4-b1b1-35ea4c56a479
2026-03-26 22:55:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7409b90>
2026-03-26 22:55:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bf6eef3-8789-54b4-b1b1-35ea4c56a479/7bf6eef3-8789-54b4-b1b1-35ea4c56a479_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:55:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fd05d1015c6d848b7aa2c16239070c7b2%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/d05d1015c6d848b7aa2c16239070c7b2/images/large/9.jpg saved to cache
2026-03-26 22:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7bf6eef3-8789-54b4-b1b1-35ea4c56a479
2026-03-26 22:55:03 [ayvens.be] INFO: Found listing with ID: 1985565
2026-03-26 22:55:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985565%27 HTTP/1.1" 200 None
2026-03-26 22:55:03 [ayvens.be] INFO: Scrape type for 1985565: 1
2026-03-26 22:55:03 [ayvens.be] INFO: Extracting data for car ID: 1985565
2026-03-26 22:55:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d with identifier: 1985565
2026-03-26 22:55:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d with scrape type 1
2026-03-26 22:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d
2026-03-26 22:55:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ee%252F72ba451457b34d69aea23abbcdfb7495%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ee/72ba451457b34d69aea23abbcdfb7495/images/large/1.jpg not downloaded yet
2026-03-26 22:55:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ee%252F72ba451457b34d69aea23abbcdfb7495%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ee/72ba451457b34d69aea23abbcdfb7495/images/large/2.jpg not downloaded yet
2026-03-26 22:55:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd0c7510>
2026-03-26 22:55:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bf6eef3-8789-54b4-b1b1-35ea4c56a479/7bf6eef3-8789-54b4-b1b1-35ea4c56a479_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:55:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fd05d1015c6d848b7aa2c16239070c7b2%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/d05d1015c6d848b7aa2c16239070c7b2/images/large/3.jpg saved to cache
2026-03-26 22:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7bf6eef3-8789-54b4-b1b1-35ea4c56a479
2026-03-26 22:55:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7bf6eef3-8789-54b4-b1b1-35ea4c56a479, skipping ID generation
2026-03-26 22:55:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7bf6eef3-8789-54b4-b1b1-35ea4c56a479 with scrape type 1
2026-03-26 22:55:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7bf6eef3-8789-54b4-b1b1-35ea4c56a479 sending to next pipeline
2026-03-26 22:55:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 7bf6eef3-8789-54b4-b1b1-35ea4c56a479, identifier: 1985563
2026-03-26 22:55:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 7bf6eef3-8789-54b4-b1b1-35ea4c56a479 with identifier: 1985563
2026-03-26 22:55:04 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 22:55:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 22:55:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 7bf6eef3-8789-54b4-b1b1-35ea4c56a479 with identifier: 1985563
2026-03-26 22:55:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 7bf6eef3-8789-54b4-b1b1-35ea4c56a479 with identifier: 1985563 to the API
2026-03-26 22:55:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:55:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:55:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ab/d05d1015c6d848b7aa2c16239070c7b2/images/large/3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'MINERAL BLANC BRILLANT',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'electric',
 'id': '7bf6eef3-8789-54b4-b1b1-35ea4c56a479',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'Kangoo',
 'odometer': 17328,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bf6eef3-8789-54b4-b1b1-35ea4c56a479/7bf6eef3-8789-54b4-b1b1-35ea4c56a479_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 393070,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/d05d1015c6d848b7aa2c16239070c7b2/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bf6eef3-8789-54b4-b1b1-35ea4c56a479/7bf6eef3-8789-54b4-b1b1-35ea4c56a479_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 402458,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/d05d1015c6d848b7aa2c16239070c7b2/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bf6eef3-8789-54b4-b1b1-35ea4c56a479/7bf6eef3-8789-54b4-b1b1-35ea4c56a479_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 402553,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/d05d1015c6d848b7aa2c16239070c7b2/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bf6eef3-8789-54b4-b1b1-35ea4c56a479/7bf6eef3-8789-54b4-b1b1-35ea4c56a479_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 416333,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/d05d1015c6d848b7aa2c16239070c7b2/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bf6eef3-8789-54b4-b1b1-35ea4c56a479/7bf6eef3-8789-54b4-b1b1-35ea4c56a479_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 343397,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/d05d1015c6d848b7aa2c16239070c7b2/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bf6eef3-8789-54b4-b1b1-35ea4c56a479/7bf6eef3-8789-54b4-b1b1-35ea4c56a479_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 279262,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/d05d1015c6d848b7aa2c16239070c7b2/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bf6eef3-8789-54b4-b1b1-35ea4c56a479/7bf6eef3-8789-54b4-b1b1-35ea4c56a479_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 328454,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/d05d1015c6d848b7aa2c16239070c7b2/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bf6eef3-8789-54b4-b1b1-35ea4c56a479/7bf6eef3-8789-54b4-b1b1-35ea4c56a479_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 358493,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/d05d1015c6d848b7aa2c16239070c7b2/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bf6eef3-8789-54b4-b1b1-35ea4c56a479/7bf6eef3-8789-54b4-b1b1-35ea4c56a479_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 345463,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/d05d1015c6d848b7aa2c16239070c7b2/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bf6eef3-8789-54b4-b1b1-35ea4c56a479/7bf6eef3-8789-54b4-b1b1-35ea4c56a479_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113819,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/d05d1015c6d848b7aa2c16239070c7b2/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT Kangoo BEV 33KWH MAXI Z.E. B-BUY 5-SEATS',
 'transmission': 'automatic',
 'trim': 'BEV 33KWH MAXI Z.E. B-BUY 5-SEATS',
 'vin': None,
 'year': 2021}
2026-03-26 22:55:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985563%27 HTTP/1.1" 200 None
2026-03-26 22:55:04 [ayvens.be] INFO: Saving data for 1985563: {'created_time': 1774565704.325148, 'last_price_update_time': 1774565704.325157, 'auction_closing_time': 1774958400.0}
2026-03-26 22:55:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985563') HTTP/1.1" 204 0
2026-03-26 22:55:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ee%252F72ba451457b34d69aea23abbcdfb7495%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ee/72ba451457b34d69aea23abbcdfb7495/images/large/3.jpg not downloaded yet
2026-03-26 22:55:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/b363bb4c9a02456088903e6bc701a19e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/b363bb4c9a02456088903e6bc701a19e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ee%252F72ba451457b34d69aea23abbcdfb7495%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ee/72ba451457b34d69aea23abbcdfb7495/images/large/4.jpg not downloaded yet
2026-03-26 22:55:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/b363bb4c9a02456088903e6bc701a19e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/b363bb4c9a02456088903e6bc701a19e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ee%252F72ba451457b34d69aea23abbcdfb7495%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ee/72ba451457b34d69aea23abbcdfb7495/images/large/5.jpg not downloaded yet
2026-03-26 22:55:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/b363bb4c9a02456088903e6bc701a19e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ee%252F72ba451457b34d69aea23abbcdfb7495%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ee/72ba451457b34d69aea23abbcdfb7495/images/large/6.jpg not downloaded yet
2026-03-26 22:55:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/b363bb4c9a02456088903e6bc701a19e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/b363bb4c9a02456088903e6bc701a19e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ee%252F72ba451457b34d69aea23abbcdfb7495%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ee/72ba451457b34d69aea23abbcdfb7495/images/large/7.jpg not downloaded yet
2026-03-26 22:55:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/b363bb4c9a02456088903e6bc701a19e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ee%252F72ba451457b34d69aea23abbcdfb7495%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ee/72ba451457b34d69aea23abbcdfb7495/images/large/8.jpg not downloaded yet
2026-03-26 22:55:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ee%252F72ba451457b34d69aea23abbcdfb7495%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ee/72ba451457b34d69aea23abbcdfb7495/images/large/9.jpg not downloaded yet
2026-03-26 22:55:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ee%252F72ba451457b34d69aea23abbcdfb7495%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ee/72ba451457b34d69aea23abbcdfb7495/images/large/10.jpg not downloaded yet
2026-03-26 22:55:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b743bad0>
2026-03-26 22:55:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2e328d8-b8fa-5e9a-aacc-ce7d1babb380/e2e328d8-b8fa-5e9a-aacc-ce7d1babb380_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:55:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fb363bb4c9a02456088903e6bc701a19e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/b363bb4c9a02456088903e6bc701a19e/images/large/1.jpg saved to cache
2026-03-26 22:55:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e2e328d8-b8fa-5e9a-aacc-ce7d1babb380
2026-03-26 22:55:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e11cd0>
2026-03-26 22:55:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2e328d8-b8fa-5e9a-aacc-ce7d1babb380/e2e328d8-b8fa-5e9a-aacc-ce7d1babb380_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:55:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fb363bb4c9a02456088903e6bc701a19e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/b363bb4c9a02456088903e6bc701a19e/images/large/3.jpg saved to cache
2026-03-26 22:55:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e2e328d8-b8fa-5e9a-aacc-ce7d1babb380
2026-03-26 22:55:04 [ayvens.be] INFO: Found listing with ID: 1985566
2026-03-26 22:55:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985566%27 HTTP/1.1" 200 None
2026-03-26 22:55:04 [ayvens.be] INFO: Scrape type for 1985566: 1
2026-03-26 22:55:04 [ayvens.be] INFO: Extracting data for car ID: 1985566
2026-03-26 22:55:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 44b09540-2cfa-59a3-bcbe-719968d86e7f with identifier: 1985566
2026-03-26 22:55:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44b09540-2cfa-59a3-bcbe-719968d86e7f with scrape type 1
2026-03-26 22:55:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 44b09540-2cfa-59a3-bcbe-719968d86e7f
2026-03-26 22:55:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fm%252F901bd270746c4301801f63acb2e9d379%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fm/901bd270746c4301801f63acb2e9d379/images/large/1.jpg not downloaded yet
2026-03-26 22:55:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e4dd10>
2026-03-26 22:55:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2e328d8-b8fa-5e9a-aacc-ce7d1babb380/e2e328d8-b8fa-5e9a-aacc-ce7d1babb380_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:55:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fb363bb4c9a02456088903e6bc701a19e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/b363bb4c9a02456088903e6bc701a19e/images/large/4.jpg saved to cache
2026-03-26 22:55:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e2e328d8-b8fa-5e9a-aacc-ce7d1babb380
2026-03-26 22:55:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b146d0>
2026-03-26 22:55:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2e328d8-b8fa-5e9a-aacc-ce7d1babb380/e2e328d8-b8fa-5e9a-aacc-ce7d1babb380_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:55:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fb363bb4c9a02456088903e6bc701a19e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/b363bb4c9a02456088903e6bc701a19e/images/large/2.jpg saved to cache
2026-03-26 22:55:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e2e328d8-b8fa-5e9a-aacc-ce7d1babb380
2026-03-26 22:55:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fm%252F901bd270746c4301801f63acb2e9d379%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fm/901bd270746c4301801f63acb2e9d379/images/large/2.jpg not downloaded yet
2026-03-26 22:55:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7649a90>
2026-03-26 22:55:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2e328d8-b8fa-5e9a-aacc-ce7d1babb380/e2e328d8-b8fa-5e9a-aacc-ce7d1babb380_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:55:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fb363bb4c9a02456088903e6bc701a19e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/b363bb4c9a02456088903e6bc701a19e/images/large/7.jpg saved to cache
2026-03-26 22:55:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e2e328d8-b8fa-5e9a-aacc-ce7d1babb380
2026-03-26 22:55:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c829d0>
2026-03-26 22:55:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2e328d8-b8fa-5e9a-aacc-ce7d1babb380/e2e328d8-b8fa-5e9a-aacc-ce7d1babb380_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:55:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fb363bb4c9a02456088903e6bc701a19e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/b363bb4c9a02456088903e6bc701a19e/images/large/5.jpg saved to cache
2026-03-26 22:55:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e2e328d8-b8fa-5e9a-aacc-ce7d1babb380
2026-03-26 22:55:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74926d0>
2026-03-26 22:55:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2e328d8-b8fa-5e9a-aacc-ce7d1babb380/e2e328d8-b8fa-5e9a-aacc-ce7d1babb380_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:55:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fb363bb4c9a02456088903e6bc701a19e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/b363bb4c9a02456088903e6bc701a19e/images/large/6.jpg saved to cache
2026-03-26 22:55:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e2e328d8-b8fa-5e9a-aacc-ce7d1babb380
2026-03-26 22:55:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7570350>
2026-03-26 22:55:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2e328d8-b8fa-5e9a-aacc-ce7d1babb380/e2e328d8-b8fa-5e9a-aacc-ce7d1babb380_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:55:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fb363bb4c9a02456088903e6bc701a19e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/b363bb4c9a02456088903e6bc701a19e/images/large/8.jpg saved to cache
2026-03-26 22:55:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e2e328d8-b8fa-5e9a-aacc-ce7d1babb380
2026-03-26 22:55:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fm%252F901bd270746c4301801f63acb2e9d379%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fm/901bd270746c4301801f63acb2e9d379/images/large/3.jpg not downloaded yet
2026-03-26 22:55:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fm%252F901bd270746c4301801f63acb2e9d379%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fm/901bd270746c4301801f63acb2e9d379/images/large/4.jpg not downloaded yet
2026-03-26 22:55:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fm%252F901bd270746c4301801f63acb2e9d379%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fm/901bd270746c4301801f63acb2e9d379/images/large/5.jpg not downloaded yet
2026-03-26 22:55:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/b363bb4c9a02456088903e6bc701a19e/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ee/72ba451457b34d69aea23abbcdfb7495/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fm%252F901bd270746c4301801f63acb2e9d379%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fm/901bd270746c4301801f63acb2e9d379/images/large/6.jpg not downloaded yet
2026-03-26 22:55:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ee/72ba451457b34d69aea23abbcdfb7495/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ee/72ba451457b34d69aea23abbcdfb7495/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ee/72ba451457b34d69aea23abbcdfb7495/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fm%252F901bd270746c4301801f63acb2e9d379%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fm/901bd270746c4301801f63acb2e9d379/images/large/7.jpg not downloaded yet
2026-03-26 22:55:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ee/72ba451457b34d69aea23abbcdfb7495/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/b363bb4c9a02456088903e6bc701a19e/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fm%252F901bd270746c4301801f63acb2e9d379%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fm/901bd270746c4301801f63acb2e9d379/images/large/8.jpg not downloaded yet
2026-03-26 22:55:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fm%252F901bd270746c4301801f63acb2e9d379%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fm/901bd270746c4301801f63acb2e9d379/images/large/9.jpg not downloaded yet
2026-03-26 22:55:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fm%252F901bd270746c4301801f63acb2e9d379%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fm/901bd270746c4301801f63acb2e9d379/images/large/10.jpg not downloaded yet
2026-03-26 22:55:05 [ayvens.be] INFO: Found listing with ID: 1985567
2026-03-26 22:55:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985567%27 HTTP/1.1" 200 None
2026-03-26 22:55:05 [ayvens.be] INFO: Scrape type for 1985567: 1
2026-03-26 22:55:05 [ayvens.be] INFO: Extracting data for car ID: 1985567
2026-03-26 22:55:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99c16ce4-23e7-5da6-9da3-86696de860c7 with identifier: 1985567
2026-03-26 22:55:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99c16ce4-23e7-5da6-9da3-86696de860c7 with scrape type 1
2026-03-26 22:55:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 99c16ce4-23e7-5da6-9da3-86696de860c7
2026-03-26 22:55:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ef%252Fe26d79d379404db695f6751564ba09e5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ef/e26d79d379404db695f6751564ba09e5/images/large/1.jpg not downloaded yet
2026-03-26 22:55:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ef%252Fe26d79d379404db695f6751564ba09e5%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ef/e26d79d379404db695f6751564ba09e5/images/large/2.jpg not downloaded yet
2026-03-26 22:55:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7649f50>
2026-03-26 22:55:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2e328d8-b8fa-5e9a-aacc-ce7d1babb380/e2e328d8-b8fa-5e9a-aacc-ce7d1babb380_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:55:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fb363bb4c9a02456088903e6bc701a19e%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/b363bb4c9a02456088903e6bc701a19e/images/large/9.jpg saved to cache
2026-03-26 22:55:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e2e328d8-b8fa-5e9a-aacc-ce7d1babb380
2026-03-26 22:55:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74ae110>
2026-03-26 22:55:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d/2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:55:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ee%252F72ba451457b34d69aea23abbcdfb7495%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ee/72ba451457b34d69aea23abbcdfb7495/images/large/1.jpg saved to cache
2026-03-26 22:55:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d
2026-03-26 22:55:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e13b50>
2026-03-26 22:55:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d/2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:55:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ee%252F72ba451457b34d69aea23abbcdfb7495%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ee/72ba451457b34d69aea23abbcdfb7495/images/large/2.jpg saved to cache
2026-03-26 22:55:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d
2026-03-26 22:55:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7449e90>
2026-03-26 22:55:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d/2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:55:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ee%252F72ba451457b34d69aea23abbcdfb7495%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ee/72ba451457b34d69aea23abbcdfb7495/images/large/4.jpg saved to cache
2026-03-26 22:55:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d
2026-03-26 22:55:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7773d90>
2026-03-26 22:55:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d/2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:55:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ee%252F72ba451457b34d69aea23abbcdfb7495%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ee/72ba451457b34d69aea23abbcdfb7495/images/large/3.jpg saved to cache
2026-03-26 22:55:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d
2026-03-26 22:55:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ef%252Fe26d79d379404db695f6751564ba09e5%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ef/e26d79d379404db695f6751564ba09e5/images/large/3.jpg not downloaded yet
2026-03-26 22:55:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fm/901bd270746c4301801f63acb2e9d379/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e45a50>
2026-03-26 22:55:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d/2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ee%252F72ba451457b34d69aea23abbcdfb7495%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ee/72ba451457b34d69aea23abbcdfb7495/images/large/5.jpg saved to cache
2026-03-26 22:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d
2026-03-26 22:55:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6da59d0>
2026-03-26 22:55:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2e328d8-b8fa-5e9a-aacc-ce7d1babb380/e2e328d8-b8fa-5e9a-aacc-ce7d1babb380_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fb363bb4c9a02456088903e6bc701a19e%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/b363bb4c9a02456088903e6bc701a19e/images/large/10.jpg saved to cache
2026-03-26 22:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e2e328d8-b8fa-5e9a-aacc-ce7d1babb380
2026-03-26 22:55:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e2e328d8-b8fa-5e9a-aacc-ce7d1babb380, skipping ID generation
2026-03-26 22:55:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2e328d8-b8fa-5e9a-aacc-ce7d1babb380 with scrape type 1
2026-03-26 22:55:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e2e328d8-b8fa-5e9a-aacc-ce7d1babb380 sending to next pipeline
2026-03-26 22:55:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e2e328d8-b8fa-5e9a-aacc-ce7d1babb380, identifier: 1985564
2026-03-26 22:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ef%252Fe26d79d379404db695f6751564ba09e5%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ef/e26d79d379404db695f6751564ba09e5/images/large/4.jpg not downloaded yet
2026-03-26 22:55:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e2e328d8-b8fa-5e9a-aacc-ce7d1babb380 with identifier: 1985564
2026-03-26 22:55:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e2e328d8-b8fa-5e9a-aacc-ce7d1babb380 with identifier: 1985564
2026-03-26 22:55:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e2e328d8-b8fa-5e9a-aacc-ce7d1babb380 with identifier: 1985564 to the API
2026-03-26 22:55:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:55:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:55:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bl/b363bb4c9a02456088903e6bc701a19e/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'e2e328d8-b8fa-5e9a-aacc-ce7d1babb380',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'CITROAu2039N',
 'model': 'C5Aircross',
 'odometer': 93476,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 24,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2e328d8-b8fa-5e9a-aacc-ce7d1babb380/e2e328d8-b8fa-5e9a-aacc-ce7d1babb380_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 769673,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/b363bb4c9a02456088903e6bc701a19e/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2e328d8-b8fa-5e9a-aacc-ce7d1babb380/e2e328d8-b8fa-5e9a-aacc-ce7d1babb380_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 784444,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/b363bb4c9a02456088903e6bc701a19e/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2e328d8-b8fa-5e9a-aacc-ce7d1babb380/e2e328d8-b8fa-5e9a-aacc-ce7d1babb380_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 697543,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/b363bb4c9a02456088903e6bc701a19e/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2e328d8-b8fa-5e9a-aacc-ce7d1babb380/e2e328d8-b8fa-5e9a-aacc-ce7d1babb380_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 762635,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/b363bb4c9a02456088903e6bc701a19e/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2e328d8-b8fa-5e9a-aacc-ce7d1babb380/e2e328d8-b8fa-5e9a-aacc-ce7d1babb380_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 692019,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/b363bb4c9a02456088903e6bc701a19e/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2e328d8-b8fa-5e9a-aacc-ce7d1babb380/e2e328d8-b8fa-5e9a-aacc-ce7d1babb380_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 759938,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/b363bb4c9a02456088903e6bc701a19e/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2e328d8-b8fa-5e9a-aacc-ce7d1babb380/e2e328d8-b8fa-5e9a-aacc-ce7d1babb380_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 619178,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/b363bb4c9a02456088903e6bc701a19e/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2e328d8-b8fa-5e9a-aacc-ce7d1babb380/e2e328d8-b8fa-5e9a-aacc-ce7d1babb380_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 913728,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/b363bb4c9a02456088903e6bc701a19e/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2e328d8-b8fa-5e9a-aacc-ce7d1babb380/e2e328d8-b8fa-5e9a-aacc-ce7d1babb380_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 883938,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/b363bb4c9a02456088903e6bc701a19e/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2e328d8-b8fa-5e9a-aacc-ce7d1babb380/e2e328d8-b8fa-5e9a-aacc-ce7d1babb380_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 818142,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/b363bb4c9a02456088903e6bc701a19e/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROAu2039N C5Aircross 1.6 PHEV 225 E-EAT8 BUS. LOUNGE AUTO',
 'transmission': 'automatic',
 'trim': '1.6 PHEV 225 E-EAT8 BUS. LOUNGE AUTO',
 'vin': None,
 'year': 2022}
2026-03-26 22:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985564%27 HTTP/1.1" 200 None
2026-03-26 22:55:06 [ayvens.be] INFO: Saving data for 1985564: {'created_time': 1774565706.674732, 'last_price_update_time': 1774565706.674741, 'auction_closing_time': 1774958400.0}
2026-03-26 22:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985564') HTTP/1.1" 204 0
2026-03-26 22:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ef%252Fe26d79d379404db695f6751564ba09e5%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ef/e26d79d379404db695f6751564ba09e5/images/large/5.jpg not downloaded yet
2026-03-26 22:55:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e28ad0>
2026-03-26 22:55:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44b09540-2cfa-59a3-bcbe-719968d86e7f/44b09540-2cfa-59a3-bcbe-719968d86e7f_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fm%252F901bd270746c4301801f63acb2e9d379%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fm/901bd270746c4301801f63acb2e9d379/images/large/1.jpg saved to cache
2026-03-26 22:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 44b09540-2cfa-59a3-bcbe-719968d86e7f
2026-03-26 22:55:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ee/72ba451457b34d69aea23abbcdfb7495/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ef%252Fe26d79d379404db695f6751564ba09e5%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ef/e26d79d379404db695f6751564ba09e5/images/large/6.jpg not downloaded yet
2026-03-26 22:55:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ee/72ba451457b34d69aea23abbcdfb7495/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ee/72ba451457b34d69aea23abbcdfb7495/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fm/901bd270746c4301801f63acb2e9d379/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ef%252Fe26d79d379404db695f6751564ba09e5%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ef/e26d79d379404db695f6751564ba09e5/images/large/7.jpg not downloaded yet
2026-03-26 22:55:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ee/72ba451457b34d69aea23abbcdfb7495/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fm/901bd270746c4301801f63acb2e9d379/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ef%252Fe26d79d379404db695f6751564ba09e5%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ef/e26d79d379404db695f6751564ba09e5/images/large/8.jpg not downloaded yet
2026-03-26 22:55:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ee/72ba451457b34d69aea23abbcdfb7495/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:06 [scrapy.extensions.logstats] INFO: Crawled 13 pages (at 5 pages/min), scraped 345 items (at 37 items/min)
2026-03-26 22:55:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 182MiB
2026-03-26 22:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ef%252Fe26d79d379404db695f6751564ba09e5%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ef/e26d79d379404db695f6751564ba09e5/images/large/9.jpg not downloaded yet
2026-03-26 22:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ef%252Fe26d79d379404db695f6751564ba09e5%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ef/e26d79d379404db695f6751564ba09e5/images/large/10.jpg not downloaded yet
2026-03-26 22:55:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fm/901bd270746c4301801f63acb2e9d379/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:06 [ayvens.be] INFO: Found listing with ID: 1985568
2026-03-26 22:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985568%27 HTTP/1.1" 200 None
2026-03-26 22:55:06 [ayvens.be] INFO: Scrape type for 1985568: 1
2026-03-26 22:55:06 [ayvens.be] INFO: Extracting data for car ID: 1985568
2026-03-26 22:55:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be3059e2-656c-5e69-aca5-e764afd132b2 with identifier: 1985568
2026-03-26 22:55:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be3059e2-656c-5e69-aca5-e764afd132b2 with scrape type 1
2026-03-26 22:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item be3059e2-656c-5e69-aca5-e764afd132b2
2026-03-26 22:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252Fe486e8fcfdc04cee99063d8059d97e10%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/e486e8fcfdc04cee99063d8059d97e10/images/large/1.jpg not downloaded yet
2026-03-26 22:55:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7649290>
2026-03-26 22:55:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d/2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ee%252F72ba451457b34d69aea23abbcdfb7495%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ee/72ba451457b34d69aea23abbcdfb7495/images/large/8.jpg saved to cache
2026-03-26 22:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d
2026-03-26 22:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252Fe486e8fcfdc04cee99063d8059d97e10%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/e486e8fcfdc04cee99063d8059d97e10/images/large/2.jpg not downloaded yet
2026-03-26 22:55:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79a3010>
2026-03-26 22:55:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d/2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ee%252F72ba451457b34d69aea23abbcdfb7495%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ee/72ba451457b34d69aea23abbcdfb7495/images/large/7.jpg saved to cache
2026-03-26 22:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d
2026-03-26 22:55:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77beb50>
2026-03-26 22:55:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d/2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ee%252F72ba451457b34d69aea23abbcdfb7495%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ee/72ba451457b34d69aea23abbcdfb7495/images/large/10.jpg saved to cache
2026-03-26 22:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d
2026-03-26 22:55:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd0c4f10>
2026-03-26 22:55:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44b09540-2cfa-59a3-bcbe-719968d86e7f/44b09540-2cfa-59a3-bcbe-719968d86e7f_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fm%252F901bd270746c4301801f63acb2e9d379%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fm/901bd270746c4301801f63acb2e9d379/images/large/2.jpg saved to cache
2026-03-26 22:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 44b09540-2cfa-59a3-bcbe-719968d86e7f
2026-03-26 22:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252Fe486e8fcfdc04cee99063d8059d97e10%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/e486e8fcfdc04cee99063d8059d97e10/images/large/3.jpg not downloaded yet
2026-03-26 22:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252Fe486e8fcfdc04cee99063d8059d97e10%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/e486e8fcfdc04cee99063d8059d97e10/images/large/4.jpg not downloaded yet
2026-03-26 22:55:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b787c2d0>
2026-03-26 22:55:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d/2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ee%252F72ba451457b34d69aea23abbcdfb7495%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ee/72ba451457b34d69aea23abbcdfb7495/images/large/9.jpg saved to cache
2026-03-26 22:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d
2026-03-26 22:55:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6df0690>
2026-03-26 22:55:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44b09540-2cfa-59a3-bcbe-719968d86e7f/44b09540-2cfa-59a3-bcbe-719968d86e7f_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fm%252F901bd270746c4301801f63acb2e9d379%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fm/901bd270746c4301801f63acb2e9d379/images/large/3.jpg saved to cache
2026-03-26 22:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 44b09540-2cfa-59a3-bcbe-719968d86e7f
2026-03-26 22:55:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b78a85d0>
2026-03-26 22:55:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d/2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ee%252F72ba451457b34d69aea23abbcdfb7495%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ee/72ba451457b34d69aea23abbcdfb7495/images/large/6.jpg saved to cache
2026-03-26 22:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d
2026-03-26 22:55:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d, skipping ID generation
2026-03-26 22:55:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d with scrape type 1
2026-03-26 22:55:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d sending to next pipeline
2026-03-26 22:55:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d, identifier: 1985565
2026-03-26 22:55:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b729f350>
2026-03-26 22:55:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44b09540-2cfa-59a3-bcbe-719968d86e7f/44b09540-2cfa-59a3-bcbe-719968d86e7f_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fm%252F901bd270746c4301801f63acb2e9d379%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fm/901bd270746c4301801f63acb2e9d379/images/large/4.jpg saved to cache
2026-03-26 22:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 44b09540-2cfa-59a3-bcbe-719968d86e7f
2026-03-26 22:55:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d with identifier: 1985565
2026-03-26 22:55:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d with identifier: 1985565
2026-03-26 22:55:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d with identifier: 1985565 to the API
2026-03-26 22:55:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:55:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:55:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ee/72ba451457b34d69aea23abbcdfb7495/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'electric',
 'id': '2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'EQA',
 'odometer': 88931,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d/2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 773430,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ee/72ba451457b34d69aea23abbcdfb7495/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d/2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 776573,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ee/72ba451457b34d69aea23abbcdfb7495/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d/2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 801493,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ee/72ba451457b34d69aea23abbcdfb7495/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d/2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 838782,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ee/72ba451457b34d69aea23abbcdfb7495/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d/2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 821901,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ee/72ba451457b34d69aea23abbcdfb7495/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d/2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 873656,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ee/72ba451457b34d69aea23abbcdfb7495/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d/2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 656059,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ee/72ba451457b34d69aea23abbcdfb7495/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d/2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 742310,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ee/72ba451457b34d69aea23abbcdfb7495/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d/2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 735377,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ee/72ba451457b34d69aea23abbcdfb7495/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d/2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 761643,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ee/72ba451457b34d69aea23abbcdfb7495/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-09-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ EQA BEV 67KWH EQA 250 BUSINESS LINE',
 'transmission': 'automatic',
 'trim': 'BEV 67KWH EQA 250 BUSINESS LINE',
 'vin': None,
 'year': 2023}
2026-03-26 22:55:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985565%27 HTTP/1.1" 200 None
2026-03-26 22:55:08 [ayvens.be] INFO: Saving data for 1985565: {'created_time': 1774565708.266693, 'last_price_update_time': 1774565708.266702, 'auction_closing_time': 1774958400.0}
2026-03-26 22:55:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985565') HTTP/1.1" 204 0
2026-03-26 22:55:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252Fe486e8fcfdc04cee99063d8059d97e10%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/e486e8fcfdc04cee99063d8059d97e10/images/large/5.jpg not downloaded yet
2026-03-26 22:55:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252Fe486e8fcfdc04cee99063d8059d97e10%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/e486e8fcfdc04cee99063d8059d97e10/images/large/6.jpg not downloaded yet
2026-03-26 22:55:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fm/901bd270746c4301801f63acb2e9d379/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ef/e26d79d379404db695f6751564ba09e5/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fm/901bd270746c4301801f63acb2e9d379/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fm/901bd270746c4301801f63acb2e9d379/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252Fe486e8fcfdc04cee99063d8059d97e10%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/e486e8fcfdc04cee99063d8059d97e10/images/large/7.jpg not downloaded yet
2026-03-26 22:55:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ef/e26d79d379404db695f6751564ba09e5/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fm/901bd270746c4301801f63acb2e9d379/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fm/901bd270746c4301801f63acb2e9d379/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ef/e26d79d379404db695f6751564ba09e5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252Fe486e8fcfdc04cee99063d8059d97e10%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/e486e8fcfdc04cee99063d8059d97e10/images/large/8.jpg not downloaded yet
2026-03-26 22:55:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252Fe486e8fcfdc04cee99063d8059d97e10%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/e486e8fcfdc04cee99063d8059d97e10/images/large/9.jpg not downloaded yet
2026-03-26 22:55:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252Fe486e8fcfdc04cee99063d8059d97e10%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/e486e8fcfdc04cee99063d8059d97e10/images/large/10.jpg not downloaded yet
2026-03-26 22:55:08 [ayvens.be] INFO: Found listing with ID: 1985569
2026-03-26 22:55:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985569%27 HTTP/1.1" 200 None
2026-03-26 22:55:08 [ayvens.be] INFO: Scrape type for 1985569: 1
2026-03-26 22:55:08 [ayvens.be] INFO: Extracting data for car ID: 1985569
2026-03-26 22:55:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0980ad47-8713-5737-b72e-7ea91ca5aa84 with identifier: 1985569
2026-03-26 22:55:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0980ad47-8713-5737-b72e-7ea91ca5aa84 with scrape type 1
2026-03-26 22:55:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0980ad47-8713-5737-b72e-7ea91ca5aa84
2026-03-26 22:55:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fdab8941057fa43bb85bd50f1bdffb461%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/dab8941057fa43bb85bd50f1bdffb461/images/large/1.jpg not downloaded yet
2026-03-26 22:55:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fdab8941057fa43bb85bd50f1bdffb461%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/dab8941057fa43bb85bd50f1bdffb461/images/large/2.jpg not downloaded yet
2026-03-26 22:55:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b75a66d0>
2026-03-26 22:55:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44b09540-2cfa-59a3-bcbe-719968d86e7f/44b09540-2cfa-59a3-bcbe-719968d86e7f_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:55:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fm%252F901bd270746c4301801f63acb2e9d379%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fm/901bd270746c4301801f63acb2e9d379/images/large/9.jpg saved to cache
2026-03-26 22:55:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 44b09540-2cfa-59a3-bcbe-719968d86e7f
2026-03-26 22:55:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7449a90>
2026-03-26 22:55:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99c16ce4-23e7-5da6-9da3-86696de860c7/99c16ce4-23e7-5da6-9da3-86696de860c7_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:55:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ef%252Fe26d79d379404db695f6751564ba09e5%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ef/e26d79d379404db695f6751564ba09e5/images/large/2.jpg saved to cache
2026-03-26 22:55:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 99c16ce4-23e7-5da6-9da3-86696de860c7
2026-03-26 22:55:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b72efdd0>
2026-03-26 22:55:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44b09540-2cfa-59a3-bcbe-719968d86e7f/44b09540-2cfa-59a3-bcbe-719968d86e7f_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:55:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fm%252F901bd270746c4301801f63acb2e9d379%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fm/901bd270746c4301801f63acb2e9d379/images/large/5.jpg saved to cache
2026-03-26 22:55:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 44b09540-2cfa-59a3-bcbe-719968d86e7f
2026-03-26 22:55:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7440050>
2026-03-26 22:55:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44b09540-2cfa-59a3-bcbe-719968d86e7f/44b09540-2cfa-59a3-bcbe-719968d86e7f_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:55:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fm%252F901bd270746c4301801f63acb2e9d379%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fm/901bd270746c4301801f63acb2e9d379/images/large/7.jpg saved to cache
2026-03-26 22:55:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 44b09540-2cfa-59a3-bcbe-719968d86e7f
2026-03-26 22:55:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fdab8941057fa43bb85bd50f1bdffb461%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/dab8941057fa43bb85bd50f1bdffb461/images/large/3.jpg not downloaded yet
2026-03-26 22:55:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7412650>
2026-03-26 22:55:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99c16ce4-23e7-5da6-9da3-86696de860c7/99c16ce4-23e7-5da6-9da3-86696de860c7_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ef%252Fe26d79d379404db695f6751564ba09e5%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ef/e26d79d379404db695f6751564ba09e5/images/large/3.jpg saved to cache
2026-03-26 22:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 99c16ce4-23e7-5da6-9da3-86696de860c7
2026-03-26 22:55:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74e5290>
2026-03-26 22:55:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44b09540-2cfa-59a3-bcbe-719968d86e7f/44b09540-2cfa-59a3-bcbe-719968d86e7f_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fm%252F901bd270746c4301801f63acb2e9d379%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fm/901bd270746c4301801f63acb2e9d379/images/large/10.jpg saved to cache
2026-03-26 22:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 44b09540-2cfa-59a3-bcbe-719968d86e7f
2026-03-26 22:55:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7439ed0>
2026-03-26 22:55:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44b09540-2cfa-59a3-bcbe-719968d86e7f/44b09540-2cfa-59a3-bcbe-719968d86e7f_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fm%252F901bd270746c4301801f63acb2e9d379%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fm/901bd270746c4301801f63acb2e9d379/images/large/8.jpg saved to cache
2026-03-26 22:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 44b09540-2cfa-59a3-bcbe-719968d86e7f
2026-03-26 22:55:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c61490>
2026-03-26 22:55:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99c16ce4-23e7-5da6-9da3-86696de860c7/99c16ce4-23e7-5da6-9da3-86696de860c7_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ef%252Fe26d79d379404db695f6751564ba09e5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ef/e26d79d379404db695f6751564ba09e5/images/large/1.jpg saved to cache
2026-03-26 22:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 99c16ce4-23e7-5da6-9da3-86696de860c7
2026-03-26 22:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fdab8941057fa43bb85bd50f1bdffb461%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/dab8941057fa43bb85bd50f1bdffb461/images/large/4.jpg not downloaded yet
2026-03-26 22:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fdab8941057fa43bb85bd50f1bdffb461%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/dab8941057fa43bb85bd50f1bdffb461/images/large/5.jpg not downloaded yet
2026-03-26 22:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fdab8941057fa43bb85bd50f1bdffb461%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/dab8941057fa43bb85bd50f1bdffb461/images/large/6.jpg not downloaded yet
2026-03-26 22:55:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ef/e26d79d379404db695f6751564ba09e5/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/e486e8fcfdc04cee99063d8059d97e10/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ef/e26d79d379404db695f6751564ba09e5/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fdab8941057fa43bb85bd50f1bdffb461%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/dab8941057fa43bb85bd50f1bdffb461/images/large/7.jpg not downloaded yet
2026-03-26 22:55:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fm/901bd270746c4301801f63acb2e9d379/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/e486e8fcfdc04cee99063d8059d97e10/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/e486e8fcfdc04cee99063d8059d97e10/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fdab8941057fa43bb85bd50f1bdffb461%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/dab8941057fa43bb85bd50f1bdffb461/images/large/8.jpg not downloaded yet
2026-03-26 22:55:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ef/e26d79d379404db695f6751564ba09e5/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fdab8941057fa43bb85bd50f1bdffb461%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/dab8941057fa43bb85bd50f1bdffb461/images/large/9.jpg not downloaded yet
2026-03-26 22:55:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ef/e26d79d379404db695f6751564ba09e5/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fdab8941057fa43bb85bd50f1bdffb461%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/dab8941057fa43bb85bd50f1bdffb461/images/large/10.jpg not downloaded yet
2026-03-26 22:55:09 [ayvens.be] INFO: Found listing with ID: 1985570
2026-03-26 22:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985570%27 HTTP/1.1" 200 None
2026-03-26 22:55:09 [ayvens.be] INFO: Scrape type for 1985570: 1
2026-03-26 22:55:09 [ayvens.be] INFO: Extracting data for car ID: 1985570
2026-03-26 22:55:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 966881a6-57ad-58a3-8bb5-1938c5357336 with identifier: 1985570
2026-03-26 22:55:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 966881a6-57ad-58a3-8bb5-1938c5357336 with scrape type 1
2026-03-26 22:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 966881a6-57ad-58a3-8bb5-1938c5357336
2026-03-26 22:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2db%252F9d4566ff19cb454dba09c15b09e07758%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2db/9d4566ff19cb454dba09c15b09e07758/images/large/1.jpg not downloaded yet
2026-03-26 22:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2db%252F9d4566ff19cb454dba09c15b09e07758%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2db/9d4566ff19cb454dba09c15b09e07758/images/large/2.jpg not downloaded yet
2026-03-26 22:55:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7412410>
2026-03-26 22:55:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99c16ce4-23e7-5da6-9da3-86696de860c7/99c16ce4-23e7-5da6-9da3-86696de860c7_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ef%252Fe26d79d379404db695f6751564ba09e5%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ef/e26d79d379404db695f6751564ba09e5/images/large/5.jpg saved to cache
2026-03-26 22:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 99c16ce4-23e7-5da6-9da3-86696de860c7
2026-03-26 22:55:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7436bd0>
2026-03-26 22:55:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be3059e2-656c-5e69-aca5-e764afd132b2/be3059e2-656c-5e69-aca5-e764afd132b2_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252Fe486e8fcfdc04cee99063d8059d97e10%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/e486e8fcfdc04cee99063d8059d97e10/images/large/2.jpg saved to cache
2026-03-26 22:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item be3059e2-656c-5e69-aca5-e764afd132b2
2026-03-26 22:55:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c95450>
2026-03-26 22:55:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99c16ce4-23e7-5da6-9da3-86696de860c7/99c16ce4-23e7-5da6-9da3-86696de860c7_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ef%252Fe26d79d379404db695f6751564ba09e5%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ef/e26d79d379404db695f6751564ba09e5/images/large/4.jpg saved to cache
2026-03-26 22:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 99c16ce4-23e7-5da6-9da3-86696de860c7
2026-03-26 22:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2db%252F9d4566ff19cb454dba09c15b09e07758%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2db/9d4566ff19cb454dba09c15b09e07758/images/large/3.jpg not downloaded yet
2026-03-26 22:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2db%252F9d4566ff19cb454dba09c15b09e07758%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2db/9d4566ff19cb454dba09c15b09e07758/images/large/4.jpg not downloaded yet
2026-03-26 22:55:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b741cad0>
2026-03-26 22:55:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44b09540-2cfa-59a3-bcbe-719968d86e7f/44b09540-2cfa-59a3-bcbe-719968d86e7f_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fm%252F901bd270746c4301801f63acb2e9d379%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fm/901bd270746c4301801f63acb2e9d379/images/large/6.jpg saved to cache
2026-03-26 22:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 44b09540-2cfa-59a3-bcbe-719968d86e7f
2026-03-26 22:55:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 44b09540-2cfa-59a3-bcbe-719968d86e7f, skipping ID generation
2026-03-26 22:55:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44b09540-2cfa-59a3-bcbe-719968d86e7f with scrape type 1
2026-03-26 22:55:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 44b09540-2cfa-59a3-bcbe-719968d86e7f sending to next pipeline
2026-03-26 22:55:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 44b09540-2cfa-59a3-bcbe-719968d86e7f, identifier: 1985566
2026-03-26 22:55:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7768dd0>
2026-03-26 22:55:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be3059e2-656c-5e69-aca5-e764afd132b2/be3059e2-656c-5e69-aca5-e764afd132b2_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252Fe486e8fcfdc04cee99063d8059d97e10%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/e486e8fcfdc04cee99063d8059d97e10/images/large/3.jpg saved to cache
2026-03-26 22:55:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item be3059e2-656c-5e69-aca5-e764afd132b2
2026-03-26 22:55:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b787d690>
2026-03-26 22:55:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be3059e2-656c-5e69-aca5-e764afd132b2/be3059e2-656c-5e69-aca5-e764afd132b2_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252Fe486e8fcfdc04cee99063d8059d97e10%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/e486e8fcfdc04cee99063d8059d97e10/images/large/1.jpg saved to cache
2026-03-26 22:55:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item be3059e2-656c-5e69-aca5-e764afd132b2
2026-03-26 22:55:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7ae9e50>
2026-03-26 22:55:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99c16ce4-23e7-5da6-9da3-86696de860c7/99c16ce4-23e7-5da6-9da3-86696de860c7_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ef%252Fe26d79d379404db695f6751564ba09e5%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ef/e26d79d379404db695f6751564ba09e5/images/large/6.jpg saved to cache
2026-03-26 22:55:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 99c16ce4-23e7-5da6-9da3-86696de860c7
2026-03-26 22:55:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b768bed0>
2026-03-26 22:55:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99c16ce4-23e7-5da6-9da3-86696de860c7/99c16ce4-23e7-5da6-9da3-86696de860c7_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ef%252Fe26d79d379404db695f6751564ba09e5%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ef/e26d79d379404db695f6751564ba09e5/images/large/10.jpg saved to cache
2026-03-26 22:55:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 99c16ce4-23e7-5da6-9da3-86696de860c7
2026-03-26 22:55:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 44b09540-2cfa-59a3-bcbe-719968d86e7f with identifier: 1985566
2026-03-26 22:55:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 44b09540-2cfa-59a3-bcbe-719968d86e7f with identifier: 1985566
2026-03-26 22:55:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 44b09540-2cfa-59a3-bcbe-719968d86e7f with identifier: 1985566 to the API
2026-03-26 22:55:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:55:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:55:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2fm/901bd270746c4301801f63acb2e9d379/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'electric',
 'id': '44b09540-2cfa-59a3-bcbe-719968d86e7f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q4 SPORTBACK E-TRON',
 'odometer': 13316,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44b09540-2cfa-59a3-bcbe-719968d86e7f/44b09540-2cfa-59a3-bcbe-719968d86e7f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 751712,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fm/901bd270746c4301801f63acb2e9d379/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44b09540-2cfa-59a3-bcbe-719968d86e7f/44b09540-2cfa-59a3-bcbe-719968d86e7f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 702514,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fm/901bd270746c4301801f63acb2e9d379/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44b09540-2cfa-59a3-bcbe-719968d86e7f/44b09540-2cfa-59a3-bcbe-719968d86e7f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 735973,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fm/901bd270746c4301801f63acb2e9d379/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44b09540-2cfa-59a3-bcbe-719968d86e7f/44b09540-2cfa-59a3-bcbe-719968d86e7f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 750287,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fm/901bd270746c4301801f63acb2e9d379/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44b09540-2cfa-59a3-bcbe-719968d86e7f/44b09540-2cfa-59a3-bcbe-719968d86e7f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 711157,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fm/901bd270746c4301801f63acb2e9d379/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44b09540-2cfa-59a3-bcbe-719968d86e7f/44b09540-2cfa-59a3-bcbe-719968d86e7f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 762435,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fm/901bd270746c4301801f63acb2e9d379/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44b09540-2cfa-59a3-bcbe-719968d86e7f/44b09540-2cfa-59a3-bcbe-719968d86e7f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 593775,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fm/901bd270746c4301801f63acb2e9d379/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44b09540-2cfa-59a3-bcbe-719968d86e7f/44b09540-2cfa-59a3-bcbe-719968d86e7f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 691071,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fm/901bd270746c4301801f63acb2e9d379/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44b09540-2cfa-59a3-bcbe-719968d86e7f/44b09540-2cfa-59a3-bcbe-719968d86e7f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 717936,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fm/901bd270746c4301801f63acb2e9d379/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44b09540-2cfa-59a3-bcbe-719968d86e7f/44b09540-2cfa-59a3-bcbe-719968d86e7f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 703005,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fm/901bd270746c4301801f63acb2e9d379/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-06-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q4 SPORTBACK E-TRON BEV 82KWH 40 ADVANCED AUTO',
 'transmission': 'automatic',
 'trim': 'BEV 82KWH 40 ADVANCED AUTO',
 'vin': None,
 'year': 2024}
2026-03-26 22:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985566%27 HTTP/1.1" 200 None
2026-03-26 22:55:10 [ayvens.be] INFO: Saving data for 1985566: {'created_time': 1774565710.861352, 'last_price_update_time': 1774565710.861362, 'auction_closing_time': 1774958400.0}
2026-03-26 22:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985566') HTTP/1.1" 204 0
2026-03-26 22:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2db%252F9d4566ff19cb454dba09c15b09e07758%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2db/9d4566ff19cb454dba09c15b09e07758/images/large/5.jpg not downloaded yet
2026-03-26 22:55:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/e486e8fcfdc04cee99063d8059d97e10/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2db%252F9d4566ff19cb454dba09c15b09e07758%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2db/9d4566ff19cb454dba09c15b09e07758/images/large/6.jpg not downloaded yet
2026-03-26 22:55:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/dab8941057fa43bb85bd50f1bdffb461/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/dab8941057fa43bb85bd50f1bdffb461/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2db%252F9d4566ff19cb454dba09c15b09e07758%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2db/9d4566ff19cb454dba09c15b09e07758/images/large/7.jpg not downloaded yet
2026-03-26 22:55:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/dab8941057fa43bb85bd50f1bdffb461/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/e486e8fcfdc04cee99063d8059d97e10/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/e486e8fcfdc04cee99063d8059d97e10/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2db%252F9d4566ff19cb454dba09c15b09e07758%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2db/9d4566ff19cb454dba09c15b09e07758/images/large/8.jpg not downloaded yet
2026-03-26 22:55:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/e486e8fcfdc04cee99063d8059d97e10/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/e486e8fcfdc04cee99063d8059d97e10/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2db%252F9d4566ff19cb454dba09c15b09e07758%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2db/9d4566ff19cb454dba09c15b09e07758/images/large/9.jpg not downloaded yet
2026-03-26 22:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2db%252F9d4566ff19cb454dba09c15b09e07758%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2db/9d4566ff19cb454dba09c15b09e07758/images/large/10.jpg not downloaded yet
2026-03-26 22:55:11 [ayvens.be] INFO: Found listing with ID: 1985571
2026-03-26 22:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985571%27 HTTP/1.1" 200 None
2026-03-26 22:55:11 [ayvens.be] INFO: Scrape type for 1985571: 1
2026-03-26 22:55:11 [ayvens.be] INFO: Extracting data for car ID: 1985571
2026-03-26 22:55:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c41590c-6777-5c3e-bdc0-3649b66068c8 with identifier: 1985571
2026-03-26 22:55:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c41590c-6777-5c3e-bdc0-3649b66068c8 with scrape type 1
2026-03-26 22:55:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8c41590c-6777-5c3e-bdc0-3649b66068c8
2026-03-26 22:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F3864125516b14cc597fedc9af971992d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/3864125516b14cc597fedc9af971992d/images/large/1.jpg not downloaded yet
2026-03-26 22:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F3864125516b14cc597fedc9af971992d%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/3864125516b14cc597fedc9af971992d/images/large/2.jpg not downloaded yet
2026-03-26 22:55:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7474750>
2026-03-26 22:55:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be3059e2-656c-5e69-aca5-e764afd132b2/be3059e2-656c-5e69-aca5-e764afd132b2_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252Fe486e8fcfdc04cee99063d8059d97e10%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/e486e8fcfdc04cee99063d8059d97e10/images/large/7.jpg saved to cache
2026-03-26 22:55:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item be3059e2-656c-5e69-aca5-e764afd132b2
2026-03-26 22:55:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74aeb50>
2026-03-26 22:55:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0980ad47-8713-5737-b72e-7ea91ca5aa84/0980ad47-8713-5737-b72e-7ea91ca5aa84_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fdab8941057fa43bb85bd50f1bdffb461%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/dab8941057fa43bb85bd50f1bdffb461/images/large/1.jpg saved to cache
2026-03-26 22:55:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0980ad47-8713-5737-b72e-7ea91ca5aa84
2026-03-26 22:55:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b764aa10>
2026-03-26 22:55:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0980ad47-8713-5737-b72e-7ea91ca5aa84/0980ad47-8713-5737-b72e-7ea91ca5aa84_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fdab8941057fa43bb85bd50f1bdffb461%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/dab8941057fa43bb85bd50f1bdffb461/images/large/3.jpg saved to cache
2026-03-26 22:55:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0980ad47-8713-5737-b72e-7ea91ca5aa84
2026-03-26 22:55:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b726b910>
2026-03-26 22:55:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0980ad47-8713-5737-b72e-7ea91ca5aa84/0980ad47-8713-5737-b72e-7ea91ca5aa84_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fdab8941057fa43bb85bd50f1bdffb461%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/dab8941057fa43bb85bd50f1bdffb461/images/large/2.jpg saved to cache
2026-03-26 22:55:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0980ad47-8713-5737-b72e-7ea91ca5aa84
2026-03-26 22:55:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74af8d0>
2026-03-26 22:55:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be3059e2-656c-5e69-aca5-e764afd132b2/be3059e2-656c-5e69-aca5-e764afd132b2_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252Fe486e8fcfdc04cee99063d8059d97e10%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/e486e8fcfdc04cee99063d8059d97e10/images/large/8.jpg saved to cache
2026-03-26 22:55:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item be3059e2-656c-5e69-aca5-e764afd132b2
2026-03-26 22:55:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7451e10>
2026-03-26 22:55:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be3059e2-656c-5e69-aca5-e764afd132b2/be3059e2-656c-5e69-aca5-e764afd132b2_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252Fe486e8fcfdc04cee99063d8059d97e10%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/e486e8fcfdc04cee99063d8059d97e10/images/large/6.jpg saved to cache
2026-03-26 22:55:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item be3059e2-656c-5e69-aca5-e764afd132b2
2026-03-26 22:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F3864125516b14cc597fedc9af971992d%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/3864125516b14cc597fedc9af971992d/images/large/3.jpg not downloaded yet
2026-03-26 22:55:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2db/9d4566ff19cb454dba09c15b09e07758/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b787cc50>
2026-03-26 22:55:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be3059e2-656c-5e69-aca5-e764afd132b2/be3059e2-656c-5e69-aca5-e764afd132b2_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252Fe486e8fcfdc04cee99063d8059d97e10%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/e486e8fcfdc04cee99063d8059d97e10/images/large/10.jpg saved to cache
2026-03-26 22:55:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item be3059e2-656c-5e69-aca5-e764afd132b2
2026-03-26 22:55:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b787dc90>
2026-03-26 22:55:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be3059e2-656c-5e69-aca5-e764afd132b2/be3059e2-656c-5e69-aca5-e764afd132b2_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252Fe486e8fcfdc04cee99063d8059d97e10%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/e486e8fcfdc04cee99063d8059d97e10/images/large/9.jpg saved to cache
2026-03-26 22:55:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item be3059e2-656c-5e69-aca5-e764afd132b2
2026-03-26 22:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F3864125516b14cc597fedc9af971992d%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/3864125516b14cc597fedc9af971992d/images/large/4.jpg not downloaded yet
2026-03-26 22:55:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2db/9d4566ff19cb454dba09c15b09e07758/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F3864125516b14cc597fedc9af971992d%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/3864125516b14cc597fedc9af971992d/images/large/5.jpg not downloaded yet
2026-03-26 22:55:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7a57110>
2026-03-26 22:55:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_966881a6-57ad-58a3-8bb5-1938c5357336/966881a6-57ad-58a3-8bb5-1938c5357336_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2db%252F9d4566ff19cb454dba09c15b09e07758%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2db/9d4566ff19cb454dba09c15b09e07758/images/large/3.jpg saved to cache
2026-03-26 22:55:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 966881a6-57ad-58a3-8bb5-1938c5357336
2026-03-26 22:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F3864125516b14cc597fedc9af971992d%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/3864125516b14cc597fedc9af971992d/images/large/6.jpg not downloaded yet
2026-03-26 22:55:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/e486e8fcfdc04cee99063d8059d97e10/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F3864125516b14cc597fedc9af971992d%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/3864125516b14cc597fedc9af971992d/images/large/7.jpg not downloaded yet
2026-03-26 22:55:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/dab8941057fa43bb85bd50f1bdffb461/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/e486e8fcfdc04cee99063d8059d97e10/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F3864125516b14cc597fedc9af971992d%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/3864125516b14cc597fedc9af971992d/images/large/8.jpg not downloaded yet
2026-03-26 22:55:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/dab8941057fa43bb85bd50f1bdffb461/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2db/9d4566ff19cb454dba09c15b09e07758/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6d83b10>
2026-03-26 22:55:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_966881a6-57ad-58a3-8bb5-1938c5357336/966881a6-57ad-58a3-8bb5-1938c5357336_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2db%252F9d4566ff19cb454dba09c15b09e07758%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2db/9d4566ff19cb454dba09c15b09e07758/images/large/2.jpg saved to cache
2026-03-26 22:55:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 966881a6-57ad-58a3-8bb5-1938c5357336
2026-03-26 22:55:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ef/e26d79d379404db695f6751564ba09e5/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/dab8941057fa43bb85bd50f1bdffb461/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F3864125516b14cc597fedc9af971992d%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/3864125516b14cc597fedc9af971992d/images/large/9.jpg not downloaded yet
2026-03-26 22:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F3864125516b14cc597fedc9af971992d%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/3864125516b14cc597fedc9af971992d/images/large/10.jpg not downloaded yet
2026-03-26 22:55:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2db/9d4566ff19cb454dba09c15b09e07758/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:12 [ayvens.be] INFO: Found listing with ID: 1985572
2026-03-26 22:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985572%27 HTTP/1.1" 200 None
2026-03-26 22:55:12 [ayvens.be] INFO: Scrape type for 1985572: 1
2026-03-26 22:55:12 [ayvens.be] INFO: Extracting data for car ID: 1985572
2026-03-26 22:55:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 438d6f36-9e95-56f4-aabe-ce1ba17d0ad8 with identifier: 1985572
2026-03-26 22:55:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 438d6f36-9e95-56f4-aabe-ce1ba17d0ad8 with scrape type 1
2026-03-26 22:55:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 438d6f36-9e95-56f4-aabe-ce1ba17d0ad8
2026-03-26 22:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252Fbc34a985835b4e9daa94b7f587675709%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/bc34a985835b4e9daa94b7f587675709/images/large/1.jpg not downloaded yet
2026-03-26 22:55:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b741e410>
2026-03-26 22:55:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be3059e2-656c-5e69-aca5-e764afd132b2/be3059e2-656c-5e69-aca5-e764afd132b2_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252Fe486e8fcfdc04cee99063d8059d97e10%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/e486e8fcfdc04cee99063d8059d97e10/images/large/5.jpg saved to cache
2026-03-26 22:55:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item be3059e2-656c-5e69-aca5-e764afd132b2
2026-03-26 22:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252Fbc34a985835b4e9daa94b7f587675709%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/bc34a985835b4e9daa94b7f587675709/images/large/2.jpg not downloaded yet
2026-03-26 22:55:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77ae510>
2026-03-26 22:55:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0980ad47-8713-5737-b72e-7ea91ca5aa84/0980ad47-8713-5737-b72e-7ea91ca5aa84_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fdab8941057fa43bb85bd50f1bdffb461%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/dab8941057fa43bb85bd50f1bdffb461/images/large/5.jpg saved to cache
2026-03-26 22:55:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0980ad47-8713-5737-b72e-7ea91ca5aa84
2026-03-26 22:55:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79dea10>
2026-03-26 22:55:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be3059e2-656c-5e69-aca5-e764afd132b2/be3059e2-656c-5e69-aca5-e764afd132b2_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252Fe486e8fcfdc04cee99063d8059d97e10%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/e486e8fcfdc04cee99063d8059d97e10/images/large/4.jpg saved to cache
2026-03-26 22:55:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item be3059e2-656c-5e69-aca5-e764afd132b2
2026-03-26 22:55:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: be3059e2-656c-5e69-aca5-e764afd132b2, skipping ID generation
2026-03-26 22:55:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be3059e2-656c-5e69-aca5-e764afd132b2 with scrape type 1
2026-03-26 22:55:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item be3059e2-656c-5e69-aca5-e764afd132b2 sending to next pipeline
2026-03-26 22:55:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: be3059e2-656c-5e69-aca5-e764afd132b2, identifier: 1985568
2026-03-26 22:55:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2db/9d4566ff19cb454dba09c15b09e07758/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: be3059e2-656c-5e69-aca5-e764afd132b2 with identifier: 1985568
2026-03-26 22:55:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: be3059e2-656c-5e69-aca5-e764afd132b2 with identifier: 1985568
2026-03-26 22:55:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: be3059e2-656c-5e69-aca5-e764afd132b2 with identifier: 1985568 to the API
2026-03-26 22:55:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:55:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:55:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bu/e486e8fcfdc04cee99063d8059d97e10/images/large/4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'be3059e2-656c-5e69-aca5-e764afd132b2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X3',
 'odometer': 124353,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be3059e2-656c-5e69-aca5-e764afd132b2/be3059e2-656c-5e69-aca5-e764afd132b2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 659134,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/e486e8fcfdc04cee99063d8059d97e10/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be3059e2-656c-5e69-aca5-e764afd132b2/be3059e2-656c-5e69-aca5-e764afd132b2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 662456,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/e486e8fcfdc04cee99063d8059d97e10/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be3059e2-656c-5e69-aca5-e764afd132b2/be3059e2-656c-5e69-aca5-e764afd132b2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 699342,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/e486e8fcfdc04cee99063d8059d97e10/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be3059e2-656c-5e69-aca5-e764afd132b2/be3059e2-656c-5e69-aca5-e764afd132b2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 701492,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/e486e8fcfdc04cee99063d8059d97e10/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be3059e2-656c-5e69-aca5-e764afd132b2/be3059e2-656c-5e69-aca5-e764afd132b2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 682752,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/e486e8fcfdc04cee99063d8059d97e10/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be3059e2-656c-5e69-aca5-e764afd132b2/be3059e2-656c-5e69-aca5-e764afd132b2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 684411,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/e486e8fcfdc04cee99063d8059d97e10/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be3059e2-656c-5e69-aca5-e764afd132b2/be3059e2-656c-5e69-aca5-e764afd132b2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 585952,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/e486e8fcfdc04cee99063d8059d97e10/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be3059e2-656c-5e69-aca5-e764afd132b2/be3059e2-656c-5e69-aca5-e764afd132b2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 853088,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/e486e8fcfdc04cee99063d8059d97e10/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be3059e2-656c-5e69-aca5-e764afd132b2/be3059e2-656c-5e69-aca5-e764afd132b2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 919662,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/e486e8fcfdc04cee99063d8059d97e10/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be3059e2-656c-5e69-aca5-e764afd132b2/be3059e2-656c-5e69-aca5-e764afd132b2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 919662,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/e486e8fcfdc04cee99063d8059d97e10/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X3 2.0 XDRIVE30E (120KW) AUTO',
 'transmission': 'automatic',
 'trim': '2.0 XDRIVE30E (120KW) AUTO',
 'vin': None,
 'year': 2022}
2026-03-26 22:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985568%27 HTTP/1.1" 200 None
2026-03-26 22:55:12 [ayvens.be] INFO: Saving data for 1985568: {'created_time': 1774565712.891578, 'last_price_update_time': 1774565712.891587, 'auction_closing_time': 1774958400.0}
2026-03-26 22:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985568') HTTP/1.1" 204 0
2026-03-26 22:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252Fbc34a985835b4e9daa94b7f587675709%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/bc34a985835b4e9daa94b7f587675709/images/large/3.jpg not downloaded yet
2026-03-26 22:55:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2db/9d4566ff19cb454dba09c15b09e07758/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b776b990>
2026-03-26 22:55:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0980ad47-8713-5737-b72e-7ea91ca5aa84/0980ad47-8713-5737-b72e-7ea91ca5aa84_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fdab8941057fa43bb85bd50f1bdffb461%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/dab8941057fa43bb85bd50f1bdffb461/images/large/6.jpg saved to cache
2026-03-26 22:55:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0980ad47-8713-5737-b72e-7ea91ca5aa84
2026-03-26 22:55:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6d80dd0>
2026-03-26 22:55:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_966881a6-57ad-58a3-8bb5-1938c5357336/966881a6-57ad-58a3-8bb5-1938c5357336_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2db%252F9d4566ff19cb454dba09c15b09e07758%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2db/9d4566ff19cb454dba09c15b09e07758/images/large/5.jpg saved to cache
2026-03-26 22:55:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 966881a6-57ad-58a3-8bb5-1938c5357336
2026-03-26 22:55:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7503d10>
2026-03-26 22:55:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99c16ce4-23e7-5da6-9da3-86696de860c7/99c16ce4-23e7-5da6-9da3-86696de860c7_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ef%252Fe26d79d379404db695f6751564ba09e5%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ef/e26d79d379404db695f6751564ba09e5/images/large/9.jpg saved to cache
2026-03-26 22:55:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 99c16ce4-23e7-5da6-9da3-86696de860c7
2026-03-26 22:55:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79f8e90>
2026-03-26 22:55:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0980ad47-8713-5737-b72e-7ea91ca5aa84/0980ad47-8713-5737-b72e-7ea91ca5aa84_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fdab8941057fa43bb85bd50f1bdffb461%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/dab8941057fa43bb85bd50f1bdffb461/images/large/4.jpg saved to cache
2026-03-26 22:55:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0980ad47-8713-5737-b72e-7ea91ca5aa84
2026-03-26 22:55:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7769150>
2026-03-26 22:55:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_966881a6-57ad-58a3-8bb5-1938c5357336/966881a6-57ad-58a3-8bb5-1938c5357336_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2db%252F9d4566ff19cb454dba09c15b09e07758%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2db/9d4566ff19cb454dba09c15b09e07758/images/large/6.jpg saved to cache
2026-03-26 22:55:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 966881a6-57ad-58a3-8bb5-1938c5357336
2026-03-26 22:55:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2db/9d4566ff19cb454dba09c15b09e07758/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2db/9d4566ff19cb454dba09c15b09e07758/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252Fbc34a985835b4e9daa94b7f587675709%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/bc34a985835b4e9daa94b7f587675709/images/large/4.jpg not downloaded yet
2026-03-26 22:55:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7caad10>
2026-03-26 22:55:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_966881a6-57ad-58a3-8bb5-1938c5357336/966881a6-57ad-58a3-8bb5-1938c5357336_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2db%252F9d4566ff19cb454dba09c15b09e07758%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2db/9d4566ff19cb454dba09c15b09e07758/images/large/1.jpg saved to cache
2026-03-26 22:55:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 966881a6-57ad-58a3-8bb5-1938c5357336
2026-03-26 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252Fbc34a985835b4e9daa94b7f587675709%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/bc34a985835b4e9daa94b7f587675709/images/large/5.jpg not downloaded yet
2026-03-26 22:55:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7ca9f90>
2026-03-26 22:55:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_966881a6-57ad-58a3-8bb5-1938c5357336/966881a6-57ad-58a3-8bb5-1938c5357336_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2db%252F9d4566ff19cb454dba09c15b09e07758%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2db/9d4566ff19cb454dba09c15b09e07758/images/large/4.jpg saved to cache
2026-03-26 22:55:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 966881a6-57ad-58a3-8bb5-1938c5357336
2026-03-26 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252Fbc34a985835b4e9daa94b7f587675709%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/bc34a985835b4e9daa94b7f587675709/images/large/6.jpg not downloaded yet
2026-03-26 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252Fbc34a985835b4e9daa94b7f587675709%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/bc34a985835b4e9daa94b7f587675709/images/large/7.jpg not downloaded yet
2026-03-26 22:55:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/3864125516b14cc597fedc9af971992d/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/3864125516b14cc597fedc9af971992d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/3864125516b14cc597fedc9af971992d/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6dd86d0>
2026-03-26 22:55:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_966881a6-57ad-58a3-8bb5-1938c5357336/966881a6-57ad-58a3-8bb5-1938c5357336_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2db%252F9d4566ff19cb454dba09c15b09e07758%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2db/9d4566ff19cb454dba09c15b09e07758/images/large/9.jpg saved to cache
2026-03-26 22:55:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 966881a6-57ad-58a3-8bb5-1938c5357336
2026-03-26 22:55:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b781bd50>
2026-03-26 22:55:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_966881a6-57ad-58a3-8bb5-1938c5357336/966881a6-57ad-58a3-8bb5-1938c5357336_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2db%252F9d4566ff19cb454dba09c15b09e07758%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2db/9d4566ff19cb454dba09c15b09e07758/images/large/10.jpg saved to cache
2026-03-26 22:55:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 966881a6-57ad-58a3-8bb5-1938c5357336
2026-03-26 22:55:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2db/9d4566ff19cb454dba09c15b09e07758/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252Fbc34a985835b4e9daa94b7f587675709%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/bc34a985835b4e9daa94b7f587675709/images/large/8.jpg not downloaded yet
2026-03-26 22:55:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/3864125516b14cc597fedc9af971992d/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252Fbc34a985835b4e9daa94b7f587675709%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/bc34a985835b4e9daa94b7f587675709/images/large/9.jpg not downloaded yet
2026-03-26 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252Fbc34a985835b4e9daa94b7f587675709%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/bc34a985835b4e9daa94b7f587675709/images/large/10.jpg not downloaded yet
2026-03-26 22:55:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7773710>
2026-03-26 22:55:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c41590c-6777-5c3e-bdc0-3649b66068c8/8c41590c-6777-5c3e-bdc0-3649b66068c8_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F3864125516b14cc597fedc9af971992d%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/3864125516b14cc597fedc9af971992d/images/large/3.jpg saved to cache
2026-03-26 22:55:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8c41590c-6777-5c3e-bdc0-3649b66068c8
2026-03-26 22:55:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74120d0>
2026-03-26 22:55:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c41590c-6777-5c3e-bdc0-3649b66068c8/8c41590c-6777-5c3e-bdc0-3649b66068c8_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F3864125516b14cc597fedc9af971992d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/3864125516b14cc597fedc9af971992d/images/large/1.jpg saved to cache
2026-03-26 22:55:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8c41590c-6777-5c3e-bdc0-3649b66068c8
2026-03-26 22:55:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7304450>
2026-03-26 22:55:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c41590c-6777-5c3e-bdc0-3649b66068c8/8c41590c-6777-5c3e-bdc0-3649b66068c8_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F3864125516b14cc597fedc9af971992d%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/3864125516b14cc597fedc9af971992d/images/large/2.jpg saved to cache
2026-03-26 22:55:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8c41590c-6777-5c3e-bdc0-3649b66068c8
2026-03-26 22:55:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/3864125516b14cc597fedc9af971992d/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:14 [ayvens.be] INFO: Found listing with ID: 1985573
2026-03-26 22:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985573%27 HTTP/1.1" 200 None
2026-03-26 22:55:14 [ayvens.be] INFO: Scrape type for 1985573: 1
2026-03-26 22:55:14 [ayvens.be] INFO: Extracting data for car ID: 1985573
2026-03-26 22:55:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a931999a-c1a0-5ac7-a643-391330f16773 with identifier: 1985573
2026-03-26 22:55:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a931999a-c1a0-5ac7-a643-391330f16773 with scrape type 1
2026-03-26 22:55:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a931999a-c1a0-5ac7-a643-391330f16773
2026-03-26 22:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F8c529da85b00471694260742dc41b26c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/8c529da85b00471694260742dc41b26c/images/large/1.jpg not downloaded yet
2026-03-26 22:55:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/3864125516b14cc597fedc9af971992d/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/3864125516b14cc597fedc9af971992d/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F8c529da85b00471694260742dc41b26c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/8c529da85b00471694260742dc41b26c/images/large/2.jpg not downloaded yet
2026-03-26 22:55:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2db/9d4566ff19cb454dba09c15b09e07758/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79ce7d0>
2026-03-26 22:55:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_966881a6-57ad-58a3-8bb5-1938c5357336/966881a6-57ad-58a3-8bb5-1938c5357336_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2db%252F9d4566ff19cb454dba09c15b09e07758%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2db/9d4566ff19cb454dba09c15b09e07758/images/large/8.jpg saved to cache
2026-03-26 22:55:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 966881a6-57ad-58a3-8bb5-1938c5357336
2026-03-26 22:55:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd0c7c50>
2026-03-26 22:55:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c41590c-6777-5c3e-bdc0-3649b66068c8/8c41590c-6777-5c3e-bdc0-3649b66068c8_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F3864125516b14cc597fedc9af971992d%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/3864125516b14cc597fedc9af971992d/images/large/4.jpg saved to cache
2026-03-26 22:55:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8c41590c-6777-5c3e-bdc0-3649b66068c8
2026-03-26 22:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F8c529da85b00471694260742dc41b26c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/8c529da85b00471694260742dc41b26c/images/large/3.jpg not downloaded yet
2026-03-26 22:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F8c529da85b00471694260742dc41b26c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/8c529da85b00471694260742dc41b26c/images/large/4.jpg not downloaded yet
2026-03-26 22:55:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6dd8f10>
2026-03-26 22:55:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c41590c-6777-5c3e-bdc0-3649b66068c8/8c41590c-6777-5c3e-bdc0-3649b66068c8_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F3864125516b14cc597fedc9af971992d%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/3864125516b14cc597fedc9af971992d/images/large/6.jpg saved to cache
2026-03-26 22:55:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8c41590c-6777-5c3e-bdc0-3649b66068c8
2026-03-26 22:55:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6da5010>
2026-03-26 22:55:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c41590c-6777-5c3e-bdc0-3649b66068c8/8c41590c-6777-5c3e-bdc0-3649b66068c8_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F3864125516b14cc597fedc9af971992d%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/3864125516b14cc597fedc9af971992d/images/large/7.jpg saved to cache
2026-03-26 22:55:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8c41590c-6777-5c3e-bdc0-3649b66068c8
2026-03-26 22:55:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79cff90>
2026-03-26 22:55:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c41590c-6777-5c3e-bdc0-3649b66068c8/8c41590c-6777-5c3e-bdc0-3649b66068c8_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F3864125516b14cc597fedc9af971992d%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/3864125516b14cc597fedc9af971992d/images/large/5.jpg saved to cache
2026-03-26 22:55:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8c41590c-6777-5c3e-bdc0-3649b66068c8
2026-03-26 22:55:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76a4b10>
2026-03-26 22:55:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_966881a6-57ad-58a3-8bb5-1938c5357336/966881a6-57ad-58a3-8bb5-1938c5357336_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2db%252F9d4566ff19cb454dba09c15b09e07758%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2db/9d4566ff19cb454dba09c15b09e07758/images/large/7.jpg saved to cache
2026-03-26 22:55:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 966881a6-57ad-58a3-8bb5-1938c5357336
2026-03-26 22:55:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 966881a6-57ad-58a3-8bb5-1938c5357336, skipping ID generation
2026-03-26 22:55:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 966881a6-57ad-58a3-8bb5-1938c5357336 with scrape type 1
2026-03-26 22:55:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 966881a6-57ad-58a3-8bb5-1938c5357336 sending to next pipeline
2026-03-26 22:55:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 966881a6-57ad-58a3-8bb5-1938c5357336, identifier: 1985570
2026-03-26 22:55:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 966881a6-57ad-58a3-8bb5-1938c5357336 with identifier: 1985570
2026-03-26 22:55:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 966881a6-57ad-58a3-8bb5-1938c5357336 with identifier: 1985570
2026-03-26 22:55:15 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 966881a6-57ad-58a3-8bb5-1938c5357336 with identifier: 1985570 to the API
2026-03-26 22:55:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:55:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:55:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2db/9d4566ff19cb454dba09c15b09e07758/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '966881a6-57ad-58a3-8bb5-1938c5357336',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'PUMA',
 'odometer': 48870,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_966881a6-57ad-58a3-8bb5-1938c5357336/966881a6-57ad-58a3-8bb5-1938c5357336_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 240464,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2db/9d4566ff19cb454dba09c15b09e07758/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_966881a6-57ad-58a3-8bb5-1938c5357336/966881a6-57ad-58a3-8bb5-1938c5357336_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 243096,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2db/9d4566ff19cb454dba09c15b09e07758/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_966881a6-57ad-58a3-8bb5-1938c5357336/966881a6-57ad-58a3-8bb5-1938c5357336_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 221755,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2db/9d4566ff19cb454dba09c15b09e07758/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_966881a6-57ad-58a3-8bb5-1938c5357336/966881a6-57ad-58a3-8bb5-1938c5357336_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 221149,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2db/9d4566ff19cb454dba09c15b09e07758/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_966881a6-57ad-58a3-8bb5-1938c5357336/966881a6-57ad-58a3-8bb5-1938c5357336_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 239858,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2db/9d4566ff19cb454dba09c15b09e07758/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_966881a6-57ad-58a3-8bb5-1938c5357336/966881a6-57ad-58a3-8bb5-1938c5357336_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 226632,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2db/9d4566ff19cb454dba09c15b09e07758/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_966881a6-57ad-58a3-8bb5-1938c5357336/966881a6-57ad-58a3-8bb5-1938c5357336_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 221438,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2db/9d4566ff19cb454dba09c15b09e07758/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_966881a6-57ad-58a3-8bb5-1938c5357336/966881a6-57ad-58a3-8bb5-1938c5357336_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 294553,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2db/9d4566ff19cb454dba09c15b09e07758/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_966881a6-57ad-58a3-8bb5-1938c5357336/966881a6-57ad-58a3-8bb5-1938c5357336_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 281140,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2db/9d4566ff19cb454dba09c15b09e07758/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_966881a6-57ad-58a3-8bb5-1938c5357336/966881a6-57ad-58a3-8bb5-1938c5357336_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 268654,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2db/9d4566ff19cb454dba09c15b09e07758/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD PUMA 1.0 ECOBOOST MHEV 92KW TITANIUM',
 'transmission': 'manual',
 'trim': '1.0 ECOBOOST MHEV 92KW TITANIUM',
 'vin': None,
 'year': 2023}
2026-03-26 22:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985570%27 HTTP/1.1" 200 None
2026-03-26 22:55:15 [ayvens.be] INFO: Saving data for 1985570: {'created_time': 1774565715.237464, 'last_price_update_time': 1774565715.237473, 'auction_closing_time': 1774958400.0}
2026-03-26 22:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985570') HTTP/1.1" 204 0
2026-03-26 22:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F8c529da85b00471694260742dc41b26c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/8c529da85b00471694260742dc41b26c/images/large/5.jpg not downloaded yet
2026-03-26 22:55:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/bc34a985835b4e9daa94b7f587675709/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F8c529da85b00471694260742dc41b26c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/8c529da85b00471694260742dc41b26c/images/large/6.jpg not downloaded yet
2026-03-26 22:55:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/3864125516b14cc597fedc9af971992d/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/3864125516b14cc597fedc9af971992d/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/3864125516b14cc597fedc9af971992d/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/bc34a985835b4e9daa94b7f587675709/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F8c529da85b00471694260742dc41b26c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/8c529da85b00471694260742dc41b26c/images/large/7.jpg not downloaded yet
2026-03-26 22:55:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/bc34a985835b4e9daa94b7f587675709/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F8c529da85b00471694260742dc41b26c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/8c529da85b00471694260742dc41b26c/images/large/8.jpg not downloaded yet
2026-03-26 22:55:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/bc34a985835b4e9daa94b7f587675709/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F8c529da85b00471694260742dc41b26c%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/8c529da85b00471694260742dc41b26c/images/large/9.jpg not downloaded yet
2026-03-26 22:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F8c529da85b00471694260742dc41b26c%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/8c529da85b00471694260742dc41b26c/images/large/10.jpg not downloaded yet
2026-03-26 22:55:15 [ayvens.be] INFO: Found listing with ID: 1985574
2026-03-26 22:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985574%27 HTTP/1.1" 200 None
2026-03-26 22:55:15 [ayvens.be] INFO: Scrape type for 1985574: 1
2026-03-26 22:55:15 [ayvens.be] INFO: Extracting data for car ID: 1985574
2026-03-26 22:55:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 694c3744-9423-597e-8981-51fdfba093c6 with identifier: 1985574
2026-03-26 22:55:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 694c3744-9423-597e-8981-51fdfba093c6 with scrape type 1
2026-03-26 22:55:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 694c3744-9423-597e-8981-51fdfba093c6
2026-03-26 22:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F7a48dc0202c34bc89606bead24e67954%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/7a48dc0202c34bc89606bead24e67954/images/large/1.jpg not downloaded yet
2026-03-26 22:55:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7492490>
2026-03-26 22:55:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_438d6f36-9e95-56f4-aabe-ce1ba17d0ad8/438d6f36-9e95-56f4-aabe-ce1ba17d0ad8_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252Fbc34a985835b4e9daa94b7f587675709%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/bc34a985835b4e9daa94b7f587675709/images/large/1.jpg saved to cache
2026-03-26 22:55:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 438d6f36-9e95-56f4-aabe-ce1ba17d0ad8
2026-03-26 22:55:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/dab8941057fa43bb85bd50f1bdffb461/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F7a48dc0202c34bc89606bead24e67954%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/7a48dc0202c34bc89606bead24e67954/images/large/2.jpg not downloaded yet
2026-03-26 22:55:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7451390>
2026-03-26 22:55:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c41590c-6777-5c3e-bdc0-3649b66068c8/8c41590c-6777-5c3e-bdc0-3649b66068c8_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F3864125516b14cc597fedc9af971992d%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/3864125516b14cc597fedc9af971992d/images/large/9.jpg saved to cache
2026-03-26 22:55:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8c41590c-6777-5c3e-bdc0-3649b66068c8
2026-03-26 22:55:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cbeed0>
2026-03-26 22:55:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c41590c-6777-5c3e-bdc0-3649b66068c8/8c41590c-6777-5c3e-bdc0-3649b66068c8_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F3864125516b14cc597fedc9af971992d%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/3864125516b14cc597fedc9af971992d/images/large/8.jpg saved to cache
2026-03-26 22:55:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8c41590c-6777-5c3e-bdc0-3649b66068c8
2026-03-26 22:55:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7ceb150>
2026-03-26 22:55:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c41590c-6777-5c3e-bdc0-3649b66068c8/8c41590c-6777-5c3e-bdc0-3649b66068c8_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F3864125516b14cc597fedc9af971992d%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/3864125516b14cc597fedc9af971992d/images/large/10.jpg saved to cache
2026-03-26 22:55:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8c41590c-6777-5c3e-bdc0-3649b66068c8
2026-03-26 22:55:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8c41590c-6777-5c3e-bdc0-3649b66068c8, skipping ID generation
2026-03-26 22:55:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c41590c-6777-5c3e-bdc0-3649b66068c8 with scrape type 1
2026-03-26 22:55:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8c41590c-6777-5c3e-bdc0-3649b66068c8 sending to next pipeline
2026-03-26 22:55:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 8c41590c-6777-5c3e-bdc0-3649b66068c8, identifier: 1985571
2026-03-26 22:55:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7497290>
2026-03-26 22:55:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_438d6f36-9e95-56f4-aabe-ce1ba17d0ad8/438d6f36-9e95-56f4-aabe-ce1ba17d0ad8_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252Fbc34a985835b4e9daa94b7f587675709%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/bc34a985835b4e9daa94b7f587675709/images/large/2.jpg saved to cache
2026-03-26 22:55:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 438d6f36-9e95-56f4-aabe-ce1ba17d0ad8
2026-03-26 22:55:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/bc34a985835b4e9daa94b7f587675709/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F7a48dc0202c34bc89606bead24e67954%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/7a48dc0202c34bc89606bead24e67954/images/large/3.jpg not downloaded yet
2026-03-26 22:55:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 8c41590c-6777-5c3e-bdc0-3649b66068c8 with identifier: 1985571
2026-03-26 22:55:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 8c41590c-6777-5c3e-bdc0-3649b66068c8 with identifier: 1985571
2026-03-26 22:55:16 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 8c41590c-6777-5c3e-bdc0-3649b66068c8 with identifier: 1985571 to the API
2026-03-26 22:55:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:55:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:55:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cq/3864125516b14cc597fedc9af971992d/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '8c41590c-6777-5c3e-bdc0-3649b66068c8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '1 SERIES HATCH',
 'odometer': 70763,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 20,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c41590c-6777-5c3e-bdc0-3649b66068c8/8c41590c-6777-5c3e-bdc0-3649b66068c8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 730612,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/3864125516b14cc597fedc9af971992d/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c41590c-6777-5c3e-bdc0-3649b66068c8/8c41590c-6777-5c3e-bdc0-3649b66068c8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 727640,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/3864125516b14cc597fedc9af971992d/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c41590c-6777-5c3e-bdc0-3649b66068c8/8c41590c-6777-5c3e-bdc0-3649b66068c8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 751054,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/3864125516b14cc597fedc9af971992d/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c41590c-6777-5c3e-bdc0-3649b66068c8/8c41590c-6777-5c3e-bdc0-3649b66068c8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 790080,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/3864125516b14cc597fedc9af971992d/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c41590c-6777-5c3e-bdc0-3649b66068c8/8c41590c-6777-5c3e-bdc0-3649b66068c8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 787716,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/3864125516b14cc597fedc9af971992d/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c41590c-6777-5c3e-bdc0-3649b66068c8/8c41590c-6777-5c3e-bdc0-3649b66068c8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 789435,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/3864125516b14cc597fedc9af971992d/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c41590c-6777-5c3e-bdc0-3649b66068c8/8c41590c-6777-5c3e-bdc0-3649b66068c8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 624507,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/3864125516b14cc597fedc9af971992d/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c41590c-6777-5c3e-bdc0-3649b66068c8/8c41590c-6777-5c3e-bdc0-3649b66068c8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 749655,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/3864125516b14cc597fedc9af971992d/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c41590c-6777-5c3e-bdc0-3649b66068c8/8c41590c-6777-5c3e-bdc0-3649b66068c8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 755778,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/3864125516b14cc597fedc9af971992d/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c41590c-6777-5c3e-bdc0-3649b66068c8/8c41590c-6777-5c3e-bdc0-3649b66068c8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 765386,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/3864125516b14cc597fedc9af971992d/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1 SERIES HATCH 1.5 116D (85KW)',
 'transmission': 'manual',
 'trim': '1.5 116D (85KW)',
 'vin': None,
 'year': 2022}
2026-03-26 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985571%27 HTTP/1.1" 200 None
2026-03-26 22:55:16 [ayvens.be] INFO: Saving data for 1985571: {'created_time': 1774565716.292903, 'last_price_update_time': 1774565716.292914, 'auction_closing_time': 1774958400.0}
2026-03-26 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985571') HTTP/1.1" 204 0
2026-03-26 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F7a48dc0202c34bc89606bead24e67954%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/7a48dc0202c34bc89606bead24e67954/images/large/4.jpg not downloaded yet
2026-03-26 22:55:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b748a890>
2026-03-26 22:55:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_438d6f36-9e95-56f4-aabe-ce1ba17d0ad8/438d6f36-9e95-56f4-aabe-ce1ba17d0ad8_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252Fbc34a985835b4e9daa94b7f587675709%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/bc34a985835b4e9daa94b7f587675709/images/large/3.jpg saved to cache
2026-03-26 22:55:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 438d6f36-9e95-56f4-aabe-ce1ba17d0ad8
2026-03-26 22:55:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7660a90>
2026-03-26 22:55:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_438d6f36-9e95-56f4-aabe-ce1ba17d0ad8/438d6f36-9e95-56f4-aabe-ce1ba17d0ad8_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252Fbc34a985835b4e9daa94b7f587675709%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/bc34a985835b4e9daa94b7f587675709/images/large/6.jpg saved to cache
2026-03-26 22:55:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 438d6f36-9e95-56f4-aabe-ce1ba17d0ad8
2026-03-26 22:55:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e2ae50>
2026-03-26 22:55:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0980ad47-8713-5737-b72e-7ea91ca5aa84/0980ad47-8713-5737-b72e-7ea91ca5aa84_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fdab8941057fa43bb85bd50f1bdffb461%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/dab8941057fa43bb85bd50f1bdffb461/images/large/10.jpg saved to cache
2026-03-26 22:55:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0980ad47-8713-5737-b72e-7ea91ca5aa84
2026-03-26 22:55:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/bc34a985835b4e9daa94b7f587675709/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/bc34a985835b4e9daa94b7f587675709/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F7a48dc0202c34bc89606bead24e67954%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/7a48dc0202c34bc89606bead24e67954/images/large/5.jpg not downloaded yet
2026-03-26 22:55:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b75a7390>
2026-03-26 22:55:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_438d6f36-9e95-56f4-aabe-ce1ba17d0ad8/438d6f36-9e95-56f4-aabe-ce1ba17d0ad8_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252Fbc34a985835b4e9daa94b7f587675709%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/bc34a985835b4e9daa94b7f587675709/images/large/5.jpg saved to cache
2026-03-26 22:55:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 438d6f36-9e95-56f4-aabe-ce1ba17d0ad8
2026-03-26 22:55:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/bc34a985835b4e9daa94b7f587675709/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/bc34a985835b4e9daa94b7f587675709/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F7a48dc0202c34bc89606bead24e67954%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/7a48dc0202c34bc89606bead24e67954/images/large/6.jpg not downloaded yet
2026-03-26 22:55:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/8c529da85b00471694260742dc41b26c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7a60390>
2026-03-26 22:55:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_438d6f36-9e95-56f4-aabe-ce1ba17d0ad8/438d6f36-9e95-56f4-aabe-ce1ba17d0ad8_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252Fbc34a985835b4e9daa94b7f587675709%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/bc34a985835b4e9daa94b7f587675709/images/large/10.jpg saved to cache
2026-03-26 22:55:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 438d6f36-9e95-56f4-aabe-ce1ba17d0ad8
2026-03-26 22:55:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e2b550>
2026-03-26 22:55:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_438d6f36-9e95-56f4-aabe-ce1ba17d0ad8/438d6f36-9e95-56f4-aabe-ce1ba17d0ad8_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252Fbc34a985835b4e9daa94b7f587675709%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/bc34a985835b4e9daa94b7f587675709/images/large/4.jpg saved to cache
2026-03-26 22:55:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 438d6f36-9e95-56f4-aabe-ce1ba17d0ad8
2026-03-26 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F7a48dc0202c34bc89606bead24e67954%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/7a48dc0202c34bc89606bead24e67954/images/large/7.jpg not downloaded yet
2026-03-26 22:55:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/8c529da85b00471694260742dc41b26c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F7a48dc0202c34bc89606bead24e67954%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/7a48dc0202c34bc89606bead24e67954/images/large/8.jpg not downloaded yet
2026-03-26 22:55:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7a634d0>
2026-03-26 22:55:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_438d6f36-9e95-56f4-aabe-ce1ba17d0ad8/438d6f36-9e95-56f4-aabe-ce1ba17d0ad8_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252Fbc34a985835b4e9daa94b7f587675709%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/bc34a985835b4e9daa94b7f587675709/images/large/8.jpg saved to cache
2026-03-26 22:55:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 438d6f36-9e95-56f4-aabe-ce1ba17d0ad8
2026-03-26 22:55:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7910d10>
2026-03-26 22:55:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_438d6f36-9e95-56f4-aabe-ce1ba17d0ad8/438d6f36-9e95-56f4-aabe-ce1ba17d0ad8_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252Fbc34a985835b4e9daa94b7f587675709%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/bc34a985835b4e9daa94b7f587675709/images/large/9.jpg saved to cache
2026-03-26 22:55:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 438d6f36-9e95-56f4-aabe-ce1ba17d0ad8
2026-03-26 22:55:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7aa0210>
2026-03-26 22:55:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a931999a-c1a0-5ac7-a643-391330f16773/a931999a-c1a0-5ac7-a643-391330f16773_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F8c529da85b00471694260742dc41b26c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/8c529da85b00471694260742dc41b26c/images/large/1.jpg saved to cache
2026-03-26 22:55:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a931999a-c1a0-5ac7-a643-391330f16773
2026-03-26 22:55:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/bc34a985835b4e9daa94b7f587675709/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/8c529da85b00471694260742dc41b26c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F7a48dc0202c34bc89606bead24e67954%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/7a48dc0202c34bc89606bead24e67954/images/large/9.jpg not downloaded yet
2026-03-26 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F7a48dc0202c34bc89606bead24e67954%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/7a48dc0202c34bc89606bead24e67954/images/large/10.jpg not downloaded yet
2026-03-26 22:55:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/8c529da85b00471694260742dc41b26c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76e2f90>
2026-03-26 22:55:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a931999a-c1a0-5ac7-a643-391330f16773/a931999a-c1a0-5ac7-a643-391330f16773_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F8c529da85b00471694260742dc41b26c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/8c529da85b00471694260742dc41b26c/images/large/4.jpg saved to cache
2026-03-26 22:55:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a931999a-c1a0-5ac7-a643-391330f16773
2026-03-26 22:55:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/dab8941057fa43bb85bd50f1bdffb461/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/8c529da85b00471694260742dc41b26c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:17 [ayvens.be] INFO: Found listing with ID: 1985575
2026-03-26 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985575%27 HTTP/1.1" 200 None
2026-03-26 22:55:17 [ayvens.be] INFO: Scrape type for 1985575: 1
2026-03-26 22:55:17 [ayvens.be] INFO: Extracting data for car ID: 1985575
2026-03-26 22:55:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dbac0540-39df-5073-9762-7f74f4e38c3a with identifier: 1985575
2026-03-26 22:55:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dbac0540-39df-5073-9762-7f74f4e38c3a with scrape type 1
2026-03-26 22:55:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dbac0540-39df-5073-9762-7f74f4e38c3a
2026-03-26 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F1dff36e495c1427799be5c45f57767b6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/1dff36e495c1427799be5c45f57767b6/images/large/1.jpg not downloaded yet
2026-03-26 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F1dff36e495c1427799be5c45f57767b6%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/1dff36e495c1427799be5c45f57767b6/images/large/2.jpg not downloaded yet
2026-03-26 22:55:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/8c529da85b00471694260742dc41b26c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F1dff36e495c1427799be5c45f57767b6%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/1dff36e495c1427799be5c45f57767b6/images/large/3.jpg not downloaded yet
2026-03-26 22:55:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7503690>
2026-03-26 22:55:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_438d6f36-9e95-56f4-aabe-ce1ba17d0ad8/438d6f36-9e95-56f4-aabe-ce1ba17d0ad8_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252Fbc34a985835b4e9daa94b7f587675709%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/bc34a985835b4e9daa94b7f587675709/images/large/7.jpg saved to cache
2026-03-26 22:55:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 438d6f36-9e95-56f4-aabe-ce1ba17d0ad8
2026-03-26 22:55:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 438d6f36-9e95-56f4-aabe-ce1ba17d0ad8, skipping ID generation
2026-03-26 22:55:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 438d6f36-9e95-56f4-aabe-ce1ba17d0ad8 with scrape type 1
2026-03-26 22:55:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 438d6f36-9e95-56f4-aabe-ce1ba17d0ad8 sending to next pipeline
2026-03-26 22:55:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 438d6f36-9e95-56f4-aabe-ce1ba17d0ad8, identifier: 1985572
2026-03-26 22:55:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e2a0d0>
2026-03-26 22:55:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a931999a-c1a0-5ac7-a643-391330f16773/a931999a-c1a0-5ac7-a643-391330f16773_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F8c529da85b00471694260742dc41b26c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/8c529da85b00471694260742dc41b26c/images/large/5.jpg saved to cache
2026-03-26 22:55:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a931999a-c1a0-5ac7-a643-391330f16773
2026-03-26 22:55:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7773590>
2026-03-26 22:55:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a931999a-c1a0-5ac7-a643-391330f16773/a931999a-c1a0-5ac7-a643-391330f16773_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F8c529da85b00471694260742dc41b26c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/8c529da85b00471694260742dc41b26c/images/large/6.jpg saved to cache
2026-03-26 22:55:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a931999a-c1a0-5ac7-a643-391330f16773
2026-03-26 22:55:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/8c529da85b00471694260742dc41b26c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 438d6f36-9e95-56f4-aabe-ce1ba17d0ad8 with identifier: 1985572
2026-03-26 22:55:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 438d6f36-9e95-56f4-aabe-ce1ba17d0ad8 with identifier: 1985572
2026-03-26 22:55:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 438d6f36-9e95-56f4-aabe-ce1ba17d0ad8 with identifier: 1985572 to the API
2026-03-26 22:55:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:55:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:55:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yl/bc34a985835b4e9daa94b7f587675709/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '438d6f36-9e95-56f4-aabe-ce1ba17d0ad8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '3 TOURING DIESEL - 2019',
 'odometer': 175892,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_438d6f36-9e95-56f4-aabe-ce1ba17d0ad8/438d6f36-9e95-56f4-aabe-ce1ba17d0ad8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 634221,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/bc34a985835b4e9daa94b7f587675709/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_438d6f36-9e95-56f4-aabe-ce1ba17d0ad8/438d6f36-9e95-56f4-aabe-ce1ba17d0ad8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 587314,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/bc34a985835b4e9daa94b7f587675709/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_438d6f36-9e95-56f4-aabe-ce1ba17d0ad8/438d6f36-9e95-56f4-aabe-ce1ba17d0ad8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 652753,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/bc34a985835b4e9daa94b7f587675709/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_438d6f36-9e95-56f4-aabe-ce1ba17d0ad8/438d6f36-9e95-56f4-aabe-ce1ba17d0ad8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 672519,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/bc34a985835b4e9daa94b7f587675709/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_438d6f36-9e95-56f4-aabe-ce1ba17d0ad8/438d6f36-9e95-56f4-aabe-ce1ba17d0ad8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 594846,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/bc34a985835b4e9daa94b7f587675709/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_438d6f36-9e95-56f4-aabe-ce1ba17d0ad8/438d6f36-9e95-56f4-aabe-ce1ba17d0ad8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 565311,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/bc34a985835b4e9daa94b7f587675709/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_438d6f36-9e95-56f4-aabe-ce1ba17d0ad8/438d6f36-9e95-56f4-aabe-ce1ba17d0ad8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 706310,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/bc34a985835b4e9daa94b7f587675709/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_438d6f36-9e95-56f4-aabe-ce1ba17d0ad8/438d6f36-9e95-56f4-aabe-ce1ba17d0ad8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 746454,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/bc34a985835b4e9daa94b7f587675709/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_438d6f36-9e95-56f4-aabe-ce1ba17d0ad8/438d6f36-9e95-56f4-aabe-ce1ba17d0ad8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 556200,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/bc34a985835b4e9daa94b7f587675709/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_438d6f36-9e95-56f4-aabe-ce1ba17d0ad8/438d6f36-9e95-56f4-aabe-ce1ba17d0ad8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 520323,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/bc34a985835b4e9daa94b7f587675709/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3 TOURING DIESEL - 2019 320 d AdBlue',
 'transmission': 'manual',
 'trim': '320 d AdBlue',
 'vin': None,
 'year': 2020}
2026-03-26 22:55:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985572%27 HTTP/1.1" 200 None
2026-03-26 22:55:18 [ayvens.be] INFO: Saving data for 1985572: {'created_time': 1774565718.045503, 'last_price_update_time': 1774565718.045512, 'auction_closing_time': 1774958400.0}
2026-03-26 22:55:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985572') HTTP/1.1" 204 0
2026-03-26 22:55:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F1dff36e495c1427799be5c45f57767b6%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/1dff36e495c1427799be5c45f57767b6/images/large/4.jpg not downloaded yet
2026-03-26 22:55:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/7a48dc0202c34bc89606bead24e67954/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F1dff36e495c1427799be5c45f57767b6%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/1dff36e495c1427799be5c45f57767b6/images/large/5.jpg not downloaded yet
2026-03-26 22:55:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd0afad0>
2026-03-26 22:55:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0980ad47-8713-5737-b72e-7ea91ca5aa84/0980ad47-8713-5737-b72e-7ea91ca5aa84_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:55:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fdab8941057fa43bb85bd50f1bdffb461%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/dab8941057fa43bb85bd50f1bdffb461/images/large/9.jpg saved to cache
2026-03-26 22:55:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0980ad47-8713-5737-b72e-7ea91ca5aa84
2026-03-26 22:55:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd844990>
2026-03-26 22:55:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a931999a-c1a0-5ac7-a643-391330f16773/a931999a-c1a0-5ac7-a643-391330f16773_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:55:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F8c529da85b00471694260742dc41b26c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/8c529da85b00471694260742dc41b26c/images/large/3.jpg saved to cache
2026-03-26 22:55:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a931999a-c1a0-5ac7-a643-391330f16773
2026-03-26 22:55:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b740a610>
2026-03-26 22:55:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a931999a-c1a0-5ac7-a643-391330f16773/a931999a-c1a0-5ac7-a643-391330f16773_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:55:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F8c529da85b00471694260742dc41b26c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/8c529da85b00471694260742dc41b26c/images/large/2.jpg saved to cache
2026-03-26 22:55:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a931999a-c1a0-5ac7-a643-391330f16773
2026-03-26 22:55:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e3ecd0>
2026-03-26 22:55:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a931999a-c1a0-5ac7-a643-391330f16773/a931999a-c1a0-5ac7-a643-391330f16773_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:55:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F8c529da85b00471694260742dc41b26c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/8c529da85b00471694260742dc41b26c/images/large/8.jpg saved to cache
2026-03-26 22:55:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a931999a-c1a0-5ac7-a643-391330f16773
2026-03-26 22:55:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/8c529da85b00471694260742dc41b26c/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F1dff36e495c1427799be5c45f57767b6%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/1dff36e495c1427799be5c45f57767b6/images/large/6.jpg not downloaded yet
2026-03-26 22:55:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/dab8941057fa43bb85bd50f1bdffb461/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/7a48dc0202c34bc89606bead24e67954/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/7a48dc0202c34bc89606bead24e67954/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F1dff36e495c1427799be5c45f57767b6%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/1dff36e495c1427799be5c45f57767b6/images/large/7.jpg not downloaded yet
2026-03-26 22:55:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b781a3d0>
2026-03-26 22:55:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_694c3744-9423-597e-8981-51fdfba093c6/694c3744-9423-597e-8981-51fdfba093c6_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:55:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F7a48dc0202c34bc89606bead24e67954%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/7a48dc0202c34bc89606bead24e67954/images/large/2.jpg saved to cache
2026-03-26 22:55:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 694c3744-9423-597e-8981-51fdfba093c6
2026-03-26 22:55:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/8c529da85b00471694260742dc41b26c/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F1dff36e495c1427799be5c45f57767b6%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/1dff36e495c1427799be5c45f57767b6/images/large/8.jpg not downloaded yet
2026-03-26 22:55:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/7a48dc0202c34bc89606bead24e67954/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F1dff36e495c1427799be5c45f57767b6%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/1dff36e495c1427799be5c45f57767b6/images/large/9.jpg not downloaded yet
2026-03-26 22:55:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6d823d0>
2026-03-26 22:55:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a931999a-c1a0-5ac7-a643-391330f16773/a931999a-c1a0-5ac7-a643-391330f16773_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:55:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F8c529da85b00471694260742dc41b26c%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/8c529da85b00471694260742dc41b26c/images/large/10.jpg saved to cache
2026-03-26 22:55:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a931999a-c1a0-5ac7-a643-391330f16773
2026-03-26 22:55:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cc80d0>
2026-03-26 22:55:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0980ad47-8713-5737-b72e-7ea91ca5aa84/0980ad47-8713-5737-b72e-7ea91ca5aa84_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:55:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fdab8941057fa43bb85bd50f1bdffb461%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/dab8941057fa43bb85bd50f1bdffb461/images/large/8.jpg saved to cache
2026-03-26 22:55:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0980ad47-8713-5737-b72e-7ea91ca5aa84
2026-03-26 22:55:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7773fd0>
2026-03-26 22:55:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_694c3744-9423-597e-8981-51fdfba093c6/694c3744-9423-597e-8981-51fdfba093c6_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:55:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F7a48dc0202c34bc89606bead24e67954%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/7a48dc0202c34bc89606bead24e67954/images/large/3.jpg saved to cache
2026-03-26 22:55:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 694c3744-9423-597e-8981-51fdfba093c6
2026-03-26 22:55:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b742a7d0>
2026-03-26 22:55:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_694c3744-9423-597e-8981-51fdfba093c6/694c3744-9423-597e-8981-51fdfba093c6_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F7a48dc0202c34bc89606bead24e67954%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/7a48dc0202c34bc89606bead24e67954/images/large/5.jpg saved to cache
2026-03-26 22:55:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 694c3744-9423-597e-8981-51fdfba093c6
2026-03-26 22:55:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/7a48dc0202c34bc89606bead24e67954/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F1dff36e495c1427799be5c45f57767b6%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/1dff36e495c1427799be5c45f57767b6/images/large/10.jpg not downloaded yet
2026-03-26 22:55:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/7a48dc0202c34bc89606bead24e67954/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/7a48dc0202c34bc89606bead24e67954/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:19 [ayvens.be] INFO: Found listing with ID: 1985576
2026-03-26 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985576%27 HTTP/1.1" 200 None
2026-03-26 22:55:19 [ayvens.be] INFO: Scrape type for 1985576: 1
2026-03-26 22:55:19 [ayvens.be] INFO: Extracting data for car ID: 1985576
2026-03-26 22:55:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96fdc9f1-7ce0-5fb1-a642-99698f01a88c with identifier: 1985576
2026-03-26 22:55:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96fdc9f1-7ce0-5fb1-a642-99698f01a88c with scrape type 1
2026-03-26 22:55:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 96fdc9f1-7ce0-5fb1-a642-99698f01a88c
2026-03-26 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252Fc828286a79364e25873f83a7764cba7e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/c828286a79364e25873f83a7764cba7e/images/large/1.jpg not downloaded yet
2026-03-26 22:55:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/7a48dc0202c34bc89606bead24e67954/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252Fc828286a79364e25873f83a7764cba7e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/c828286a79364e25873f83a7764cba7e/images/large/2.jpg not downloaded yet
2026-03-26 22:55:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79811d0>
2026-03-26 22:55:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a931999a-c1a0-5ac7-a643-391330f16773/a931999a-c1a0-5ac7-a643-391330f16773_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F8c529da85b00471694260742dc41b26c%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/8c529da85b00471694260742dc41b26c/images/large/9.jpg saved to cache
2026-03-26 22:55:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a931999a-c1a0-5ac7-a643-391330f16773
2026-03-26 22:55:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7981450>
2026-03-26 22:55:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_694c3744-9423-597e-8981-51fdfba093c6/694c3744-9423-597e-8981-51fdfba093c6_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F7a48dc0202c34bc89606bead24e67954%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/7a48dc0202c34bc89606bead24e67954/images/large/4.jpg saved to cache
2026-03-26 22:55:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 694c3744-9423-597e-8981-51fdfba093c6
2026-03-26 22:55:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/7a48dc0202c34bc89606bead24e67954/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/8c529da85b00471694260742dc41b26c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/7a48dc0202c34bc89606bead24e67954/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252Fc828286a79364e25873f83a7764cba7e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/c828286a79364e25873f83a7764cba7e/images/large/3.jpg not downloaded yet
2026-03-26 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252Fc828286a79364e25873f83a7764cba7e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/c828286a79364e25873f83a7764cba7e/images/large/4.jpg not downloaded yet
2026-03-26 22:55:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74e5f10>
2026-03-26 22:55:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_694c3744-9423-597e-8981-51fdfba093c6/694c3744-9423-597e-8981-51fdfba093c6_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F7a48dc0202c34bc89606bead24e67954%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/7a48dc0202c34bc89606bead24e67954/images/large/1.jpg saved to cache
2026-03-26 22:55:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 694c3744-9423-597e-8981-51fdfba093c6
2026-03-26 22:55:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76a75d0>
2026-03-26 22:55:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_694c3744-9423-597e-8981-51fdfba093c6/694c3744-9423-597e-8981-51fdfba093c6_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F7a48dc0202c34bc89606bead24e67954%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/7a48dc0202c34bc89606bead24e67954/images/large/8.jpg saved to cache
2026-03-26 22:55:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 694c3744-9423-597e-8981-51fdfba093c6
2026-03-26 22:55:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74fad90>
2026-03-26 22:55:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_694c3744-9423-597e-8981-51fdfba093c6/694c3744-9423-597e-8981-51fdfba093c6_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F7a48dc0202c34bc89606bead24e67954%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/7a48dc0202c34bc89606bead24e67954/images/large/7.jpg saved to cache
2026-03-26 22:55:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 694c3744-9423-597e-8981-51fdfba093c6
2026-03-26 22:55:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6dd8ad0>
2026-03-26 22:55:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_694c3744-9423-597e-8981-51fdfba093c6/694c3744-9423-597e-8981-51fdfba093c6_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F7a48dc0202c34bc89606bead24e67954%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/7a48dc0202c34bc89606bead24e67954/images/large/10.jpg saved to cache
2026-03-26 22:55:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 694c3744-9423-597e-8981-51fdfba093c6
2026-03-26 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252Fc828286a79364e25873f83a7764cba7e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/c828286a79364e25873f83a7764cba7e/images/large/5.jpg not downloaded yet
2026-03-26 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252Fc828286a79364e25873f83a7764cba7e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/c828286a79364e25873f83a7764cba7e/images/large/6.jpg not downloaded yet
2026-03-26 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252Fc828286a79364e25873f83a7764cba7e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/c828286a79364e25873f83a7764cba7e/images/large/7.jpg not downloaded yet
2026-03-26 22:55:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74fb710>
2026-03-26 22:55:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_694c3744-9423-597e-8981-51fdfba093c6/694c3744-9423-597e-8981-51fdfba093c6_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F7a48dc0202c34bc89606bead24e67954%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/7a48dc0202c34bc89606bead24e67954/images/large/6.jpg saved to cache
2026-03-26 22:55:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 694c3744-9423-597e-8981-51fdfba093c6
2026-03-26 22:55:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b75a6c10>
2026-03-26 22:55:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a931999a-c1a0-5ac7-a643-391330f16773/a931999a-c1a0-5ac7-a643-391330f16773_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F8c529da85b00471694260742dc41b26c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/8c529da85b00471694260742dc41b26c/images/large/7.jpg saved to cache
2026-03-26 22:55:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a931999a-c1a0-5ac7-a643-391330f16773
2026-03-26 22:55:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a931999a-c1a0-5ac7-a643-391330f16773, skipping ID generation
2026-03-26 22:55:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a931999a-c1a0-5ac7-a643-391330f16773 with scrape type 1
2026-03-26 22:55:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a931999a-c1a0-5ac7-a643-391330f16773 sending to next pipeline
2026-03-26 22:55:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a931999a-c1a0-5ac7-a643-391330f16773, identifier: 1985573
2026-03-26 22:55:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b78c10d0>
2026-03-26 22:55:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_694c3744-9423-597e-8981-51fdfba093c6/694c3744-9423-597e-8981-51fdfba093c6_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F7a48dc0202c34bc89606bead24e67954%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/7a48dc0202c34bc89606bead24e67954/images/large/9.jpg saved to cache
2026-03-26 22:55:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 694c3744-9423-597e-8981-51fdfba093c6
2026-03-26 22:55:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 694c3744-9423-597e-8981-51fdfba093c6, skipping ID generation
2026-03-26 22:55:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 694c3744-9423-597e-8981-51fdfba093c6 with scrape type 1
2026-03-26 22:55:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 694c3744-9423-597e-8981-51fdfba093c6 sending to next pipeline
2026-03-26 22:55:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 694c3744-9423-597e-8981-51fdfba093c6, identifier: 1985574
2026-03-26 22:55:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a931999a-c1a0-5ac7-a643-391330f16773 with identifier: 1985573
2026-03-26 22:55:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a931999a-c1a0-5ac7-a643-391330f16773 with identifier: 1985573
2026-03-26 22:55:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a931999a-c1a0-5ac7-a643-391330f16773 with identifier: 1985573 to the API
2026-03-26 22:55:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:55:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:55:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bq/8c529da85b00471694260742dc41b26c/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'electric',
 'id': 'a931999a-c1a0-5ac7-a643-391330f16773',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '208',
 'odometer': 60665,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a931999a-c1a0-5ac7-a643-391330f16773/a931999a-c1a0-5ac7-a643-391330f16773_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 459923,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/8c529da85b00471694260742dc41b26c/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a931999a-c1a0-5ac7-a643-391330f16773/a931999a-c1a0-5ac7-a643-391330f16773_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 472459,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/8c529da85b00471694260742dc41b26c/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a931999a-c1a0-5ac7-a643-391330f16773/a931999a-c1a0-5ac7-a643-391330f16773_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 471669,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/8c529da85b00471694260742dc41b26c/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a931999a-c1a0-5ac7-a643-391330f16773/a931999a-c1a0-5ac7-a643-391330f16773_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 435639,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/8c529da85b00471694260742dc41b26c/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a931999a-c1a0-5ac7-a643-391330f16773/a931999a-c1a0-5ac7-a643-391330f16773_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 245515,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/8c529da85b00471694260742dc41b26c/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a931999a-c1a0-5ac7-a643-391330f16773/a931999a-c1a0-5ac7-a643-391330f16773_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 230243,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/8c529da85b00471694260742dc41b26c/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a931999a-c1a0-5ac7-a643-391330f16773/a931999a-c1a0-5ac7-a643-391330f16773_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 291495,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/8c529da85b00471694260742dc41b26c/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a931999a-c1a0-5ac7-a643-391330f16773/a931999a-c1a0-5ac7-a643-391330f16773_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 313858,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/8c529da85b00471694260742dc41b26c/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a931999a-c1a0-5ac7-a643-391330f16773/a931999a-c1a0-5ac7-a643-391330f16773_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 241250,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/8c529da85b00471694260742dc41b26c/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a931999a-c1a0-5ac7-a643-391330f16773/a931999a-c1a0-5ac7-a643-391330f16773_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 248778,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/8c529da85b00471694260742dc41b26c/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 208 BEV 50KWH ELECT. E-208 AUTO ACTIVE PACK',
 'transmission': 'automatic',
 'trim': 'BEV 50KWH ELECT. E-208 AUTO ACTIVE PACK',
 'vin': None,
 'year': 2022}
2026-03-26 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985573%27 HTTP/1.1" 200 None
2026-03-26 22:55:20 [ayvens.be] INFO: Saving data for 1985573: {'created_time': 1774565720.554958, 'last_price_update_time': 1774565720.554967, 'auction_closing_time': 1774958400.0}
2026-03-26 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985573') HTTP/1.1" 204 0
2026-03-26 22:55:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 694c3744-9423-597e-8981-51fdfba093c6 with identifier: 1985574
2026-03-26 22:55:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 694c3744-9423-597e-8981-51fdfba093c6 with identifier: 1985574
2026-03-26 22:55:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 694c3744-9423-597e-8981-51fdfba093c6 with identifier: 1985574 to the API
2026-03-26 22:55:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:55:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:55:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bs/7a48dc0202c34bc89606bead24e67954/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '694c3744-9423-597e-8981-51fdfba093c6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Puma',
 'odometer': 98842,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_694c3744-9423-597e-8981-51fdfba093c6/694c3744-9423-597e-8981-51fdfba093c6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 728821,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/7a48dc0202c34bc89606bead24e67954/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_694c3744-9423-597e-8981-51fdfba093c6/694c3744-9423-597e-8981-51fdfba093c6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 505676,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/7a48dc0202c34bc89606bead24e67954/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_694c3744-9423-597e-8981-51fdfba093c6/694c3744-9423-597e-8981-51fdfba093c6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 686084,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/7a48dc0202c34bc89606bead24e67954/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_694c3744-9423-597e-8981-51fdfba093c6/694c3744-9423-597e-8981-51fdfba093c6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 713578,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/7a48dc0202c34bc89606bead24e67954/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_694c3744-9423-597e-8981-51fdfba093c6/694c3744-9423-597e-8981-51fdfba093c6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 437315,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/7a48dc0202c34bc89606bead24e67954/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_694c3744-9423-597e-8981-51fdfba093c6/694c3744-9423-597e-8981-51fdfba093c6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 314085,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/7a48dc0202c34bc89606bead24e67954/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_694c3744-9423-597e-8981-51fdfba093c6/694c3744-9423-597e-8981-51fdfba093c6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 441228,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/7a48dc0202c34bc89606bead24e67954/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_694c3744-9423-597e-8981-51fdfba093c6/694c3744-9423-597e-8981-51fdfba093c6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 405267,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/7a48dc0202c34bc89606bead24e67954/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_694c3744-9423-597e-8981-51fdfba093c6/694c3744-9423-597e-8981-51fdfba093c6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 375910,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/7a48dc0202c34bc89606bead24e67954/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_694c3744-9423-597e-8981-51fdfba093c6/694c3744-9423-597e-8981-51fdfba093c6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 239527,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/7a48dc0202c34bc89606bead24e67954/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD Puma 1.5 TDCI 88KW TITANIUM',
 'transmission': 'manual',
 'trim': '1.5 TDCI 88KW TITANIUM',
 'vin': None,
 'year': 2022}
2026-03-26 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985574%27 HTTP/1.1" 200 None
2026-03-26 22:55:20 [ayvens.be] INFO: Saving data for 1985574: {'created_time': 1774565720.855711, 'last_price_update_time': 1774565720.855722, 'auction_closing_time': 1774958400.0}
2026-03-26 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985574') HTTP/1.1" 204 0
2026-03-26 22:55:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/1dff36e495c1427799be5c45f57767b6/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252Fc828286a79364e25873f83a7764cba7e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/c828286a79364e25873f83a7764cba7e/images/large/8.jpg not downloaded yet
2026-03-26 22:55:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/1dff36e495c1427799be5c45f57767b6/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/1dff36e495c1427799be5c45f57767b6/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/1dff36e495c1427799be5c45f57767b6/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252Fc828286a79364e25873f83a7764cba7e%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/c828286a79364e25873f83a7764cba7e/images/large/9.jpg not downloaded yet
2026-03-26 22:55:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/1dff36e495c1427799be5c45f57767b6/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252Fc828286a79364e25873f83a7764cba7e%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/c828286a79364e25873f83a7764cba7e/images/large/10.jpg not downloaded yet
2026-03-26 22:55:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/1dff36e495c1427799be5c45f57767b6/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/dab8941057fa43bb85bd50f1bdffb461/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/1dff36e495c1427799be5c45f57767b6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:20 [ayvens.be] INFO: Found listing with ID: 1985577
2026-03-26 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985577%27 HTTP/1.1" 200 None
2026-03-26 22:55:20 [ayvens.be] INFO: Scrape type for 1985577: 1
2026-03-26 22:55:20 [ayvens.be] INFO: Extracting data for car ID: 1985577
2026-03-26 22:55:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0df3679-6c69-53f3-837f-08eaed75cc34 with identifier: 1985577
2026-03-26 22:55:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0df3679-6c69-53f3-837f-08eaed75cc34 with scrape type 1
2026-03-26 22:55:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a0df3679-6c69-53f3-837f-08eaed75cc34
2026-03-26 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fe0c75242a7d440fe9775e632ca43ac0c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/e0c75242a7d440fe9775e632ca43ac0c/images/large/1.jpg not downloaded yet
2026-03-26 22:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fe0c75242a7d440fe9775e632ca43ac0c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/e0c75242a7d440fe9775e632ca43ac0c/images/large/2.jpg not downloaded yet
2026-03-26 22:55:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7572690>
2026-03-26 22:55:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbac0540-39df-5073-9762-7f74f4e38c3a/dbac0540-39df-5073-9762-7f74f4e38c3a_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F1dff36e495c1427799be5c45f57767b6%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/1dff36e495c1427799be5c45f57767b6/images/large/2.jpg saved to cache
2026-03-26 22:55:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dbac0540-39df-5073-9762-7f74f4e38c3a
2026-03-26 22:55:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6da4e10>
2026-03-26 22:55:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbac0540-39df-5073-9762-7f74f4e38c3a/dbac0540-39df-5073-9762-7f74f4e38c3a_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F1dff36e495c1427799be5c45f57767b6%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/1dff36e495c1427799be5c45f57767b6/images/large/3.jpg saved to cache
2026-03-26 22:55:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dbac0540-39df-5073-9762-7f74f4e38c3a
2026-03-26 22:55:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79811d0>
2026-03-26 22:55:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbac0540-39df-5073-9762-7f74f4e38c3a/dbac0540-39df-5073-9762-7f74f4e38c3a_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F1dff36e495c1427799be5c45f57767b6%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/1dff36e495c1427799be5c45f57767b6/images/large/4.jpg saved to cache
2026-03-26 22:55:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dbac0540-39df-5073-9762-7f74f4e38c3a
2026-03-26 22:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fe0c75242a7d440fe9775e632ca43ac0c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/e0c75242a7d440fe9775e632ca43ac0c/images/large/3.jpg not downloaded yet
2026-03-26 22:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fe0c75242a7d440fe9775e632ca43ac0c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/e0c75242a7d440fe9775e632ca43ac0c/images/large/4.jpg not downloaded yet
2026-03-26 22:55:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74080d0>
2026-03-26 22:55:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbac0540-39df-5073-9762-7f74f4e38c3a/dbac0540-39df-5073-9762-7f74f4e38c3a_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F1dff36e495c1427799be5c45f57767b6%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/1dff36e495c1427799be5c45f57767b6/images/large/5.jpg saved to cache
2026-03-26 22:55:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dbac0540-39df-5073-9762-7f74f4e38c3a
2026-03-26 22:55:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79a1e50>
2026-03-26 22:55:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbac0540-39df-5073-9762-7f74f4e38c3a/dbac0540-39df-5073-9762-7f74f4e38c3a_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F1dff36e495c1427799be5c45f57767b6%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/1dff36e495c1427799be5c45f57767b6/images/large/7.jpg saved to cache
2026-03-26 22:55:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item dbac0540-39df-5073-9762-7f74f4e38c3a
2026-03-26 22:55:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7a80410>
2026-03-26 22:55:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbac0540-39df-5073-9762-7f74f4e38c3a/dbac0540-39df-5073-9762-7f74f4e38c3a_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F1dff36e495c1427799be5c45f57767b6%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/1dff36e495c1427799be5c45f57767b6/images/large/6.jpg saved to cache
2026-03-26 22:55:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dbac0540-39df-5073-9762-7f74f4e38c3a
2026-03-26 22:55:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7ae8650>
2026-03-26 22:55:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0980ad47-8713-5737-b72e-7ea91ca5aa84/0980ad47-8713-5737-b72e-7ea91ca5aa84_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fdab8941057fa43bb85bd50f1bdffb461%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/dab8941057fa43bb85bd50f1bdffb461/images/large/7.jpg saved to cache
2026-03-26 22:55:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0980ad47-8713-5737-b72e-7ea91ca5aa84
2026-03-26 22:55:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0980ad47-8713-5737-b72e-7ea91ca5aa84, skipping ID generation
2026-03-26 22:55:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0980ad47-8713-5737-b72e-7ea91ca5aa84 with scrape type 1
2026-03-26 22:55:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0980ad47-8713-5737-b72e-7ea91ca5aa84 sending to next pipeline
2026-03-26 22:55:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 0980ad47-8713-5737-b72e-7ea91ca5aa84, identifier: 1985569
2026-03-26 22:55:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6ddab10>
2026-03-26 22:55:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbac0540-39df-5073-9762-7f74f4e38c3a/dbac0540-39df-5073-9762-7f74f4e38c3a_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F1dff36e495c1427799be5c45f57767b6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/1dff36e495c1427799be5c45f57767b6/images/large/1.jpg saved to cache
2026-03-26 22:55:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dbac0540-39df-5073-9762-7f74f4e38c3a
2026-03-26 22:55:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 0980ad47-8713-5737-b72e-7ea91ca5aa84 with identifier: 1985569
2026-03-26 22:55:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 0980ad47-8713-5737-b72e-7ea91ca5aa84 with identifier: 1985569
2026-03-26 22:55:21 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 0980ad47-8713-5737-b72e-7ea91ca5aa84 with identifier: 1985569 to the API
2026-03-26 22:55:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:55:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:55:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bl/dab8941057fa43bb85bd50f1bdffb461/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '0980ad47-8713-5737-b72e-7ea91ca5aa84',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3',
 'odometer': 106979,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 24,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0980ad47-8713-5737-b72e-7ea91ca5aa84/0980ad47-8713-5737-b72e-7ea91ca5aa84_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 709390,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/dab8941057fa43bb85bd50f1bdffb461/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0980ad47-8713-5737-b72e-7ea91ca5aa84/0980ad47-8713-5737-b72e-7ea91ca5aa84_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 719754,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/dab8941057fa43bb85bd50f1bdffb461/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0980ad47-8713-5737-b72e-7ea91ca5aa84/0980ad47-8713-5737-b72e-7ea91ca5aa84_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 706256,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/dab8941057fa43bb85bd50f1bdffb461/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0980ad47-8713-5737-b72e-7ea91ca5aa84/0980ad47-8713-5737-b72e-7ea91ca5aa84_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 737649,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/dab8941057fa43bb85bd50f1bdffb461/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0980ad47-8713-5737-b72e-7ea91ca5aa84/0980ad47-8713-5737-b72e-7ea91ca5aa84_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 737860,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/dab8941057fa43bb85bd50f1bdffb461/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0980ad47-8713-5737-b72e-7ea91ca5aa84/0980ad47-8713-5737-b72e-7ea91ca5aa84_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 775540,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/dab8941057fa43bb85bd50f1bdffb461/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0980ad47-8713-5737-b72e-7ea91ca5aa84/0980ad47-8713-5737-b72e-7ea91ca5aa84_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 705468,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/dab8941057fa43bb85bd50f1bdffb461/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0980ad47-8713-5737-b72e-7ea91ca5aa84/0980ad47-8713-5737-b72e-7ea91ca5aa84_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 996311,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/dab8941057fa43bb85bd50f1bdffb461/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0980ad47-8713-5737-b72e-7ea91ca5aa84/0980ad47-8713-5737-b72e-7ea91ca5aa84_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 951027,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/dab8941057fa43bb85bd50f1bdffb461/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0980ad47-8713-5737-b72e-7ea91ca5aa84/0980ad47-8713-5737-b72e-7ea91ca5aa84_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 953391,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/dab8941057fa43bb85bd50f1bdffb461/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 1.4 45 TFSI E S TRONIC',
 'transmission': 'automatic',
 'trim': '1.4 45 TFSI E S TRONIC',
 'vin': None,
 'year': 2022}
2026-03-26 22:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985569%27 HTTP/1.1" 200 None
2026-03-26 22:55:22 [ayvens.be] INFO: Saving data for 1985569: {'created_time': 1774565722.203083, 'last_price_update_time': 1774565722.203092, 'auction_closing_time': 1774958400.0}
2026-03-26 22:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985569') HTTP/1.1" 204 0
2026-03-26 22:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fe0c75242a7d440fe9775e632ca43ac0c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/e0c75242a7d440fe9775e632ca43ac0c/images/large/5.jpg not downloaded yet
2026-03-26 22:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fe0c75242a7d440fe9775e632ca43ac0c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/e0c75242a7d440fe9775e632ca43ac0c/images/large/6.jpg not downloaded yet
2026-03-26 22:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fe0c75242a7d440fe9775e632ca43ac0c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/e0c75242a7d440fe9775e632ca43ac0c/images/large/7.jpg not downloaded yet
2026-03-26 22:55:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ef/e26d79d379404db695f6751564ba09e5/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fe0c75242a7d440fe9775e632ca43ac0c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/e0c75242a7d440fe9775e632ca43ac0c/images/large/8.jpg not downloaded yet
2026-03-26 22:55:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/1dff36e495c1427799be5c45f57767b6/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ck/c828286a79364e25873f83a7764cba7e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ck/c828286a79364e25873f83a7764cba7e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ef/e26d79d379404db695f6751564ba09e5/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/1dff36e495c1427799be5c45f57767b6/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ck/c828286a79364e25873f83a7764cba7e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fe0c75242a7d440fe9775e632ca43ac0c%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/e0c75242a7d440fe9775e632ca43ac0c/images/large/9.jpg not downloaded yet
2026-03-26 22:55:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/1dff36e495c1427799be5c45f57767b6/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fe0c75242a7d440fe9775e632ca43ac0c%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/e0c75242a7d440fe9775e632ca43ac0c/images/large/10.jpg not downloaded yet
2026-03-26 22:55:22 [ayvens.be] INFO: Found listing with ID: 1985578
2026-03-26 22:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985578%27 HTTP/1.1" 200 None
2026-03-26 22:55:22 [ayvens.be] INFO: Scrape type for 1985578: 1
2026-03-26 22:55:22 [ayvens.be] INFO: Extracting data for car ID: 1985578
2026-03-26 22:55:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb7e5240-8a65-5e03-80d9-ed222dac75cd with identifier: 1985578
2026-03-26 22:55:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb7e5240-8a65-5e03-80d9-ed222dac75cd with scrape type 1
2026-03-26 22:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item eb7e5240-8a65-5e03-80d9-ed222dac75cd
2026-03-26 22:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eq%252F5fbfd585b71740b290e3f842c8e94fa4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eq/5fbfd585b71740b290e3f842c8e94fa4/images/large/1.jpg not downloaded yet
2026-03-26 22:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eq%252F5fbfd585b71740b290e3f842c8e94fa4%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eq/5fbfd585b71740b290e3f842c8e94fa4/images/large/2.jpg not downloaded yet
2026-03-26 22:55:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd3a9650>
2026-03-26 22:55:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99c16ce4-23e7-5da6-9da3-86696de860c7/99c16ce4-23e7-5da6-9da3-86696de860c7_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ef%252Fe26d79d379404db695f6751564ba09e5%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ef/e26d79d379404db695f6751564ba09e5/images/large/7.jpg saved to cache
2026-03-26 22:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 99c16ce4-23e7-5da6-9da3-86696de860c7
2026-03-26 22:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eq%252F5fbfd585b71740b290e3f842c8e94fa4%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eq/5fbfd585b71740b290e3f842c8e94fa4/images/large/3.jpg not downloaded yet
2026-03-26 22:55:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b75a6250>
2026-03-26 22:55:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbac0540-39df-5073-9762-7f74f4e38c3a/dbac0540-39df-5073-9762-7f74f4e38c3a_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F1dff36e495c1427799be5c45f57767b6%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/1dff36e495c1427799be5c45f57767b6/images/large/9.jpg saved to cache
2026-03-26 22:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item dbac0540-39df-5073-9762-7f74f4e38c3a
2026-03-26 22:55:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5ca46d0>
2026-03-26 22:55:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96fdc9f1-7ce0-5fb1-a642-99698f01a88c/96fdc9f1-7ce0-5fb1-a642-99698f01a88c_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252Fc828286a79364e25873f83a7764cba7e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/c828286a79364e25873f83a7764cba7e/images/large/3.jpg saved to cache
2026-03-26 22:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 96fdc9f1-7ce0-5fb1-a642-99698f01a88c
2026-03-26 22:55:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c82e90>
2026-03-26 22:55:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96fdc9f1-7ce0-5fb1-a642-99698f01a88c/96fdc9f1-7ce0-5fb1-a642-99698f01a88c_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252Fc828286a79364e25873f83a7764cba7e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/c828286a79364e25873f83a7764cba7e/images/large/2.jpg saved to cache
2026-03-26 22:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 96fdc9f1-7ce0-5fb1-a642-99698f01a88c
2026-03-26 22:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eq%252F5fbfd585b71740b290e3f842c8e94fa4%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eq/5fbfd585b71740b290e3f842c8e94fa4/images/large/4.jpg not downloaded yet
2026-03-26 22:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eq%252F5fbfd585b71740b290e3f842c8e94fa4%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eq/5fbfd585b71740b290e3f842c8e94fa4/images/large/5.jpg not downloaded yet
2026-03-26 22:55:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7493c10>
2026-03-26 22:55:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99c16ce4-23e7-5da6-9da3-86696de860c7/99c16ce4-23e7-5da6-9da3-86696de860c7_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ef%252Fe26d79d379404db695f6751564ba09e5%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ef/e26d79d379404db695f6751564ba09e5/images/large/8.jpg saved to cache
2026-03-26 22:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 99c16ce4-23e7-5da6-9da3-86696de860c7
2026-03-26 22:55:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 99c16ce4-23e7-5da6-9da3-86696de860c7, skipping ID generation
2026-03-26 22:55:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99c16ce4-23e7-5da6-9da3-86696de860c7 with scrape type 1
2026-03-26 22:55:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 99c16ce4-23e7-5da6-9da3-86696de860c7 sending to next pipeline
2026-03-26 22:55:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 99c16ce4-23e7-5da6-9da3-86696de860c7, identifier: 1985567
2026-03-26 22:55:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7a81410>
2026-03-26 22:55:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbac0540-39df-5073-9762-7f74f4e38c3a/dbac0540-39df-5073-9762-7f74f4e38c3a_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F1dff36e495c1427799be5c45f57767b6%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/1dff36e495c1427799be5c45f57767b6/images/large/10.jpg saved to cache
2026-03-26 22:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item dbac0540-39df-5073-9762-7f74f4e38c3a
2026-03-26 22:55:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c5d890>
2026-03-26 22:55:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96fdc9f1-7ce0-5fb1-a642-99698f01a88c/96fdc9f1-7ce0-5fb1-a642-99698f01a88c_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252Fc828286a79364e25873f83a7764cba7e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/c828286a79364e25873f83a7764cba7e/images/large/1.jpg saved to cache
2026-03-26 22:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 96fdc9f1-7ce0-5fb1-a642-99698f01a88c
2026-03-26 22:55:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd8e0550>
2026-03-26 22:55:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbac0540-39df-5073-9762-7f74f4e38c3a/dbac0540-39df-5073-9762-7f74f4e38c3a_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F1dff36e495c1427799be5c45f57767b6%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/1dff36e495c1427799be5c45f57767b6/images/large/8.jpg saved to cache
2026-03-26 22:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item dbac0540-39df-5073-9762-7f74f4e38c3a
2026-03-26 22:55:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dbac0540-39df-5073-9762-7f74f4e38c3a, skipping ID generation
2026-03-26 22:55:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dbac0540-39df-5073-9762-7f74f4e38c3a with scrape type 1
2026-03-26 22:55:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dbac0540-39df-5073-9762-7f74f4e38c3a sending to next pipeline
2026-03-26 22:55:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: dbac0540-39df-5073-9762-7f74f4e38c3a, identifier: 1985575
2026-03-26 22:55:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 99c16ce4-23e7-5da6-9da3-86696de860c7 with identifier: 1985567
2026-03-26 22:55:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 99c16ce4-23e7-5da6-9da3-86696de860c7 with identifier: 1985567
2026-03-26 22:55:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 99c16ce4-23e7-5da6-9da3-86696de860c7 with identifier: 1985567 to the API
2026-03-26 22:55:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:55:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:55:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ef/e26d79d379404db695f6751564ba09e5/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '99c16ce4-23e7-5da6-9da3-86696de860c7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A-CLASS',
 'odometer': 20854,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99c16ce4-23e7-5da6-9da3-86696de860c7/99c16ce4-23e7-5da6-9da3-86696de860c7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 719200,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ef/e26d79d379404db695f6751564ba09e5/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99c16ce4-23e7-5da6-9da3-86696de860c7/99c16ce4-23e7-5da6-9da3-86696de860c7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 679392,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ef/e26d79d379404db695f6751564ba09e5/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99c16ce4-23e7-5da6-9da3-86696de860c7/99c16ce4-23e7-5da6-9da3-86696de860c7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 721333,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ef/e26d79d379404db695f6751564ba09e5/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99c16ce4-23e7-5da6-9da3-86696de860c7/99c16ce4-23e7-5da6-9da3-86696de860c7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 702551,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ef/e26d79d379404db695f6751564ba09e5/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99c16ce4-23e7-5da6-9da3-86696de860c7/99c16ce4-23e7-5da6-9da3-86696de860c7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 727042,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ef/e26d79d379404db695f6751564ba09e5/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99c16ce4-23e7-5da6-9da3-86696de860c7/99c16ce4-23e7-5da6-9da3-86696de860c7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 729916,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ef/e26d79d379404db695f6751564ba09e5/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99c16ce4-23e7-5da6-9da3-86696de860c7/99c16ce4-23e7-5da6-9da3-86696de860c7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 633203,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ef/e26d79d379404db695f6751564ba09e5/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99c16ce4-23e7-5da6-9da3-86696de860c7/99c16ce4-23e7-5da6-9da3-86696de860c7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 807729,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ef/e26d79d379404db695f6751564ba09e5/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99c16ce4-23e7-5da6-9da3-86696de860c7/99c16ce4-23e7-5da6-9da3-86696de860c7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 885943,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ef/e26d79d379404db695f6751564ba09e5/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99c16ce4-23e7-5da6-9da3-86696de860c7/99c16ce4-23e7-5da6-9da3-86696de860c7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 858858,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ef/e26d79d379404db695f6751564ba09e5/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-09-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ A-CLASS 1.3 A 250 E LUXURY LINE DCT',
 'transmission': 'automatic',
 'trim': '1.3 A 250 E LUXURY LINE DCT',
 'vin': None,
 'year': 2023}
2026-03-26 22:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985567%27 HTTP/1.1" 200 None
2026-03-26 22:55:23 [ayvens.be] INFO: Saving data for 1985567: {'created_time': 1774565723.786625, 'last_price_update_time': 1774565723.786636, 'auction_closing_time': 1774958400.0}
2026-03-26 22:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985567') HTTP/1.1" 204 0
2026-03-26 22:55:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: dbac0540-39df-5073-9762-7f74f4e38c3a with identifier: 1985575
2026-03-26 22:55:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: dbac0540-39df-5073-9762-7f74f4e38c3a with identifier: 1985575
2026-03-26 22:55:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: dbac0540-39df-5073-9762-7f74f4e38c3a with identifier: 1985575 to the API
2026-03-26 22:55:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:55:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:55:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bv/1dff36e495c1427799be5c45f57767b6/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'dbac0540-39df-5073-9762-7f74f4e38c3a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q2',
 'odometer': 183362,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbac0540-39df-5073-9762-7f74f4e38c3a/dbac0540-39df-5073-9762-7f74f4e38c3a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 739837,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/1dff36e495c1427799be5c45f57767b6/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbac0540-39df-5073-9762-7f74f4e38c3a/dbac0540-39df-5073-9762-7f74f4e38c3a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 719452,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/1dff36e495c1427799be5c45f57767b6/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbac0540-39df-5073-9762-7f74f4e38c3a/dbac0540-39df-5073-9762-7f74f4e38c3a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 721322,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/1dff36e495c1427799be5c45f57767b6/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbac0540-39df-5073-9762-7f74f4e38c3a/dbac0540-39df-5073-9762-7f74f4e38c3a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 758348,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/1dff36e495c1427799be5c45f57767b6/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbac0540-39df-5073-9762-7f74f4e38c3a/dbac0540-39df-5073-9762-7f74f4e38c3a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 707731,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/1dff36e495c1427799be5c45f57767b6/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbac0540-39df-5073-9762-7f74f4e38c3a/dbac0540-39df-5073-9762-7f74f4e38c3a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 752863,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/1dff36e495c1427799be5c45f57767b6/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbac0540-39df-5073-9762-7f74f4e38c3a/dbac0540-39df-5073-9762-7f74f4e38c3a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 602355,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/1dff36e495c1427799be5c45f57767b6/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbac0540-39df-5073-9762-7f74f4e38c3a/dbac0540-39df-5073-9762-7f74f4e38c3a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 856536,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/1dff36e495c1427799be5c45f57767b6/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbac0540-39df-5073-9762-7f74f4e38c3a/dbac0540-39df-5073-9762-7f74f4e38c3a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 891085,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/1dff36e495c1427799be5c45f57767b6/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbac0540-39df-5073-9762-7f74f4e38c3a/dbac0540-39df-5073-9762-7f74f4e38c3a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 834081,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/1dff36e495c1427799be5c45f57767b6/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q2 1.0 30 TFSI ATTRACTION',
 'transmission': 'manual',
 'trim': '1.0 30 TFSI ATTRACTION',
 'vin': None,
 'year': 2022}
2026-03-26 22:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985575%27 HTTP/1.1" 200 None
2026-03-26 22:55:24 [ayvens.be] INFO: Saving data for 1985575: {'created_time': 1774565724.098863, 'last_price_update_time': 1774565724.098872, 'auction_closing_time': 1774958400.0}
2026-03-26 22:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985575') HTTP/1.1" 204 0
2026-03-26 22:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eq%252F5fbfd585b71740b290e3f842c8e94fa4%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eq/5fbfd585b71740b290e3f842c8e94fa4/images/large/6.jpg not downloaded yet
2026-03-26 22:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eq%252F5fbfd585b71740b290e3f842c8e94fa4%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eq/5fbfd585b71740b290e3f842c8e94fa4/images/large/7.jpg not downloaded yet
2026-03-26 22:55:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/e0c75242a7d440fe9775e632ca43ac0c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/e0c75242a7d440fe9775e632ca43ac0c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/e0c75242a7d440fe9775e632ca43ac0c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eq%252F5fbfd585b71740b290e3f842c8e94fa4%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eq/5fbfd585b71740b290e3f842c8e94fa4/images/large/8.jpg not downloaded yet
2026-03-26 22:55:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ck/c828286a79364e25873f83a7764cba7e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ck/c828286a79364e25873f83a7764cba7e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ck/c828286a79364e25873f83a7764cba7e/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ck/c828286a79364e25873f83a7764cba7e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ck/c828286a79364e25873f83a7764cba7e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eq%252F5fbfd585b71740b290e3f842c8e94fa4%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eq/5fbfd585b71740b290e3f842c8e94fa4/images/large/9.jpg not downloaded yet
2026-03-26 22:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eq%252F5fbfd585b71740b290e3f842c8e94fa4%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eq/5fbfd585b71740b290e3f842c8e94fa4/images/large/10.jpg not downloaded yet
2026-03-26 22:55:24 [ayvens.be] INFO: Found listing with ID: 1985579
2026-03-26 22:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985579%27 HTTP/1.1" 200 None
2026-03-26 22:55:24 [ayvens.be] INFO: Scrape type for 1985579: 1
2026-03-26 22:55:24 [ayvens.be] INFO: Extracting data for car ID: 1985579
2026-03-26 22:55:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 054bf54d-3f34-5d87-91cc-317a6a689a28 with identifier: 1985579
2026-03-26 22:55:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 054bf54d-3f34-5d87-91cc-317a6a689a28 with scrape type 1
2026-03-26 22:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 054bf54d-3f34-5d87-91cc-317a6a689a28
2026-03-26 22:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F674b8954cb8741c091b8237326277e4b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/674b8954cb8741c091b8237326277e4b/images/large/1.jpg not downloaded yet
2026-03-26 22:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F674b8954cb8741c091b8237326277e4b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/674b8954cb8741c091b8237326277e4b/images/large/2.jpg not downloaded yet
2026-03-26 22:55:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7429250>
2026-03-26 22:55:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0df3679-6c69-53f3-837f-08eaed75cc34/a0df3679-6c69-53f3-837f-08eaed75cc34_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fe0c75242a7d440fe9775e632ca43ac0c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/e0c75242a7d440fe9775e632ca43ac0c/images/large/3.jpg saved to cache
2026-03-26 22:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a0df3679-6c69-53f3-837f-08eaed75cc34
2026-03-26 22:55:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7a56110>
2026-03-26 22:55:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0df3679-6c69-53f3-837f-08eaed75cc34/a0df3679-6c69-53f3-837f-08eaed75cc34_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fe0c75242a7d440fe9775e632ca43ac0c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/e0c75242a7d440fe9775e632ca43ac0c/images/large/2.jpg saved to cache
2026-03-26 22:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a0df3679-6c69-53f3-837f-08eaed75cc34
2026-03-26 22:55:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6da7810>
2026-03-26 22:55:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0df3679-6c69-53f3-837f-08eaed75cc34/a0df3679-6c69-53f3-837f-08eaed75cc34_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fe0c75242a7d440fe9775e632ca43ac0c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/e0c75242a7d440fe9775e632ca43ac0c/images/large/1.jpg saved to cache
2026-03-26 22:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a0df3679-6c69-53f3-837f-08eaed75cc34
2026-03-26 22:55:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7a54090>
2026-03-26 22:55:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96fdc9f1-7ce0-5fb1-a642-99698f01a88c/96fdc9f1-7ce0-5fb1-a642-99698f01a88c_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252Fc828286a79364e25873f83a7764cba7e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/c828286a79364e25873f83a7764cba7e/images/large/8.jpg saved to cache
2026-03-26 22:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 96fdc9f1-7ce0-5fb1-a642-99698f01a88c
2026-03-26 22:55:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5ca7210>
2026-03-26 22:55:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96fdc9f1-7ce0-5fb1-a642-99698f01a88c/96fdc9f1-7ce0-5fb1-a642-99698f01a88c_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252Fc828286a79364e25873f83a7764cba7e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/c828286a79364e25873f83a7764cba7e/images/large/6.jpg saved to cache
2026-03-26 22:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 96fdc9f1-7ce0-5fb1-a642-99698f01a88c
2026-03-26 22:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F674b8954cb8741c091b8237326277e4b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/674b8954cb8741c091b8237326277e4b/images/large/3.jpg not downloaded yet
2026-03-26 22:55:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2eq/5fbfd585b71740b290e3f842c8e94fa4/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2eq/5fbfd585b71740b290e3f842c8e94fa4/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b788c8d0>
2026-03-26 22:55:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96fdc9f1-7ce0-5fb1-a642-99698f01a88c/96fdc9f1-7ce0-5fb1-a642-99698f01a88c_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252Fc828286a79364e25873f83a7764cba7e%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/c828286a79364e25873f83a7764cba7e/images/large/10.jpg saved to cache
2026-03-26 22:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 96fdc9f1-7ce0-5fb1-a642-99698f01a88c
2026-03-26 22:55:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd5b17d0>
2026-03-26 22:55:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96fdc9f1-7ce0-5fb1-a642-99698f01a88c/96fdc9f1-7ce0-5fb1-a642-99698f01a88c_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252Fc828286a79364e25873f83a7764cba7e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/c828286a79364e25873f83a7764cba7e/images/large/7.jpg saved to cache
2026-03-26 22:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 96fdc9f1-7ce0-5fb1-a642-99698f01a88c
2026-03-26 22:55:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7a81850>
2026-03-26 22:55:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96fdc9f1-7ce0-5fb1-a642-99698f01a88c/96fdc9f1-7ce0-5fb1-a642-99698f01a88c_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252Fc828286a79364e25873f83a7764cba7e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/c828286a79364e25873f83a7764cba7e/images/large/5.jpg saved to cache
2026-03-26 22:55:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 96fdc9f1-7ce0-5fb1-a642-99698f01a88c
2026-03-26 22:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F674b8954cb8741c091b8237326277e4b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/674b8954cb8741c091b8237326277e4b/images/large/4.jpg not downloaded yet
2026-03-26 22:55:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2eq/5fbfd585b71740b290e3f842c8e94fa4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2eq/5fbfd585b71740b290e3f842c8e94fa4/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F674b8954cb8741c091b8237326277e4b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/674b8954cb8741c091b8237326277e4b/images/large/5.jpg not downloaded yet
2026-03-26 22:55:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7412790>
2026-03-26 22:55:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb7e5240-8a65-5e03-80d9-ed222dac75cd/eb7e5240-8a65-5e03-80d9-ed222dac75cd_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eq%252F5fbfd585b71740b290e3f842c8e94fa4%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eq/5fbfd585b71740b290e3f842c8e94fa4/images/large/4.jpg saved to cache
2026-03-26 22:55:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item eb7e5240-8a65-5e03-80d9-ed222dac75cd
2026-03-26 22:55:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b75733d0>
2026-03-26 22:55:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb7e5240-8a65-5e03-80d9-ed222dac75cd/eb7e5240-8a65-5e03-80d9-ed222dac75cd_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eq%252F5fbfd585b71740b290e3f842c8e94fa4%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eq/5fbfd585b71740b290e3f842c8e94fa4/images/large/2.jpg saved to cache
2026-03-26 22:55:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item eb7e5240-8a65-5e03-80d9-ed222dac75cd
2026-03-26 22:55:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/e0c75242a7d440fe9775e632ca43ac0c/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F674b8954cb8741c091b8237326277e4b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/674b8954cb8741c091b8237326277e4b/images/large/6.jpg not downloaded yet
2026-03-26 22:55:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/e0c75242a7d440fe9775e632ca43ac0c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/e0c75242a7d440fe9775e632ca43ac0c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/e0c75242a7d440fe9775e632ca43ac0c/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F674b8954cb8741c091b8237326277e4b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/674b8954cb8741c091b8237326277e4b/images/large/7.jpg not downloaded yet
2026-03-26 22:55:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2eq/5fbfd585b71740b290e3f842c8e94fa4/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F674b8954cb8741c091b8237326277e4b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/674b8954cb8741c091b8237326277e4b/images/large/8.jpg not downloaded yet
2026-03-26 22:55:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5ca7190>
2026-03-26 22:55:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb7e5240-8a65-5e03-80d9-ed222dac75cd/eb7e5240-8a65-5e03-80d9-ed222dac75cd_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eq%252F5fbfd585b71740b290e3f842c8e94fa4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eq/5fbfd585b71740b290e3f842c8e94fa4/images/large/1.jpg saved to cache
2026-03-26 22:55:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item eb7e5240-8a65-5e03-80d9-ed222dac75cd
2026-03-26 22:55:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7410a10>
2026-03-26 22:55:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb7e5240-8a65-5e03-80d9-ed222dac75cd/eb7e5240-8a65-5e03-80d9-ed222dac75cd_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eq%252F5fbfd585b71740b290e3f842c8e94fa4%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eq/5fbfd585b71740b290e3f842c8e94fa4/images/large/3.jpg saved to cache
2026-03-26 22:55:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item eb7e5240-8a65-5e03-80d9-ed222dac75cd
2026-03-26 22:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F674b8954cb8741c091b8237326277e4b%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/674b8954cb8741c091b8237326277e4b/images/large/9.jpg not downloaded yet
2026-03-26 22:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F674b8954cb8741c091b8237326277e4b%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/674b8954cb8741c091b8237326277e4b/images/large/10.jpg not downloaded yet
2026-03-26 22:55:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2eq/5fbfd585b71740b290e3f842c8e94fa4/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b746e650>
2026-03-26 22:55:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0df3679-6c69-53f3-837f-08eaed75cc34/a0df3679-6c69-53f3-837f-08eaed75cc34_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fe0c75242a7d440fe9775e632ca43ac0c%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/e0c75242a7d440fe9775e632ca43ac0c/images/large/10.jpg saved to cache
2026-03-26 22:55:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a0df3679-6c69-53f3-837f-08eaed75cc34
2026-03-26 22:55:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b781bb90>
2026-03-26 22:55:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0df3679-6c69-53f3-837f-08eaed75cc34/a0df3679-6c69-53f3-837f-08eaed75cc34_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fe0c75242a7d440fe9775e632ca43ac0c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/e0c75242a7d440fe9775e632ca43ac0c/images/large/7.jpg saved to cache
2026-03-26 22:55:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a0df3679-6c69-53f3-837f-08eaed75cc34
2026-03-26 22:55:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c81d50>
2026-03-26 22:55:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0df3679-6c69-53f3-837f-08eaed75cc34/a0df3679-6c69-53f3-837f-08eaed75cc34_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fe0c75242a7d440fe9775e632ca43ac0c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/e0c75242a7d440fe9775e632ca43ac0c/images/large/8.jpg saved to cache
2026-03-26 22:55:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a0df3679-6c69-53f3-837f-08eaed75cc34
2026-03-26 22:55:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b740bc10>
2026-03-26 22:55:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0df3679-6c69-53f3-837f-08eaed75cc34/a0df3679-6c69-53f3-837f-08eaed75cc34_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fe0c75242a7d440fe9775e632ca43ac0c%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/e0c75242a7d440fe9775e632ca43ac0c/images/large/9.jpg saved to cache
2026-03-26 22:55:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a0df3679-6c69-53f3-837f-08eaed75cc34
2026-03-26 22:55:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7926bd0>
2026-03-26 22:55:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb7e5240-8a65-5e03-80d9-ed222dac75cd/eb7e5240-8a65-5e03-80d9-ed222dac75cd_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eq%252F5fbfd585b71740b290e3f842c8e94fa4%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eq/5fbfd585b71740b290e3f842c8e94fa4/images/large/6.jpg saved to cache
2026-03-26 22:55:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item eb7e5240-8a65-5e03-80d9-ed222dac75cd
2026-03-26 22:55:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2eq/5fbfd585b71740b290e3f842c8e94fa4/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2eq/5fbfd585b71740b290e3f842c8e94fa4/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2eq/5fbfd585b71740b290e3f842c8e94fa4/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:25 [ayvens.be] INFO: Found listing with ID: 1985580
2026-03-26 22:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985580%27 HTTP/1.1" 200 None
2026-03-26 22:55:25 [ayvens.be] INFO: Scrape type for 1985580: 1
2026-03-26 22:55:25 [ayvens.be] INFO: Extracting data for car ID: 1985580
2026-03-26 22:55:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 768ee90d-9e68-5f82-b05d-5531b8607182 with identifier: 1985580
2026-03-26 22:55:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 768ee90d-9e68-5f82-b05d-5531b8607182 with scrape type 1
2026-03-26 22:55:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 768ee90d-9e68-5f82-b05d-5531b8607182
2026-03-26 22:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F9d9663d888314f3496cb93868b518eac%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/9d9663d888314f3496cb93868b518eac/images/large/1.jpg not downloaded yet
2026-03-26 22:55:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/674b8954cb8741c091b8237326277e4b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/674b8954cb8741c091b8237326277e4b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F9d9663d888314f3496cb93868b518eac%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/9d9663d888314f3496cb93868b518eac/images/large/2.jpg not downloaded yet
2026-03-26 22:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F9d9663d888314f3496cb93868b518eac%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/9d9663d888314f3496cb93868b518eac/images/large/3.jpg not downloaded yet
2026-03-26 22:55:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b72ffb10>
2026-03-26 22:55:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb7e5240-8a65-5e03-80d9-ed222dac75cd/eb7e5240-8a65-5e03-80d9-ed222dac75cd_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eq%252F5fbfd585b71740b290e3f842c8e94fa4%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eq/5fbfd585b71740b290e3f842c8e94fa4/images/large/10.jpg saved to cache
2026-03-26 22:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item eb7e5240-8a65-5e03-80d9-ed222dac75cd
2026-03-26 22:55:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2eq/5fbfd585b71740b290e3f842c8e94fa4/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F9d9663d888314f3496cb93868b518eac%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/9d9663d888314f3496cb93868b518eac/images/large/4.jpg not downloaded yet
2026-03-26 22:55:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/674b8954cb8741c091b8237326277e4b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F9d9663d888314f3496cb93868b518eac%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/9d9663d888314f3496cb93868b518eac/images/large/5.jpg not downloaded yet
2026-03-26 22:55:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cbc790>
2026-03-26 22:55:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb7e5240-8a65-5e03-80d9-ed222dac75cd/eb7e5240-8a65-5e03-80d9-ed222dac75cd_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eq%252F5fbfd585b71740b290e3f842c8e94fa4%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eq/5fbfd585b71740b290e3f842c8e94fa4/images/large/9.jpg saved to cache
2026-03-26 22:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item eb7e5240-8a65-5e03-80d9-ed222dac75cd
2026-03-26 22:55:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7913d50>
2026-03-26 22:55:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb7e5240-8a65-5e03-80d9-ed222dac75cd/eb7e5240-8a65-5e03-80d9-ed222dac75cd_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eq%252F5fbfd585b71740b290e3f842c8e94fa4%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eq/5fbfd585b71740b290e3f842c8e94fa4/images/large/7.jpg saved to cache
2026-03-26 22:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item eb7e5240-8a65-5e03-80d9-ed222dac75cd
2026-03-26 22:55:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7ae9e90>
2026-03-26 22:55:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb7e5240-8a65-5e03-80d9-ed222dac75cd/eb7e5240-8a65-5e03-80d9-ed222dac75cd_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eq%252F5fbfd585b71740b290e3f842c8e94fa4%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eq/5fbfd585b71740b290e3f842c8e94fa4/images/large/8.jpg saved to cache
2026-03-26 22:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item eb7e5240-8a65-5e03-80d9-ed222dac75cd
2026-03-26 22:55:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7924090>
2026-03-26 22:55:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_054bf54d-3f34-5d87-91cc-317a6a689a28/054bf54d-3f34-5d87-91cc-317a6a689a28_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F674b8954cb8741c091b8237326277e4b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/674b8954cb8741c091b8237326277e4b/images/large/3.jpg saved to cache
2026-03-26 22:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 054bf54d-3f34-5d87-91cc-317a6a689a28
2026-03-26 22:55:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7459790>
2026-03-26 22:55:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_054bf54d-3f34-5d87-91cc-317a6a689a28/054bf54d-3f34-5d87-91cc-317a6a689a28_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F674b8954cb8741c091b8237326277e4b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/674b8954cb8741c091b8237326277e4b/images/large/2.jpg saved to cache
2026-03-26 22:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 054bf54d-3f34-5d87-91cc-317a6a689a28
2026-03-26 22:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F9d9663d888314f3496cb93868b518eac%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/9d9663d888314f3496cb93868b518eac/images/large/6.jpg not downloaded yet
2026-03-26 22:55:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/e0c75242a7d440fe9775e632ca43ac0c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F9d9663d888314f3496cb93868b518eac%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/9d9663d888314f3496cb93868b518eac/images/large/7.jpg not downloaded yet
2026-03-26 22:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F9d9663d888314f3496cb93868b518eac%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/9d9663d888314f3496cb93868b518eac/images/large/8.jpg not downloaded yet
2026-03-26 22:55:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7406810>
2026-03-26 22:55:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb7e5240-8a65-5e03-80d9-ed222dac75cd/eb7e5240-8a65-5e03-80d9-ed222dac75cd_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eq%252F5fbfd585b71740b290e3f842c8e94fa4%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eq/5fbfd585b71740b290e3f842c8e94fa4/images/large/5.jpg saved to cache
2026-03-26 22:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item eb7e5240-8a65-5e03-80d9-ed222dac75cd
2026-03-26 22:55:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: eb7e5240-8a65-5e03-80d9-ed222dac75cd, skipping ID generation
2026-03-26 22:55:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb7e5240-8a65-5e03-80d9-ed222dac75cd with scrape type 1
2026-03-26 22:55:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item eb7e5240-8a65-5e03-80d9-ed222dac75cd sending to next pipeline
2026-03-26 22:55:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: eb7e5240-8a65-5e03-80d9-ed222dac75cd, identifier: 1985578
2026-03-26 22:55:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd496d90>
2026-03-26 22:55:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_054bf54d-3f34-5d87-91cc-317a6a689a28/054bf54d-3f34-5d87-91cc-317a6a689a28_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F674b8954cb8741c091b8237326277e4b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/674b8954cb8741c091b8237326277e4b/images/large/1.jpg saved to cache
2026-03-26 22:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 054bf54d-3f34-5d87-91cc-317a6a689a28
2026-03-26 22:55:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/e0c75242a7d440fe9775e632ca43ac0c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: eb7e5240-8a65-5e03-80d9-ed222dac75cd with identifier: 1985578
2026-03-26 22:55:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: eb7e5240-8a65-5e03-80d9-ed222dac75cd with identifier: 1985578
2026-03-26 22:55:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: eb7e5240-8a65-5e03-80d9-ed222dac75cd with identifier: 1985578 to the API
2026-03-26 22:55:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:55:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:55:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2eq/5fbfd585b71740b290e3f842c8e94fa4/images/large/5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'eb7e5240-8a65-5e03-80d9-ed222dac75cd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'PUMA',
 'odometer': 54559,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb7e5240-8a65-5e03-80d9-ed222dac75cd/eb7e5240-8a65-5e03-80d9-ed222dac75cd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 244492,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2eq/5fbfd585b71740b290e3f842c8e94fa4/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb7e5240-8a65-5e03-80d9-ed222dac75cd/eb7e5240-8a65-5e03-80d9-ed222dac75cd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 237099,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2eq/5fbfd585b71740b290e3f842c8e94fa4/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb7e5240-8a65-5e03-80d9-ed222dac75cd/eb7e5240-8a65-5e03-80d9-ed222dac75cd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 260330,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2eq/5fbfd585b71740b290e3f842c8e94fa4/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb7e5240-8a65-5e03-80d9-ed222dac75cd/eb7e5240-8a65-5e03-80d9-ed222dac75cd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 255514,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2eq/5fbfd585b71740b290e3f842c8e94fa4/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb7e5240-8a65-5e03-80d9-ed222dac75cd/eb7e5240-8a65-5e03-80d9-ed222dac75cd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 275797,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2eq/5fbfd585b71740b290e3f842c8e94fa4/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb7e5240-8a65-5e03-80d9-ed222dac75cd/eb7e5240-8a65-5e03-80d9-ed222dac75cd_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 241455,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2eq/5fbfd585b71740b290e3f842c8e94fa4/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb7e5240-8a65-5e03-80d9-ed222dac75cd/eb7e5240-8a65-5e03-80d9-ed222dac75cd_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 270525,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2eq/5fbfd585b71740b290e3f842c8e94fa4/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb7e5240-8a65-5e03-80d9-ed222dac75cd/eb7e5240-8a65-5e03-80d9-ed222dac75cd_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 268442,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2eq/5fbfd585b71740b290e3f842c8e94fa4/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb7e5240-8a65-5e03-80d9-ed222dac75cd/eb7e5240-8a65-5e03-80d9-ed222dac75cd_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 312176,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2eq/5fbfd585b71740b290e3f842c8e94fa4/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb7e5240-8a65-5e03-80d9-ed222dac75cd/eb7e5240-8a65-5e03-80d9-ed222dac75cd_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 233079,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2eq/5fbfd585b71740b290e3f842c8e94fa4/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-01-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD PUMA 1.0 ECOBOOST MHEV 92KW TITANIUM',
 'transmission': 'manual',
 'trim': '1.0 ECOBOOST MHEV 92KW TITANIUM',
 'vin': None,
 'year': 2024}
2026-03-26 22:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985578%27 HTTP/1.1" 200 None
2026-03-26 22:55:27 [ayvens.be] INFO: Saving data for 1985578: {'created_time': 1774565727.418846, 'last_price_update_time': 1774565727.418857, 'auction_closing_time': 1774958400.0}
2026-03-26 22:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985578') HTTP/1.1" 204 0
2026-03-26 22:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F9d9663d888314f3496cb93868b518eac%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/9d9663d888314f3496cb93868b518eac/images/large/9.jpg not downloaded yet
2026-03-26 22:55:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/e0c75242a7d440fe9775e632ca43ac0c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/674b8954cb8741c091b8237326277e4b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F9d9663d888314f3496cb93868b518eac%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/9d9663d888314f3496cb93868b518eac/images/large/10.jpg not downloaded yet
2026-03-26 22:55:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7573890>
2026-03-26 22:55:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0df3679-6c69-53f3-837f-08eaed75cc34/a0df3679-6c69-53f3-837f-08eaed75cc34_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fe0c75242a7d440fe9775e632ca43ac0c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/e0c75242a7d440fe9775e632ca43ac0c/images/large/6.jpg saved to cache
2026-03-26 22:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a0df3679-6c69-53f3-837f-08eaed75cc34
2026-03-26 22:55:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7405d50>
2026-03-26 22:55:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0df3679-6c69-53f3-837f-08eaed75cc34/a0df3679-6c69-53f3-837f-08eaed75cc34_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fe0c75242a7d440fe9775e632ca43ac0c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/e0c75242a7d440fe9775e632ca43ac0c/images/large/5.jpg saved to cache
2026-03-26 22:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a0df3679-6c69-53f3-837f-08eaed75cc34
2026-03-26 22:55:27 [ayvens.be] INFO: Found listing with ID: 1985581
2026-03-26 22:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985581%27 HTTP/1.1" 200 None
2026-03-26 22:55:27 [ayvens.be] INFO: Scrape type for 1985581: 1
2026-03-26 22:55:27 [ayvens.be] INFO: Extracting data for car ID: 1985581
2026-03-26 22:55:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15f5a42c-df82-58fa-8fd9-3104414d6d3a with identifier: 1985581
2026-03-26 22:55:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15f5a42c-df82-58fa-8fd9-3104414d6d3a with scrape type 1
2026-03-26 22:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 15f5a42c-df82-58fa-8fd9-3104414d6d3a
2026-03-26 22:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F41776e31673c42e0a3082ac11d60b1c7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/41776e31673c42e0a3082ac11d60b1c7/images/large/1.jpg not downloaded yet
2026-03-26 22:55:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/674b8954cb8741c091b8237326277e4b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/674b8954cb8741c091b8237326277e4b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/674b8954cb8741c091b8237326277e4b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F41776e31673c42e0a3082ac11d60b1c7%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/41776e31673c42e0a3082ac11d60b1c7/images/large/2.jpg not downloaded yet
2026-03-26 22:55:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77ad750>
2026-03-26 22:55:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0df3679-6c69-53f3-837f-08eaed75cc34/a0df3679-6c69-53f3-837f-08eaed75cc34_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fe0c75242a7d440fe9775e632ca43ac0c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/e0c75242a7d440fe9775e632ca43ac0c/images/large/4.jpg saved to cache
2026-03-26 22:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a0df3679-6c69-53f3-837f-08eaed75cc34
2026-03-26 22:55:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a0df3679-6c69-53f3-837f-08eaed75cc34, skipping ID generation
2026-03-26 22:55:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0df3679-6c69-53f3-837f-08eaed75cc34 with scrape type 1
2026-03-26 22:55:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a0df3679-6c69-53f3-837f-08eaed75cc34 sending to next pipeline
2026-03-26 22:55:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a0df3679-6c69-53f3-837f-08eaed75cc34, identifier: 1985577
2026-03-26 22:55:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7a54bd0>
2026-03-26 22:55:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_054bf54d-3f34-5d87-91cc-317a6a689a28/054bf54d-3f34-5d87-91cc-317a6a689a28_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F674b8954cb8741c091b8237326277e4b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/674b8954cb8741c091b8237326277e4b/images/large/4.jpg saved to cache
2026-03-26 22:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 054bf54d-3f34-5d87-91cc-317a6a689a28
2026-03-26 22:55:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ck/c828286a79364e25873f83a7764cba7e/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a0df3679-6c69-53f3-837f-08eaed75cc34 with identifier: 1985577
2026-03-26 22:55:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a0df3679-6c69-53f3-837f-08eaed75cc34 with identifier: 1985577
2026-03-26 22:55:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a0df3679-6c69-53f3-837f-08eaed75cc34 with identifier: 1985577 to the API
2026-03-26 22:55:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:55:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:55:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bh/e0c75242a7d440fe9775e632ca43ac0c/images/large/4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'a0df3679-6c69-53f3-837f-08eaed75cc34',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3 Sportback',
 'odometer': 70710,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0df3679-6c69-53f3-837f-08eaed75cc34/a0df3679-6c69-53f3-837f-08eaed75cc34_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 678294,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/e0c75242a7d440fe9775e632ca43ac0c/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0df3679-6c69-53f3-837f-08eaed75cc34/a0df3679-6c69-53f3-837f-08eaed75cc34_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 699117,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/e0c75242a7d440fe9775e632ca43ac0c/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0df3679-6c69-53f3-837f-08eaed75cc34/a0df3679-6c69-53f3-837f-08eaed75cc34_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 591920,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/e0c75242a7d440fe9775e632ca43ac0c/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0df3679-6c69-53f3-837f-08eaed75cc34/a0df3679-6c69-53f3-837f-08eaed75cc34_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 730847,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/e0c75242a7d440fe9775e632ca43ac0c/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0df3679-6c69-53f3-837f-08eaed75cc34/a0df3679-6c69-53f3-837f-08eaed75cc34_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 592803,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/e0c75242a7d440fe9775e632ca43ac0c/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0df3679-6c69-53f3-837f-08eaed75cc34/a0df3679-6c69-53f3-837f-08eaed75cc34_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 587962,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/e0c75242a7d440fe9775e632ca43ac0c/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0df3679-6c69-53f3-837f-08eaed75cc34/a0df3679-6c69-53f3-837f-08eaed75cc34_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 623134,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/e0c75242a7d440fe9775e632ca43ac0c/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0df3679-6c69-53f3-837f-08eaed75cc34/a0df3679-6c69-53f3-837f-08eaed75cc34_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 717929,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/e0c75242a7d440fe9775e632ca43ac0c/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0df3679-6c69-53f3-837f-08eaed75cc34/a0df3679-6c69-53f3-837f-08eaed75cc34_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 552485,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/e0c75242a7d440fe9775e632ca43ac0c/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0df3679-6c69-53f3-837f-08eaed75cc34/a0df3679-6c69-53f3-837f-08eaed75cc34_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 543140,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/e0c75242a7d440fe9775e632ca43ac0c/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 Sportback 1.4 45 TFSI E S TRONIC',
 'transmission': 'automatic',
 'trim': '1.4 45 TFSI E S TRONIC',
 'vin': None,
 'year': 2021}
2026-03-26 22:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985577%27 HTTP/1.1" 200 None
2026-03-26 22:55:28 [ayvens.be] INFO: Saving data for 1985577: {'created_time': 1774565728.332231, 'last_price_update_time': 1774565728.332242, 'auction_closing_time': 1774958400.0}
2026-03-26 22:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985577') HTTP/1.1" 204 0
2026-03-26 22:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F41776e31673c42e0a3082ac11d60b1c7%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/41776e31673c42e0a3082ac11d60b1c7/images/large/3.jpg not downloaded yet
2026-03-26 22:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F41776e31673c42e0a3082ac11d60b1c7%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/41776e31673c42e0a3082ac11d60b1c7/images/large/4.jpg not downloaded yet
2026-03-26 22:55:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79d7f50>
2026-03-26 22:55:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_054bf54d-3f34-5d87-91cc-317a6a689a28/054bf54d-3f34-5d87-91cc-317a6a689a28_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F674b8954cb8741c091b8237326277e4b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/674b8954cb8741c091b8237326277e4b/images/large/7.jpg saved to cache
2026-03-26 22:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 054bf54d-3f34-5d87-91cc-317a6a689a28
2026-03-26 22:55:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c82610>
2026-03-26 22:55:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_054bf54d-3f34-5d87-91cc-317a6a689a28/054bf54d-3f34-5d87-91cc-317a6a689a28_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F674b8954cb8741c091b8237326277e4b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/674b8954cb8741c091b8237326277e4b/images/large/5.jpg saved to cache
2026-03-26 22:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 054bf54d-3f34-5d87-91cc-317a6a689a28
2026-03-26 22:55:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6def810>
2026-03-26 22:55:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_054bf54d-3f34-5d87-91cc-317a6a689a28/054bf54d-3f34-5d87-91cc-317a6a689a28_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F674b8954cb8741c091b8237326277e4b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/674b8954cb8741c091b8237326277e4b/images/large/6.jpg saved to cache
2026-03-26 22:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 054bf54d-3f34-5d87-91cc-317a6a689a28
2026-03-26 22:55:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6da5110>
2026-03-26 22:55:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96fdc9f1-7ce0-5fb1-a642-99698f01a88c/96fdc9f1-7ce0-5fb1-a642-99698f01a88c_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252Fc828286a79364e25873f83a7764cba7e%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/c828286a79364e25873f83a7764cba7e/images/large/9.jpg saved to cache
2026-03-26 22:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 96fdc9f1-7ce0-5fb1-a642-99698f01a88c
2026-03-26 22:55:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/674b8954cb8741c091b8237326277e4b/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F41776e31673c42e0a3082ac11d60b1c7%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/41776e31673c42e0a3082ac11d60b1c7/images/large/5.jpg not downloaded yet
2026-03-26 22:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F41776e31673c42e0a3082ac11d60b1c7%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/41776e31673c42e0a3082ac11d60b1c7/images/large/6.jpg not downloaded yet
2026-03-26 22:55:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ck/c828286a79364e25873f83a7764cba7e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F41776e31673c42e0a3082ac11d60b1c7%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/41776e31673c42e0a3082ac11d60b1c7/images/large/7.jpg not downloaded yet
2026-03-26 22:55:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/674b8954cb8741c091b8237326277e4b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/674b8954cb8741c091b8237326277e4b/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/9d9663d888314f3496cb93868b518eac/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/9d9663d888314f3496cb93868b518eac/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F41776e31673c42e0a3082ac11d60b1c7%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/41776e31673c42e0a3082ac11d60b1c7/images/large/8.jpg not downloaded yet
2026-03-26 22:55:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/9d9663d888314f3496cb93868b518eac/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F41776e31673c42e0a3082ac11d60b1c7%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/41776e31673c42e0a3082ac11d60b1c7/images/large/9.jpg not downloaded yet
2026-03-26 22:55:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6df1410>
2026-03-26 22:55:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_054bf54d-3f34-5d87-91cc-317a6a689a28/054bf54d-3f34-5d87-91cc-317a6a689a28_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F674b8954cb8741c091b8237326277e4b%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/674b8954cb8741c091b8237326277e4b/images/large/9.jpg saved to cache
2026-03-26 22:55:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 054bf54d-3f34-5d87-91cc-317a6a689a28
2026-03-26 22:55:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/9d9663d888314f3496cb93868b518eac/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F41776e31673c42e0a3082ac11d60b1c7%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/41776e31673c42e0a3082ac11d60b1c7/images/large/10.jpg not downloaded yet
2026-03-26 22:55:29 [ayvens.be] INFO: Found listing with ID: 1985582
2026-03-26 22:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985582%27 HTTP/1.1" 200 None
2026-03-26 22:55:29 [ayvens.be] INFO: Scrape type for 1985582: 1
2026-03-26 22:55:29 [ayvens.be] INFO: Extracting data for car ID: 1985582
2026-03-26 22:55:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d1a3554-0055-53af-a270-fe16424e8590 with identifier: 1985582
2026-03-26 22:55:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d1a3554-0055-53af-a270-fe16424e8590 with scrape type 1
2026-03-26 22:55:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6d1a3554-0055-53af-a270-fe16424e8590
2026-03-26 22:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F93306b94323940c7a210b5669c85d3c4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/93306b94323940c7a210b5669c85d3c4/images/large/1.jpg not downloaded yet
2026-03-26 22:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F93306b94323940c7a210b5669c85d3c4%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/93306b94323940c7a210b5669c85d3c4/images/large/2.jpg not downloaded yet
2026-03-26 22:55:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b17350>
2026-03-26 22:55:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96fdc9f1-7ce0-5fb1-a642-99698f01a88c/96fdc9f1-7ce0-5fb1-a642-99698f01a88c_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252Fc828286a79364e25873f83a7764cba7e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/c828286a79364e25873f83a7764cba7e/images/large/4.jpg saved to cache
2026-03-26 22:55:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 96fdc9f1-7ce0-5fb1-a642-99698f01a88c
2026-03-26 22:55:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 96fdc9f1-7ce0-5fb1-a642-99698f01a88c, skipping ID generation
2026-03-26 22:55:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96fdc9f1-7ce0-5fb1-a642-99698f01a88c with scrape type 1
2026-03-26 22:55:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 96fdc9f1-7ce0-5fb1-a642-99698f01a88c sending to next pipeline
2026-03-26 22:55:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 96fdc9f1-7ce0-5fb1-a642-99698f01a88c, identifier: 1985576
2026-03-26 22:55:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7747210>
2026-03-26 22:55:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_054bf54d-3f34-5d87-91cc-317a6a689a28/054bf54d-3f34-5d87-91cc-317a6a689a28_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F674b8954cb8741c091b8237326277e4b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/674b8954cb8741c091b8237326277e4b/images/large/8.jpg saved to cache
2026-03-26 22:55:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 054bf54d-3f34-5d87-91cc-317a6a689a28
2026-03-26 22:55:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c81ad0>
2026-03-26 22:55:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_054bf54d-3f34-5d87-91cc-317a6a689a28/054bf54d-3f34-5d87-91cc-317a6a689a28_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F674b8954cb8741c091b8237326277e4b%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/674b8954cb8741c091b8237326277e4b/images/large/10.jpg saved to cache
2026-03-26 22:55:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 054bf54d-3f34-5d87-91cc-317a6a689a28
2026-03-26 22:55:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 054bf54d-3f34-5d87-91cc-317a6a689a28, skipping ID generation
2026-03-26 22:55:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 054bf54d-3f34-5d87-91cc-317a6a689a28 with scrape type 1
2026-03-26 22:55:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 054bf54d-3f34-5d87-91cc-317a6a689a28 sending to next pipeline
2026-03-26 22:55:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 054bf54d-3f34-5d87-91cc-317a6a689a28, identifier: 1985579
2026-03-26 22:55:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cb1550>
2026-03-26 22:55:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_768ee90d-9e68-5f82-b05d-5531b8607182/768ee90d-9e68-5f82-b05d-5531b8607182_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F9d9663d888314f3496cb93868b518eac%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/9d9663d888314f3496cb93868b518eac/images/large/1.jpg saved to cache
2026-03-26 22:55:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 768ee90d-9e68-5f82-b05d-5531b8607182
2026-03-26 22:55:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c75090>
2026-03-26 22:55:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_768ee90d-9e68-5f82-b05d-5531b8607182/768ee90d-9e68-5f82-b05d-5531b8607182_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F9d9663d888314f3496cb93868b518eac%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/9d9663d888314f3496cb93868b518eac/images/large/2.jpg saved to cache
2026-03-26 22:55:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 768ee90d-9e68-5f82-b05d-5531b8607182
2026-03-26 22:55:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6dee110>
2026-03-26 22:55:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_768ee90d-9e68-5f82-b05d-5531b8607182/768ee90d-9e68-5f82-b05d-5531b8607182_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F9d9663d888314f3496cb93868b518eac%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/9d9663d888314f3496cb93868b518eac/images/large/3.jpg saved to cache
2026-03-26 22:55:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 768ee90d-9e68-5f82-b05d-5531b8607182
2026-03-26 22:55:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 96fdc9f1-7ce0-5fb1-a642-99698f01a88c with identifier: 1985576
2026-03-26 22:55:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 96fdc9f1-7ce0-5fb1-a642-99698f01a88c with identifier: 1985576
2026-03-26 22:55:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 96fdc9f1-7ce0-5fb1-a642-99698f01a88c with identifier: 1985576 to the API
2026-03-26 22:55:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:55:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:55:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ck/c828286a79364e25873f83a7764cba7e/images/large/4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '96fdc9f1-7ce0-5fb1-a642-99698f01a88c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLB',
 'odometer': 172566,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96fdc9f1-7ce0-5fb1-a642-99698f01a88c/96fdc9f1-7ce0-5fb1-a642-99698f01a88c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 736840,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ck/c828286a79364e25873f83a7764cba7e/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96fdc9f1-7ce0-5fb1-a642-99698f01a88c/96fdc9f1-7ce0-5fb1-a642-99698f01a88c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 710770,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ck/c828286a79364e25873f83a7764cba7e/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96fdc9f1-7ce0-5fb1-a642-99698f01a88c/96fdc9f1-7ce0-5fb1-a642-99698f01a88c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 742214,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ck/c828286a79364e25873f83a7764cba7e/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96fdc9f1-7ce0-5fb1-a642-99698f01a88c/96fdc9f1-7ce0-5fb1-a642-99698f01a88c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 773433,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ck/c828286a79364e25873f83a7764cba7e/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96fdc9f1-7ce0-5fb1-a642-99698f01a88c/96fdc9f1-7ce0-5fb1-a642-99698f01a88c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 754530,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ck/c828286a79364e25873f83a7764cba7e/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96fdc9f1-7ce0-5fb1-a642-99698f01a88c/96fdc9f1-7ce0-5fb1-a642-99698f01a88c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 752242,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ck/c828286a79364e25873f83a7764cba7e/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96fdc9f1-7ce0-5fb1-a642-99698f01a88c/96fdc9f1-7ce0-5fb1-a642-99698f01a88c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 668348,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ck/c828286a79364e25873f83a7764cba7e/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96fdc9f1-7ce0-5fb1-a642-99698f01a88c/96fdc9f1-7ce0-5fb1-a642-99698f01a88c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 770770,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ck/c828286a79364e25873f83a7764cba7e/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96fdc9f1-7ce0-5fb1-a642-99698f01a88c/96fdc9f1-7ce0-5fb1-a642-99698f01a88c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 812481,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ck/c828286a79364e25873f83a7764cba7e/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96fdc9f1-7ce0-5fb1-a642-99698f01a88c/96fdc9f1-7ce0-5fb1-a642-99698f01a88c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 776447,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ck/c828286a79364e25873f83a7764cba7e/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLB 2.0 GLB 180 D BUSINESS SOLUTION',
 'transmission': 'automatic',
 'trim': '2.0 GLB 180 D BUSINESS SOLUTION',
 'vin': None,
 'year': 2022}
2026-03-26 22:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985576%27 HTTP/1.1" 200 None
2026-03-26 22:55:30 [ayvens.be] INFO: Saving data for 1985576: {'created_time': 1774565730.209886, 'last_price_update_time': 1774565730.209896, 'auction_closing_time': 1774958400.0}
2026-03-26 22:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985576') HTTP/1.1" 204 0
2026-03-26 22:55:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 054bf54d-3f34-5d87-91cc-317a6a689a28 with identifier: 1985579
2026-03-26 22:55:30 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 22:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 22:55:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 054bf54d-3f34-5d87-91cc-317a6a689a28 with identifier: 1985579
2026-03-26 22:55:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 054bf54d-3f34-5d87-91cc-317a6a689a28 with identifier: 1985579 to the API
2026-03-26 22:55:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:55:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:55:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ba/674b8954cb8741c091b8237326277e4b/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 28,
 'color': 'DARK PENTA METAL METALLIC',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '054bf54d-3f34-5d87-91cc-317a6a689a28',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': "CEE'D SPORTSWAGON",
 'odometer': 79955,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_054bf54d-3f34-5d87-91cc-317a6a689a28/054bf54d-3f34-5d87-91cc-317a6a689a28_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 736263,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/674b8954cb8741c091b8237326277e4b/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_054bf54d-3f34-5d87-91cc-317a6a689a28/054bf54d-3f34-5d87-91cc-317a6a689a28_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 739602,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/674b8954cb8741c091b8237326277e4b/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_054bf54d-3f34-5d87-91cc-317a6a689a28/054bf54d-3f34-5d87-91cc-317a6a689a28_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 708908,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/674b8954cb8741c091b8237326277e4b/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_054bf54d-3f34-5d87-91cc-317a6a689a28/054bf54d-3f34-5d87-91cc-317a6a689a28_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 756506,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/674b8954cb8741c091b8237326277e4b/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_054bf54d-3f34-5d87-91cc-317a6a689a28/054bf54d-3f34-5d87-91cc-317a6a689a28_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 741723,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/674b8954cb8741c091b8237326277e4b/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_054bf54d-3f34-5d87-91cc-317a6a689a28/054bf54d-3f34-5d87-91cc-317a6a689a28_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 721606,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/674b8954cb8741c091b8237326277e4b/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_054bf54d-3f34-5d87-91cc-317a6a689a28/054bf54d-3f34-5d87-91cc-317a6a689a28_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 707074,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/674b8954cb8741c091b8237326277e4b/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_054bf54d-3f34-5d87-91cc-317a6a689a28/054bf54d-3f34-5d87-91cc-317a6a689a28_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 864900,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/674b8954cb8741c091b8237326277e4b/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_054bf54d-3f34-5d87-91cc-317a6a689a28/054bf54d-3f34-5d87-91cc-317a6a689a28_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 828938,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/674b8954cb8741c091b8237326277e4b/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_054bf54d-3f34-5d87-91cc-317a6a689a28/054bf54d-3f34-5d87-91cc-317a6a689a28_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 903131,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/674b8954cb8741c091b8237326277e4b/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-14',
 'seats_number': 5,
 'seller_name': None,
 'title': "KIA CEE'D SPORTSWAGON 1.6 GDI PHEV BUSINESS LINE DCT",
 'transmission': 'automatic',
 'trim': '1.6 GDI PHEV BUSINESS LINE DCT',
 'vin': None,
 'year': 2021}
2026-03-26 22:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985579%27 HTTP/1.1" 200 None
2026-03-26 22:55:30 [ayvens.be] INFO: Saving data for 1985579: {'created_time': 1774565730.523515, 'last_price_update_time': 1774565730.523526, 'auction_closing_time': 1774958400.0}
2026-03-26 22:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985579') HTTP/1.1" 204 0
2026-03-26 22:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F93306b94323940c7a210b5669c85d3c4%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/93306b94323940c7a210b5669c85d3c4/images/large/3.jpg not downloaded yet
2026-03-26 22:55:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/9d9663d888314f3496cb93868b518eac/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F93306b94323940c7a210b5669c85d3c4%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/93306b94323940c7a210b5669c85d3c4/images/large/4.jpg not downloaded yet
2026-03-26 22:55:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/9d9663d888314f3496cb93868b518eac/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7a62450>
2026-03-26 22:55:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_768ee90d-9e68-5f82-b05d-5531b8607182/768ee90d-9e68-5f82-b05d-5531b8607182_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F9d9663d888314f3496cb93868b518eac%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/9d9663d888314f3496cb93868b518eac/images/large/4.jpg saved to cache
2026-03-26 22:55:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 768ee90d-9e68-5f82-b05d-5531b8607182
2026-03-26 22:55:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/9d9663d888314f3496cb93868b518eac/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/9d9663d888314f3496cb93868b518eac/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/9d9663d888314f3496cb93868b518eac/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F93306b94323940c7a210b5669c85d3c4%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/93306b94323940c7a210b5669c85d3c4/images/large/5.jpg not downloaded yet
2026-03-26 22:55:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/9d9663d888314f3496cb93868b518eac/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F93306b94323940c7a210b5669c85d3c4%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/93306b94323940c7a210b5669c85d3c4/images/large/6.jpg not downloaded yet
2026-03-26 22:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F93306b94323940c7a210b5669c85d3c4%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/93306b94323940c7a210b5669c85d3c4/images/large/7.jpg not downloaded yet
2026-03-26 22:55:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7874350>
2026-03-26 22:55:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_768ee90d-9e68-5f82-b05d-5531b8607182/768ee90d-9e68-5f82-b05d-5531b8607182_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F9d9663d888314f3496cb93868b518eac%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/9d9663d888314f3496cb93868b518eac/images/large/6.jpg saved to cache
2026-03-26 22:55:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 768ee90d-9e68-5f82-b05d-5531b8607182
2026-03-26 22:55:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/41776e31673c42e0a3082ac11d60b1c7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/41776e31673c42e0a3082ac11d60b1c7/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F93306b94323940c7a210b5669c85d3c4%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/93306b94323940c7a210b5669c85d3c4/images/large/8.jpg not downloaded yet
2026-03-26 22:55:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77734d0>
2026-03-26 22:55:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_768ee90d-9e68-5f82-b05d-5531b8607182/768ee90d-9e68-5f82-b05d-5531b8607182_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F9d9663d888314f3496cb93868b518eac%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/9d9663d888314f3496cb93868b518eac/images/large/9.jpg saved to cache
2026-03-26 22:55:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 768ee90d-9e68-5f82-b05d-5531b8607182
2026-03-26 22:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F93306b94323940c7a210b5669c85d3c4%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/93306b94323940c7a210b5669c85d3c4/images/large/9.jpg not downloaded yet
2026-03-26 22:55:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7819150>
2026-03-26 22:55:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_768ee90d-9e68-5f82-b05d-5531b8607182/768ee90d-9e68-5f82-b05d-5531b8607182_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:55:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F9d9663d888314f3496cb93868b518eac%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/9d9663d888314f3496cb93868b518eac/images/large/8.jpg saved to cache
2026-03-26 22:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 768ee90d-9e68-5f82-b05d-5531b8607182
2026-03-26 22:55:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7771750>
2026-03-26 22:55:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_768ee90d-9e68-5f82-b05d-5531b8607182/768ee90d-9e68-5f82-b05d-5531b8607182_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:55:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F9d9663d888314f3496cb93868b518eac%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/9d9663d888314f3496cb93868b518eac/images/large/10.jpg saved to cache
2026-03-26 22:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 768ee90d-9e68-5f82-b05d-5531b8607182
2026-03-26 22:55:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e2a2d0>
2026-03-26 22:55:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_768ee90d-9e68-5f82-b05d-5531b8607182/768ee90d-9e68-5f82-b05d-5531b8607182_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:55:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F9d9663d888314f3496cb93868b518eac%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/9d9663d888314f3496cb93868b518eac/images/large/5.jpg saved to cache
2026-03-26 22:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 768ee90d-9e68-5f82-b05d-5531b8607182
2026-03-26 22:55:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b788cb50>
2026-03-26 22:55:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_768ee90d-9e68-5f82-b05d-5531b8607182/768ee90d-9e68-5f82-b05d-5531b8607182_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:55:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F9d9663d888314f3496cb93868b518eac%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/9d9663d888314f3496cb93868b518eac/images/large/7.jpg saved to cache
2026-03-26 22:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 768ee90d-9e68-5f82-b05d-5531b8607182
2026-03-26 22:55:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 768ee90d-9e68-5f82-b05d-5531b8607182, skipping ID generation
2026-03-26 22:55:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 768ee90d-9e68-5f82-b05d-5531b8607182 with scrape type 1
2026-03-26 22:55:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 768ee90d-9e68-5f82-b05d-5531b8607182 sending to next pipeline
2026-03-26 22:55:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 768ee90d-9e68-5f82-b05d-5531b8607182, identifier: 1985580
2026-03-26 22:55:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b782f790>
2026-03-26 22:55:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15f5a42c-df82-58fa-8fd9-3104414d6d3a/15f5a42c-df82-58fa-8fd9-3104414d6d3a_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:55:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F41776e31673c42e0a3082ac11d60b1c7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/41776e31673c42e0a3082ac11d60b1c7/images/large/1.jpg saved to cache
2026-03-26 22:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 15f5a42c-df82-58fa-8fd9-3104414d6d3a
2026-03-26 22:55:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e478d0>
2026-03-26 22:55:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15f5a42c-df82-58fa-8fd9-3104414d6d3a/15f5a42c-df82-58fa-8fd9-3104414d6d3a_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:55:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F41776e31673c42e0a3082ac11d60b1c7%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/41776e31673c42e0a3082ac11d60b1c7/images/large/2.jpg saved to cache
2026-03-26 22:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 15f5a42c-df82-58fa-8fd9-3104414d6d3a
2026-03-26 22:55:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F93306b94323940c7a210b5669c85d3c4%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/93306b94323940c7a210b5669c85d3c4/images/large/10.jpg not downloaded yet
2026-03-26 22:55:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 768ee90d-9e68-5f82-b05d-5531b8607182 with identifier: 1985580
2026-03-26 22:55:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 768ee90d-9e68-5f82-b05d-5531b8607182 with identifier: 1985580
2026-03-26 22:55:31 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 768ee90d-9e68-5f82-b05d-5531b8607182 with identifier: 1985580 to the API
2026-03-26 22:55:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:55:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:55:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yu/9d9663d888314f3496cb93868b518eac/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '768ee90d-9e68-5f82-b05d-5531b8607182',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLC',
 'odometer': 119366,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_768ee90d-9e68-5f82-b05d-5531b8607182/768ee90d-9e68-5f82-b05d-5531b8607182_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 604675,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/9d9663d888314f3496cb93868b518eac/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_768ee90d-9e68-5f82-b05d-5531b8607182/768ee90d-9e68-5f82-b05d-5531b8607182_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 596727,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/9d9663d888314f3496cb93868b518eac/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_768ee90d-9e68-5f82-b05d-5531b8607182/768ee90d-9e68-5f82-b05d-5531b8607182_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 656977,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/9d9663d888314f3496cb93868b518eac/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_768ee90d-9e68-5f82-b05d-5531b8607182/768ee90d-9e68-5f82-b05d-5531b8607182_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 588612,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/9d9663d888314f3496cb93868b518eac/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_768ee90d-9e68-5f82-b05d-5531b8607182/768ee90d-9e68-5f82-b05d-5531b8607182_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 538444,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/9d9663d888314f3496cb93868b518eac/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_768ee90d-9e68-5f82-b05d-5531b8607182/768ee90d-9e68-5f82-b05d-5531b8607182_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 594949,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/9d9663d888314f3496cb93868b518eac/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_768ee90d-9e68-5f82-b05d-5531b8607182/768ee90d-9e68-5f82-b05d-5531b8607182_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 598740,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/9d9663d888314f3496cb93868b518eac/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_768ee90d-9e68-5f82-b05d-5531b8607182/768ee90d-9e68-5f82-b05d-5531b8607182_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 638664,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/9d9663d888314f3496cb93868b518eac/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_768ee90d-9e68-5f82-b05d-5531b8607182/768ee90d-9e68-5f82-b05d-5531b8607182_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 580311,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/9d9663d888314f3496cb93868b518eac/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_768ee90d-9e68-5f82-b05d-5531b8607182/768ee90d-9e68-5f82-b05d-5531b8607182_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 614251,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/9d9663d888314f3496cb93868b518eac/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLC 2.0 GLC 300 DE 4MATIC 4WD AUTO',
 'transmission': 'automatic',
 'trim': '2.0 GLC 300 DE 4MATIC 4WD AUTO',
 'vin': None,
 'year': 2020}
2026-03-26 22:55:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985580%27 HTTP/1.1" 200 None
2026-03-26 22:55:32 [ayvens.be] INFO: Saving data for 1985580: {'created_time': 1774565732.14405, 'last_price_update_time': 1774565732.144059, 'auction_closing_time': 1774958400.0}
2026-03-26 22:55:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985580') HTTP/1.1" 204 0
2026-03-26 22:55:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/41776e31673c42e0a3082ac11d60b1c7/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:32 [ayvens.be] INFO: Found listing with ID: 1985583
2026-03-26 22:55:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985583%27 HTTP/1.1" 200 None
2026-03-26 22:55:32 [ayvens.be] INFO: Scrape type for 1985583: 1
2026-03-26 22:55:32 [ayvens.be] INFO: Extracting data for car ID: 1985583
2026-03-26 22:55:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c3c01302-3a2c-5f20-b7f7-b55664bd78ee with identifier: 1985583
2026-03-26 22:55:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3c01302-3a2c-5f20-b7f7-b55664bd78ee with scrape type 1
2026-03-26 22:55:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c3c01302-3a2c-5f20-b7f7-b55664bd78ee
2026-03-26 22:55:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F9aaefd7febac41fbb9c03374c3283852%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/9aaefd7febac41fbb9c03374c3283852/images/large/1.jpg not downloaded yet
2026-03-26 22:55:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F9aaefd7febac41fbb9c03374c3283852%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/9aaefd7febac41fbb9c03374c3283852/images/large/2.jpg not downloaded yet
2026-03-26 22:55:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/41776e31673c42e0a3082ac11d60b1c7/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/41776e31673c42e0a3082ac11d60b1c7/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/93306b94323940c7a210b5669c85d3c4/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/93306b94323940c7a210b5669c85d3c4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/41776e31673c42e0a3082ac11d60b1c7/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F9aaefd7febac41fbb9c03374c3283852%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/9aaefd7febac41fbb9c03374c3283852/images/large/3.jpg not downloaded yet
2026-03-26 22:55:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F9aaefd7febac41fbb9c03374c3283852%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/9aaefd7febac41fbb9c03374c3283852/images/large/4.jpg not downloaded yet
2026-03-26 22:55:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F9aaefd7febac41fbb9c03374c3283852%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/9aaefd7febac41fbb9c03374c3283852/images/large/5.jpg not downloaded yet
2026-03-26 22:55:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/41776e31673c42e0a3082ac11d60b1c7/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/41776e31673c42e0a3082ac11d60b1c7/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F9aaefd7febac41fbb9c03374c3283852%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/9aaefd7febac41fbb9c03374c3283852/images/large/6.jpg not downloaded yet
2026-03-26 22:55:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7501b10>
2026-03-26 22:55:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15f5a42c-df82-58fa-8fd9-3104414d6d3a/15f5a42c-df82-58fa-8fd9-3104414d6d3a_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:55:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F41776e31673c42e0a3082ac11d60b1c7%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/41776e31673c42e0a3082ac11d60b1c7/images/large/9.jpg saved to cache
2026-03-26 22:55:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 15f5a42c-df82-58fa-8fd9-3104414d6d3a
2026-03-26 22:55:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F9aaefd7febac41fbb9c03374c3283852%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/9aaefd7febac41fbb9c03374c3283852/images/large/7.jpg not downloaded yet
2026-03-26 22:55:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F9aaefd7febac41fbb9c03374c3283852%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/9aaefd7febac41fbb9c03374c3283852/images/large/8.jpg not downloaded yet
2026-03-26 22:55:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F9aaefd7febac41fbb9c03374c3283852%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/9aaefd7febac41fbb9c03374c3283852/images/large/9.jpg not downloaded yet
2026-03-26 22:55:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c82b50>
2026-03-26 22:55:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15f5a42c-df82-58fa-8fd9-3104414d6d3a/15f5a42c-df82-58fa-8fd9-3104414d6d3a_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:55:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F41776e31673c42e0a3082ac11d60b1c7%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/41776e31673c42e0a3082ac11d60b1c7/images/large/6.jpg saved to cache
2026-03-26 22:55:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 15f5a42c-df82-58fa-8fd9-3104414d6d3a
2026-03-26 22:55:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74a4210>
2026-03-26 22:55:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15f5a42c-df82-58fa-8fd9-3104414d6d3a/15f5a42c-df82-58fa-8fd9-3104414d6d3a_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:55:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F41776e31673c42e0a3082ac11d60b1c7%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/41776e31673c42e0a3082ac11d60b1c7/images/large/10.jpg saved to cache
2026-03-26 22:55:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 15f5a42c-df82-58fa-8fd9-3104414d6d3a
2026-03-26 22:55:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79a2c50>
2026-03-26 22:55:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d1a3554-0055-53af-a270-fe16424e8590/6d1a3554-0055-53af-a270-fe16424e8590_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:55:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F93306b94323940c7a210b5669c85d3c4%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/93306b94323940c7a210b5669c85d3c4/images/large/2.jpg saved to cache
2026-03-26 22:55:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6d1a3554-0055-53af-a270-fe16424e8590
2026-03-26 22:55:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79dc8d0>
2026-03-26 22:55:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d1a3554-0055-53af-a270-fe16424e8590/6d1a3554-0055-53af-a270-fe16424e8590_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:55:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F93306b94323940c7a210b5669c85d3c4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/93306b94323940c7a210b5669c85d3c4/images/large/1.jpg saved to cache
2026-03-26 22:55:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6d1a3554-0055-53af-a270-fe16424e8590
2026-03-26 22:55:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7440150>
2026-03-26 22:55:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15f5a42c-df82-58fa-8fd9-3104414d6d3a/15f5a42c-df82-58fa-8fd9-3104414d6d3a_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:55:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F41776e31673c42e0a3082ac11d60b1c7%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/41776e31673c42e0a3082ac11d60b1c7/images/large/4.jpg saved to cache
2026-03-26 22:55:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 15f5a42c-df82-58fa-8fd9-3104414d6d3a
2026-03-26 22:55:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b9b110>
2026-03-26 22:55:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15f5a42c-df82-58fa-8fd9-3104414d6d3a/15f5a42c-df82-58fa-8fd9-3104414d6d3a_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:55:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F41776e31673c42e0a3082ac11d60b1c7%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/41776e31673c42e0a3082ac11d60b1c7/images/large/7.jpg saved to cache
2026-03-26 22:55:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 15f5a42c-df82-58fa-8fd9-3104414d6d3a
2026-03-26 22:55:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79dc390>
2026-03-26 22:55:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15f5a42c-df82-58fa-8fd9-3104414d6d3a/15f5a42c-df82-58fa-8fd9-3104414d6d3a_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:55:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F41776e31673c42e0a3082ac11d60b1c7%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/41776e31673c42e0a3082ac11d60b1c7/images/large/8.jpg saved to cache
2026-03-26 22:55:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 15f5a42c-df82-58fa-8fd9-3104414d6d3a
2026-03-26 22:55:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F9aaefd7febac41fbb9c03374c3283852%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/9aaefd7febac41fbb9c03374c3283852/images/large/10.jpg not downloaded yet
2026-03-26 22:55:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/93306b94323940c7a210b5669c85d3c4/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:33 [ayvens.be] INFO: Found listing with ID: 1985584
2026-03-26 22:55:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985584%27 HTTP/1.1" 200 None
2026-03-26 22:55:33 [ayvens.be] INFO: Scrape type for 1985584: 1
2026-03-26 22:55:33 [ayvens.be] INFO: Extracting data for car ID: 1985584
2026-03-26 22:55:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 793c0c01-3b2f-51f7-abf8-56f206854475 with identifier: 1985584
2026-03-26 22:55:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 793c0c01-3b2f-51f7-abf8-56f206854475 with scrape type 1
2026-03-26 22:55:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 793c0c01-3b2f-51f7-abf8-56f206854475
2026-03-26 22:55:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Fdcd8ab8a80f445929daec3806c852e04%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/dcd8ab8a80f445929daec3806c852e04/images/large/1.jpg not downloaded yet
2026-03-26 22:55:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/93306b94323940c7a210b5669c85d3c4/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/93306b94323940c7a210b5669c85d3c4/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/93306b94323940c7a210b5669c85d3c4/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Fdcd8ab8a80f445929daec3806c852e04%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/dcd8ab8a80f445929daec3806c852e04/images/large/2.jpg not downloaded yet
2026-03-26 22:55:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/41776e31673c42e0a3082ac11d60b1c7/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/93306b94323940c7a210b5669c85d3c4/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Fdcd8ab8a80f445929daec3806c852e04%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/dcd8ab8a80f445929daec3806c852e04/images/large/3.jpg not downloaded yet
2026-03-26 22:55:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Fdcd8ab8a80f445929daec3806c852e04%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/dcd8ab8a80f445929daec3806c852e04/images/large/4.jpg not downloaded yet
2026-03-26 22:55:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/93306b94323940c7a210b5669c85d3c4/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Fdcd8ab8a80f445929daec3806c852e04%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/dcd8ab8a80f445929daec3806c852e04/images/large/5.jpg not downloaded yet
2026-03-26 22:55:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/93306b94323940c7a210b5669c85d3c4/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/41776e31673c42e0a3082ac11d60b1c7/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7586510>
2026-03-26 22:55:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d1a3554-0055-53af-a270-fe16424e8590/6d1a3554-0055-53af-a270-fe16424e8590_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:55:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F93306b94323940c7a210b5669c85d3c4%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/93306b94323940c7a210b5669c85d3c4/images/large/3.jpg saved to cache
2026-03-26 22:55:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6d1a3554-0055-53af-a270-fe16424e8590
2026-03-26 22:55:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Fdcd8ab8a80f445929daec3806c852e04%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/dcd8ab8a80f445929daec3806c852e04/images/large/6.jpg not downloaded yet
2026-03-26 22:55:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Fdcd8ab8a80f445929daec3806c852e04%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/dcd8ab8a80f445929daec3806c852e04/images/large/7.jpg not downloaded yet
2026-03-26 22:55:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Fdcd8ab8a80f445929daec3806c852e04%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/dcd8ab8a80f445929daec3806c852e04/images/large/8.jpg not downloaded yet
2026-03-26 22:55:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6d82e90>
2026-03-26 22:55:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d1a3554-0055-53af-a270-fe16424e8590/6d1a3554-0055-53af-a270-fe16424e8590_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:55:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F93306b94323940c7a210b5669c85d3c4%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/93306b94323940c7a210b5669c85d3c4/images/large/6.jpg saved to cache
2026-03-26 22:55:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6d1a3554-0055-53af-a270-fe16424e8590
2026-03-26 22:55:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7ccfe90>
2026-03-26 22:55:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d1a3554-0055-53af-a270-fe16424e8590/6d1a3554-0055-53af-a270-fe16424e8590_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:55:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F93306b94323940c7a210b5669c85d3c4%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/93306b94323940c7a210b5669c85d3c4/images/large/5.jpg saved to cache
2026-03-26 22:55:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6d1a3554-0055-53af-a270-fe16424e8590
2026-03-26 22:55:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7c22390>
2026-03-26 22:55:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d1a3554-0055-53af-a270-fe16424e8590/6d1a3554-0055-53af-a270-fe16424e8590_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:55:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F93306b94323940c7a210b5669c85d3c4%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/93306b94323940c7a210b5669c85d3c4/images/large/7.jpg saved to cache
2026-03-26 22:55:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6d1a3554-0055-53af-a270-fe16424e8590
2026-03-26 22:55:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c7cb50>
2026-03-26 22:55:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15f5a42c-df82-58fa-8fd9-3104414d6d3a/15f5a42c-df82-58fa-8fd9-3104414d6d3a_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:55:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F41776e31673c42e0a3082ac11d60b1c7%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/41776e31673c42e0a3082ac11d60b1c7/images/large/3.jpg saved to cache
2026-03-26 22:55:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 15f5a42c-df82-58fa-8fd9-3104414d6d3a
2026-03-26 22:55:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b74550>
2026-03-26 22:55:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d1a3554-0055-53af-a270-fe16424e8590/6d1a3554-0055-53af-a270-fe16424e8590_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F93306b94323940c7a210b5669c85d3c4%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/93306b94323940c7a210b5669c85d3c4/images/large/4.jpg saved to cache
2026-03-26 22:55:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6d1a3554-0055-53af-a270-fe16424e8590
2026-03-26 22:55:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b4f790>
2026-03-26 22:55:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d1a3554-0055-53af-a270-fe16424e8590/6d1a3554-0055-53af-a270-fe16424e8590_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F93306b94323940c7a210b5669c85d3c4%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/93306b94323940c7a210b5669c85d3c4/images/large/10.jpg saved to cache
2026-03-26 22:55:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6d1a3554-0055-53af-a270-fe16424e8590
2026-03-26 22:55:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7ccf210>
2026-03-26 22:55:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d1a3554-0055-53af-a270-fe16424e8590/6d1a3554-0055-53af-a270-fe16424e8590_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F93306b94323940c7a210b5669c85d3c4%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/93306b94323940c7a210b5669c85d3c4/images/large/8.jpg saved to cache
2026-03-26 22:55:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6d1a3554-0055-53af-a270-fe16424e8590
2026-03-26 22:55:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b6b290>
2026-03-26 22:55:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15f5a42c-df82-58fa-8fd9-3104414d6d3a/15f5a42c-df82-58fa-8fd9-3104414d6d3a_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F41776e31673c42e0a3082ac11d60b1c7%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/41776e31673c42e0a3082ac11d60b1c7/images/large/5.jpg saved to cache
2026-03-26 22:55:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 15f5a42c-df82-58fa-8fd9-3104414d6d3a
2026-03-26 22:55:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 15f5a42c-df82-58fa-8fd9-3104414d6d3a, skipping ID generation
2026-03-26 22:55:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15f5a42c-df82-58fa-8fd9-3104414d6d3a with scrape type 1
2026-03-26 22:55:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 15f5a42c-df82-58fa-8fd9-3104414d6d3a sending to next pipeline
2026-03-26 22:55:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 15f5a42c-df82-58fa-8fd9-3104414d6d3a, identifier: 1985581
2026-03-26 22:55:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 15f5a42c-df82-58fa-8fd9-3104414d6d3a with identifier: 1985581
2026-03-26 22:55:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 15f5a42c-df82-58fa-8fd9-3104414d6d3a with identifier: 1985581
2026-03-26 22:55:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 15f5a42c-df82-58fa-8fd9-3104414d6d3a with identifier: 1985581 to the API
2026-03-26 22:55:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:55:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:55:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ba/41776e31673c42e0a3082ac11d60b1c7/images/large/5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '15f5a42c-df82-58fa-8fd9-3104414d6d3a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TIGUAN ALLSPACE',
 'odometer': 148205,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15f5a42c-df82-58fa-8fd9-3104414d6d3a/15f5a42c-df82-58fa-8fd9-3104414d6d3a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 736623,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/41776e31673c42e0a3082ac11d60b1c7/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15f5a42c-df82-58fa-8fd9-3104414d6d3a/15f5a42c-df82-58fa-8fd9-3104414d6d3a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 709979,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/41776e31673c42e0a3082ac11d60b1c7/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15f5a42c-df82-58fa-8fd9-3104414d6d3a/15f5a42c-df82-58fa-8fd9-3104414d6d3a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 709317,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/41776e31673c42e0a3082ac11d60b1c7/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15f5a42c-df82-58fa-8fd9-3104414d6d3a/15f5a42c-df82-58fa-8fd9-3104414d6d3a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 718591,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/41776e31673c42e0a3082ac11d60b1c7/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15f5a42c-df82-58fa-8fd9-3104414d6d3a/15f5a42c-df82-58fa-8fd9-3104414d6d3a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 743825,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/41776e31673c42e0a3082ac11d60b1c7/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15f5a42c-df82-58fa-8fd9-3104414d6d3a/15f5a42c-df82-58fa-8fd9-3104414d6d3a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 615031,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/41776e31673c42e0a3082ac11d60b1c7/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15f5a42c-df82-58fa-8fd9-3104414d6d3a/15f5a42c-df82-58fa-8fd9-3104414d6d3a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 762841,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/41776e31673c42e0a3082ac11d60b1c7/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15f5a42c-df82-58fa-8fd9-3104414d6d3a/15f5a42c-df82-58fa-8fd9-3104414d6d3a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 744879,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/41776e31673c42e0a3082ac11d60b1c7/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15f5a42c-df82-58fa-8fd9-3104414d6d3a/15f5a42c-df82-58fa-8fd9-3104414d6d3a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 433092,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/41776e31673c42e0a3082ac11d60b1c7/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15f5a42c-df82-58fa-8fd9-3104414d6d3a/15f5a42c-df82-58fa-8fd9-3104414d6d3a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 623718,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/41776e31673c42e0a3082ac11d60b1c7/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-13',
 'seats_number': 7,
 'seller_name': None,
 'title': 'VOLKSWAGEN TIGUAN ALLSPACE 2.0 TDI PLATINUM DSG',
 'transmission': 'automatic',
 'trim': '2.0 TDI PLATINUM DSG',
 'vin': None,
 'year': 2021}
2026-03-26 22:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985581%27 HTTP/1.1" 200 None
2026-03-26 22:55:34 [ayvens.be] INFO: Saving data for 1985581: {'created_time': 1774565734.799138, 'last_price_update_time': 1774565734.799148, 'auction_closing_time': 1774958400.0}
2026-03-26 22:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985581') HTTP/1.1" 204 0
2026-03-26 22:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Fdcd8ab8a80f445929daec3806c852e04%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/dcd8ab8a80f445929daec3806c852e04/images/large/9.jpg not downloaded yet
2026-03-26 22:55:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/93306b94323940c7a210b5669c85d3c4/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Fdcd8ab8a80f445929daec3806c852e04%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/dcd8ab8a80f445929daec3806c852e04/images/large/10.jpg not downloaded yet
2026-03-26 22:55:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/9aaefd7febac41fbb9c03374c3283852/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:34 [ayvens.be] INFO: Found listing with ID: 1985585
2026-03-26 22:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985585%27 HTTP/1.1" 200 None
2026-03-26 22:55:34 [ayvens.be] INFO: Scrape type for 1985585: 1
2026-03-26 22:55:34 [ayvens.be] INFO: Extracting data for car ID: 1985585
2026-03-26 22:55:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c6c750c-311e-5bb4-92b0-52a55d2cc9fa with identifier: 1985585
2026-03-26 22:55:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c6c750c-311e-5bb4-92b0-52a55d2cc9fa with scrape type 1
2026-03-26 22:55:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2c6c750c-311e-5bb4-92b0-52a55d2cc9fa
2026-03-26 22:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F9f14cfc6d064485ab6c29234e55462eb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/9f14cfc6d064485ab6c29234e55462eb/images/large/1.jpg not downloaded yet
2026-03-26 22:55:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/9aaefd7febac41fbb9c03374c3283852/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/9aaefd7febac41fbb9c03374c3283852/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/9aaefd7febac41fbb9c03374c3283852/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F9f14cfc6d064485ab6c29234e55462eb%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/9f14cfc6d064485ab6c29234e55462eb/images/large/2.jpg not downloaded yet
2026-03-26 22:55:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/9aaefd7febac41fbb9c03374c3283852/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/9aaefd7febac41fbb9c03374c3283852/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F9f14cfc6d064485ab6c29234e55462eb%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/9f14cfc6d064485ab6c29234e55462eb/images/large/3.jpg not downloaded yet
2026-03-26 22:55:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/9aaefd7febac41fbb9c03374c3283852/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F9f14cfc6d064485ab6c29234e55462eb%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/9f14cfc6d064485ab6c29234e55462eb/images/large/4.jpg not downloaded yet
2026-03-26 22:55:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79a6b90>
2026-03-26 22:55:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d1a3554-0055-53af-a270-fe16424e8590/6d1a3554-0055-53af-a270-fe16424e8590_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:55:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F93306b94323940c7a210b5669c85d3c4%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/93306b94323940c7a210b5669c85d3c4/images/large/9.jpg saved to cache
2026-03-26 22:55:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6d1a3554-0055-53af-a270-fe16424e8590
2026-03-26 22:55:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6d1a3554-0055-53af-a270-fe16424e8590, skipping ID generation
2026-03-26 22:55:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d1a3554-0055-53af-a270-fe16424e8590 with scrape type 1
2026-03-26 22:55:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6d1a3554-0055-53af-a270-fe16424e8590 sending to next pipeline
2026-03-26 22:55:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 6d1a3554-0055-53af-a270-fe16424e8590, identifier: 1985582
2026-03-26 22:55:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F9f14cfc6d064485ab6c29234e55462eb%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/9f14cfc6d064485ab6c29234e55462eb/images/large/5.jpg not downloaded yet
2026-03-26 22:55:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 6d1a3554-0055-53af-a270-fe16424e8590 with identifier: 1985582
2026-03-26 22:55:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 6d1a3554-0055-53af-a270-fe16424e8590 with identifier: 1985582
2026-03-26 22:55:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 6d1a3554-0055-53af-a270-fe16424e8590 with identifier: 1985582 to the API
2026-03-26 22:55:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:55:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:55:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2br/93306b94323940c7a210b5669c85d3c4/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '6d1a3554-0055-53af-a270-fe16424e8590',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A3',
 'odometer': 79780,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d1a3554-0055-53af-a270-fe16424e8590/6d1a3554-0055-53af-a270-fe16424e8590_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 671431,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/93306b94323940c7a210b5669c85d3c4/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d1a3554-0055-53af-a270-fe16424e8590/6d1a3554-0055-53af-a270-fe16424e8590_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 652504,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/93306b94323940c7a210b5669c85d3c4/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d1a3554-0055-53af-a270-fe16424e8590/6d1a3554-0055-53af-a270-fe16424e8590_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 576930,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/93306b94323940c7a210b5669c85d3c4/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d1a3554-0055-53af-a270-fe16424e8590/6d1a3554-0055-53af-a270-fe16424e8590_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 726952,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/93306b94323940c7a210b5669c85d3c4/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d1a3554-0055-53af-a270-fe16424e8590/6d1a3554-0055-53af-a270-fe16424e8590_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 578088,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/93306b94323940c7a210b5669c85d3c4/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d1a3554-0055-53af-a270-fe16424e8590/6d1a3554-0055-53af-a270-fe16424e8590_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 533004,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/93306b94323940c7a210b5669c85d3c4/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d1a3554-0055-53af-a270-fe16424e8590/6d1a3554-0055-53af-a270-fe16424e8590_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 608968,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/93306b94323940c7a210b5669c85d3c4/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d1a3554-0055-53af-a270-fe16424e8590/6d1a3554-0055-53af-a270-fe16424e8590_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 760559,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/93306b94323940c7a210b5669c85d3c4/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d1a3554-0055-53af-a270-fe16424e8590/6d1a3554-0055-53af-a270-fe16424e8590_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 546728,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/93306b94323940c7a210b5669c85d3c4/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d1a3554-0055-53af-a270-fe16424e8590/6d1a3554-0055-53af-a270-fe16424e8590_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 455364,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/93306b94323940c7a210b5669c85d3c4/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A3 1.4 40 TFSI E S TRON. ADVANCED SPORTBACK',
 'transmission': 'automatic',
 'trim': '1.4 40 TFSI E S TRON. ADVANCED SPORTBACK',
 'vin': None,
 'year': 2022}
2026-03-26 22:55:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985582%27 HTTP/1.1" 200 None
2026-03-26 22:55:35 [ayvens.be] INFO: Saving data for 1985582: {'created_time': 1774565735.540121, 'last_price_update_time': 1774565735.540131, 'auction_closing_time': 1774958400.0}
2026-03-26 22:55:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985582') HTTP/1.1" 204 0
2026-03-26 22:55:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b78c2c10>
2026-03-26 22:55:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3c01302-3a2c-5f20-b7f7-b55664bd78ee/c3c01302-3a2c-5f20-b7f7-b55664bd78ee_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:55:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F9aaefd7febac41fbb9c03374c3283852%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/9aaefd7febac41fbb9c03374c3283852/images/large/10.jpg saved to cache
2026-03-26 22:55:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c3c01302-3a2c-5f20-b7f7-b55664bd78ee
2026-03-26 22:55:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F9f14cfc6d064485ab6c29234e55462eb%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/9f14cfc6d064485ab6c29234e55462eb/images/large/6.jpg not downloaded yet
2026-03-26 22:55:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/dcd8ab8a80f445929daec3806c852e04/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7571210>
2026-03-26 22:55:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3c01302-3a2c-5f20-b7f7-b55664bd78ee/c3c01302-3a2c-5f20-b7f7-b55664bd78ee_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:55:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F9aaefd7febac41fbb9c03374c3283852%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/9aaefd7febac41fbb9c03374c3283852/images/large/1.jpg saved to cache
2026-03-26 22:55:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c3c01302-3a2c-5f20-b7f7-b55664bd78ee
2026-03-26 22:55:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cc8410>
2026-03-26 22:55:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3c01302-3a2c-5f20-b7f7-b55664bd78ee/c3c01302-3a2c-5f20-b7f7-b55664bd78ee_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:55:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F9aaefd7febac41fbb9c03374c3283852%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/9aaefd7febac41fbb9c03374c3283852/images/large/2.jpg saved to cache
2026-03-26 22:55:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c3c01302-3a2c-5f20-b7f7-b55664bd78ee
2026-03-26 22:55:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd0cf490>
2026-03-26 22:55:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3c01302-3a2c-5f20-b7f7-b55664bd78ee/c3c01302-3a2c-5f20-b7f7-b55664bd78ee_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:55:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F9aaefd7febac41fbb9c03374c3283852%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/9aaefd7febac41fbb9c03374c3283852/images/large/4.jpg saved to cache
2026-03-26 22:55:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c3c01302-3a2c-5f20-b7f7-b55664bd78ee
2026-03-26 22:55:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7a62bd0>
2026-03-26 22:55:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3c01302-3a2c-5f20-b7f7-b55664bd78ee/c3c01302-3a2c-5f20-b7f7-b55664bd78ee_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F9aaefd7febac41fbb9c03374c3283852%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/9aaefd7febac41fbb9c03374c3283852/images/large/3.jpg saved to cache
2026-03-26 22:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c3c01302-3a2c-5f20-b7f7-b55664bd78ee
2026-03-26 22:55:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b777b810>
2026-03-26 22:55:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3c01302-3a2c-5f20-b7f7-b55664bd78ee/c3c01302-3a2c-5f20-b7f7-b55664bd78ee_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F9aaefd7febac41fbb9c03374c3283852%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/9aaefd7febac41fbb9c03374c3283852/images/large/9.jpg saved to cache
2026-03-26 22:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c3c01302-3a2c-5f20-b7f7-b55664bd78ee
2026-03-26 22:55:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cc9590>
2026-03-26 22:55:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3c01302-3a2c-5f20-b7f7-b55664bd78ee/c3c01302-3a2c-5f20-b7f7-b55664bd78ee_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F9aaefd7febac41fbb9c03374c3283852%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/9aaefd7febac41fbb9c03374c3283852/images/large/8.jpg saved to cache
2026-03-26 22:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c3c01302-3a2c-5f20-b7f7-b55664bd78ee
2026-03-26 22:55:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/dcd8ab8a80f445929daec3806c852e04/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F9f14cfc6d064485ab6c29234e55462eb%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/9f14cfc6d064485ab6c29234e55462eb/images/large/7.jpg not downloaded yet
2026-03-26 22:55:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/dcd8ab8a80f445929daec3806c852e04/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/dcd8ab8a80f445929daec3806c852e04/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/dcd8ab8a80f445929daec3806c852e04/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F9f14cfc6d064485ab6c29234e55462eb%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/9f14cfc6d064485ab6c29234e55462eb/images/large/8.jpg not downloaded yet
2026-03-26 22:55:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e123d0>
2026-03-26 22:55:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_793c0c01-3b2f-51f7-abf8-56f206854475/793c0c01-3b2f-51f7-abf8-56f206854475_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Fdcd8ab8a80f445929daec3806c852e04%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/dcd8ab8a80f445929daec3806c852e04/images/large/1.jpg saved to cache
2026-03-26 22:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 793c0c01-3b2f-51f7-abf8-56f206854475
2026-03-26 22:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F9f14cfc6d064485ab6c29234e55462eb%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/9f14cfc6d064485ab6c29234e55462eb/images/large/9.jpg not downloaded yet
2026-03-26 22:55:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/9aaefd7febac41fbb9c03374c3283852/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/9aaefd7febac41fbb9c03374c3283852/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/9aaefd7febac41fbb9c03374c3283852/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F9f14cfc6d064485ab6c29234e55462eb%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/9f14cfc6d064485ab6c29234e55462eb/images/large/10.jpg not downloaded yet
2026-03-26 22:55:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/dcd8ab8a80f445929daec3806c852e04/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76ec250>
2026-03-26 22:55:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_793c0c01-3b2f-51f7-abf8-56f206854475/793c0c01-3b2f-51f7-abf8-56f206854475_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Fdcd8ab8a80f445929daec3806c852e04%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/dcd8ab8a80f445929daec3806c852e04/images/large/9.jpg saved to cache
2026-03-26 22:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 793c0c01-3b2f-51f7-abf8-56f206854475
2026-03-26 22:55:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c82110>
2026-03-26 22:55:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_793c0c01-3b2f-51f7-abf8-56f206854475/793c0c01-3b2f-51f7-abf8-56f206854475_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Fdcd8ab8a80f445929daec3806c852e04%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/dcd8ab8a80f445929daec3806c852e04/images/large/8.jpg saved to cache
2026-03-26 22:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 793c0c01-3b2f-51f7-abf8-56f206854475
2026-03-26 22:55:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74402d0>
2026-03-26 22:55:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_793c0c01-3b2f-51f7-abf8-56f206854475/793c0c01-3b2f-51f7-abf8-56f206854475_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Fdcd8ab8a80f445929daec3806c852e04%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/dcd8ab8a80f445929daec3806c852e04/images/large/2.jpg saved to cache
2026-03-26 22:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 793c0c01-3b2f-51f7-abf8-56f206854475
2026-03-26 22:55:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c83fd0>
2026-03-26 22:55:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_793c0c01-3b2f-51f7-abf8-56f206854475/793c0c01-3b2f-51f7-abf8-56f206854475_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Fdcd8ab8a80f445929daec3806c852e04%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/dcd8ab8a80f445929daec3806c852e04/images/large/7.jpg saved to cache
2026-03-26 22:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 793c0c01-3b2f-51f7-abf8-56f206854475
2026-03-26 22:55:36 [ayvens.be] INFO: Found listing with ID: 1985586
2026-03-26 22:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985586%27 HTTP/1.1" 200 None
2026-03-26 22:55:36 [ayvens.be] INFO: Scrape type for 1985586: 1
2026-03-26 22:55:36 [ayvens.be] INFO: Extracting data for car ID: 1985586
2026-03-26 22:55:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5af63105-081c-5512-913f-f3447d11d7c9 with identifier: 1985586
2026-03-26 22:55:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5af63105-081c-5512-913f-f3447d11d7c9 with scrape type 1
2026-03-26 22:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5af63105-081c-5512-913f-f3447d11d7c9
2026-03-26 22:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252F8d9927258535458ab8a8d5e7472f2602%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/8d9927258535458ab8a8d5e7472f2602/images/large/1.jpg not downloaded yet
2026-03-26 22:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252F8d9927258535458ab8a8d5e7472f2602%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/8d9927258535458ab8a8d5e7472f2602/images/large/2.jpg not downloaded yet
2026-03-26 22:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252F8d9927258535458ab8a8d5e7472f2602%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/8d9927258535458ab8a8d5e7472f2602/images/large/3.jpg not downloaded yet
2026-03-26 22:55:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c975d0>
2026-03-26 22:55:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3c01302-3a2c-5f20-b7f7-b55664bd78ee/c3c01302-3a2c-5f20-b7f7-b55664bd78ee_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F9aaefd7febac41fbb9c03374c3283852%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/9aaefd7febac41fbb9c03374c3283852/images/large/6.jpg saved to cache
2026-03-26 22:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c3c01302-3a2c-5f20-b7f7-b55664bd78ee
2026-03-26 22:55:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b782f590>
2026-03-26 22:55:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3c01302-3a2c-5f20-b7f7-b55664bd78ee/c3c01302-3a2c-5f20-b7f7-b55664bd78ee_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F9aaefd7febac41fbb9c03374c3283852%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/9aaefd7febac41fbb9c03374c3283852/images/large/7.jpg saved to cache
2026-03-26 22:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c3c01302-3a2c-5f20-b7f7-b55664bd78ee
2026-03-26 22:55:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b78a8450>
2026-03-26 22:55:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3c01302-3a2c-5f20-b7f7-b55664bd78ee/c3c01302-3a2c-5f20-b7f7-b55664bd78ee_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F9aaefd7febac41fbb9c03374c3283852%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/9aaefd7febac41fbb9c03374c3283852/images/large/5.jpg saved to cache
2026-03-26 22:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c3c01302-3a2c-5f20-b7f7-b55664bd78ee
2026-03-26 22:55:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c3c01302-3a2c-5f20-b7f7-b55664bd78ee, skipping ID generation
2026-03-26 22:55:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3c01302-3a2c-5f20-b7f7-b55664bd78ee with scrape type 1
2026-03-26 22:55:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c3c01302-3a2c-5f20-b7f7-b55664bd78ee sending to next pipeline
2026-03-26 22:55:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c3c01302-3a2c-5f20-b7f7-b55664bd78ee, identifier: 1985583
2026-03-26 22:55:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e45b10>
2026-03-26 22:55:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_793c0c01-3b2f-51f7-abf8-56f206854475/793c0c01-3b2f-51f7-abf8-56f206854475_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Fdcd8ab8a80f445929daec3806c852e04%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/dcd8ab8a80f445929daec3806c852e04/images/large/10.jpg saved to cache
2026-03-26 22:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 793c0c01-3b2f-51f7-abf8-56f206854475
2026-03-26 22:55:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/dcd8ab8a80f445929daec3806c852e04/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/dcd8ab8a80f445929daec3806c852e04/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/dcd8ab8a80f445929daec3806c852e04/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/dcd8ab8a80f445929daec3806c852e04/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c3c01302-3a2c-5f20-b7f7-b55664bd78ee with identifier: 1985583
2026-03-26 22:55:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c3c01302-3a2c-5f20-b7f7-b55664bd78ee with identifier: 1985583
2026-03-26 22:55:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c3c01302-3a2c-5f20-b7f7-b55664bd78ee with identifier: 1985583 to the API
2026-03-26 22:55:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:55:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:55:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yw/9aaefd7febac41fbb9c03374c3283852/images/large/5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'c3c01302-3a2c-5f20-b7f7-b55664bd78ee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X2',
 'odometer': 128234,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3c01302-3a2c-5f20-b7f7-b55664bd78ee/c3c01302-3a2c-5f20-b7f7-b55664bd78ee_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 734416,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/9aaefd7febac41fbb9c03374c3283852/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3c01302-3a2c-5f20-b7f7-b55664bd78ee/c3c01302-3a2c-5f20-b7f7-b55664bd78ee_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 728909,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/9aaefd7febac41fbb9c03374c3283852/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3c01302-3a2c-5f20-b7f7-b55664bd78ee/c3c01302-3a2c-5f20-b7f7-b55664bd78ee_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 716447,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/9aaefd7febac41fbb9c03374c3283852/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3c01302-3a2c-5f20-b7f7-b55664bd78ee/c3c01302-3a2c-5f20-b7f7-b55664bd78ee_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 764904,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/9aaefd7febac41fbb9c03374c3283852/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3c01302-3a2c-5f20-b7f7-b55664bd78ee/c3c01302-3a2c-5f20-b7f7-b55664bd78ee_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 585980,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/9aaefd7febac41fbb9c03374c3283852/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3c01302-3a2c-5f20-b7f7-b55664bd78ee/c3c01302-3a2c-5f20-b7f7-b55664bd78ee_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 549925,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/9aaefd7febac41fbb9c03374c3283852/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3c01302-3a2c-5f20-b7f7-b55664bd78ee/c3c01302-3a2c-5f20-b7f7-b55664bd78ee_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 567410,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/9aaefd7febac41fbb9c03374c3283852/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3c01302-3a2c-5f20-b7f7-b55664bd78ee/c3c01302-3a2c-5f20-b7f7-b55664bd78ee_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 751171,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/9aaefd7febac41fbb9c03374c3283852/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3c01302-3a2c-5f20-b7f7-b55664bd78ee/c3c01302-3a2c-5f20-b7f7-b55664bd78ee_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 647714,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/9aaefd7febac41fbb9c03374c3283852/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3c01302-3a2c-5f20-b7f7-b55664bd78ee/c3c01302-3a2c-5f20-b7f7-b55664bd78ee_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 442332,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/9aaefd7febac41fbb9c03374c3283852/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X2 1.5iA xDrive25e PHEV OPF',
 'transmission': 'automatic',
 'trim': '1.5iA xDrive25e PHEV OPF',
 'vin': None,
 'year': 2021}
2026-03-26 22:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985583%27 HTTP/1.1" 200 None
2026-03-26 22:55:37 [ayvens.be] INFO: Saving data for 1985583: {'created_time': 1774565737.719837, 'last_price_update_time': 1774565737.719848, 'auction_closing_time': 1774958400.0}
2026-03-26 22:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985583') HTTP/1.1" 204 0
2026-03-26 22:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252F8d9927258535458ab8a8d5e7472f2602%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/8d9927258535458ab8a8d5e7472f2602/images/large/4.jpg not downloaded yet
2026-03-26 22:55:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/9f14cfc6d064485ab6c29234e55462eb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252F8d9927258535458ab8a8d5e7472f2602%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/8d9927258535458ab8a8d5e7472f2602/images/large/5.jpg not downloaded yet
2026-03-26 22:55:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b728e2d0>
2026-03-26 22:55:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_793c0c01-3b2f-51f7-abf8-56f206854475/793c0c01-3b2f-51f7-abf8-56f206854475_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Fdcd8ab8a80f445929daec3806c852e04%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/dcd8ab8a80f445929daec3806c852e04/images/large/5.jpg saved to cache
2026-03-26 22:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 793c0c01-3b2f-51f7-abf8-56f206854475
2026-03-26 22:55:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79d5210>
2026-03-26 22:55:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_793c0c01-3b2f-51f7-abf8-56f206854475/793c0c01-3b2f-51f7-abf8-56f206854475_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Fdcd8ab8a80f445929daec3806c852e04%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/dcd8ab8a80f445929daec3806c852e04/images/large/6.jpg saved to cache
2026-03-26 22:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 793c0c01-3b2f-51f7-abf8-56f206854475
2026-03-26 22:55:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b782ec90>
2026-03-26 22:55:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_793c0c01-3b2f-51f7-abf8-56f206854475/793c0c01-3b2f-51f7-abf8-56f206854475_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Fdcd8ab8a80f445929daec3806c852e04%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/dcd8ab8a80f445929daec3806c852e04/images/large/4.jpg saved to cache
2026-03-26 22:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 793c0c01-3b2f-51f7-abf8-56f206854475
2026-03-26 22:55:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e4f450>
2026-03-26 22:55:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_793c0c01-3b2f-51f7-abf8-56f206854475/793c0c01-3b2f-51f7-abf8-56f206854475_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Fdcd8ab8a80f445929daec3806c852e04%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/dcd8ab8a80f445929daec3806c852e04/images/large/3.jpg saved to cache
2026-03-26 22:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 793c0c01-3b2f-51f7-abf8-56f206854475
2026-03-26 22:55:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 793c0c01-3b2f-51f7-abf8-56f206854475, skipping ID generation
2026-03-26 22:55:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 793c0c01-3b2f-51f7-abf8-56f206854475 with scrape type 1
2026-03-26 22:55:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 793c0c01-3b2f-51f7-abf8-56f206854475 sending to next pipeline
2026-03-26 22:55:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 793c0c01-3b2f-51f7-abf8-56f206854475, identifier: 1985584
2026-03-26 22:55:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/9f14cfc6d064485ab6c29234e55462eb/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252F8d9927258535458ab8a8d5e7472f2602%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/8d9927258535458ab8a8d5e7472f2602/images/large/6.jpg not downloaded yet
2026-03-26 22:55:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 793c0c01-3b2f-51f7-abf8-56f206854475 with identifier: 1985584
2026-03-26 22:55:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 793c0c01-3b2f-51f7-abf8-56f206854475 with identifier: 1985584
2026-03-26 22:55:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 793c0c01-3b2f-51f7-abf8-56f206854475 with identifier: 1985584 to the API
2026-03-26 22:55:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:55:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:55:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1ys/dcd8ab8a80f445929daec3806c852e04/images/large/3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '793c0c01-3b2f-51f7-abf8-56f206854475',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 102641,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_793c0c01-3b2f-51f7-abf8-56f206854475/793c0c01-3b2f-51f7-abf8-56f206854475_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 306975,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/dcd8ab8a80f445929daec3806c852e04/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_793c0c01-3b2f-51f7-abf8-56f206854475/793c0c01-3b2f-51f7-abf8-56f206854475_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 310566,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/dcd8ab8a80f445929daec3806c852e04/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_793c0c01-3b2f-51f7-abf8-56f206854475/793c0c01-3b2f-51f7-abf8-56f206854475_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 263147,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/dcd8ab8a80f445929daec3806c852e04/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_793c0c01-3b2f-51f7-abf8-56f206854475/793c0c01-3b2f-51f7-abf8-56f206854475_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 283290,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/dcd8ab8a80f445929daec3806c852e04/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_793c0c01-3b2f-51f7-abf8-56f206854475/793c0c01-3b2f-51f7-abf8-56f206854475_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 313977,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/dcd8ab8a80f445929daec3806c852e04/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_793c0c01-3b2f-51f7-abf8-56f206854475/793c0c01-3b2f-51f7-abf8-56f206854475_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 299657,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/dcd8ab8a80f445929daec3806c852e04/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_793c0c01-3b2f-51f7-abf8-56f206854475/793c0c01-3b2f-51f7-abf8-56f206854475_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 346426,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/dcd8ab8a80f445929daec3806c852e04/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_793c0c01-3b2f-51f7-abf8-56f206854475/793c0c01-3b2f-51f7-abf8-56f206854475_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 308892,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/dcd8ab8a80f445929daec3806c852e04/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_793c0c01-3b2f-51f7-abf8-56f206854475/793c0c01-3b2f-51f7-abf8-56f206854475_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 198910,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/dcd8ab8a80f445929daec3806c852e04/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_793c0c01-3b2f-51f7-abf8-56f206854475/793c0c01-3b2f-51f7-abf8-56f206854475_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 256766,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/dcd8ab8a80f445929daec3806c852e04/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 1.5 XDRIVE25E (162KW) BELGIAN CUSTOMERS ONLY',
 'transmission': 'automatic',
 'trim': '1.5 XDRIVE25E (162KW) BELGIAN CUSTOMERS ONLY',
 'vin': None,
 'year': 2020}
2026-03-26 22:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985584%27 HTTP/1.1" 200 None
2026-03-26 22:55:38 [ayvens.be] INFO: Saving data for 1985584: {'created_time': 1774565738.639679, 'last_price_update_time': 1774565738.63969, 'auction_closing_time': 1774958400.0}
2026-03-26 22:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985584') HTTP/1.1" 204 0
2026-03-26 22:55:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/9f14cfc6d064485ab6c29234e55462eb/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/9f14cfc6d064485ab6c29234e55462eb/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252F8d9927258535458ab8a8d5e7472f2602%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/8d9927258535458ab8a8d5e7472f2602/images/large/7.jpg not downloaded yet
2026-03-26 22:55:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b16290>
2026-03-26 22:55:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c6c750c-311e-5bb4-92b0-52a55d2cc9fa/2c6c750c-311e-5bb4-92b0-52a55d2cc9fa_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F9f14cfc6d064485ab6c29234e55462eb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/9f14cfc6d064485ab6c29234e55462eb/images/large/1.jpg saved to cache
2026-03-26 22:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2c6c750c-311e-5bb4-92b0-52a55d2cc9fa
2026-03-26 22:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252F8d9927258535458ab8a8d5e7472f2602%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/8d9927258535458ab8a8d5e7472f2602/images/large/8.jpg not downloaded yet
2026-03-26 22:55:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7981a90>
2026-03-26 22:55:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c6c750c-311e-5bb4-92b0-52a55d2cc9fa/2c6c750c-311e-5bb4-92b0-52a55d2cc9fa_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F9f14cfc6d064485ab6c29234e55462eb%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/9f14cfc6d064485ab6c29234e55462eb/images/large/7.jpg saved to cache
2026-03-26 22:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2c6c750c-311e-5bb4-92b0-52a55d2cc9fa
2026-03-26 22:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252F8d9927258535458ab8a8d5e7472f2602%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/8d9927258535458ab8a8d5e7472f2602/images/large/9.jpg not downloaded yet
2026-03-26 22:55:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7768b90>
2026-03-26 22:55:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c6c750c-311e-5bb4-92b0-52a55d2cc9fa/2c6c750c-311e-5bb4-92b0-52a55d2cc9fa_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F9f14cfc6d064485ab6c29234e55462eb%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/9f14cfc6d064485ab6c29234e55462eb/images/large/6.jpg saved to cache
2026-03-26 22:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2c6c750c-311e-5bb4-92b0-52a55d2cc9fa
2026-03-26 22:55:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b788f9d0>
2026-03-26 22:55:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c6c750c-311e-5bb4-92b0-52a55d2cc9fa/2c6c750c-311e-5bb4-92b0-52a55d2cc9fa_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F9f14cfc6d064485ab6c29234e55462eb%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/9f14cfc6d064485ab6c29234e55462eb/images/large/5.jpg saved to cache
2026-03-26 22:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2c6c750c-311e-5bb4-92b0-52a55d2cc9fa
2026-03-26 22:55:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/9f14cfc6d064485ab6c29234e55462eb/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252F8d9927258535458ab8a8d5e7472f2602%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/8d9927258535458ab8a8d5e7472f2602/images/large/10.jpg not downloaded yet
2026-03-26 22:55:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/9f14cfc6d064485ab6c29234e55462eb/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/9f14cfc6d064485ab6c29234e55462eb/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:39 [ayvens.be] INFO: Found listing with ID: 1985587
2026-03-26 22:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985587%27 HTTP/1.1" 200 None
2026-03-26 22:55:39 [ayvens.be] INFO: Scrape type for 1985587: 1
2026-03-26 22:55:39 [ayvens.be] INFO: Extracting data for car ID: 1985587
2026-03-26 22:55:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 040088e1-6085-591e-8249-b75a78ad9128 with identifier: 1985587
2026-03-26 22:55:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 040088e1-6085-591e-8249-b75a78ad9128 with scrape type 1
2026-03-26 22:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 040088e1-6085-591e-8249-b75a78ad9128
2026-03-26 22:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F77893398625a4ef7b60318e3ed55a9e9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/77893398625a4ef7b60318e3ed55a9e9/images/large/1.jpg not downloaded yet
2026-03-26 22:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F77893398625a4ef7b60318e3ed55a9e9%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/77893398625a4ef7b60318e3ed55a9e9/images/large/2.jpg not downloaded yet
2026-03-26 22:55:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/9f14cfc6d064485ab6c29234e55462eb/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F77893398625a4ef7b60318e3ed55a9e9%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/77893398625a4ef7b60318e3ed55a9e9/images/large/3.jpg not downloaded yet
2026-03-26 22:55:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/9f14cfc6d064485ab6c29234e55462eb/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F77893398625a4ef7b60318e3ed55a9e9%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/77893398625a4ef7b60318e3ed55a9e9/images/large/4.jpg not downloaded yet
2026-03-26 22:55:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b174d0>
2026-03-26 22:55:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c6c750c-311e-5bb4-92b0-52a55d2cc9fa/2c6c750c-311e-5bb4-92b0-52a55d2cc9fa_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F9f14cfc6d064485ab6c29234e55462eb%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/9f14cfc6d064485ab6c29234e55462eb/images/large/2.jpg saved to cache
2026-03-26 22:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2c6c750c-311e-5bb4-92b0-52a55d2cc9fa
2026-03-26 22:55:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ap/8d9927258535458ab8a8d5e7472f2602/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ap/8d9927258535458ab8a8d5e7472f2602/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F77893398625a4ef7b60318e3ed55a9e9%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/77893398625a4ef7b60318e3ed55a9e9/images/large/5.jpg not downloaded yet
2026-03-26 22:55:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/9f14cfc6d064485ab6c29234e55462eb/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F77893398625a4ef7b60318e3ed55a9e9%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/77893398625a4ef7b60318e3ed55a9e9/images/large/6.jpg not downloaded yet
2026-03-26 22:55:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7a57ad0>
2026-03-26 22:55:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c6c750c-311e-5bb4-92b0-52a55d2cc9fa/2c6c750c-311e-5bb4-92b0-52a55d2cc9fa_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F9f14cfc6d064485ab6c29234e55462eb%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/9f14cfc6d064485ab6c29234e55462eb/images/large/3.jpg saved to cache
2026-03-26 22:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2c6c750c-311e-5bb4-92b0-52a55d2cc9fa
2026-03-26 22:55:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b746f510>
2026-03-26 22:55:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c6c750c-311e-5bb4-92b0-52a55d2cc9fa/2c6c750c-311e-5bb4-92b0-52a55d2cc9fa_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F9f14cfc6d064485ab6c29234e55462eb%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/9f14cfc6d064485ab6c29234e55462eb/images/large/4.jpg saved to cache
2026-03-26 22:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2c6c750c-311e-5bb4-92b0-52a55d2cc9fa
2026-03-26 22:55:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7474910>
2026-03-26 22:55:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c6c750c-311e-5bb4-92b0-52a55d2cc9fa/2c6c750c-311e-5bb4-92b0-52a55d2cc9fa_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F9f14cfc6d064485ab6c29234e55462eb%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/9f14cfc6d064485ab6c29234e55462eb/images/large/8.jpg saved to cache
2026-03-26 22:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2c6c750c-311e-5bb4-92b0-52a55d2cc9fa
2026-03-26 22:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F77893398625a4ef7b60318e3ed55a9e9%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/77893398625a4ef7b60318e3ed55a9e9/images/large/7.jpg not downloaded yet
2026-03-26 22:55:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79d7650>
2026-03-26 22:55:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c6c750c-311e-5bb4-92b0-52a55d2cc9fa/2c6c750c-311e-5bb4-92b0-52a55d2cc9fa_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F9f14cfc6d064485ab6c29234e55462eb%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/9f14cfc6d064485ab6c29234e55462eb/images/large/9.jpg saved to cache
2026-03-26 22:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2c6c750c-311e-5bb4-92b0-52a55d2cc9fa
2026-03-26 22:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F77893398625a4ef7b60318e3ed55a9e9%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/77893398625a4ef7b60318e3ed55a9e9/images/large/8.jpg not downloaded yet
2026-03-26 22:55:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6df3810>
2026-03-26 22:55:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5af63105-081c-5512-913f-f3447d11d7c9/5af63105-081c-5512-913f-f3447d11d7c9_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252F8d9927258535458ab8a8d5e7472f2602%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/8d9927258535458ab8a8d5e7472f2602/images/large/2.jpg saved to cache
2026-03-26 22:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5af63105-081c-5512-913f-f3447d11d7c9
2026-03-26 22:55:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6def890>
2026-03-26 22:55:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5af63105-081c-5512-913f-f3447d11d7c9/5af63105-081c-5512-913f-f3447d11d7c9_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252F8d9927258535458ab8a8d5e7472f2602%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/8d9927258535458ab8a8d5e7472f2602/images/large/1.jpg saved to cache
2026-03-26 22:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5af63105-081c-5512-913f-f3447d11d7c9
2026-03-26 22:55:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7946410>
2026-03-26 22:55:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c6c750c-311e-5bb4-92b0-52a55d2cc9fa/2c6c750c-311e-5bb4-92b0-52a55d2cc9fa_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F9f14cfc6d064485ab6c29234e55462eb%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/9f14cfc6d064485ab6c29234e55462eb/images/large/10.jpg saved to cache
2026-03-26 22:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2c6c750c-311e-5bb4-92b0-52a55d2cc9fa
2026-03-26 22:55:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2c6c750c-311e-5bb4-92b0-52a55d2cc9fa, skipping ID generation
2026-03-26 22:55:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c6c750c-311e-5bb4-92b0-52a55d2cc9fa with scrape type 1
2026-03-26 22:55:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2c6c750c-311e-5bb4-92b0-52a55d2cc9fa sending to next pipeline
2026-03-26 22:55:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 2c6c750c-311e-5bb4-92b0-52a55d2cc9fa, identifier: 1985585
2026-03-26 22:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F77893398625a4ef7b60318e3ed55a9e9%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/77893398625a4ef7b60318e3ed55a9e9/images/large/9.jpg not downloaded yet
2026-03-26 22:55:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 2c6c750c-311e-5bb4-92b0-52a55d2cc9fa with identifier: 1985585
2026-03-26 22:55:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 2c6c750c-311e-5bb4-92b0-52a55d2cc9fa with identifier: 1985585
2026-03-26 22:55:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 2c6c750c-311e-5bb4-92b0-52a55d2cc9fa with identifier: 1985585 to the API
2026-03-26 22:55:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:55:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:55:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yl/9f14cfc6d064485ab6c29234e55462eb/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '2c6c750c-311e-5bb4-92b0-52a55d2cc9fa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X3 - 2018',
 'odometer': 154840,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c6c750c-311e-5bb4-92b0-52a55d2cc9fa/2c6c750c-311e-5bb4-92b0-52a55d2cc9fa_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 518263,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/9f14cfc6d064485ab6c29234e55462eb/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c6c750c-311e-5bb4-92b0-52a55d2cc9fa/2c6c750c-311e-5bb4-92b0-52a55d2cc9fa_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 483916,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/9f14cfc6d064485ab6c29234e55462eb/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c6c750c-311e-5bb4-92b0-52a55d2cc9fa/2c6c750c-311e-5bb4-92b0-52a55d2cc9fa_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 545146,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/9f14cfc6d064485ab6c29234e55462eb/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c6c750c-311e-5bb4-92b0-52a55d2cc9fa/2c6c750c-311e-5bb4-92b0-52a55d2cc9fa_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 532633,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/9f14cfc6d064485ab6c29234e55462eb/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c6c750c-311e-5bb4-92b0-52a55d2cc9fa/2c6c750c-311e-5bb4-92b0-52a55d2cc9fa_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 501270,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/9f14cfc6d064485ab6c29234e55462eb/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c6c750c-311e-5bb4-92b0-52a55d2cc9fa/2c6c750c-311e-5bb4-92b0-52a55d2cc9fa_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 704391,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/9f14cfc6d064485ab6c29234e55462eb/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c6c750c-311e-5bb4-92b0-52a55d2cc9fa/2c6c750c-311e-5bb4-92b0-52a55d2cc9fa_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 597658,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/9f14cfc6d064485ab6c29234e55462eb/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c6c750c-311e-5bb4-92b0-52a55d2cc9fa/2c6c750c-311e-5bb4-92b0-52a55d2cc9fa_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 801338,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/9f14cfc6d064485ab6c29234e55462eb/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c6c750c-311e-5bb4-92b0-52a55d2cc9fa/2c6c750c-311e-5bb4-92b0-52a55d2cc9fa_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 874914,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/9f14cfc6d064485ab6c29234e55462eb/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c6c750c-311e-5bb4-92b0-52a55d2cc9fa/2c6c750c-311e-5bb4-92b0-52a55d2cc9fa_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 898989,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/9f14cfc6d064485ab6c29234e55462eb/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X3 - 2018 2.0iA xDrive30e PHEV OPF',
 'transmission': 'automatic',
 'trim': '2.0iA xDrive30e PHEV OPF',
 'vin': None,
 'year': 2020}
2026-03-26 22:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985585%27 HTTP/1.1" 200 None
2026-03-26 22:55:40 [ayvens.be] INFO: Saving data for 1985585: {'created_time': 1774565740.236795, 'last_price_update_time': 1774565740.236803, 'auction_closing_time': 1774958400.0}
2026-03-26 22:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985585') HTTP/1.1" 204 0
2026-03-26 22:55:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ap/8d9927258535458ab8a8d5e7472f2602/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F77893398625a4ef7b60318e3ed55a9e9%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/77893398625a4ef7b60318e3ed55a9e9/images/large/10.jpg not downloaded yet
2026-03-26 22:55:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ap/8d9927258535458ab8a8d5e7472f2602/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ap/8d9927258535458ab8a8d5e7472f2602/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ap/8d9927258535458ab8a8d5e7472f2602/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:40 [ayvens.be] INFO: Found listing with ID: 1985588
2026-03-26 22:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985588%27 HTTP/1.1" 200 None
2026-03-26 22:55:40 [ayvens.be] INFO: Scrape type for 1985588: 1
2026-03-26 22:55:40 [ayvens.be] INFO: Extracting data for car ID: 1985588
2026-03-26 22:55:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 67ef6410-cbdb-5f79-bd50-4d8fb92361cc with identifier: 1985588
2026-03-26 22:55:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67ef6410-cbdb-5f79-bd50-4d8fb92361cc with scrape type 1
2026-03-26 22:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 67ef6410-cbdb-5f79-bd50-4d8fb92361cc
2026-03-26 22:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252Fbd282df787894068b57da27c26960642%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/bd282df787894068b57da27c26960642/images/large/1.jpg not downloaded yet
2026-03-26 22:55:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ap/8d9927258535458ab8a8d5e7472f2602/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ap/8d9927258535458ab8a8d5e7472f2602/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ap/8d9927258535458ab8a8d5e7472f2602/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252Fbd282df787894068b57da27c26960642%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/bd282df787894068b57da27c26960642/images/large/2.jpg not downloaded yet
2026-03-26 22:55:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ap/8d9927258535458ab8a8d5e7472f2602/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252Fbd282df787894068b57da27c26960642%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/bd282df787894068b57da27c26960642/images/large/3.jpg not downloaded yet
2026-03-26 22:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252Fbd282df787894068b57da27c26960642%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/bd282df787894068b57da27c26960642/images/large/4.jpg not downloaded yet
2026-03-26 22:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252Fbd282df787894068b57da27c26960642%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/bd282df787894068b57da27c26960642/images/large/5.jpg not downloaded yet
2026-03-26 22:55:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74ad350>
2026-03-26 22:55:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5af63105-081c-5512-913f-f3447d11d7c9/5af63105-081c-5512-913f-f3447d11d7c9_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252F8d9927258535458ab8a8d5e7472f2602%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/8d9927258535458ab8a8d5e7472f2602/images/large/4.jpg saved to cache
2026-03-26 22:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5af63105-081c-5512-913f-f3447d11d7c9
2026-03-26 22:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252Fbd282df787894068b57da27c26960642%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/bd282df787894068b57da27c26960642/images/large/6.jpg not downloaded yet
2026-03-26 22:55:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77eb250>
2026-03-26 22:55:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5af63105-081c-5512-913f-f3447d11d7c9/5af63105-081c-5512-913f-f3447d11d7c9_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252F8d9927258535458ab8a8d5e7472f2602%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/8d9927258535458ab8a8d5e7472f2602/images/large/3.jpg saved to cache
2026-03-26 22:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5af63105-081c-5512-913f-f3447d11d7c9
2026-03-26 22:55:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b727e710>
2026-03-26 22:55:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5af63105-081c-5512-913f-f3447d11d7c9/5af63105-081c-5512-913f-f3447d11d7c9_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252F8d9927258535458ab8a8d5e7472f2602%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/8d9927258535458ab8a8d5e7472f2602/images/large/5.jpg saved to cache
2026-03-26 22:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5af63105-081c-5512-913f-f3447d11d7c9
2026-03-26 22:55:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b742b4d0>
2026-03-26 22:55:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5af63105-081c-5512-913f-f3447d11d7c9/5af63105-081c-5512-913f-f3447d11d7c9_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252F8d9927258535458ab8a8d5e7472f2602%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/8d9927258535458ab8a8d5e7472f2602/images/large/6.jpg saved to cache
2026-03-26 22:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5af63105-081c-5512-913f-f3447d11d7c9
2026-03-26 22:55:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b75005d0>
2026-03-26 22:55:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5af63105-081c-5512-913f-f3447d11d7c9/5af63105-081c-5512-913f-f3447d11d7c9_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252F8d9927258535458ab8a8d5e7472f2602%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/8d9927258535458ab8a8d5e7472f2602/images/large/9.jpg saved to cache
2026-03-26 22:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5af63105-081c-5512-913f-f3447d11d7c9
2026-03-26 22:55:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77beb10>
2026-03-26 22:55:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5af63105-081c-5512-913f-f3447d11d7c9/5af63105-081c-5512-913f-f3447d11d7c9_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252F8d9927258535458ab8a8d5e7472f2602%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/8d9927258535458ab8a8d5e7472f2602/images/large/8.jpg saved to cache
2026-03-26 22:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5af63105-081c-5512-913f-f3447d11d7c9
2026-03-26 22:55:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b740bdd0>
2026-03-26 22:55:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5af63105-081c-5512-913f-f3447d11d7c9/5af63105-081c-5512-913f-f3447d11d7c9_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252F8d9927258535458ab8a8d5e7472f2602%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/8d9927258535458ab8a8d5e7472f2602/images/large/7.jpg saved to cache
2026-03-26 22:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5af63105-081c-5512-913f-f3447d11d7c9
2026-03-26 22:55:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e28b90>
2026-03-26 22:55:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5af63105-081c-5512-913f-f3447d11d7c9/5af63105-081c-5512-913f-f3447d11d7c9_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:55:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252F8d9927258535458ab8a8d5e7472f2602%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/8d9927258535458ab8a8d5e7472f2602/images/large/10.jpg saved to cache
2026-03-26 22:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5af63105-081c-5512-913f-f3447d11d7c9
2026-03-26 22:55:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5af63105-081c-5512-913f-f3447d11d7c9, skipping ID generation
2026-03-26 22:55:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5af63105-081c-5512-913f-f3447d11d7c9 with scrape type 1
2026-03-26 22:55:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5af63105-081c-5512-913f-f3447d11d7c9 sending to next pipeline
2026-03-26 22:55:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 5af63105-081c-5512-913f-f3447d11d7c9, identifier: 1985586
2026-03-26 22:55:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252Fbd282df787894068b57da27c26960642%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/bd282df787894068b57da27c26960642/images/large/7.jpg not downloaded yet
2026-03-26 22:55:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 5af63105-081c-5512-913f-f3447d11d7c9 with identifier: 1985586
2026-03-26 22:55:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 5af63105-081c-5512-913f-f3447d11d7c9 with identifier: 1985586
2026-03-26 22:55:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 5af63105-081c-5512-913f-f3447d11d7c9 with identifier: 1985586 to the API
2026-03-26 22:55:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:55:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:55:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ap/8d9927258535458ab8a8d5e7472f2602/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '5af63105-081c-5512-913f-f3447d11d7c9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 80507,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5af63105-081c-5512-913f-f3447d11d7c9/5af63105-081c-5512-913f-f3447d11d7c9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 620727,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ap/8d9927258535458ab8a8d5e7472f2602/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5af63105-081c-5512-913f-f3447d11d7c9/5af63105-081c-5512-913f-f3447d11d7c9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 715025,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ap/8d9927258535458ab8a8d5e7472f2602/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5af63105-081c-5512-913f-f3447d11d7c9/5af63105-081c-5512-913f-f3447d11d7c9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 527628,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ap/8d9927258535458ab8a8d5e7472f2602/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5af63105-081c-5512-913f-f3447d11d7c9/5af63105-081c-5512-913f-f3447d11d7c9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 710381,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ap/8d9927258535458ab8a8d5e7472f2602/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5af63105-081c-5512-913f-f3447d11d7c9/5af63105-081c-5512-913f-f3447d11d7c9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 520485,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ap/8d9927258535458ab8a8d5e7472f2602/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5af63105-081c-5512-913f-f3447d11d7c9/5af63105-081c-5512-913f-f3447d11d7c9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 566257,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ap/8d9927258535458ab8a8d5e7472f2602/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5af63105-081c-5512-913f-f3447d11d7c9/5af63105-081c-5512-913f-f3447d11d7c9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 670325,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ap/8d9927258535458ab8a8d5e7472f2602/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5af63105-081c-5512-913f-f3447d11d7c9/5af63105-081c-5512-913f-f3447d11d7c9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 626420,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ap/8d9927258535458ab8a8d5e7472f2602/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5af63105-081c-5512-913f-f3447d11d7c9/5af63105-081c-5512-913f-f3447d11d7c9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 595283,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ap/8d9927258535458ab8a8d5e7472f2602/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5af63105-081c-5512-913f-f3447d11d7c9/5af63105-081c-5512-913f-f3447d11d7c9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 544360,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ap/8d9927258535458ab8a8d5e7472f2602/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 1.6 HYBRID 225 E-AUTO8 GT PACK',
 'transmission': 'automatic',
 'trim': '1.6 HYBRID 225 E-AUTO8 GT PACK',
 'vin': None,
 'year': 2021}
2026-03-26 22:55:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985586%27 HTTP/1.1" 200 None
2026-03-26 22:55:41 [ayvens.be] INFO: Saving data for 1985586: {'created_time': 1774565741.542771, 'last_price_update_time': 1774565741.542782, 'auction_closing_time': 1774958400.0}
2026-03-26 22:55:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985586') HTTP/1.1" 204 0
2026-03-26 22:55:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252Fbd282df787894068b57da27c26960642%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/bd282df787894068b57da27c26960642/images/large/8.jpg not downloaded yet
2026-03-26 22:55:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/77893398625a4ef7b60318e3ed55a9e9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252Fbd282df787894068b57da27c26960642%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/bd282df787894068b57da27c26960642/images/large/9.jpg not downloaded yet
2026-03-26 22:55:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/77893398625a4ef7b60318e3ed55a9e9/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252Fbd282df787894068b57da27c26960642%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/bd282df787894068b57da27c26960642/images/large/10.jpg not downloaded yet
2026-03-26 22:55:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/77893398625a4ef7b60318e3ed55a9e9/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/77893398625a4ef7b60318e3ed55a9e9/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/77893398625a4ef7b60318e3ed55a9e9/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/77893398625a4ef7b60318e3ed55a9e9/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/77893398625a4ef7b60318e3ed55a9e9/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/77893398625a4ef7b60318e3ed55a9e9/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:41 [ayvens.be] INFO: Found listing with ID: 1985589
2026-03-26 22:55:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985589%27 HTTP/1.1" 200 None
2026-03-26 22:55:41 [ayvens.be] INFO: Scrape type for 1985589: 1
2026-03-26 22:55:41 [ayvens.be] INFO: Extracting data for car ID: 1985589
2026-03-26 22:55:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14f2b002-b2a6-542d-8ece-7cf9f9bede1d with identifier: 1985589
2026-03-26 22:55:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14f2b002-b2a6-542d-8ece-7cf9f9bede1d with scrape type 1
2026-03-26 22:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 14f2b002-b2a6-542d-8ece-7cf9f9bede1d
2026-03-26 22:55:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252Faef8571a7da34167917c344bb808ceb6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/aef8571a7da34167917c344bb808ceb6/images/large/1.jpg not downloaded yet
2026-03-26 22:55:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252Faef8571a7da34167917c344bb808ceb6%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/aef8571a7da34167917c344bb808ceb6/images/large/2.jpg not downloaded yet
2026-03-26 22:55:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252Faef8571a7da34167917c344bb808ceb6%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/aef8571a7da34167917c344bb808ceb6/images/large/3.jpg not downloaded yet
2026-03-26 22:55:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd134bd0>
2026-03-26 22:55:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_040088e1-6085-591e-8249-b75a78ad9128/040088e1-6085-591e-8249-b75a78ad9128_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:55:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F77893398625a4ef7b60318e3ed55a9e9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/77893398625a4ef7b60318e3ed55a9e9/images/large/1.jpg saved to cache
2026-03-26 22:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 040088e1-6085-591e-8249-b75a78ad9128
2026-03-26 22:55:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252Faef8571a7da34167917c344bb808ceb6%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/aef8571a7da34167917c344bb808ceb6/images/large/4.jpg not downloaded yet
2026-03-26 22:55:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74cd910>
2026-03-26 22:55:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_040088e1-6085-591e-8249-b75a78ad9128/040088e1-6085-591e-8249-b75a78ad9128_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:55:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F77893398625a4ef7b60318e3ed55a9e9%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/77893398625a4ef7b60318e3ed55a9e9/images/large/3.jpg saved to cache
2026-03-26 22:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 040088e1-6085-591e-8249-b75a78ad9128
2026-03-26 22:55:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252Faef8571a7da34167917c344bb808ceb6%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/aef8571a7da34167917c344bb808ceb6/images/large/5.jpg not downloaded yet
2026-03-26 22:55:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd3b6190>
2026-03-26 22:55:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_040088e1-6085-591e-8249-b75a78ad9128/040088e1-6085-591e-8249-b75a78ad9128_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F77893398625a4ef7b60318e3ed55a9e9%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/77893398625a4ef7b60318e3ed55a9e9/images/large/6.jpg saved to cache
2026-03-26 22:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 040088e1-6085-591e-8249-b75a78ad9128
2026-03-26 22:55:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6da6810>
2026-03-26 22:55:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_040088e1-6085-591e-8249-b75a78ad9128/040088e1-6085-591e-8249-b75a78ad9128_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F77893398625a4ef7b60318e3ed55a9e9%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/77893398625a4ef7b60318e3ed55a9e9/images/large/2.jpg saved to cache
2026-03-26 22:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 040088e1-6085-591e-8249-b75a78ad9128
2026-03-26 22:55:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b741de90>
2026-03-26 22:55:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_040088e1-6085-591e-8249-b75a78ad9128/040088e1-6085-591e-8249-b75a78ad9128_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F77893398625a4ef7b60318e3ed55a9e9%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/77893398625a4ef7b60318e3ed55a9e9/images/large/4.jpg saved to cache
2026-03-26 22:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 040088e1-6085-591e-8249-b75a78ad9128
2026-03-26 22:55:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74cdc10>
2026-03-26 22:55:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_040088e1-6085-591e-8249-b75a78ad9128/040088e1-6085-591e-8249-b75a78ad9128_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F77893398625a4ef7b60318e3ed55a9e9%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/77893398625a4ef7b60318e3ed55a9e9/images/large/7.jpg saved to cache
2026-03-26 22:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 040088e1-6085-591e-8249-b75a78ad9128
2026-03-26 22:55:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77472d0>
2026-03-26 22:55:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_040088e1-6085-591e-8249-b75a78ad9128/040088e1-6085-591e-8249-b75a78ad9128_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F77893398625a4ef7b60318e3ed55a9e9%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/77893398625a4ef7b60318e3ed55a9e9/images/large/5.jpg saved to cache
2026-03-26 22:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 040088e1-6085-591e-8249-b75a78ad9128
2026-03-26 22:55:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7745850>
2026-03-26 22:55:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_040088e1-6085-591e-8249-b75a78ad9128/040088e1-6085-591e-8249-b75a78ad9128_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F77893398625a4ef7b60318e3ed55a9e9%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/77893398625a4ef7b60318e3ed55a9e9/images/large/8.jpg saved to cache
2026-03-26 22:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 040088e1-6085-591e-8249-b75a78ad9128
2026-03-26 22:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252Faef8571a7da34167917c344bb808ceb6%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/aef8571a7da34167917c344bb808ceb6/images/large/6.jpg not downloaded yet
2026-03-26 22:55:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aa/bd282df787894068b57da27c26960642/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aa/bd282df787894068b57da27c26960642/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aa/bd282df787894068b57da27c26960642/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252Faef8571a7da34167917c344bb808ceb6%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/aef8571a7da34167917c344bb808ceb6/images/large/7.jpg not downloaded yet
2026-03-26 22:55:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/77893398625a4ef7b60318e3ed55a9e9/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aa/bd282df787894068b57da27c26960642/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aa/bd282df787894068b57da27c26960642/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aa/bd282df787894068b57da27c26960642/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252Faef8571a7da34167917c344bb808ceb6%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/aef8571a7da34167917c344bb808ceb6/images/large/8.jpg not downloaded yet
2026-03-26 22:55:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/77893398625a4ef7b60318e3ed55a9e9/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252Faef8571a7da34167917c344bb808ceb6%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/aef8571a7da34167917c344bb808ceb6/images/large/9.jpg not downloaded yet
2026-03-26 22:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252Faef8571a7da34167917c344bb808ceb6%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/aef8571a7da34167917c344bb808ceb6/images/large/10.jpg not downloaded yet
2026-03-26 22:55:42 [ayvens.be] INFO: Found listing with ID: 1985590
2026-03-26 22:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985590%27 HTTP/1.1" 200 None
2026-03-26 22:55:42 [ayvens.be] INFO: Scrape type for 1985590: 1
2026-03-26 22:55:42 [ayvens.be] INFO: Extracting data for car ID: 1985590
2026-03-26 22:55:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ffc82ec7-e1b1-591a-80b6-4f56857b498c with identifier: 1985590
2026-03-26 22:55:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ffc82ec7-e1b1-591a-80b6-4f56857b498c with scrape type 1
2026-03-26 22:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ffc82ec7-e1b1-591a-80b6-4f56857b498c
2026-03-26 22:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F662183b82c204fe79815363badc1894e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/662183b82c204fe79815363badc1894e/images/large/1.jpg not downloaded yet
2026-03-26 22:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F662183b82c204fe79815363badc1894e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/662183b82c204fe79815363badc1894e/images/large/2.jpg not downloaded yet
2026-03-26 22:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F662183b82c204fe79815363badc1894e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/662183b82c204fe79815363badc1894e/images/large/3.jpg not downloaded yet
2026-03-26 22:55:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74cf210>
2026-03-26 22:55:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67ef6410-cbdb-5f79-bd50-4d8fb92361cc/67ef6410-cbdb-5f79-bd50-4d8fb92361cc_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252Fbd282df787894068b57da27c26960642%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/bd282df787894068b57da27c26960642/images/large/1.jpg saved to cache
2026-03-26 22:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 67ef6410-cbdb-5f79-bd50-4d8fb92361cc
2026-03-26 22:55:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b745a650>
2026-03-26 22:55:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67ef6410-cbdb-5f79-bd50-4d8fb92361cc/67ef6410-cbdb-5f79-bd50-4d8fb92361cc_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252Fbd282df787894068b57da27c26960642%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/bd282df787894068b57da27c26960642/images/large/6.jpg saved to cache
2026-03-26 22:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 67ef6410-cbdb-5f79-bd50-4d8fb92361cc
2026-03-26 22:55:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd12d1d0>
2026-03-26 22:55:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67ef6410-cbdb-5f79-bd50-4d8fb92361cc/67ef6410-cbdb-5f79-bd50-4d8fb92361cc_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252Fbd282df787894068b57da27c26960642%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/bd282df787894068b57da27c26960642/images/large/5.jpg saved to cache
2026-03-26 22:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 67ef6410-cbdb-5f79-bd50-4d8fb92361cc
2026-03-26 22:55:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7405850>
2026-03-26 22:55:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_040088e1-6085-591e-8249-b75a78ad9128/040088e1-6085-591e-8249-b75a78ad9128_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F77893398625a4ef7b60318e3ed55a9e9%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/77893398625a4ef7b60318e3ed55a9e9/images/large/9.jpg saved to cache
2026-03-26 22:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 040088e1-6085-591e-8249-b75a78ad9128
2026-03-26 22:55:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cc08d0>
2026-03-26 22:55:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67ef6410-cbdb-5f79-bd50-4d8fb92361cc/67ef6410-cbdb-5f79-bd50-4d8fb92361cc_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:55:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252Fbd282df787894068b57da27c26960642%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/bd282df787894068b57da27c26960642/images/large/2.jpg saved to cache
2026-03-26 22:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 67ef6410-cbdb-5f79-bd50-4d8fb92361cc
2026-03-26 22:55:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79ce510>
2026-03-26 22:55:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67ef6410-cbdb-5f79-bd50-4d8fb92361cc/67ef6410-cbdb-5f79-bd50-4d8fb92361cc_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:55:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252Fbd282df787894068b57da27c26960642%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/bd282df787894068b57da27c26960642/images/large/4.jpg saved to cache
2026-03-26 22:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 67ef6410-cbdb-5f79-bd50-4d8fb92361cc
2026-03-26 22:55:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7661d50>
2026-03-26 22:55:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67ef6410-cbdb-5f79-bd50-4d8fb92361cc/67ef6410-cbdb-5f79-bd50-4d8fb92361cc_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:55:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252Fbd282df787894068b57da27c26960642%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/bd282df787894068b57da27c26960642/images/large/3.jpg saved to cache
2026-03-26 22:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 67ef6410-cbdb-5f79-bd50-4d8fb92361cc
2026-03-26 22:55:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aa/bd282df787894068b57da27c26960642/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aa/bd282df787894068b57da27c26960642/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aa/bd282df787894068b57da27c26960642/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F662183b82c204fe79815363badc1894e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/662183b82c204fe79815363badc1894e/images/large/4.jpg not downloaded yet
2026-03-26 22:55:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79a7850>
2026-03-26 22:55:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_040088e1-6085-591e-8249-b75a78ad9128/040088e1-6085-591e-8249-b75a78ad9128_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:55:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F77893398625a4ef7b60318e3ed55a9e9%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/77893398625a4ef7b60318e3ed55a9e9/images/large/10.jpg saved to cache
2026-03-26 22:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 040088e1-6085-591e-8249-b75a78ad9128
2026-03-26 22:55:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 040088e1-6085-591e-8249-b75a78ad9128, skipping ID generation
2026-03-26 22:55:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 040088e1-6085-591e-8249-b75a78ad9128 with scrape type 1
2026-03-26 22:55:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 040088e1-6085-591e-8249-b75a78ad9128 sending to next pipeline
2026-03-26 22:55:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 040088e1-6085-591e-8249-b75a78ad9128, identifier: 1985587
2026-03-26 22:55:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aa/bd282df787894068b57da27c26960642/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 040088e1-6085-591e-8249-b75a78ad9128 with identifier: 1985587
2026-03-26 22:55:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 040088e1-6085-591e-8249-b75a78ad9128 with identifier: 1985587
2026-03-26 22:55:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 040088e1-6085-591e-8249-b75a78ad9128 with identifier: 1985587 to the API
2026-03-26 22:55:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:55:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:55:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bq/77893398625a4ef7b60318e3ed55a9e9/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.3L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '040088e1-6085-591e-8249-b75a78ad9128',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A-CLASS LIMOUSINE',
 'odometer': 48710,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 19,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_040088e1-6085-591e-8249-b75a78ad9128/040088e1-6085-591e-8249-b75a78ad9128_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 635696,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/77893398625a4ef7b60318e3ed55a9e9/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_040088e1-6085-591e-8249-b75a78ad9128/040088e1-6085-591e-8249-b75a78ad9128_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 666085,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/77893398625a4ef7b60318e3ed55a9e9/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_040088e1-6085-591e-8249-b75a78ad9128/040088e1-6085-591e-8249-b75a78ad9128_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 588601,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/77893398625a4ef7b60318e3ed55a9e9/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_040088e1-6085-591e-8249-b75a78ad9128/040088e1-6085-591e-8249-b75a78ad9128_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 688931,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/77893398625a4ef7b60318e3ed55a9e9/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_040088e1-6085-591e-8249-b75a78ad9128/040088e1-6085-591e-8249-b75a78ad9128_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 600970,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/77893398625a4ef7b60318e3ed55a9e9/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_040088e1-6085-591e-8249-b75a78ad9128/040088e1-6085-591e-8249-b75a78ad9128_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 616443,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/77893398625a4ef7b60318e3ed55a9e9/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_040088e1-6085-591e-8249-b75a78ad9128/040088e1-6085-591e-8249-b75a78ad9128_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 639805,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/77893398625a4ef7b60318e3ed55a9e9/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_040088e1-6085-591e-8249-b75a78ad9128/040088e1-6085-591e-8249-b75a78ad9128_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 631660,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/77893398625a4ef7b60318e3ed55a9e9/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_040088e1-6085-591e-8249-b75a78ad9128/040088e1-6085-591e-8249-b75a78ad9128_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 686355,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/77893398625a4ef7b60318e3ed55a9e9/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_040088e1-6085-591e-8249-b75a78ad9128/040088e1-6085-591e-8249-b75a78ad9128_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 679733,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/77893398625a4ef7b60318e3ed55a9e9/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ A-CLASS LIMOUSINE 1.3 A 250 E BUSINESS SOLUTION DCT',
 'transmission': 'automatic',
 'trim': '1.3 A 250 E BUSINESS SOLUTION DCT',
 'vin': None,
 'year': 2022}
2026-03-26 22:55:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985587%27 HTTP/1.1" 200 None
2026-03-26 22:55:43 [ayvens.be] INFO: Saving data for 1985587: {'created_time': 1774565743.934324, 'last_price_update_time': 1774565743.934334, 'auction_closing_time': 1774958400.0}
2026-03-26 22:55:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985587') HTTP/1.1" 204 0
2026-03-26 22:55:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F662183b82c204fe79815363badc1894e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/662183b82c204fe79815363badc1894e/images/large/5.jpg not downloaded yet
2026-03-26 22:55:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e3dd90>
2026-03-26 22:55:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67ef6410-cbdb-5f79-bd50-4d8fb92361cc/67ef6410-cbdb-5f79-bd50-4d8fb92361cc_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:55:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252Fbd282df787894068b57da27c26960642%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/bd282df787894068b57da27c26960642/images/large/8.jpg saved to cache
2026-03-26 22:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 67ef6410-cbdb-5f79-bd50-4d8fb92361cc
2026-03-26 22:55:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b792f4d0>
2026-03-26 22:55:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67ef6410-cbdb-5f79-bd50-4d8fb92361cc/67ef6410-cbdb-5f79-bd50-4d8fb92361cc_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:55:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252Fbd282df787894068b57da27c26960642%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/bd282df787894068b57da27c26960642/images/large/9.jpg saved to cache
2026-03-26 22:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 67ef6410-cbdb-5f79-bd50-4d8fb92361cc
2026-03-26 22:55:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b727bc90>
2026-03-26 22:55:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67ef6410-cbdb-5f79-bd50-4d8fb92361cc/67ef6410-cbdb-5f79-bd50-4d8fb92361cc_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:55:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252Fbd282df787894068b57da27c26960642%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/bd282df787894068b57da27c26960642/images/large/10.jpg saved to cache
2026-03-26 22:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 67ef6410-cbdb-5f79-bd50-4d8fb92361cc
2026-03-26 22:55:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ch/aef8571a7da34167917c344bb808ceb6/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F662183b82c204fe79815363badc1894e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/662183b82c204fe79815363badc1894e/images/large/6.jpg not downloaded yet
2026-03-26 22:55:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ch/aef8571a7da34167917c344bb808ceb6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b792df10>
2026-03-26 22:55:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67ef6410-cbdb-5f79-bd50-4d8fb92361cc/67ef6410-cbdb-5f79-bd50-4d8fb92361cc_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:55:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252Fbd282df787894068b57da27c26960642%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/bd282df787894068b57da27c26960642/images/large/7.jpg saved to cache
2026-03-26 22:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 67ef6410-cbdb-5f79-bd50-4d8fb92361cc
2026-03-26 22:55:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 67ef6410-cbdb-5f79-bd50-4d8fb92361cc, skipping ID generation
2026-03-26 22:55:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67ef6410-cbdb-5f79-bd50-4d8fb92361cc with scrape type 1
2026-03-26 22:55:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 67ef6410-cbdb-5f79-bd50-4d8fb92361cc sending to next pipeline
2026-03-26 22:55:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 67ef6410-cbdb-5f79-bd50-4d8fb92361cc, identifier: 1985588
2026-03-26 22:55:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F662183b82c204fe79815363badc1894e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/662183b82c204fe79815363badc1894e/images/large/7.jpg not downloaded yet
2026-03-26 22:55:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 67ef6410-cbdb-5f79-bd50-4d8fb92361cc with identifier: 1985588
2026-03-26 22:55:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 67ef6410-cbdb-5f79-bd50-4d8fb92361cc with identifier: 1985588
2026-03-26 22:55:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 67ef6410-cbdb-5f79-bd50-4d8fb92361cc with identifier: 1985588 to the API
2026-03-26 22:55:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:55:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:55:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2aa/bd282df787894068b57da27c26960642/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'electric',
 'id': '67ef6410-cbdb-5f79-bd50-4d8fb92361cc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'Kangoo',
 'odometer': 20688,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67ef6410-cbdb-5f79-bd50-4d8fb92361cc/67ef6410-cbdb-5f79-bd50-4d8fb92361cc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 381521,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aa/bd282df787894068b57da27c26960642/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67ef6410-cbdb-5f79-bd50-4d8fb92361cc/67ef6410-cbdb-5f79-bd50-4d8fb92361cc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 445794,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aa/bd282df787894068b57da27c26960642/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67ef6410-cbdb-5f79-bd50-4d8fb92361cc/67ef6410-cbdb-5f79-bd50-4d8fb92361cc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 406893,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aa/bd282df787894068b57da27c26960642/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67ef6410-cbdb-5f79-bd50-4d8fb92361cc/67ef6410-cbdb-5f79-bd50-4d8fb92361cc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 415250,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aa/bd282df787894068b57da27c26960642/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67ef6410-cbdb-5f79-bd50-4d8fb92361cc/67ef6410-cbdb-5f79-bd50-4d8fb92361cc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 323091,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aa/bd282df787894068b57da27c26960642/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67ef6410-cbdb-5f79-bd50-4d8fb92361cc/67ef6410-cbdb-5f79-bd50-4d8fb92361cc_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 290050,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aa/bd282df787894068b57da27c26960642/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67ef6410-cbdb-5f79-bd50-4d8fb92361cc/67ef6410-cbdb-5f79-bd50-4d8fb92361cc_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 336587,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aa/bd282df787894068b57da27c26960642/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67ef6410-cbdb-5f79-bd50-4d8fb92361cc/67ef6410-cbdb-5f79-bd50-4d8fb92361cc_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 359238,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aa/bd282df787894068b57da27c26960642/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67ef6410-cbdb-5f79-bd50-4d8fb92361cc/67ef6410-cbdb-5f79-bd50-4d8fb92361cc_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 266252,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aa/bd282df787894068b57da27c26960642/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67ef6410-cbdb-5f79-bd50-4d8fb92361cc/67ef6410-cbdb-5f79-bd50-4d8fb92361cc_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109377,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aa/bd282df787894068b57da27c26960642/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT Kangoo BEV 33KWH MAXI Z.E. B-BUY 5-SEATS',
 'transmission': 'automatic',
 'trim': 'BEV 33KWH MAXI Z.E. B-BUY 5-SEATS',
 'vin': None,
 'year': 2021}
2026-03-26 22:55:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985588%27 HTTP/1.1" 200 None
2026-03-26 22:55:44 [ayvens.be] INFO: Saving data for 1985588: {'created_time': 1774565744.719439, 'last_price_update_time': 1774565744.719448, 'auction_closing_time': 1774958400.0}
2026-03-26 22:55:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985588') HTTP/1.1" 204 0
2026-03-26 22:55:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ch/aef8571a7da34167917c344bb808ceb6/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F662183b82c204fe79815363badc1894e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/662183b82c204fe79815363badc1894e/images/large/8.jpg not downloaded yet
2026-03-26 22:55:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e3fe50>
2026-03-26 22:55:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14f2b002-b2a6-542d-8ece-7cf9f9bede1d/14f2b002-b2a6-542d-8ece-7cf9f9bede1d_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:55:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252Faef8571a7da34167917c344bb808ceb6%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/aef8571a7da34167917c344bb808ceb6/images/large/4.jpg saved to cache
2026-03-26 22:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 14f2b002-b2a6-542d-8ece-7cf9f9bede1d
2026-03-26 22:55:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7aa2e10>
2026-03-26 22:55:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14f2b002-b2a6-542d-8ece-7cf9f9bede1d/14f2b002-b2a6-542d-8ece-7cf9f9bede1d_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:55:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252Faef8571a7da34167917c344bb808ceb6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/aef8571a7da34167917c344bb808ceb6/images/large/1.jpg saved to cache
2026-03-26 22:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 14f2b002-b2a6-542d-8ece-7cf9f9bede1d
2026-03-26 22:55:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ch/aef8571a7da34167917c344bb808ceb6/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F662183b82c204fe79815363badc1894e%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/662183b82c204fe79815363badc1894e/images/large/9.jpg not downloaded yet
2026-03-26 22:55:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ch/aef8571a7da34167917c344bb808ceb6/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F662183b82c204fe79815363badc1894e%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/662183b82c204fe79815363badc1894e/images/large/10.jpg not downloaded yet
2026-03-26 22:55:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ch/aef8571a7da34167917c344bb808ceb6/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b787f190>
2026-03-26 22:55:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14f2b002-b2a6-542d-8ece-7cf9f9bede1d/14f2b002-b2a6-542d-8ece-7cf9f9bede1d_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252Faef8571a7da34167917c344bb808ceb6%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/aef8571a7da34167917c344bb808ceb6/images/large/2.jpg saved to cache
2026-03-26 22:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 14f2b002-b2a6-542d-8ece-7cf9f9bede1d
2026-03-26 22:55:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ch/aef8571a7da34167917c344bb808ceb6/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:45 [ayvens.be] INFO: Found listing with ID: 1985591
2026-03-26 22:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985591%27 HTTP/1.1" 200 None
2026-03-26 22:55:45 [ayvens.be] INFO: Scrape type for 1985591: 1
2026-03-26 22:55:45 [ayvens.be] INFO: Extracting data for car ID: 1985591
2026-03-26 22:55:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 807845ce-938b-5149-aef8-3b7658af3e71 with identifier: 1985591
2026-03-26 22:55:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 807845ce-938b-5149-aef8-3b7658af3e71 with scrape type 1
2026-03-26 22:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 807845ce-938b-5149-aef8-3b7658af3e71
2026-03-26 22:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fee73c68ab1e847a9b2dd1a81576822e9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/ee73c68ab1e847a9b2dd1a81576822e9/images/large/1.jpg not downloaded yet
2026-03-26 22:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fee73c68ab1e847a9b2dd1a81576822e9%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/ee73c68ab1e847a9b2dd1a81576822e9/images/large/2.jpg not downloaded yet
2026-03-26 22:55:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ch/aef8571a7da34167917c344bb808ceb6/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fee73c68ab1e847a9b2dd1a81576822e9%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/ee73c68ab1e847a9b2dd1a81576822e9/images/large/3.jpg not downloaded yet
2026-03-26 22:55:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7aa2f50>
2026-03-26 22:55:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14f2b002-b2a6-542d-8ece-7cf9f9bede1d/14f2b002-b2a6-542d-8ece-7cf9f9bede1d_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252Faef8571a7da34167917c344bb808ceb6%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/aef8571a7da34167917c344bb808ceb6/images/large/3.jpg saved to cache
2026-03-26 22:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 14f2b002-b2a6-542d-8ece-7cf9f9bede1d
2026-03-26 22:55:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b34cd0>
2026-03-26 22:55:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14f2b002-b2a6-542d-8ece-7cf9f9bede1d/14f2b002-b2a6-542d-8ece-7cf9f9bede1d_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252Faef8571a7da34167917c344bb808ceb6%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/aef8571a7da34167917c344bb808ceb6/images/large/5.jpg saved to cache
2026-03-26 22:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 14f2b002-b2a6-542d-8ece-7cf9f9bede1d
2026-03-26 22:55:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76a5e50>
2026-03-26 22:55:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14f2b002-b2a6-542d-8ece-7cf9f9bede1d/14f2b002-b2a6-542d-8ece-7cf9f9bede1d_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252Faef8571a7da34167917c344bb808ceb6%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/aef8571a7da34167917c344bb808ceb6/images/large/7.jpg saved to cache
2026-03-26 22:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 14f2b002-b2a6-542d-8ece-7cf9f9bede1d
2026-03-26 22:55:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ch/aef8571a7da34167917c344bb808ceb6/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ch/aef8571a7da34167917c344bb808ceb6/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fee73c68ab1e847a9b2dd1a81576822e9%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/ee73c68ab1e847a9b2dd1a81576822e9/images/large/4.jpg not downloaded yet
2026-03-26 22:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fee73c68ab1e847a9b2dd1a81576822e9%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/ee73c68ab1e847a9b2dd1a81576822e9/images/large/5.jpg not downloaded yet
2026-03-26 22:55:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/662183b82c204fe79815363badc1894e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd46d850>
2026-03-26 22:55:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14f2b002-b2a6-542d-8ece-7cf9f9bede1d/14f2b002-b2a6-542d-8ece-7cf9f9bede1d_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252Faef8571a7da34167917c344bb808ceb6%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/aef8571a7da34167917c344bb808ceb6/images/large/6.jpg saved to cache
2026-03-26 22:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 14f2b002-b2a6-542d-8ece-7cf9f9bede1d
2026-03-26 22:55:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b727afd0>
2026-03-26 22:55:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14f2b002-b2a6-542d-8ece-7cf9f9bede1d/14f2b002-b2a6-542d-8ece-7cf9f9bede1d_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252Faef8571a7da34167917c344bb808ceb6%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/aef8571a7da34167917c344bb808ceb6/images/large/8.jpg saved to cache
2026-03-26 22:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 14f2b002-b2a6-542d-8ece-7cf9f9bede1d
2026-03-26 22:55:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/662183b82c204fe79815363badc1894e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fee73c68ab1e847a9b2dd1a81576822e9%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/ee73c68ab1e847a9b2dd1a81576822e9/images/large/6.jpg not downloaded yet
2026-03-26 22:55:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/662183b82c204fe79815363badc1894e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fee73c68ab1e847a9b2dd1a81576822e9%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/ee73c68ab1e847a9b2dd1a81576822e9/images/large/7.jpg not downloaded yet
2026-03-26 22:55:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/662183b82c204fe79815363badc1894e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fee73c68ab1e847a9b2dd1a81576822e9%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/ee73c68ab1e847a9b2dd1a81576822e9/images/large/8.jpg not downloaded yet
2026-03-26 22:55:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd496d90>
2026-03-26 22:55:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14f2b002-b2a6-542d-8ece-7cf9f9bede1d/14f2b002-b2a6-542d-8ece-7cf9f9bede1d_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252Faef8571a7da34167917c344bb808ceb6%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/aef8571a7da34167917c344bb808ceb6/images/large/9.jpg saved to cache
2026-03-26 22:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 14f2b002-b2a6-542d-8ece-7cf9f9bede1d
2026-03-26 22:55:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76c4fd0>
2026-03-26 22:55:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14f2b002-b2a6-542d-8ece-7cf9f9bede1d/14f2b002-b2a6-542d-8ece-7cf9f9bede1d_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252Faef8571a7da34167917c344bb808ceb6%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/aef8571a7da34167917c344bb808ceb6/images/large/10.jpg saved to cache
2026-03-26 22:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 14f2b002-b2a6-542d-8ece-7cf9f9bede1d
2026-03-26 22:55:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 14f2b002-b2a6-542d-8ece-7cf9f9bede1d, skipping ID generation
2026-03-26 22:55:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14f2b002-b2a6-542d-8ece-7cf9f9bede1d with scrape type 1
2026-03-26 22:55:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 14f2b002-b2a6-542d-8ece-7cf9f9bede1d sending to next pipeline
2026-03-26 22:55:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 14f2b002-b2a6-542d-8ece-7cf9f9bede1d, identifier: 1985589
2026-03-26 22:55:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd26f5d0>
2026-03-26 22:55:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffc82ec7-e1b1-591a-80b6-4f56857b498c/ffc82ec7-e1b1-591a-80b6-4f56857b498c_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F662183b82c204fe79815363badc1894e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/662183b82c204fe79815363badc1894e/images/large/1.jpg saved to cache
2026-03-26 22:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ffc82ec7-e1b1-591a-80b6-4f56857b498c
2026-03-26 22:55:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/662183b82c204fe79815363badc1894e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 14f2b002-b2a6-542d-8ece-7cf9f9bede1d with identifier: 1985589
2026-03-26 22:55:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 14f2b002-b2a6-542d-8ece-7cf9f9bede1d with identifier: 1985589
2026-03-26 22:55:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 14f2b002-b2a6-542d-8ece-7cf9f9bede1d with identifier: 1985589 to the API
2026-03-26 22:55:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:55:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:55:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ch/aef8571a7da34167917c344bb808ceb6/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '14f2b002-b2a6-542d-8ece-7cf9f9bede1d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC60',
 'odometer': 179692,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 20,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14f2b002-b2a6-542d-8ece-7cf9f9bede1d/14f2b002-b2a6-542d-8ece-7cf9f9bede1d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 640866,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ch/aef8571a7da34167917c344bb808ceb6/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14f2b002-b2a6-542d-8ece-7cf9f9bede1d/14f2b002-b2a6-542d-8ece-7cf9f9bede1d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 613332,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ch/aef8571a7da34167917c344bb808ceb6/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14f2b002-b2a6-542d-8ece-7cf9f9bede1d/14f2b002-b2a6-542d-8ece-7cf9f9bede1d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 618919,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ch/aef8571a7da34167917c344bb808ceb6/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14f2b002-b2a6-542d-8ece-7cf9f9bede1d/14f2b002-b2a6-542d-8ece-7cf9f9bede1d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 587813,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ch/aef8571a7da34167917c344bb808ceb6/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14f2b002-b2a6-542d-8ece-7cf9f9bede1d/14f2b002-b2a6-542d-8ece-7cf9f9bede1d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 650794,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ch/aef8571a7da34167917c344bb808ceb6/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14f2b002-b2a6-542d-8ece-7cf9f9bede1d/14f2b002-b2a6-542d-8ece-7cf9f9bede1d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 736092,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ch/aef8571a7da34167917c344bb808ceb6/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14f2b002-b2a6-542d-8ece-7cf9f9bede1d/14f2b002-b2a6-542d-8ece-7cf9f9bede1d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 670032,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ch/aef8571a7da34167917c344bb808ceb6/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14f2b002-b2a6-542d-8ece-7cf9f9bede1d/14f2b002-b2a6-542d-8ece-7cf9f9bede1d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 788388,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ch/aef8571a7da34167917c344bb808ceb6/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14f2b002-b2a6-542d-8ece-7cf9f9bede1d/14f2b002-b2a6-542d-8ece-7cf9f9bede1d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 796263,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ch/aef8571a7da34167917c344bb808ceb6/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14f2b002-b2a6-542d-8ece-7cf9f9bede1d/14f2b002-b2a6-542d-8ece-7cf9f9bede1d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 822239,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ch/aef8571a7da34167917c344bb808ceb6/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC60 2.0 B4 D MHEV ULTIMATE BRIGHT AUTO',
 'transmission': 'automatic',
 'trim': '2.0 B4 D MHEV ULTIMATE BRIGHT AUTO',
 'vin': None,
 'year': 2022}
2026-03-26 22:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985589%27 HTTP/1.1" 200 None
2026-03-26 22:55:46 [ayvens.be] INFO: Saving data for 1985589: {'created_time': 1774565746.538705, 'last_price_update_time': 1774565746.538716, 'auction_closing_time': 1774958400.0}
2026-03-26 22:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985589') HTTP/1.1" 204 0
2026-03-26 22:55:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/662183b82c204fe79815363badc1894e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fee73c68ab1e847a9b2dd1a81576822e9%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/ee73c68ab1e847a9b2dd1a81576822e9/images/large/9.jpg not downloaded yet
2026-03-26 22:55:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e3e4d0>
2026-03-26 22:55:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffc82ec7-e1b1-591a-80b6-4f56857b498c/ffc82ec7-e1b1-591a-80b6-4f56857b498c_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F662183b82c204fe79815363badc1894e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/662183b82c204fe79815363badc1894e/images/large/2.jpg saved to cache
2026-03-26 22:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ffc82ec7-e1b1-591a-80b6-4f56857b498c
2026-03-26 22:55:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/662183b82c204fe79815363badc1894e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/662183b82c204fe79815363badc1894e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fee73c68ab1e847a9b2dd1a81576822e9%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/ee73c68ab1e847a9b2dd1a81576822e9/images/large/10.jpg not downloaded yet
2026-03-26 22:55:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/662183b82c204fe79815363badc1894e/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80cad3d850>
2026-03-26 22:55:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffc82ec7-e1b1-591a-80b6-4f56857b498c/ffc82ec7-e1b1-591a-80b6-4f56857b498c_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F662183b82c204fe79815363badc1894e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/662183b82c204fe79815363badc1894e/images/large/5.jpg saved to cache
2026-03-26 22:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ffc82ec7-e1b1-591a-80b6-4f56857b498c
2026-03-26 22:55:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7434f90>
2026-03-26 22:55:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffc82ec7-e1b1-591a-80b6-4f56857b498c/ffc82ec7-e1b1-591a-80b6-4f56857b498c_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F662183b82c204fe79815363badc1894e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/662183b82c204fe79815363badc1894e/images/large/3.jpg saved to cache
2026-03-26 22:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ffc82ec7-e1b1-591a-80b6-4f56857b498c
2026-03-26 22:55:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79fa2d0>
2026-03-26 22:55:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffc82ec7-e1b1-591a-80b6-4f56857b498c/ffc82ec7-e1b1-591a-80b6-4f56857b498c_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F662183b82c204fe79815363badc1894e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/662183b82c204fe79815363badc1894e/images/large/4.jpg saved to cache
2026-03-26 22:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ffc82ec7-e1b1-591a-80b6-4f56857b498c
2026-03-26 22:55:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76a4f90>
2026-03-26 22:55:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffc82ec7-e1b1-591a-80b6-4f56857b498c/ffc82ec7-e1b1-591a-80b6-4f56857b498c_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F662183b82c204fe79815363badc1894e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/662183b82c204fe79815363badc1894e/images/large/6.jpg saved to cache
2026-03-26 22:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ffc82ec7-e1b1-591a-80b6-4f56857b498c
2026-03-26 22:55:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/662183b82c204fe79815363badc1894e/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:47 [ayvens.be] INFO: Found listing with ID: 1985592
2026-03-26 22:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985592%27 HTTP/1.1" 200 None
2026-03-26 22:55:47 [ayvens.be] INFO: Scrape type for 1985592: 1
2026-03-26 22:55:47 [ayvens.be] INFO: Extracting data for car ID: 1985592
2026-03-26 22:55:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b8c7c7c-c02d-5ba0-acb4-cd5073322417 with identifier: 1985592
2026-03-26 22:55:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b8c7c7c-c02d-5ba0-acb4-cd5073322417 with scrape type 1
2026-03-26 22:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1b8c7c7c-c02d-5ba0-acb4-cd5073322417
2026-03-26 22:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F107605a40f6643658710b4777212141d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/107605a40f6643658710b4777212141d/images/large/1.jpg not downloaded yet
2026-03-26 22:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F107605a40f6643658710b4777212141d%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/107605a40f6643658710b4777212141d/images/large/2.jpg not downloaded yet
2026-03-26 22:55:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7403d90>
2026-03-26 22:55:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffc82ec7-e1b1-591a-80b6-4f56857b498c/ffc82ec7-e1b1-591a-80b6-4f56857b498c_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F662183b82c204fe79815363badc1894e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/662183b82c204fe79815363badc1894e/images/large/7.jpg saved to cache
2026-03-26 22:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ffc82ec7-e1b1-591a-80b6-4f56857b498c
2026-03-26 22:55:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74bdd50>
2026-03-26 22:55:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffc82ec7-e1b1-591a-80b6-4f56857b498c/ffc82ec7-e1b1-591a-80b6-4f56857b498c_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F662183b82c204fe79815363badc1894e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/662183b82c204fe79815363badc1894e/images/large/8.jpg saved to cache
2026-03-26 22:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ffc82ec7-e1b1-591a-80b6-4f56857b498c
2026-03-26 22:55:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b8bc10>
2026-03-26 22:55:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffc82ec7-e1b1-591a-80b6-4f56857b498c/ffc82ec7-e1b1-591a-80b6-4f56857b498c_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F662183b82c204fe79815363badc1894e%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/662183b82c204fe79815363badc1894e/images/large/9.jpg saved to cache
2026-03-26 22:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ffc82ec7-e1b1-591a-80b6-4f56857b498c
2026-03-26 22:55:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/ee73c68ab1e847a9b2dd1a81576822e9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F107605a40f6643658710b4777212141d%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/107605a40f6643658710b4777212141d/images/large/3.jpg not downloaded yet
2026-03-26 22:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F107605a40f6643658710b4777212141d%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/107605a40f6643658710b4777212141d/images/large/4.jpg not downloaded yet
2026-03-26 22:55:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/ee73c68ab1e847a9b2dd1a81576822e9/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b746cc10>
2026-03-26 22:55:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffc82ec7-e1b1-591a-80b6-4f56857b498c/ffc82ec7-e1b1-591a-80b6-4f56857b498c_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F662183b82c204fe79815363badc1894e%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/662183b82c204fe79815363badc1894e/images/large/10.jpg saved to cache
2026-03-26 22:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ffc82ec7-e1b1-591a-80b6-4f56857b498c
2026-03-26 22:55:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ffc82ec7-e1b1-591a-80b6-4f56857b498c, skipping ID generation
2026-03-26 22:55:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ffc82ec7-e1b1-591a-80b6-4f56857b498c with scrape type 1
2026-03-26 22:55:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ffc82ec7-e1b1-591a-80b6-4f56857b498c sending to next pipeline
2026-03-26 22:55:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: ffc82ec7-e1b1-591a-80b6-4f56857b498c, identifier: 1985590
2026-03-26 22:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F107605a40f6643658710b4777212141d%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/107605a40f6643658710b4777212141d/images/large/5.jpg not downloaded yet
2026-03-26 22:55:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: ffc82ec7-e1b1-591a-80b6-4f56857b498c with identifier: 1985590
2026-03-26 22:55:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: ffc82ec7-e1b1-591a-80b6-4f56857b498c with identifier: 1985590
2026-03-26 22:55:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: ffc82ec7-e1b1-591a-80b6-4f56857b498c with identifier: 1985590 to the API
2026-03-26 22:55:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:55:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:55:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bq/662183b82c204fe79815363badc1894e/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'ffc82ec7-e1b1-591a-80b6-4f56857b498c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'PASSAT VARIANT GTE - 2020',
 'odometer': 149760,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffc82ec7-e1b1-591a-80b6-4f56857b498c/ffc82ec7-e1b1-591a-80b6-4f56857b498c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 572941,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/662183b82c204fe79815363badc1894e/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffc82ec7-e1b1-591a-80b6-4f56857b498c/ffc82ec7-e1b1-591a-80b6-4f56857b498c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 613209,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/662183b82c204fe79815363badc1894e/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffc82ec7-e1b1-591a-80b6-4f56857b498c/ffc82ec7-e1b1-591a-80b6-4f56857b498c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 569267,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/662183b82c204fe79815363badc1894e/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffc82ec7-e1b1-591a-80b6-4f56857b498c/ffc82ec7-e1b1-591a-80b6-4f56857b498c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 607932,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/662183b82c204fe79815363badc1894e/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffc82ec7-e1b1-591a-80b6-4f56857b498c/ffc82ec7-e1b1-591a-80b6-4f56857b498c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 375268,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/662183b82c204fe79815363badc1894e/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffc82ec7-e1b1-591a-80b6-4f56857b498c/ffc82ec7-e1b1-591a-80b6-4f56857b498c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 368956,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/662183b82c204fe79815363badc1894e/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffc82ec7-e1b1-591a-80b6-4f56857b498c/ffc82ec7-e1b1-591a-80b6-4f56857b498c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 458262,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/662183b82c204fe79815363badc1894e/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffc82ec7-e1b1-591a-80b6-4f56857b498c/ffc82ec7-e1b1-591a-80b6-4f56857b498c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 471646,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/662183b82c204fe79815363badc1894e/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffc82ec7-e1b1-591a-80b6-4f56857b498c/ffc82ec7-e1b1-591a-80b6-4f56857b498c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 355113,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/662183b82c204fe79815363badc1894e/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffc82ec7-e1b1-591a-80b6-4f56857b498c/ffc82ec7-e1b1-591a-80b6-4f56857b498c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 409929,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/662183b82c204fe79815363badc1894e/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN PASSAT VARIANT GTE - 2020 1.4 TSI PHEV GTE Business DSG',
 'transmission': 'automatic',
 'trim': '1.4 TSI PHEV GTE Business DSG',
 'vin': None,
 'year': 2022}
2026-03-26 22:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985590%27 HTTP/1.1" 200 None
2026-03-26 22:55:48 [ayvens.be] INFO: Saving data for 1985590: {'created_time': 1774565748.015801, 'last_price_update_time': 1774565748.015812, 'auction_closing_time': 1774958400.0}
2026-03-26 22:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985590') HTTP/1.1" 204 0
2026-03-26 22:55:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/ee73c68ab1e847a9b2dd1a81576822e9/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F107605a40f6643658710b4777212141d%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/107605a40f6643658710b4777212141d/images/large/6.jpg not downloaded yet
2026-03-26 22:55:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/ee73c68ab1e847a9b2dd1a81576822e9/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7406d90>
2026-03-26 22:55:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_807845ce-938b-5149-aef8-3b7658af3e71/807845ce-938b-5149-aef8-3b7658af3e71_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fee73c68ab1e847a9b2dd1a81576822e9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/ee73c68ab1e847a9b2dd1a81576822e9/images/large/1.jpg saved to cache
2026-03-26 22:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 807845ce-938b-5149-aef8-3b7658af3e71
2026-03-26 22:55:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77ae590>
2026-03-26 22:55:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_807845ce-938b-5149-aef8-3b7658af3e71/807845ce-938b-5149-aef8-3b7658af3e71_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fee73c68ab1e847a9b2dd1a81576822e9%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/ee73c68ab1e847a9b2dd1a81576822e9/images/large/2.jpg saved to cache
2026-03-26 22:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 807845ce-938b-5149-aef8-3b7658af3e71
2026-03-26 22:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F107605a40f6643658710b4777212141d%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/107605a40f6643658710b4777212141d/images/large/7.jpg not downloaded yet
2026-03-26 22:55:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/ee73c68ab1e847a9b2dd1a81576822e9/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/ee73c68ab1e847a9b2dd1a81576822e9/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/ee73c68ab1e847a9b2dd1a81576822e9/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/ee73c68ab1e847a9b2dd1a81576822e9/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F107605a40f6643658710b4777212141d%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/107605a40f6643658710b4777212141d/images/large/8.jpg not downloaded yet
2026-03-26 22:55:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6da5750>
2026-03-26 22:55:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_807845ce-938b-5149-aef8-3b7658af3e71/807845ce-938b-5149-aef8-3b7658af3e71_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fee73c68ab1e847a9b2dd1a81576822e9%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/ee73c68ab1e847a9b2dd1a81576822e9/images/large/3.jpg saved to cache
2026-03-26 22:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 807845ce-938b-5149-aef8-3b7658af3e71
2026-03-26 22:55:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b75a7bd0>
2026-03-26 22:55:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_807845ce-938b-5149-aef8-3b7658af3e71/807845ce-938b-5149-aef8-3b7658af3e71_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fee73c68ab1e847a9b2dd1a81576822e9%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/ee73c68ab1e847a9b2dd1a81576822e9/images/large/4.jpg saved to cache
2026-03-26 22:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 807845ce-938b-5149-aef8-3b7658af3e71
2026-03-26 22:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F107605a40f6643658710b4777212141d%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/107605a40f6643658710b4777212141d/images/large/9.jpg not downloaded yet
2026-03-26 22:55:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/ee73c68ab1e847a9b2dd1a81576822e9/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F107605a40f6643658710b4777212141d%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/107605a40f6643658710b4777212141d/images/large/10.jpg not downloaded yet
2026-03-26 22:55:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/ee73c68ab1e847a9b2dd1a81576822e9/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b88390>
2026-03-26 22:55:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_807845ce-938b-5149-aef8-3b7658af3e71/807845ce-938b-5149-aef8-3b7658af3e71_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fee73c68ab1e847a9b2dd1a81576822e9%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/ee73c68ab1e847a9b2dd1a81576822e9/images/large/5.jpg saved to cache
2026-03-26 22:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 807845ce-938b-5149-aef8-3b7658af3e71
2026-03-26 22:55:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76eebd0>
2026-03-26 22:55:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_807845ce-938b-5149-aef8-3b7658af3e71/807845ce-938b-5149-aef8-3b7658af3e71_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fee73c68ab1e847a9b2dd1a81576822e9%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/ee73c68ab1e847a9b2dd1a81576822e9/images/large/6.jpg saved to cache
2026-03-26 22:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 807845ce-938b-5149-aef8-3b7658af3e71
2026-03-26 22:55:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79f9b10>
2026-03-26 22:55:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_807845ce-938b-5149-aef8-3b7658af3e71/807845ce-938b-5149-aef8-3b7658af3e71_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fee73c68ab1e847a9b2dd1a81576822e9%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/ee73c68ab1e847a9b2dd1a81576822e9/images/large/7.jpg saved to cache
2026-03-26 22:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 807845ce-938b-5149-aef8-3b7658af3e71
2026-03-26 22:55:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79f9150>
2026-03-26 22:55:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_807845ce-938b-5149-aef8-3b7658af3e71/807845ce-938b-5149-aef8-3b7658af3e71_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fee73c68ab1e847a9b2dd1a81576822e9%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/ee73c68ab1e847a9b2dd1a81576822e9/images/large/8.jpg saved to cache
2026-03-26 22:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 807845ce-938b-5149-aef8-3b7658af3e71
2026-03-26 22:55:48 [ayvens.be] INFO: Found listing with ID: 1985593
2026-03-26 22:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985593%27 HTTP/1.1" 200 None
2026-03-26 22:55:48 [ayvens.be] INFO: Scrape type for 1985593: 1
2026-03-26 22:55:48 [ayvens.be] INFO: Extracting data for car ID: 1985593
2026-03-26 22:55:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af974b1e-bc76-523e-80e0-698c29fe183c with identifier: 1985593
2026-03-26 22:55:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af974b1e-bc76-523e-80e0-698c29fe183c with scrape type 1
2026-03-26 22:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item af974b1e-bc76-523e-80e0-698c29fe183c
2026-03-26 22:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F87c4d7517d06418190db4b45ae7ea59b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/87c4d7517d06418190db4b45ae7ea59b/images/large/1.jpg not downloaded yet
2026-03-26 22:55:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/107605a40f6643658710b4777212141d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F87c4d7517d06418190db4b45ae7ea59b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/87c4d7517d06418190db4b45ae7ea59b/images/large/2.jpg not downloaded yet
2026-03-26 22:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F87c4d7517d06418190db4b45ae7ea59b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/87c4d7517d06418190db4b45ae7ea59b/images/large/3.jpg not downloaded yet
2026-03-26 22:55:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6dec850>
2026-03-26 22:55:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_807845ce-938b-5149-aef8-3b7658af3e71/807845ce-938b-5149-aef8-3b7658af3e71_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:55:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fee73c68ab1e847a9b2dd1a81576822e9%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/ee73c68ab1e847a9b2dd1a81576822e9/images/large/9.jpg saved to cache
2026-03-26 22:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 807845ce-938b-5149-aef8-3b7658af3e71
2026-03-26 22:55:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6da7910>
2026-03-26 22:55:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_807845ce-938b-5149-aef8-3b7658af3e71/807845ce-938b-5149-aef8-3b7658af3e71_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:55:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fee73c68ab1e847a9b2dd1a81576822e9%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/ee73c68ab1e847a9b2dd1a81576822e9/images/large/10.jpg saved to cache
2026-03-26 22:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 807845ce-938b-5149-aef8-3b7658af3e71
2026-03-26 22:55:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 807845ce-938b-5149-aef8-3b7658af3e71, skipping ID generation
2026-03-26 22:55:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 807845ce-938b-5149-aef8-3b7658af3e71 with scrape type 1
2026-03-26 22:55:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 807845ce-938b-5149-aef8-3b7658af3e71 sending to next pipeline
2026-03-26 22:55:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 807845ce-938b-5149-aef8-3b7658af3e71, identifier: 1985591
2026-03-26 22:55:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/107605a40f6643658710b4777212141d/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 807845ce-938b-5149-aef8-3b7658af3e71 with identifier: 1985591
2026-03-26 22:55:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 807845ce-938b-5149-aef8-3b7658af3e71 with identifier: 1985591
2026-03-26 22:55:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 807845ce-938b-5149-aef8-3b7658af3e71 with identifier: 1985591 to the API
2026-03-26 22:55:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:55:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:55:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bl/ee73c68ab1e847a9b2dd1a81576822e9/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '807845ce-938b-5149-aef8-3b7658af3e71',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'KUGA',
 'odometer': 74611,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_807845ce-938b-5149-aef8-3b7658af3e71/807845ce-938b-5149-aef8-3b7658af3e71_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 647669,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/ee73c68ab1e847a9b2dd1a81576822e9/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_807845ce-938b-5149-aef8-3b7658af3e71/807845ce-938b-5149-aef8-3b7658af3e71_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 659653,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/ee73c68ab1e847a9b2dd1a81576822e9/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_807845ce-938b-5149-aef8-3b7658af3e71/807845ce-938b-5149-aef8-3b7658af3e71_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 554663,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/ee73c68ab1e847a9b2dd1a81576822e9/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_807845ce-938b-5149-aef8-3b7658af3e71/807845ce-938b-5149-aef8-3b7658af3e71_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 667438,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/ee73c68ab1e847a9b2dd1a81576822e9/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_807845ce-938b-5149-aef8-3b7658af3e71/807845ce-938b-5149-aef8-3b7658af3e71_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 595435,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/ee73c68ab1e847a9b2dd1a81576822e9/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_807845ce-938b-5149-aef8-3b7658af3e71/807845ce-938b-5149-aef8-3b7658af3e71_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 653122,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/ee73c68ab1e847a9b2dd1a81576822e9/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_807845ce-938b-5149-aef8-3b7658af3e71/807845ce-938b-5149-aef8-3b7658af3e71_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 664782,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/ee73c68ab1e847a9b2dd1a81576822e9/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_807845ce-938b-5149-aef8-3b7658af3e71/807845ce-938b-5149-aef8-3b7658af3e71_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 685738,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/ee73c68ab1e847a9b2dd1a81576822e9/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_807845ce-938b-5149-aef8-3b7658af3e71/807845ce-938b-5149-aef8-3b7658af3e71_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 527857,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/ee73c68ab1e847a9b2dd1a81576822e9/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_807845ce-938b-5149-aef8-3b7658af3e71/807845ce-938b-5149-aef8-3b7658af3e71_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 613727,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/ee73c68ab1e847a9b2dd1a81576822e9/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD KUGA 2.5I PHEV 165KW TITANIUM AUTO',
 'transmission': 'automatic',
 'trim': '2.5I PHEV 165KW TITANIUM AUTO',
 'vin': None,
 'year': 2022}
2026-03-26 22:55:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985591%27 HTTP/1.1" 200 None
2026-03-26 22:55:49 [ayvens.be] INFO: Saving data for 1985591: {'created_time': 1774565749.594941, 'last_price_update_time': 1774565749.594952, 'auction_closing_time': 1774958400.0}
2026-03-26 22:55:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985591') HTTP/1.1" 204 0
2026-03-26 22:55:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F87c4d7517d06418190db4b45ae7ea59b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/87c4d7517d06418190db4b45ae7ea59b/images/large/4.jpg not downloaded yet
2026-03-26 22:55:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F87c4d7517d06418190db4b45ae7ea59b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/87c4d7517d06418190db4b45ae7ea59b/images/large/5.jpg not downloaded yet
2026-03-26 22:55:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/107605a40f6643658710b4777212141d/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/107605a40f6643658710b4777212141d/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7416a90>
2026-03-26 22:55:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b8c7c7c-c02d-5ba0-acb4-cd5073322417/1b8c7c7c-c02d-5ba0-acb4-cd5073322417_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:55:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F107605a40f6643658710b4777212141d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/107605a40f6643658710b4777212141d/images/large/1.jpg saved to cache
2026-03-26 22:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1b8c7c7c-c02d-5ba0-acb4-cd5073322417
2026-03-26 22:55:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7410250>
2026-03-26 22:55:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b8c7c7c-c02d-5ba0-acb4-cd5073322417/1b8c7c7c-c02d-5ba0-acb4-cd5073322417_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:55:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F107605a40f6643658710b4777212141d%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/107605a40f6643658710b4777212141d/images/large/2.jpg saved to cache
2026-03-26 22:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1b8c7c7c-c02d-5ba0-acb4-cd5073322417
2026-03-26 22:55:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F87c4d7517d06418190db4b45ae7ea59b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/87c4d7517d06418190db4b45ae7ea59b/images/large/6.jpg not downloaded yet
2026-03-26 22:55:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/107605a40f6643658710b4777212141d/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/107605a40f6643658710b4777212141d/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/107605a40f6643658710b4777212141d/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F87c4d7517d06418190db4b45ae7ea59b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/87c4d7517d06418190db4b45ae7ea59b/images/large/7.jpg not downloaded yet
2026-03-26 22:55:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e4d410>
2026-03-26 22:55:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b8c7c7c-c02d-5ba0-acb4-cd5073322417/1b8c7c7c-c02d-5ba0-acb4-cd5073322417_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F107605a40f6643658710b4777212141d%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/107605a40f6643658710b4777212141d/images/large/6.jpg saved to cache
2026-03-26 22:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1b8c7c7c-c02d-5ba0-acb4-cd5073322417
2026-03-26 22:55:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7437c50>
2026-03-26 22:55:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b8c7c7c-c02d-5ba0-acb4-cd5073322417/1b8c7c7c-c02d-5ba0-acb4-cd5073322417_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F107605a40f6643658710b4777212141d%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/107605a40f6643658710b4777212141d/images/large/3.jpg saved to cache
2026-03-26 22:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1b8c7c7c-c02d-5ba0-acb4-cd5073322417
2026-03-26 22:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F87c4d7517d06418190db4b45ae7ea59b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/87c4d7517d06418190db4b45ae7ea59b/images/large/8.jpg not downloaded yet
2026-03-26 22:55:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/107605a40f6643658710b4777212141d/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/107605a40f6643658710b4777212141d/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F87c4d7517d06418190db4b45ae7ea59b%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/87c4d7517d06418190db4b45ae7ea59b/images/large/9.jpg not downloaded yet
2026-03-26 22:55:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/107605a40f6643658710b4777212141d/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6deedd0>
2026-03-26 22:55:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b8c7c7c-c02d-5ba0-acb4-cd5073322417/1b8c7c7c-c02d-5ba0-acb4-cd5073322417_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F107605a40f6643658710b4777212141d%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/107605a40f6643658710b4777212141d/images/large/5.jpg saved to cache
2026-03-26 22:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1b8c7c7c-c02d-5ba0-acb4-cd5073322417
2026-03-26 22:55:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b746dd90>
2026-03-26 22:55:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b8c7c7c-c02d-5ba0-acb4-cd5073322417/1b8c7c7c-c02d-5ba0-acb4-cd5073322417_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F107605a40f6643658710b4777212141d%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/107605a40f6643658710b4777212141d/images/large/7.jpg saved to cache
2026-03-26 22:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1b8c7c7c-c02d-5ba0-acb4-cd5073322417
2026-03-26 22:55:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c83790>
2026-03-26 22:55:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b8c7c7c-c02d-5ba0-acb4-cd5073322417/1b8c7c7c-c02d-5ba0-acb4-cd5073322417_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F107605a40f6643658710b4777212141d%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/107605a40f6643658710b4777212141d/images/large/4.jpg saved to cache
2026-03-26 22:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1b8c7c7c-c02d-5ba0-acb4-cd5073322417
2026-03-26 22:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F87c4d7517d06418190db4b45ae7ea59b%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/87c4d7517d06418190db4b45ae7ea59b/images/large/10.jpg not downloaded yet
2026-03-26 22:55:50 [ayvens.be] INFO: Found listing with ID: 1985594
2026-03-26 22:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985594%27 HTTP/1.1" 200 None
2026-03-26 22:55:50 [ayvens.be] INFO: Scrape type for 1985594: 1
2026-03-26 22:55:50 [ayvens.be] INFO: Extracting data for car ID: 1985594
2026-03-26 22:55:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 798116e5-b8de-5252-8955-1d1dbebba461 with identifier: 1985594
2026-03-26 22:55:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 798116e5-b8de-5252-8955-1d1dbebba461 with scrape type 1
2026-03-26 22:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 798116e5-b8de-5252-8955-1d1dbebba461
2026-03-26 22:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xb%252F0288f1e695d14e159b80d961d376f8c5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xb/0288f1e695d14e159b80d961d376f8c5/images/large/1.jpg not downloaded yet
2026-03-26 22:55:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7489690>
2026-03-26 22:55:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b8c7c7c-c02d-5ba0-acb4-cd5073322417/1b8c7c7c-c02d-5ba0-acb4-cd5073322417_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F107605a40f6643658710b4777212141d%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/107605a40f6643658710b4777212141d/images/large/9.jpg saved to cache
2026-03-26 22:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1b8c7c7c-c02d-5ba0-acb4-cd5073322417
2026-03-26 22:55:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7404490>
2026-03-26 22:55:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b8c7c7c-c02d-5ba0-acb4-cd5073322417/1b8c7c7c-c02d-5ba0-acb4-cd5073322417_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F107605a40f6643658710b4777212141d%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/107605a40f6643658710b4777212141d/images/large/8.jpg saved to cache
2026-03-26 22:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1b8c7c7c-c02d-5ba0-acb4-cd5073322417
2026-03-26 22:55:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77273d0>
2026-03-26 22:55:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b8c7c7c-c02d-5ba0-acb4-cd5073322417/1b8c7c7c-c02d-5ba0-acb4-cd5073322417_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F107605a40f6643658710b4777212141d%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/107605a40f6643658710b4777212141d/images/large/10.jpg saved to cache
2026-03-26 22:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1b8c7c7c-c02d-5ba0-acb4-cd5073322417
2026-03-26 22:55:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1b8c7c7c-c02d-5ba0-acb4-cd5073322417, skipping ID generation
2026-03-26 22:55:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b8c7c7c-c02d-5ba0-acb4-cd5073322417 with scrape type 1
2026-03-26 22:55:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1b8c7c7c-c02d-5ba0-acb4-cd5073322417 sending to next pipeline
2026-03-26 22:55:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 1b8c7c7c-c02d-5ba0-acb4-cd5073322417, identifier: 1985592
2026-03-26 22:55:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 1b8c7c7c-c02d-5ba0-acb4-cd5073322417 with identifier: 1985592
2026-03-26 22:55:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 1b8c7c7c-c02d-5ba0-acb4-cd5073322417 with identifier: 1985592
2026-03-26 22:55:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 1b8c7c7c-c02d-5ba0-acb4-cd5073322417 with identifier: 1985592 to the API
2026-03-26 22:55:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:55:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:55:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bw/107605a40f6643658710b4777212141d/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '1b8c7c7c-c02d-5ba0-acb4-cd5073322417',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X2',
 'odometer': 43166,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b8c7c7c-c02d-5ba0-acb4-cd5073322417/1b8c7c7c-c02d-5ba0-acb4-cd5073322417_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 566678,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/107605a40f6643658710b4777212141d/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b8c7c7c-c02d-5ba0-acb4-cd5073322417/1b8c7c7c-c02d-5ba0-acb4-cd5073322417_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 597494,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/107605a40f6643658710b4777212141d/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b8c7c7c-c02d-5ba0-acb4-cd5073322417/1b8c7c7c-c02d-5ba0-acb4-cd5073322417_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 552660,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/107605a40f6643658710b4777212141d/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b8c7c7c-c02d-5ba0-acb4-cd5073322417/1b8c7c7c-c02d-5ba0-acb4-cd5073322417_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 666168,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/107605a40f6643658710b4777212141d/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b8c7c7c-c02d-5ba0-acb4-cd5073322417/1b8c7c7c-c02d-5ba0-acb4-cd5073322417_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 657986,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/107605a40f6643658710b4777212141d/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b8c7c7c-c02d-5ba0-acb4-cd5073322417/1b8c7c7c-c02d-5ba0-acb4-cd5073322417_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 584110,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/107605a40f6643658710b4777212141d/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b8c7c7c-c02d-5ba0-acb4-cd5073322417/1b8c7c7c-c02d-5ba0-acb4-cd5073322417_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 656864,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/107605a40f6643658710b4777212141d/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b8c7c7c-c02d-5ba0-acb4-cd5073322417/1b8c7c7c-c02d-5ba0-acb4-cd5073322417_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 694589,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/107605a40f6643658710b4777212141d/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b8c7c7c-c02d-5ba0-acb4-cd5073322417/1b8c7c7c-c02d-5ba0-acb4-cd5073322417_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 604363,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/107605a40f6643658710b4777212141d/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b8c7c7c-c02d-5ba0-acb4-cd5073322417/1b8c7c7c-c02d-5ba0-acb4-cd5073322417_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 438568,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/107605a40f6643658710b4777212141d/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X2 1.5 XDRIVE25E PHEV 162KW)',
 'transmission': 'automatic',
 'trim': '1.5 XDRIVE25E PHEV 162KW)',
 'vin': None,
 'year': 2022}
2026-03-26 22:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985592%27 HTTP/1.1" 200 None
2026-03-26 22:55:51 [ayvens.be] INFO: Saving data for 1985592: {'created_time': 1774565751.162009, 'last_price_update_time': 1774565751.162022, 'auction_closing_time': 1774958400.0}
2026-03-26 22:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985592') HTTP/1.1" 204 0
2026-03-26 22:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xb%252F0288f1e695d14e159b80d961d376f8c5%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xb/0288f1e695d14e159b80d961d376f8c5/images/large/2.jpg not downloaded yet
2026-03-26 22:55:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/87c4d7517d06418190db4b45ae7ea59b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/87c4d7517d06418190db4b45ae7ea59b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xb%252F0288f1e695d14e159b80d961d376f8c5%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xb/0288f1e695d14e159b80d961d376f8c5/images/large/3.jpg not downloaded yet
2026-03-26 22:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xb%252F0288f1e695d14e159b80d961d376f8c5%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xb/0288f1e695d14e159b80d961d376f8c5/images/large/4.jpg not downloaded yet
2026-03-26 22:55:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/87c4d7517d06418190db4b45ae7ea59b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xb%252F0288f1e695d14e159b80d961d376f8c5%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xb/0288f1e695d14e159b80d961d376f8c5/images/large/5.jpg not downloaded yet
2026-03-26 22:55:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/87c4d7517d06418190db4b45ae7ea59b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/87c4d7517d06418190db4b45ae7ea59b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/87c4d7517d06418190db4b45ae7ea59b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xb%252F0288f1e695d14e159b80d961d376f8c5%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xb/0288f1e695d14e159b80d961d376f8c5/images/large/6.jpg not downloaded yet
2026-03-26 22:55:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/87c4d7517d06418190db4b45ae7ea59b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xb%252F0288f1e695d14e159b80d961d376f8c5%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xb/0288f1e695d14e159b80d961d376f8c5/images/large/7.jpg not downloaded yet
2026-03-26 22:55:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/87c4d7517d06418190db4b45ae7ea59b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xb%252F0288f1e695d14e159b80d961d376f8c5%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xb/0288f1e695d14e159b80d961d376f8c5/images/large/8.jpg not downloaded yet
2026-03-26 22:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xb%252F0288f1e695d14e159b80d961d376f8c5%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xb/0288f1e695d14e159b80d961d376f8c5/images/large/9.jpg not downloaded yet
2026-03-26 22:55:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7570d10>
2026-03-26 22:55:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af974b1e-bc76-523e-80e0-698c29fe183c/af974b1e-bc76-523e-80e0-698c29fe183c_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F87c4d7517d06418190db4b45ae7ea59b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/87c4d7517d06418190db4b45ae7ea59b/images/large/1.jpg saved to cache
2026-03-26 22:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item af974b1e-bc76-523e-80e0-698c29fe183c
2026-03-26 22:55:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd0c7350>
2026-03-26 22:55:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af974b1e-bc76-523e-80e0-698c29fe183c/af974b1e-bc76-523e-80e0-698c29fe183c_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F87c4d7517d06418190db4b45ae7ea59b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/87c4d7517d06418190db4b45ae7ea59b/images/large/2.jpg saved to cache
2026-03-26 22:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item af974b1e-bc76-523e-80e0-698c29fe183c
2026-03-26 22:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xb%252F0288f1e695d14e159b80d961d376f8c5%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xb/0288f1e695d14e159b80d961d376f8c5/images/large/10.jpg not downloaded yet
2026-03-26 22:55:51 [ayvens.be] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 500
2026-03-26 22:55:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/87c4d7517d06418190db4b45ae7ea59b/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xb/0288f1e695d14e159b80d961d376f8c5/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/87c4d7517d06418190db4b45ae7ea59b/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xb/0288f1e695d14e159b80d961d376f8c5/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xb/0288f1e695d14e159b80d961d376f8c5/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b8b150>
2026-03-26 22:55:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af974b1e-bc76-523e-80e0-698c29fe183c/af974b1e-bc76-523e-80e0-698c29fe183c_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F87c4d7517d06418190db4b45ae7ea59b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/87c4d7517d06418190db4b45ae7ea59b/images/large/5.jpg saved to cache
2026-03-26 22:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item af974b1e-bc76-523e-80e0-698c29fe183c
2026-03-26 22:55:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7414fd0>
2026-03-26 22:55:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af974b1e-bc76-523e-80e0-698c29fe183c/af974b1e-bc76-523e-80e0-698c29fe183c_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F87c4d7517d06418190db4b45ae7ea59b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/87c4d7517d06418190db4b45ae7ea59b/images/large/4.jpg saved to cache
2026-03-26 22:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item af974b1e-bc76-523e-80e0-698c29fe183c
2026-03-26 22:55:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79a7510>
2026-03-26 22:55:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af974b1e-bc76-523e-80e0-698c29fe183c/af974b1e-bc76-523e-80e0-698c29fe183c_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F87c4d7517d06418190db4b45ae7ea59b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/87c4d7517d06418190db4b45ae7ea59b/images/large/3.jpg saved to cache
2026-03-26 22:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item af974b1e-bc76-523e-80e0-698c29fe183c
2026-03-26 22:55:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74dd850>
2026-03-26 22:55:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af974b1e-bc76-523e-80e0-698c29fe183c/af974b1e-bc76-523e-80e0-698c29fe183c_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F87c4d7517d06418190db4b45ae7ea59b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/87c4d7517d06418190db4b45ae7ea59b/images/large/6.jpg saved to cache
2026-03-26 22:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item af974b1e-bc76-523e-80e0-698c29fe183c
2026-03-26 22:55:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b788d750>
2026-03-26 22:55:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af974b1e-bc76-523e-80e0-698c29fe183c/af974b1e-bc76-523e-80e0-698c29fe183c_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F87c4d7517d06418190db4b45ae7ea59b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/87c4d7517d06418190db4b45ae7ea59b/images/large/7.jpg saved to cache
2026-03-26 22:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item af974b1e-bc76-523e-80e0-698c29fe183c
2026-03-26 22:55:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77bc190>
2026-03-26 22:55:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af974b1e-bc76-523e-80e0-698c29fe183c/af974b1e-bc76-523e-80e0-698c29fe183c_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F87c4d7517d06418190db4b45ae7ea59b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/87c4d7517d06418190db4b45ae7ea59b/images/large/8.jpg saved to cache
2026-03-26 22:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item af974b1e-bc76-523e-80e0-698c29fe183c
2026-03-26 22:55:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xb/0288f1e695d14e159b80d961d376f8c5/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xb/0288f1e695d14e159b80d961d376f8c5/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xb/0288f1e695d14e159b80d961d376f8c5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-26 22:55:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77bf490>
2026-03-26 22:55:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af974b1e-bc76-523e-80e0-698c29fe183c/af974b1e-bc76-523e-80e0-698c29fe183c_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F87c4d7517d06418190db4b45ae7ea59b%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/87c4d7517d06418190db4b45ae7ea59b/images/large/9.jpg saved to cache
2026-03-26 22:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item af974b1e-bc76-523e-80e0-698c29fe183c
2026-03-26 22:55:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74bd210>
2026-03-26 22:55:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_798116e5-b8de-5252-8955-1d1dbebba461/798116e5-b8de-5252-8955-1d1dbebba461_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xb%252F0288f1e695d14e159b80d961d376f8c5%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xb/0288f1e695d14e159b80d961d376f8c5/images/large/2.jpg saved to cache
2026-03-26 22:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 798116e5-b8de-5252-8955-1d1dbebba461
2026-03-26 22:55:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7437e10>
2026-03-26 22:55:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af974b1e-bc76-523e-80e0-698c29fe183c/af974b1e-bc76-523e-80e0-698c29fe183c_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F87c4d7517d06418190db4b45ae7ea59b%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/87c4d7517d06418190db4b45ae7ea59b/images/large/10.jpg saved to cache
2026-03-26 22:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item af974b1e-bc76-523e-80e0-698c29fe183c
2026-03-26 22:55:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: af974b1e-bc76-523e-80e0-698c29fe183c, skipping ID generation
2026-03-26 22:55:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af974b1e-bc76-523e-80e0-698c29fe183c with scrape type 1
2026-03-26 22:55:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item af974b1e-bc76-523e-80e0-698c29fe183c sending to next pipeline
2026-03-26 22:55:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: af974b1e-bc76-523e-80e0-698c29fe183c, identifier: 1985593
2026-03-26 22:55:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7488350>
2026-03-26 22:55:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_798116e5-b8de-5252-8955-1d1dbebba461/798116e5-b8de-5252-8955-1d1dbebba461_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xb%252F0288f1e695d14e159b80d961d376f8c5%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xb/0288f1e695d14e159b80d961d376f8c5/images/large/3.jpg saved to cache
2026-03-26 22:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 798116e5-b8de-5252-8955-1d1dbebba461
2026-03-26 22:55:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7496350>
2026-03-26 22:55:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_798116e5-b8de-5252-8955-1d1dbebba461/798116e5-b8de-5252-8955-1d1dbebba461_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xb%252F0288f1e695d14e159b80d961d376f8c5%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xb/0288f1e695d14e159b80d961d376f8c5/images/large/4.jpg saved to cache
2026-03-26 22:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 798116e5-b8de-5252-8955-1d1dbebba461
2026-03-26 22:55:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: af974b1e-bc76-523e-80e0-698c29fe183c with identifier: 1985593
2026-03-26 22:55:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: af974b1e-bc76-523e-80e0-698c29fe183c with identifier: 1985593
2026-03-26 22:55:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: af974b1e-bc76-523e-80e0-698c29fe183c with identifier: 1985593 to the API
2026-03-26 22:55:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:55:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:55:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2dt/87c4d7517d06418190db4b45ae7ea59b/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'af974b1e-bc76-523e-80e0-698c29fe183c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'MULTIVAN LANG',
 'odometer': 75696,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 20,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af974b1e-bc76-523e-80e0-698c29fe183c/af974b1e-bc76-523e-80e0-698c29fe183c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 689960,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/87c4d7517d06418190db4b45ae7ea59b/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af974b1e-bc76-523e-80e0-698c29fe183c/af974b1e-bc76-523e-80e0-698c29fe183c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 677848,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/87c4d7517d06418190db4b45ae7ea59b/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af974b1e-bc76-523e-80e0-698c29fe183c/af974b1e-bc76-523e-80e0-698c29fe183c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 678213,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/87c4d7517d06418190db4b45ae7ea59b/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af974b1e-bc76-523e-80e0-698c29fe183c/af974b1e-bc76-523e-80e0-698c29fe183c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 707145,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/87c4d7517d06418190db4b45ae7ea59b/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af974b1e-bc76-523e-80e0-698c29fe183c/af974b1e-bc76-523e-80e0-698c29fe183c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 677760,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/87c4d7517d06418190db4b45ae7ea59b/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af974b1e-bc76-523e-80e0-698c29fe183c/af974b1e-bc76-523e-80e0-698c29fe183c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 669409,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/87c4d7517d06418190db4b45ae7ea59b/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af974b1e-bc76-523e-80e0-698c29fe183c/af974b1e-bc76-523e-80e0-698c29fe183c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 623669,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/87c4d7517d06418190db4b45ae7ea59b/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af974b1e-bc76-523e-80e0-698c29fe183c/af974b1e-bc76-523e-80e0-698c29fe183c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 786428,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/87c4d7517d06418190db4b45ae7ea59b/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af974b1e-bc76-523e-80e0-698c29fe183c/af974b1e-bc76-523e-80e0-698c29fe183c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 775378,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/87c4d7517d06418190db4b45ae7ea59b/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af974b1e-bc76-523e-80e0-698c29fe183c/af974b1e-bc76-523e-80e0-698c29fe183c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 658146,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/87c4d7517d06418190db4b45ae7ea59b/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-21',
 'seats_number': 7,
 'seller_name': None,
 'title': 'VOLKSWAGEN MULTIVAN LANG 1.4 EHYBRID PHEV DSG EXT STYLE',
 'transmission': 'automatic',
 'trim': '1.4 EHYBRID PHEV DSG EXT STYLE',
 'vin': None,
 'year': 2023}
2026-03-26 22:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985593%27 HTTP/1.1" 200 None
2026-03-26 22:55:52 [ayvens.be] INFO: Saving data for 1985593: {'created_time': 1774565752.965262, 'last_price_update_time': 1774565752.965272, 'auction_closing_time': 1774958400.0}
2026-03-26 22:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985593') HTTP/1.1" 204 0
2026-03-26 22:55:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80be1b44d0>
2026-03-26 22:55:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_798116e5-b8de-5252-8955-1d1dbebba461/798116e5-b8de-5252-8955-1d1dbebba461_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xb%252F0288f1e695d14e159b80d961d376f8c5%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xb/0288f1e695d14e159b80d961d376f8c5/images/large/5.jpg saved to cache
2026-03-26 22:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 798116e5-b8de-5252-8955-1d1dbebba461
2026-03-26 22:55:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7437e10>
2026-03-26 22:55:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_798116e5-b8de-5252-8955-1d1dbebba461/798116e5-b8de-5252-8955-1d1dbebba461_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xb%252F0288f1e695d14e159b80d961d376f8c5%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xb/0288f1e695d14e159b80d961d376f8c5/images/large/6.jpg saved to cache
2026-03-26 22:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 798116e5-b8de-5252-8955-1d1dbebba461
2026-03-26 22:55:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77e8250>
2026-03-26 22:55:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_798116e5-b8de-5252-8955-1d1dbebba461/798116e5-b8de-5252-8955-1d1dbebba461_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xb%252F0288f1e695d14e159b80d961d376f8c5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xb/0288f1e695d14e159b80d961d376f8c5/images/large/1.jpg saved to cache
2026-03-26 22:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 798116e5-b8de-5252-8955-1d1dbebba461
2026-03-26 22:55:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xb/0288f1e695d14e159b80d961d376f8c5/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xb/0288f1e695d14e159b80d961d376f8c5/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xb/0288f1e695d14e159b80d961d376f8c5/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xb/0288f1e695d14e159b80d961d376f8c5/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77ebd90>
2026-03-26 22:55:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_798116e5-b8de-5252-8955-1d1dbebba461/798116e5-b8de-5252-8955-1d1dbebba461_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xb%252F0288f1e695d14e159b80d961d376f8c5%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xb/0288f1e695d14e159b80d961d376f8c5/images/large/10.jpg saved to cache
2026-03-26 22:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 798116e5-b8de-5252-8955-1d1dbebba461
2026-03-26 22:55:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd496f10>
2026-03-26 22:55:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_798116e5-b8de-5252-8955-1d1dbebba461/798116e5-b8de-5252-8955-1d1dbebba461_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xb%252F0288f1e695d14e159b80d961d376f8c5%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xb/0288f1e695d14e159b80d961d376f8c5/images/large/8.jpg saved to cache
2026-03-26 22:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 798116e5-b8de-5252-8955-1d1dbebba461
2026-03-26 22:55:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7876310>
2026-03-26 22:55:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_798116e5-b8de-5252-8955-1d1dbebba461/798116e5-b8de-5252-8955-1d1dbebba461_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xb%252F0288f1e695d14e159b80d961d376f8c5%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xb/0288f1e695d14e159b80d961d376f8c5/images/large/7.jpg saved to cache
2026-03-26 22:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 798116e5-b8de-5252-8955-1d1dbebba461
2026-03-26 22:55:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5ca0b10>
2026-03-26 22:55:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_798116e5-b8de-5252-8955-1d1dbebba461/798116e5-b8de-5252-8955-1d1dbebba461_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xb%252F0288f1e695d14e159b80d961d376f8c5%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xb/0288f1e695d14e159b80d961d376f8c5/images/large/9.jpg saved to cache
2026-03-26 22:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 798116e5-b8de-5252-8955-1d1dbebba461
2026-03-26 22:55:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 798116e5-b8de-5252-8955-1d1dbebba461, skipping ID generation
2026-03-26 22:55:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 798116e5-b8de-5252-8955-1d1dbebba461 with scrape type 1
2026-03-26 22:55:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 798116e5-b8de-5252-8955-1d1dbebba461 sending to next pipeline
2026-03-26 22:55:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 798116e5-b8de-5252-8955-1d1dbebba461, identifier: 1985594
2026-03-26 22:55:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 798116e5-b8de-5252-8955-1d1dbebba461 with identifier: 1985594
2026-03-26 22:55:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 798116e5-b8de-5252-8955-1d1dbebba461 with identifier: 1985594
2026-03-26 22:55:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 798116e5-b8de-5252-8955-1d1dbebba461 with identifier: 1985594 to the API
2026-03-26 22:55:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:55:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:55:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1xb/0288f1e695d14e159b80d961d376f8c5/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 179,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '798116e5-b8de-5252-8955-1d1dbebba461',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT 2T 350M FOU MWB HR DSL',
 'odometer': 87053,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_798116e5-b8de-5252-8955-1d1dbebba461/798116e5-b8de-5252-8955-1d1dbebba461_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 262256,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xb/0288f1e695d14e159b80d961d376f8c5/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_798116e5-b8de-5252-8955-1d1dbebba461/798116e5-b8de-5252-8955-1d1dbebba461_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 276867,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xb/0288f1e695d14e159b80d961d376f8c5/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_798116e5-b8de-5252-8955-1d1dbebba461/798116e5-b8de-5252-8955-1d1dbebba461_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 281392,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xb/0288f1e695d14e159b80d961d376f8c5/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_798116e5-b8de-5252-8955-1d1dbebba461/798116e5-b8de-5252-8955-1d1dbebba461_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 261420,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xb/0288f1e695d14e159b80d961d376f8c5/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_798116e5-b8de-5252-8955-1d1dbebba461/798116e5-b8de-5252-8955-1d1dbebba461_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 273005,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xb/0288f1e695d14e159b80d961d376f8c5/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_798116e5-b8de-5252-8955-1d1dbebba461/798116e5-b8de-5252-8955-1d1dbebba461_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 266371,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xb/0288f1e695d14e159b80d961d376f8c5/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_798116e5-b8de-5252-8955-1d1dbebba461/798116e5-b8de-5252-8955-1d1dbebba461_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 339903,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xb/0288f1e695d14e159b80d961d376f8c5/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_798116e5-b8de-5252-8955-1d1dbebba461/798116e5-b8de-5252-8955-1d1dbebba461_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 291740,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xb/0288f1e695d14e159b80d961d376f8c5/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_798116e5-b8de-5252-8955-1d1dbebba461/798116e5-b8de-5252-8955-1d1dbebba461_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 341773,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xb/0288f1e695d14e159b80d961d376f8c5/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_798116e5-b8de-5252-8955-1d1dbebba461/798116e5-b8de-5252-8955-1d1dbebba461_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 261812,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xb/0288f1e695d14e159b80d961d376f8c5/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-12',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FORD TRANSIT 2T 350M FOU MWB HR DSL 2.0 TDCi L2H2 Trend STOCK',
 'transmission': 'manual',
 'trim': '2.0 TDCi L2H2 Trend STOCK',
 'vin': None,
 'year': 2019}
2026-03-26 22:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985594%27 HTTP/1.1" 200 None
2026-03-26 22:55:53 [ayvens.be] INFO: Saving data for 1985594: {'created_time': 1774565753.980327, 'last_price_update_time': 1774565753.980338, 'auction_closing_time': 1774958400.0}
2026-03-26 22:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985594') HTTP/1.1" 204 0
2026-03-26 22:55:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-03-26 22:55:56 [ayvens.be] INFO: Found listing with ID: 1985595
2026-03-26 22:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985595%27 HTTP/1.1" 200 None
2026-03-26 22:55:56 [ayvens.be] INFO: Scrape type for 1985595: 1
2026-03-26 22:55:56 [ayvens.be] INFO: Extracting data for car ID: 1985595
2026-03-26 22:55:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af185355-7844-5b20-8600-3e62f970b76e with identifier: 1985595
2026-03-26 22:55:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af185355-7844-5b20-8600-3e62f970b76e with scrape type 1
2026-03-26 22:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item af185355-7844-5b20-8600-3e62f970b76e
2026-03-26 22:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F6cef8e0502f0448f92ff2f7209be7f88%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/6cef8e0502f0448f92ff2f7209be7f88/images/large/1.jpg not downloaded yet
2026-03-26 22:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F6cef8e0502f0448f92ff2f7209be7f88%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/6cef8e0502f0448f92ff2f7209be7f88/images/large/2.jpg not downloaded yet
2026-03-26 22:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F6cef8e0502f0448f92ff2f7209be7f88%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/6cef8e0502f0448f92ff2f7209be7f88/images/large/3.jpg not downloaded yet
2026-03-26 22:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F6cef8e0502f0448f92ff2f7209be7f88%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/6cef8e0502f0448f92ff2f7209be7f88/images/large/4.jpg not downloaded yet
2026-03-26 22:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F6cef8e0502f0448f92ff2f7209be7f88%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/6cef8e0502f0448f92ff2f7209be7f88/images/large/5.jpg not downloaded yet
2026-03-26 22:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F6cef8e0502f0448f92ff2f7209be7f88%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/6cef8e0502f0448f92ff2f7209be7f88/images/large/6.jpg not downloaded yet
2026-03-26 22:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F6cef8e0502f0448f92ff2f7209be7f88%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/6cef8e0502f0448f92ff2f7209be7f88/images/large/7.jpg not downloaded yet
2026-03-26 22:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F6cef8e0502f0448f92ff2f7209be7f88%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/6cef8e0502f0448f92ff2f7209be7f88/images/large/8.jpg not downloaded yet
2026-03-26 22:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F6cef8e0502f0448f92ff2f7209be7f88%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/6cef8e0502f0448f92ff2f7209be7f88/images/large/9.jpg not downloaded yet
2026-03-26 22:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F6cef8e0502f0448f92ff2f7209be7f88%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/6cef8e0502f0448f92ff2f7209be7f88/images/large/10.jpg not downloaded yet
2026-03-26 22:55:56 [ayvens.be] INFO: Found listing with ID: 1985596
2026-03-26 22:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985596%27 HTTP/1.1" 200 None
2026-03-26 22:55:56 [ayvens.be] INFO: Scrape type for 1985596: 1
2026-03-26 22:55:56 [ayvens.be] INFO: Extracting data for car ID: 1985596
2026-03-26 22:55:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d54a7ee4-2d8b-566b-a509-c22bcb737f83 with identifier: 1985596
2026-03-26 22:55:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d54a7ee4-2d8b-566b-a509-c22bcb737f83 with scrape type 1
2026-03-26 22:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d54a7ee4-2d8b-566b-a509-c22bcb737f83
2026-03-26 22:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fd9d50b102dca4941a7d8f0a6757abf14%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/d9d50b102dca4941a7d8f0a6757abf14/images/large/1.jpg not downloaded yet
2026-03-26 22:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fd9d50b102dca4941a7d8f0a6757abf14%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/d9d50b102dca4941a7d8f0a6757abf14/images/large/2.jpg not downloaded yet
2026-03-26 22:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fd9d50b102dca4941a7d8f0a6757abf14%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/d9d50b102dca4941a7d8f0a6757abf14/images/large/3.jpg not downloaded yet
2026-03-26 22:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fd9d50b102dca4941a7d8f0a6757abf14%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/d9d50b102dca4941a7d8f0a6757abf14/images/large/4.jpg not downloaded yet
2026-03-26 22:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fd9d50b102dca4941a7d8f0a6757abf14%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/d9d50b102dca4941a7d8f0a6757abf14/images/large/5.jpg not downloaded yet
2026-03-26 22:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fd9d50b102dca4941a7d8f0a6757abf14%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/d9d50b102dca4941a7d8f0a6757abf14/images/large/6.jpg not downloaded yet
2026-03-26 22:55:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/6cef8e0502f0448f92ff2f7209be7f88/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/6cef8e0502f0448f92ff2f7209be7f88/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fd9d50b102dca4941a7d8f0a6757abf14%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/d9d50b102dca4941a7d8f0a6757abf14/images/large/7.jpg not downloaded yet
2026-03-26 22:55:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/6cef8e0502f0448f92ff2f7209be7f88/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fd9d50b102dca4941a7d8f0a6757abf14%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/d9d50b102dca4941a7d8f0a6757abf14/images/large/8.jpg not downloaded yet
2026-03-26 22:55:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/6cef8e0502f0448f92ff2f7209be7f88/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fd9d50b102dca4941a7d8f0a6757abf14%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/d9d50b102dca4941a7d8f0a6757abf14/images/large/9.jpg not downloaded yet
2026-03-26 22:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fd9d50b102dca4941a7d8f0a6757abf14%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/d9d50b102dca4941a7d8f0a6757abf14/images/large/10.jpg not downloaded yet
2026-03-26 22:55:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/6cef8e0502f0448f92ff2f7209be7f88/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/6cef8e0502f0448f92ff2f7209be7f88/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/6cef8e0502f0448f92ff2f7209be7f88/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:56 [ayvens.be] INFO: Found listing with ID: 1985597
2026-03-26 22:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985597%27 HTTP/1.1" 200 None
2026-03-26 22:55:56 [ayvens.be] INFO: Scrape type for 1985597: 1
2026-03-26 22:55:56 [ayvens.be] INFO: Extracting data for car ID: 1985597
2026-03-26 22:55:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: faea3369-91d8-5b91-a94c-ab1ee56c2f75 with identifier: 1985597
2026-03-26 22:55:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item faea3369-91d8-5b91-a94c-ab1ee56c2f75 with scrape type 1
2026-03-26 22:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item faea3369-91d8-5b91-a94c-ab1ee56c2f75
2026-03-26 22:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F1bf15de9cfc240db9f06f33f54b36d53%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/1bf15de9cfc240db9f06f33f54b36d53/images/large/1.jpg not downloaded yet
2026-03-26 22:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F1bf15de9cfc240db9f06f33f54b36d53%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/1bf15de9cfc240db9f06f33f54b36d53/images/large/2.jpg not downloaded yet
2026-03-26 22:55:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7874550>
2026-03-26 22:55:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af185355-7844-5b20-8600-3e62f970b76e/af185355-7844-5b20-8600-3e62f970b76e_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F6cef8e0502f0448f92ff2f7209be7f88%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/6cef8e0502f0448f92ff2f7209be7f88/images/large/3.jpg saved to cache
2026-03-26 22:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item af185355-7844-5b20-8600-3e62f970b76e
2026-03-26 22:55:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7401950>
2026-03-26 22:55:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af185355-7844-5b20-8600-3e62f970b76e/af185355-7844-5b20-8600-3e62f970b76e_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F6cef8e0502f0448f92ff2f7209be7f88%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/6cef8e0502f0448f92ff2f7209be7f88/images/large/2.jpg saved to cache
2026-03-26 22:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item af185355-7844-5b20-8600-3e62f970b76e
2026-03-26 22:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F1bf15de9cfc240db9f06f33f54b36d53%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/1bf15de9cfc240db9f06f33f54b36d53/images/large/3.jpg not downloaded yet
2026-03-26 22:55:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77706d0>
2026-03-26 22:55:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af185355-7844-5b20-8600-3e62f970b76e/af185355-7844-5b20-8600-3e62f970b76e_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F6cef8e0502f0448f92ff2f7209be7f88%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/6cef8e0502f0448f92ff2f7209be7f88/images/large/5.jpg saved to cache
2026-03-26 22:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item af185355-7844-5b20-8600-3e62f970b76e
2026-03-26 22:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F1bf15de9cfc240db9f06f33f54b36d53%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/1bf15de9cfc240db9f06f33f54b36d53/images/large/4.jpg not downloaded yet
2026-03-26 22:55:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/6cef8e0502f0448f92ff2f7209be7f88/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/d9d50b102dca4941a7d8f0a6757abf14/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74bf9d0>
2026-03-26 22:55:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af185355-7844-5b20-8600-3e62f970b76e/af185355-7844-5b20-8600-3e62f970b76e_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F6cef8e0502f0448f92ff2f7209be7f88%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/6cef8e0502f0448f92ff2f7209be7f88/images/large/6.jpg saved to cache
2026-03-26 22:55:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item af185355-7844-5b20-8600-3e62f970b76e
2026-03-26 22:55:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74bd850>
2026-03-26 22:55:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af185355-7844-5b20-8600-3e62f970b76e/af185355-7844-5b20-8600-3e62f970b76e_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F6cef8e0502f0448f92ff2f7209be7f88%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/6cef8e0502f0448f92ff2f7209be7f88/images/large/8.jpg saved to cache
2026-03-26 22:55:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item af185355-7844-5b20-8600-3e62f970b76e
2026-03-26 22:55:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b776aed0>
2026-03-26 22:55:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af185355-7844-5b20-8600-3e62f970b76e/af185355-7844-5b20-8600-3e62f970b76e_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F6cef8e0502f0448f92ff2f7209be7f88%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/6cef8e0502f0448f92ff2f7209be7f88/images/large/1.jpg saved to cache
2026-03-26 22:55:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item af185355-7844-5b20-8600-3e62f970b76e
2026-03-26 22:55:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7494710>
2026-03-26 22:55:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af185355-7844-5b20-8600-3e62f970b76e/af185355-7844-5b20-8600-3e62f970b76e_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F6cef8e0502f0448f92ff2f7209be7f88%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/6cef8e0502f0448f92ff2f7209be7f88/images/large/4.jpg saved to cache
2026-03-26 22:55:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item af185355-7844-5b20-8600-3e62f970b76e
2026-03-26 22:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F1bf15de9cfc240db9f06f33f54b36d53%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/1bf15de9cfc240db9f06f33f54b36d53/images/large/5.jpg not downloaded yet
2026-03-26 22:55:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/d9d50b102dca4941a7d8f0a6757abf14/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/d9d50b102dca4941a7d8f0a6757abf14/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/d9d50b102dca4941a7d8f0a6757abf14/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F1bf15de9cfc240db9f06f33f54b36d53%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/1bf15de9cfc240db9f06f33f54b36d53/images/large/6.jpg not downloaded yet
2026-03-26 22:55:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c97790>
2026-03-26 22:55:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af185355-7844-5b20-8600-3e62f970b76e/af185355-7844-5b20-8600-3e62f970b76e_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F6cef8e0502f0448f92ff2f7209be7f88%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/6cef8e0502f0448f92ff2f7209be7f88/images/large/7.jpg saved to cache
2026-03-26 22:55:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item af185355-7844-5b20-8600-3e62f970b76e
2026-03-26 22:55:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e2b350>
2026-03-26 22:55:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d54a7ee4-2d8b-566b-a509-c22bcb737f83/d54a7ee4-2d8b-566b-a509-c22bcb737f83_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fd9d50b102dca4941a7d8f0a6757abf14%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/d9d50b102dca4941a7d8f0a6757abf14/images/large/2.jpg saved to cache
2026-03-26 22:55:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d54a7ee4-2d8b-566b-a509-c22bcb737f83
2026-03-26 22:55:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/d9d50b102dca4941a7d8f0a6757abf14/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F1bf15de9cfc240db9f06f33f54b36d53%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/1bf15de9cfc240db9f06f33f54b36d53/images/large/7.jpg not downloaded yet
2026-03-26 22:55:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/6cef8e0502f0448f92ff2f7209be7f88/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F1bf15de9cfc240db9f06f33f54b36d53%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/1bf15de9cfc240db9f06f33f54b36d53/images/large/8.jpg not downloaded yet
2026-03-26 22:55:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/d9d50b102dca4941a7d8f0a6757abf14/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74a42d0>
2026-03-26 22:55:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d54a7ee4-2d8b-566b-a509-c22bcb737f83/d54a7ee4-2d8b-566b-a509-c22bcb737f83_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fd9d50b102dca4941a7d8f0a6757abf14%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/d9d50b102dca4941a7d8f0a6757abf14/images/large/5.jpg saved to cache
2026-03-26 22:55:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d54a7ee4-2d8b-566b-a509-c22bcb737f83
2026-03-26 22:55:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5ca0ed0>
2026-03-26 22:55:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d54a7ee4-2d8b-566b-a509-c22bcb737f83/d54a7ee4-2d8b-566b-a509-c22bcb737f83_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fd9d50b102dca4941a7d8f0a6757abf14%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/d9d50b102dca4941a7d8f0a6757abf14/images/large/4.jpg saved to cache
2026-03-26 22:55:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d54a7ee4-2d8b-566b-a509-c22bcb737f83
2026-03-26 22:55:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79f9d10>
2026-03-26 22:55:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d54a7ee4-2d8b-566b-a509-c22bcb737f83/d54a7ee4-2d8b-566b-a509-c22bcb737f83_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fd9d50b102dca4941a7d8f0a6757abf14%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/d9d50b102dca4941a7d8f0a6757abf14/images/large/1.jpg saved to cache
2026-03-26 22:55:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d54a7ee4-2d8b-566b-a509-c22bcb737f83
2026-03-26 22:55:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/6cef8e0502f0448f92ff2f7209be7f88/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/d9d50b102dca4941a7d8f0a6757abf14/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F1bf15de9cfc240db9f06f33f54b36d53%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/1bf15de9cfc240db9f06f33f54b36d53/images/large/9.jpg not downloaded yet
2026-03-26 22:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F1bf15de9cfc240db9f06f33f54b36d53%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/1bf15de9cfc240db9f06f33f54b36d53/images/large/10.jpg not downloaded yet
2026-03-26 22:55:57 [ayvens.be] INFO: Found listing with ID: 1985598
2026-03-26 22:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985598%27 HTTP/1.1" 200 None
2026-03-26 22:55:57 [ayvens.be] INFO: Scrape type for 1985598: 1
2026-03-26 22:55:57 [ayvens.be] INFO: Extracting data for car ID: 1985598
2026-03-26 22:55:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c729140a-a6ea-5cdb-874c-9d2dbfa6cd66 with identifier: 1985598
2026-03-26 22:55:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c729140a-a6ea-5cdb-874c-9d2dbfa6cd66 with scrape type 1
2026-03-26 22:55:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c729140a-a6ea-5cdb-874c-9d2dbfa6cd66
2026-03-26 22:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fc4c7f6f65a8c4c44841f44b2f8b5d87c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/c4c7f6f65a8c4c44841f44b2f8b5d87c/images/large/1.jpg not downloaded yet
2026-03-26 22:55:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c7f950>
2026-03-26 22:55:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d54a7ee4-2d8b-566b-a509-c22bcb737f83/d54a7ee4-2d8b-566b-a509-c22bcb737f83_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fd9d50b102dca4941a7d8f0a6757abf14%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/d9d50b102dca4941a7d8f0a6757abf14/images/large/3.jpg saved to cache
2026-03-26 22:55:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d54a7ee4-2d8b-566b-a509-c22bcb737f83
2026-03-26 22:55:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76ee110>
2026-03-26 22:55:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af185355-7844-5b20-8600-3e62f970b76e/af185355-7844-5b20-8600-3e62f970b76e_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F6cef8e0502f0448f92ff2f7209be7f88%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/6cef8e0502f0448f92ff2f7209be7f88/images/large/9.jpg saved to cache
2026-03-26 22:55:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item af185355-7844-5b20-8600-3e62f970b76e
2026-03-26 22:55:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b740a790>
2026-03-26 22:55:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d54a7ee4-2d8b-566b-a509-c22bcb737f83/d54a7ee4-2d8b-566b-a509-c22bcb737f83_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fd9d50b102dca4941a7d8f0a6757abf14%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/d9d50b102dca4941a7d8f0a6757abf14/images/large/6.jpg saved to cache
2026-03-26 22:55:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d54a7ee4-2d8b-566b-a509-c22bcb737f83
2026-03-26 22:55:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/d9d50b102dca4941a7d8f0a6757abf14/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/d9d50b102dca4941a7d8f0a6757abf14/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fc4c7f6f65a8c4c44841f44b2f8b5d87c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/c4c7f6f65a8c4c44841f44b2f8b5d87c/images/large/2.jpg not downloaded yet
2026-03-26 22:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fc4c7f6f65a8c4c44841f44b2f8b5d87c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/c4c7f6f65a8c4c44841f44b2f8b5d87c/images/large/3.jpg not downloaded yet
2026-03-26 22:55:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c83890>
2026-03-26 22:55:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af185355-7844-5b20-8600-3e62f970b76e/af185355-7844-5b20-8600-3e62f970b76e_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F6cef8e0502f0448f92ff2f7209be7f88%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/6cef8e0502f0448f92ff2f7209be7f88/images/large/10.jpg saved to cache
2026-03-26 22:55:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item af185355-7844-5b20-8600-3e62f970b76e
2026-03-26 22:55:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: af185355-7844-5b20-8600-3e62f970b76e, skipping ID generation
2026-03-26 22:55:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af185355-7844-5b20-8600-3e62f970b76e with scrape type 1
2026-03-26 22:55:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item af185355-7844-5b20-8600-3e62f970b76e sending to next pipeline
2026-03-26 22:55:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: af185355-7844-5b20-8600-3e62f970b76e, identifier: 1985595
2026-03-26 22:55:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e013d0>
2026-03-26 22:55:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d54a7ee4-2d8b-566b-a509-c22bcb737f83/d54a7ee4-2d8b-566b-a509-c22bcb737f83_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fd9d50b102dca4941a7d8f0a6757abf14%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/d9d50b102dca4941a7d8f0a6757abf14/images/large/7.jpg saved to cache
2026-03-26 22:55:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d54a7ee4-2d8b-566b-a509-c22bcb737f83
2026-03-26 22:55:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/1bf15de9cfc240db9f06f33f54b36d53/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fc4c7f6f65a8c4c44841f44b2f8b5d87c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/c4c7f6f65a8c4c44841f44b2f8b5d87c/images/large/4.jpg not downloaded yet
2026-03-26 22:55:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: af185355-7844-5b20-8600-3e62f970b76e with identifier: 1985595
2026-03-26 22:55:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: af185355-7844-5b20-8600-3e62f970b76e with identifier: 1985595
2026-03-26 22:55:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: af185355-7844-5b20-8600-3e62f970b76e with identifier: 1985595 to the API
2026-03-26 22:55:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:55:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:55:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bs/6cef8e0502f0448f92ff2f7209be7f88/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'af185355-7844-5b20-8600-3e62f970b76e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A3 SPORTBACK',
 'odometer': 92176,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af185355-7844-5b20-8600-3e62f970b76e/af185355-7844-5b20-8600-3e62f970b76e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 785971,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/6cef8e0502f0448f92ff2f7209be7f88/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af185355-7844-5b20-8600-3e62f970b76e/af185355-7844-5b20-8600-3e62f970b76e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 775452,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/6cef8e0502f0448f92ff2f7209be7f88/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af185355-7844-5b20-8600-3e62f970b76e/af185355-7844-5b20-8600-3e62f970b76e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 751007,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/6cef8e0502f0448f92ff2f7209be7f88/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af185355-7844-5b20-8600-3e62f970b76e/af185355-7844-5b20-8600-3e62f970b76e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 792577,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/6cef8e0502f0448f92ff2f7209be7f88/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af185355-7844-5b20-8600-3e62f970b76e/af185355-7844-5b20-8600-3e62f970b76e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 792281,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/6cef8e0502f0448f92ff2f7209be7f88/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af185355-7844-5b20-8600-3e62f970b76e/af185355-7844-5b20-8600-3e62f970b76e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 790607,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/6cef8e0502f0448f92ff2f7209be7f88/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af185355-7844-5b20-8600-3e62f970b76e/af185355-7844-5b20-8600-3e62f970b76e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 664377,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/6cef8e0502f0448f92ff2f7209be7f88/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af185355-7844-5b20-8600-3e62f970b76e/af185355-7844-5b20-8600-3e62f970b76e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 906242,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/6cef8e0502f0448f92ff2f7209be7f88/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af185355-7844-5b20-8600-3e62f970b76e/af185355-7844-5b20-8600-3e62f970b76e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 942203,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/6cef8e0502f0448f92ff2f7209be7f88/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af185355-7844-5b20-8600-3e62f970b76e/af185355-7844-5b20-8600-3e62f970b76e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 775333,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/6cef8e0502f0448f92ff2f7209be7f88/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A3 SPORTBACK 1.4 40 TFSI E S TRONIC SPORTB ATTRACTION',
 'transmission': 'automatic',
 'trim': '1.4 40 TFSI E S TRONIC SPORTB ATTRACTION',
 'vin': None,
 'year': 2022}
2026-03-26 22:55:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985595%27 HTTP/1.1" 200 None
2026-03-26 22:55:59 [ayvens.be] INFO: Saving data for 1985595: {'created_time': 1774565759.093236, 'last_price_update_time': 1774565759.093246, 'auction_closing_time': 1774958400.0}
2026-03-26 22:55:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985595') HTTP/1.1" 204 0
2026-03-26 22:55:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/1bf15de9cfc240db9f06f33f54b36d53/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/d9d50b102dca4941a7d8f0a6757abf14/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fc4c7f6f65a8c4c44841f44b2f8b5d87c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/c4c7f6f65a8c4c44841f44b2f8b5d87c/images/large/5.jpg not downloaded yet
2026-03-26 22:55:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fc4c7f6f65a8c4c44841f44b2f8b5d87c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/c4c7f6f65a8c4c44841f44b2f8b5d87c/images/large/6.jpg not downloaded yet
2026-03-26 22:55:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b68410>
2026-03-26 22:55:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d54a7ee4-2d8b-566b-a509-c22bcb737f83/d54a7ee4-2d8b-566b-a509-c22bcb737f83_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:55:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fd9d50b102dca4941a7d8f0a6757abf14%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/d9d50b102dca4941a7d8f0a6757abf14/images/large/8.jpg saved to cache
2026-03-26 22:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d54a7ee4-2d8b-566b-a509-c22bcb737f83
2026-03-26 22:55:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74dccd0>
2026-03-26 22:55:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d54a7ee4-2d8b-566b-a509-c22bcb737f83/d54a7ee4-2d8b-566b-a509-c22bcb737f83_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:55:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fd9d50b102dca4941a7d8f0a6757abf14%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/d9d50b102dca4941a7d8f0a6757abf14/images/large/9.jpg saved to cache
2026-03-26 22:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d54a7ee4-2d8b-566b-a509-c22bcb737f83
2026-03-26 22:55:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b72ee790>
2026-03-26 22:55:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_faea3369-91d8-5b91-a94c-ab1ee56c2f75/faea3369-91d8-5b91-a94c-ab1ee56c2f75_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:55:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F1bf15de9cfc240db9f06f33f54b36d53%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/1bf15de9cfc240db9f06f33f54b36d53/images/large/3.jpg saved to cache
2026-03-26 22:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item faea3369-91d8-5b91-a94c-ab1ee56c2f75
2026-03-26 22:55:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/1bf15de9cfc240db9f06f33f54b36d53/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/1bf15de9cfc240db9f06f33f54b36d53/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/1bf15de9cfc240db9f06f33f54b36d53/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fc4c7f6f65a8c4c44841f44b2f8b5d87c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/c4c7f6f65a8c4c44841f44b2f8b5d87c/images/large/7.jpg not downloaded yet
2026-03-26 22:55:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fc4c7f6f65a8c4c44841f44b2f8b5d87c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/c4c7f6f65a8c4c44841f44b2f8b5d87c/images/large/8.jpg not downloaded yet
2026-03-26 22:55:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cbef90>
2026-03-26 22:55:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_faea3369-91d8-5b91-a94c-ab1ee56c2f75/faea3369-91d8-5b91-a94c-ab1ee56c2f75_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:55:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F1bf15de9cfc240db9f06f33f54b36d53%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/1bf15de9cfc240db9f06f33f54b36d53/images/large/2.jpg saved to cache
2026-03-26 22:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item faea3369-91d8-5b91-a94c-ab1ee56c2f75
2026-03-26 22:55:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:55:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c95f90>
2026-03-26 22:55:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:55:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:55:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:55:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d54a7ee4-2d8b-566b-a509-c22bcb737f83/d54a7ee4-2d8b-566b-a509-c22bcb737f83_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:55:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fd9d50b102dca4941a7d8f0a6757abf14%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/d9d50b102dca4941a7d8f0a6757abf14/images/large/10.jpg saved to cache
2026-03-26 22:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d54a7ee4-2d8b-566b-a509-c22bcb737f83
2026-03-26 22:55:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d54a7ee4-2d8b-566b-a509-c22bcb737f83, skipping ID generation
2026-03-26 22:55:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d54a7ee4-2d8b-566b-a509-c22bcb737f83 with scrape type 1
2026-03-26 22:55:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d54a7ee4-2d8b-566b-a509-c22bcb737f83 sending to next pipeline
2026-03-26 22:55:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d54a7ee4-2d8b-566b-a509-c22bcb737f83, identifier: 1985596
2026-03-26 22:55:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/1bf15de9cfc240db9f06f33f54b36d53/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:55:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:55:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fc4c7f6f65a8c4c44841f44b2f8b5d87c%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/c4c7f6f65a8c4c44841f44b2f8b5d87c/images/large/9.jpg not downloaded yet
2026-03-26 22:55:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d54a7ee4-2d8b-566b-a509-c22bcb737f83 with identifier: 1985596
2026-03-26 22:55:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d54a7ee4-2d8b-566b-a509-c22bcb737f83 with identifier: 1985596
2026-03-26 22:56:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d54a7ee4-2d8b-566b-a509-c22bcb737f83 with identifier: 1985596 to the API
2026-03-26 22:56:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:56:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:56:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cv/d9d50b102dca4941a7d8f0a6757abf14/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.3L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'd54a7ee4-2d8b-566b-a509-c22bcb737f83',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A-CLASS LIMOUSINE',
 'odometer': 94918,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d54a7ee4-2d8b-566b-a509-c22bcb737f83/d54a7ee4-2d8b-566b-a509-c22bcb737f83_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 379315,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/d9d50b102dca4941a7d8f0a6757abf14/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d54a7ee4-2d8b-566b-a509-c22bcb737f83/d54a7ee4-2d8b-566b-a509-c22bcb737f83_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 329158,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/d9d50b102dca4941a7d8f0a6757abf14/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d54a7ee4-2d8b-566b-a509-c22bcb737f83/d54a7ee4-2d8b-566b-a509-c22bcb737f83_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 406215,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/d9d50b102dca4941a7d8f0a6757abf14/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d54a7ee4-2d8b-566b-a509-c22bcb737f83/d54a7ee4-2d8b-566b-a509-c22bcb737f83_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 371338,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/d9d50b102dca4941a7d8f0a6757abf14/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d54a7ee4-2d8b-566b-a509-c22bcb737f83/d54a7ee4-2d8b-566b-a509-c22bcb737f83_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 303379,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/d9d50b102dca4941a7d8f0a6757abf14/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d54a7ee4-2d8b-566b-a509-c22bcb737f83/d54a7ee4-2d8b-566b-a509-c22bcb737f83_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 244430,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/d9d50b102dca4941a7d8f0a6757abf14/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d54a7ee4-2d8b-566b-a509-c22bcb737f83/d54a7ee4-2d8b-566b-a509-c22bcb737f83_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 292647,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/d9d50b102dca4941a7d8f0a6757abf14/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d54a7ee4-2d8b-566b-a509-c22bcb737f83/d54a7ee4-2d8b-566b-a509-c22bcb737f83_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 354146,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/d9d50b102dca4941a7d8f0a6757abf14/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d54a7ee4-2d8b-566b-a509-c22bcb737f83/d54a7ee4-2d8b-566b-a509-c22bcb737f83_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 350556,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/d9d50b102dca4941a7d8f0a6757abf14/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d54a7ee4-2d8b-566b-a509-c22bcb737f83/d54a7ee4-2d8b-566b-a509-c22bcb737f83_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 427468,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/d9d50b102dca4941a7d8f0a6757abf14/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ A-CLASS LIMOUSINE 1.3 A 250 E LUXURY LINE DCT',
 'transmission': 'automatic',
 'trim': '1.3 A 250 E LUXURY LINE DCT',
 'vin': None,
 'year': 2022}
2026-03-26 22:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985596%27 HTTP/1.1" 200 None
2026-03-26 22:56:00 [ayvens.be] INFO: Saving data for 1985596: {'created_time': 1774565760.258751, 'last_price_update_time': 1774565760.258761, 'auction_closing_time': 1774958400.0}
2026-03-26 22:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985596') HTTP/1.1" 204 0
2026-03-26 22:56:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/1bf15de9cfc240db9f06f33f54b36d53/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fc4c7f6f65a8c4c44841f44b2f8b5d87c%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/c4c7f6f65a8c4c44841f44b2f8b5d87c/images/large/10.jpg not downloaded yet
2026-03-26 22:56:00 [ayvens.be] INFO: Found listing with ID: 1985599
2026-03-26 22:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985599%27 HTTP/1.1" 200 None
2026-03-26 22:56:00 [ayvens.be] INFO: Scrape type for 1985599: 1
2026-03-26 22:56:00 [ayvens.be] INFO: Extracting data for car ID: 1985599
2026-03-26 22:56:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b232f238-ff97-549b-a6d4-bacd62f8dff8 with identifier: 1985599
2026-03-26 22:56:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b232f238-ff97-549b-a6d4-bacd62f8dff8 with scrape type 1
2026-03-26 22:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b232f238-ff97-549b-a6d4-bacd62f8dff8
2026-03-26 22:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Ff14b11c9cc4a49efa6ede57b3a409911%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/f14b11c9cc4a49efa6ede57b3a409911/images/large/1.jpg not downloaded yet
2026-03-26 22:56:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd12d850>
2026-03-26 22:56:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_faea3369-91d8-5b91-a94c-ab1ee56c2f75/faea3369-91d8-5b91-a94c-ab1ee56c2f75_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F1bf15de9cfc240db9f06f33f54b36d53%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/1bf15de9cfc240db9f06f33f54b36d53/images/large/4.jpg saved to cache
2026-03-26 22:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item faea3369-91d8-5b91-a94c-ab1ee56c2f75
2026-03-26 22:56:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7ae98d0>
2026-03-26 22:56:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_faea3369-91d8-5b91-a94c-ab1ee56c2f75/faea3369-91d8-5b91-a94c-ab1ee56c2f75_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F1bf15de9cfc240db9f06f33f54b36d53%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/1bf15de9cfc240db9f06f33f54b36d53/images/large/1.jpg saved to cache
2026-03-26 22:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item faea3369-91d8-5b91-a94c-ab1ee56c2f75
2026-03-26 22:56:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7662a90>
2026-03-26 22:56:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_faea3369-91d8-5b91-a94c-ab1ee56c2f75/faea3369-91d8-5b91-a94c-ab1ee56c2f75_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F1bf15de9cfc240db9f06f33f54b36d53%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/1bf15de9cfc240db9f06f33f54b36d53/images/large/5.jpg saved to cache
2026-03-26 22:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item faea3369-91d8-5b91-a94c-ab1ee56c2f75
2026-03-26 22:56:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7587cd0>
2026-03-26 22:56:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_faea3369-91d8-5b91-a94c-ab1ee56c2f75/faea3369-91d8-5b91-a94c-ab1ee56c2f75_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F1bf15de9cfc240db9f06f33f54b36d53%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/1bf15de9cfc240db9f06f33f54b36d53/images/large/7.jpg saved to cache
2026-03-26 22:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item faea3369-91d8-5b91-a94c-ab1ee56c2f75
2026-03-26 22:56:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/1bf15de9cfc240db9f06f33f54b36d53/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/1bf15de9cfc240db9f06f33f54b36d53/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Ff14b11c9cc4a49efa6ede57b3a409911%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/f14b11c9cc4a49efa6ede57b3a409911/images/large/2.jpg not downloaded yet
2026-03-26 22:56:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/1bf15de9cfc240db9f06f33f54b36d53/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/c4c7f6f65a8c4c44841f44b2f8b5d87c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/c4c7f6f65a8c4c44841f44b2f8b5d87c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/c4c7f6f65a8c4c44841f44b2f8b5d87c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Ff14b11c9cc4a49efa6ede57b3a409911%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/f14b11c9cc4a49efa6ede57b3a409911/images/large/3.jpg not downloaded yet
2026-03-26 22:56:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76e3c10>
2026-03-26 22:56:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_faea3369-91d8-5b91-a94c-ab1ee56c2f75/faea3369-91d8-5b91-a94c-ab1ee56c2f75_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F1bf15de9cfc240db9f06f33f54b36d53%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/1bf15de9cfc240db9f06f33f54b36d53/images/large/6.jpg saved to cache
2026-03-26 22:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item faea3369-91d8-5b91-a94c-ab1ee56c2f75
2026-03-26 22:56:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/c4c7f6f65a8c4c44841f44b2f8b5d87c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Ff14b11c9cc4a49efa6ede57b3a409911%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/f14b11c9cc4a49efa6ede57b3a409911/images/large/4.jpg not downloaded yet
2026-03-26 22:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Ff14b11c9cc4a49efa6ede57b3a409911%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/f14b11c9cc4a49efa6ede57b3a409911/images/large/5.jpg not downloaded yet
2026-03-26 22:56:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/c4c7f6f65a8c4c44841f44b2f8b5d87c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Ff14b11c9cc4a49efa6ede57b3a409911%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/f14b11c9cc4a49efa6ede57b3a409911/images/large/6.jpg not downloaded yet
2026-03-26 22:56:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76a7c90>
2026-03-26 22:56:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_faea3369-91d8-5b91-a94c-ab1ee56c2f75/faea3369-91d8-5b91-a94c-ab1ee56c2f75_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:56:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F1bf15de9cfc240db9f06f33f54b36d53%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/1bf15de9cfc240db9f06f33f54b36d53/images/large/9.jpg saved to cache
2026-03-26 22:56:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item faea3369-91d8-5b91-a94c-ab1ee56c2f75
2026-03-26 22:56:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79cc710>
2026-03-26 22:56:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_faea3369-91d8-5b91-a94c-ab1ee56c2f75/faea3369-91d8-5b91-a94c-ab1ee56c2f75_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:56:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F1bf15de9cfc240db9f06f33f54b36d53%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/1bf15de9cfc240db9f06f33f54b36d53/images/large/10.jpg saved to cache
2026-03-26 22:56:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item faea3369-91d8-5b91-a94c-ab1ee56c2f75
2026-03-26 22:56:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e2ba50>
2026-03-26 22:56:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_faea3369-91d8-5b91-a94c-ab1ee56c2f75/faea3369-91d8-5b91-a94c-ab1ee56c2f75_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:56:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F1bf15de9cfc240db9f06f33f54b36d53%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/1bf15de9cfc240db9f06f33f54b36d53/images/large/8.jpg saved to cache
2026-03-26 22:56:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item faea3369-91d8-5b91-a94c-ab1ee56c2f75
2026-03-26 22:56:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: faea3369-91d8-5b91-a94c-ab1ee56c2f75, skipping ID generation
2026-03-26 22:56:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item faea3369-91d8-5b91-a94c-ab1ee56c2f75 with scrape type 1
2026-03-26 22:56:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item faea3369-91d8-5b91-a94c-ab1ee56c2f75 sending to next pipeline
2026-03-26 22:56:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: faea3369-91d8-5b91-a94c-ab1ee56c2f75, identifier: 1985597
2026-03-26 22:56:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b743bd90>
2026-03-26 22:56:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c729140a-a6ea-5cdb-874c-9d2dbfa6cd66/c729140a-a6ea-5cdb-874c-9d2dbfa6cd66_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:56:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fc4c7f6f65a8c4c44841f44b2f8b5d87c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/c4c7f6f65a8c4c44841f44b2f8b5d87c/images/large/1.jpg saved to cache
2026-03-26 22:56:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c729140a-a6ea-5cdb-874c-9d2dbfa6cd66
2026-03-26 22:56:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b726b510>
2026-03-26 22:56:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c729140a-a6ea-5cdb-874c-9d2dbfa6cd66/c729140a-a6ea-5cdb-874c-9d2dbfa6cd66_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:56:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fc4c7f6f65a8c4c44841f44b2f8b5d87c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/c4c7f6f65a8c4c44841f44b2f8b5d87c/images/large/3.jpg saved to cache
2026-03-26 22:56:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c729140a-a6ea-5cdb-874c-9d2dbfa6cd66
2026-03-26 22:56:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e3fe50>
2026-03-26 22:56:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c729140a-a6ea-5cdb-874c-9d2dbfa6cd66/c729140a-a6ea-5cdb-874c-9d2dbfa6cd66_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:56:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fc4c7f6f65a8c4c44841f44b2f8b5d87c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/c4c7f6f65a8c4c44841f44b2f8b5d87c/images/large/2.jpg saved to cache
2026-03-26 22:56:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c729140a-a6ea-5cdb-874c-9d2dbfa6cd66
2026-03-26 22:56:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/c4c7f6f65a8c4c44841f44b2f8b5d87c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/c4c7f6f65a8c4c44841f44b2f8b5d87c/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: faea3369-91d8-5b91-a94c-ab1ee56c2f75 with identifier: 1985597
2026-03-26 22:56:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: faea3369-91d8-5b91-a94c-ab1ee56c2f75 with identifier: 1985597
2026-03-26 22:56:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: faea3369-91d8-5b91-a94c-ab1ee56c2f75 with identifier: 1985597 to the API
2026-03-26 22:56:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:56:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:56:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bm/1bf15de9cfc240db9f06f33f54b36d53/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.9L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'faea3369-91d8-5b91-a94c-ab1ee56c2f75',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLA',
 'odometer': 85359,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_faea3369-91d8-5b91-a94c-ab1ee56c2f75/faea3369-91d8-5b91-a94c-ab1ee56c2f75_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 671963,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/1bf15de9cfc240db9f06f33f54b36d53/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_faea3369-91d8-5b91-a94c-ab1ee56c2f75/faea3369-91d8-5b91-a94c-ab1ee56c2f75_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 673731,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/1bf15de9cfc240db9f06f33f54b36d53/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_faea3369-91d8-5b91-a94c-ab1ee56c2f75/faea3369-91d8-5b91-a94c-ab1ee56c2f75_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 660184,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/1bf15de9cfc240db9f06f33f54b36d53/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_faea3369-91d8-5b91-a94c-ab1ee56c2f75/faea3369-91d8-5b91-a94c-ab1ee56c2f75_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 691754,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/1bf15de9cfc240db9f06f33f54b36d53/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_faea3369-91d8-5b91-a94c-ab1ee56c2f75/faea3369-91d8-5b91-a94c-ab1ee56c2f75_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 691131,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/1bf15de9cfc240db9f06f33f54b36d53/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_faea3369-91d8-5b91-a94c-ab1ee56c2f75/faea3369-91d8-5b91-a94c-ab1ee56c2f75_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 700281,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/1bf15de9cfc240db9f06f33f54b36d53/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_faea3369-91d8-5b91-a94c-ab1ee56c2f75/faea3369-91d8-5b91-a94c-ab1ee56c2f75_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 641155,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/1bf15de9cfc240db9f06f33f54b36d53/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_faea3369-91d8-5b91-a94c-ab1ee56c2f75/faea3369-91d8-5b91-a94c-ab1ee56c2f75_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 723296,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/1bf15de9cfc240db9f06f33f54b36d53/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_faea3369-91d8-5b91-a94c-ab1ee56c2f75/faea3369-91d8-5b91-a94c-ab1ee56c2f75_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 699759,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/1bf15de9cfc240db9f06f33f54b36d53/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_faea3369-91d8-5b91-a94c-ab1ee56c2f75/faea3369-91d8-5b91-a94c-ab1ee56c2f75_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 705743,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/1bf15de9cfc240db9f06f33f54b36d53/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLA 2.0 CLA 180 D BUSINESS SOLUTION',
 'transmission': 'manual',
 'trim': '2.0 CLA 180 D BUSINESS SOLUTION',
 'vin': None,
 'year': 2022}
2026-03-26 22:56:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985597%27 HTTP/1.1" 200 None
2026-03-26 22:56:01 [ayvens.be] INFO: Saving data for 1985597: {'created_time': 1774565761.943212, 'last_price_update_time': 1774565761.943222, 'auction_closing_time': 1774958400.0}
2026-03-26 22:56:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985597') HTTP/1.1" 204 0
2026-03-26 22:56:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Ff14b11c9cc4a49efa6ede57b3a409911%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/f14b11c9cc4a49efa6ede57b3a409911/images/large/7.jpg not downloaded yet
2026-03-26 22:56:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/c4c7f6f65a8c4c44841f44b2f8b5d87c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/c4c7f6f65a8c4c44841f44b2f8b5d87c/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7ae89d0>
2026-03-26 22:56:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c729140a-a6ea-5cdb-874c-9d2dbfa6cd66/c729140a-a6ea-5cdb-874c-9d2dbfa6cd66_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:56:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fc4c7f6f65a8c4c44841f44b2f8b5d87c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/c4c7f6f65a8c4c44841f44b2f8b5d87c/images/large/5.jpg saved to cache
2026-03-26 22:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c729140a-a6ea-5cdb-874c-9d2dbfa6cd66
2026-03-26 22:56:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79a4150>
2026-03-26 22:56:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c729140a-a6ea-5cdb-874c-9d2dbfa6cd66/c729140a-a6ea-5cdb-874c-9d2dbfa6cd66_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:56:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fc4c7f6f65a8c4c44841f44b2f8b5d87c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/c4c7f6f65a8c4c44841f44b2f8b5d87c/images/large/4.jpg saved to cache
2026-03-26 22:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c729140a-a6ea-5cdb-874c-9d2dbfa6cd66
2026-03-26 22:56:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Ff14b11c9cc4a49efa6ede57b3a409911%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/f14b11c9cc4a49efa6ede57b3a409911/images/large/8.jpg not downloaded yet
2026-03-26 22:56:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7448150>
2026-03-26 22:56:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c729140a-a6ea-5cdb-874c-9d2dbfa6cd66/c729140a-a6ea-5cdb-874c-9d2dbfa6cd66_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:56:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fc4c7f6f65a8c4c44841f44b2f8b5d87c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/c4c7f6f65a8c4c44841f44b2f8b5d87c/images/large/6.jpg saved to cache
2026-03-26 22:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c729140a-a6ea-5cdb-874c-9d2dbfa6cd66
2026-03-26 22:56:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b69650>
2026-03-26 22:56:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c729140a-a6ea-5cdb-874c-9d2dbfa6cd66/c729140a-a6ea-5cdb-874c-9d2dbfa6cd66_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:56:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fc4c7f6f65a8c4c44841f44b2f8b5d87c%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/c4c7f6f65a8c4c44841f44b2f8b5d87c/images/large/10.jpg saved to cache
2026-03-26 22:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c729140a-a6ea-5cdb-874c-9d2dbfa6cd66
2026-03-26 22:56:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/c4c7f6f65a8c4c44841f44b2f8b5d87c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Ff14b11c9cc4a49efa6ede57b3a409911%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/f14b11c9cc4a49efa6ede57b3a409911/images/large/9.jpg not downloaded yet
2026-03-26 22:56:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b8b7d0>
2026-03-26 22:56:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c729140a-a6ea-5cdb-874c-9d2dbfa6cd66/c729140a-a6ea-5cdb-874c-9d2dbfa6cd66_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:56:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fc4c7f6f65a8c4c44841f44b2f8b5d87c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/c4c7f6f65a8c4c44841f44b2f8b5d87c/images/large/8.jpg saved to cache
2026-03-26 22:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c729140a-a6ea-5cdb-874c-9d2dbfa6cd66
2026-03-26 22:56:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74e4f10>
2026-03-26 22:56:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c729140a-a6ea-5cdb-874c-9d2dbfa6cd66/c729140a-a6ea-5cdb-874c-9d2dbfa6cd66_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:56:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fc4c7f6f65a8c4c44841f44b2f8b5d87c%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/c4c7f6f65a8c4c44841f44b2f8b5d87c/images/large/9.jpg saved to cache
2026-03-26 22:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c729140a-a6ea-5cdb-874c-9d2dbfa6cd66
2026-03-26 22:56:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/f14b11c9cc4a49efa6ede57b3a409911/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/f14b11c9cc4a49efa6ede57b3a409911/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Ff14b11c9cc4a49efa6ede57b3a409911%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/f14b11c9cc4a49efa6ede57b3a409911/images/large/10.jpg not downloaded yet
2026-03-26 22:56:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77bf690>
2026-03-26 22:56:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c729140a-a6ea-5cdb-874c-9d2dbfa6cd66/c729140a-a6ea-5cdb-874c-9d2dbfa6cd66_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:56:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fc4c7f6f65a8c4c44841f44b2f8b5d87c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/c4c7f6f65a8c4c44841f44b2f8b5d87c/images/large/7.jpg saved to cache
2026-03-26 22:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c729140a-a6ea-5cdb-874c-9d2dbfa6cd66
2026-03-26 22:56:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c729140a-a6ea-5cdb-874c-9d2dbfa6cd66, skipping ID generation
2026-03-26 22:56:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c729140a-a6ea-5cdb-874c-9d2dbfa6cd66 with scrape type 1
2026-03-26 22:56:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c729140a-a6ea-5cdb-874c-9d2dbfa6cd66 sending to next pipeline
2026-03-26 22:56:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c729140a-a6ea-5cdb-874c-9d2dbfa6cd66, identifier: 1985598
2026-03-26 22:56:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/f14b11c9cc4a49efa6ede57b3a409911/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/f14b11c9cc4a49efa6ede57b3a409911/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:02 [ayvens.be] INFO: Found listing with ID: 1985600
2026-03-26 22:56:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985600%27 HTTP/1.1" 200 None
2026-03-26 22:56:02 [ayvens.be] INFO: Scrape type for 1985600: 1
2026-03-26 22:56:02 [ayvens.be] INFO: Extracting data for car ID: 1985600
2026-03-26 22:56:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 221e3902-9489-55a3-aab9-96890baab06c with identifier: 1985600
2026-03-26 22:56:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 221e3902-9489-55a3-aab9-96890baab06c with scrape type 1
2026-03-26 22:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 221e3902-9489-55a3-aab9-96890baab06c
2026-03-26 22:56:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fe48c6cc650ea4abb8fc104d77edd4e47%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/e48c6cc650ea4abb8fc104d77edd4e47/images/large/1.jpg not downloaded yet
2026-03-26 22:56:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c729140a-a6ea-5cdb-874c-9d2dbfa6cd66 with identifier: 1985598
2026-03-26 22:56:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c729140a-a6ea-5cdb-874c-9d2dbfa6cd66 with identifier: 1985598
2026-03-26 22:56:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c729140a-a6ea-5cdb-874c-9d2dbfa6cd66 with identifier: 1985598 to the API
2026-03-26 22:56:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:56:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:56:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yw/c4c7f6f65a8c4c44841f44b2f8b5d87c/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'c729140a-a6ea-5cdb-874c-9d2dbfa6cd66',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 150408,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c729140a-a6ea-5cdb-874c-9d2dbfa6cd66/c729140a-a6ea-5cdb-874c-9d2dbfa6cd66_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 440281,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/c4c7f6f65a8c4c44841f44b2f8b5d87c/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c729140a-a6ea-5cdb-874c-9d2dbfa6cd66/c729140a-a6ea-5cdb-874c-9d2dbfa6cd66_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 513448,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/c4c7f6f65a8c4c44841f44b2f8b5d87c/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c729140a-a6ea-5cdb-874c-9d2dbfa6cd66/c729140a-a6ea-5cdb-874c-9d2dbfa6cd66_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 440819,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/c4c7f6f65a8c4c44841f44b2f8b5d87c/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c729140a-a6ea-5cdb-874c-9d2dbfa6cd66/c729140a-a6ea-5cdb-874c-9d2dbfa6cd66_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 464419,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/c4c7f6f65a8c4c44841f44b2f8b5d87c/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c729140a-a6ea-5cdb-874c-9d2dbfa6cd66/c729140a-a6ea-5cdb-874c-9d2dbfa6cd66_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 299435,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/c4c7f6f65a8c4c44841f44b2f8b5d87c/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c729140a-a6ea-5cdb-874c-9d2dbfa6cd66/c729140a-a6ea-5cdb-874c-9d2dbfa6cd66_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 314453,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/c4c7f6f65a8c4c44841f44b2f8b5d87c/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c729140a-a6ea-5cdb-874c-9d2dbfa6cd66/c729140a-a6ea-5cdb-874c-9d2dbfa6cd66_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 353854,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/c4c7f6f65a8c4c44841f44b2f8b5d87c/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c729140a-a6ea-5cdb-874c-9d2dbfa6cd66/c729140a-a6ea-5cdb-874c-9d2dbfa6cd66_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 403318,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/c4c7f6f65a8c4c44841f44b2f8b5d87c/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c729140a-a6ea-5cdb-874c-9d2dbfa6cd66/c729140a-a6ea-5cdb-874c-9d2dbfa6cd66_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 257337,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/c4c7f6f65a8c4c44841f44b2f8b5d87c/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c729140a-a6ea-5cdb-874c-9d2dbfa6cd66/c729140a-a6ea-5cdb-874c-9d2dbfa6cd66_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 304046,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/c4c7f6f65a8c4c44841f44b2f8b5d87c/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 1.5 XDRIVE25E PHEV 162KW)',
 'transmission': 'automatic',
 'trim': '1.5 XDRIVE25E PHEV 162KW)',
 'vin': None,
 'year': 2021}
2026-03-26 22:56:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985598%27 HTTP/1.1" 200 None
2026-03-26 22:56:03 [ayvens.be] INFO: Saving data for 1985598: {'created_time': 1774565763.163165, 'last_price_update_time': 1774565763.163177, 'auction_closing_time': 1774958400.0}
2026-03-26 22:56:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985598') HTTP/1.1" 204 0
2026-03-26 22:56:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/f14b11c9cc4a49efa6ede57b3a409911/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/f14b11c9cc4a49efa6ede57b3a409911/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/f14b11c9cc4a49efa6ede57b3a409911/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fe48c6cc650ea4abb8fc104d77edd4e47%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/e48c6cc650ea4abb8fc104d77edd4e47/images/large/2.jpg not downloaded yet
2026-03-26 22:56:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7cccfd0>
2026-03-26 22:56:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b232f238-ff97-549b-a6d4-bacd62f8dff8/b232f238-ff97-549b-a6d4-bacd62f8dff8_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:56:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Ff14b11c9cc4a49efa6ede57b3a409911%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/f14b11c9cc4a49efa6ede57b3a409911/images/large/2.jpg saved to cache
2026-03-26 22:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b232f238-ff97-549b-a6d4-bacd62f8dff8
2026-03-26 22:56:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7a62490>
2026-03-26 22:56:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b232f238-ff97-549b-a6d4-bacd62f8dff8/b232f238-ff97-549b-a6d4-bacd62f8dff8_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:56:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Ff14b11c9cc4a49efa6ede57b3a409911%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/f14b11c9cc4a49efa6ede57b3a409911/images/large/1.jpg saved to cache
2026-03-26 22:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b232f238-ff97-549b-a6d4-bacd62f8dff8
2026-03-26 22:56:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b748b190>
2026-03-26 22:56:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b232f238-ff97-549b-a6d4-bacd62f8dff8/b232f238-ff97-549b-a6d4-bacd62f8dff8_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:56:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Ff14b11c9cc4a49efa6ede57b3a409911%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/f14b11c9cc4a49efa6ede57b3a409911/images/large/3.jpg saved to cache
2026-03-26 22:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b232f238-ff97-549b-a6d4-bacd62f8dff8
2026-03-26 22:56:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79a40d0>
2026-03-26 22:56:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b232f238-ff97-549b-a6d4-bacd62f8dff8/b232f238-ff97-549b-a6d4-bacd62f8dff8_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:56:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Ff14b11c9cc4a49efa6ede57b3a409911%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/f14b11c9cc4a49efa6ede57b3a409911/images/large/5.jpg saved to cache
2026-03-26 22:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b232f238-ff97-549b-a6d4-bacd62f8dff8
2026-03-26 22:56:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fe48c6cc650ea4abb8fc104d77edd4e47%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/e48c6cc650ea4abb8fc104d77edd4e47/images/large/3.jpg not downloaded yet
2026-03-26 22:56:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/f14b11c9cc4a49efa6ede57b3a409911/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fe48c6cc650ea4abb8fc104d77edd4e47%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/e48c6cc650ea4abb8fc104d77edd4e47/images/large/4.jpg not downloaded yet
2026-03-26 22:56:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cbe6d0>
2026-03-26 22:56:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b232f238-ff97-549b-a6d4-bacd62f8dff8/b232f238-ff97-549b-a6d4-bacd62f8dff8_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:56:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Ff14b11c9cc4a49efa6ede57b3a409911%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/f14b11c9cc4a49efa6ede57b3a409911/images/large/4.jpg saved to cache
2026-03-26 22:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b232f238-ff97-549b-a6d4-bacd62f8dff8
2026-03-26 22:56:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74a6c10>
2026-03-26 22:56:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b232f238-ff97-549b-a6d4-bacd62f8dff8/b232f238-ff97-549b-a6d4-bacd62f8dff8_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:56:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Ff14b11c9cc4a49efa6ede57b3a409911%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/f14b11c9cc4a49efa6ede57b3a409911/images/large/7.jpg saved to cache
2026-03-26 22:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b232f238-ff97-549b-a6d4-bacd62f8dff8
2026-03-26 22:56:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7413090>
2026-03-26 22:56:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b232f238-ff97-549b-a6d4-bacd62f8dff8/b232f238-ff97-549b-a6d4-bacd62f8dff8_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:56:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Ff14b11c9cc4a49efa6ede57b3a409911%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/f14b11c9cc4a49efa6ede57b3a409911/images/large/6.jpg saved to cache
2026-03-26 22:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b232f238-ff97-549b-a6d4-bacd62f8dff8
2026-03-26 22:56:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fe48c6cc650ea4abb8fc104d77edd4e47%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/e48c6cc650ea4abb8fc104d77edd4e47/images/large/5.jpg not downloaded yet
2026-03-26 22:56:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7458410>
2026-03-26 22:56:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b232f238-ff97-549b-a6d4-bacd62f8dff8/b232f238-ff97-549b-a6d4-bacd62f8dff8_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:56:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Ff14b11c9cc4a49efa6ede57b3a409911%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/f14b11c9cc4a49efa6ede57b3a409911/images/large/8.jpg saved to cache
2026-03-26 22:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b232f238-ff97-549b-a6d4-bacd62f8dff8
2026-03-26 22:56:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fe48c6cc650ea4abb8fc104d77edd4e47%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/e48c6cc650ea4abb8fc104d77edd4e47/images/large/6.jpg not downloaded yet
2026-03-26 22:56:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/f14b11c9cc4a49efa6ede57b3a409911/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/f14b11c9cc4a49efa6ede57b3a409911/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fe48c6cc650ea4abb8fc104d77edd4e47%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/e48c6cc650ea4abb8fc104d77edd4e47/images/large/7.jpg not downloaded yet
2026-03-26 22:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fe48c6cc650ea4abb8fc104d77edd4e47%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/e48c6cc650ea4abb8fc104d77edd4e47/images/large/8.jpg not downloaded yet
2026-03-26 22:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fe48c6cc650ea4abb8fc104d77edd4e47%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/e48c6cc650ea4abb8fc104d77edd4e47/images/large/9.jpg not downloaded yet
2026-03-26 22:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fe48c6cc650ea4abb8fc104d77edd4e47%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/e48c6cc650ea4abb8fc104d77edd4e47/images/large/10.jpg not downloaded yet
2026-03-26 22:56:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/e48c6cc650ea4abb8fc104d77edd4e47/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/e48c6cc650ea4abb8fc104d77edd4e47/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:04 [ayvens.be] INFO: Found listing with ID: 1985601
2026-03-26 22:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985601%27 HTTP/1.1" 200 None
2026-03-26 22:56:04 [ayvens.be] INFO: Scrape type for 1985601: 1
2026-03-26 22:56:04 [ayvens.be] INFO: Extracting data for car ID: 1985601
2026-03-26 22:56:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aeb29561-e158-5223-bfca-38b14132c135 with identifier: 1985601
2026-03-26 22:56:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aeb29561-e158-5223-bfca-38b14132c135 with scrape type 1
2026-03-26 22:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item aeb29561-e158-5223-bfca-38b14132c135
2026-03-26 22:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fe2d4cebe45cf4154acd39a0b08cf2872%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/e2d4cebe45cf4154acd39a0b08cf2872/images/large/1.jpg not downloaded yet
2026-03-26 22:56:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/e48c6cc650ea4abb8fc104d77edd4e47/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fe2d4cebe45cf4154acd39a0b08cf2872%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/e2d4cebe45cf4154acd39a0b08cf2872/images/large/2.jpg not downloaded yet
2026-03-26 22:56:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79a0650>
2026-03-26 22:56:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b232f238-ff97-549b-a6d4-bacd62f8dff8/b232f238-ff97-549b-a6d4-bacd62f8dff8_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Ff14b11c9cc4a49efa6ede57b3a409911%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/f14b11c9cc4a49efa6ede57b3a409911/images/large/9.jpg saved to cache
2026-03-26 22:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b232f238-ff97-549b-a6d4-bacd62f8dff8
2026-03-26 22:56:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7407dd0>
2026-03-26 22:56:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b232f238-ff97-549b-a6d4-bacd62f8dff8/b232f238-ff97-549b-a6d4-bacd62f8dff8_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Ff14b11c9cc4a49efa6ede57b3a409911%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/f14b11c9cc4a49efa6ede57b3a409911/images/large/10.jpg saved to cache
2026-03-26 22:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b232f238-ff97-549b-a6d4-bacd62f8dff8
2026-03-26 22:56:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b232f238-ff97-549b-a6d4-bacd62f8dff8, skipping ID generation
2026-03-26 22:56:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b232f238-ff97-549b-a6d4-bacd62f8dff8 with scrape type 1
2026-03-26 22:56:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b232f238-ff97-549b-a6d4-bacd62f8dff8 sending to next pipeline
2026-03-26 22:56:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b232f238-ff97-549b-a6d4-bacd62f8dff8, identifier: 1985599
2026-03-26 22:56:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6dd8210>
2026-03-26 22:56:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_221e3902-9489-55a3-aab9-96890baab06c/221e3902-9489-55a3-aab9-96890baab06c_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fe48c6cc650ea4abb8fc104d77edd4e47%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/e48c6cc650ea4abb8fc104d77edd4e47/images/large/2.jpg saved to cache
2026-03-26 22:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 221e3902-9489-55a3-aab9-96890baab06c
2026-03-26 22:56:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b748a690>
2026-03-26 22:56:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_221e3902-9489-55a3-aab9-96890baab06c/221e3902-9489-55a3-aab9-96890baab06c_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fe48c6cc650ea4abb8fc104d77edd4e47%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/e48c6cc650ea4abb8fc104d77edd4e47/images/large/1.jpg saved to cache
2026-03-26 22:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 221e3902-9489-55a3-aab9-96890baab06c
2026-03-26 22:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fe2d4cebe45cf4154acd39a0b08cf2872%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/e2d4cebe45cf4154acd39a0b08cf2872/images/large/3.jpg not downloaded yet
2026-03-26 22:56:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b232f238-ff97-549b-a6d4-bacd62f8dff8 with identifier: 1985599
2026-03-26 22:56:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b232f238-ff97-549b-a6d4-bacd62f8dff8 with identifier: 1985599
2026-03-26 22:56:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b232f238-ff97-549b-a6d4-bacd62f8dff8 with identifier: 1985599 to the API
2026-03-26 22:56:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:56:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:56:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bj/f14b11c9cc4a49efa6ede57b3a409911/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'b232f238-ff97-549b-a6d4-bacd62f8dff8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '5 SERIES BERLINE',
 'odometer': 154342,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b232f238-ff97-549b-a6d4-bacd62f8dff8/b232f238-ff97-549b-a6d4-bacd62f8dff8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 479230,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/f14b11c9cc4a49efa6ede57b3a409911/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b232f238-ff97-549b-a6d4-bacd62f8dff8/b232f238-ff97-549b-a6d4-bacd62f8dff8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 451490,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/f14b11c9cc4a49efa6ede57b3a409911/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b232f238-ff97-549b-a6d4-bacd62f8dff8/b232f238-ff97-549b-a6d4-bacd62f8dff8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 505858,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/f14b11c9cc4a49efa6ede57b3a409911/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b232f238-ff97-549b-a6d4-bacd62f8dff8/b232f238-ff97-549b-a6d4-bacd62f8dff8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 497842,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/f14b11c9cc4a49efa6ede57b3a409911/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b232f238-ff97-549b-a6d4-bacd62f8dff8/b232f238-ff97-549b-a6d4-bacd62f8dff8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 355221,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/f14b11c9cc4a49efa6ede57b3a409911/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b232f238-ff97-549b-a6d4-bacd62f8dff8/b232f238-ff97-549b-a6d4-bacd62f8dff8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 280177,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/f14b11c9cc4a49efa6ede57b3a409911/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b232f238-ff97-549b-a6d4-bacd62f8dff8/b232f238-ff97-549b-a6d4-bacd62f8dff8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 320755,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/f14b11c9cc4a49efa6ede57b3a409911/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b232f238-ff97-549b-a6d4-bacd62f8dff8/b232f238-ff97-549b-a6d4-bacd62f8dff8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 369650,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/f14b11c9cc4a49efa6ede57b3a409911/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b232f238-ff97-549b-a6d4-bacd62f8dff8/b232f238-ff97-549b-a6d4-bacd62f8dff8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 402609,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/f14b11c9cc4a49efa6ede57b3a409911/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b232f238-ff97-549b-a6d4-bacd62f8dff8/b232f238-ff97-549b-a6d4-bacd62f8dff8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 459128,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/f14b11c9cc4a49efa6ede57b3a409911/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 5 SERIES BERLINE 2.0 530E 185KW AUTO',
 'transmission': 'automatic',
 'trim': '2.0 530E 185KW AUTO',
 'vin': None,
 'year': 2021}
2026-03-26 22:56:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985599%27 HTTP/1.1" 200 None
2026-03-26 22:56:05 [ayvens.be] INFO: Saving data for 1985599: {'created_time': 1774565765.164061, 'last_price_update_time': 1774565765.16407, 'auction_closing_time': 1774958400.0}
2026-03-26 22:56:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985599') HTTP/1.1" 204 0
2026-03-26 22:56:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fe2d4cebe45cf4154acd39a0b08cf2872%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/e2d4cebe45cf4154acd39a0b08cf2872/images/large/4.jpg not downloaded yet
2026-03-26 22:56:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b75845d0>
2026-03-26 22:56:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_221e3902-9489-55a3-aab9-96890baab06c/221e3902-9489-55a3-aab9-96890baab06c_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:56:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fe48c6cc650ea4abb8fc104d77edd4e47%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/e48c6cc650ea4abb8fc104d77edd4e47/images/large/3.jpg saved to cache
2026-03-26 22:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 221e3902-9489-55a3-aab9-96890baab06c
2026-03-26 22:56:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fe2d4cebe45cf4154acd39a0b08cf2872%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/e2d4cebe45cf4154acd39a0b08cf2872/images/large/5.jpg not downloaded yet
2026-03-26 22:56:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fe2d4cebe45cf4154acd39a0b08cf2872%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/e2d4cebe45cf4154acd39a0b08cf2872/images/large/6.jpg not downloaded yet
2026-03-26 22:56:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/e48c6cc650ea4abb8fc104d77edd4e47/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/e48c6cc650ea4abb8fc104d77edd4e47/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fe2d4cebe45cf4154acd39a0b08cf2872%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/e2d4cebe45cf4154acd39a0b08cf2872/images/large/7.jpg not downloaded yet
2026-03-26 22:56:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/e48c6cc650ea4abb8fc104d77edd4e47/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/e48c6cc650ea4abb8fc104d77edd4e47/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/e48c6cc650ea4abb8fc104d77edd4e47/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fe2d4cebe45cf4154acd39a0b08cf2872%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/e2d4cebe45cf4154acd39a0b08cf2872/images/large/8.jpg not downloaded yet
2026-03-26 22:56:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/e48c6cc650ea4abb8fc104d77edd4e47/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fe2d4cebe45cf4154acd39a0b08cf2872%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/e2d4cebe45cf4154acd39a0b08cf2872/images/large/9.jpg not downloaded yet
2026-03-26 22:56:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/e48c6cc650ea4abb8fc104d77edd4e47/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/e2d4cebe45cf4154acd39a0b08cf2872/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fe2d4cebe45cf4154acd39a0b08cf2872%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/e2d4cebe45cf4154acd39a0b08cf2872/images/large/10.jpg not downloaded yet
2026-03-26 22:56:05 [ayvens.be] INFO: Found listing with ID: 1985602
2026-03-26 22:56:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985602%27 HTTP/1.1" 200 None
2026-03-26 22:56:05 [ayvens.be] INFO: Scrape type for 1985602: 1
2026-03-26 22:56:05 [ayvens.be] INFO: Extracting data for car ID: 1985602
2026-03-26 22:56:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f5926a4-868d-51d5-b909-123e0d888f17 with identifier: 1985602
2026-03-26 22:56:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f5926a4-868d-51d5-b909-123e0d888f17 with scrape type 1
2026-03-26 22:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0f5926a4-868d-51d5-b909-123e0d888f17
2026-03-26 22:56:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F45b1fd86ba3f41d5ab91001ba7193c52%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/45b1fd86ba3f41d5ab91001ba7193c52/images/large/1.jpg not downloaded yet
2026-03-26 22:56:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7502c90>
2026-03-26 22:56:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_221e3902-9489-55a3-aab9-96890baab06c/221e3902-9489-55a3-aab9-96890baab06c_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:56:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fe48c6cc650ea4abb8fc104d77edd4e47%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/e48c6cc650ea4abb8fc104d77edd4e47/images/large/7.jpg saved to cache
2026-03-26 22:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 221e3902-9489-55a3-aab9-96890baab06c
2026-03-26 22:56:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F45b1fd86ba3f41d5ab91001ba7193c52%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/45b1fd86ba3f41d5ab91001ba7193c52/images/large/2.jpg not downloaded yet
2026-03-26 22:56:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bead6e90>
2026-03-26 22:56:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_221e3902-9489-55a3-aab9-96890baab06c/221e3902-9489-55a3-aab9-96890baab06c_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:56:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fe48c6cc650ea4abb8fc104d77edd4e47%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/e48c6cc650ea4abb8fc104d77edd4e47/images/large/6.jpg saved to cache
2026-03-26 22:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 221e3902-9489-55a3-aab9-96890baab06c
2026-03-26 22:56:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F45b1fd86ba3f41d5ab91001ba7193c52%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/45b1fd86ba3f41d5ab91001ba7193c52/images/large/3.jpg not downloaded yet
2026-03-26 22:56:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6def4d0>
2026-03-26 22:56:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_221e3902-9489-55a3-aab9-96890baab06c/221e3902-9489-55a3-aab9-96890baab06c_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:56:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fe48c6cc650ea4abb8fc104d77edd4e47%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/e48c6cc650ea4abb8fc104d77edd4e47/images/large/5.jpg saved to cache
2026-03-26 22:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 221e3902-9489-55a3-aab9-96890baab06c
2026-03-26 22:56:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b740ba50>
2026-03-26 22:56:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_221e3902-9489-55a3-aab9-96890baab06c/221e3902-9489-55a3-aab9-96890baab06c_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:56:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fe48c6cc650ea4abb8fc104d77edd4e47%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/e48c6cc650ea4abb8fc104d77edd4e47/images/large/4.jpg saved to cache
2026-03-26 22:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 221e3902-9489-55a3-aab9-96890baab06c
2026-03-26 22:56:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77bf410>
2026-03-26 22:56:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_221e3902-9489-55a3-aab9-96890baab06c/221e3902-9489-55a3-aab9-96890baab06c_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fe48c6cc650ea4abb8fc104d77edd4e47%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/e48c6cc650ea4abb8fc104d77edd4e47/images/large/8.jpg saved to cache
2026-03-26 22:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 221e3902-9489-55a3-aab9-96890baab06c
2026-03-26 22:56:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6dd8210>
2026-03-26 22:56:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_221e3902-9489-55a3-aab9-96890baab06c/221e3902-9489-55a3-aab9-96890baab06c_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fe48c6cc650ea4abb8fc104d77edd4e47%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/e48c6cc650ea4abb8fc104d77edd4e47/images/large/10.jpg saved to cache
2026-03-26 22:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 221e3902-9489-55a3-aab9-96890baab06c
2026-03-26 22:56:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6d81490>
2026-03-26 22:56:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_221e3902-9489-55a3-aab9-96890baab06c/221e3902-9489-55a3-aab9-96890baab06c_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fe48c6cc650ea4abb8fc104d77edd4e47%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/e48c6cc650ea4abb8fc104d77edd4e47/images/large/9.jpg saved to cache
2026-03-26 22:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 221e3902-9489-55a3-aab9-96890baab06c
2026-03-26 22:56:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 221e3902-9489-55a3-aab9-96890baab06c, skipping ID generation
2026-03-26 22:56:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 221e3902-9489-55a3-aab9-96890baab06c with scrape type 1
2026-03-26 22:56:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 221e3902-9489-55a3-aab9-96890baab06c sending to next pipeline
2026-03-26 22:56:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 221e3902-9489-55a3-aab9-96890baab06c, identifier: 1985600
2026-03-26 22:56:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b787c410>
2026-03-26 22:56:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aeb29561-e158-5223-bfca-38b14132c135/aeb29561-e158-5223-bfca-38b14132c135_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fe2d4cebe45cf4154acd39a0b08cf2872%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/e2d4cebe45cf4154acd39a0b08cf2872/images/large/1.jpg saved to cache
2026-03-26 22:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item aeb29561-e158-5223-bfca-38b14132c135
2026-03-26 22:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F45b1fd86ba3f41d5ab91001ba7193c52%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/45b1fd86ba3f41d5ab91001ba7193c52/images/large/4.jpg not downloaded yet
2026-03-26 22:56:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 221e3902-9489-55a3-aab9-96890baab06c with identifier: 1985600
2026-03-26 22:56:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 221e3902-9489-55a3-aab9-96890baab06c with identifier: 1985600
2026-03-26 22:56:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 221e3902-9489-55a3-aab9-96890baab06c with identifier: 1985600 to the API
2026-03-26 22:56:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:56:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:56:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bp/e48c6cc650ea4abb8fc104d77edd4e47/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '221e3902-9489-55a3-aab9-96890baab06c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A3 BERLINE',
 'odometer': 101350,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_221e3902-9489-55a3-aab9-96890baab06c/221e3902-9489-55a3-aab9-96890baab06c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 740292,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/e48c6cc650ea4abb8fc104d77edd4e47/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_221e3902-9489-55a3-aab9-96890baab06c/221e3902-9489-55a3-aab9-96890baab06c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 746548,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/e48c6cc650ea4abb8fc104d77edd4e47/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_221e3902-9489-55a3-aab9-96890baab06c/221e3902-9489-55a3-aab9-96890baab06c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 732998,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/e48c6cc650ea4abb8fc104d77edd4e47/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_221e3902-9489-55a3-aab9-96890baab06c/221e3902-9489-55a3-aab9-96890baab06c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 766304,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/e48c6cc650ea4abb8fc104d77edd4e47/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_221e3902-9489-55a3-aab9-96890baab06c/221e3902-9489-55a3-aab9-96890baab06c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 736768,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/e48c6cc650ea4abb8fc104d77edd4e47/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_221e3902-9489-55a3-aab9-96890baab06c/221e3902-9489-55a3-aab9-96890baab06c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 715086,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/e48c6cc650ea4abb8fc104d77edd4e47/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_221e3902-9489-55a3-aab9-96890baab06c/221e3902-9489-55a3-aab9-96890baab06c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 630560,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/e48c6cc650ea4abb8fc104d77edd4e47/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_221e3902-9489-55a3-aab9-96890baab06c/221e3902-9489-55a3-aab9-96890baab06c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 806790,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/e48c6cc650ea4abb8fc104d77edd4e47/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_221e3902-9489-55a3-aab9-96890baab06c/221e3902-9489-55a3-aab9-96890baab06c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 810742,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/e48c6cc650ea4abb8fc104d77edd4e47/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_221e3902-9489-55a3-aab9-96890baab06c/221e3902-9489-55a3-aab9-96890baab06c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 700226,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/e48c6cc650ea4abb8fc104d77edd4e47/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A3 BERLINE 1.0 TFSI 30 81KW ATTRACTION',
 'transmission': 'manual',
 'trim': '1.0 TFSI 30 81KW ATTRACTION',
 'vin': None,
 'year': 2022}
2026-03-26 22:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985600%27 HTTP/1.1" 200 None
2026-03-26 22:56:06 [ayvens.be] INFO: Saving data for 1985600: {'created_time': 1774565766.828976, 'last_price_update_time': 1774565766.828987, 'auction_closing_time': 1774958400.0}
2026-03-26 22:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985600') HTTP/1.1" 204 0
2026-03-26 22:56:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/e2d4cebe45cf4154acd39a0b08cf2872/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:06 [scrapy.extensions.logstats] INFO: Crawled 8 pages (at -5 pages/min), scraped 381 items (at 36 items/min)
2026-03-26 22:56:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 182MiB
2026-03-26 22:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F45b1fd86ba3f41d5ab91001ba7193c52%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/45b1fd86ba3f41d5ab91001ba7193c52/images/large/5.jpg not downloaded yet
2026-03-26 22:56:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/e2d4cebe45cf4154acd39a0b08cf2872/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F45b1fd86ba3f41d5ab91001ba7193c52%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/45b1fd86ba3f41d5ab91001ba7193c52/images/large/6.jpg not downloaded yet
2026-03-26 22:56:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/e2d4cebe45cf4154acd39a0b08cf2872/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/e2d4cebe45cf4154acd39a0b08cf2872/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F45b1fd86ba3f41d5ab91001ba7193c52%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/45b1fd86ba3f41d5ab91001ba7193c52/images/large/7.jpg not downloaded yet
2026-03-26 22:56:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/e2d4cebe45cf4154acd39a0b08cf2872/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/e2d4cebe45cf4154acd39a0b08cf2872/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/e2d4cebe45cf4154acd39a0b08cf2872/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F45b1fd86ba3f41d5ab91001ba7193c52%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/45b1fd86ba3f41d5ab91001ba7193c52/images/large/8.jpg not downloaded yet
2026-03-26 22:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F45b1fd86ba3f41d5ab91001ba7193c52%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/45b1fd86ba3f41d5ab91001ba7193c52/images/large/9.jpg not downloaded yet
2026-03-26 22:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F45b1fd86ba3f41d5ab91001ba7193c52%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/45b1fd86ba3f41d5ab91001ba7193c52/images/large/10.jpg not downloaded yet
2026-03-26 22:56:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77adf10>
2026-03-26 22:56:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aeb29561-e158-5223-bfca-38b14132c135/aeb29561-e158-5223-bfca-38b14132c135_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fe2d4cebe45cf4154acd39a0b08cf2872%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/e2d4cebe45cf4154acd39a0b08cf2872/images/large/2.jpg saved to cache
2026-03-26 22:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item aeb29561-e158-5223-bfca-38b14132c135
2026-03-26 22:56:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/45b1fd86ba3f41d5ab91001ba7193c52/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/45b1fd86ba3f41d5ab91001ba7193c52/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:07 [ayvens.be] INFO: Found listing with ID: 1985603
2026-03-26 22:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985603%27 HTTP/1.1" 200 None
2026-03-26 22:56:07 [ayvens.be] INFO: Scrape type for 1985603: 1
2026-03-26 22:56:07 [ayvens.be] INFO: Extracting data for car ID: 1985603
2026-03-26 22:56:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5 with identifier: 1985603
2026-03-26 22:56:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5 with scrape type 1
2026-03-26 22:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5
2026-03-26 22:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fba5c2ca03d8446209edf1284da20e64c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/ba5c2ca03d8446209edf1284da20e64c/images/large/1.jpg not downloaded yet
2026-03-26 22:56:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77afa50>
2026-03-26 22:56:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aeb29561-e158-5223-bfca-38b14132c135/aeb29561-e158-5223-bfca-38b14132c135_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fe2d4cebe45cf4154acd39a0b08cf2872%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/e2d4cebe45cf4154acd39a0b08cf2872/images/large/4.jpg saved to cache
2026-03-26 22:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item aeb29561-e158-5223-bfca-38b14132c135
2026-03-26 22:56:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/45b1fd86ba3f41d5ab91001ba7193c52/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fba5c2ca03d8446209edf1284da20e64c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/ba5c2ca03d8446209edf1284da20e64c/images/large/2.jpg not downloaded yet
2026-03-26 22:56:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7725c90>
2026-03-26 22:56:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aeb29561-e158-5223-bfca-38b14132c135/aeb29561-e158-5223-bfca-38b14132c135_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fe2d4cebe45cf4154acd39a0b08cf2872%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/e2d4cebe45cf4154acd39a0b08cf2872/images/large/6.jpg saved to cache
2026-03-26 22:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item aeb29561-e158-5223-bfca-38b14132c135
2026-03-26 22:56:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c7f610>
2026-03-26 22:56:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aeb29561-e158-5223-bfca-38b14132c135/aeb29561-e158-5223-bfca-38b14132c135_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fe2d4cebe45cf4154acd39a0b08cf2872%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/e2d4cebe45cf4154acd39a0b08cf2872/images/large/8.jpg saved to cache
2026-03-26 22:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item aeb29561-e158-5223-bfca-38b14132c135
2026-03-26 22:56:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79cfa50>
2026-03-26 22:56:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aeb29561-e158-5223-bfca-38b14132c135/aeb29561-e158-5223-bfca-38b14132c135_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fe2d4cebe45cf4154acd39a0b08cf2872%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/e2d4cebe45cf4154acd39a0b08cf2872/images/large/7.jpg saved to cache
2026-03-26 22:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item aeb29561-e158-5223-bfca-38b14132c135
2026-03-26 22:56:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7aa3ad0>
2026-03-26 22:56:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aeb29561-e158-5223-bfca-38b14132c135/aeb29561-e158-5223-bfca-38b14132c135_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fe2d4cebe45cf4154acd39a0b08cf2872%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/e2d4cebe45cf4154acd39a0b08cf2872/images/large/3.jpg saved to cache
2026-03-26 22:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item aeb29561-e158-5223-bfca-38b14132c135
2026-03-26 22:56:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7745590>
2026-03-26 22:56:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aeb29561-e158-5223-bfca-38b14132c135/aeb29561-e158-5223-bfca-38b14132c135_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fe2d4cebe45cf4154acd39a0b08cf2872%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/e2d4cebe45cf4154acd39a0b08cf2872/images/large/5.jpg saved to cache
2026-03-26 22:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item aeb29561-e158-5223-bfca-38b14132c135
2026-03-26 22:56:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/45b1fd86ba3f41d5ab91001ba7193c52/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7aa2ed0>
2026-03-26 22:56:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f5926a4-868d-51d5-b909-123e0d888f17/0f5926a4-868d-51d5-b909-123e0d888f17_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F45b1fd86ba3f41d5ab91001ba7193c52%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/45b1fd86ba3f41d5ab91001ba7193c52/images/large/3.jpg saved to cache
2026-03-26 22:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0f5926a4-868d-51d5-b909-123e0d888f17
2026-03-26 22:56:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74ce250>
2026-03-26 22:56:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f5926a4-868d-51d5-b909-123e0d888f17/0f5926a4-868d-51d5-b909-123e0d888f17_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F45b1fd86ba3f41d5ab91001ba7193c52%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/45b1fd86ba3f41d5ab91001ba7193c52/images/large/2.jpg saved to cache
2026-03-26 22:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0f5926a4-868d-51d5-b909-123e0d888f17
2026-03-26 22:56:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/45b1fd86ba3f41d5ab91001ba7193c52/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fba5c2ca03d8446209edf1284da20e64c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/ba5c2ca03d8446209edf1284da20e64c/images/large/3.jpg not downloaded yet
2026-03-26 22:56:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7585010>
2026-03-26 22:56:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f5926a4-868d-51d5-b909-123e0d888f17/0f5926a4-868d-51d5-b909-123e0d888f17_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F45b1fd86ba3f41d5ab91001ba7193c52%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/45b1fd86ba3f41d5ab91001ba7193c52/images/large/1.jpg saved to cache
2026-03-26 22:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0f5926a4-868d-51d5-b909-123e0d888f17
2026-03-26 22:56:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/45b1fd86ba3f41d5ab91001ba7193c52/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fba5c2ca03d8446209edf1284da20e64c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/ba5c2ca03d8446209edf1284da20e64c/images/large/4.jpg not downloaded yet
2026-03-26 22:56:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e1f7d0>
2026-03-26 22:56:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f5926a4-868d-51d5-b909-123e0d888f17/0f5926a4-868d-51d5-b909-123e0d888f17_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F45b1fd86ba3f41d5ab91001ba7193c52%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/45b1fd86ba3f41d5ab91001ba7193c52/images/large/4.jpg saved to cache
2026-03-26 22:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0f5926a4-868d-51d5-b909-123e0d888f17
2026-03-26 22:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fba5c2ca03d8446209edf1284da20e64c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/ba5c2ca03d8446209edf1284da20e64c/images/large/5.jpg not downloaded yet
2026-03-26 22:56:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/e2d4cebe45cf4154acd39a0b08cf2872/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/45b1fd86ba3f41d5ab91001ba7193c52/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/45b1fd86ba3f41d5ab91001ba7193c52/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/45b1fd86ba3f41d5ab91001ba7193c52/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fba5c2ca03d8446209edf1284da20e64c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/ba5c2ca03d8446209edf1284da20e64c/images/large/6.jpg not downloaded yet
2026-03-26 22:56:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7415050>
2026-03-26 22:56:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f5926a4-868d-51d5-b909-123e0d888f17/0f5926a4-868d-51d5-b909-123e0d888f17_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F45b1fd86ba3f41d5ab91001ba7193c52%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/45b1fd86ba3f41d5ab91001ba7193c52/images/large/5.jpg saved to cache
2026-03-26 22:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0f5926a4-868d-51d5-b909-123e0d888f17
2026-03-26 22:56:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/e2d4cebe45cf4154acd39a0b08cf2872/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fba5c2ca03d8446209edf1284da20e64c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/ba5c2ca03d8446209edf1284da20e64c/images/large/7.jpg not downloaded yet
2026-03-26 22:56:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7417050>
2026-03-26 22:56:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f5926a4-868d-51d5-b909-123e0d888f17/0f5926a4-868d-51d5-b909-123e0d888f17_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F45b1fd86ba3f41d5ab91001ba7193c52%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/45b1fd86ba3f41d5ab91001ba7193c52/images/large/6.jpg saved to cache
2026-03-26 22:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0f5926a4-868d-51d5-b909-123e0d888f17
2026-03-26 22:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fba5c2ca03d8446209edf1284da20e64c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/ba5c2ca03d8446209edf1284da20e64c/images/large/8.jpg not downloaded yet
2026-03-26 22:56:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6d73b10>
2026-03-26 22:56:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aeb29561-e158-5223-bfca-38b14132c135/aeb29561-e158-5223-bfca-38b14132c135_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fe2d4cebe45cf4154acd39a0b08cf2872%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/e2d4cebe45cf4154acd39a0b08cf2872/images/large/10.jpg saved to cache
2026-03-26 22:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item aeb29561-e158-5223-bfca-38b14132c135
2026-03-26 22:56:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e295d0>
2026-03-26 22:56:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f5926a4-868d-51d5-b909-123e0d888f17/0f5926a4-868d-51d5-b909-123e0d888f17_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F45b1fd86ba3f41d5ab91001ba7193c52%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/45b1fd86ba3f41d5ab91001ba7193c52/images/large/10.jpg saved to cache
2026-03-26 22:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0f5926a4-868d-51d5-b909-123e0d888f17
2026-03-26 22:56:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7500050>
2026-03-26 22:56:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f5926a4-868d-51d5-b909-123e0d888f17/0f5926a4-868d-51d5-b909-123e0d888f17_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F45b1fd86ba3f41d5ab91001ba7193c52%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/45b1fd86ba3f41d5ab91001ba7193c52/images/large/9.jpg saved to cache
2026-03-26 22:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0f5926a4-868d-51d5-b909-123e0d888f17
2026-03-26 22:56:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e16250>
2026-03-26 22:56:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f5926a4-868d-51d5-b909-123e0d888f17/0f5926a4-868d-51d5-b909-123e0d888f17_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F45b1fd86ba3f41d5ab91001ba7193c52%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/45b1fd86ba3f41d5ab91001ba7193c52/images/large/8.jpg saved to cache
2026-03-26 22:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0f5926a4-868d-51d5-b909-123e0d888f17
2026-03-26 22:56:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/45b1fd86ba3f41d5ab91001ba7193c52/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fba5c2ca03d8446209edf1284da20e64c%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/ba5c2ca03d8446209edf1284da20e64c/images/large/9.jpg not downloaded yet
2026-03-26 22:56:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7500210>
2026-03-26 22:56:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aeb29561-e158-5223-bfca-38b14132c135/aeb29561-e158-5223-bfca-38b14132c135_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fe2d4cebe45cf4154acd39a0b08cf2872%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/e2d4cebe45cf4154acd39a0b08cf2872/images/large/9.jpg saved to cache
2026-03-26 22:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item aeb29561-e158-5223-bfca-38b14132c135
2026-03-26 22:56:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: aeb29561-e158-5223-bfca-38b14132c135, skipping ID generation
2026-03-26 22:56:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aeb29561-e158-5223-bfca-38b14132c135 with scrape type 1
2026-03-26 22:56:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item aeb29561-e158-5223-bfca-38b14132c135 sending to next pipeline
2026-03-26 22:56:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: aeb29561-e158-5223-bfca-38b14132c135, identifier: 1985601
2026-03-26 22:56:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: aeb29561-e158-5223-bfca-38b14132c135 with identifier: 1985601
2026-03-26 22:56:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: aeb29561-e158-5223-bfca-38b14132c135 with identifier: 1985601
2026-03-26 22:56:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: aeb29561-e158-5223-bfca-38b14132c135 with identifier: 1985601 to the API
2026-03-26 22:56:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:56:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:56:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bd/e2d4cebe45cf4154acd39a0b08cf2872/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'aeb29561-e158-5223-bfca-38b14132c135',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLASS A (W177)',
 'odometer': 63948,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 19,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aeb29561-e158-5223-bfca-38b14132c135/aeb29561-e158-5223-bfca-38b14132c135_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 654374,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/e2d4cebe45cf4154acd39a0b08cf2872/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aeb29561-e158-5223-bfca-38b14132c135/aeb29561-e158-5223-bfca-38b14132c135_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 660819,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/e2d4cebe45cf4154acd39a0b08cf2872/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aeb29561-e158-5223-bfca-38b14132c135/aeb29561-e158-5223-bfca-38b14132c135_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 731436,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/e2d4cebe45cf4154acd39a0b08cf2872/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aeb29561-e158-5223-bfca-38b14132c135/aeb29561-e158-5223-bfca-38b14132c135_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 680047,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/e2d4cebe45cf4154acd39a0b08cf2872/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aeb29561-e158-5223-bfca-38b14132c135/aeb29561-e158-5223-bfca-38b14132c135_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 708007,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/e2d4cebe45cf4154acd39a0b08cf2872/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aeb29561-e158-5223-bfca-38b14132c135/aeb29561-e158-5223-bfca-38b14132c135_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 643685,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/e2d4cebe45cf4154acd39a0b08cf2872/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aeb29561-e158-5223-bfca-38b14132c135/aeb29561-e158-5223-bfca-38b14132c135_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 736738,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/e2d4cebe45cf4154acd39a0b08cf2872/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aeb29561-e158-5223-bfca-38b14132c135/aeb29561-e158-5223-bfca-38b14132c135_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 694851,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/e2d4cebe45cf4154acd39a0b08cf2872/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aeb29561-e158-5223-bfca-38b14132c135/aeb29561-e158-5223-bfca-38b14132c135_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 762411,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/e2d4cebe45cf4154acd39a0b08cf2872/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aeb29561-e158-5223-bfca-38b14132c135/aeb29561-e158-5223-bfca-38b14132c135_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 634646,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/e2d4cebe45cf4154acd39a0b08cf2872/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLASS A (W177) A 250 e PHEV Business Solution',
 'transmission': 'automatic',
 'trim': 'A 250 e PHEV Business Solution',
 'vin': None,
 'year': 2021}
2026-03-26 22:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985601%27 HTTP/1.1" 200 None
2026-03-26 22:56:09 [ayvens.be] INFO: Saving data for 1985601: {'created_time': 1774565769.562802, 'last_price_update_time': 1774565769.562813, 'auction_closing_time': 1774958400.0}
2026-03-26 22:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985601') HTTP/1.1" 204 0
2026-03-26 22:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fba5c2ca03d8446209edf1284da20e64c%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/ba5c2ca03d8446209edf1284da20e64c/images/large/10.jpg not downloaded yet
2026-03-26 22:56:09 [ayvens.be] INFO: Found listing with ID: 1985604
2026-03-26 22:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985604%27 HTTP/1.1" 200 None
2026-03-26 22:56:09 [ayvens.be] INFO: Scrape type for 1985604: 1
2026-03-26 22:56:09 [ayvens.be] INFO: Extracting data for car ID: 1985604
2026-03-26 22:56:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 81745107-cd5b-55d7-b04b-60f6322262e6 with identifier: 1985604
2026-03-26 22:56:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 81745107-cd5b-55d7-b04b-60f6322262e6 with scrape type 1
2026-03-26 22:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 81745107-cd5b-55d7-b04b-60f6322262e6
2026-03-26 22:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2am%252F6806335b85b1470e9f46c18606501d38%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2am/6806335b85b1470e9f46c18606501d38/images/large/1.jpg not downloaded yet
2026-03-26 22:56:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7413f50>
2026-03-26 22:56:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f5926a4-868d-51d5-b909-123e0d888f17/0f5926a4-868d-51d5-b909-123e0d888f17_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F45b1fd86ba3f41d5ab91001ba7193c52%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/45b1fd86ba3f41d5ab91001ba7193c52/images/large/7.jpg saved to cache
2026-03-26 22:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0f5926a4-868d-51d5-b909-123e0d888f17
2026-03-26 22:56:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0f5926a4-868d-51d5-b909-123e0d888f17, skipping ID generation
2026-03-26 22:56:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f5926a4-868d-51d5-b909-123e0d888f17 with scrape type 1
2026-03-26 22:56:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0f5926a4-868d-51d5-b909-123e0d888f17 sending to next pipeline
2026-03-26 22:56:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 0f5926a4-868d-51d5-b909-123e0d888f17, identifier: 1985602
2026-03-26 22:56:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/ba5c2ca03d8446209edf1284da20e64c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 0f5926a4-868d-51d5-b909-123e0d888f17 with identifier: 1985602
2026-03-26 22:56:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 0f5926a4-868d-51d5-b909-123e0d888f17 with identifier: 1985602
2026-03-26 22:56:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 0f5926a4-868d-51d5-b909-123e0d888f17 with identifier: 1985602 to the API
2026-03-26 22:56:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:56:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:56:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bl/45b1fd86ba3f41d5ab91001ba7193c52/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '0f5926a4-868d-51d5-b909-123e0d888f17',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'CAPTUR',
 'odometer': 114303,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f5926a4-868d-51d5-b909-123e0d888f17/0f5926a4-868d-51d5-b909-123e0d888f17_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 248692,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/45b1fd86ba3f41d5ab91001ba7193c52/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f5926a4-868d-51d5-b909-123e0d888f17/0f5926a4-868d-51d5-b909-123e0d888f17_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 241319,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/45b1fd86ba3f41d5ab91001ba7193c52/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f5926a4-868d-51d5-b909-123e0d888f17/0f5926a4-868d-51d5-b909-123e0d888f17_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 244644,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/45b1fd86ba3f41d5ab91001ba7193c52/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f5926a4-868d-51d5-b909-123e0d888f17/0f5926a4-868d-51d5-b909-123e0d888f17_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 245050,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/45b1fd86ba3f41d5ab91001ba7193c52/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f5926a4-868d-51d5-b909-123e0d888f17/0f5926a4-868d-51d5-b909-123e0d888f17_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 323902,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/45b1fd86ba3f41d5ab91001ba7193c52/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f5926a4-868d-51d5-b909-123e0d888f17/0f5926a4-868d-51d5-b909-123e0d888f17_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 305968,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/45b1fd86ba3f41d5ab91001ba7193c52/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f5926a4-868d-51d5-b909-123e0d888f17/0f5926a4-868d-51d5-b909-123e0d888f17_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 301126,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/45b1fd86ba3f41d5ab91001ba7193c52/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f5926a4-868d-51d5-b909-123e0d888f17/0f5926a4-868d-51d5-b909-123e0d888f17_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 339847,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/45b1fd86ba3f41d5ab91001ba7193c52/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f5926a4-868d-51d5-b909-123e0d888f17/0f5926a4-868d-51d5-b909-123e0d888f17_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 316790,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/45b1fd86ba3f41d5ab91001ba7193c52/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f5926a4-868d-51d5-b909-123e0d888f17/0f5926a4-868d-51d5-b909-123e0d888f17_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 292291,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/45b1fd86ba3f41d5ab91001ba7193c52/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT CAPTUR 1.6 E-TECH PLUG-IN HYBRID INITIALE PARIS',
 'transmission': 'automatic',
 'trim': '1.6 E-TECH PLUG-IN HYBRID INITIALE PARIS',
 'vin': None,
 'year': 2022}
2026-03-26 22:56:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985602%27 HTTP/1.1" 200 None
2026-03-26 22:56:10 [ayvens.be] INFO: Saving data for 1985602: {'created_time': 1774565770.224233, 'last_price_update_time': 1774565770.224242, 'auction_closing_time': 1774958400.0}
2026-03-26 22:56:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985602') HTTP/1.1" 204 0
2026-03-26 22:56:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/ba5c2ca03d8446209edf1284da20e64c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2am%252F6806335b85b1470e9f46c18606501d38%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2am/6806335b85b1470e9f46c18606501d38/images/large/2.jpg not downloaded yet
2026-03-26 22:56:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/ba5c2ca03d8446209edf1284da20e64c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2am%252F6806335b85b1470e9f46c18606501d38%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2am/6806335b85b1470e9f46c18606501d38/images/large/3.jpg not downloaded yet
2026-03-26 22:56:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/ba5c2ca03d8446209edf1284da20e64c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/ba5c2ca03d8446209edf1284da20e64c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b727d850>
2026-03-26 22:56:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5/c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:56:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fba5c2ca03d8446209edf1284da20e64c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/ba5c2ca03d8446209edf1284da20e64c/images/large/3.jpg saved to cache
2026-03-26 22:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5
2026-03-26 22:56:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/ba5c2ca03d8446209edf1284da20e64c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2am%252F6806335b85b1470e9f46c18606501d38%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2am/6806335b85b1470e9f46c18606501d38/images/large/4.jpg not downloaded yet
2026-03-26 22:56:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/ba5c2ca03d8446209edf1284da20e64c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2am%252F6806335b85b1470e9f46c18606501d38%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2am/6806335b85b1470e9f46c18606501d38/images/large/5.jpg not downloaded yet
2026-03-26 22:56:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e36fd0>
2026-03-26 22:56:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5/c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:56:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fba5c2ca03d8446209edf1284da20e64c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/ba5c2ca03d8446209edf1284da20e64c/images/large/1.jpg saved to cache
2026-03-26 22:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5
2026-03-26 22:56:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6d81610>
2026-03-26 22:56:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5/c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:56:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fba5c2ca03d8446209edf1284da20e64c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/ba5c2ca03d8446209edf1284da20e64c/images/large/2.jpg saved to cache
2026-03-26 22:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5
2026-03-26 22:56:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b740aa90>
2026-03-26 22:56:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5/c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:56:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fba5c2ca03d8446209edf1284da20e64c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/ba5c2ca03d8446209edf1284da20e64c/images/large/4.jpg saved to cache
2026-03-26 22:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5
2026-03-26 22:56:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b792c7d0>
2026-03-26 22:56:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5/c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:56:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fba5c2ca03d8446209edf1284da20e64c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/ba5c2ca03d8446209edf1284da20e64c/images/large/5.jpg saved to cache
2026-03-26 22:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5
2026-03-26 22:56:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2am%252F6806335b85b1470e9f46c18606501d38%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2am/6806335b85b1470e9f46c18606501d38/images/large/6.jpg not downloaded yet
2026-03-26 22:56:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/ba5c2ca03d8446209edf1284da20e64c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7416dd0>
2026-03-26 22:56:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5/c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:56:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fba5c2ca03d8446209edf1284da20e64c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/ba5c2ca03d8446209edf1284da20e64c/images/large/6.jpg saved to cache
2026-03-26 22:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5
2026-03-26 22:56:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b72ffcd0>
2026-03-26 22:56:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5/c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fba5c2ca03d8446209edf1284da20e64c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/ba5c2ca03d8446209edf1284da20e64c/images/large/7.jpg saved to cache
2026-03-26 22:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5
2026-03-26 22:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2am%252F6806335b85b1470e9f46c18606501d38%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2am/6806335b85b1470e9f46c18606501d38/images/large/7.jpg not downloaded yet
2026-03-26 22:56:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2am/6806335b85b1470e9f46c18606501d38/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2am/6806335b85b1470e9f46c18606501d38/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2am/6806335b85b1470e9f46c18606501d38/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2am%252F6806335b85b1470e9f46c18606501d38%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2am/6806335b85b1470e9f46c18606501d38/images/large/8.jpg not downloaded yet
2026-03-26 22:56:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/ba5c2ca03d8446209edf1284da20e64c/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74e5310>
2026-03-26 22:56:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5/c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fba5c2ca03d8446209edf1284da20e64c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/ba5c2ca03d8446209edf1284da20e64c/images/large/8.jpg saved to cache
2026-03-26 22:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5
2026-03-26 22:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2am%252F6806335b85b1470e9f46c18606501d38%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2am/6806335b85b1470e9f46c18606501d38/images/large/9.jpg not downloaded yet
2026-03-26 22:56:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/ba5c2ca03d8446209edf1284da20e64c/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2am/6806335b85b1470e9f46c18606501d38/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2am%252F6806335b85b1470e9f46c18606501d38%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2am/6806335b85b1470e9f46c18606501d38/images/large/10.jpg not downloaded yet
2026-03-26 22:56:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b727b7d0>
2026-03-26 22:56:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81745107-cd5b-55d7-b04b-60f6322262e6/81745107-cd5b-55d7-b04b-60f6322262e6_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2am%252F6806335b85b1470e9f46c18606501d38%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2am/6806335b85b1470e9f46c18606501d38/images/large/2.jpg saved to cache
2026-03-26 22:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 81745107-cd5b-55d7-b04b-60f6322262e6
2026-03-26 22:56:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7429590>
2026-03-26 22:56:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81745107-cd5b-55d7-b04b-60f6322262e6/81745107-cd5b-55d7-b04b-60f6322262e6_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2am%252F6806335b85b1470e9f46c18606501d38%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2am/6806335b85b1470e9f46c18606501d38/images/large/1.jpg saved to cache
2026-03-26 22:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 81745107-cd5b-55d7-b04b-60f6322262e6
2026-03-26 22:56:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74a6b10>
2026-03-26 22:56:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81745107-cd5b-55d7-b04b-60f6322262e6/81745107-cd5b-55d7-b04b-60f6322262e6_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2am%252F6806335b85b1470e9f46c18606501d38%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2am/6806335b85b1470e9f46c18606501d38/images/large/3.jpg saved to cache
2026-03-26 22:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 81745107-cd5b-55d7-b04b-60f6322262e6
2026-03-26 22:56:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6dd9390>
2026-03-26 22:56:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5/c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fba5c2ca03d8446209edf1284da20e64c%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/ba5c2ca03d8446209edf1284da20e64c/images/large/9.jpg saved to cache
2026-03-26 22:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5
2026-03-26 22:56:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2am/6806335b85b1470e9f46c18606501d38/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:11 [ayvens.be] INFO: Found listing with ID: 1985605
2026-03-26 22:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985605%27 HTTP/1.1" 200 None
2026-03-26 22:56:11 [ayvens.be] INFO: Scrape type for 1985605: 1
2026-03-26 22:56:11 [ayvens.be] INFO: Extracting data for car ID: 1985605
2026-03-26 22:56:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cedfca8f-75b5-5fc8-8992-8c4e6b512ab9 with identifier: 1985605
2026-03-26 22:56:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cedfca8f-75b5-5fc8-8992-8c4e6b512ab9 with scrape type 1
2026-03-26 22:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cedfca8f-75b5-5fc8-8992-8c4e6b512ab9
2026-03-26 22:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F0f9f2ab6fd7b4c67aa2e718cf0848300%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/0f9f2ab6fd7b4c67aa2e718cf0848300/images/large/1.jpg not downloaded yet
2026-03-26 22:56:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2am/6806335b85b1470e9f46c18606501d38/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F0f9f2ab6fd7b4c67aa2e718cf0848300%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/0f9f2ab6fd7b4c67aa2e718cf0848300/images/large/2.jpg not downloaded yet
2026-03-26 22:56:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77479d0>
2026-03-26 22:56:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5/c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fba5c2ca03d8446209edf1284da20e64c%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/ba5c2ca03d8446209edf1284da20e64c/images/large/10.jpg saved to cache
2026-03-26 22:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5
2026-03-26 22:56:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5, skipping ID generation
2026-03-26 22:56:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5 with scrape type 1
2026-03-26 22:56:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5 sending to next pipeline
2026-03-26 22:56:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5, identifier: 1985603
2026-03-26 22:56:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7408510>
2026-03-26 22:56:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81745107-cd5b-55d7-b04b-60f6322262e6/81745107-cd5b-55d7-b04b-60f6322262e6_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:56:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2am%252F6806335b85b1470e9f46c18606501d38%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2am/6806335b85b1470e9f46c18606501d38/images/large/4.jpg saved to cache
2026-03-26 22:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 81745107-cd5b-55d7-b04b-60f6322262e6
2026-03-26 22:56:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7947990>
2026-03-26 22:56:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81745107-cd5b-55d7-b04b-60f6322262e6/81745107-cd5b-55d7-b04b-60f6322262e6_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:56:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2am%252F6806335b85b1470e9f46c18606501d38%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2am/6806335b85b1470e9f46c18606501d38/images/large/6.jpg saved to cache
2026-03-26 22:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 81745107-cd5b-55d7-b04b-60f6322262e6
2026-03-26 22:56:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F0f9f2ab6fd7b4c67aa2e718cf0848300%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/0f9f2ab6fd7b4c67aa2e718cf0848300/images/large/3.jpg not downloaded yet
2026-03-26 22:56:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5 with identifier: 1985603
2026-03-26 22:56:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5 with identifier: 1985603
2026-03-26 22:56:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5 with identifier: 1985603 to the API
2026-03-26 22:56:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:56:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:56:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bx/ba5c2ca03d8446209edf1284da20e64c/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X2',
 'odometer': 74237,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 19,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5/c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 574939,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/ba5c2ca03d8446209edf1284da20e64c/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5/c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 605617,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/ba5c2ca03d8446209edf1284da20e64c/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5/c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 647646,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/ba5c2ca03d8446209edf1284da20e64c/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5/c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 658602,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/ba5c2ca03d8446209edf1284da20e64c/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5/c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 678555,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/ba5c2ca03d8446209edf1284da20e64c/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5/c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 617823,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/ba5c2ca03d8446209edf1284da20e64c/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5/c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 695597,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/ba5c2ca03d8446209edf1284da20e64c/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5/c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 649499,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/ba5c2ca03d8446209edf1284da20e64c/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5/c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 590904,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/ba5c2ca03d8446209edf1284da20e64c/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5/c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 579074,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/ba5c2ca03d8446209edf1284da20e64c/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X2 1.5 XDRIVE25E PHEV 162KW)',
 'transmission': 'automatic',
 'trim': '1.5 XDRIVE25E PHEV 162KW)',
 'vin': None,
 'year': 2022}
2026-03-26 22:56:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985603%27 HTTP/1.1" 200 None
2026-03-26 22:56:12 [ayvens.be] INFO: Saving data for 1985603: {'created_time': 1774565772.546694, 'last_price_update_time': 1774565772.546706, 'auction_closing_time': 1774958400.0}
2026-03-26 22:56:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985603') HTTP/1.1" 204 0
2026-03-26 22:56:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2am/6806335b85b1470e9f46c18606501d38/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2am/6806335b85b1470e9f46c18606501d38/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F0f9f2ab6fd7b4c67aa2e718cf0848300%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/0f9f2ab6fd7b4c67aa2e718cf0848300/images/large/4.jpg not downloaded yet
2026-03-26 22:56:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79a4510>
2026-03-26 22:56:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81745107-cd5b-55d7-b04b-60f6322262e6/81745107-cd5b-55d7-b04b-60f6322262e6_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:56:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2am%252F6806335b85b1470e9f46c18606501d38%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2am/6806335b85b1470e9f46c18606501d38/images/large/5.jpg saved to cache
2026-03-26 22:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 81745107-cd5b-55d7-b04b-60f6322262e6
2026-03-26 22:56:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2am/6806335b85b1470e9f46c18606501d38/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F0f9f2ab6fd7b4c67aa2e718cf0848300%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/0f9f2ab6fd7b4c67aa2e718cf0848300/images/large/5.jpg not downloaded yet
2026-03-26 22:56:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2am/6806335b85b1470e9f46c18606501d38/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7437190>
2026-03-26 22:56:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81745107-cd5b-55d7-b04b-60f6322262e6/81745107-cd5b-55d7-b04b-60f6322262e6_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:56:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2am%252F6806335b85b1470e9f46c18606501d38%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2am/6806335b85b1470e9f46c18606501d38/images/large/7.jpg saved to cache
2026-03-26 22:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 81745107-cd5b-55d7-b04b-60f6322262e6
2026-03-26 22:56:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7926a50>
2026-03-26 22:56:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81745107-cd5b-55d7-b04b-60f6322262e6/81745107-cd5b-55d7-b04b-60f6322262e6_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:56:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2am%252F6806335b85b1470e9f46c18606501d38%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2am/6806335b85b1470e9f46c18606501d38/images/large/8.jpg saved to cache
2026-03-26 22:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 81745107-cd5b-55d7-b04b-60f6322262e6
2026-03-26 22:56:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F0f9f2ab6fd7b4c67aa2e718cf0848300%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/0f9f2ab6fd7b4c67aa2e718cf0848300/images/large/6.jpg not downloaded yet
2026-03-26 22:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F0f9f2ab6fd7b4c67aa2e718cf0848300%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/0f9f2ab6fd7b4c67aa2e718cf0848300/images/large/7.jpg not downloaded yet
2026-03-26 22:56:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e15250>
2026-03-26 22:56:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81745107-cd5b-55d7-b04b-60f6322262e6/81745107-cd5b-55d7-b04b-60f6322262e6_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2am%252F6806335b85b1470e9f46c18606501d38%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2am/6806335b85b1470e9f46c18606501d38/images/large/10.jpg saved to cache
2026-03-26 22:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 81745107-cd5b-55d7-b04b-60f6322262e6
2026-03-26 22:56:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b6b0d0>
2026-03-26 22:56:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81745107-cd5b-55d7-b04b-60f6322262e6/81745107-cd5b-55d7-b04b-60f6322262e6_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2am%252F6806335b85b1470e9f46c18606501d38%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2am/6806335b85b1470e9f46c18606501d38/images/large/9.jpg saved to cache
2026-03-26 22:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 81745107-cd5b-55d7-b04b-60f6322262e6
2026-03-26 22:56:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 81745107-cd5b-55d7-b04b-60f6322262e6, skipping ID generation
2026-03-26 22:56:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 81745107-cd5b-55d7-b04b-60f6322262e6 with scrape type 1
2026-03-26 22:56:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 81745107-cd5b-55d7-b04b-60f6322262e6 sending to next pipeline
2026-03-26 22:56:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 81745107-cd5b-55d7-b04b-60f6322262e6, identifier: 1985604
2026-03-26 22:56:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/0f9f2ab6fd7b4c67aa2e718cf0848300/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 81745107-cd5b-55d7-b04b-60f6322262e6 with identifier: 1985604
2026-03-26 22:56:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 81745107-cd5b-55d7-b04b-60f6322262e6 with identifier: 1985604
2026-03-26 22:56:13 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 81745107-cd5b-55d7-b04b-60f6322262e6 with identifier: 1985604 to the API
2026-03-26 22:56:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:56:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:56:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2am/6806335b85b1470e9f46c18606501d38/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 32,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '81745107-cd5b-55d7-b04b-60f6322262e6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3',
 'odometer': 55405,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81745107-cd5b-55d7-b04b-60f6322262e6/81745107-cd5b-55d7-b04b-60f6322262e6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 254984,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2am/6806335b85b1470e9f46c18606501d38/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81745107-cd5b-55d7-b04b-60f6322262e6/81745107-cd5b-55d7-b04b-60f6322262e6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 255794,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2am/6806335b85b1470e9f46c18606501d38/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81745107-cd5b-55d7-b04b-60f6322262e6/81745107-cd5b-55d7-b04b-60f6322262e6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 294810,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2am/6806335b85b1470e9f46c18606501d38/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81745107-cd5b-55d7-b04b-60f6322262e6/81745107-cd5b-55d7-b04b-60f6322262e6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 290381,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2am/6806335b85b1470e9f46c18606501d38/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81745107-cd5b-55d7-b04b-60f6322262e6/81745107-cd5b-55d7-b04b-60f6322262e6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 283334,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2am/6806335b85b1470e9f46c18606501d38/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81745107-cd5b-55d7-b04b-60f6322262e6/81745107-cd5b-55d7-b04b-60f6322262e6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 258801,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2am/6806335b85b1470e9f46c18606501d38/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81745107-cd5b-55d7-b04b-60f6322262e6/81745107-cd5b-55d7-b04b-60f6322262e6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 270699,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2am/6806335b85b1470e9f46c18606501d38/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81745107-cd5b-55d7-b04b-60f6322262e6/81745107-cd5b-55d7-b04b-60f6322262e6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 346290,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2am/6806335b85b1470e9f46c18606501d38/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81745107-cd5b-55d7-b04b-60f6322262e6/81745107-cd5b-55d7-b04b-60f6322262e6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 324375,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2am/6806335b85b1470e9f46c18606501d38/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81745107-cd5b-55d7-b04b-60f6322262e6/81745107-cd5b-55d7-b04b-60f6322262e6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 179664,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2am/6806335b85b1470e9f46c18606501d38/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 1.4 45 TFSI E S TRONIC',
 'transmission': 'automatic',
 'trim': '1.4 45 TFSI E S TRONIC',
 'vin': None,
 'year': 2021}
2026-03-26 22:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985604%27 HTTP/1.1" 200 None
2026-03-26 22:56:13 [ayvens.be] INFO: Saving data for 1985604: {'created_time': 1774565773.57411, 'last_price_update_time': 1774565773.574121, 'auction_closing_time': 1774958400.0}
2026-03-26 22:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985604') HTTP/1.1" 204 0
2026-03-26 22:56:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/0f9f2ab6fd7b4c67aa2e718cf0848300/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F0f9f2ab6fd7b4c67aa2e718cf0848300%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/0f9f2ab6fd7b4c67aa2e718cf0848300/images/large/8.jpg not downloaded yet
2026-03-26 22:56:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/0f9f2ab6fd7b4c67aa2e718cf0848300/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F0f9f2ab6fd7b4c67aa2e718cf0848300%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/0f9f2ab6fd7b4c67aa2e718cf0848300/images/large/9.jpg not downloaded yet
2026-03-26 22:56:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7439610>
2026-03-26 22:56:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cedfca8f-75b5-5fc8-8992-8c4e6b512ab9/cedfca8f-75b5-5fc8-8992-8c4e6b512ab9_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F0f9f2ab6fd7b4c67aa2e718cf0848300%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/0f9f2ab6fd7b4c67aa2e718cf0848300/images/large/1.jpg saved to cache
2026-03-26 22:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cedfca8f-75b5-5fc8-8992-8c4e6b512ab9
2026-03-26 22:56:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/0f9f2ab6fd7b4c67aa2e718cf0848300/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F0f9f2ab6fd7b4c67aa2e718cf0848300%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/0f9f2ab6fd7b4c67aa2e718cf0848300/images/large/10.jpg not downloaded yet
2026-03-26 22:56:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/0f9f2ab6fd7b4c67aa2e718cf0848300/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:13 [ayvens.be] INFO: Found listing with ID: 1985606
2026-03-26 22:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985606%27 HTTP/1.1" 200 None
2026-03-26 22:56:13 [ayvens.be] INFO: Scrape type for 1985606: 1
2026-03-26 22:56:13 [ayvens.be] INFO: Extracting data for car ID: 1985606
2026-03-26 22:56:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c99a21a0-6528-59bd-b83a-0a37275320b1 with identifier: 1985606
2026-03-26 22:56:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c99a21a0-6528-59bd-b83a-0a37275320b1 with scrape type 1
2026-03-26 22:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c99a21a0-6528-59bd-b83a-0a37275320b1
2026-03-26 22:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252Ff0ba2f1fdf5b4c8a9baafd01a8fe4bae%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/f0ba2f1fdf5b4c8a9baafd01a8fe4bae/images/large/1.jpg not downloaded yet
2026-03-26 22:56:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b75852d0>
2026-03-26 22:56:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cedfca8f-75b5-5fc8-8992-8c4e6b512ab9/cedfca8f-75b5-5fc8-8992-8c4e6b512ab9_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F0f9f2ab6fd7b4c67aa2e718cf0848300%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/0f9f2ab6fd7b4c67aa2e718cf0848300/images/large/2.jpg saved to cache
2026-03-26 22:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cedfca8f-75b5-5fc8-8992-8c4e6b512ab9
2026-03-26 22:56:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e16e50>
2026-03-26 22:56:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cedfca8f-75b5-5fc8-8992-8c4e6b512ab9/cedfca8f-75b5-5fc8-8992-8c4e6b512ab9_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F0f9f2ab6fd7b4c67aa2e718cf0848300%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/0f9f2ab6fd7b4c67aa2e718cf0848300/images/large/3.jpg saved to cache
2026-03-26 22:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cedfca8f-75b5-5fc8-8992-8c4e6b512ab9
2026-03-26 22:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252Ff0ba2f1fdf5b4c8a9baafd01a8fe4bae%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/f0ba2f1fdf5b4c8a9baafd01a8fe4bae/images/large/2.jpg not downloaded yet
2026-03-26 22:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252Ff0ba2f1fdf5b4c8a9baafd01a8fe4bae%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/f0ba2f1fdf5b4c8a9baafd01a8fe4bae/images/large/3.jpg not downloaded yet
2026-03-26 22:56:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/0f9f2ab6fd7b4c67aa2e718cf0848300/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e1d910>
2026-03-26 22:56:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cedfca8f-75b5-5fc8-8992-8c4e6b512ab9/cedfca8f-75b5-5fc8-8992-8c4e6b512ab9_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F0f9f2ab6fd7b4c67aa2e718cf0848300%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/0f9f2ab6fd7b4c67aa2e718cf0848300/images/large/4.jpg saved to cache
2026-03-26 22:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cedfca8f-75b5-5fc8-8992-8c4e6b512ab9
2026-03-26 22:56:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b743ae10>
2026-03-26 22:56:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cedfca8f-75b5-5fc8-8992-8c4e6b512ab9/cedfca8f-75b5-5fc8-8992-8c4e6b512ab9_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F0f9f2ab6fd7b4c67aa2e718cf0848300%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/0f9f2ab6fd7b4c67aa2e718cf0848300/images/large/5.jpg saved to cache
2026-03-26 22:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cedfca8f-75b5-5fc8-8992-8c4e6b512ab9
2026-03-26 22:56:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/0f9f2ab6fd7b4c67aa2e718cf0848300/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252Ff0ba2f1fdf5b4c8a9baafd01a8fe4bae%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/f0ba2f1fdf5b4c8a9baafd01a8fe4bae/images/large/4.jpg not downloaded yet
2026-03-26 22:56:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/0f9f2ab6fd7b4c67aa2e718cf0848300/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252Ff0ba2f1fdf5b4c8a9baafd01a8fe4bae%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/f0ba2f1fdf5b4c8a9baafd01a8fe4bae/images/large/5.jpg not downloaded yet
2026-03-26 22:56:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7278350>
2026-03-26 22:56:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cedfca8f-75b5-5fc8-8992-8c4e6b512ab9/cedfca8f-75b5-5fc8-8992-8c4e6b512ab9_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F0f9f2ab6fd7b4c67aa2e718cf0848300%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/0f9f2ab6fd7b4c67aa2e718cf0848300/images/large/7.jpg saved to cache
2026-03-26 22:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cedfca8f-75b5-5fc8-8992-8c4e6b512ab9
2026-03-26 22:56:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/f0ba2f1fdf5b4c8a9baafd01a8fe4bae/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252Ff0ba2f1fdf5b4c8a9baafd01a8fe4bae%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/f0ba2f1fdf5b4c8a9baafd01a8fe4bae/images/large/6.jpg not downloaded yet
2026-03-26 22:56:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/0f9f2ab6fd7b4c67aa2e718cf0848300/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cbcf90>
2026-03-26 22:56:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cedfca8f-75b5-5fc8-8992-8c4e6b512ab9/cedfca8f-75b5-5fc8-8992-8c4e6b512ab9_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F0f9f2ab6fd7b4c67aa2e718cf0848300%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/0f9f2ab6fd7b4c67aa2e718cf0848300/images/large/6.jpg saved to cache
2026-03-26 22:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cedfca8f-75b5-5fc8-8992-8c4e6b512ab9
2026-03-26 22:56:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7279710>
2026-03-26 22:56:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cedfca8f-75b5-5fc8-8992-8c4e6b512ab9/cedfca8f-75b5-5fc8-8992-8c4e6b512ab9_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F0f9f2ab6fd7b4c67aa2e718cf0848300%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/0f9f2ab6fd7b4c67aa2e718cf0848300/images/large/8.jpg saved to cache
2026-03-26 22:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cedfca8f-75b5-5fc8-8992-8c4e6b512ab9
2026-03-26 22:56:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/0f9f2ab6fd7b4c67aa2e718cf0848300/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252Ff0ba2f1fdf5b4c8a9baafd01a8fe4bae%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/f0ba2f1fdf5b4c8a9baafd01a8fe4bae/images/large/7.jpg not downloaded yet
2026-03-26 22:56:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/f0ba2f1fdf5b4c8a9baafd01a8fe4bae/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252Ff0ba2f1fdf5b4c8a9baafd01a8fe4bae%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/f0ba2f1fdf5b4c8a9baafd01a8fe4bae/images/large/8.jpg not downloaded yet
2026-03-26 22:56:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7400690>
2026-03-26 22:56:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c99a21a0-6528-59bd-b83a-0a37275320b1/c99a21a0-6528-59bd-b83a-0a37275320b1_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252Ff0ba2f1fdf5b4c8a9baafd01a8fe4bae%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/f0ba2f1fdf5b4c8a9baafd01a8fe4bae/images/large/1.jpg saved to cache
2026-03-26 22:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c99a21a0-6528-59bd-b83a-0a37275320b1
2026-03-26 22:56:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74165d0>
2026-03-26 22:56:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cedfca8f-75b5-5fc8-8992-8c4e6b512ab9/cedfca8f-75b5-5fc8-8992-8c4e6b512ab9_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F0f9f2ab6fd7b4c67aa2e718cf0848300%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/0f9f2ab6fd7b4c67aa2e718cf0848300/images/large/10.jpg saved to cache
2026-03-26 22:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cedfca8f-75b5-5fc8-8992-8c4e6b512ab9
2026-03-26 22:56:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/f0ba2f1fdf5b4c8a9baafd01a8fe4bae/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/f0ba2f1fdf5b4c8a9baafd01a8fe4bae/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252Ff0ba2f1fdf5b4c8a9baafd01a8fe4bae%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/f0ba2f1fdf5b4c8a9baafd01a8fe4bae/images/large/9.jpg not downloaded yet
2026-03-26 22:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252Ff0ba2f1fdf5b4c8a9baafd01a8fe4bae%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/f0ba2f1fdf5b4c8a9baafd01a8fe4bae/images/large/10.jpg not downloaded yet
2026-03-26 22:56:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd3c4490>
2026-03-26 22:56:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cedfca8f-75b5-5fc8-8992-8c4e6b512ab9/cedfca8f-75b5-5fc8-8992-8c4e6b512ab9_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F0f9f2ab6fd7b4c67aa2e718cf0848300%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/0f9f2ab6fd7b4c67aa2e718cf0848300/images/large/9.jpg saved to cache
2026-03-26 22:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cedfca8f-75b5-5fc8-8992-8c4e6b512ab9
2026-03-26 22:56:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cedfca8f-75b5-5fc8-8992-8c4e6b512ab9, skipping ID generation
2026-03-26 22:56:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cedfca8f-75b5-5fc8-8992-8c4e6b512ab9 with scrape type 1
2026-03-26 22:56:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cedfca8f-75b5-5fc8-8992-8c4e6b512ab9 sending to next pipeline
2026-03-26 22:56:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: cedfca8f-75b5-5fc8-8992-8c4e6b512ab9, identifier: 1985605
2026-03-26 22:56:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7aa2550>
2026-03-26 22:56:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c99a21a0-6528-59bd-b83a-0a37275320b1/c99a21a0-6528-59bd-b83a-0a37275320b1_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252Ff0ba2f1fdf5b4c8a9baafd01a8fe4bae%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/f0ba2f1fdf5b4c8a9baafd01a8fe4bae/images/large/2.jpg saved to cache
2026-03-26 22:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c99a21a0-6528-59bd-b83a-0a37275320b1
2026-03-26 22:56:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: cedfca8f-75b5-5fc8-8992-8c4e6b512ab9 with identifier: 1985605
2026-03-26 22:56:15 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 22:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 22:56:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: cedfca8f-75b5-5fc8-8992-8c4e6b512ab9 with identifier: 1985605
2026-03-26 22:56:15 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: cedfca8f-75b5-5fc8-8992-8c4e6b512ab9 with identifier: 1985605 to the API
2026-03-26 22:56:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:56:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:56:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yl/0f9f2ab6fd7b4c67aa2e718cf0848300/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 47,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'cedfca8f-75b5-5fc8-8992-8c4e6b512ab9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 138035,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cedfca8f-75b5-5fc8-8992-8c4e6b512ab9/cedfca8f-75b5-5fc8-8992-8c4e6b512ab9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 255452,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/0f9f2ab6fd7b4c67aa2e718cf0848300/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cedfca8f-75b5-5fc8-8992-8c4e6b512ab9/cedfca8f-75b5-5fc8-8992-8c4e6b512ab9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 252237,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/0f9f2ab6fd7b4c67aa2e718cf0848300/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cedfca8f-75b5-5fc8-8992-8c4e6b512ab9/cedfca8f-75b5-5fc8-8992-8c4e6b512ab9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 271743,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/0f9f2ab6fd7b4c67aa2e718cf0848300/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cedfca8f-75b5-5fc8-8992-8c4e6b512ab9/cedfca8f-75b5-5fc8-8992-8c4e6b512ab9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 283774,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/0f9f2ab6fd7b4c67aa2e718cf0848300/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cedfca8f-75b5-5fc8-8992-8c4e6b512ab9/cedfca8f-75b5-5fc8-8992-8c4e6b512ab9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 337819,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/0f9f2ab6fd7b4c67aa2e718cf0848300/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cedfca8f-75b5-5fc8-8992-8c4e6b512ab9/cedfca8f-75b5-5fc8-8992-8c4e6b512ab9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 329156,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/0f9f2ab6fd7b4c67aa2e718cf0848300/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cedfca8f-75b5-5fc8-8992-8c4e6b512ab9/cedfca8f-75b5-5fc8-8992-8c4e6b512ab9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 336465,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/0f9f2ab6fd7b4c67aa2e718cf0848300/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cedfca8f-75b5-5fc8-8992-8c4e6b512ab9/cedfca8f-75b5-5fc8-8992-8c4e6b512ab9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 348996,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/0f9f2ab6fd7b4c67aa2e718cf0848300/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cedfca8f-75b5-5fc8-8992-8c4e6b512ab9/cedfca8f-75b5-5fc8-8992-8c4e6b512ab9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 327291,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/0f9f2ab6fd7b4c67aa2e718cf0848300/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cedfca8f-75b5-5fc8-8992-8c4e6b512ab9/cedfca8f-75b5-5fc8-8992-8c4e6b512ab9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 288704,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/0f9f2ab6fd7b4c67aa2e718cf0848300/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T5 PHEV Recharge Pro DCT',
 'transmission': 'automatic',
 'trim': '1.5 T5 PHEV Recharge Pro DCT',
 'vin': None,
 'year': 2020}
2026-03-26 22:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985605%27 HTTP/1.1" 200 None
2026-03-26 22:56:15 [ayvens.be] INFO: Saving data for 1985605: {'created_time': 1774565775.515457, 'last_price_update_time': 1774565775.51547, 'auction_closing_time': 1774958400.0}
2026-03-26 22:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985605') HTTP/1.1" 204 0
2026-03-26 22:56:15 [ayvens.be] INFO: Found listing with ID: 1985607
2026-03-26 22:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985607%27 HTTP/1.1" 200 None
2026-03-26 22:56:15 [ayvens.be] INFO: Scrape type for 1985607: 1
2026-03-26 22:56:15 [ayvens.be] INFO: Extracting data for car ID: 1985607
2026-03-26 22:56:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 102740f9-a11d-52fd-a67d-bdfa14b5e0fb with identifier: 1985607
2026-03-26 22:56:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 102740f9-a11d-52fd-a67d-bdfa14b5e0fb with scrape type 1
2026-03-26 22:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 102740f9-a11d-52fd-a67d-bdfa14b5e0fb
2026-03-26 22:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252Fc842ec7ba9c54f0786ff3c14ff73bc1a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/c842ec7ba9c54f0786ff3c14ff73bc1a/images/large/1.jpg not downloaded yet
2026-03-26 22:56:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/f0ba2f1fdf5b4c8a9baafd01a8fe4bae/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/f0ba2f1fdf5b4c8a9baafd01a8fe4bae/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd8d2c10>
2026-03-26 22:56:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c99a21a0-6528-59bd-b83a-0a37275320b1/c99a21a0-6528-59bd-b83a-0a37275320b1_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252Ff0ba2f1fdf5b4c8a9baafd01a8fe4bae%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/f0ba2f1fdf5b4c8a9baafd01a8fe4bae/images/large/3.jpg saved to cache
2026-03-26 22:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c99a21a0-6528-59bd-b83a-0a37275320b1
2026-03-26 22:56:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c5d690>
2026-03-26 22:56:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c99a21a0-6528-59bd-b83a-0a37275320b1/c99a21a0-6528-59bd-b83a-0a37275320b1_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252Ff0ba2f1fdf5b4c8a9baafd01a8fe4bae%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/f0ba2f1fdf5b4c8a9baafd01a8fe4bae/images/large/4.jpg saved to cache
2026-03-26 22:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c99a21a0-6528-59bd-b83a-0a37275320b1
2026-03-26 22:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252Fc842ec7ba9c54f0786ff3c14ff73bc1a%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/c842ec7ba9c54f0786ff3c14ff73bc1a/images/large/2.jpg not downloaded yet
2026-03-26 22:56:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/f0ba2f1fdf5b4c8a9baafd01a8fe4bae/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252Fc842ec7ba9c54f0786ff3c14ff73bc1a%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/c842ec7ba9c54f0786ff3c14ff73bc1a/images/large/3.jpg not downloaded yet
2026-03-26 22:56:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/f0ba2f1fdf5b4c8a9baafd01a8fe4bae/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6df2390>
2026-03-26 22:56:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c99a21a0-6528-59bd-b83a-0a37275320b1/c99a21a0-6528-59bd-b83a-0a37275320b1_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252Ff0ba2f1fdf5b4c8a9baafd01a8fe4bae%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/f0ba2f1fdf5b4c8a9baafd01a8fe4bae/images/large/6.jpg saved to cache
2026-03-26 22:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c99a21a0-6528-59bd-b83a-0a37275320b1
2026-03-26 22:56:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7279a90>
2026-03-26 22:56:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c99a21a0-6528-59bd-b83a-0a37275320b1/c99a21a0-6528-59bd-b83a-0a37275320b1_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252Ff0ba2f1fdf5b4c8a9baafd01a8fe4bae%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/f0ba2f1fdf5b4c8a9baafd01a8fe4bae/images/large/5.jpg saved to cache
2026-03-26 22:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c99a21a0-6528-59bd-b83a-0a37275320b1
2026-03-26 22:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252Fc842ec7ba9c54f0786ff3c14ff73bc1a%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/c842ec7ba9c54f0786ff3c14ff73bc1a/images/large/4.jpg not downloaded yet
2026-03-26 22:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252Fc842ec7ba9c54f0786ff3c14ff73bc1a%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/c842ec7ba9c54f0786ff3c14ff73bc1a/images/large/5.jpg not downloaded yet
2026-03-26 22:56:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7ca8490>
2026-03-26 22:56:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c99a21a0-6528-59bd-b83a-0a37275320b1/c99a21a0-6528-59bd-b83a-0a37275320b1_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252Ff0ba2f1fdf5b4c8a9baafd01a8fe4bae%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/f0ba2f1fdf5b4c8a9baafd01a8fe4bae/images/large/7.jpg saved to cache
2026-03-26 22:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c99a21a0-6528-59bd-b83a-0a37275320b1
2026-03-26 22:56:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7a80490>
2026-03-26 22:56:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c99a21a0-6528-59bd-b83a-0a37275320b1/c99a21a0-6528-59bd-b83a-0a37275320b1_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252Ff0ba2f1fdf5b4c8a9baafd01a8fe4bae%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/f0ba2f1fdf5b4c8a9baafd01a8fe4bae/images/large/8.jpg saved to cache
2026-03-26 22:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c99a21a0-6528-59bd-b83a-0a37275320b1
2026-03-26 22:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252Fc842ec7ba9c54f0786ff3c14ff73bc1a%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/c842ec7ba9c54f0786ff3c14ff73bc1a/images/large/6.jpg not downloaded yet
2026-03-26 22:56:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/f0ba2f1fdf5b4c8a9baafd01a8fe4bae/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/f0ba2f1fdf5b4c8a9baafd01a8fe4bae/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252Fc842ec7ba9c54f0786ff3c14ff73bc1a%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/c842ec7ba9c54f0786ff3c14ff73bc1a/images/large/7.jpg not downloaded yet
2026-03-26 22:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252Fc842ec7ba9c54f0786ff3c14ff73bc1a%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/c842ec7ba9c54f0786ff3c14ff73bc1a/images/large/8.jpg not downloaded yet
2026-03-26 22:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252Fc842ec7ba9c54f0786ff3c14ff73bc1a%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/c842ec7ba9c54f0786ff3c14ff73bc1a/images/large/9.jpg not downloaded yet
2026-03-26 22:56:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ym/c842ec7ba9c54f0786ff3c14ff73bc1a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252Fc842ec7ba9c54f0786ff3c14ff73bc1a%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/c842ec7ba9c54f0786ff3c14ff73bc1a/images/large/10.jpg not downloaded yet
2026-03-26 22:56:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ym/c842ec7ba9c54f0786ff3c14ff73bc1a/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:16 [ayvens.be] INFO: Found listing with ID: 1985608
2026-03-26 22:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985608%27 HTTP/1.1" 200 None
2026-03-26 22:56:16 [ayvens.be] INFO: Scrape type for 1985608: 1
2026-03-26 22:56:16 [ayvens.be] INFO: Extracting data for car ID: 1985608
2026-03-26 22:56:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d9129de0-b3cc-56eb-8492-96e4712690fb with identifier: 1985608
2026-03-26 22:56:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9129de0-b3cc-56eb-8492-96e4712690fb with scrape type 1
2026-03-26 22:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d9129de0-b3cc-56eb-8492-96e4712690fb
2026-03-26 22:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F74b564ac282441569f392a2cadaf54b9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/74b564ac282441569f392a2cadaf54b9/images/large/1.jpg not downloaded yet
2026-03-26 22:56:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ym/c842ec7ba9c54f0786ff3c14ff73bc1a/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F74b564ac282441569f392a2cadaf54b9%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/74b564ac282441569f392a2cadaf54b9/images/large/2.jpg not downloaded yet
2026-03-26 22:56:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74b5510>
2026-03-26 22:56:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c99a21a0-6528-59bd-b83a-0a37275320b1/c99a21a0-6528-59bd-b83a-0a37275320b1_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252Ff0ba2f1fdf5b4c8a9baafd01a8fe4bae%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/f0ba2f1fdf5b4c8a9baafd01a8fe4bae/images/large/9.jpg saved to cache
2026-03-26 22:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c99a21a0-6528-59bd-b83a-0a37275320b1
2026-03-26 22:56:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b6bb10>
2026-03-26 22:56:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c99a21a0-6528-59bd-b83a-0a37275320b1/c99a21a0-6528-59bd-b83a-0a37275320b1_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252Ff0ba2f1fdf5b4c8a9baafd01a8fe4bae%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/f0ba2f1fdf5b4c8a9baafd01a8fe4bae/images/large/10.jpg saved to cache
2026-03-26 22:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c99a21a0-6528-59bd-b83a-0a37275320b1
2026-03-26 22:56:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c99a21a0-6528-59bd-b83a-0a37275320b1, skipping ID generation
2026-03-26 22:56:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c99a21a0-6528-59bd-b83a-0a37275320b1 with scrape type 1
2026-03-26 22:56:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c99a21a0-6528-59bd-b83a-0a37275320b1 sending to next pipeline
2026-03-26 22:56:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c99a21a0-6528-59bd-b83a-0a37275320b1, identifier: 1985606
2026-03-26 22:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F74b564ac282441569f392a2cadaf54b9%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/74b564ac282441569f392a2cadaf54b9/images/large/3.jpg not downloaded yet
2026-03-26 22:56:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c99a21a0-6528-59bd-b83a-0a37275320b1 with identifier: 1985606
2026-03-26 22:56:16 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 22:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 22:56:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c99a21a0-6528-59bd-b83a-0a37275320b1 with identifier: 1985606
2026-03-26 22:56:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c99a21a0-6528-59bd-b83a-0a37275320b1 with identifier: 1985606 to the API
2026-03-26 22:56:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:56:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:56:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yn/f0ba2f1fdf5b4c8a9baafd01a8fe4bae/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 102,
 'color': 'NACRE WIT PARELKLEUR',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'c99a21a0-6528-59bd-b83a-0a37275320b1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '5008',
 'odometer': 126107,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c99a21a0-6528-59bd-b83a-0a37275320b1/c99a21a0-6528-59bd-b83a-0a37275320b1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 219154,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/f0ba2f1fdf5b4c8a9baafd01a8fe4bae/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c99a21a0-6528-59bd-b83a-0a37275320b1/c99a21a0-6528-59bd-b83a-0a37275320b1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 211559,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/f0ba2f1fdf5b4c8a9baafd01a8fe4bae/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c99a21a0-6528-59bd-b83a-0a37275320b1/c99a21a0-6528-59bd-b83a-0a37275320b1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 219646,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/f0ba2f1fdf5b4c8a9baafd01a8fe4bae/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c99a21a0-6528-59bd-b83a-0a37275320b1/c99a21a0-6528-59bd-b83a-0a37275320b1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 219782,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/f0ba2f1fdf5b4c8a9baafd01a8fe4bae/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c99a21a0-6528-59bd-b83a-0a37275320b1/c99a21a0-6528-59bd-b83a-0a37275320b1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 284165,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/f0ba2f1fdf5b4c8a9baafd01a8fe4bae/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c99a21a0-6528-59bd-b83a-0a37275320b1/c99a21a0-6528-59bd-b83a-0a37275320b1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 283239,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/f0ba2f1fdf5b4c8a9baafd01a8fe4bae/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c99a21a0-6528-59bd-b83a-0a37275320b1/c99a21a0-6528-59bd-b83a-0a37275320b1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 299829,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/f0ba2f1fdf5b4c8a9baafd01a8fe4bae/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c99a21a0-6528-59bd-b83a-0a37275320b1/c99a21a0-6528-59bd-b83a-0a37275320b1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 361522,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/f0ba2f1fdf5b4c8a9baafd01a8fe4bae/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c99a21a0-6528-59bd-b83a-0a37275320b1/c99a21a0-6528-59bd-b83a-0a37275320b1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 376611,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/f0ba2f1fdf5b4c8a9baafd01a8fe4bae/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c99a21a0-6528-59bd-b83a-0a37275320b1/c99a21a0-6528-59bd-b83a-0a37275320b1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 332939,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/f0ba2f1fdf5b4c8a9baafd01a8fe4bae/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-14',
 'seats_number': 7,
 'seller_name': None,
 'title': 'PEUGEOT 5008 1.5 BLUEHDI 130 ALLURE 7pl',
 'transmission': 'manual',
 'trim': '1.5 BLUEHDI 130 ALLURE 7pl',
 'vin': None,
 'year': 2020}
2026-03-26 22:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985606%27 HTTP/1.1" 200 None
2026-03-26 22:56:17 [ayvens.be] INFO: Saving data for 1985606: {'created_time': 1774565777.231887, 'last_price_update_time': 1774565777.231897, 'auction_closing_time': 1774958400.0}
2026-03-26 22:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985606') HTTP/1.1" 204 0
2026-03-26 22:56:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e296d0>
2026-03-26 22:56:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_102740f9-a11d-52fd-a67d-bdfa14b5e0fb/102740f9-a11d-52fd-a67d-bdfa14b5e0fb_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252Fc842ec7ba9c54f0786ff3c14ff73bc1a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/c842ec7ba9c54f0786ff3c14ff73bc1a/images/large/1.jpg saved to cache
2026-03-26 22:56:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 102740f9-a11d-52fd-a67d-bdfa14b5e0fb
2026-03-26 22:56:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cb2210>
2026-03-26 22:56:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_102740f9-a11d-52fd-a67d-bdfa14b5e0fb/102740f9-a11d-52fd-a67d-bdfa14b5e0fb_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252Fc842ec7ba9c54f0786ff3c14ff73bc1a%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/c842ec7ba9c54f0786ff3c14ff73bc1a/images/large/2.jpg saved to cache
2026-03-26 22:56:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 102740f9-a11d-52fd-a67d-bdfa14b5e0fb
2026-03-26 22:56:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cbedd0>
2026-03-26 22:56:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_102740f9-a11d-52fd-a67d-bdfa14b5e0fb/102740f9-a11d-52fd-a67d-bdfa14b5e0fb_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252Fc842ec7ba9c54f0786ff3c14ff73bc1a%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/c842ec7ba9c54f0786ff3c14ff73bc1a/images/large/3.jpg saved to cache
2026-03-26 22:56:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 102740f9-a11d-52fd-a67d-bdfa14b5e0fb
2026-03-26 22:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F74b564ac282441569f392a2cadaf54b9%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/74b564ac282441569f392a2cadaf54b9/images/large/4.jpg not downloaded yet
2026-03-26 22:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F74b564ac282441569f392a2cadaf54b9%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/74b564ac282441569f392a2cadaf54b9/images/large/5.jpg not downloaded yet
2026-03-26 22:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F74b564ac282441569f392a2cadaf54b9%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/74b564ac282441569f392a2cadaf54b9/images/large/6.jpg not downloaded yet
2026-03-26 22:56:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ym/c842ec7ba9c54f0786ff3c14ff73bc1a/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ym/c842ec7ba9c54f0786ff3c14ff73bc1a/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ym/c842ec7ba9c54f0786ff3c14ff73bc1a/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F74b564ac282441569f392a2cadaf54b9%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/74b564ac282441569f392a2cadaf54b9/images/large/7.jpg not downloaded yet
2026-03-26 22:56:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ym/c842ec7ba9c54f0786ff3c14ff73bc1a/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F74b564ac282441569f392a2cadaf54b9%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/74b564ac282441569f392a2cadaf54b9/images/large/8.jpg not downloaded yet
2026-03-26 22:56:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ym/c842ec7ba9c54f0786ff3c14ff73bc1a/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ym/c842ec7ba9c54f0786ff3c14ff73bc1a/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F74b564ac282441569f392a2cadaf54b9%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/74b564ac282441569f392a2cadaf54b9/images/large/9.jpg not downloaded yet
2026-03-26 22:56:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ym/c842ec7ba9c54f0786ff3c14ff73bc1a/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/74b564ac282441569f392a2cadaf54b9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e44950>
2026-03-26 22:56:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_102740f9-a11d-52fd-a67d-bdfa14b5e0fb/102740f9-a11d-52fd-a67d-bdfa14b5e0fb_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252Fc842ec7ba9c54f0786ff3c14ff73bc1a%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/c842ec7ba9c54f0786ff3c14ff73bc1a/images/large/4.jpg saved to cache
2026-03-26 22:56:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 102740f9-a11d-52fd-a67d-bdfa14b5e0fb
2026-03-26 22:56:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74acf50>
2026-03-26 22:56:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_102740f9-a11d-52fd-a67d-bdfa14b5e0fb/102740f9-a11d-52fd-a67d-bdfa14b5e0fb_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252Fc842ec7ba9c54f0786ff3c14ff73bc1a%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/c842ec7ba9c54f0786ff3c14ff73bc1a/images/large/6.jpg saved to cache
2026-03-26 22:56:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 102740f9-a11d-52fd-a67d-bdfa14b5e0fb
2026-03-26 22:56:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7661150>
2026-03-26 22:56:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_102740f9-a11d-52fd-a67d-bdfa14b5e0fb/102740f9-a11d-52fd-a67d-bdfa14b5e0fb_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:56:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252Fc842ec7ba9c54f0786ff3c14ff73bc1a%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/c842ec7ba9c54f0786ff3c14ff73bc1a/images/large/5.jpg saved to cache
2026-03-26 22:56:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 102740f9-a11d-52fd-a67d-bdfa14b5e0fb
2026-03-26 22:56:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F74b564ac282441569f392a2cadaf54b9%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/74b564ac282441569f392a2cadaf54b9/images/large/10.jpg not downloaded yet
2026-03-26 22:56:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c5c290>
2026-03-26 22:56:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_102740f9-a11d-52fd-a67d-bdfa14b5e0fb/102740f9-a11d-52fd-a67d-bdfa14b5e0fb_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:56:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252Fc842ec7ba9c54f0786ff3c14ff73bc1a%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/c842ec7ba9c54f0786ff3c14ff73bc1a/images/large/7.jpg saved to cache
2026-03-26 22:56:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 102740f9-a11d-52fd-a67d-bdfa14b5e0fb
2026-03-26 22:56:18 [ayvens.be] INFO: Found listing with ID: 1985609
2026-03-26 22:56:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985609%27 HTTP/1.1" 200 None
2026-03-26 22:56:18 [ayvens.be] INFO: Scrape type for 1985609: 1
2026-03-26 22:56:18 [ayvens.be] INFO: Extracting data for car ID: 1985609
2026-03-26 22:56:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ddafa458-3cf3-57c1-abb3-73f34a7dfa14 with identifier: 1985609
2026-03-26 22:56:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ddafa458-3cf3-57c1-abb3-73f34a7dfa14 with scrape type 1
2026-03-26 22:56:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ddafa458-3cf3-57c1-abb3-73f34a7dfa14
2026-03-26 22:56:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F5af0389742d8413d85fc30c6f57689e2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/5af0389742d8413d85fc30c6f57689e2/images/large/1.jpg not downloaded yet
2026-03-26 22:56:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77e9b10>
2026-03-26 22:56:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_102740f9-a11d-52fd-a67d-bdfa14b5e0fb/102740f9-a11d-52fd-a67d-bdfa14b5e0fb_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:56:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252Fc842ec7ba9c54f0786ff3c14ff73bc1a%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/c842ec7ba9c54f0786ff3c14ff73bc1a/images/large/8.jpg saved to cache
2026-03-26 22:56:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 102740f9-a11d-52fd-a67d-bdfa14b5e0fb
2026-03-26 22:56:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cb2610>
2026-03-26 22:56:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_102740f9-a11d-52fd-a67d-bdfa14b5e0fb/102740f9-a11d-52fd-a67d-bdfa14b5e0fb_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:56:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252Fc842ec7ba9c54f0786ff3c14ff73bc1a%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/c842ec7ba9c54f0786ff3c14ff73bc1a/images/large/10.jpg saved to cache
2026-03-26 22:56:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 102740f9-a11d-52fd-a67d-bdfa14b5e0fb
2026-03-26 22:56:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b788f1d0>
2026-03-26 22:56:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_102740f9-a11d-52fd-a67d-bdfa14b5e0fb/102740f9-a11d-52fd-a67d-bdfa14b5e0fb_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:56:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252Fc842ec7ba9c54f0786ff3c14ff73bc1a%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/c842ec7ba9c54f0786ff3c14ff73bc1a/images/large/9.jpg saved to cache
2026-03-26 22:56:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 102740f9-a11d-52fd-a67d-bdfa14b5e0fb
2026-03-26 22:56:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 102740f9-a11d-52fd-a67d-bdfa14b5e0fb, skipping ID generation
2026-03-26 22:56:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 102740f9-a11d-52fd-a67d-bdfa14b5e0fb with scrape type 1
2026-03-26 22:56:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 102740f9-a11d-52fd-a67d-bdfa14b5e0fb sending to next pipeline
2026-03-26 22:56:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 102740f9-a11d-52fd-a67d-bdfa14b5e0fb, identifier: 1985607
2026-03-26 22:56:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5ca7e50>
2026-03-26 22:56:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9129de0-b3cc-56eb-8492-96e4712690fb/d9129de0-b3cc-56eb-8492-96e4712690fb_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:56:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F74b564ac282441569f392a2cadaf54b9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/74b564ac282441569f392a2cadaf54b9/images/large/1.jpg saved to cache
2026-03-26 22:56:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d9129de0-b3cc-56eb-8492-96e4712690fb
2026-03-26 22:56:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F5af0389742d8413d85fc30c6f57689e2%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/5af0389742d8413d85fc30c6f57689e2/images/large/2.jpg not downloaded yet
2026-03-26 22:56:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 102740f9-a11d-52fd-a67d-bdfa14b5e0fb with identifier: 1985607
2026-03-26 22:56:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 102740f9-a11d-52fd-a67d-bdfa14b5e0fb with identifier: 1985607
2026-03-26 22:56:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 102740f9-a11d-52fd-a67d-bdfa14b5e0fb with identifier: 1985607 to the API
2026-03-26 22:56:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:56:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:56:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1ym/c842ec7ba9c54f0786ff3c14ff73bc1a/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '102740f9-a11d-52fd-a67d-bdfa14b5e0fb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1 DIESEL - 2019',
 'odometer': 125107,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_102740f9-a11d-52fd-a67d-bdfa14b5e0fb/102740f9-a11d-52fd-a67d-bdfa14b5e0fb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 722017,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ym/c842ec7ba9c54f0786ff3c14ff73bc1a/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_102740f9-a11d-52fd-a67d-bdfa14b5e0fb/102740f9-a11d-52fd-a67d-bdfa14b5e0fb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 696245,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ym/c842ec7ba9c54f0786ff3c14ff73bc1a/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_102740f9-a11d-52fd-a67d-bdfa14b5e0fb/102740f9-a11d-52fd-a67d-bdfa14b5e0fb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 693386,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ym/c842ec7ba9c54f0786ff3c14ff73bc1a/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_102740f9-a11d-52fd-a67d-bdfa14b5e0fb/102740f9-a11d-52fd-a67d-bdfa14b5e0fb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 714969,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ym/c842ec7ba9c54f0786ff3c14ff73bc1a/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_102740f9-a11d-52fd-a67d-bdfa14b5e0fb/102740f9-a11d-52fd-a67d-bdfa14b5e0fb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 719381,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ym/c842ec7ba9c54f0786ff3c14ff73bc1a/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_102740f9-a11d-52fd-a67d-bdfa14b5e0fb/102740f9-a11d-52fd-a67d-bdfa14b5e0fb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 744691,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ym/c842ec7ba9c54f0786ff3c14ff73bc1a/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_102740f9-a11d-52fd-a67d-bdfa14b5e0fb/102740f9-a11d-52fd-a67d-bdfa14b5e0fb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 619688,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ym/c842ec7ba9c54f0786ff3c14ff73bc1a/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_102740f9-a11d-52fd-a67d-bdfa14b5e0fb/102740f9-a11d-52fd-a67d-bdfa14b5e0fb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 842596,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ym/c842ec7ba9c54f0786ff3c14ff73bc1a/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_102740f9-a11d-52fd-a67d-bdfa14b5e0fb/102740f9-a11d-52fd-a67d-bdfa14b5e0fb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 857704,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ym/c842ec7ba9c54f0786ff3c14ff73bc1a/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_102740f9-a11d-52fd-a67d-bdfa14b5e0fb/102740f9-a11d-52fd-a67d-bdfa14b5e0fb_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 836674,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ym/c842ec7ba9c54f0786ff3c14ff73bc1a/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 DIESEL - 2019 1.5 dA sDrive16 AdBlue',
 'transmission': 'automatic',
 'trim': '1.5 dA sDrive16 AdBlue',
 'vin': None,
 'year': 2020}
2026-03-26 22:56:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985607%27 HTTP/1.1" 200 None
2026-03-26 22:56:19 [ayvens.be] INFO: Saving data for 1985607: {'created_time': 1774565779.092292, 'last_price_update_time': 1774565779.092302, 'auction_closing_time': 1774958400.0}
2026-03-26 22:56:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985607') HTTP/1.1" 204 0
2026-03-26 22:56:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F5af0389742d8413d85fc30c6f57689e2%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/5af0389742d8413d85fc30c6f57689e2/images/large/3.jpg not downloaded yet
2026-03-26 22:56:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F5af0389742d8413d85fc30c6f57689e2%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/5af0389742d8413d85fc30c6f57689e2/images/large/4.jpg not downloaded yet
2026-03-26 22:56:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/74b564ac282441569f392a2cadaf54b9/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/74b564ac282441569f392a2cadaf54b9/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F5af0389742d8413d85fc30c6f57689e2%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/5af0389742d8413d85fc30c6f57689e2/images/large/5.jpg not downloaded yet
2026-03-26 22:56:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/74b564ac282441569f392a2cadaf54b9/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/74b564ac282441569f392a2cadaf54b9/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/74b564ac282441569f392a2cadaf54b9/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F5af0389742d8413d85fc30c6f57689e2%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/5af0389742d8413d85fc30c6f57689e2/images/large/6.jpg not downloaded yet
2026-03-26 22:56:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/74b564ac282441569f392a2cadaf54b9/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F5af0389742d8413d85fc30c6f57689e2%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/5af0389742d8413d85fc30c6f57689e2/images/large/7.jpg not downloaded yet
2026-03-26 22:56:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F5af0389742d8413d85fc30c6f57689e2%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/5af0389742d8413d85fc30c6f57689e2/images/large/8.jpg not downloaded yet
2026-03-26 22:56:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/74b564ac282441569f392a2cadaf54b9/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/74b564ac282441569f392a2cadaf54b9/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F5af0389742d8413d85fc30c6f57689e2%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/5af0389742d8413d85fc30c6f57689e2/images/large/9.jpg not downloaded yet
2026-03-26 22:56:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b75a7950>
2026-03-26 22:56:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9129de0-b3cc-56eb-8492-96e4712690fb/d9129de0-b3cc-56eb-8492-96e4712690fb_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:56:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F74b564ac282441569f392a2cadaf54b9%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/74b564ac282441569f392a2cadaf54b9/images/large/2.jpg saved to cache
2026-03-26 22:56:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d9129de0-b3cc-56eb-8492-96e4712690fb
2026-03-26 22:56:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7488790>
2026-03-26 22:56:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9129de0-b3cc-56eb-8492-96e4712690fb/d9129de0-b3cc-56eb-8492-96e4712690fb_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:56:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F74b564ac282441569f392a2cadaf54b9%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/74b564ac282441569f392a2cadaf54b9/images/large/4.jpg saved to cache
2026-03-26 22:56:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d9129de0-b3cc-56eb-8492-96e4712690fb
2026-03-26 22:56:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F5af0389742d8413d85fc30c6f57689e2%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/5af0389742d8413d85fc30c6f57689e2/images/large/10.jpg not downloaded yet
2026-03-26 22:56:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b69b50>
2026-03-26 22:56:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9129de0-b3cc-56eb-8492-96e4712690fb/d9129de0-b3cc-56eb-8492-96e4712690fb_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:56:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F74b564ac282441569f392a2cadaf54b9%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/74b564ac282441569f392a2cadaf54b9/images/large/3.jpg saved to cache
2026-03-26 22:56:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d9129de0-b3cc-56eb-8492-96e4712690fb
2026-03-26 22:56:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e29050>
2026-03-26 22:56:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9129de0-b3cc-56eb-8492-96e4712690fb/d9129de0-b3cc-56eb-8492-96e4712690fb_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:56:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F74b564ac282441569f392a2cadaf54b9%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/74b564ac282441569f392a2cadaf54b9/images/large/5.jpg saved to cache
2026-03-26 22:56:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d9129de0-b3cc-56eb-8492-96e4712690fb
2026-03-26 22:56:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e281d0>
2026-03-26 22:56:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9129de0-b3cc-56eb-8492-96e4712690fb/d9129de0-b3cc-56eb-8492-96e4712690fb_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:56:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F74b564ac282441569f392a2cadaf54b9%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/74b564ac282441569f392a2cadaf54b9/images/large/7.jpg saved to cache
2026-03-26 22:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d9129de0-b3cc-56eb-8492-96e4712690fb
2026-03-26 22:56:20 [ayvens.be] INFO: Found listing with ID: 1985610
2026-03-26 22:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985610%27 HTTP/1.1" 200 None
2026-03-26 22:56:20 [ayvens.be] INFO: Scrape type for 1985610: 1
2026-03-26 22:56:20 [ayvens.be] INFO: Extracting data for car ID: 1985610
2026-03-26 22:56:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8fe589cd-55eb-56c1-a18a-eb475b284f11 with identifier: 1985610
2026-03-26 22:56:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8fe589cd-55eb-56c1-a18a-eb475b284f11 with scrape type 1
2026-03-26 22:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8fe589cd-55eb-56c1-a18a-eb475b284f11
2026-03-26 22:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Ff184258865fb4fcb9bfb26ba1803a5e2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/f184258865fb4fcb9bfb26ba1803a5e2/images/large/1.jpg not downloaded yet
2026-03-26 22:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Ff184258865fb4fcb9bfb26ba1803a5e2%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/f184258865fb4fcb9bfb26ba1803a5e2/images/large/2.jpg not downloaded yet
2026-03-26 22:56:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7944a10>
2026-03-26 22:56:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9129de0-b3cc-56eb-8492-96e4712690fb/d9129de0-b3cc-56eb-8492-96e4712690fb_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F74b564ac282441569f392a2cadaf54b9%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/74b564ac282441569f392a2cadaf54b9/images/large/6.jpg saved to cache
2026-03-26 22:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d9129de0-b3cc-56eb-8492-96e4712690fb
2026-03-26 22:56:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7768e50>
2026-03-26 22:56:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9129de0-b3cc-56eb-8492-96e4712690fb/d9129de0-b3cc-56eb-8492-96e4712690fb_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F74b564ac282441569f392a2cadaf54b9%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/74b564ac282441569f392a2cadaf54b9/images/large/10.jpg saved to cache
2026-03-26 22:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d9129de0-b3cc-56eb-8492-96e4712690fb
2026-03-26 22:56:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7413090>
2026-03-26 22:56:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9129de0-b3cc-56eb-8492-96e4712690fb/d9129de0-b3cc-56eb-8492-96e4712690fb_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F74b564ac282441569f392a2cadaf54b9%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/74b564ac282441569f392a2cadaf54b9/images/large/9.jpg saved to cache
2026-03-26 22:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d9129de0-b3cc-56eb-8492-96e4712690fb
2026-03-26 22:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Ff184258865fb4fcb9bfb26ba1803a5e2%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/f184258865fb4fcb9bfb26ba1803a5e2/images/large/3.jpg not downloaded yet
2026-03-26 22:56:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/5af0389742d8413d85fc30c6f57689e2/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/5af0389742d8413d85fc30c6f57689e2/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Ff184258865fb4fcb9bfb26ba1803a5e2%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/f184258865fb4fcb9bfb26ba1803a5e2/images/large/4.jpg not downloaded yet
2026-03-26 22:56:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/5af0389742d8413d85fc30c6f57689e2/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/5af0389742d8413d85fc30c6f57689e2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Ff184258865fb4fcb9bfb26ba1803a5e2%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/f184258865fb4fcb9bfb26ba1803a5e2/images/large/5.jpg not downloaded yet
2026-03-26 22:56:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/5af0389742d8413d85fc30c6f57689e2/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/5af0389742d8413d85fc30c6f57689e2/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Ff184258865fb4fcb9bfb26ba1803a5e2%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/f184258865fb4fcb9bfb26ba1803a5e2/images/large/6.jpg not downloaded yet
2026-03-26 22:56:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/5af0389742d8413d85fc30c6f57689e2/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/74b564ac282441569f392a2cadaf54b9/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Ff184258865fb4fcb9bfb26ba1803a5e2%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/f184258865fb4fcb9bfb26ba1803a5e2/images/large/7.jpg not downloaded yet
2026-03-26 22:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Ff184258865fb4fcb9bfb26ba1803a5e2%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/f184258865fb4fcb9bfb26ba1803a5e2/images/large/8.jpg not downloaded yet
2026-03-26 22:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Ff184258865fb4fcb9bfb26ba1803a5e2%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/f184258865fb4fcb9bfb26ba1803a5e2/images/large/9.jpg not downloaded yet
2026-03-26 22:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Ff184258865fb4fcb9bfb26ba1803a5e2%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/f184258865fb4fcb9bfb26ba1803a5e2/images/large/10.jpg not downloaded yet
2026-03-26 22:56:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c5f750>
2026-03-26 22:56:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ddafa458-3cf3-57c1-abb3-73f34a7dfa14/ddafa458-3cf3-57c1-abb3-73f34a7dfa14_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F5af0389742d8413d85fc30c6f57689e2%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/5af0389742d8413d85fc30c6f57689e2/images/large/3.jpg saved to cache
2026-03-26 22:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ddafa458-3cf3-57c1-abb3-73f34a7dfa14
2026-03-26 22:56:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b78ab6d0>
2026-03-26 22:56:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ddafa458-3cf3-57c1-abb3-73f34a7dfa14/ddafa458-3cf3-57c1-abb3-73f34a7dfa14_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F5af0389742d8413d85fc30c6f57689e2%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/5af0389742d8413d85fc30c6f57689e2/images/large/2.jpg saved to cache
2026-03-26 22:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ddafa458-3cf3-57c1-abb3-73f34a7dfa14
2026-03-26 22:56:20 [ayvens.be] INFO: Found listing with ID: 1985611
2026-03-26 22:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985611%27 HTTP/1.1" 200 None
2026-03-26 22:56:20 [ayvens.be] INFO: Scrape type for 1985611: 1
2026-03-26 22:56:20 [ayvens.be] INFO: Extracting data for car ID: 1985611
2026-03-26 22:56:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a53da03-7f2a-5801-ba2a-6387e94f4c8c with identifier: 1985611
2026-03-26 22:56:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a53da03-7f2a-5801-ba2a-6387e94f4c8c with scrape type 1
2026-03-26 22:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8a53da03-7f2a-5801-ba2a-6387e94f4c8c
2026-03-26 22:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252F781519fb607c459ebd4a0f8f4d5ea3e7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/781519fb607c459ebd4a0f8f4d5ea3e7/images/large/1.jpg not downloaded yet
2026-03-26 22:56:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e2a990>
2026-03-26 22:56:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ddafa458-3cf3-57c1-abb3-73f34a7dfa14/ddafa458-3cf3-57c1-abb3-73f34a7dfa14_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F5af0389742d8413d85fc30c6f57689e2%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/5af0389742d8413d85fc30c6f57689e2/images/large/5.jpg saved to cache
2026-03-26 22:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ddafa458-3cf3-57c1-abb3-73f34a7dfa14
2026-03-26 22:56:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7982390>
2026-03-26 22:56:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ddafa458-3cf3-57c1-abb3-73f34a7dfa14/ddafa458-3cf3-57c1-abb3-73f34a7dfa14_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F5af0389742d8413d85fc30c6f57689e2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/5af0389742d8413d85fc30c6f57689e2/images/large/1.jpg saved to cache
2026-03-26 22:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ddafa458-3cf3-57c1-abb3-73f34a7dfa14
2026-03-26 22:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252F781519fb607c459ebd4a0f8f4d5ea3e7%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/781519fb607c459ebd4a0f8f4d5ea3e7/images/large/2.jpg not downloaded yet
2026-03-26 22:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252F781519fb607c459ebd4a0f8f4d5ea3e7%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/781519fb607c459ebd4a0f8f4d5ea3e7/images/large/3.jpg not downloaded yet
2026-03-26 22:56:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7440d90>
2026-03-26 22:56:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ddafa458-3cf3-57c1-abb3-73f34a7dfa14/ddafa458-3cf3-57c1-abb3-73f34a7dfa14_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:56:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F5af0389742d8413d85fc30c6f57689e2%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/5af0389742d8413d85fc30c6f57689e2/images/large/4.jpg saved to cache
2026-03-26 22:56:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ddafa458-3cf3-57c1-abb3-73f34a7dfa14
2026-03-26 22:56:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e340d0>
2026-03-26 22:56:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ddafa458-3cf3-57c1-abb3-73f34a7dfa14/ddafa458-3cf3-57c1-abb3-73f34a7dfa14_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:56:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F5af0389742d8413d85fc30c6f57689e2%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/5af0389742d8413d85fc30c6f57689e2/images/large/6.jpg saved to cache
2026-03-26 22:56:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ddafa458-3cf3-57c1-abb3-73f34a7dfa14
2026-03-26 22:56:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74b67d0>
2026-03-26 22:56:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ddafa458-3cf3-57c1-abb3-73f34a7dfa14/ddafa458-3cf3-57c1-abb3-73f34a7dfa14_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:56:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F5af0389742d8413d85fc30c6f57689e2%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/5af0389742d8413d85fc30c6f57689e2/images/large/7.jpg saved to cache
2026-03-26 22:56:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ddafa458-3cf3-57c1-abb3-73f34a7dfa14
2026-03-26 22:56:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b727fa90>
2026-03-26 22:56:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9129de0-b3cc-56eb-8492-96e4712690fb/d9129de0-b3cc-56eb-8492-96e4712690fb_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:56:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F74b564ac282441569f392a2cadaf54b9%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/74b564ac282441569f392a2cadaf54b9/images/large/8.jpg saved to cache
2026-03-26 22:56:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d9129de0-b3cc-56eb-8492-96e4712690fb
2026-03-26 22:56:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d9129de0-b3cc-56eb-8492-96e4712690fb, skipping ID generation
2026-03-26 22:56:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9129de0-b3cc-56eb-8492-96e4712690fb with scrape type 1
2026-03-26 22:56:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d9129de0-b3cc-56eb-8492-96e4712690fb sending to next pipeline
2026-03-26 22:56:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d9129de0-b3cc-56eb-8492-96e4712690fb, identifier: 1985608
2026-03-26 22:56:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d9129de0-b3cc-56eb-8492-96e4712690fb with identifier: 1985608
2026-03-26 22:56:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d9129de0-b3cc-56eb-8492-96e4712690fb with identifier: 1985608
2026-03-26 22:56:21 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d9129de0-b3cc-56eb-8492-96e4712690fb with identifier: 1985608 to the API
2026-03-26 22:56:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:56:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:56:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bb/74b564ac282441569f392a2cadaf54b9/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'd9129de0-b3cc-56eb-8492-96e4712690fb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'LAND ROVER',
 'model': 'RANGE ROVER EVOQUE - 2019',
 'odometer': 53507,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9129de0-b3cc-56eb-8492-96e4712690fb/d9129de0-b3cc-56eb-8492-96e4712690fb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 703959,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/74b564ac282441569f392a2cadaf54b9/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9129de0-b3cc-56eb-8492-96e4712690fb/d9129de0-b3cc-56eb-8492-96e4712690fb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 721703,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/74b564ac282441569f392a2cadaf54b9/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9129de0-b3cc-56eb-8492-96e4712690fb/d9129de0-b3cc-56eb-8492-96e4712690fb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 684512,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/74b564ac282441569f392a2cadaf54b9/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9129de0-b3cc-56eb-8492-96e4712690fb/d9129de0-b3cc-56eb-8492-96e4712690fb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 719743,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/74b564ac282441569f392a2cadaf54b9/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9129de0-b3cc-56eb-8492-96e4712690fb/d9129de0-b3cc-56eb-8492-96e4712690fb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 668425,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/74b564ac282441569f392a2cadaf54b9/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9129de0-b3cc-56eb-8492-96e4712690fb/d9129de0-b3cc-56eb-8492-96e4712690fb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 808680,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/74b564ac282441569f392a2cadaf54b9/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9129de0-b3cc-56eb-8492-96e4712690fb/d9129de0-b3cc-56eb-8492-96e4712690fb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 631065,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/74b564ac282441569f392a2cadaf54b9/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9129de0-b3cc-56eb-8492-96e4712690fb/d9129de0-b3cc-56eb-8492-96e4712690fb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 851046,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/74b564ac282441569f392a2cadaf54b9/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9129de0-b3cc-56eb-8492-96e4712690fb/d9129de0-b3cc-56eb-8492-96e4712690fb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 796747,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/74b564ac282441569f392a2cadaf54b9/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9129de0-b3cc-56eb-8492-96e4712690fb/d9129de0-b3cc-56eb-8492-96e4712690fb_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 798277,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/74b564ac282441569f392a2cadaf54b9/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'LAND ROVER RANGE ROVER EVOQUE - 2019 2.0 Turbo 4WD R-Dynamic HSE',
 'transmission': 'automatic',
 'trim': '2.0 Turbo 4WD R-Dynamic HSE',
 'vin': None,
 'year': 2021}
2026-03-26 22:56:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985608%27 HTTP/1.1" 200 None
2026-03-26 22:56:21 [ayvens.be] INFO: Saving data for 1985608: {'created_time': 1774565781.831232, 'last_price_update_time': 1774565781.831241, 'auction_closing_time': 1774958400.0}
2026-03-26 22:56:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985608') HTTP/1.1" 204 0
2026-03-26 22:56:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252F781519fb607c459ebd4a0f8f4d5ea3e7%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/781519fb607c459ebd4a0f8f4d5ea3e7/images/large/4.jpg not downloaded yet
2026-03-26 22:56:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/5af0389742d8413d85fc30c6f57689e2/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/5af0389742d8413d85fc30c6f57689e2/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/5af0389742d8413d85fc30c6f57689e2/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252F781519fb607c459ebd4a0f8f4d5ea3e7%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/781519fb607c459ebd4a0f8f4d5ea3e7/images/large/5.jpg not downloaded yet
2026-03-26 22:56:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/f184258865fb4fcb9bfb26ba1803a5e2/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/f184258865fb4fcb9bfb26ba1803a5e2/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252F781519fb607c459ebd4a0f8f4d5ea3e7%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/781519fb607c459ebd4a0f8f4d5ea3e7/images/large/6.jpg not downloaded yet
2026-03-26 22:56:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/f184258865fb4fcb9bfb26ba1803a5e2/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/f184258865fb4fcb9bfb26ba1803a5e2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/f184258865fb4fcb9bfb26ba1803a5e2/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252F781519fb607c459ebd4a0f8f4d5ea3e7%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/781519fb607c459ebd4a0f8f4d5ea3e7/images/large/7.jpg not downloaded yet
2026-03-26 22:56:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252F781519fb607c459ebd4a0f8f4d5ea3e7%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/781519fb607c459ebd4a0f8f4d5ea3e7/images/large/8.jpg not downloaded yet
2026-03-26 22:56:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252F781519fb607c459ebd4a0f8f4d5ea3e7%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/781519fb607c459ebd4a0f8f4d5ea3e7/images/large/9.jpg not downloaded yet
2026-03-26 22:56:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252F781519fb607c459ebd4a0f8f4d5ea3e7%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/781519fb607c459ebd4a0f8f4d5ea3e7/images/large/10.jpg not downloaded yet
2026-03-26 22:56:21 [ayvens.be] INFO: Found listing with ID: 1985612
2026-03-26 22:56:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985612%27 HTTP/1.1" 200 None
2026-03-26 22:56:22 [ayvens.be] INFO: Scrape type for 1985612: 1
2026-03-26 22:56:22 [ayvens.be] INFO: Extracting data for car ID: 1985612
2026-03-26 22:56:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2c2d1c4-9322-5908-a639-1d2425340280 with identifier: 1985612
2026-03-26 22:56:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2c2d1c4-9322-5908-a639-1d2425340280 with scrape type 1
2026-03-26 22:56:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b2c2d1c4-9322-5908-a639-1d2425340280
2026-03-26 22:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dh%252Ff27b9dd5ea3a4eb1a83d965a879bc1bb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dh/f27b9dd5ea3a4eb1a83d965a879bc1bb/images/large/1.jpg not downloaded yet
2026-03-26 22:56:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aq/781519fb607c459ebd4a0f8f4d5ea3e7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7745010>
2026-03-26 22:56:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ddafa458-3cf3-57c1-abb3-73f34a7dfa14/ddafa458-3cf3-57c1-abb3-73f34a7dfa14_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F5af0389742d8413d85fc30c6f57689e2%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/5af0389742d8413d85fc30c6f57689e2/images/large/10.jpg saved to cache
2026-03-26 22:56:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ddafa458-3cf3-57c1-abb3-73f34a7dfa14
2026-03-26 22:56:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7649950>
2026-03-26 22:56:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ddafa458-3cf3-57c1-abb3-73f34a7dfa14/ddafa458-3cf3-57c1-abb3-73f34a7dfa14_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F5af0389742d8413d85fc30c6f57689e2%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/5af0389742d8413d85fc30c6f57689e2/images/large/9.jpg saved to cache
2026-03-26 22:56:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ddafa458-3cf3-57c1-abb3-73f34a7dfa14
2026-03-26 22:56:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b741fd10>
2026-03-26 22:56:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ddafa458-3cf3-57c1-abb3-73f34a7dfa14/ddafa458-3cf3-57c1-abb3-73f34a7dfa14_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F5af0389742d8413d85fc30c6f57689e2%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/5af0389742d8413d85fc30c6f57689e2/images/large/8.jpg saved to cache
2026-03-26 22:56:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ddafa458-3cf3-57c1-abb3-73f34a7dfa14
2026-03-26 22:56:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ddafa458-3cf3-57c1-abb3-73f34a7dfa14, skipping ID generation
2026-03-26 22:56:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ddafa458-3cf3-57c1-abb3-73f34a7dfa14 with scrape type 1
2026-03-26 22:56:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ddafa458-3cf3-57c1-abb3-73f34a7dfa14 sending to next pipeline
2026-03-26 22:56:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: ddafa458-3cf3-57c1-abb3-73f34a7dfa14, identifier: 1985609
2026-03-26 22:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dh%252Ff27b9dd5ea3a4eb1a83d965a879bc1bb%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dh/f27b9dd5ea3a4eb1a83d965a879bc1bb/images/large/2.jpg not downloaded yet
2026-03-26 22:56:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: ddafa458-3cf3-57c1-abb3-73f34a7dfa14 with identifier: 1985609
2026-03-26 22:56:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: ddafa458-3cf3-57c1-abb3-73f34a7dfa14 with identifier: 1985609
2026-03-26 22:56:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: ddafa458-3cf3-57c1-abb3-73f34a7dfa14 with identifier: 1985609 to the API
2026-03-26 22:56:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:56:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:56:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ad/5af0389742d8413d85fc30c6f57689e2/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ddafa458-3cf3-57c1-abb3-73f34a7dfa14',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'PASSAT VARIANT',
 'odometer': 85430,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddafa458-3cf3-57c1-abb3-73f34a7dfa14/ddafa458-3cf3-57c1-abb3-73f34a7dfa14_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 635597,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/5af0389742d8413d85fc30c6f57689e2/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddafa458-3cf3-57c1-abb3-73f34a7dfa14/ddafa458-3cf3-57c1-abb3-73f34a7dfa14_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 582223,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/5af0389742d8413d85fc30c6f57689e2/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddafa458-3cf3-57c1-abb3-73f34a7dfa14/ddafa458-3cf3-57c1-abb3-73f34a7dfa14_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 582845,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/5af0389742d8413d85fc30c6f57689e2/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddafa458-3cf3-57c1-abb3-73f34a7dfa14/ddafa458-3cf3-57c1-abb3-73f34a7dfa14_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 689912,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/5af0389742d8413d85fc30c6f57689e2/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddafa458-3cf3-57c1-abb3-73f34a7dfa14/ddafa458-3cf3-57c1-abb3-73f34a7dfa14_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 637043,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/5af0389742d8413d85fc30c6f57689e2/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddafa458-3cf3-57c1-abb3-73f34a7dfa14/ddafa458-3cf3-57c1-abb3-73f34a7dfa14_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 551342,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/5af0389742d8413d85fc30c6f57689e2/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddafa458-3cf3-57c1-abb3-73f34a7dfa14/ddafa458-3cf3-57c1-abb3-73f34a7dfa14_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 689143,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/5af0389742d8413d85fc30c6f57689e2/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddafa458-3cf3-57c1-abb3-73f34a7dfa14/ddafa458-3cf3-57c1-abb3-73f34a7dfa14_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 711315,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/5af0389742d8413d85fc30c6f57689e2/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddafa458-3cf3-57c1-abb3-73f34a7dfa14/ddafa458-3cf3-57c1-abb3-73f34a7dfa14_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 605640,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/5af0389742d8413d85fc30c6f57689e2/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddafa458-3cf3-57c1-abb3-73f34a7dfa14/ddafa458-3cf3-57c1-abb3-73f34a7dfa14_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 575265,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/5af0389742d8413d85fc30c6f57689e2/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN PASSAT VARIANT 2.0 TDI 90KW MSQ VARIANT STYLE BUSINESS',
 'transmission': 'automatic',
 'trim': '2.0 TDI 90KW MSQ VARIANT STYLE BUSINESS',
 'vin': None,
 'year': 2021}
2026-03-26 22:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985609%27 HTTP/1.1" 200 None
2026-03-26 22:56:22 [ayvens.be] INFO: Saving data for 1985609: {'created_time': 1774565782.70442, 'last_price_update_time': 1774565782.704429, 'auction_closing_time': 1774958400.0}
2026-03-26 22:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985609') HTTP/1.1" 204 0
2026-03-26 22:56:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aq/781519fb607c459ebd4a0f8f4d5ea3e7/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7403390>
2026-03-26 22:56:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fe589cd-55eb-56c1-a18a-eb475b284f11/8fe589cd-55eb-56c1-a18a-eb475b284f11_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Ff184258865fb4fcb9bfb26ba1803a5e2%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/f184258865fb4fcb9bfb26ba1803a5e2/images/large/2.jpg saved to cache
2026-03-26 22:56:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8fe589cd-55eb-56c1-a18a-eb475b284f11
2026-03-26 22:56:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6d81d50>
2026-03-26 22:56:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fe589cd-55eb-56c1-a18a-eb475b284f11/8fe589cd-55eb-56c1-a18a-eb475b284f11_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Ff184258865fb4fcb9bfb26ba1803a5e2%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/f184258865fb4fcb9bfb26ba1803a5e2/images/large/3.jpg saved to cache
2026-03-26 22:56:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8fe589cd-55eb-56c1-a18a-eb475b284f11
2026-03-26 22:56:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7441310>
2026-03-26 22:56:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fe589cd-55eb-56c1-a18a-eb475b284f11/8fe589cd-55eb-56c1-a18a-eb475b284f11_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Ff184258865fb4fcb9bfb26ba1803a5e2%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/f184258865fb4fcb9bfb26ba1803a5e2/images/large/5.jpg saved to cache
2026-03-26 22:56:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8fe589cd-55eb-56c1-a18a-eb475b284f11
2026-03-26 22:56:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7496690>
2026-03-26 22:56:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fe589cd-55eb-56c1-a18a-eb475b284f11/8fe589cd-55eb-56c1-a18a-eb475b284f11_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Ff184258865fb4fcb9bfb26ba1803a5e2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/f184258865fb4fcb9bfb26ba1803a5e2/images/large/1.jpg saved to cache
2026-03-26 22:56:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8fe589cd-55eb-56c1-a18a-eb475b284f11
2026-03-26 22:56:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74bd5d0>
2026-03-26 22:56:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fe589cd-55eb-56c1-a18a-eb475b284f11/8fe589cd-55eb-56c1-a18a-eb475b284f11_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Ff184258865fb4fcb9bfb26ba1803a5e2%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/f184258865fb4fcb9bfb26ba1803a5e2/images/large/4.jpg saved to cache
2026-03-26 22:56:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8fe589cd-55eb-56c1-a18a-eb475b284f11
2026-03-26 22:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dh%252Ff27b9dd5ea3a4eb1a83d965a879bc1bb%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dh/f27b9dd5ea3a4eb1a83d965a879bc1bb/images/large/3.jpg not downloaded yet
2026-03-26 22:56:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aq/781519fb607c459ebd4a0f8f4d5ea3e7/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dh%252Ff27b9dd5ea3a4eb1a83d965a879bc1bb%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dh/f27b9dd5ea3a4eb1a83d965a879bc1bb/images/large/4.jpg not downloaded yet
2026-03-26 22:56:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79d5150>
2026-03-26 22:56:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a53da03-7f2a-5801-ba2a-6387e94f4c8c/8a53da03-7f2a-5801-ba2a-6387e94f4c8c_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252F781519fb607c459ebd4a0f8f4d5ea3e7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/781519fb607c459ebd4a0f8f4d5ea3e7/images/large/1.jpg saved to cache
2026-03-26 22:56:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8a53da03-7f2a-5801-ba2a-6387e94f4c8c
2026-03-26 22:56:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b99e50>
2026-03-26 22:56:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a53da03-7f2a-5801-ba2a-6387e94f4c8c/8a53da03-7f2a-5801-ba2a-6387e94f4c8c_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252F781519fb607c459ebd4a0f8f4d5ea3e7%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/781519fb607c459ebd4a0f8f4d5ea3e7/images/large/2.jpg saved to cache
2026-03-26 22:56:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8a53da03-7f2a-5801-ba2a-6387e94f4c8c
2026-03-26 22:56:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aq/781519fb607c459ebd4a0f8f4d5ea3e7/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dh%252Ff27b9dd5ea3a4eb1a83d965a879bc1bb%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dh/f27b9dd5ea3a4eb1a83d965a879bc1bb/images/large/5.jpg not downloaded yet
2026-03-26 22:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dh%252Ff27b9dd5ea3a4eb1a83d965a879bc1bb%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dh/f27b9dd5ea3a4eb1a83d965a879bc1bb/images/large/6.jpg not downloaded yet
2026-03-26 22:56:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/f184258865fb4fcb9bfb26ba1803a5e2/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aq/781519fb607c459ebd4a0f8f4d5ea3e7/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6da6b10>
2026-03-26 22:56:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a53da03-7f2a-5801-ba2a-6387e94f4c8c/8a53da03-7f2a-5801-ba2a-6387e94f4c8c_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252F781519fb607c459ebd4a0f8f4d5ea3e7%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/781519fb607c459ebd4a0f8f4d5ea3e7/images/large/3.jpg saved to cache
2026-03-26 22:56:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8a53da03-7f2a-5801-ba2a-6387e94f4c8c
2026-03-26 22:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dh%252Ff27b9dd5ea3a4eb1a83d965a879bc1bb%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dh/f27b9dd5ea3a4eb1a83d965a879bc1bb/images/large/7.jpg not downloaded yet
2026-03-26 22:56:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/f184258865fb4fcb9bfb26ba1803a5e2/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/f184258865fb4fcb9bfb26ba1803a5e2/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/f184258865fb4fcb9bfb26ba1803a5e2/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dh%252Ff27b9dd5ea3a4eb1a83d965a879bc1bb%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dh/f27b9dd5ea3a4eb1a83d965a879bc1bb/images/large/8.jpg not downloaded yet
2026-03-26 22:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dh%252Ff27b9dd5ea3a4eb1a83d965a879bc1bb%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dh/f27b9dd5ea3a4eb1a83d965a879bc1bb/images/large/9.jpg not downloaded yet
2026-03-26 22:56:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b35f90>
2026-03-26 22:56:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a53da03-7f2a-5801-ba2a-6387e94f4c8c/8a53da03-7f2a-5801-ba2a-6387e94f4c8c_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252F781519fb607c459ebd4a0f8f4d5ea3e7%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/781519fb607c459ebd4a0f8f4d5ea3e7/images/large/4.jpg saved to cache
2026-03-26 22:56:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8a53da03-7f2a-5801-ba2a-6387e94f4c8c
2026-03-26 22:56:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/f184258865fb4fcb9bfb26ba1803a5e2/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dh%252Ff27b9dd5ea3a4eb1a83d965a879bc1bb%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dh/f27b9dd5ea3a4eb1a83d965a879bc1bb/images/large/10.jpg not downloaded yet
2026-03-26 22:56:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aq/781519fb607c459ebd4a0f8f4d5ea3e7/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:23 [ayvens.be] INFO: Found listing with ID: 1985613
2026-03-26 22:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985613%27 HTTP/1.1" 200 None
2026-03-26 22:56:23 [ayvens.be] INFO: Scrape type for 1985613: 1
2026-03-26 22:56:23 [ayvens.be] INFO: Extracting data for car ID: 1985613
2026-03-26 22:56:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e7ac458c-7145-517c-9805-468b8545bc8f with identifier: 1985613
2026-03-26 22:56:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7ac458c-7145-517c-9805-468b8545bc8f with scrape type 1
2026-03-26 22:56:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e7ac458c-7145-517c-9805-468b8545bc8f
2026-03-26 22:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252Ff86bc232d31c4655a06e40aa3d9bfeae%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/f86bc232d31c4655a06e40aa3d9bfeae/images/large/1.jpg not downloaded yet
2026-03-26 22:56:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aq/781519fb607c459ebd4a0f8f4d5ea3e7/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e28410>
2026-03-26 22:56:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fe589cd-55eb-56c1-a18a-eb475b284f11/8fe589cd-55eb-56c1-a18a-eb475b284f11_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Ff184258865fb4fcb9bfb26ba1803a5e2%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/f184258865fb4fcb9bfb26ba1803a5e2/images/large/7.jpg saved to cache
2026-03-26 22:56:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8fe589cd-55eb-56c1-a18a-eb475b284f11
2026-03-26 22:56:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76e1cd0>
2026-03-26 22:56:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a53da03-7f2a-5801-ba2a-6387e94f4c8c/8a53da03-7f2a-5801-ba2a-6387e94f4c8c_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252F781519fb607c459ebd4a0f8f4d5ea3e7%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/781519fb607c459ebd4a0f8f4d5ea3e7/images/large/5.jpg saved to cache
2026-03-26 22:56:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8a53da03-7f2a-5801-ba2a-6387e94f4c8c
2026-03-26 22:56:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b764be90>
2026-03-26 22:56:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fe589cd-55eb-56c1-a18a-eb475b284f11/8fe589cd-55eb-56c1-a18a-eb475b284f11_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Ff184258865fb4fcb9bfb26ba1803a5e2%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/f184258865fb4fcb9bfb26ba1803a5e2/images/large/10.jpg saved to cache
2026-03-26 22:56:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8fe589cd-55eb-56c1-a18a-eb475b284f11
2026-03-26 22:56:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74a59d0>
2026-03-26 22:56:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fe589cd-55eb-56c1-a18a-eb475b284f11/8fe589cd-55eb-56c1-a18a-eb475b284f11_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Ff184258865fb4fcb9bfb26ba1803a5e2%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/f184258865fb4fcb9bfb26ba1803a5e2/images/large/6.jpg saved to cache
2026-03-26 22:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8fe589cd-55eb-56c1-a18a-eb475b284f11
2026-03-26 22:56:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dh/f27b9dd5ea3a4eb1a83d965a879bc1bb/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252Ff86bc232d31c4655a06e40aa3d9bfeae%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/f86bc232d31c4655a06e40aa3d9bfeae/images/large/2.jpg not downloaded yet
2026-03-26 22:56:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bead1510>
2026-03-26 22:56:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fe589cd-55eb-56c1-a18a-eb475b284f11/8fe589cd-55eb-56c1-a18a-eb475b284f11_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Ff184258865fb4fcb9bfb26ba1803a5e2%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/f184258865fb4fcb9bfb26ba1803a5e2/images/large/9.jpg saved to cache
2026-03-26 22:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8fe589cd-55eb-56c1-a18a-eb475b284f11
2026-03-26 22:56:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aq/781519fb607c459ebd4a0f8f4d5ea3e7/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252Ff86bc232d31c4655a06e40aa3d9bfeae%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/f86bc232d31c4655a06e40aa3d9bfeae/images/large/3.jpg not downloaded yet
2026-03-26 22:56:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aq/781519fb607c459ebd4a0f8f4d5ea3e7/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aq/781519fb607c459ebd4a0f8f4d5ea3e7/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252Ff86bc232d31c4655a06e40aa3d9bfeae%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/f86bc232d31c4655a06e40aa3d9bfeae/images/large/4.jpg not downloaded yet
2026-03-26 22:56:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7688990>
2026-03-26 22:56:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fe589cd-55eb-56c1-a18a-eb475b284f11/8fe589cd-55eb-56c1-a18a-eb475b284f11_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Ff184258865fb4fcb9bfb26ba1803a5e2%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/f184258865fb4fcb9bfb26ba1803a5e2/images/large/8.jpg saved to cache
2026-03-26 22:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8fe589cd-55eb-56c1-a18a-eb475b284f11
2026-03-26 22:56:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8fe589cd-55eb-56c1-a18a-eb475b284f11, skipping ID generation
2026-03-26 22:56:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8fe589cd-55eb-56c1-a18a-eb475b284f11 with scrape type 1
2026-03-26 22:56:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8fe589cd-55eb-56c1-a18a-eb475b284f11 sending to next pipeline
2026-03-26 22:56:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 8fe589cd-55eb-56c1-a18a-eb475b284f11, identifier: 1985610
2026-03-26 22:56:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7593b50>
2026-03-26 22:56:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a53da03-7f2a-5801-ba2a-6387e94f4c8c/8a53da03-7f2a-5801-ba2a-6387e94f4c8c_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252F781519fb607c459ebd4a0f8f4d5ea3e7%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/781519fb607c459ebd4a0f8f4d5ea3e7/images/large/9.jpg saved to cache
2026-03-26 22:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8a53da03-7f2a-5801-ba2a-6387e94f4c8c
2026-03-26 22:56:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7a81c90>
2026-03-26 22:56:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a53da03-7f2a-5801-ba2a-6387e94f4c8c/8a53da03-7f2a-5801-ba2a-6387e94f4c8c_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252F781519fb607c459ebd4a0f8f4d5ea3e7%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/781519fb607c459ebd4a0f8f4d5ea3e7/images/large/10.jpg saved to cache
2026-03-26 22:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8a53da03-7f2a-5801-ba2a-6387e94f4c8c
2026-03-26 22:56:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6d73450>
2026-03-26 22:56:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2c2d1c4-9322-5908-a639-1d2425340280/b2c2d1c4-9322-5908-a639-1d2425340280_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dh%252Ff27b9dd5ea3a4eb1a83d965a879bc1bb%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dh/f27b9dd5ea3a4eb1a83d965a879bc1bb/images/large/2.jpg saved to cache
2026-03-26 22:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b2c2d1c4-9322-5908-a639-1d2425340280
2026-03-26 22:56:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 8fe589cd-55eb-56c1-a18a-eb475b284f11 with identifier: 1985610
2026-03-26 22:56:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 8fe589cd-55eb-56c1-a18a-eb475b284f11 with identifier: 1985610
2026-03-26 22:56:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 8fe589cd-55eb-56c1-a18a-eb475b284f11 with identifier: 1985610 to the API
2026-03-26 22:56:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:56:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:56:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ac/f184258865fb4fcb9bfb26ba1803a5e2/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '8fe589cd-55eb-56c1-a18a-eb475b284f11',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'PASSAT VARIANT',
 'odometer': 135693,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fe589cd-55eb-56c1-a18a-eb475b284f11/8fe589cd-55eb-56c1-a18a-eb475b284f11_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 696271,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/f184258865fb4fcb9bfb26ba1803a5e2/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fe589cd-55eb-56c1-a18a-eb475b284f11/8fe589cd-55eb-56c1-a18a-eb475b284f11_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 728995,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/f184258865fb4fcb9bfb26ba1803a5e2/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fe589cd-55eb-56c1-a18a-eb475b284f11/8fe589cd-55eb-56c1-a18a-eb475b284f11_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 695053,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/f184258865fb4fcb9bfb26ba1803a5e2/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fe589cd-55eb-56c1-a18a-eb475b284f11/8fe589cd-55eb-56c1-a18a-eb475b284f11_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 768845,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/f184258865fb4fcb9bfb26ba1803a5e2/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fe589cd-55eb-56c1-a18a-eb475b284f11/8fe589cd-55eb-56c1-a18a-eb475b284f11_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 708883,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/f184258865fb4fcb9bfb26ba1803a5e2/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fe589cd-55eb-56c1-a18a-eb475b284f11/8fe589cd-55eb-56c1-a18a-eb475b284f11_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 767768,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/f184258865fb4fcb9bfb26ba1803a5e2/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fe589cd-55eb-56c1-a18a-eb475b284f11/8fe589cd-55eb-56c1-a18a-eb475b284f11_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 675004,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/f184258865fb4fcb9bfb26ba1803a5e2/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fe589cd-55eb-56c1-a18a-eb475b284f11/8fe589cd-55eb-56c1-a18a-eb475b284f11_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 963842,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/f184258865fb4fcb9bfb26ba1803a5e2/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fe589cd-55eb-56c1-a18a-eb475b284f11/8fe589cd-55eb-56c1-a18a-eb475b284f11_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 893962,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/f184258865fb4fcb9bfb26ba1803a5e2/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fe589cd-55eb-56c1-a18a-eb475b284f11/8fe589cd-55eb-56c1-a18a-eb475b284f11_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 923287,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/f184258865fb4fcb9bfb26ba1803a5e2/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN PASSAT VARIANT 2.0 TDI 90KW MSQ VARIANT STYLE BUSINESS',
 'transmission': 'automatic',
 'trim': '2.0 TDI 90KW MSQ VARIANT STYLE BUSINESS',
 'vin': None,
 'year': 2021}
2026-03-26 22:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985610%27 HTTP/1.1" 200 None
2026-03-26 22:56:25 [ayvens.be] INFO: Saving data for 1985610: {'created_time': 1774565785.010643, 'last_price_update_time': 1774565785.010652, 'auction_closing_time': 1774958400.0}
2026-03-26 22:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985610') HTTP/1.1" 204 0
2026-03-26 22:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252Ff86bc232d31c4655a06e40aa3d9bfeae%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/f86bc232d31c4655a06e40aa3d9bfeae/images/large/5.jpg not downloaded yet
2026-03-26 22:56:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dh/f27b9dd5ea3a4eb1a83d965a879bc1bb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dh/f27b9dd5ea3a4eb1a83d965a879bc1bb/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252Ff86bc232d31c4655a06e40aa3d9bfeae%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/f86bc232d31c4655a06e40aa3d9bfeae/images/large/6.jpg not downloaded yet
2026-03-26 22:56:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b78ab9d0>
2026-03-26 22:56:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a53da03-7f2a-5801-ba2a-6387e94f4c8c/8a53da03-7f2a-5801-ba2a-6387e94f4c8c_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252F781519fb607c459ebd4a0f8f4d5ea3e7%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/781519fb607c459ebd4a0f8f4d5ea3e7/images/large/8.jpg saved to cache
2026-03-26 22:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8a53da03-7f2a-5801-ba2a-6387e94f4c8c
2026-03-26 22:56:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7585090>
2026-03-26 22:56:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a53da03-7f2a-5801-ba2a-6387e94f4c8c/8a53da03-7f2a-5801-ba2a-6387e94f4c8c_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252F781519fb607c459ebd4a0f8f4d5ea3e7%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/781519fb607c459ebd4a0f8f4d5ea3e7/images/large/7.jpg saved to cache
2026-03-26 22:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8a53da03-7f2a-5801-ba2a-6387e94f4c8c
2026-03-26 22:56:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cb0310>
2026-03-26 22:56:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a53da03-7f2a-5801-ba2a-6387e94f4c8c/8a53da03-7f2a-5801-ba2a-6387e94f4c8c_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252F781519fb607c459ebd4a0f8f4d5ea3e7%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/781519fb607c459ebd4a0f8f4d5ea3e7/images/large/6.jpg saved to cache
2026-03-26 22:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8a53da03-7f2a-5801-ba2a-6387e94f4c8c
2026-03-26 22:56:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8a53da03-7f2a-5801-ba2a-6387e94f4c8c, skipping ID generation
2026-03-26 22:56:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a53da03-7f2a-5801-ba2a-6387e94f4c8c with scrape type 1
2026-03-26 22:56:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8a53da03-7f2a-5801-ba2a-6387e94f4c8c sending to next pipeline
2026-03-26 22:56:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 8a53da03-7f2a-5801-ba2a-6387e94f4c8c, identifier: 1985611
2026-03-26 22:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252Ff86bc232d31c4655a06e40aa3d9bfeae%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/f86bc232d31c4655a06e40aa3d9bfeae/images/large/7.jpg not downloaded yet
2026-03-26 22:56:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 8a53da03-7f2a-5801-ba2a-6387e94f4c8c with identifier: 1985611
2026-03-26 22:56:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 8a53da03-7f2a-5801-ba2a-6387e94f4c8c with identifier: 1985611
2026-03-26 22:56:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 8a53da03-7f2a-5801-ba2a-6387e94f4c8c with identifier: 1985611 to the API
2026-03-26 22:56:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:56:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:56:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2aq/781519fb607c459ebd4a0f8f4d5ea3e7/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '8a53da03-7f2a-5801-ba2a-6387e94f4c8c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLASS A (W177)',
 'odometer': 17867,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a53da03-7f2a-5801-ba2a-6387e94f4c8c/8a53da03-7f2a-5801-ba2a-6387e94f4c8c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 198566,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/781519fb607c459ebd4a0f8f4d5ea3e7/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a53da03-7f2a-5801-ba2a-6387e94f4c8c/8a53da03-7f2a-5801-ba2a-6387e94f4c8c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 204828,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/781519fb607c459ebd4a0f8f4d5ea3e7/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a53da03-7f2a-5801-ba2a-6387e94f4c8c/8a53da03-7f2a-5801-ba2a-6387e94f4c8c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 222656,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/781519fb607c459ebd4a0f8f4d5ea3e7/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a53da03-7f2a-5801-ba2a-6387e94f4c8c/8a53da03-7f2a-5801-ba2a-6387e94f4c8c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 222489,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/781519fb607c459ebd4a0f8f4d5ea3e7/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a53da03-7f2a-5801-ba2a-6387e94f4c8c/8a53da03-7f2a-5801-ba2a-6387e94f4c8c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 244216,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/781519fb607c459ebd4a0f8f4d5ea3e7/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a53da03-7f2a-5801-ba2a-6387e94f4c8c/8a53da03-7f2a-5801-ba2a-6387e94f4c8c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 259411,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/781519fb607c459ebd4a0f8f4d5ea3e7/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a53da03-7f2a-5801-ba2a-6387e94f4c8c/8a53da03-7f2a-5801-ba2a-6387e94f4c8c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 273139,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/781519fb607c459ebd4a0f8f4d5ea3e7/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a53da03-7f2a-5801-ba2a-6387e94f4c8c/8a53da03-7f2a-5801-ba2a-6387e94f4c8c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 233919,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/781519fb607c459ebd4a0f8f4d5ea3e7/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a53da03-7f2a-5801-ba2a-6387e94f4c8c/8a53da03-7f2a-5801-ba2a-6387e94f4c8c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 175486,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/781519fb607c459ebd4a0f8f4d5ea3e7/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a53da03-7f2a-5801-ba2a-6387e94f4c8c/8a53da03-7f2a-5801-ba2a-6387e94f4c8c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 238191,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/781519fb607c459ebd4a0f8f4d5ea3e7/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLASS A (W177) A 160 Business Solution',
 'transmission': 'manual',
 'trim': 'A 160 Business Solution',
 'vin': None,
 'year': 2021}
2026-03-26 22:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985611%27 HTTP/1.1" 200 None
2026-03-26 22:56:25 [ayvens.be] INFO: Saving data for 1985611: {'created_time': 1774565785.706662, 'last_price_update_time': 1774565785.706672, 'auction_closing_time': 1774958400.0}
2026-03-26 22:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985611') HTTP/1.1" 204 0
2026-03-26 22:56:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dh/f27b9dd5ea3a4eb1a83d965a879bc1bb/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dh/f27b9dd5ea3a4eb1a83d965a879bc1bb/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252Ff86bc232d31c4655a06e40aa3d9bfeae%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/f86bc232d31c4655a06e40aa3d9bfeae/images/large/8.jpg not downloaded yet
2026-03-26 22:56:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e3e4d0>
2026-03-26 22:56:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2c2d1c4-9322-5908-a639-1d2425340280/b2c2d1c4-9322-5908-a639-1d2425340280_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dh%252Ff27b9dd5ea3a4eb1a83d965a879bc1bb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dh/f27b9dd5ea3a4eb1a83d965a879bc1bb/images/large/1.jpg saved to cache
2026-03-26 22:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b2c2d1c4-9322-5908-a639-1d2425340280
2026-03-26 22:56:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7593f50>
2026-03-26 22:56:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2c2d1c4-9322-5908-a639-1d2425340280/b2c2d1c4-9322-5908-a639-1d2425340280_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dh%252Ff27b9dd5ea3a4eb1a83d965a879bc1bb%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dh/f27b9dd5ea3a4eb1a83d965a879bc1bb/images/large/3.jpg saved to cache
2026-03-26 22:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b2c2d1c4-9322-5908-a639-1d2425340280
2026-03-26 22:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252Ff86bc232d31c4655a06e40aa3d9bfeae%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/f86bc232d31c4655a06e40aa3d9bfeae/images/large/9.jpg not downloaded yet
2026-03-26 22:56:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dh/f27b9dd5ea3a4eb1a83d965a879bc1bb/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dh/f27b9dd5ea3a4eb1a83d965a879bc1bb/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dh/f27b9dd5ea3a4eb1a83d965a879bc1bb/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dh/f27b9dd5ea3a4eb1a83d965a879bc1bb/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252Ff86bc232d31c4655a06e40aa3d9bfeae%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/f86bc232d31c4655a06e40aa3d9bfeae/images/large/10.jpg not downloaded yet
2026-03-26 22:56:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd0d0410>
2026-03-26 22:56:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2c2d1c4-9322-5908-a639-1d2425340280/b2c2d1c4-9322-5908-a639-1d2425340280_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dh%252Ff27b9dd5ea3a4eb1a83d965a879bc1bb%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dh/f27b9dd5ea3a4eb1a83d965a879bc1bb/images/large/4.jpg saved to cache
2026-03-26 22:56:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b2c2d1c4-9322-5908-a639-1d2425340280
2026-03-26 22:56:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e298d0>
2026-03-26 22:56:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2c2d1c4-9322-5908-a639-1d2425340280/b2c2d1c4-9322-5908-a639-1d2425340280_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dh%252Ff27b9dd5ea3a4eb1a83d965a879bc1bb%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dh/f27b9dd5ea3a4eb1a83d965a879bc1bb/images/large/5.jpg saved to cache
2026-03-26 22:56:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b2c2d1c4-9322-5908-a639-1d2425340280
2026-03-26 22:56:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dg/f86bc232d31c4655a06e40aa3d9bfeae/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:26 [ayvens.be] INFO: Found listing with ID: 1985614
2026-03-26 22:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985614%27 HTTP/1.1" 200 None
2026-03-26 22:56:26 [ayvens.be] INFO: Scrape type for 1985614: 1
2026-03-26 22:56:26 [ayvens.be] INFO: Extracting data for car ID: 1985614
2026-03-26 22:56:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3fee27e6-61f1-5f95-91d9-a32647513628 with identifier: 1985614
2026-03-26 22:56:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3fee27e6-61f1-5f95-91d9-a32647513628 with scrape type 1
2026-03-26 22:56:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3fee27e6-61f1-5f95-91d9-a32647513628
2026-03-26 22:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F41166c51428a411288f5fcdf809fd864%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/41166c51428a411288f5fcdf809fd864/images/large/1.jpg not downloaded yet
2026-03-26 22:56:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dg/f86bc232d31c4655a06e40aa3d9bfeae/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F41166c51428a411288f5fcdf809fd864%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/41166c51428a411288f5fcdf809fd864/images/large/2.jpg not downloaded yet
2026-03-26 22:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F41166c51428a411288f5fcdf809fd864%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/41166c51428a411288f5fcdf809fd864/images/large/3.jpg not downloaded yet
2026-03-26 22:56:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c970d0>
2026-03-26 22:56:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2c2d1c4-9322-5908-a639-1d2425340280/b2c2d1c4-9322-5908-a639-1d2425340280_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dh%252Ff27b9dd5ea3a4eb1a83d965a879bc1bb%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dh/f27b9dd5ea3a4eb1a83d965a879bc1bb/images/large/6.jpg saved to cache
2026-03-26 22:56:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b2c2d1c4-9322-5908-a639-1d2425340280
2026-03-26 22:56:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7778910>
2026-03-26 22:56:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2c2d1c4-9322-5908-a639-1d2425340280/b2c2d1c4-9322-5908-a639-1d2425340280_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dh%252Ff27b9dd5ea3a4eb1a83d965a879bc1bb%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dh/f27b9dd5ea3a4eb1a83d965a879bc1bb/images/large/7.jpg saved to cache
2026-03-26 22:56:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b2c2d1c4-9322-5908-a639-1d2425340280
2026-03-26 22:56:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76e0610>
2026-03-26 22:56:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2c2d1c4-9322-5908-a639-1d2425340280/b2c2d1c4-9322-5908-a639-1d2425340280_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dh%252Ff27b9dd5ea3a4eb1a83d965a879bc1bb%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dh/f27b9dd5ea3a4eb1a83d965a879bc1bb/images/large/9.jpg saved to cache
2026-03-26 22:56:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b2c2d1c4-9322-5908-a639-1d2425340280
2026-03-26 22:56:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e1c450>
2026-03-26 22:56:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2c2d1c4-9322-5908-a639-1d2425340280/b2c2d1c4-9322-5908-a639-1d2425340280_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dh%252Ff27b9dd5ea3a4eb1a83d965a879bc1bb%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dh/f27b9dd5ea3a4eb1a83d965a879bc1bb/images/large/8.jpg saved to cache
2026-03-26 22:56:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b2c2d1c4-9322-5908-a639-1d2425340280
2026-03-26 22:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F41166c51428a411288f5fcdf809fd864%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/41166c51428a411288f5fcdf809fd864/images/large/4.jpg not downloaded yet
2026-03-26 22:56:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dg/f86bc232d31c4655a06e40aa3d9bfeae/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F41166c51428a411288f5fcdf809fd864%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/41166c51428a411288f5fcdf809fd864/images/large/5.jpg not downloaded yet
2026-03-26 22:56:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dh/f27b9dd5ea3a4eb1a83d965a879bc1bb/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b787eb10>
2026-03-26 22:56:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7ac458c-7145-517c-9805-468b8545bc8f/e7ac458c-7145-517c-9805-468b8545bc8f_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252Ff86bc232d31c4655a06e40aa3d9bfeae%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/f86bc232d31c4655a06e40aa3d9bfeae/images/large/2.jpg saved to cache
2026-03-26 22:56:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e7ac458c-7145-517c-9805-468b8545bc8f
2026-03-26 22:56:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6da7190>
2026-03-26 22:56:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7ac458c-7145-517c-9805-468b8545bc8f/e7ac458c-7145-517c-9805-468b8545bc8f_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252Ff86bc232d31c4655a06e40aa3d9bfeae%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/f86bc232d31c4655a06e40aa3d9bfeae/images/large/1.jpg saved to cache
2026-03-26 22:56:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e7ac458c-7145-517c-9805-468b8545bc8f
2026-03-26 22:56:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dg/f86bc232d31c4655a06e40aa3d9bfeae/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F41166c51428a411288f5fcdf809fd864%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/41166c51428a411288f5fcdf809fd864/images/large/6.jpg not downloaded yet
2026-03-26 22:56:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dg/f86bc232d31c4655a06e40aa3d9bfeae/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F41166c51428a411288f5fcdf809fd864%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/41166c51428a411288f5fcdf809fd864/images/large/7.jpg not downloaded yet
2026-03-26 22:56:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dg/f86bc232d31c4655a06e40aa3d9bfeae/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dg/f86bc232d31c4655a06e40aa3d9bfeae/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F41166c51428a411288f5fcdf809fd864%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/41166c51428a411288f5fcdf809fd864/images/large/8.jpg not downloaded yet
2026-03-26 22:56:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cbe550>
2026-03-26 22:56:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7ac458c-7145-517c-9805-468b8545bc8f/e7ac458c-7145-517c-9805-468b8545bc8f_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252Ff86bc232d31c4655a06e40aa3d9bfeae%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/f86bc232d31c4655a06e40aa3d9bfeae/images/large/3.jpg saved to cache
2026-03-26 22:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e7ac458c-7145-517c-9805-468b8545bc8f
2026-03-26 22:56:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b75878d0>
2026-03-26 22:56:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2c2d1c4-9322-5908-a639-1d2425340280/b2c2d1c4-9322-5908-a639-1d2425340280_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dh%252Ff27b9dd5ea3a4eb1a83d965a879bc1bb%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dh/f27b9dd5ea3a4eb1a83d965a879bc1bb/images/large/10.jpg saved to cache
2026-03-26 22:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b2c2d1c4-9322-5908-a639-1d2425340280
2026-03-26 22:56:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b2c2d1c4-9322-5908-a639-1d2425340280, skipping ID generation
2026-03-26 22:56:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2c2d1c4-9322-5908-a639-1d2425340280 with scrape type 1
2026-03-26 22:56:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b2c2d1c4-9322-5908-a639-1d2425340280 sending to next pipeline
2026-03-26 22:56:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b2c2d1c4-9322-5908-a639-1d2425340280, identifier: 1985612
2026-03-26 22:56:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b2c2d1c4-9322-5908-a639-1d2425340280 with identifier: 1985612
2026-03-26 22:56:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b2c2d1c4-9322-5908-a639-1d2425340280 with identifier: 1985612
2026-03-26 22:56:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b2c2d1c4-9322-5908-a639-1d2425340280 with identifier: 1985612 to the API
2026-03-26 22:56:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:56:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:56:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2dh/f27b9dd5ea3a4eb1a83d965a879bc1bb/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b2c2d1c4-9322-5908-a639-1d2425340280',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLB',
 'odometer': 120060,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2c2d1c4-9322-5908-a639-1d2425340280/b2c2d1c4-9322-5908-a639-1d2425340280_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 582409,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dh/f27b9dd5ea3a4eb1a83d965a879bc1bb/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2c2d1c4-9322-5908-a639-1d2425340280/b2c2d1c4-9322-5908-a639-1d2425340280_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 551389,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dh/f27b9dd5ea3a4eb1a83d965a879bc1bb/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2c2d1c4-9322-5908-a639-1d2425340280/b2c2d1c4-9322-5908-a639-1d2425340280_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 572247,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dh/f27b9dd5ea3a4eb1a83d965a879bc1bb/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2c2d1c4-9322-5908-a639-1d2425340280/b2c2d1c4-9322-5908-a639-1d2425340280_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 560178,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dh/f27b9dd5ea3a4eb1a83d965a879bc1bb/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2c2d1c4-9322-5908-a639-1d2425340280/b2c2d1c4-9322-5908-a639-1d2425340280_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 531107,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dh/f27b9dd5ea3a4eb1a83d965a879bc1bb/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2c2d1c4-9322-5908-a639-1d2425340280/b2c2d1c4-9322-5908-a639-1d2425340280_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 654677,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dh/f27b9dd5ea3a4eb1a83d965a879bc1bb/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2c2d1c4-9322-5908-a639-1d2425340280/b2c2d1c4-9322-5908-a639-1d2425340280_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 690869,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dh/f27b9dd5ea3a4eb1a83d965a879bc1bb/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2c2d1c4-9322-5908-a639-1d2425340280/b2c2d1c4-9322-5908-a639-1d2425340280_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 617302,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dh/f27b9dd5ea3a4eb1a83d965a879bc1bb/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2c2d1c4-9322-5908-a639-1d2425340280/b2c2d1c4-9322-5908-a639-1d2425340280_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 596086,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dh/f27b9dd5ea3a4eb1a83d965a879bc1bb/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2c2d1c4-9322-5908-a639-1d2425340280/b2c2d1c4-9322-5908-a639-1d2425340280_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 559973,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dh/f27b9dd5ea3a4eb1a83d965a879bc1bb/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLB 2.0 GLB 200 D LUXURY LINE DCT',
 'transmission': 'automatic',
 'trim': '2.0 GLB 200 D LUXURY LINE DCT',
 'vin': None,
 'year': 2023}
2026-03-26 22:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985612%27 HTTP/1.1" 200 None
2026-03-26 22:56:27 [ayvens.be] INFO: Saving data for 1985612: {'created_time': 1774565787.554542, 'last_price_update_time': 1774565787.554553, 'auction_closing_time': 1774958400.0}
2026-03-26 22:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985612') HTTP/1.1" 204 0
2026-03-26 22:56:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dg/f86bc232d31c4655a06e40aa3d9bfeae/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F41166c51428a411288f5fcdf809fd864%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/41166c51428a411288f5fcdf809fd864/images/large/9.jpg not downloaded yet
2026-03-26 22:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F41166c51428a411288f5fcdf809fd864%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/41166c51428a411288f5fcdf809fd864/images/large/10.jpg not downloaded yet
2026-03-26 22:56:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd0d8390>
2026-03-26 22:56:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7ac458c-7145-517c-9805-468b8545bc8f/e7ac458c-7145-517c-9805-468b8545bc8f_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252Ff86bc232d31c4655a06e40aa3d9bfeae%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/f86bc232d31c4655a06e40aa3d9bfeae/images/large/4.jpg saved to cache
2026-03-26 22:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e7ac458c-7145-517c-9805-468b8545bc8f
2026-03-26 22:56:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c7e110>
2026-03-26 22:56:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7ac458c-7145-517c-9805-468b8545bc8f/e7ac458c-7145-517c-9805-468b8545bc8f_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252Ff86bc232d31c4655a06e40aa3d9bfeae%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/f86bc232d31c4655a06e40aa3d9bfeae/images/large/7.jpg saved to cache
2026-03-26 22:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e7ac458c-7145-517c-9805-468b8545bc8f
2026-03-26 22:56:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7474210>
2026-03-26 22:56:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7ac458c-7145-517c-9805-468b8545bc8f/e7ac458c-7145-517c-9805-468b8545bc8f_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252Ff86bc232d31c4655a06e40aa3d9bfeae%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/f86bc232d31c4655a06e40aa3d9bfeae/images/large/6.jpg saved to cache
2026-03-26 22:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e7ac458c-7145-517c-9805-468b8545bc8f
2026-03-26 22:56:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74a6dd0>
2026-03-26 22:56:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7ac458c-7145-517c-9805-468b8545bc8f/e7ac458c-7145-517c-9805-468b8545bc8f_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252Ff86bc232d31c4655a06e40aa3d9bfeae%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/f86bc232d31c4655a06e40aa3d9bfeae/images/large/5.jpg saved to cache
2026-03-26 22:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e7ac458c-7145-517c-9805-468b8545bc8f
2026-03-26 22:56:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dg/f86bc232d31c4655a06e40aa3d9bfeae/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:27 [ayvens.be] INFO: Found listing with ID: 1985615
2026-03-26 22:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985615%27 HTTP/1.1" 200 None
2026-03-26 22:56:27 [ayvens.be] INFO: Scrape type for 1985615: 1
2026-03-26 22:56:27 [ayvens.be] INFO: Extracting data for car ID: 1985615
2026-03-26 22:56:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 477eb99e-c090-55db-89eb-5a7bf472e898 with identifier: 1985615
2026-03-26 22:56:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 477eb99e-c090-55db-89eb-5a7bf472e898 with scrape type 1
2026-03-26 22:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 477eb99e-c090-55db-89eb-5a7bf472e898
2026-03-26 22:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252Fd0821ded9f544aeeac030826548a0987%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/d0821ded9f544aeeac030826548a0987/images/large/1.jpg not downloaded yet
2026-03-26 22:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252Fd0821ded9f544aeeac030826548a0987%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/d0821ded9f544aeeac030826548a0987/images/large/2.jpg not downloaded yet
2026-03-26 22:56:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7477f90>
2026-03-26 22:56:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7ac458c-7145-517c-9805-468b8545bc8f/e7ac458c-7145-517c-9805-468b8545bc8f_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252Ff86bc232d31c4655a06e40aa3d9bfeae%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/f86bc232d31c4655a06e40aa3d9bfeae/images/large/8.jpg saved to cache
2026-03-26 22:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e7ac458c-7145-517c-9805-468b8545bc8f
2026-03-26 22:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252Fd0821ded9f544aeeac030826548a0987%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/d0821ded9f544aeeac030826548a0987/images/large/3.jpg not downloaded yet
2026-03-26 22:56:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2at/41166c51428a411288f5fcdf809fd864/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252Fd0821ded9f544aeeac030826548a0987%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/d0821ded9f544aeeac030826548a0987/images/large/4.jpg not downloaded yet
2026-03-26 22:56:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2at/41166c51428a411288f5fcdf809fd864/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2at/41166c51428a411288f5fcdf809fd864/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2at/41166c51428a411288f5fcdf809fd864/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2at/41166c51428a411288f5fcdf809fd864/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74a4650>
2026-03-26 22:56:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7ac458c-7145-517c-9805-468b8545bc8f/e7ac458c-7145-517c-9805-468b8545bc8f_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252Ff86bc232d31c4655a06e40aa3d9bfeae%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/f86bc232d31c4655a06e40aa3d9bfeae/images/large/9.jpg saved to cache
2026-03-26 22:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e7ac458c-7145-517c-9805-468b8545bc8f
2026-03-26 22:56:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dg/f86bc232d31c4655a06e40aa3d9bfeae/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252Fd0821ded9f544aeeac030826548a0987%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/d0821ded9f544aeeac030826548a0987/images/large/5.jpg not downloaded yet
2026-03-26 22:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252Fd0821ded9f544aeeac030826548a0987%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/d0821ded9f544aeeac030826548a0987/images/large/6.jpg not downloaded yet
2026-03-26 22:56:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2at/41166c51428a411288f5fcdf809fd864/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252Fd0821ded9f544aeeac030826548a0987%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/d0821ded9f544aeeac030826548a0987/images/large/7.jpg not downloaded yet
2026-03-26 22:56:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cb2910>
2026-03-26 22:56:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fee27e6-61f1-5f95-91d9-a32647513628/3fee27e6-61f1-5f95-91d9-a32647513628_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F41166c51428a411288f5fcdf809fd864%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/41166c51428a411288f5fcdf809fd864/images/large/1.jpg saved to cache
2026-03-26 22:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3fee27e6-61f1-5f95-91d9-a32647513628
2026-03-26 22:56:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b792d650>
2026-03-26 22:56:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fee27e6-61f1-5f95-91d9-a32647513628/3fee27e6-61f1-5f95-91d9-a32647513628_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F41166c51428a411288f5fcdf809fd864%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/41166c51428a411288f5fcdf809fd864/images/large/2.jpg saved to cache
2026-03-26 22:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3fee27e6-61f1-5f95-91d9-a32647513628
2026-03-26 22:56:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74e6c50>
2026-03-26 22:56:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fee27e6-61f1-5f95-91d9-a32647513628/3fee27e6-61f1-5f95-91d9-a32647513628_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F41166c51428a411288f5fcdf809fd864%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/41166c51428a411288f5fcdf809fd864/images/large/3.jpg saved to cache
2026-03-26 22:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3fee27e6-61f1-5f95-91d9-a32647513628
2026-03-26 22:56:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e45110>
2026-03-26 22:56:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fee27e6-61f1-5f95-91d9-a32647513628/3fee27e6-61f1-5f95-91d9-a32647513628_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F41166c51428a411288f5fcdf809fd864%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/41166c51428a411288f5fcdf809fd864/images/large/4.jpg saved to cache
2026-03-26 22:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3fee27e6-61f1-5f95-91d9-a32647513628
2026-03-26 22:56:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74e4b90>
2026-03-26 22:56:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fee27e6-61f1-5f95-91d9-a32647513628/3fee27e6-61f1-5f95-91d9-a32647513628_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F41166c51428a411288f5fcdf809fd864%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/41166c51428a411288f5fcdf809fd864/images/large/5.jpg saved to cache
2026-03-26 22:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3fee27e6-61f1-5f95-91d9-a32647513628
2026-03-26 22:56:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2at/41166c51428a411288f5fcdf809fd864/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252Fd0821ded9f544aeeac030826548a0987%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/d0821ded9f544aeeac030826548a0987/images/large/8.jpg not downloaded yet
2026-03-26 22:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252Fd0821ded9f544aeeac030826548a0987%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/d0821ded9f544aeeac030826548a0987/images/large/9.jpg not downloaded yet
2026-03-26 22:56:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/d0821ded9f544aeeac030826548a0987/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/d0821ded9f544aeeac030826548a0987/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/d0821ded9f544aeeac030826548a0987/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7453110>
2026-03-26 22:56:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7ac458c-7145-517c-9805-468b8545bc8f/e7ac458c-7145-517c-9805-468b8545bc8f_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252Ff86bc232d31c4655a06e40aa3d9bfeae%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/f86bc232d31c4655a06e40aa3d9bfeae/images/large/10.jpg saved to cache
2026-03-26 22:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e7ac458c-7145-517c-9805-468b8545bc8f
2026-03-26 22:56:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e7ac458c-7145-517c-9805-468b8545bc8f, skipping ID generation
2026-03-26 22:56:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7ac458c-7145-517c-9805-468b8545bc8f with scrape type 1
2026-03-26 22:56:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e7ac458c-7145-517c-9805-468b8545bc8f sending to next pipeline
2026-03-26 22:56:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e7ac458c-7145-517c-9805-468b8545bc8f, identifier: 1985613
2026-03-26 22:56:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7ccded0>
2026-03-26 22:56:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fee27e6-61f1-5f95-91d9-a32647513628/3fee27e6-61f1-5f95-91d9-a32647513628_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F41166c51428a411288f5fcdf809fd864%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/41166c51428a411288f5fcdf809fd864/images/large/6.jpg saved to cache
2026-03-26 22:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3fee27e6-61f1-5f95-91d9-a32647513628
2026-03-26 22:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252Fd0821ded9f544aeeac030826548a0987%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/d0821ded9f544aeeac030826548a0987/images/large/10.jpg not downloaded yet
2026-03-26 22:56:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e7ac458c-7145-517c-9805-468b8545bc8f with identifier: 1985613
2026-03-26 22:56:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e7ac458c-7145-517c-9805-468b8545bc8f with identifier: 1985613
2026-03-26 22:56:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e7ac458c-7145-517c-9805-468b8545bc8f with identifier: 1985613 to the API
2026-03-26 22:56:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:56:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:56:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2dg/f86bc232d31c4655a06e40aa3d9bfeae/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'e7ac458c-7145-517c-9805-468b8545bc8f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'KUGA',
 'odometer': 131721,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7ac458c-7145-517c-9805-468b8545bc8f/e7ac458c-7145-517c-9805-468b8545bc8f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 523696,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dg/f86bc232d31c4655a06e40aa3d9bfeae/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7ac458c-7145-517c-9805-468b8545bc8f/e7ac458c-7145-517c-9805-468b8545bc8f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 447822,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dg/f86bc232d31c4655a06e40aa3d9bfeae/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7ac458c-7145-517c-9805-468b8545bc8f/e7ac458c-7145-517c-9805-468b8545bc8f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 532644,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dg/f86bc232d31c4655a06e40aa3d9bfeae/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7ac458c-7145-517c-9805-468b8545bc8f/e7ac458c-7145-517c-9805-468b8545bc8f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 546702,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dg/f86bc232d31c4655a06e40aa3d9bfeae/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7ac458c-7145-517c-9805-468b8545bc8f/e7ac458c-7145-517c-9805-468b8545bc8f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 514479,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dg/f86bc232d31c4655a06e40aa3d9bfeae/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7ac458c-7145-517c-9805-468b8545bc8f/e7ac458c-7145-517c-9805-468b8545bc8f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 768278,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dg/f86bc232d31c4655a06e40aa3d9bfeae/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7ac458c-7145-517c-9805-468b8545bc8f/e7ac458c-7145-517c-9805-468b8545bc8f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 641910,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dg/f86bc232d31c4655a06e40aa3d9bfeae/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7ac458c-7145-517c-9805-468b8545bc8f/e7ac458c-7145-517c-9805-468b8545bc8f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 690514,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dg/f86bc232d31c4655a06e40aa3d9bfeae/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7ac458c-7145-517c-9805-468b8545bc8f/e7ac458c-7145-517c-9805-468b8545bc8f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 932857,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dg/f86bc232d31c4655a06e40aa3d9bfeae/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7ac458c-7145-517c-9805-468b8545bc8f/e7ac458c-7145-517c-9805-468b8545bc8f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 919739,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dg/f86bc232d31c4655a06e40aa3d9bfeae/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD KUGA 2.5I PHEV 165KW ST-LINE AUTO',
 'transmission': 'automatic',
 'trim': '2.5I PHEV 165KW ST-LINE AUTO',
 'vin': None,
 'year': 2023}
2026-03-26 22:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985613%27 HTTP/1.1" 200 None
2026-03-26 22:56:29 [ayvens.be] INFO: Saving data for 1985613: {'created_time': 1774565789.406333, 'last_price_update_time': 1774565789.406344, 'auction_closing_time': 1774958400.0}
2026-03-26 22:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985613') HTTP/1.1" 204 0
2026-03-26 22:56:29 [ayvens.be] INFO: Found listing with ID: 1985616
2026-03-26 22:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985616%27 HTTP/1.1" 200 None
2026-03-26 22:56:29 [ayvens.be] INFO: Scrape type for 1985616: 1
2026-03-26 22:56:29 [ayvens.be] INFO: Extracting data for car ID: 1985616
2026-03-26 22:56:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 586037ca-bf37-5f2f-8942-f775bf132317 with identifier: 1985616
2026-03-26 22:56:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 586037ca-bf37-5f2f-8942-f775bf132317 with scrape type 1
2026-03-26 22:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 586037ca-bf37-5f2f-8942-f775bf132317
2026-03-26 22:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Ff3391c3061fe4afa9784d8d0e5bf5535%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/f3391c3061fe4afa9784d8d0e5bf5535/images/large/1.jpg not downloaded yet
2026-03-26 22:56:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7587390>
2026-03-26 22:56:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fee27e6-61f1-5f95-91d9-a32647513628/3fee27e6-61f1-5f95-91d9-a32647513628_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F41166c51428a411288f5fcdf809fd864%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/41166c51428a411288f5fcdf809fd864/images/large/7.jpg saved to cache
2026-03-26 22:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3fee27e6-61f1-5f95-91d9-a32647513628
2026-03-26 22:56:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79d7b10>
2026-03-26 22:56:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_477eb99e-c090-55db-89eb-5a7bf472e898/477eb99e-c090-55db-89eb-5a7bf472e898_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252Fd0821ded9f544aeeac030826548a0987%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/d0821ded9f544aeeac030826548a0987/images/large/2.jpg saved to cache
2026-03-26 22:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 477eb99e-c090-55db-89eb-5a7bf472e898
2026-03-26 22:56:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7ca9b50>
2026-03-26 22:56:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_477eb99e-c090-55db-89eb-5a7bf472e898/477eb99e-c090-55db-89eb-5a7bf472e898_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252Fd0821ded9f544aeeac030826548a0987%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/d0821ded9f544aeeac030826548a0987/images/large/1.jpg saved to cache
2026-03-26 22:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 477eb99e-c090-55db-89eb-5a7bf472e898
2026-03-26 22:56:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e3e910>
2026-03-26 22:56:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_477eb99e-c090-55db-89eb-5a7bf472e898/477eb99e-c090-55db-89eb-5a7bf472e898_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252Fd0821ded9f544aeeac030826548a0987%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/d0821ded9f544aeeac030826548a0987/images/large/3.jpg saved to cache
2026-03-26 22:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 477eb99e-c090-55db-89eb-5a7bf472e898
2026-03-26 22:56:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/d0821ded9f544aeeac030826548a0987/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Ff3391c3061fe4afa9784d8d0e5bf5535%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/f3391c3061fe4afa9784d8d0e5bf5535/images/large/2.jpg not downloaded yet
2026-03-26 22:56:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/d0821ded9f544aeeac030826548a0987/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/d0821ded9f544aeeac030826548a0987/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Ff3391c3061fe4afa9784d8d0e5bf5535%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/f3391c3061fe4afa9784d8d0e5bf5535/images/large/3.jpg not downloaded yet
2026-03-26 22:56:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/d0821ded9f544aeeac030826548a0987/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2at/41166c51428a411288f5fcdf809fd864/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2at/41166c51428a411288f5fcdf809fd864/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Ff3391c3061fe4afa9784d8d0e5bf5535%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/f3391c3061fe4afa9784d8d0e5bf5535/images/large/4.jpg not downloaded yet
2026-03-26 22:56:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2at/41166c51428a411288f5fcdf809fd864/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/d0821ded9f544aeeac030826548a0987/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Ff3391c3061fe4afa9784d8d0e5bf5535%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/f3391c3061fe4afa9784d8d0e5bf5535/images/large/5.jpg not downloaded yet
2026-03-26 22:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Ff3391c3061fe4afa9784d8d0e5bf5535%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/f3391c3061fe4afa9784d8d0e5bf5535/images/large/6.jpg not downloaded yet
2026-03-26 22:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Ff3391c3061fe4afa9784d8d0e5bf5535%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/f3391c3061fe4afa9784d8d0e5bf5535/images/large/7.jpg not downloaded yet
2026-03-26 22:56:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd0d3c10>
2026-03-26 22:56:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_477eb99e-c090-55db-89eb-5a7bf472e898/477eb99e-c090-55db-89eb-5a7bf472e898_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252Fd0821ded9f544aeeac030826548a0987%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/d0821ded9f544aeeac030826548a0987/images/large/4.jpg saved to cache
2026-03-26 22:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 477eb99e-c090-55db-89eb-5a7bf472e898
2026-03-26 22:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Ff3391c3061fe4afa9784d8d0e5bf5535%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/f3391c3061fe4afa9784d8d0e5bf5535/images/large/8.jpg not downloaded yet
2026-03-26 22:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Ff3391c3061fe4afa9784d8d0e5bf5535%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/f3391c3061fe4afa9784d8d0e5bf5535/images/large/9.jpg not downloaded yet
2026-03-26 22:56:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b788e350>
2026-03-26 22:56:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_477eb99e-c090-55db-89eb-5a7bf472e898/477eb99e-c090-55db-89eb-5a7bf472e898_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252Fd0821ded9f544aeeac030826548a0987%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/d0821ded9f544aeeac030826548a0987/images/large/5.jpg saved to cache
2026-03-26 22:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 477eb99e-c090-55db-89eb-5a7bf472e898
2026-03-26 22:56:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b68750>
2026-03-26 22:56:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_477eb99e-c090-55db-89eb-5a7bf472e898/477eb99e-c090-55db-89eb-5a7bf472e898_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252Fd0821ded9f544aeeac030826548a0987%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/d0821ded9f544aeeac030826548a0987/images/large/6.jpg saved to cache
2026-03-26 22:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 477eb99e-c090-55db-89eb-5a7bf472e898
2026-03-26 22:56:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79a0490>
2026-03-26 22:56:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_477eb99e-c090-55db-89eb-5a7bf472e898/477eb99e-c090-55db-89eb-5a7bf472e898_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252Fd0821ded9f544aeeac030826548a0987%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/d0821ded9f544aeeac030826548a0987/images/large/7.jpg saved to cache
2026-03-26 22:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 477eb99e-c090-55db-89eb-5a7bf472e898
2026-03-26 22:56:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74cebd0>
2026-03-26 22:56:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fee27e6-61f1-5f95-91d9-a32647513628/3fee27e6-61f1-5f95-91d9-a32647513628_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F41166c51428a411288f5fcdf809fd864%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/41166c51428a411288f5fcdf809fd864/images/large/10.jpg saved to cache
2026-03-26 22:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3fee27e6-61f1-5f95-91d9-a32647513628
2026-03-26 22:56:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b788e350>
2026-03-26 22:56:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fee27e6-61f1-5f95-91d9-a32647513628/3fee27e6-61f1-5f95-91d9-a32647513628_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F41166c51428a411288f5fcdf809fd864%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/41166c51428a411288f5fcdf809fd864/images/large/9.jpg saved to cache
2026-03-26 22:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3fee27e6-61f1-5f95-91d9-a32647513628
2026-03-26 22:56:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b6bad0>
2026-03-26 22:56:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fee27e6-61f1-5f95-91d9-a32647513628/3fee27e6-61f1-5f95-91d9-a32647513628_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F41166c51428a411288f5fcdf809fd864%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/41166c51428a411288f5fcdf809fd864/images/large/8.jpg saved to cache
2026-03-26 22:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3fee27e6-61f1-5f95-91d9-a32647513628
2026-03-26 22:56:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3fee27e6-61f1-5f95-91d9-a32647513628, skipping ID generation
2026-03-26 22:56:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3fee27e6-61f1-5f95-91d9-a32647513628 with scrape type 1
2026-03-26 22:56:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3fee27e6-61f1-5f95-91d9-a32647513628 sending to next pipeline
2026-03-26 22:56:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 3fee27e6-61f1-5f95-91d9-a32647513628, identifier: 1985614
2026-03-26 22:56:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c5fc10>
2026-03-26 22:56:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_477eb99e-c090-55db-89eb-5a7bf472e898/477eb99e-c090-55db-89eb-5a7bf472e898_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252Fd0821ded9f544aeeac030826548a0987%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/d0821ded9f544aeeac030826548a0987/images/large/8.jpg saved to cache
2026-03-26 22:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 477eb99e-c090-55db-89eb-5a7bf472e898
2026-03-26 22:56:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/f3391c3061fe4afa9784d8d0e5bf5535/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 3fee27e6-61f1-5f95-91d9-a32647513628 with identifier: 1985614
2026-03-26 22:56:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 3fee27e6-61f1-5f95-91d9-a32647513628 with identifier: 1985614
2026-03-26 22:56:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 3fee27e6-61f1-5f95-91d9-a32647513628 with identifier: 1985614 to the API
2026-03-26 22:56:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:56:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:56:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2at/41166c51428a411288f5fcdf809fd864/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '3fee27e6-61f1-5f95-91d9-a32647513628',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A4',
 'odometer': 156563,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fee27e6-61f1-5f95-91d9-a32647513628/3fee27e6-61f1-5f95-91d9-a32647513628_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 711244,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2at/41166c51428a411288f5fcdf809fd864/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fee27e6-61f1-5f95-91d9-a32647513628/3fee27e6-61f1-5f95-91d9-a32647513628_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 732673,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2at/41166c51428a411288f5fcdf809fd864/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fee27e6-61f1-5f95-91d9-a32647513628/3fee27e6-61f1-5f95-91d9-a32647513628_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 722747,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2at/41166c51428a411288f5fcdf809fd864/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fee27e6-61f1-5f95-91d9-a32647513628/3fee27e6-61f1-5f95-91d9-a32647513628_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 714369,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2at/41166c51428a411288f5fcdf809fd864/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fee27e6-61f1-5f95-91d9-a32647513628/3fee27e6-61f1-5f95-91d9-a32647513628_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 661736,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2at/41166c51428a411288f5fcdf809fd864/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fee27e6-61f1-5f95-91d9-a32647513628/3fee27e6-61f1-5f95-91d9-a32647513628_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 695228,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2at/41166c51428a411288f5fcdf809fd864/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fee27e6-61f1-5f95-91d9-a32647513628/3fee27e6-61f1-5f95-91d9-a32647513628_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 597983,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2at/41166c51428a411288f5fcdf809fd864/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fee27e6-61f1-5f95-91d9-a32647513628/3fee27e6-61f1-5f95-91d9-a32647513628_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 885978,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2at/41166c51428a411288f5fcdf809fd864/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fee27e6-61f1-5f95-91d9-a32647513628/3fee27e6-61f1-5f95-91d9-a32647513628_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 790468,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2at/41166c51428a411288f5fcdf809fd864/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fee27e6-61f1-5f95-91d9-a32647513628/3fee27e6-61f1-5f95-91d9-a32647513628_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 806724,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2at/41166c51428a411288f5fcdf809fd864/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A4 2.0 35 TDI 120KW S TR S LINE BUSINESS ED',
 'transmission': 'automatic',
 'trim': '2.0 35 TDI 120KW S TR S LINE BUSINESS ED',
 'vin': None,
 'year': 2021}
2026-03-26 22:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985614%27 HTTP/1.1" 200 None
2026-03-26 22:56:31 [ayvens.be] INFO: Saving data for 1985614: {'created_time': 1774565791.31223, 'last_price_update_time': 1774565791.312245, 'auction_closing_time': 1774958400.0}
2026-03-26 22:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985614') HTTP/1.1" 204 0
2026-03-26 22:56:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/d0821ded9f544aeeac030826548a0987/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Ff3391c3061fe4afa9784d8d0e5bf5535%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/f3391c3061fe4afa9784d8d0e5bf5535/images/large/10.jpg not downloaded yet
2026-03-26 22:56:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/f3391c3061fe4afa9784d8d0e5bf5535/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:31 [ayvens.be] INFO: Found listing with ID: 1985617
2026-03-26 22:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985617%27 HTTP/1.1" 200 None
2026-03-26 22:56:31 [ayvens.be] INFO: Scrape type for 1985617: 1
2026-03-26 22:56:31 [ayvens.be] INFO: Extracting data for car ID: 1985617
2026-03-26 22:56:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15129c96-225f-52ab-943d-69e5fbd62080 with identifier: 1985617
2026-03-26 22:56:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15129c96-225f-52ab-943d-69e5fbd62080 with scrape type 1
2026-03-26 22:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 15129c96-225f-52ab-943d-69e5fbd62080
2026-03-26 22:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ya%252F748e14ff24ee4607b546315290f9581b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ya/748e14ff24ee4607b546315290f9581b/images/large/1.jpg not downloaded yet
2026-03-26 22:56:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/d0821ded9f544aeeac030826548a0987/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b741e450>
2026-03-26 22:56:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_586037ca-bf37-5f2f-8942-f775bf132317/586037ca-bf37-5f2f-8942-f775bf132317_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Ff3391c3061fe4afa9784d8d0e5bf5535%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/f3391c3061fe4afa9784d8d0e5bf5535/images/large/1.jpg saved to cache
2026-03-26 22:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 586037ca-bf37-5f2f-8942-f775bf132317
2026-03-26 22:56:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/f3391c3061fe4afa9784d8d0e5bf5535/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/f3391c3061fe4afa9784d8d0e5bf5535/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/f3391c3061fe4afa9784d8d0e5bf5535/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ya%252F748e14ff24ee4607b546315290f9581b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ya/748e14ff24ee4607b546315290f9581b/images/large/2.jpg not downloaded yet
2026-03-26 22:56:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/f3391c3061fe4afa9784d8d0e5bf5535/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ya%252F748e14ff24ee4607b546315290f9581b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ya/748e14ff24ee4607b546315290f9581b/images/large/3.jpg not downloaded yet
2026-03-26 22:56:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e15fd0>
2026-03-26 22:56:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_477eb99e-c090-55db-89eb-5a7bf472e898/477eb99e-c090-55db-89eb-5a7bf472e898_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252Fd0821ded9f544aeeac030826548a0987%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/d0821ded9f544aeeac030826548a0987/images/large/9.jpg saved to cache
2026-03-26 22:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 477eb99e-c090-55db-89eb-5a7bf472e898
2026-03-26 22:56:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b743b990>
2026-03-26 22:56:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_586037ca-bf37-5f2f-8942-f775bf132317/586037ca-bf37-5f2f-8942-f775bf132317_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Ff3391c3061fe4afa9784d8d0e5bf5535%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/f3391c3061fe4afa9784d8d0e5bf5535/images/large/2.jpg saved to cache
2026-03-26 22:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 586037ca-bf37-5f2f-8942-f775bf132317
2026-03-26 22:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ya%252F748e14ff24ee4607b546315290f9581b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ya/748e14ff24ee4607b546315290f9581b/images/large/4.jpg not downloaded yet
2026-03-26 22:56:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/f3391c3061fe4afa9784d8d0e5bf5535/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79fabd0>
2026-03-26 22:56:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_477eb99e-c090-55db-89eb-5a7bf472e898/477eb99e-c090-55db-89eb-5a7bf472e898_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252Fd0821ded9f544aeeac030826548a0987%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/d0821ded9f544aeeac030826548a0987/images/large/10.jpg saved to cache
2026-03-26 22:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 477eb99e-c090-55db-89eb-5a7bf472e898
2026-03-26 22:56:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 477eb99e-c090-55db-89eb-5a7bf472e898, skipping ID generation
2026-03-26 22:56:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 477eb99e-c090-55db-89eb-5a7bf472e898 with scrape type 1
2026-03-26 22:56:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 477eb99e-c090-55db-89eb-5a7bf472e898 sending to next pipeline
2026-03-26 22:56:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 477eb99e-c090-55db-89eb-5a7bf472e898, identifier: 1985615
2026-03-26 22:56:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b727c090>
2026-03-26 22:56:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_586037ca-bf37-5f2f-8942-f775bf132317/586037ca-bf37-5f2f-8942-f775bf132317_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Ff3391c3061fe4afa9784d8d0e5bf5535%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/f3391c3061fe4afa9784d8d0e5bf5535/images/large/5.jpg saved to cache
2026-03-26 22:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 586037ca-bf37-5f2f-8942-f775bf132317
2026-03-26 22:56:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77bc950>
2026-03-26 22:56:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_586037ca-bf37-5f2f-8942-f775bf132317/586037ca-bf37-5f2f-8942-f775bf132317_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Ff3391c3061fe4afa9784d8d0e5bf5535%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/f3391c3061fe4afa9784d8d0e5bf5535/images/large/4.jpg saved to cache
2026-03-26 22:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 586037ca-bf37-5f2f-8942-f775bf132317
2026-03-26 22:56:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b746f990>
2026-03-26 22:56:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_586037ca-bf37-5f2f-8942-f775bf132317/586037ca-bf37-5f2f-8942-f775bf132317_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Ff3391c3061fe4afa9784d8d0e5bf5535%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/f3391c3061fe4afa9784d8d0e5bf5535/images/large/3.jpg saved to cache
2026-03-26 22:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 586037ca-bf37-5f2f-8942-f775bf132317
2026-03-26 22:56:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7438b50>
2026-03-26 22:56:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_586037ca-bf37-5f2f-8942-f775bf132317/586037ca-bf37-5f2f-8942-f775bf132317_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Ff3391c3061fe4afa9784d8d0e5bf5535%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/f3391c3061fe4afa9784d8d0e5bf5535/images/large/6.jpg saved to cache
2026-03-26 22:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 586037ca-bf37-5f2f-8942-f775bf132317
2026-03-26 22:56:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/f3391c3061fe4afa9784d8d0e5bf5535/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ya%252F748e14ff24ee4607b546315290f9581b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ya/748e14ff24ee4607b546315290f9581b/images/large/5.jpg not downloaded yet
2026-03-26 22:56:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 477eb99e-c090-55db-89eb-5a7bf472e898 with identifier: 1985615
2026-03-26 22:56:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 477eb99e-c090-55db-89eb-5a7bf472e898 with identifier: 1985615
2026-03-26 22:56:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 477eb99e-c090-55db-89eb-5a7bf472e898 with identifier: 1985615 to the API
2026-03-26 22:56:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:56:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:56:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ar/d0821ded9f544aeeac030826548a0987/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 38,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '477eb99e-c090-55db-89eb-5a7bf472e898',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'E-CLASS BREAK',
 'odometer': 46187,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_477eb99e-c090-55db-89eb-5a7bf472e898/477eb99e-c090-55db-89eb-5a7bf472e898_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 239553,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/d0821ded9f544aeeac030826548a0987/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_477eb99e-c090-55db-89eb-5a7bf472e898/477eb99e-c090-55db-89eb-5a7bf472e898_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 232027,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/d0821ded9f544aeeac030826548a0987/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_477eb99e-c090-55db-89eb-5a7bf472e898/477eb99e-c090-55db-89eb-5a7bf472e898_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 260723,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/d0821ded9f544aeeac030826548a0987/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_477eb99e-c090-55db-89eb-5a7bf472e898/477eb99e-c090-55db-89eb-5a7bf472e898_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 257349,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/d0821ded9f544aeeac030826548a0987/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_477eb99e-c090-55db-89eb-5a7bf472e898/477eb99e-c090-55db-89eb-5a7bf472e898_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 331687,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/d0821ded9f544aeeac030826548a0987/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_477eb99e-c090-55db-89eb-5a7bf472e898/477eb99e-c090-55db-89eb-5a7bf472e898_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 312514,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/d0821ded9f544aeeac030826548a0987/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_477eb99e-c090-55db-89eb-5a7bf472e898/477eb99e-c090-55db-89eb-5a7bf472e898_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 354770,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/d0821ded9f544aeeac030826548a0987/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_477eb99e-c090-55db-89eb-5a7bf472e898/477eb99e-c090-55db-89eb-5a7bf472e898_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 366100,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/d0821ded9f544aeeac030826548a0987/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_477eb99e-c090-55db-89eb-5a7bf472e898/477eb99e-c090-55db-89eb-5a7bf472e898_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 376299,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/d0821ded9f544aeeac030826548a0987/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_477eb99e-c090-55db-89eb-5a7bf472e898/477eb99e-c090-55db-89eb-5a7bf472e898_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 487354,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/d0821ded9f544aeeac030826548a0987/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ E-CLASS BREAK 2.0 E 300 DE AUTO BUSINESS SOL AUTO 4MT',
 'transmission': 'automatic',
 'trim': '2.0 E 300 DE AUTO BUSINESS SOL AUTO 4MT',
 'vin': None,
 'year': 2021}
2026-03-26 22:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985615%27 HTTP/1.1" 200 None
2026-03-26 22:56:32 [ayvens.be] INFO: Saving data for 1985615: {'created_time': 1774565792.466179, 'last_price_update_time': 1774565792.466188, 'auction_closing_time': 1774958400.0}
2026-03-26 22:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985615') HTTP/1.1" 204 0
2026-03-26 22:56:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/f3391c3061fe4afa9784d8d0e5bf5535/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/f3391c3061fe4afa9784d8d0e5bf5535/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ya%252F748e14ff24ee4607b546315290f9581b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ya/748e14ff24ee4607b546315290f9581b/images/large/6.jpg not downloaded yet
2026-03-26 22:56:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7440690>
2026-03-26 22:56:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_586037ca-bf37-5f2f-8942-f775bf132317/586037ca-bf37-5f2f-8942-f775bf132317_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Ff3391c3061fe4afa9784d8d0e5bf5535%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/f3391c3061fe4afa9784d8d0e5bf5535/images/large/8.jpg saved to cache
2026-03-26 22:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 586037ca-bf37-5f2f-8942-f775bf132317
2026-03-26 22:56:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cb2b90>
2026-03-26 22:56:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_586037ca-bf37-5f2f-8942-f775bf132317/586037ca-bf37-5f2f-8942-f775bf132317_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Ff3391c3061fe4afa9784d8d0e5bf5535%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/f3391c3061fe4afa9784d8d0e5bf5535/images/large/9.jpg saved to cache
2026-03-26 22:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 586037ca-bf37-5f2f-8942-f775bf132317
2026-03-26 22:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ya%252F748e14ff24ee4607b546315290f9581b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ya/748e14ff24ee4607b546315290f9581b/images/large/7.jpg not downloaded yet
2026-03-26 22:56:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ya/748e14ff24ee4607b546315290f9581b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ya/748e14ff24ee4607b546315290f9581b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ya%252F748e14ff24ee4607b546315290f9581b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ya/748e14ff24ee4607b546315290f9581b/images/large/8.jpg not downloaded yet
2026-03-26 22:56:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e1d490>
2026-03-26 22:56:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_586037ca-bf37-5f2f-8942-f775bf132317/586037ca-bf37-5f2f-8942-f775bf132317_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Ff3391c3061fe4afa9784d8d0e5bf5535%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/f3391c3061fe4afa9784d8d0e5bf5535/images/large/7.jpg saved to cache
2026-03-26 22:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 586037ca-bf37-5f2f-8942-f775bf132317
2026-03-26 22:56:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74421d0>
2026-03-26 22:56:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_586037ca-bf37-5f2f-8942-f775bf132317/586037ca-bf37-5f2f-8942-f775bf132317_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Ff3391c3061fe4afa9784d8d0e5bf5535%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/f3391c3061fe4afa9784d8d0e5bf5535/images/large/10.jpg saved to cache
2026-03-26 22:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 586037ca-bf37-5f2f-8942-f775bf132317
2026-03-26 22:56:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 586037ca-bf37-5f2f-8942-f775bf132317, skipping ID generation
2026-03-26 22:56:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 586037ca-bf37-5f2f-8942-f775bf132317 with scrape type 1
2026-03-26 22:56:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 586037ca-bf37-5f2f-8942-f775bf132317 sending to next pipeline
2026-03-26 22:56:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 586037ca-bf37-5f2f-8942-f775bf132317, identifier: 1985616
2026-03-26 22:56:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 586037ca-bf37-5f2f-8942-f775bf132317 with identifier: 1985616
2026-03-26 22:56:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 586037ca-bf37-5f2f-8942-f775bf132317 with identifier: 1985616
2026-03-26 22:56:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 586037ca-bf37-5f2f-8942-f775bf132317 with identifier: 1985616 to the API
2026-03-26 22:56:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:56:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:56:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ae/f3391c3061fe4afa9784d8d0e5bf5535/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '586037ca-bf37-5f2f-8942-f775bf132317',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '2 GRAN TOURER DIESEL - 2018',
 'odometer': 75116,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_586037ca-bf37-5f2f-8942-f775bf132317/586037ca-bf37-5f2f-8942-f775bf132317_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 296723,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/f3391c3061fe4afa9784d8d0e5bf5535/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_586037ca-bf37-5f2f-8942-f775bf132317/586037ca-bf37-5f2f-8942-f775bf132317_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 297322,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/f3391c3061fe4afa9784d8d0e5bf5535/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_586037ca-bf37-5f2f-8942-f775bf132317/586037ca-bf37-5f2f-8942-f775bf132317_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 322313,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/f3391c3061fe4afa9784d8d0e5bf5535/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_586037ca-bf37-5f2f-8942-f775bf132317/586037ca-bf37-5f2f-8942-f775bf132317_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 337690,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/f3391c3061fe4afa9784d8d0e5bf5535/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_586037ca-bf37-5f2f-8942-f775bf132317/586037ca-bf37-5f2f-8942-f775bf132317_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 383387,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/f3391c3061fe4afa9784d8d0e5bf5535/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_586037ca-bf37-5f2f-8942-f775bf132317/586037ca-bf37-5f2f-8942-f775bf132317_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 408183,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/f3391c3061fe4afa9784d8d0e5bf5535/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_586037ca-bf37-5f2f-8942-f775bf132317/586037ca-bf37-5f2f-8942-f775bf132317_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 391130,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/f3391c3061fe4afa9784d8d0e5bf5535/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_586037ca-bf37-5f2f-8942-f775bf132317/586037ca-bf37-5f2f-8942-f775bf132317_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 340678,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/f3391c3061fe4afa9784d8d0e5bf5535/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_586037ca-bf37-5f2f-8942-f775bf132317/586037ca-bf37-5f2f-8942-f775bf132317_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 375221,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/f3391c3061fe4afa9784d8d0e5bf5535/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_586037ca-bf37-5f2f-8942-f775bf132317/586037ca-bf37-5f2f-8942-f775bf132317_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 302834,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/f3391c3061fe4afa9784d8d0e5bf5535/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 2 GRAN TOURER DIESEL - 2018 216 d AdBlue',
 'transmission': 'manual',
 'trim': '216 d AdBlue',
 'vin': None,
 'year': 2021}
2026-03-26 22:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985616%27 HTTP/1.1" 200 None
2026-03-26 22:56:33 [ayvens.be] INFO: Saving data for 1985616: {'created_time': 1774565793.305127, 'last_price_update_time': 1774565793.305138, 'auction_closing_time': 1774958400.0}
2026-03-26 22:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985616') HTTP/1.1" 204 0
2026-03-26 22:56:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ya/748e14ff24ee4607b546315290f9581b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ya/748e14ff24ee4607b546315290f9581b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ya%252F748e14ff24ee4607b546315290f9581b%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ya/748e14ff24ee4607b546315290f9581b/images/large/9.jpg not downloaded yet
2026-03-26 22:56:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7a60490>
2026-03-26 22:56:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15129c96-225f-52ab-943d-69e5fbd62080/15129c96-225f-52ab-943d-69e5fbd62080_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ya%252F748e14ff24ee4607b546315290f9581b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ya/748e14ff24ee4607b546315290f9581b/images/large/1.jpg saved to cache
2026-03-26 22:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 15129c96-225f-52ab-943d-69e5fbd62080
2026-03-26 22:56:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6dd8410>
2026-03-26 22:56:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15129c96-225f-52ab-943d-69e5fbd62080/15129c96-225f-52ab-943d-69e5fbd62080_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ya%252F748e14ff24ee4607b546315290f9581b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ya/748e14ff24ee4607b546315290f9581b/images/large/2.jpg saved to cache
2026-03-26 22:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 15129c96-225f-52ab-943d-69e5fbd62080
2026-03-26 22:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ya%252F748e14ff24ee4607b546315290f9581b%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ya/748e14ff24ee4607b546315290f9581b/images/large/10.jpg not downloaded yet
2026-03-26 22:56:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ya/748e14ff24ee4607b546315290f9581b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ya/748e14ff24ee4607b546315290f9581b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:33 [ayvens.be] INFO: Found listing with ID: 1985618
2026-03-26 22:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985618%27 HTTP/1.1" 200 None
2026-03-26 22:56:33 [ayvens.be] INFO: Scrape type for 1985618: 1
2026-03-26 22:56:33 [ayvens.be] INFO: Extracting data for car ID: 1985618
2026-03-26 22:56:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 973b0b30-ae16-5993-8445-749a81894b5c with identifier: 1985618
2026-03-26 22:56:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 973b0b30-ae16-5993-8445-749a81894b5c with scrape type 1
2026-03-26 22:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 973b0b30-ae16-5993-8445-749a81894b5c
2026-03-26 22:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F2174df28dfcc4e169a19009b8a741661%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/2174df28dfcc4e169a19009b8a741661/images/large/1.jpg not downloaded yet
2026-03-26 22:56:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7745850>
2026-03-26 22:56:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15129c96-225f-52ab-943d-69e5fbd62080/15129c96-225f-52ab-943d-69e5fbd62080_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ya%252F748e14ff24ee4607b546315290f9581b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ya/748e14ff24ee4607b546315290f9581b/images/large/4.jpg saved to cache
2026-03-26 22:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 15129c96-225f-52ab-943d-69e5fbd62080
2026-03-26 22:56:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5ca6490>
2026-03-26 22:56:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15129c96-225f-52ab-943d-69e5fbd62080/15129c96-225f-52ab-943d-69e5fbd62080_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ya%252F748e14ff24ee4607b546315290f9581b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ya/748e14ff24ee4607b546315290f9581b/images/large/3.jpg saved to cache
2026-03-26 22:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 15129c96-225f-52ab-943d-69e5fbd62080
2026-03-26 22:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F2174df28dfcc4e169a19009b8a741661%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/2174df28dfcc4e169a19009b8a741661/images/large/2.jpg not downloaded yet
2026-03-26 22:56:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79d4d50>
2026-03-26 22:56:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15129c96-225f-52ab-943d-69e5fbd62080/15129c96-225f-52ab-943d-69e5fbd62080_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ya%252F748e14ff24ee4607b546315290f9581b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ya/748e14ff24ee4607b546315290f9581b/images/large/5.jpg saved to cache
2026-03-26 22:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 15129c96-225f-52ab-943d-69e5fbd62080
2026-03-26 22:56:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e02bd0>
2026-03-26 22:56:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15129c96-225f-52ab-943d-69e5fbd62080/15129c96-225f-52ab-943d-69e5fbd62080_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ya%252F748e14ff24ee4607b546315290f9581b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ya/748e14ff24ee4607b546315290f9581b/images/large/6.jpg saved to cache
2026-03-26 22:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 15129c96-225f-52ab-943d-69e5fbd62080
2026-03-26 22:56:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ya/748e14ff24ee4607b546315290f9581b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F2174df28dfcc4e169a19009b8a741661%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/2174df28dfcc4e169a19009b8a741661/images/large/3.jpg not downloaded yet
2026-03-26 22:56:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ya/748e14ff24ee4607b546315290f9581b/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F2174df28dfcc4e169a19009b8a741661%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/2174df28dfcc4e169a19009b8a741661/images/large/4.jpg not downloaded yet
2026-03-26 22:56:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ya/748e14ff24ee4607b546315290f9581b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F2174df28dfcc4e169a19009b8a741661%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/2174df28dfcc4e169a19009b8a741661/images/large/5.jpg not downloaded yet
2026-03-26 22:56:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ya/748e14ff24ee4607b546315290f9581b/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F2174df28dfcc4e169a19009b8a741661%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/2174df28dfcc4e169a19009b8a741661/images/large/6.jpg not downloaded yet
2026-03-26 22:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F2174df28dfcc4e169a19009b8a741661%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/2174df28dfcc4e169a19009b8a741661/images/large/7.jpg not downloaded yet
2026-03-26 22:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F2174df28dfcc4e169a19009b8a741661%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/2174df28dfcc4e169a19009b8a741661/images/large/8.jpg not downloaded yet
2026-03-26 22:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F2174df28dfcc4e169a19009b8a741661%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/2174df28dfcc4e169a19009b8a741661/images/large/9.jpg not downloaded yet
2026-03-26 22:56:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e4d090>
2026-03-26 22:56:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15129c96-225f-52ab-943d-69e5fbd62080/15129c96-225f-52ab-943d-69e5fbd62080_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ya%252F748e14ff24ee4607b546315290f9581b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ya/748e14ff24ee4607b546315290f9581b/images/large/7.jpg saved to cache
2026-03-26 22:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 15129c96-225f-52ab-943d-69e5fbd62080
2026-03-26 22:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F2174df28dfcc4e169a19009b8a741661%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/2174df28dfcc4e169a19009b8a741661/images/large/10.jpg not downloaded yet
2026-03-26 22:56:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e4c6d0>
2026-03-26 22:56:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15129c96-225f-52ab-943d-69e5fbd62080/15129c96-225f-52ab-943d-69e5fbd62080_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ya%252F748e14ff24ee4607b546315290f9581b%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ya/748e14ff24ee4607b546315290f9581b/images/large/9.jpg saved to cache
2026-03-26 22:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 15129c96-225f-52ab-943d-69e5fbd62080
2026-03-26 22:56:34 [ayvens.be] INFO: Found listing with ID: 1985619
2026-03-26 22:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985619%27 HTTP/1.1" 200 None
2026-03-26 22:56:34 [ayvens.be] INFO: Scrape type for 1985619: 1
2026-03-26 22:56:34 [ayvens.be] INFO: Extracting data for car ID: 1985619
2026-03-26 22:56:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 555f67f7-ee2f-5c9f-8fd6-24113fff47fc with identifier: 1985619
2026-03-26 22:56:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 555f67f7-ee2f-5c9f-8fd6-24113fff47fc with scrape type 1
2026-03-26 22:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 555f67f7-ee2f-5c9f-8fd6-24113fff47fc
2026-03-26 22:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fbffe48d991434276bdb645334b5cb6ab%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/bffe48d991434276bdb645334b5cb6ab/images/large/1.jpg not downloaded yet
2026-03-26 22:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fbffe48d991434276bdb645334b5cb6ab%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/bffe48d991434276bdb645334b5cb6ab/images/large/2.jpg not downloaded yet
2026-03-26 22:56:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76e0110>
2026-03-26 22:56:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15129c96-225f-52ab-943d-69e5fbd62080/15129c96-225f-52ab-943d-69e5fbd62080_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ya%252F748e14ff24ee4607b546315290f9581b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ya/748e14ff24ee4607b546315290f9581b/images/large/8.jpg saved to cache
2026-03-26 22:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 15129c96-225f-52ab-943d-69e5fbd62080
2026-03-26 22:56:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cb22d0>
2026-03-26 22:56:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15129c96-225f-52ab-943d-69e5fbd62080/15129c96-225f-52ab-943d-69e5fbd62080_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ya%252F748e14ff24ee4607b546315290f9581b%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ya/748e14ff24ee4607b546315290f9581b/images/large/10.jpg saved to cache
2026-03-26 22:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 15129c96-225f-52ab-943d-69e5fbd62080
2026-03-26 22:56:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 15129c96-225f-52ab-943d-69e5fbd62080, skipping ID generation
2026-03-26 22:56:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15129c96-225f-52ab-943d-69e5fbd62080 with scrape type 1
2026-03-26 22:56:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 15129c96-225f-52ab-943d-69e5fbd62080 sending to next pipeline
2026-03-26 22:56:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 15129c96-225f-52ab-943d-69e5fbd62080, identifier: 1985617
2026-03-26 22:56:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 15129c96-225f-52ab-943d-69e5fbd62080 with identifier: 1985617
2026-03-26 22:56:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 15129c96-225f-52ab-943d-69e5fbd62080 with identifier: 1985617
2026-03-26 22:56:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 15129c96-225f-52ab-943d-69e5fbd62080 with identifier: 1985617 to the API
2026-03-26 22:56:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:56:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:56:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1ya/748e14ff24ee4607b546315290f9581b/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '15129c96-225f-52ab-943d-69e5fbd62080',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '508 SW DIESEL - 2018',
 'odometer': 72664,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15129c96-225f-52ab-943d-69e5fbd62080/15129c96-225f-52ab-943d-69e5fbd62080_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 264824,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ya/748e14ff24ee4607b546315290f9581b/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15129c96-225f-52ab-943d-69e5fbd62080/15129c96-225f-52ab-943d-69e5fbd62080_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 270757,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ya/748e14ff24ee4607b546315290f9581b/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15129c96-225f-52ab-943d-69e5fbd62080/15129c96-225f-52ab-943d-69e5fbd62080_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 283385,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ya/748e14ff24ee4607b546315290f9581b/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15129c96-225f-52ab-943d-69e5fbd62080/15129c96-225f-52ab-943d-69e5fbd62080_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 282270,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ya/748e14ff24ee4607b546315290f9581b/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15129c96-225f-52ab-943d-69e5fbd62080/15129c96-225f-52ab-943d-69e5fbd62080_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 256764,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ya/748e14ff24ee4607b546315290f9581b/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15129c96-225f-52ab-943d-69e5fbd62080/15129c96-225f-52ab-943d-69e5fbd62080_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 242788,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ya/748e14ff24ee4607b546315290f9581b/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15129c96-225f-52ab-943d-69e5fbd62080/15129c96-225f-52ab-943d-69e5fbd62080_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 269426,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ya/748e14ff24ee4607b546315290f9581b/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15129c96-225f-52ab-943d-69e5fbd62080/15129c96-225f-52ab-943d-69e5fbd62080_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 396741,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ya/748e14ff24ee4607b546315290f9581b/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15129c96-225f-52ab-943d-69e5fbd62080/15129c96-225f-52ab-943d-69e5fbd62080_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 252491,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ya/748e14ff24ee4607b546315290f9581b/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15129c96-225f-52ab-943d-69e5fbd62080/15129c96-225f-52ab-943d-69e5fbd62080_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 314582,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ya/748e14ff24ee4607b546315290f9581b/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 508 SW DIESEL - 2018 1.5 BlueHDi Active S&S',
 'transmission': 'automatic',
 'trim': '1.5 BlueHDi Active S&S',
 'vin': None,
 'year': 2020}
2026-03-26 22:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985617%27 HTTP/1.1" 200 None
2026-03-26 22:56:34 [ayvens.be] INFO: Saving data for 1985617: {'created_time': 1774565794.833742, 'last_price_update_time': 1774565794.833752, 'auction_closing_time': 1774958400.0}
2026-03-26 22:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985617') HTTP/1.1" 204 0
2026-03-26 22:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fbffe48d991434276bdb645334b5cb6ab%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/bffe48d991434276bdb645334b5cb6ab/images/large/3.jpg not downloaded yet
2026-03-26 22:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fbffe48d991434276bdb645334b5cb6ab%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/bffe48d991434276bdb645334b5cb6ab/images/large/4.jpg not downloaded yet
2026-03-26 22:56:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/2174df28dfcc4e169a19009b8a741661/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/2174df28dfcc4e169a19009b8a741661/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/2174df28dfcc4e169a19009b8a741661/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fbffe48d991434276bdb645334b5cb6ab%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/bffe48d991434276bdb645334b5cb6ab/images/large/5.jpg not downloaded yet
2026-03-26 22:56:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/2174df28dfcc4e169a19009b8a741661/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/2174df28dfcc4e169a19009b8a741661/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/2174df28dfcc4e169a19009b8a741661/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fbffe48d991434276bdb645334b5cb6ab%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/bffe48d991434276bdb645334b5cb6ab/images/large/6.jpg not downloaded yet
2026-03-26 22:56:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/2174df28dfcc4e169a19009b8a741661/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fbffe48d991434276bdb645334b5cb6ab%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/bffe48d991434276bdb645334b5cb6ab/images/large/7.jpg not downloaded yet
2026-03-26 22:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fbffe48d991434276bdb645334b5cb6ab%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/bffe48d991434276bdb645334b5cb6ab/images/large/8.jpg not downloaded yet
2026-03-26 22:56:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/2174df28dfcc4e169a19009b8a741661/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fbffe48d991434276bdb645334b5cb6ab%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/bffe48d991434276bdb645334b5cb6ab/images/large/9.jpg not downloaded yet
2026-03-26 22:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fbffe48d991434276bdb645334b5cb6ab%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/bffe48d991434276bdb645334b5cb6ab/images/large/10.jpg not downloaded yet
2026-03-26 22:56:35 [ayvens.be] INFO: Found listing with ID: 1985620
2026-03-26 22:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985620%27 HTTP/1.1" 200 None
2026-03-26 22:56:35 [ayvens.be] INFO: Scrape type for 1985620: 1
2026-03-26 22:56:35 [ayvens.be] INFO: Extracting data for car ID: 1985620
2026-03-26 22:56:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fcb94b69-fc8d-5462-932e-5e54a021f291 with identifier: 1985620
2026-03-26 22:56:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fcb94b69-fc8d-5462-932e-5e54a021f291 with scrape type 1
2026-03-26 22:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fcb94b69-fc8d-5462-932e-5e54a021f291
2026-03-26 22:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xr%252F6a568b0ca52844b889f80a707e9dc975%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xr/6a568b0ca52844b889f80a707e9dc975/images/large/1.jpg not downloaded yet
2026-03-26 22:56:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7587610>
2026-03-26 22:56:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_973b0b30-ae16-5993-8445-749a81894b5c/973b0b30-ae16-5993-8445-749a81894b5c_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F2174df28dfcc4e169a19009b8a741661%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/2174df28dfcc4e169a19009b8a741661/images/large/1.jpg saved to cache
2026-03-26 22:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 973b0b30-ae16-5993-8445-749a81894b5c
2026-03-26 22:56:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7911790>
2026-03-26 22:56:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_973b0b30-ae16-5993-8445-749a81894b5c/973b0b30-ae16-5993-8445-749a81894b5c_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F2174df28dfcc4e169a19009b8a741661%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/2174df28dfcc4e169a19009b8a741661/images/large/5.jpg saved to cache
2026-03-26 22:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 973b0b30-ae16-5993-8445-749a81894b5c
2026-03-26 22:56:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74b4d50>
2026-03-26 22:56:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_973b0b30-ae16-5993-8445-749a81894b5c/973b0b30-ae16-5993-8445-749a81894b5c_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F2174df28dfcc4e169a19009b8a741661%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/2174df28dfcc4e169a19009b8a741661/images/large/3.jpg saved to cache
2026-03-26 22:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 973b0b30-ae16-5993-8445-749a81894b5c
2026-03-26 22:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xr%252F6a568b0ca52844b889f80a707e9dc975%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xr/6a568b0ca52844b889f80a707e9dc975/images/large/2.jpg not downloaded yet
2026-03-26 22:56:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74584d0>
2026-03-26 22:56:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_973b0b30-ae16-5993-8445-749a81894b5c/973b0b30-ae16-5993-8445-749a81894b5c_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F2174df28dfcc4e169a19009b8a741661%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/2174df28dfcc4e169a19009b8a741661/images/large/2.jpg saved to cache
2026-03-26 22:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 973b0b30-ae16-5993-8445-749a81894b5c
2026-03-26 22:56:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7746190>
2026-03-26 22:56:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_973b0b30-ae16-5993-8445-749a81894b5c/973b0b30-ae16-5993-8445-749a81894b5c_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F2174df28dfcc4e169a19009b8a741661%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/2174df28dfcc4e169a19009b8a741661/images/large/4.jpg saved to cache
2026-03-26 22:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 973b0b30-ae16-5993-8445-749a81894b5c
2026-03-26 22:56:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76ec1d0>
2026-03-26 22:56:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_973b0b30-ae16-5993-8445-749a81894b5c/973b0b30-ae16-5993-8445-749a81894b5c_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F2174df28dfcc4e169a19009b8a741661%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/2174df28dfcc4e169a19009b8a741661/images/large/6.jpg saved to cache
2026-03-26 22:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 973b0b30-ae16-5993-8445-749a81894b5c
2026-03-26 22:56:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79ce590>
2026-03-26 22:56:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_973b0b30-ae16-5993-8445-749a81894b5c/973b0b30-ae16-5993-8445-749a81894b5c_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F2174df28dfcc4e169a19009b8a741661%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/2174df28dfcc4e169a19009b8a741661/images/large/8.jpg saved to cache
2026-03-26 22:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 973b0b30-ae16-5993-8445-749a81894b5c
2026-03-26 22:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xr%252F6a568b0ca52844b889f80a707e9dc975%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xr/6a568b0ca52844b889f80a707e9dc975/images/large/3.jpg not downloaded yet
2026-03-26 22:56:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/bffe48d991434276bdb645334b5cb6ab/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/bffe48d991434276bdb645334b5cb6ab/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xr%252F6a568b0ca52844b889f80a707e9dc975%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xr/6a568b0ca52844b889f80a707e9dc975/images/large/4.jpg not downloaded yet
2026-03-26 22:56:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b728ce10>
2026-03-26 22:56:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_973b0b30-ae16-5993-8445-749a81894b5c/973b0b30-ae16-5993-8445-749a81894b5c_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F2174df28dfcc4e169a19009b8a741661%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/2174df28dfcc4e169a19009b8a741661/images/large/7.jpg saved to cache
2026-03-26 22:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 973b0b30-ae16-5993-8445-749a81894b5c
2026-03-26 22:56:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/bffe48d991434276bdb645334b5cb6ab/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/bffe48d991434276bdb645334b5cb6ab/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/bffe48d991434276bdb645334b5cb6ab/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xr%252F6a568b0ca52844b889f80a707e9dc975%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xr/6a568b0ca52844b889f80a707e9dc975/images/large/5.jpg not downloaded yet
2026-03-26 22:56:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/2174df28dfcc4e169a19009b8a741661/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/bffe48d991434276bdb645334b5cb6ab/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xr%252F6a568b0ca52844b889f80a707e9dc975%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xr/6a568b0ca52844b889f80a707e9dc975/images/large/6.jpg not downloaded yet
2026-03-26 22:56:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/2174df28dfcc4e169a19009b8a741661/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79a6410>
2026-03-26 22:56:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_555f67f7-ee2f-5c9f-8fd6-24113fff47fc/555f67f7-ee2f-5c9f-8fd6-24113fff47fc_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fbffe48d991434276bdb645334b5cb6ab%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/bffe48d991434276bdb645334b5cb6ab/images/large/6.jpg saved to cache
2026-03-26 22:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 555f67f7-ee2f-5c9f-8fd6-24113fff47fc
2026-03-26 22:56:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e290d0>
2026-03-26 22:56:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_555f67f7-ee2f-5c9f-8fd6-24113fff47fc/555f67f7-ee2f-5c9f-8fd6-24113fff47fc_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fbffe48d991434276bdb645334b5cb6ab%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/bffe48d991434276bdb645334b5cb6ab/images/large/5.jpg saved to cache
2026-03-26 22:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 555f67f7-ee2f-5c9f-8fd6-24113fff47fc
2026-03-26 22:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xr%252F6a568b0ca52844b889f80a707e9dc975%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xr/6a568b0ca52844b889f80a707e9dc975/images/large/7.jpg not downloaded yet
2026-03-26 22:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xr%252F6a568b0ca52844b889f80a707e9dc975%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xr/6a568b0ca52844b889f80a707e9dc975/images/large/8.jpg not downloaded yet
2026-03-26 22:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xr%252F6a568b0ca52844b889f80a707e9dc975%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xr/6a568b0ca52844b889f80a707e9dc975/images/large/9.jpg not downloaded yet
2026-03-26 22:56:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c80c50>
2026-03-26 22:56:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_555f67f7-ee2f-5c9f-8fd6-24113fff47fc/555f67f7-ee2f-5c9f-8fd6-24113fff47fc_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fbffe48d991434276bdb645334b5cb6ab%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/bffe48d991434276bdb645334b5cb6ab/images/large/1.jpg saved to cache
2026-03-26 22:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 555f67f7-ee2f-5c9f-8fd6-24113fff47fc
2026-03-26 22:56:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5ca7910>
2026-03-26 22:56:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_555f67f7-ee2f-5c9f-8fd6-24113fff47fc/555f67f7-ee2f-5c9f-8fd6-24113fff47fc_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fbffe48d991434276bdb645334b5cb6ab%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/bffe48d991434276bdb645334b5cb6ab/images/large/2.jpg saved to cache
2026-03-26 22:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 555f67f7-ee2f-5c9f-8fd6-24113fff47fc
2026-03-26 22:56:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7584c50>
2026-03-26 22:56:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_555f67f7-ee2f-5c9f-8fd6-24113fff47fc/555f67f7-ee2f-5c9f-8fd6-24113fff47fc_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fbffe48d991434276bdb645334b5cb6ab%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/bffe48d991434276bdb645334b5cb6ab/images/large/4.jpg saved to cache
2026-03-26 22:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 555f67f7-ee2f-5c9f-8fd6-24113fff47fc
2026-03-26 22:56:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b6a3d0>
2026-03-26 22:56:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_973b0b30-ae16-5993-8445-749a81894b5c/973b0b30-ae16-5993-8445-749a81894b5c_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F2174df28dfcc4e169a19009b8a741661%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/2174df28dfcc4e169a19009b8a741661/images/large/10.jpg saved to cache
2026-03-26 22:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 973b0b30-ae16-5993-8445-749a81894b5c
2026-03-26 22:56:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7411210>
2026-03-26 22:56:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_555f67f7-ee2f-5c9f-8fd6-24113fff47fc/555f67f7-ee2f-5c9f-8fd6-24113fff47fc_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fbffe48d991434276bdb645334b5cb6ab%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/bffe48d991434276bdb645334b5cb6ab/images/large/3.jpg saved to cache
2026-03-26 22:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 555f67f7-ee2f-5c9f-8fd6-24113fff47fc
2026-03-26 22:56:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b782d5d0>
2026-03-26 22:56:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_973b0b30-ae16-5993-8445-749a81894b5c/973b0b30-ae16-5993-8445-749a81894b5c_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F2174df28dfcc4e169a19009b8a741661%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/2174df28dfcc4e169a19009b8a741661/images/large/9.jpg saved to cache
2026-03-26 22:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 973b0b30-ae16-5993-8445-749a81894b5c
2026-03-26 22:56:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 973b0b30-ae16-5993-8445-749a81894b5c, skipping ID generation
2026-03-26 22:56:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 973b0b30-ae16-5993-8445-749a81894b5c with scrape type 1
2026-03-26 22:56:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 973b0b30-ae16-5993-8445-749a81894b5c sending to next pipeline
2026-03-26 22:56:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 973b0b30-ae16-5993-8445-749a81894b5c, identifier: 1985618
2026-03-26 22:56:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/bffe48d991434276bdb645334b5cb6ab/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 973b0b30-ae16-5993-8445-749a81894b5c with identifier: 1985618
2026-03-26 22:56:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 973b0b30-ae16-5993-8445-749a81894b5c with identifier: 1985618
2026-03-26 22:56:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 973b0b30-ae16-5993-8445-749a81894b5c with identifier: 1985618 to the API
2026-03-26 22:56:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:56:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:56:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bm/2174df28dfcc4e169a19009b8a741661/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '973b0b30-ae16-5993-8445-749a81894b5c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'KUGA',
 'odometer': 128196,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_973b0b30-ae16-5993-8445-749a81894b5c/973b0b30-ae16-5993-8445-749a81894b5c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 731795,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/2174df28dfcc4e169a19009b8a741661/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_973b0b30-ae16-5993-8445-749a81894b5c/973b0b30-ae16-5993-8445-749a81894b5c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 700704,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/2174df28dfcc4e169a19009b8a741661/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_973b0b30-ae16-5993-8445-749a81894b5c/973b0b30-ae16-5993-8445-749a81894b5c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 590213,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/2174df28dfcc4e169a19009b8a741661/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_973b0b30-ae16-5993-8445-749a81894b5c/973b0b30-ae16-5993-8445-749a81894b5c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 726392,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/2174df28dfcc4e169a19009b8a741661/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_973b0b30-ae16-5993-8445-749a81894b5c/973b0b30-ae16-5993-8445-749a81894b5c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 551819,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/2174df28dfcc4e169a19009b8a741661/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_973b0b30-ae16-5993-8445-749a81894b5c/973b0b30-ae16-5993-8445-749a81894b5c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 617475,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/2174df28dfcc4e169a19009b8a741661/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_973b0b30-ae16-5993-8445-749a81894b5c/973b0b30-ae16-5993-8445-749a81894b5c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 723546,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/2174df28dfcc4e169a19009b8a741661/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_973b0b30-ae16-5993-8445-749a81894b5c/973b0b30-ae16-5993-8445-749a81894b5c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 732657,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/2174df28dfcc4e169a19009b8a741661/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_973b0b30-ae16-5993-8445-749a81894b5c/973b0b30-ae16-5993-8445-749a81894b5c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 557536,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/2174df28dfcc4e169a19009b8a741661/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_973b0b30-ae16-5993-8445-749a81894b5c/973b0b30-ae16-5993-8445-749a81894b5c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 636304,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/2174df28dfcc4e169a19009b8a741661/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD KUGA 2.5I PHEV 165KW ST-LINE X AUTO',
 'transmission': 'automatic',
 'trim': '2.5I PHEV 165KW ST-LINE X AUTO',
 'vin': None,
 'year': 2022}
2026-03-26 22:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985618%27 HTTP/1.1" 200 None
2026-03-26 22:56:37 [ayvens.be] INFO: Saving data for 1985618: {'created_time': 1774565797.075051, 'last_price_update_time': 1774565797.075063, 'auction_closing_time': 1774958400.0}
2026-03-26 22:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985618') HTTP/1.1" 204 0
2026-03-26 22:56:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/bffe48d991434276bdb645334b5cb6ab/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/bffe48d991434276bdb645334b5cb6ab/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xr%252F6a568b0ca52844b889f80a707e9dc975%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xr/6a568b0ca52844b889f80a707e9dc975/images/large/10.jpg not downloaded yet
2026-03-26 22:56:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/bffe48d991434276bdb645334b5cb6ab/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:37 [ayvens.be] INFO: Found listing with ID: 1985621
2026-03-26 22:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985621%27 HTTP/1.1" 200 None
2026-03-26 22:56:37 [ayvens.be] INFO: Scrape type for 1985621: 1
2026-03-26 22:56:37 [ayvens.be] INFO: Extracting data for car ID: 1985621
2026-03-26 22:56:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9a6501d-97ae-5b09-a2ce-ace7338f8598 with identifier: 1985621
2026-03-26 22:56:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9a6501d-97ae-5b09-a2ce-ace7338f8598 with scrape type 1
2026-03-26 22:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a9a6501d-97ae-5b09-a2ce-ace7338f8598
2026-03-26 22:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F185afb8c3f5d4945a38a2e66f51b5e70%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/185afb8c3f5d4945a38a2e66f51b5e70/images/large/1.jpg not downloaded yet
2026-03-26 22:56:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77bdc90>
2026-03-26 22:56:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_555f67f7-ee2f-5c9f-8fd6-24113fff47fc/555f67f7-ee2f-5c9f-8fd6-24113fff47fc_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fbffe48d991434276bdb645334b5cb6ab%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/bffe48d991434276bdb645334b5cb6ab/images/large/10.jpg saved to cache
2026-03-26 22:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 555f67f7-ee2f-5c9f-8fd6-24113fff47fc
2026-03-26 22:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F185afb8c3f5d4945a38a2e66f51b5e70%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/185afb8c3f5d4945a38a2e66f51b5e70/images/large/2.jpg not downloaded yet
2026-03-26 22:56:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xr/6a568b0ca52844b889f80a707e9dc975/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xr/6a568b0ca52844b889f80a707e9dc975/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F185afb8c3f5d4945a38a2e66f51b5e70%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/185afb8c3f5d4945a38a2e66f51b5e70/images/large/3.jpg not downloaded yet
2026-03-26 22:56:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6da7090>
2026-03-26 22:56:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_555f67f7-ee2f-5c9f-8fd6-24113fff47fc/555f67f7-ee2f-5c9f-8fd6-24113fff47fc_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fbffe48d991434276bdb645334b5cb6ab%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/bffe48d991434276bdb645334b5cb6ab/images/large/7.jpg saved to cache
2026-03-26 22:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 555f67f7-ee2f-5c9f-8fd6-24113fff47fc
2026-03-26 22:56:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7ca9610>
2026-03-26 22:56:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_555f67f7-ee2f-5c9f-8fd6-24113fff47fc/555f67f7-ee2f-5c9f-8fd6-24113fff47fc_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fbffe48d991434276bdb645334b5cb6ab%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/bffe48d991434276bdb645334b5cb6ab/images/large/8.jpg saved to cache
2026-03-26 22:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 555f67f7-ee2f-5c9f-8fd6-24113fff47fc
2026-03-26 22:56:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7927210>
2026-03-26 22:56:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_555f67f7-ee2f-5c9f-8fd6-24113fff47fc/555f67f7-ee2f-5c9f-8fd6-24113fff47fc_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fbffe48d991434276bdb645334b5cb6ab%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/bffe48d991434276bdb645334b5cb6ab/images/large/9.jpg saved to cache
2026-03-26 22:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 555f67f7-ee2f-5c9f-8fd6-24113fff47fc
2026-03-26 22:56:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 555f67f7-ee2f-5c9f-8fd6-24113fff47fc, skipping ID generation
2026-03-26 22:56:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 555f67f7-ee2f-5c9f-8fd6-24113fff47fc with scrape type 1
2026-03-26 22:56:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 555f67f7-ee2f-5c9f-8fd6-24113fff47fc sending to next pipeline
2026-03-26 22:56:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 555f67f7-ee2f-5c9f-8fd6-24113fff47fc, identifier: 1985619
2026-03-26 22:56:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xr/6a568b0ca52844b889f80a707e9dc975/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 555f67f7-ee2f-5c9f-8fd6-24113fff47fc with identifier: 1985619
2026-03-26 22:56:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 555f67f7-ee2f-5c9f-8fd6-24113fff47fc with identifier: 1985619
2026-03-26 22:56:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 555f67f7-ee2f-5c9f-8fd6-24113fff47fc with identifier: 1985619 to the API
2026-03-26 22:56:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:56:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:56:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bm/bffe48d991434276bdb645334b5cb6ab/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '555f67f7-ee2f-5c9f-8fd6-24113fff47fc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X2',
 'odometer': 80415,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_555f67f7-ee2f-5c9f-8fd6-24113fff47fc/555f67f7-ee2f-5c9f-8fd6-24113fff47fc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 401804,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/bffe48d991434276bdb645334b5cb6ab/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_555f67f7-ee2f-5c9f-8fd6-24113fff47fc/555f67f7-ee2f-5c9f-8fd6-24113fff47fc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 414465,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/bffe48d991434276bdb645334b5cb6ab/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_555f67f7-ee2f-5c9f-8fd6-24113fff47fc/555f67f7-ee2f-5c9f-8fd6-24113fff47fc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 439216,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/bffe48d991434276bdb645334b5cb6ab/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_555f67f7-ee2f-5c9f-8fd6-24113fff47fc/555f67f7-ee2f-5c9f-8fd6-24113fff47fc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 437865,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/bffe48d991434276bdb645334b5cb6ab/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_555f67f7-ee2f-5c9f-8fd6-24113fff47fc/555f67f7-ee2f-5c9f-8fd6-24113fff47fc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 327990,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/bffe48d991434276bdb645334b5cb6ab/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_555f67f7-ee2f-5c9f-8fd6-24113fff47fc/555f67f7-ee2f-5c9f-8fd6-24113fff47fc_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 247233,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/bffe48d991434276bdb645334b5cb6ab/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_555f67f7-ee2f-5c9f-8fd6-24113fff47fc/555f67f7-ee2f-5c9f-8fd6-24113fff47fc_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 342817,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/bffe48d991434276bdb645334b5cb6ab/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_555f67f7-ee2f-5c9f-8fd6-24113fff47fc/555f67f7-ee2f-5c9f-8fd6-24113fff47fc_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 310720,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/bffe48d991434276bdb645334b5cb6ab/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_555f67f7-ee2f-5c9f-8fd6-24113fff47fc/555f67f7-ee2f-5c9f-8fd6-24113fff47fc_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 232231,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/bffe48d991434276bdb645334b5cb6ab/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_555f67f7-ee2f-5c9f-8fd6-24113fff47fc/555f67f7-ee2f-5c9f-8fd6-24113fff47fc_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 264498,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/bffe48d991434276bdb645334b5cb6ab/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X2 1.5 SDRIVE18I 100KW',
 'transmission': 'manual',
 'trim': '1.5 SDRIVE18I 100KW',
 'vin': None,
 'year': 2022}
2026-03-26 22:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985619%27 HTTP/1.1" 200 None
2026-03-26 22:56:38 [ayvens.be] INFO: Saving data for 1985619: {'created_time': 1774565798.069328, 'last_price_update_time': 1774565798.069338, 'auction_closing_time': 1774958400.0}
2026-03-26 22:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985619') HTTP/1.1" 204 0
2026-03-26 22:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F185afb8c3f5d4945a38a2e66f51b5e70%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/185afb8c3f5d4945a38a2e66f51b5e70/images/large/4.jpg not downloaded yet
2026-03-26 22:56:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xr/6a568b0ca52844b889f80a707e9dc975/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F185afb8c3f5d4945a38a2e66f51b5e70%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/185afb8c3f5d4945a38a2e66f51b5e70/images/large/5.jpg not downloaded yet
2026-03-26 22:56:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b792d850>
2026-03-26 22:56:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcb94b69-fc8d-5462-932e-5e54a021f291/fcb94b69-fc8d-5462-932e-5e54a021f291_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xr%252F6a568b0ca52844b889f80a707e9dc975%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xr/6a568b0ca52844b889f80a707e9dc975/images/large/1.jpg saved to cache
2026-03-26 22:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fcb94b69-fc8d-5462-932e-5e54a021f291
2026-03-26 22:56:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7405f90>
2026-03-26 22:56:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcb94b69-fc8d-5462-932e-5e54a021f291/fcb94b69-fc8d-5462-932e-5e54a021f291_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xr%252F6a568b0ca52844b889f80a707e9dc975%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xr/6a568b0ca52844b889f80a707e9dc975/images/large/3.jpg saved to cache
2026-03-26 22:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fcb94b69-fc8d-5462-932e-5e54a021f291
2026-03-26 22:56:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b78a8350>
2026-03-26 22:56:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcb94b69-fc8d-5462-932e-5e54a021f291/fcb94b69-fc8d-5462-932e-5e54a021f291_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xr%252F6a568b0ca52844b889f80a707e9dc975%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xr/6a568b0ca52844b889f80a707e9dc975/images/large/2.jpg saved to cache
2026-03-26 22:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fcb94b69-fc8d-5462-932e-5e54a021f291
2026-03-26 22:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F185afb8c3f5d4945a38a2e66f51b5e70%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/185afb8c3f5d4945a38a2e66f51b5e70/images/large/6.jpg not downloaded yet
2026-03-26 22:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F185afb8c3f5d4945a38a2e66f51b5e70%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/185afb8c3f5d4945a38a2e66f51b5e70/images/large/7.jpg not downloaded yet
2026-03-26 22:56:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd3c4390>
2026-03-26 22:56:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcb94b69-fc8d-5462-932e-5e54a021f291/fcb94b69-fc8d-5462-932e-5e54a021f291_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xr%252F6a568b0ca52844b889f80a707e9dc975%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xr/6a568b0ca52844b889f80a707e9dc975/images/large/4.jpg saved to cache
2026-03-26 22:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fcb94b69-fc8d-5462-932e-5e54a021f291
2026-03-26 22:56:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xr/6a568b0ca52844b889f80a707e9dc975/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xr/6a568b0ca52844b889f80a707e9dc975/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F185afb8c3f5d4945a38a2e66f51b5e70%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/185afb8c3f5d4945a38a2e66f51b5e70/images/large/8.jpg not downloaded yet
2026-03-26 22:56:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xr/6a568b0ca52844b889f80a707e9dc975/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xr/6a568b0ca52844b889f80a707e9dc975/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/185afb8c3f5d4945a38a2e66f51b5e70/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F185afb8c3f5d4945a38a2e66f51b5e70%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/185afb8c3f5d4945a38a2e66f51b5e70/images/large/9.jpg not downloaded yet
2026-03-26 22:56:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xr/6a568b0ca52844b889f80a707e9dc975/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/185afb8c3f5d4945a38a2e66f51b5e70/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xr/6a568b0ca52844b889f80a707e9dc975/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F185afb8c3f5d4945a38a2e66f51b5e70%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/185afb8c3f5d4945a38a2e66f51b5e70/images/large/10.jpg not downloaded yet
2026-03-26 22:56:38 [ayvens.be] INFO: Found listing with ID: 1985622
2026-03-26 22:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985622%27 HTTP/1.1" 200 None
2026-03-26 22:56:38 [ayvens.be] INFO: Scrape type for 1985622: 1
2026-03-26 22:56:38 [ayvens.be] INFO: Extracting data for car ID: 1985622
2026-03-26 22:56:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 38ee1521-30fc-5153-b980-e6c443fba2e2 with identifier: 1985622
2026-03-26 22:56:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38ee1521-30fc-5153-b980-e6c443fba2e2 with scrape type 1
2026-03-26 22:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 38ee1521-30fc-5153-b980-e6c443fba2e2
2026-03-26 22:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F02a8079b1a124198aefc6a7622565fbb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/02a8079b1a124198aefc6a7622565fbb/images/large/1.jpg not downloaded yet
2026-03-26 22:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F02a8079b1a124198aefc6a7622565fbb%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/02a8079b1a124198aefc6a7622565fbb/images/large/2.jpg not downloaded yet
2026-03-26 22:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F02a8079b1a124198aefc6a7622565fbb%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/02a8079b1a124198aefc6a7622565fbb/images/large/3.jpg not downloaded yet
2026-03-26 22:56:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b748be50>
2026-03-26 22:56:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcb94b69-fc8d-5462-932e-5e54a021f291/fcb94b69-fc8d-5462-932e-5e54a021f291_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xr%252F6a568b0ca52844b889f80a707e9dc975%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xr/6a568b0ca52844b889f80a707e9dc975/images/large/7.jpg saved to cache
2026-03-26 22:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fcb94b69-fc8d-5462-932e-5e54a021f291
2026-03-26 22:56:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77bd390>
2026-03-26 22:56:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcb94b69-fc8d-5462-932e-5e54a021f291/fcb94b69-fc8d-5462-932e-5e54a021f291_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xr%252F6a568b0ca52844b889f80a707e9dc975%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xr/6a568b0ca52844b889f80a707e9dc975/images/large/5.jpg saved to cache
2026-03-26 22:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fcb94b69-fc8d-5462-932e-5e54a021f291
2026-03-26 22:56:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/185afb8c3f5d4945a38a2e66f51b5e70/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F02a8079b1a124198aefc6a7622565fbb%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/02a8079b1a124198aefc6a7622565fbb/images/large/4.jpg not downloaded yet
2026-03-26 22:56:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd3b8e90>
2026-03-26 22:56:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcb94b69-fc8d-5462-932e-5e54a021f291/fcb94b69-fc8d-5462-932e-5e54a021f291_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xr%252F6a568b0ca52844b889f80a707e9dc975%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xr/6a568b0ca52844b889f80a707e9dc975/images/large/8.jpg saved to cache
2026-03-26 22:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fcb94b69-fc8d-5462-932e-5e54a021f291
2026-03-26 22:56:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5ca6050>
2026-03-26 22:56:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcb94b69-fc8d-5462-932e-5e54a021f291/fcb94b69-fc8d-5462-932e-5e54a021f291_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xr%252F6a568b0ca52844b889f80a707e9dc975%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xr/6a568b0ca52844b889f80a707e9dc975/images/large/6.jpg saved to cache
2026-03-26 22:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fcb94b69-fc8d-5462-932e-5e54a021f291
2026-03-26 22:56:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79cd5d0>
2026-03-26 22:56:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9a6501d-97ae-5b09-a2ce-ace7338f8598/a9a6501d-97ae-5b09-a2ce-ace7338f8598_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:56:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F185afb8c3f5d4945a38a2e66f51b5e70%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/185afb8c3f5d4945a38a2e66f51b5e70/images/large/2.jpg saved to cache
2026-03-26 22:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a9a6501d-97ae-5b09-a2ce-ace7338f8598
2026-03-26 22:56:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79f9250>
2026-03-26 22:56:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcb94b69-fc8d-5462-932e-5e54a021f291/fcb94b69-fc8d-5462-932e-5e54a021f291_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:56:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xr%252F6a568b0ca52844b889f80a707e9dc975%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xr/6a568b0ca52844b889f80a707e9dc975/images/large/9.jpg saved to cache
2026-03-26 22:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fcb94b69-fc8d-5462-932e-5e54a021f291
2026-03-26 22:56:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7caa590>
2026-03-26 22:56:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9a6501d-97ae-5b09-a2ce-ace7338f8598/a9a6501d-97ae-5b09-a2ce-ace7338f8598_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:56:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F185afb8c3f5d4945a38a2e66f51b5e70%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/185afb8c3f5d4945a38a2e66f51b5e70/images/large/1.jpg saved to cache
2026-03-26 22:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a9a6501d-97ae-5b09-a2ce-ace7338f8598
2026-03-26 22:56:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6df13d0>
2026-03-26 22:56:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcb94b69-fc8d-5462-932e-5e54a021f291/fcb94b69-fc8d-5462-932e-5e54a021f291_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:56:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xr%252F6a568b0ca52844b889f80a707e9dc975%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xr/6a568b0ca52844b889f80a707e9dc975/images/large/10.jpg saved to cache
2026-03-26 22:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fcb94b69-fc8d-5462-932e-5e54a021f291
2026-03-26 22:56:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fcb94b69-fc8d-5462-932e-5e54a021f291, skipping ID generation
2026-03-26 22:56:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fcb94b69-fc8d-5462-932e-5e54a021f291 with scrape type 1
2026-03-26 22:56:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fcb94b69-fc8d-5462-932e-5e54a021f291 sending to next pipeline
2026-03-26 22:56:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: fcb94b69-fc8d-5462-932e-5e54a021f291, identifier: 1985620
2026-03-26 22:56:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/185afb8c3f5d4945a38a2e66f51b5e70/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/185afb8c3f5d4945a38a2e66f51b5e70/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/185afb8c3f5d4945a38a2e66f51b5e70/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F02a8079b1a124198aefc6a7622565fbb%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/02a8079b1a124198aefc6a7622565fbb/images/large/5.jpg not downloaded yet
2026-03-26 22:56:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: fcb94b69-fc8d-5462-932e-5e54a021f291 with identifier: 1985620
2026-03-26 22:56:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: fcb94b69-fc8d-5462-932e-5e54a021f291 with identifier: 1985620
2026-03-26 22:56:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: fcb94b69-fc8d-5462-932e-5e54a021f291 with identifier: 1985620 to the API
2026-03-26 22:56:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:56:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:56:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1xr/6a568b0ca52844b889f80a707e9dc975/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'fcb94b69-fc8d-5462-932e-5e54a021f291',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'CLIO V',
 'odometer': 84446,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcb94b69-fc8d-5462-932e-5e54a021f291/fcb94b69-fc8d-5462-932e-5e54a021f291_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 712321,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xr/6a568b0ca52844b889f80a707e9dc975/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcb94b69-fc8d-5462-932e-5e54a021f291/fcb94b69-fc8d-5462-932e-5e54a021f291_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 707082,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xr/6a568b0ca52844b889f80a707e9dc975/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcb94b69-fc8d-5462-932e-5e54a021f291/fcb94b69-fc8d-5462-932e-5e54a021f291_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 740309,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xr/6a568b0ca52844b889f80a707e9dc975/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcb94b69-fc8d-5462-932e-5e54a021f291/fcb94b69-fc8d-5462-932e-5e54a021f291_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 760944,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xr/6a568b0ca52844b889f80a707e9dc975/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcb94b69-fc8d-5462-932e-5e54a021f291/fcb94b69-fc8d-5462-932e-5e54a021f291_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 771340,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xr/6a568b0ca52844b889f80a707e9dc975/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcb94b69-fc8d-5462-932e-5e54a021f291/fcb94b69-fc8d-5462-932e-5e54a021f291_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 818296,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xr/6a568b0ca52844b889f80a707e9dc975/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcb94b69-fc8d-5462-932e-5e54a021f291/fcb94b69-fc8d-5462-932e-5e54a021f291_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 689808,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xr/6a568b0ca52844b889f80a707e9dc975/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcb94b69-fc8d-5462-932e-5e54a021f291/fcb94b69-fc8d-5462-932e-5e54a021f291_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 814230,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xr/6a568b0ca52844b889f80a707e9dc975/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcb94b69-fc8d-5462-932e-5e54a021f291/fcb94b69-fc8d-5462-932e-5e54a021f291_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 716509,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xr/6a568b0ca52844b889f80a707e9dc975/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcb94b69-fc8d-5462-932e-5e54a021f291/fcb94b69-fc8d-5462-932e-5e54a021f291_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 741343,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xr/6a568b0ca52844b889f80a707e9dc975/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT CLIO V 1.0 TCe Corporate Edition (Fleet)',
 'transmission': 'manual',
 'trim': '1.0 TCe Corporate Edition (Fleet)',
 'vin': None,
 'year': 2020}
2026-03-26 22:56:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985620%27 HTTP/1.1" 200 None
2026-03-26 22:56:39 [ayvens.be] INFO: Saving data for 1985620: {'created_time': 1774565799.736, 'last_price_update_time': 1774565799.736013, 'auction_closing_time': 1774958400.0}
2026-03-26 22:56:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985620') HTTP/1.1" 204 0
2026-03-26 22:56:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/185afb8c3f5d4945a38a2e66f51b5e70/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F02a8079b1a124198aefc6a7622565fbb%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/02a8079b1a124198aefc6a7622565fbb/images/large/6.jpg not downloaded yet
2026-03-26 22:56:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74dce10>
2026-03-26 22:56:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9a6501d-97ae-5b09-a2ce-ace7338f8598/a9a6501d-97ae-5b09-a2ce-ace7338f8598_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:56:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F185afb8c3f5d4945a38a2e66f51b5e70%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/185afb8c3f5d4945a38a2e66f51b5e70/images/large/6.jpg saved to cache
2026-03-26 22:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a9a6501d-97ae-5b09-a2ce-ace7338f8598
2026-03-26 22:56:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/185afb8c3f5d4945a38a2e66f51b5e70/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F02a8079b1a124198aefc6a7622565fbb%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/02a8079b1a124198aefc6a7622565fbb/images/large/7.jpg not downloaded yet
2026-03-26 22:56:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b788ea90>
2026-03-26 22:56:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9a6501d-97ae-5b09-a2ce-ace7338f8598/a9a6501d-97ae-5b09-a2ce-ace7338f8598_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:56:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F185afb8c3f5d4945a38a2e66f51b5e70%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/185afb8c3f5d4945a38a2e66f51b5e70/images/large/4.jpg saved to cache
2026-03-26 22:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a9a6501d-97ae-5b09-a2ce-ace7338f8598
2026-03-26 22:56:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bdffc4d0>
2026-03-26 22:56:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9a6501d-97ae-5b09-a2ce-ace7338f8598/a9a6501d-97ae-5b09-a2ce-ace7338f8598_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:56:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F185afb8c3f5d4945a38a2e66f51b5e70%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/185afb8c3f5d4945a38a2e66f51b5e70/images/large/7.jpg saved to cache
2026-03-26 22:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a9a6501d-97ae-5b09-a2ce-ace7338f8598
2026-03-26 22:56:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b741fc50>
2026-03-26 22:56:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9a6501d-97ae-5b09-a2ce-ace7338f8598/a9a6501d-97ae-5b09-a2ce-ace7338f8598_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F185afb8c3f5d4945a38a2e66f51b5e70%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/185afb8c3f5d4945a38a2e66f51b5e70/images/large/5.jpg saved to cache
2026-03-26 22:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a9a6501d-97ae-5b09-a2ce-ace7338f8598
2026-03-26 22:56:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e4ef50>
2026-03-26 22:56:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9a6501d-97ae-5b09-a2ce-ace7338f8598/a9a6501d-97ae-5b09-a2ce-ace7338f8598_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F185afb8c3f5d4945a38a2e66f51b5e70%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/185afb8c3f5d4945a38a2e66f51b5e70/images/large/8.jpg saved to cache
2026-03-26 22:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a9a6501d-97ae-5b09-a2ce-ace7338f8598
2026-03-26 22:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F02a8079b1a124198aefc6a7622565fbb%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/02a8079b1a124198aefc6a7622565fbb/images/large/8.jpg not downloaded yet
2026-03-26 22:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F02a8079b1a124198aefc6a7622565fbb%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/02a8079b1a124198aefc6a7622565fbb/images/large/9.jpg not downloaded yet
2026-03-26 22:56:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c7cfd0>
2026-03-26 22:56:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9a6501d-97ae-5b09-a2ce-ace7338f8598/a9a6501d-97ae-5b09-a2ce-ace7338f8598_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F185afb8c3f5d4945a38a2e66f51b5e70%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/185afb8c3f5d4945a38a2e66f51b5e70/images/large/3.jpg saved to cache
2026-03-26 22:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a9a6501d-97ae-5b09-a2ce-ace7338f8598
2026-03-26 22:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F02a8079b1a124198aefc6a7622565fbb%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/02a8079b1a124198aefc6a7622565fbb/images/large/10.jpg not downloaded yet
2026-03-26 22:56:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/02a8079b1a124198aefc6a7622565fbb/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/185afb8c3f5d4945a38a2e66f51b5e70/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/02a8079b1a124198aefc6a7622565fbb/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:40 [ayvens.be] INFO: Found listing with ID: 1985623
2026-03-26 22:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985623%27 HTTP/1.1" 200 None
2026-03-26 22:56:40 [ayvens.be] INFO: Scrape type for 1985623: 1
2026-03-26 22:56:40 [ayvens.be] INFO: Extracting data for car ID: 1985623
2026-03-26 22:56:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eff94e67-cb37-5cf5-899d-228774d52497 with identifier: 1985623
2026-03-26 22:56:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eff94e67-cb37-5cf5-899d-228774d52497 with scrape type 1
2026-03-26 22:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item eff94e67-cb37-5cf5-899d-228774d52497
2026-03-26 22:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F9fa3aa6eacc24ea7812ec72cc8d57198%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/9fa3aa6eacc24ea7812ec72cc8d57198/images/large/1.jpg not downloaded yet
2026-03-26 22:56:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/02a8079b1a124198aefc6a7622565fbb/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/02a8079b1a124198aefc6a7622565fbb/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/02a8079b1a124198aefc6a7622565fbb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F9fa3aa6eacc24ea7812ec72cc8d57198%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/9fa3aa6eacc24ea7812ec72cc8d57198/images/large/2.jpg not downloaded yet
2026-03-26 22:56:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/185afb8c3f5d4945a38a2e66f51b5e70/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F9fa3aa6eacc24ea7812ec72cc8d57198%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/9fa3aa6eacc24ea7812ec72cc8d57198/images/large/3.jpg not downloaded yet
2026-03-26 22:56:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/02a8079b1a124198aefc6a7622565fbb/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F9fa3aa6eacc24ea7812ec72cc8d57198%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/9fa3aa6eacc24ea7812ec72cc8d57198/images/large/4.jpg not downloaded yet
2026-03-26 22:56:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c75510>
2026-03-26 22:56:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38ee1521-30fc-5153-b980-e6c443fba2e2/38ee1521-30fc-5153-b980-e6c443fba2e2_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F02a8079b1a124198aefc6a7622565fbb%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/02a8079b1a124198aefc6a7622565fbb/images/large/4.jpg saved to cache
2026-03-26 22:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 38ee1521-30fc-5153-b980-e6c443fba2e2
2026-03-26 22:56:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7768e10>
2026-03-26 22:56:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9a6501d-97ae-5b09-a2ce-ace7338f8598/a9a6501d-97ae-5b09-a2ce-ace7338f8598_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F185afb8c3f5d4945a38a2e66f51b5e70%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/185afb8c3f5d4945a38a2e66f51b5e70/images/large/9.jpg saved to cache
2026-03-26 22:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a9a6501d-97ae-5b09-a2ce-ace7338f8598
2026-03-26 22:56:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76ee610>
2026-03-26 22:56:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38ee1521-30fc-5153-b980-e6c443fba2e2/38ee1521-30fc-5153-b980-e6c443fba2e2_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F02a8079b1a124198aefc6a7622565fbb%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/02a8079b1a124198aefc6a7622565fbb/images/large/5.jpg saved to cache
2026-03-26 22:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 38ee1521-30fc-5153-b980-e6c443fba2e2
2026-03-26 22:56:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/02a8079b1a124198aefc6a7622565fbb/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F9fa3aa6eacc24ea7812ec72cc8d57198%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/9fa3aa6eacc24ea7812ec72cc8d57198/images/large/5.jpg not downloaded yet
2026-03-26 22:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F9fa3aa6eacc24ea7812ec72cc8d57198%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/9fa3aa6eacc24ea7812ec72cc8d57198/images/large/6.jpg not downloaded yet
2026-03-26 22:56:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7778210>
2026-03-26 22:56:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38ee1521-30fc-5153-b980-e6c443fba2e2/38ee1521-30fc-5153-b980-e6c443fba2e2_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F02a8079b1a124198aefc6a7622565fbb%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/02a8079b1a124198aefc6a7622565fbb/images/large/2.jpg saved to cache
2026-03-26 22:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 38ee1521-30fc-5153-b980-e6c443fba2e2
2026-03-26 22:56:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7494690>
2026-03-26 22:56:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38ee1521-30fc-5153-b980-e6c443fba2e2/38ee1521-30fc-5153-b980-e6c443fba2e2_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F02a8079b1a124198aefc6a7622565fbb%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/02a8079b1a124198aefc6a7622565fbb/images/large/3.jpg saved to cache
2026-03-26 22:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 38ee1521-30fc-5153-b980-e6c443fba2e2
2026-03-26 22:56:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e1cfd0>
2026-03-26 22:56:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38ee1521-30fc-5153-b980-e6c443fba2e2/38ee1521-30fc-5153-b980-e6c443fba2e2_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F02a8079b1a124198aefc6a7622565fbb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/02a8079b1a124198aefc6a7622565fbb/images/large/1.jpg saved to cache
2026-03-26 22:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 38ee1521-30fc-5153-b980-e6c443fba2e2
2026-03-26 22:56:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7494310>
2026-03-26 22:56:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9a6501d-97ae-5b09-a2ce-ace7338f8598/a9a6501d-97ae-5b09-a2ce-ace7338f8598_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F185afb8c3f5d4945a38a2e66f51b5e70%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/185afb8c3f5d4945a38a2e66f51b5e70/images/large/10.jpg saved to cache
2026-03-26 22:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a9a6501d-97ae-5b09-a2ce-ace7338f8598
2026-03-26 22:56:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a9a6501d-97ae-5b09-a2ce-ace7338f8598, skipping ID generation
2026-03-26 22:56:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9a6501d-97ae-5b09-a2ce-ace7338f8598 with scrape type 1
2026-03-26 22:56:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a9a6501d-97ae-5b09-a2ce-ace7338f8598 sending to next pipeline
2026-03-26 22:56:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a9a6501d-97ae-5b09-a2ce-ace7338f8598, identifier: 1985621
2026-03-26 22:56:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74dc410>
2026-03-26 22:56:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38ee1521-30fc-5153-b980-e6c443fba2e2/38ee1521-30fc-5153-b980-e6c443fba2e2_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F02a8079b1a124198aefc6a7622565fbb%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/02a8079b1a124198aefc6a7622565fbb/images/large/6.jpg saved to cache
2026-03-26 22:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 38ee1521-30fc-5153-b980-e6c443fba2e2
2026-03-26 22:56:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/02a8079b1a124198aefc6a7622565fbb/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F9fa3aa6eacc24ea7812ec72cc8d57198%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/9fa3aa6eacc24ea7812ec72cc8d57198/images/large/7.jpg not downloaded yet
2026-03-26 22:56:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a9a6501d-97ae-5b09-a2ce-ace7338f8598 with identifier: 1985621
2026-03-26 22:56:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a9a6501d-97ae-5b09-a2ce-ace7338f8598 with identifier: 1985621
2026-03-26 22:56:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a9a6501d-97ae-5b09-a2ce-ace7338f8598 with identifier: 1985621 to the API
2026-03-26 22:56:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:56:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:56:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bj/185afb8c3f5d4945a38a2e66f51b5e70/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'electric',
 'id': 'a9a6501d-97ae-5b09-a2ce-ace7338f8598',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'TESLA',
 'model': 'MODEL 3',
 'odometer': 110560,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9a6501d-97ae-5b09-a2ce-ace7338f8598/a9a6501d-97ae-5b09-a2ce-ace7338f8598_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 428391,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/185afb8c3f5d4945a38a2e66f51b5e70/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9a6501d-97ae-5b09-a2ce-ace7338f8598/a9a6501d-97ae-5b09-a2ce-ace7338f8598_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 371162,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/185afb8c3f5d4945a38a2e66f51b5e70/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9a6501d-97ae-5b09-a2ce-ace7338f8598/a9a6501d-97ae-5b09-a2ce-ace7338f8598_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 457818,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/185afb8c3f5d4945a38a2e66f51b5e70/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9a6501d-97ae-5b09-a2ce-ace7338f8598/a9a6501d-97ae-5b09-a2ce-ace7338f8598_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 475554,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/185afb8c3f5d4945a38a2e66f51b5e70/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9a6501d-97ae-5b09-a2ce-ace7338f8598/a9a6501d-97ae-5b09-a2ce-ace7338f8598_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 411099,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/185afb8c3f5d4945a38a2e66f51b5e70/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9a6501d-97ae-5b09-a2ce-ace7338f8598/a9a6501d-97ae-5b09-a2ce-ace7338f8598_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 349516,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/185afb8c3f5d4945a38a2e66f51b5e70/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9a6501d-97ae-5b09-a2ce-ace7338f8598/a9a6501d-97ae-5b09-a2ce-ace7338f8598_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 411497,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/185afb8c3f5d4945a38a2e66f51b5e70/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9a6501d-97ae-5b09-a2ce-ace7338f8598/a9a6501d-97ae-5b09-a2ce-ace7338f8598_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 335165,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/185afb8c3f5d4945a38a2e66f51b5e70/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9a6501d-97ae-5b09-a2ce-ace7338f8598/a9a6501d-97ae-5b09-a2ce-ace7338f8598_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 361779,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/185afb8c3f5d4945a38a2e66f51b5e70/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9a6501d-97ae-5b09-a2ce-ace7338f8598/a9a6501d-97ae-5b09-a2ce-ace7338f8598_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 566421,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/185afb8c3f5d4945a38a2e66f51b5e70/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TESLA MODEL 3 75 KWH PERFORMANCE DUAL MOTOR 4WD AUTO',
 'transmission': 'automatic',
 'trim': '75 KWH PERFORMANCE DUAL MOTOR 4WD AUTO',
 'vin': None,
 'year': 2021}
2026-03-26 22:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985621%27 HTTP/1.1" 200 None
2026-03-26 22:56:41 [ayvens.be] INFO: Saving data for 1985621: {'created_time': 1774565801.67411, 'last_price_update_time': 1774565801.674119, 'auction_closing_time': 1774958400.0}
2026-03-26 22:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985621') HTTP/1.1" 204 0
2026-03-26 22:56:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/02a8079b1a124198aefc6a7622565fbb/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/02a8079b1a124198aefc6a7622565fbb/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F9fa3aa6eacc24ea7812ec72cc8d57198%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/9fa3aa6eacc24ea7812ec72cc8d57198/images/large/8.jpg not downloaded yet
2026-03-26 22:56:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd8d3e50>
2026-03-26 22:56:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38ee1521-30fc-5153-b980-e6c443fba2e2/38ee1521-30fc-5153-b980-e6c443fba2e2_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F02a8079b1a124198aefc6a7622565fbb%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/02a8079b1a124198aefc6a7622565fbb/images/large/7.jpg saved to cache
2026-03-26 22:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 38ee1521-30fc-5153-b980-e6c443fba2e2
2026-03-26 22:56:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7946dd0>
2026-03-26 22:56:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38ee1521-30fc-5153-b980-e6c443fba2e2/38ee1521-30fc-5153-b980-e6c443fba2e2_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F02a8079b1a124198aefc6a7622565fbb%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/02a8079b1a124198aefc6a7622565fbb/images/large/10.jpg saved to cache
2026-03-26 22:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 38ee1521-30fc-5153-b980-e6c443fba2e2
2026-03-26 22:56:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/9fa3aa6eacc24ea7812ec72cc8d57198/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F9fa3aa6eacc24ea7812ec72cc8d57198%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/9fa3aa6eacc24ea7812ec72cc8d57198/images/large/9.jpg not downloaded yet
2026-03-26 22:56:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/9fa3aa6eacc24ea7812ec72cc8d57198/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/9fa3aa6eacc24ea7812ec72cc8d57198/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F9fa3aa6eacc24ea7812ec72cc8d57198%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/9fa3aa6eacc24ea7812ec72cc8d57198/images/large/10.jpg not downloaded yet
2026-03-26 22:56:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7411750>
2026-03-26 22:56:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38ee1521-30fc-5153-b980-e6c443fba2e2/38ee1521-30fc-5153-b980-e6c443fba2e2_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F02a8079b1a124198aefc6a7622565fbb%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/02a8079b1a124198aefc6a7622565fbb/images/large/9.jpg saved to cache
2026-03-26 22:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 38ee1521-30fc-5153-b980-e6c443fba2e2
2026-03-26 22:56:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b75937d0>
2026-03-26 22:56:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38ee1521-30fc-5153-b980-e6c443fba2e2/38ee1521-30fc-5153-b980-e6c443fba2e2_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F02a8079b1a124198aefc6a7622565fbb%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/02a8079b1a124198aefc6a7622565fbb/images/large/8.jpg saved to cache
2026-03-26 22:56:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 38ee1521-30fc-5153-b980-e6c443fba2e2
2026-03-26 22:56:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 38ee1521-30fc-5153-b980-e6c443fba2e2, skipping ID generation
2026-03-26 22:56:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38ee1521-30fc-5153-b980-e6c443fba2e2 with scrape type 1
2026-03-26 22:56:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 38ee1521-30fc-5153-b980-e6c443fba2e2 sending to next pipeline
2026-03-26 22:56:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 38ee1521-30fc-5153-b980-e6c443fba2e2, identifier: 1985622
2026-03-26 22:56:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 38ee1521-30fc-5153-b980-e6c443fba2e2 with identifier: 1985622
2026-03-26 22:56:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 38ee1521-30fc-5153-b980-e6c443fba2e2 with identifier: 1985622
2026-03-26 22:56:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 38ee1521-30fc-5153-b980-e6c443fba2e2 with identifier: 1985622 to the API
2026-03-26 22:56:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:56:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:56:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bh/02a8079b1a124198aefc6a7622565fbb/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'electric',
 'id': '38ee1521-30fc-5153-b980-e6c443fba2e2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'ID4',
 'odometer': 66959,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38ee1521-30fc-5153-b980-e6c443fba2e2/38ee1521-30fc-5153-b980-e6c443fba2e2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 514968,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/02a8079b1a124198aefc6a7622565fbb/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38ee1521-30fc-5153-b980-e6c443fba2e2/38ee1521-30fc-5153-b980-e6c443fba2e2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 417680,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/02a8079b1a124198aefc6a7622565fbb/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38ee1521-30fc-5153-b980-e6c443fba2e2/38ee1521-30fc-5153-b980-e6c443fba2e2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 394691,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/02a8079b1a124198aefc6a7622565fbb/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38ee1521-30fc-5153-b980-e6c443fba2e2/38ee1521-30fc-5153-b980-e6c443fba2e2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 317902,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/02a8079b1a124198aefc6a7622565fbb/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38ee1521-30fc-5153-b980-e6c443fba2e2/38ee1521-30fc-5153-b980-e6c443fba2e2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 354596,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/02a8079b1a124198aefc6a7622565fbb/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38ee1521-30fc-5153-b980-e6c443fba2e2/38ee1521-30fc-5153-b980-e6c443fba2e2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 256025,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/02a8079b1a124198aefc6a7622565fbb/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38ee1521-30fc-5153-b980-e6c443fba2e2/38ee1521-30fc-5153-b980-e6c443fba2e2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 325396,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/02a8079b1a124198aefc6a7622565fbb/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38ee1521-30fc-5153-b980-e6c443fba2e2/38ee1521-30fc-5153-b980-e6c443fba2e2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 332975,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/02a8079b1a124198aefc6a7622565fbb/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38ee1521-30fc-5153-b980-e6c443fba2e2/38ee1521-30fc-5153-b980-e6c443fba2e2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 354311,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/02a8079b1a124198aefc6a7622565fbb/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38ee1521-30fc-5153-b980-e6c443fba2e2/38ee1521-30fc-5153-b980-e6c443fba2e2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 302435,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/02a8079b1a124198aefc6a7622565fbb/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN ID4 BEV 82KWH PRO FAMILY',
 'transmission': 'automatic',
 'trim': 'BEV 82KWH PRO FAMILY',
 'vin': None,
 'year': 2021}
2026-03-26 22:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985622%27 HTTP/1.1" 200 None
2026-03-26 22:56:42 [ayvens.be] INFO: Saving data for 1985622: {'created_time': 1774565802.458507, 'last_price_update_time': 1774565802.458517, 'auction_closing_time': 1774958400.0}
2026-03-26 22:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985622') HTTP/1.1" 204 0
2026-03-26 22:56:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/9fa3aa6eacc24ea7812ec72cc8d57198/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:42 [ayvens.be] INFO: Found listing with ID: 1985624
2026-03-26 22:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985624%27 HTTP/1.1" 200 None
2026-03-26 22:56:42 [ayvens.be] INFO: Scrape type for 1985624: 1
2026-03-26 22:56:42 [ayvens.be] INFO: Extracting data for car ID: 1985624
2026-03-26 22:56:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 61edf60d-253b-5f21-a6f3-9c22315f77a7 with identifier: 1985624
2026-03-26 22:56:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61edf60d-253b-5f21-a6f3-9c22315f77a7 with scrape type 1
2026-03-26 22:56:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 61edf60d-253b-5f21-a6f3-9c22315f77a7
2026-03-26 22:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F868dc5517c9a49629568ab7eb1d17af9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/868dc5517c9a49629568ab7eb1d17af9/images/large/1.jpg not downloaded yet
2026-03-26 22:56:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7768e90>
2026-03-26 22:56:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eff94e67-cb37-5cf5-899d-228774d52497/eff94e67-cb37-5cf5-899d-228774d52497_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F9fa3aa6eacc24ea7812ec72cc8d57198%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/9fa3aa6eacc24ea7812ec72cc8d57198/images/large/1.jpg saved to cache
2026-03-26 22:56:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item eff94e67-cb37-5cf5-899d-228774d52497
2026-03-26 22:56:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd0af950>
2026-03-26 22:56:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eff94e67-cb37-5cf5-899d-228774d52497/eff94e67-cb37-5cf5-899d-228774d52497_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F9fa3aa6eacc24ea7812ec72cc8d57198%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/9fa3aa6eacc24ea7812ec72cc8d57198/images/large/2.jpg saved to cache
2026-03-26 22:56:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item eff94e67-cb37-5cf5-899d-228774d52497
2026-03-26 22:56:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b782f210>
2026-03-26 22:56:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eff94e67-cb37-5cf5-899d-228774d52497/eff94e67-cb37-5cf5-899d-228774d52497_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F9fa3aa6eacc24ea7812ec72cc8d57198%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/9fa3aa6eacc24ea7812ec72cc8d57198/images/large/5.jpg saved to cache
2026-03-26 22:56:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item eff94e67-cb37-5cf5-899d-228774d52497
2026-03-26 22:56:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/9fa3aa6eacc24ea7812ec72cc8d57198/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/9fa3aa6eacc24ea7812ec72cc8d57198/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F868dc5517c9a49629568ab7eb1d17af9%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/868dc5517c9a49629568ab7eb1d17af9/images/large/2.jpg not downloaded yet
2026-03-26 22:56:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b72ec7d0>
2026-03-26 22:56:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eff94e67-cb37-5cf5-899d-228774d52497/eff94e67-cb37-5cf5-899d-228774d52497_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F9fa3aa6eacc24ea7812ec72cc8d57198%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/9fa3aa6eacc24ea7812ec72cc8d57198/images/large/3.jpg saved to cache
2026-03-26 22:56:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item eff94e67-cb37-5cf5-899d-228774d52497
2026-03-26 22:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F868dc5517c9a49629568ab7eb1d17af9%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/868dc5517c9a49629568ab7eb1d17af9/images/large/3.jpg not downloaded yet
2026-03-26 22:56:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/9fa3aa6eacc24ea7812ec72cc8d57198/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/9fa3aa6eacc24ea7812ec72cc8d57198/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F868dc5517c9a49629568ab7eb1d17af9%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/868dc5517c9a49629568ab7eb1d17af9/images/large/4.jpg not downloaded yet
2026-03-26 22:56:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/9fa3aa6eacc24ea7812ec72cc8d57198/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e37b10>
2026-03-26 22:56:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eff94e67-cb37-5cf5-899d-228774d52497/eff94e67-cb37-5cf5-899d-228774d52497_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F9fa3aa6eacc24ea7812ec72cc8d57198%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/9fa3aa6eacc24ea7812ec72cc8d57198/images/large/4.jpg saved to cache
2026-03-26 22:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item eff94e67-cb37-5cf5-899d-228774d52497
2026-03-26 22:56:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd0cf310>
2026-03-26 22:56:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eff94e67-cb37-5cf5-899d-228774d52497/eff94e67-cb37-5cf5-899d-228774d52497_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F9fa3aa6eacc24ea7812ec72cc8d57198%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/9fa3aa6eacc24ea7812ec72cc8d57198/images/large/6.jpg saved to cache
2026-03-26 22:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item eff94e67-cb37-5cf5-899d-228774d52497
2026-03-26 22:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F868dc5517c9a49629568ab7eb1d17af9%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/868dc5517c9a49629568ab7eb1d17af9/images/large/5.jpg not downloaded yet
2026-03-26 22:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F868dc5517c9a49629568ab7eb1d17af9%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/868dc5517c9a49629568ab7eb1d17af9/images/large/6.jpg not downloaded yet
2026-03-26 22:56:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cbe650>
2026-03-26 22:56:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eff94e67-cb37-5cf5-899d-228774d52497/eff94e67-cb37-5cf5-899d-228774d52497_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F9fa3aa6eacc24ea7812ec72cc8d57198%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/9fa3aa6eacc24ea7812ec72cc8d57198/images/large/7.jpg saved to cache
2026-03-26 22:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item eff94e67-cb37-5cf5-899d-228774d52497
2026-03-26 22:56:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74134d0>
2026-03-26 22:56:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eff94e67-cb37-5cf5-899d-228774d52497/eff94e67-cb37-5cf5-899d-228774d52497_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F9fa3aa6eacc24ea7812ec72cc8d57198%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/9fa3aa6eacc24ea7812ec72cc8d57198/images/large/8.jpg saved to cache
2026-03-26 22:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item eff94e67-cb37-5cf5-899d-228774d52497
2026-03-26 22:56:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b9a7d0>
2026-03-26 22:56:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eff94e67-cb37-5cf5-899d-228774d52497/eff94e67-cb37-5cf5-899d-228774d52497_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F9fa3aa6eacc24ea7812ec72cc8d57198%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/9fa3aa6eacc24ea7812ec72cc8d57198/images/large/9.jpg saved to cache
2026-03-26 22:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item eff94e67-cb37-5cf5-899d-228774d52497
2026-03-26 22:56:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/9fa3aa6eacc24ea7812ec72cc8d57198/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F868dc5517c9a49629568ab7eb1d17af9%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/868dc5517c9a49629568ab7eb1d17af9/images/large/7.jpg not downloaded yet
2026-03-26 22:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F868dc5517c9a49629568ab7eb1d17af9%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/868dc5517c9a49629568ab7eb1d17af9/images/large/8.jpg not downloaded yet
2026-03-26 22:56:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/868dc5517c9a49629568ab7eb1d17af9/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F868dc5517c9a49629568ab7eb1d17af9%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/868dc5517c9a49629568ab7eb1d17af9/images/large/9.jpg not downloaded yet
2026-03-26 22:56:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/868dc5517c9a49629568ab7eb1d17af9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F868dc5517c9a49629568ab7eb1d17af9%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/868dc5517c9a49629568ab7eb1d17af9/images/large/10.jpg not downloaded yet
2026-03-26 22:56:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/868dc5517c9a49629568ab7eb1d17af9/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/868dc5517c9a49629568ab7eb1d17af9/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:43 [ayvens.be] INFO: Found listing with ID: 1985625
2026-03-26 22:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985625%27 HTTP/1.1" 200 None
2026-03-26 22:56:43 [ayvens.be] INFO: Scrape type for 1985625: 1
2026-03-26 22:56:43 [ayvens.be] INFO: Extracting data for car ID: 1985625
2026-03-26 22:56:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7fddb233-cec4-5a57-8cac-332c509be68e with identifier: 1985625
2026-03-26 22:56:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7fddb233-cec4-5a57-8cac-332c509be68e with scrape type 1
2026-03-26 22:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7fddb233-cec4-5a57-8cac-332c509be68e
2026-03-26 22:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F83ad792b17da4a34ac2eb854442c7c1e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/83ad792b17da4a34ac2eb854442c7c1e/images/large/1.jpg not downloaded yet
2026-03-26 22:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F83ad792b17da4a34ac2eb854442c7c1e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/83ad792b17da4a34ac2eb854442c7c1e/images/large/2.jpg not downloaded yet
2026-03-26 22:56:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7405e10>
2026-03-26 22:56:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eff94e67-cb37-5cf5-899d-228774d52497/eff94e67-cb37-5cf5-899d-228774d52497_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F9fa3aa6eacc24ea7812ec72cc8d57198%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/9fa3aa6eacc24ea7812ec72cc8d57198/images/large/10.jpg saved to cache
2026-03-26 22:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item eff94e67-cb37-5cf5-899d-228774d52497
2026-03-26 22:56:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: eff94e67-cb37-5cf5-899d-228774d52497, skipping ID generation
2026-03-26 22:56:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eff94e67-cb37-5cf5-899d-228774d52497 with scrape type 1
2026-03-26 22:56:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item eff94e67-cb37-5cf5-899d-228774d52497 sending to next pipeline
2026-03-26 22:56:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: eff94e67-cb37-5cf5-899d-228774d52497, identifier: 1985623
2026-03-26 22:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F83ad792b17da4a34ac2eb854442c7c1e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/83ad792b17da4a34ac2eb854442c7c1e/images/large/3.jpg not downloaded yet
2026-03-26 22:56:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: eff94e67-cb37-5cf5-899d-228774d52497 with identifier: 1985623
2026-03-26 22:56:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: eff94e67-cb37-5cf5-899d-228774d52497 with identifier: 1985623
2026-03-26 22:56:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: eff94e67-cb37-5cf5-899d-228774d52497 with identifier: 1985623 to the API
2026-03-26 22:56:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:56:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:56:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bj/9fa3aa6eacc24ea7812ec72cc8d57198/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.9L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'eff94e67-cb37-5cf5-899d-228774d52497',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A-CLASS LIMOUSINE',
 'odometer': 71331,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eff94e67-cb37-5cf5-899d-228774d52497/eff94e67-cb37-5cf5-899d-228774d52497_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 541986,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/9fa3aa6eacc24ea7812ec72cc8d57198/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eff94e67-cb37-5cf5-899d-228774d52497/eff94e67-cb37-5cf5-899d-228774d52497_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 543731,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/9fa3aa6eacc24ea7812ec72cc8d57198/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eff94e67-cb37-5cf5-899d-228774d52497/eff94e67-cb37-5cf5-899d-228774d52497_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 515100,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/9fa3aa6eacc24ea7812ec72cc8d57198/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eff94e67-cb37-5cf5-899d-228774d52497/eff94e67-cb37-5cf5-899d-228774d52497_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 601313,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/9fa3aa6eacc24ea7812ec72cc8d57198/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eff94e67-cb37-5cf5-899d-228774d52497/eff94e67-cb37-5cf5-899d-228774d52497_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 282278,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/9fa3aa6eacc24ea7812ec72cc8d57198/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eff94e67-cb37-5cf5-899d-228774d52497/eff94e67-cb37-5cf5-899d-228774d52497_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 359179,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/9fa3aa6eacc24ea7812ec72cc8d57198/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eff94e67-cb37-5cf5-899d-228774d52497/eff94e67-cb37-5cf5-899d-228774d52497_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 369390,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/9fa3aa6eacc24ea7812ec72cc8d57198/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eff94e67-cb37-5cf5-899d-228774d52497/eff94e67-cb37-5cf5-899d-228774d52497_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 454626,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/9fa3aa6eacc24ea7812ec72cc8d57198/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eff94e67-cb37-5cf5-899d-228774d52497/eff94e67-cb37-5cf5-899d-228774d52497_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 383159,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/9fa3aa6eacc24ea7812ec72cc8d57198/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eff94e67-cb37-5cf5-899d-228774d52497/eff94e67-cb37-5cf5-899d-228774d52497_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 334537,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/9fa3aa6eacc24ea7812ec72cc8d57198/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ A-CLASS LIMOUSINE 2.0 A 180 D BUSINESS SOLUTION '
          'ESSENTIAL',
 'transmission': 'manual',
 'trim': '2.0 A 180 D BUSINESS SOLUTION ESSENTIAL',
 'vin': None,
 'year': 2021}
2026-03-26 22:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985623%27 HTTP/1.1" 200 None
2026-03-26 22:56:44 [ayvens.be] INFO: Saving data for 1985623: {'created_time': 1774565804.152952, 'last_price_update_time': 1774565804.152962, 'auction_closing_time': 1774958400.0}
2026-03-26 22:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985623') HTTP/1.1" 204 0
2026-03-26 22:56:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/868dc5517c9a49629568ab7eb1d17af9/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F83ad792b17da4a34ac2eb854442c7c1e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/83ad792b17da4a34ac2eb854442c7c1e/images/large/4.jpg not downloaded yet
2026-03-26 22:56:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7428410>
2026-03-26 22:56:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61edf60d-253b-5f21-a6f3-9c22315f77a7/61edf60d-253b-5f21-a6f3-9c22315f77a7_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F868dc5517c9a49629568ab7eb1d17af9%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/868dc5517c9a49629568ab7eb1d17af9/images/large/2.jpg saved to cache
2026-03-26 22:56:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 61edf60d-253b-5f21-a6f3-9c22315f77a7
2026-03-26 22:56:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7768690>
2026-03-26 22:56:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61edf60d-253b-5f21-a6f3-9c22315f77a7/61edf60d-253b-5f21-a6f3-9c22315f77a7_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F868dc5517c9a49629568ab7eb1d17af9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/868dc5517c9a49629568ab7eb1d17af9/images/large/1.jpg saved to cache
2026-03-26 22:56:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 61edf60d-253b-5f21-a6f3-9c22315f77a7
2026-03-26 22:56:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7874e90>
2026-03-26 22:56:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61edf60d-253b-5f21-a6f3-9c22315f77a7/61edf60d-253b-5f21-a6f3-9c22315f77a7_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F868dc5517c9a49629568ab7eb1d17af9%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/868dc5517c9a49629568ab7eb1d17af9/images/large/4.jpg saved to cache
2026-03-26 22:56:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 61edf60d-253b-5f21-a6f3-9c22315f77a7
2026-03-26 22:56:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7779550>
2026-03-26 22:56:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61edf60d-253b-5f21-a6f3-9c22315f77a7/61edf60d-253b-5f21-a6f3-9c22315f77a7_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F868dc5517c9a49629568ab7eb1d17af9%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/868dc5517c9a49629568ab7eb1d17af9/images/large/3.jpg saved to cache
2026-03-26 22:56:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 61edf60d-253b-5f21-a6f3-9c22315f77a7
2026-03-26 22:56:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/868dc5517c9a49629568ab7eb1d17af9/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/868dc5517c9a49629568ab7eb1d17af9/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/868dc5517c9a49629568ab7eb1d17af9/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F83ad792b17da4a34ac2eb854442c7c1e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/83ad792b17da4a34ac2eb854442c7c1e/images/large/5.jpg not downloaded yet
2026-03-26 22:56:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/868dc5517c9a49629568ab7eb1d17af9/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/868dc5517c9a49629568ab7eb1d17af9/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F83ad792b17da4a34ac2eb854442c7c1e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/83ad792b17da4a34ac2eb854442c7c1e/images/large/6.jpg not downloaded yet
2026-03-26 22:56:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7779c10>
2026-03-26 22:56:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61edf60d-253b-5f21-a6f3-9c22315f77a7/61edf60d-253b-5f21-a6f3-9c22315f77a7_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F868dc5517c9a49629568ab7eb1d17af9%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/868dc5517c9a49629568ab7eb1d17af9/images/large/6.jpg saved to cache
2026-03-26 22:56:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 61edf60d-253b-5f21-a6f3-9c22315f77a7
2026-03-26 22:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F83ad792b17da4a34ac2eb854442c7c1e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/83ad792b17da4a34ac2eb854442c7c1e/images/large/7.jpg not downloaded yet
2026-03-26 22:56:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/83ad792b17da4a34ac2eb854442c7c1e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F83ad792b17da4a34ac2eb854442c7c1e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/83ad792b17da4a34ac2eb854442c7c1e/images/large/8.jpg not downloaded yet
2026-03-26 22:56:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7649650>
2026-03-26 22:56:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61edf60d-253b-5f21-a6f3-9c22315f77a7/61edf60d-253b-5f21-a6f3-9c22315f77a7_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F868dc5517c9a49629568ab7eb1d17af9%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/868dc5517c9a49629568ab7eb1d17af9/images/large/7.jpg saved to cache
2026-03-26 22:56:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 61edf60d-253b-5f21-a6f3-9c22315f77a7
2026-03-26 22:56:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e29c50>
2026-03-26 22:56:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61edf60d-253b-5f21-a6f3-9c22315f77a7/61edf60d-253b-5f21-a6f3-9c22315f77a7_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F868dc5517c9a49629568ab7eb1d17af9%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/868dc5517c9a49629568ab7eb1d17af9/images/large/8.jpg saved to cache
2026-03-26 22:56:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 61edf60d-253b-5f21-a6f3-9c22315f77a7
2026-03-26 22:56:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7ca9690>
2026-03-26 22:56:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61edf60d-253b-5f21-a6f3-9c22315f77a7/61edf60d-253b-5f21-a6f3-9c22315f77a7_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F868dc5517c9a49629568ab7eb1d17af9%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/868dc5517c9a49629568ab7eb1d17af9/images/large/9.jpg saved to cache
2026-03-26 22:56:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 61edf60d-253b-5f21-a6f3-9c22315f77a7
2026-03-26 22:56:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b745b3d0>
2026-03-26 22:56:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61edf60d-253b-5f21-a6f3-9c22315f77a7/61edf60d-253b-5f21-a6f3-9c22315f77a7_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F868dc5517c9a49629568ab7eb1d17af9%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/868dc5517c9a49629568ab7eb1d17af9/images/large/10.jpg saved to cache
2026-03-26 22:56:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 61edf60d-253b-5f21-a6f3-9c22315f77a7
2026-03-26 22:56:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b75727d0>
2026-03-26 22:56:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61edf60d-253b-5f21-a6f3-9c22315f77a7/61edf60d-253b-5f21-a6f3-9c22315f77a7_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F868dc5517c9a49629568ab7eb1d17af9%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/868dc5517c9a49629568ab7eb1d17af9/images/large/5.jpg saved to cache
2026-03-26 22:56:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 61edf60d-253b-5f21-a6f3-9c22315f77a7
2026-03-26 22:56:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 61edf60d-253b-5f21-a6f3-9c22315f77a7, skipping ID generation
2026-03-26 22:56:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61edf60d-253b-5f21-a6f3-9c22315f77a7 with scrape type 1
2026-03-26 22:56:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 61edf60d-253b-5f21-a6f3-9c22315f77a7 sending to next pipeline
2026-03-26 22:56:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 61edf60d-253b-5f21-a6f3-9c22315f77a7, identifier: 1985624
2026-03-26 22:56:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 61edf60d-253b-5f21-a6f3-9c22315f77a7 with identifier: 1985624
2026-03-26 22:56:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 61edf60d-253b-5f21-a6f3-9c22315f77a7 with identifier: 1985624
2026-03-26 22:56:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 61edf60d-253b-5f21-a6f3-9c22315f77a7 with identifier: 1985624 to the API
2026-03-26 22:56:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:56:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:56:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bj/868dc5517c9a49629568ab7eb1d17af9/images/large/5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '61edf60d-253b-5f21-a6f3-9c22315f77a7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'V60',
 'odometer': 88971,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61edf60d-253b-5f21-a6f3-9c22315f77a7/61edf60d-253b-5f21-a6f3-9c22315f77a7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 509621,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/868dc5517c9a49629568ab7eb1d17af9/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61edf60d-253b-5f21-a6f3-9c22315f77a7/61edf60d-253b-5f21-a6f3-9c22315f77a7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 497960,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/868dc5517c9a49629568ab7eb1d17af9/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61edf60d-253b-5f21-a6f3-9c22315f77a7/61edf60d-253b-5f21-a6f3-9c22315f77a7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 460621,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/868dc5517c9a49629568ab7eb1d17af9/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61edf60d-253b-5f21-a6f3-9c22315f77a7/61edf60d-253b-5f21-a6f3-9c22315f77a7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 490606,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/868dc5517c9a49629568ab7eb1d17af9/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61edf60d-253b-5f21-a6f3-9c22315f77a7/61edf60d-253b-5f21-a6f3-9c22315f77a7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 330759,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/868dc5517c9a49629568ab7eb1d17af9/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61edf60d-253b-5f21-a6f3-9c22315f77a7/61edf60d-253b-5f21-a6f3-9c22315f77a7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 281197,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/868dc5517c9a49629568ab7eb1d17af9/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61edf60d-253b-5f21-a6f3-9c22315f77a7/61edf60d-253b-5f21-a6f3-9c22315f77a7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 409710,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/868dc5517c9a49629568ab7eb1d17af9/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61edf60d-253b-5f21-a6f3-9c22315f77a7/61edf60d-253b-5f21-a6f3-9c22315f77a7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 331847,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/868dc5517c9a49629568ab7eb1d17af9/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61edf60d-253b-5f21-a6f3-9c22315f77a7/61edf60d-253b-5f21-a6f3-9c22315f77a7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 311087,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/868dc5517c9a49629568ab7eb1d17af9/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61edf60d-253b-5f21-a6f3-9c22315f77a7/61edf60d-253b-5f21-a6f3-9c22315f77a7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 311651,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/868dc5517c9a49629568ab7eb1d17af9/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO V60 2.0 T6 RECHARGE GEARTR INSCRIPTION EXPR',
 'transmission': 'automatic',
 'trim': '2.0 T6 RECHARGE GEARTR INSCRIPTION EXPR',
 'vin': None,
 'year': 2021}
2026-03-26 22:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985624%27 HTTP/1.1" 200 None
2026-03-26 22:56:45 [ayvens.be] INFO: Saving data for 1985624: {'created_time': 1774565805.598567, 'last_price_update_time': 1774565805.598579, 'auction_closing_time': 1774958400.0}
2026-03-26 22:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985624') HTTP/1.1" 204 0
2026-03-26 22:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F83ad792b17da4a34ac2eb854442c7c1e%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/83ad792b17da4a34ac2eb854442c7c1e/images/large/9.jpg not downloaded yet
2026-03-26 22:56:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/83ad792b17da4a34ac2eb854442c7c1e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e284d0>
2026-03-26 22:56:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fddb233-cec4-5a57-8cac-332c509be68e/7fddb233-cec4-5a57-8cac-332c509be68e_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F83ad792b17da4a34ac2eb854442c7c1e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/83ad792b17da4a34ac2eb854442c7c1e/images/large/1.jpg saved to cache
2026-03-26 22:56:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7fddb233-cec4-5a57-8cac-332c509be68e
2026-03-26 22:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F83ad792b17da4a34ac2eb854442c7c1e%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/83ad792b17da4a34ac2eb854442c7c1e/images/large/10.jpg not downloaded yet
2026-03-26 22:56:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/83ad792b17da4a34ac2eb854442c7c1e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/83ad792b17da4a34ac2eb854442c7c1e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/83ad792b17da4a34ac2eb854442c7c1e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:45 [ayvens.be] INFO: Found listing with ID: 1985626
2026-03-26 22:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985626%27 HTTP/1.1" 200 None
2026-03-26 22:56:45 [ayvens.be] INFO: Scrape type for 1985626: 1
2026-03-26 22:56:45 [ayvens.be] INFO: Extracting data for car ID: 1985626
2026-03-26 22:56:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 66e1293d-9f61-520b-b07a-18f721a8f455 with identifier: 1985626
2026-03-26 22:56:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66e1293d-9f61-520b-b07a-18f721a8f455 with scrape type 1
2026-03-26 22:56:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 66e1293d-9f61-520b-b07a-18f721a8f455
2026-03-26 22:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252Fad2f87b7a5d14c0eb344cf4c9916c6ed%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/ad2f87b7a5d14c0eb344cf4c9916c6ed/images/large/1.jpg not downloaded yet
2026-03-26 22:56:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/83ad792b17da4a34ac2eb854442c7c1e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252Fad2f87b7a5d14c0eb344cf4c9916c6ed%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/ad2f87b7a5d14c0eb344cf4c9916c6ed/images/large/2.jpg not downloaded yet
2026-03-26 22:56:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7ae9ed0>
2026-03-26 22:56:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fddb233-cec4-5a57-8cac-332c509be68e/7fddb233-cec4-5a57-8cac-332c509be68e_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F83ad792b17da4a34ac2eb854442c7c1e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/83ad792b17da4a34ac2eb854442c7c1e/images/large/2.jpg saved to cache
2026-03-26 22:56:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7fddb233-cec4-5a57-8cac-332c509be68e
2026-03-26 22:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252Fad2f87b7a5d14c0eb344cf4c9916c6ed%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/ad2f87b7a5d14c0eb344cf4c9916c6ed/images/large/3.jpg not downloaded yet
2026-03-26 22:56:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/83ad792b17da4a34ac2eb854442c7c1e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252Fad2f87b7a5d14c0eb344cf4c9916c6ed%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/ad2f87b7a5d14c0eb344cf4c9916c6ed/images/large/4.jpg not downloaded yet
2026-03-26 22:56:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c7dc90>
2026-03-26 22:56:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fddb233-cec4-5a57-8cac-332c509be68e/7fddb233-cec4-5a57-8cac-332c509be68e_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F83ad792b17da4a34ac2eb854442c7c1e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/83ad792b17da4a34ac2eb854442c7c1e/images/large/4.jpg saved to cache
2026-03-26 22:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7fddb233-cec4-5a57-8cac-332c509be68e
2026-03-26 22:56:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b75918d0>
2026-03-26 22:56:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fddb233-cec4-5a57-8cac-332c509be68e/7fddb233-cec4-5a57-8cac-332c509be68e_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F83ad792b17da4a34ac2eb854442c7c1e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/83ad792b17da4a34ac2eb854442c7c1e/images/large/3.jpg saved to cache
2026-03-26 22:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7fddb233-cec4-5a57-8cac-332c509be68e
2026-03-26 22:56:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7662e90>
2026-03-26 22:56:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fddb233-cec4-5a57-8cac-332c509be68e/7fddb233-cec4-5a57-8cac-332c509be68e_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F83ad792b17da4a34ac2eb854442c7c1e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/83ad792b17da4a34ac2eb854442c7c1e/images/large/5.jpg saved to cache
2026-03-26 22:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7fddb233-cec4-5a57-8cac-332c509be68e
2026-03-26 22:56:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7778750>
2026-03-26 22:56:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fddb233-cec4-5a57-8cac-332c509be68e/7fddb233-cec4-5a57-8cac-332c509be68e_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F83ad792b17da4a34ac2eb854442c7c1e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/83ad792b17da4a34ac2eb854442c7c1e/images/large/6.jpg saved to cache
2026-03-26 22:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7fddb233-cec4-5a57-8cac-332c509be68e
2026-03-26 22:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252Fad2f87b7a5d14c0eb344cf4c9916c6ed%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/ad2f87b7a5d14c0eb344cf4c9916c6ed/images/large/5.jpg not downloaded yet
2026-03-26 22:56:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/83ad792b17da4a34ac2eb854442c7c1e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252Fad2f87b7a5d14c0eb344cf4c9916c6ed%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/ad2f87b7a5d14c0eb344cf4c9916c6ed/images/large/6.jpg not downloaded yet
2026-03-26 22:56:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/83ad792b17da4a34ac2eb854442c7c1e/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6df3f90>
2026-03-26 22:56:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fddb233-cec4-5a57-8cac-332c509be68e/7fddb233-cec4-5a57-8cac-332c509be68e_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F83ad792b17da4a34ac2eb854442c7c1e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/83ad792b17da4a34ac2eb854442c7c1e/images/large/7.jpg saved to cache
2026-03-26 22:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7fddb233-cec4-5a57-8cac-332c509be68e
2026-03-26 22:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252Fad2f87b7a5d14c0eb344cf4c9916c6ed%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/ad2f87b7a5d14c0eb344cf4c9916c6ed/images/large/7.jpg not downloaded yet
2026-03-26 22:56:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/83ad792b17da4a34ac2eb854442c7c1e/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252Fad2f87b7a5d14c0eb344cf4c9916c6ed%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/ad2f87b7a5d14c0eb344cf4c9916c6ed/images/large/8.jpg not downloaded yet
2026-03-26 22:56:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c6ad10>
2026-03-26 22:56:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fddb233-cec4-5a57-8cac-332c509be68e/7fddb233-cec4-5a57-8cac-332c509be68e_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F83ad792b17da4a34ac2eb854442c7c1e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/83ad792b17da4a34ac2eb854442c7c1e/images/large/8.jpg saved to cache
2026-03-26 22:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7fddb233-cec4-5a57-8cac-332c509be68e
2026-03-26 22:56:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ym/ad2f87b7a5d14c0eb344cf4c9916c6ed/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252Fad2f87b7a5d14c0eb344cf4c9916c6ed%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/ad2f87b7a5d14c0eb344cf4c9916c6ed/images/large/9.jpg not downloaded yet
2026-03-26 22:56:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ym/ad2f87b7a5d14c0eb344cf4c9916c6ed/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd12c310>
2026-03-26 22:56:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fddb233-cec4-5a57-8cac-332c509be68e/7fddb233-cec4-5a57-8cac-332c509be68e_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F83ad792b17da4a34ac2eb854442c7c1e%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/83ad792b17da4a34ac2eb854442c7c1e/images/large/10.jpg saved to cache
2026-03-26 22:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7fddb233-cec4-5a57-8cac-332c509be68e
2026-03-26 22:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252Fad2f87b7a5d14c0eb344cf4c9916c6ed%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/ad2f87b7a5d14c0eb344cf4c9916c6ed/images/large/10.jpg not downloaded yet
2026-03-26 22:56:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b9a690>
2026-03-26 22:56:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fddb233-cec4-5a57-8cac-332c509be68e/7fddb233-cec4-5a57-8cac-332c509be68e_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F83ad792b17da4a34ac2eb854442c7c1e%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/83ad792b17da4a34ac2eb854442c7c1e/images/large/9.jpg saved to cache
2026-03-26 22:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7fddb233-cec4-5a57-8cac-332c509be68e
2026-03-26 22:56:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7fddb233-cec4-5a57-8cac-332c509be68e, skipping ID generation
2026-03-26 22:56:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7fddb233-cec4-5a57-8cac-332c509be68e with scrape type 1
2026-03-26 22:56:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7fddb233-cec4-5a57-8cac-332c509be68e sending to next pipeline
2026-03-26 22:56:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 7fddb233-cec4-5a57-8cac-332c509be68e, identifier: 1985625
2026-03-26 22:56:46 [ayvens.be] INFO: Found listing with ID: 1985627
2026-03-26 22:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985627%27 HTTP/1.1" 200 None
2026-03-26 22:56:46 [ayvens.be] INFO: Scrape type for 1985627: 1
2026-03-26 22:56:46 [ayvens.be] INFO: Extracting data for car ID: 1985627
2026-03-26 22:56:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ed77adca-f00b-5d88-b37c-f5b42649bc36 with identifier: 1985627
2026-03-26 22:56:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed77adca-f00b-5d88-b37c-f5b42649bc36 with scrape type 1
2026-03-26 22:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ed77adca-f00b-5d88-b37c-f5b42649bc36
2026-03-26 22:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Feb0883e9141141059271d6a94576b1c3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/eb0883e9141141059271d6a94576b1c3/images/large/1.jpg not downloaded yet
2026-03-26 22:56:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 7fddb233-cec4-5a57-8cac-332c509be68e with identifier: 1985625
2026-03-26 22:56:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 7fddb233-cec4-5a57-8cac-332c509be68e with identifier: 1985625
2026-03-26 22:56:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 7fddb233-cec4-5a57-8cac-332c509be68e with identifier: 1985625 to the API
2026-03-26 22:56:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:56:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:56:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bj/83ad792b17da4a34ac2eb854442c7c1e/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '7fddb233-cec4-5a57-8cac-332c509be68e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 78626,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fddb233-cec4-5a57-8cac-332c509be68e/7fddb233-cec4-5a57-8cac-332c509be68e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 548808,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/83ad792b17da4a34ac2eb854442c7c1e/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fddb233-cec4-5a57-8cac-332c509be68e/7fddb233-cec4-5a57-8cac-332c509be68e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 563916,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/83ad792b17da4a34ac2eb854442c7c1e/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fddb233-cec4-5a57-8cac-332c509be68e/7fddb233-cec4-5a57-8cac-332c509be68e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 337223,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/83ad792b17da4a34ac2eb854442c7c1e/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fddb233-cec4-5a57-8cac-332c509be68e/7fddb233-cec4-5a57-8cac-332c509be68e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 505535,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/83ad792b17da4a34ac2eb854442c7c1e/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fddb233-cec4-5a57-8cac-332c509be68e/7fddb233-cec4-5a57-8cac-332c509be68e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 324012,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/83ad792b17da4a34ac2eb854442c7c1e/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fddb233-cec4-5a57-8cac-332c509be68e/7fddb233-cec4-5a57-8cac-332c509be68e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 329663,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/83ad792b17da4a34ac2eb854442c7c1e/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fddb233-cec4-5a57-8cac-332c509be68e/7fddb233-cec4-5a57-8cac-332c509be68e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 370696,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/83ad792b17da4a34ac2eb854442c7c1e/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fddb233-cec4-5a57-8cac-332c509be68e/7fddb233-cec4-5a57-8cac-332c509be68e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 342401,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/83ad792b17da4a34ac2eb854442c7c1e/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fddb233-cec4-5a57-8cac-332c509be68e/7fddb233-cec4-5a57-8cac-332c509be68e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 376559,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/83ad792b17da4a34ac2eb854442c7c1e/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fddb233-cec4-5a57-8cac-332c509be68e/7fddb233-cec4-5a57-8cac-332c509be68e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 343674,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/83ad792b17da4a34ac2eb854442c7c1e/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T4 RECHARGE GEARTR. INSCRIPTION EXPR',
 'transmission': 'automatic',
 'trim': '1.5 T4 RECHARGE GEARTR. INSCRIPTION EXPR',
 'vin': None,
 'year': 2021}
2026-03-26 22:56:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985625%27 HTTP/1.1" 200 None
2026-03-26 22:56:47 [ayvens.be] INFO: Saving data for 1985625: {'created_time': 1774565807.194805, 'last_price_update_time': 1774565807.194816, 'auction_closing_time': 1774958400.0}
2026-03-26 22:56:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985625') HTTP/1.1" 204 0
2026-03-26 22:56:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ym/ad2f87b7a5d14c0eb344cf4c9916c6ed/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ym/ad2f87b7a5d14c0eb344cf4c9916c6ed/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c94f90>
2026-03-26 22:56:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66e1293d-9f61-520b-b07a-18f721a8f455/66e1293d-9f61-520b-b07a-18f721a8f455_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:56:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252Fad2f87b7a5d14c0eb344cf4c9916c6ed%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/ad2f87b7a5d14c0eb344cf4c9916c6ed/images/large/1.jpg saved to cache
2026-03-26 22:56:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 66e1293d-9f61-520b-b07a-18f721a8f455
2026-03-26 22:56:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ym/ad2f87b7a5d14c0eb344cf4c9916c6ed/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Feb0883e9141141059271d6a94576b1c3%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/eb0883e9141141059271d6a94576b1c3/images/large/2.jpg not downloaded yet
2026-03-26 22:56:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e29250>
2026-03-26 22:56:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66e1293d-9f61-520b-b07a-18f721a8f455/66e1293d-9f61-520b-b07a-18f721a8f455_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:56:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252Fad2f87b7a5d14c0eb344cf4c9916c6ed%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/ad2f87b7a5d14c0eb344cf4c9916c6ed/images/large/2.jpg saved to cache
2026-03-26 22:56:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 66e1293d-9f61-520b-b07a-18f721a8f455
2026-03-26 22:56:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Feb0883e9141141059271d6a94576b1c3%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/eb0883e9141141059271d6a94576b1c3/images/large/3.jpg not downloaded yet
2026-03-26 22:56:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ym/ad2f87b7a5d14c0eb344cf4c9916c6ed/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ym/ad2f87b7a5d14c0eb344cf4c9916c6ed/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7876990>
2026-03-26 22:56:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66e1293d-9f61-520b-b07a-18f721a8f455/66e1293d-9f61-520b-b07a-18f721a8f455_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:56:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252Fad2f87b7a5d14c0eb344cf4c9916c6ed%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/ad2f87b7a5d14c0eb344cf4c9916c6ed/images/large/3.jpg saved to cache
2026-03-26 22:56:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 66e1293d-9f61-520b-b07a-18f721a8f455
2026-03-26 22:56:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7500910>
2026-03-26 22:56:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66e1293d-9f61-520b-b07a-18f721a8f455/66e1293d-9f61-520b-b07a-18f721a8f455_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:56:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252Fad2f87b7a5d14c0eb344cf4c9916c6ed%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/ad2f87b7a5d14c0eb344cf4c9916c6ed/images/large/5.jpg saved to cache
2026-03-26 22:56:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 66e1293d-9f61-520b-b07a-18f721a8f455
2026-03-26 22:56:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Feb0883e9141141059271d6a94576b1c3%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/eb0883e9141141059271d6a94576b1c3/images/large/4.jpg not downloaded yet
2026-03-26 22:56:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ym/ad2f87b7a5d14c0eb344cf4c9916c6ed/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ym/ad2f87b7a5d14c0eb344cf4c9916c6ed/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7944f10>
2026-03-26 22:56:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66e1293d-9f61-520b-b07a-18f721a8f455/66e1293d-9f61-520b-b07a-18f721a8f455_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:56:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252Fad2f87b7a5d14c0eb344cf4c9916c6ed%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/ad2f87b7a5d14c0eb344cf4c9916c6ed/images/large/6.jpg saved to cache
2026-03-26 22:56:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 66e1293d-9f61-520b-b07a-18f721a8f455
2026-03-26 22:56:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Feb0883e9141141059271d6a94576b1c3%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/eb0883e9141141059271d6a94576b1c3/images/large/5.jpg not downloaded yet
2026-03-26 22:56:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ym/ad2f87b7a5d14c0eb344cf4c9916c6ed/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79dfa50>
2026-03-26 22:56:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66e1293d-9f61-520b-b07a-18f721a8f455/66e1293d-9f61-520b-b07a-18f721a8f455_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:56:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252Fad2f87b7a5d14c0eb344cf4c9916c6ed%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/ad2f87b7a5d14c0eb344cf4c9916c6ed/images/large/4.jpg saved to cache
2026-03-26 22:56:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 66e1293d-9f61-520b-b07a-18f721a8f455
2026-03-26 22:56:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b741e0d0>
2026-03-26 22:56:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66e1293d-9f61-520b-b07a-18f721a8f455/66e1293d-9f61-520b-b07a-18f721a8f455_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:56:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252Fad2f87b7a5d14c0eb344cf4c9916c6ed%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/ad2f87b7a5d14c0eb344cf4c9916c6ed/images/large/7.jpg saved to cache
2026-03-26 22:56:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 66e1293d-9f61-520b-b07a-18f721a8f455
2026-03-26 22:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Feb0883e9141141059271d6a94576b1c3%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/eb0883e9141141059271d6a94576b1c3/images/large/6.jpg not downloaded yet
2026-03-26 22:56:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/eb0883e9141141059271d6a94576b1c3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Feb0883e9141141059271d6a94576b1c3%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/eb0883e9141141059271d6a94576b1c3/images/large/7.jpg not downloaded yet
2026-03-26 22:56:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c96890>
2026-03-26 22:56:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66e1293d-9f61-520b-b07a-18f721a8f455/66e1293d-9f61-520b-b07a-18f721a8f455_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252Fad2f87b7a5d14c0eb344cf4c9916c6ed%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/ad2f87b7a5d14c0eb344cf4c9916c6ed/images/large/8.jpg saved to cache
2026-03-26 22:56:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 66e1293d-9f61-520b-b07a-18f721a8f455
2026-03-26 22:56:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7875d10>
2026-03-26 22:56:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66e1293d-9f61-520b-b07a-18f721a8f455/66e1293d-9f61-520b-b07a-18f721a8f455_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252Fad2f87b7a5d14c0eb344cf4c9916c6ed%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/ad2f87b7a5d14c0eb344cf4c9916c6ed/images/large/9.jpg saved to cache
2026-03-26 22:56:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 66e1293d-9f61-520b-b07a-18f721a8f455
2026-03-26 22:56:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c7db10>
2026-03-26 22:56:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66e1293d-9f61-520b-b07a-18f721a8f455/66e1293d-9f61-520b-b07a-18f721a8f455_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252Fad2f87b7a5d14c0eb344cf4c9916c6ed%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/ad2f87b7a5d14c0eb344cf4c9916c6ed/images/large/10.jpg saved to cache
2026-03-26 22:56:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 66e1293d-9f61-520b-b07a-18f721a8f455
2026-03-26 22:56:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 66e1293d-9f61-520b-b07a-18f721a8f455, skipping ID generation
2026-03-26 22:56:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66e1293d-9f61-520b-b07a-18f721a8f455 with scrape type 1
2026-03-26 22:56:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 66e1293d-9f61-520b-b07a-18f721a8f455 sending to next pipeline
2026-03-26 22:56:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 66e1293d-9f61-520b-b07a-18f721a8f455, identifier: 1985626
2026-03-26 22:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Feb0883e9141141059271d6a94576b1c3%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/eb0883e9141141059271d6a94576b1c3/images/large/8.jpg not downloaded yet
2026-03-26 22:56:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 66e1293d-9f61-520b-b07a-18f721a8f455 with identifier: 1985626
2026-03-26 22:56:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 66e1293d-9f61-520b-b07a-18f721a8f455 with identifier: 1985626
2026-03-26 22:56:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 66e1293d-9f61-520b-b07a-18f721a8f455 with identifier: 1985626 to the API
2026-03-26 22:56:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:56:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:56:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1ym/ad2f87b7a5d14c0eb344cf4c9916c6ed/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '66e1293d-9f61-520b-b07a-18f721a8f455',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '3-serie',
 'odometer': 128346,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66e1293d-9f61-520b-b07a-18f721a8f455/66e1293d-9f61-520b-b07a-18f721a8f455_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 473167,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ym/ad2f87b7a5d14c0eb344cf4c9916c6ed/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66e1293d-9f61-520b-b07a-18f721a8f455/66e1293d-9f61-520b-b07a-18f721a8f455_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 559217,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ym/ad2f87b7a5d14c0eb344cf4c9916c6ed/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66e1293d-9f61-520b-b07a-18f721a8f455/66e1293d-9f61-520b-b07a-18f721a8f455_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 481698,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ym/ad2f87b7a5d14c0eb344cf4c9916c6ed/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66e1293d-9f61-520b-b07a-18f721a8f455/66e1293d-9f61-520b-b07a-18f721a8f455_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 586789,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ym/ad2f87b7a5d14c0eb344cf4c9916c6ed/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66e1293d-9f61-520b-b07a-18f721a8f455/66e1293d-9f61-520b-b07a-18f721a8f455_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 286591,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ym/ad2f87b7a5d14c0eb344cf4c9916c6ed/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66e1293d-9f61-520b-b07a-18f721a8f455/66e1293d-9f61-520b-b07a-18f721a8f455_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 380494,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ym/ad2f87b7a5d14c0eb344cf4c9916c6ed/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66e1293d-9f61-520b-b07a-18f721a8f455/66e1293d-9f61-520b-b07a-18f721a8f455_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 389865,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ym/ad2f87b7a5d14c0eb344cf4c9916c6ed/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66e1293d-9f61-520b-b07a-18f721a8f455/66e1293d-9f61-520b-b07a-18f721a8f455_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 414078,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ym/ad2f87b7a5d14c0eb344cf4c9916c6ed/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66e1293d-9f61-520b-b07a-18f721a8f455/66e1293d-9f61-520b-b07a-18f721a8f455_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 296507,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ym/ad2f87b7a5d14c0eb344cf4c9916c6ed/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66e1293d-9f61-520b-b07a-18f721a8f455/66e1293d-9f61-520b-b07a-18f721a8f455_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 289280,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ym/ad2f87b7a5d14c0eb344cf4c9916c6ed/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3-serie 2.0 318D (100KW) TOURING',
 'transmission': 'manual',
 'trim': '2.0 318D (100KW) TOURING',
 'vin': None,
 'year': 2020}
2026-03-26 22:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985626%27 HTTP/1.1" 200 None
2026-03-26 22:56:48 [ayvens.be] INFO: Saving data for 1985626: {'created_time': 1774565808.659159, 'last_price_update_time': 1774565808.659178, 'auction_closing_time': 1774958400.0}
2026-03-26 22:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985626') HTTP/1.1" 204 0
2026-03-26 22:56:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/eb0883e9141141059271d6a94576b1c3/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/eb0883e9141141059271d6a94576b1c3/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Feb0883e9141141059271d6a94576b1c3%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/eb0883e9141141059271d6a94576b1c3/images/large/9.jpg not downloaded yet
2026-03-26 22:56:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd4c8790>
2026-03-26 22:56:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed77adca-f00b-5d88-b37c-f5b42649bc36/ed77adca-f00b-5d88-b37c-f5b42649bc36_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Feb0883e9141141059271d6a94576b1c3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/eb0883e9141141059271d6a94576b1c3/images/large/1.jpg saved to cache
2026-03-26 22:56:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ed77adca-f00b-5d88-b37c-f5b42649bc36
2026-03-26 22:56:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/eb0883e9141141059271d6a94576b1c3/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Feb0883e9141141059271d6a94576b1c3%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/eb0883e9141141059271d6a94576b1c3/images/large/10.jpg not downloaded yet
2026-03-26 22:56:48 [ayvens.be] INFO: Found listing with ID: 1985628
2026-03-26 22:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985628%27 HTTP/1.1" 200 None
2026-03-26 22:56:48 [ayvens.be] INFO: Scrape type for 1985628: 1
2026-03-26 22:56:48 [ayvens.be] INFO: Extracting data for car ID: 1985628
2026-03-26 22:56:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a83606b-6a2f-5845-a171-3506d77c25a9 with identifier: 1985628
2026-03-26 22:56:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a83606b-6a2f-5845-a171-3506d77c25a9 with scrape type 1
2026-03-26 22:56:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1a83606b-6a2f-5845-a171-3506d77c25a9
2026-03-26 22:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F5346553d2a2248d495bdd06f4ef5aa2a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/5346553d2a2248d495bdd06f4ef5aa2a/images/large/1.jpg not downloaded yet
2026-03-26 22:56:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/eb0883e9141141059271d6a94576b1c3/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/eb0883e9141141059271d6a94576b1c3/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F5346553d2a2248d495bdd06f4ef5aa2a%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/5346553d2a2248d495bdd06f4ef5aa2a/images/large/2.jpg not downloaded yet
2026-03-26 22:56:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c68d10>
2026-03-26 22:56:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed77adca-f00b-5d88-b37c-f5b42649bc36/ed77adca-f00b-5d88-b37c-f5b42649bc36_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Feb0883e9141141059271d6a94576b1c3%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/eb0883e9141141059271d6a94576b1c3/images/large/2.jpg saved to cache
2026-03-26 22:56:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ed77adca-f00b-5d88-b37c-f5b42649bc36
2026-03-26 22:56:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b727c4d0>
2026-03-26 22:56:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed77adca-f00b-5d88-b37c-f5b42649bc36/ed77adca-f00b-5d88-b37c-f5b42649bc36_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Feb0883e9141141059271d6a94576b1c3%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/eb0883e9141141059271d6a94576b1c3/images/large/3.jpg saved to cache
2026-03-26 22:56:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ed77adca-f00b-5d88-b37c-f5b42649bc36
2026-03-26 22:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F5346553d2a2248d495bdd06f4ef5aa2a%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/5346553d2a2248d495bdd06f4ef5aa2a/images/large/3.jpg not downloaded yet
2026-03-26 22:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F5346553d2a2248d495bdd06f4ef5aa2a%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/5346553d2a2248d495bdd06f4ef5aa2a/images/large/4.jpg not downloaded yet
2026-03-26 22:56:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c95c50>
2026-03-26 22:56:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed77adca-f00b-5d88-b37c-f5b42649bc36/ed77adca-f00b-5d88-b37c-f5b42649bc36_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Feb0883e9141141059271d6a94576b1c3%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/eb0883e9141141059271d6a94576b1c3/images/large/5.jpg saved to cache
2026-03-26 22:56:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ed77adca-f00b-5d88-b37c-f5b42649bc36
2026-03-26 22:56:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74a4150>
2026-03-26 22:56:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed77adca-f00b-5d88-b37c-f5b42649bc36/ed77adca-f00b-5d88-b37c-f5b42649bc36_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Feb0883e9141141059271d6a94576b1c3%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/eb0883e9141141059271d6a94576b1c3/images/large/6.jpg saved to cache
2026-03-26 22:56:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ed77adca-f00b-5d88-b37c-f5b42649bc36
2026-03-26 22:56:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74390d0>
2026-03-26 22:56:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed77adca-f00b-5d88-b37c-f5b42649bc36/ed77adca-f00b-5d88-b37c-f5b42649bc36_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Feb0883e9141141059271d6a94576b1c3%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/eb0883e9141141059271d6a94576b1c3/images/large/4.jpg saved to cache
2026-03-26 22:56:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ed77adca-f00b-5d88-b37c-f5b42649bc36
2026-03-26 22:56:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/eb0883e9141141059271d6a94576b1c3/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/eb0883e9141141059271d6a94576b1c3/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/eb0883e9141141059271d6a94576b1c3/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F5346553d2a2248d495bdd06f4ef5aa2a%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/5346553d2a2248d495bdd06f4ef5aa2a/images/large/5.jpg not downloaded yet
2026-03-26 22:56:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/eb0883e9141141059271d6a94576b1c3/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F5346553d2a2248d495bdd06f4ef5aa2a%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/5346553d2a2248d495bdd06f4ef5aa2a/images/large/6.jpg not downloaded yet
2026-03-26 22:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F5346553d2a2248d495bdd06f4ef5aa2a%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/5346553d2a2248d495bdd06f4ef5aa2a/images/large/7.jpg not downloaded yet
2026-03-26 22:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F5346553d2a2248d495bdd06f4ef5aa2a%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/5346553d2a2248d495bdd06f4ef5aa2a/images/large/8.jpg not downloaded yet
2026-03-26 22:56:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dd/5346553d2a2248d495bdd06f4ef5aa2a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dd/5346553d2a2248d495bdd06f4ef5aa2a/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F5346553d2a2248d495bdd06f4ef5aa2a%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/5346553d2a2248d495bdd06f4ef5aa2a/images/large/9.jpg not downloaded yet
2026-03-26 22:56:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7ae87d0>
2026-03-26 22:56:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed77adca-f00b-5d88-b37c-f5b42649bc36/ed77adca-f00b-5d88-b37c-f5b42649bc36_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Feb0883e9141141059271d6a94576b1c3%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/eb0883e9141141059271d6a94576b1c3/images/large/7.jpg saved to cache
2026-03-26 22:56:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ed77adca-f00b-5d88-b37c-f5b42649bc36
2026-03-26 22:56:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6da7a50>
2026-03-26 22:56:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed77adca-f00b-5d88-b37c-f5b42649bc36/ed77adca-f00b-5d88-b37c-f5b42649bc36_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Feb0883e9141141059271d6a94576b1c3%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/eb0883e9141141059271d6a94576b1c3/images/large/8.jpg saved to cache
2026-03-26 22:56:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ed77adca-f00b-5d88-b37c-f5b42649bc36
2026-03-26 22:56:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5ca5890>
2026-03-26 22:56:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed77adca-f00b-5d88-b37c-f5b42649bc36/ed77adca-f00b-5d88-b37c-f5b42649bc36_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Feb0883e9141141059271d6a94576b1c3%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/eb0883e9141141059271d6a94576b1c3/images/large/10.jpg saved to cache
2026-03-26 22:56:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ed77adca-f00b-5d88-b37c-f5b42649bc36
2026-03-26 22:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F5346553d2a2248d495bdd06f4ef5aa2a%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/5346553d2a2248d495bdd06f4ef5aa2a/images/large/10.jpg not downloaded yet
2026-03-26 22:56:49 [ayvens.be] INFO: Found listing with ID: 1985629
2026-03-26 22:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985629%27 HTTP/1.1" 200 None
2026-03-26 22:56:49 [ayvens.be] INFO: Scrape type for 1985629: 1
2026-03-26 22:56:49 [ayvens.be] INFO: Extracting data for car ID: 1985629
2026-03-26 22:56:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4bf4fcc-1696-5beb-b3eb-da3894a8b24b with identifier: 1985629
2026-03-26 22:56:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4bf4fcc-1696-5beb-b3eb-da3894a8b24b with scrape type 1
2026-03-26 22:56:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e4bf4fcc-1696-5beb-b3eb-da3894a8b24b
2026-03-26 22:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Ff13b19f1ffb94788b515cc1994e544e1%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/f13b19f1ffb94788b515cc1994e544e1/images/large/1.jpg not downloaded yet
2026-03-26 22:56:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b782ce90>
2026-03-26 22:56:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed77adca-f00b-5d88-b37c-f5b42649bc36/ed77adca-f00b-5d88-b37c-f5b42649bc36_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Feb0883e9141141059271d6a94576b1c3%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/eb0883e9141141059271d6a94576b1c3/images/large/9.jpg saved to cache
2026-03-26 22:56:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ed77adca-f00b-5d88-b37c-f5b42649bc36
2026-03-26 22:56:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ed77adca-f00b-5d88-b37c-f5b42649bc36, skipping ID generation
2026-03-26 22:56:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed77adca-f00b-5d88-b37c-f5b42649bc36 with scrape type 1
2026-03-26 22:56:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ed77adca-f00b-5d88-b37c-f5b42649bc36 sending to next pipeline
2026-03-26 22:56:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: ed77adca-f00b-5d88-b37c-f5b42649bc36, identifier: 1985627
2026-03-26 22:56:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd0cfb10>
2026-03-26 22:56:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a83606b-6a2f-5845-a171-3506d77c25a9/1a83606b-6a2f-5845-a171-3506d77c25a9_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:56:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F5346553d2a2248d495bdd06f4ef5aa2a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/5346553d2a2248d495bdd06f4ef5aa2a/images/large/1.jpg saved to cache
2026-03-26 22:56:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1a83606b-6a2f-5845-a171-3506d77c25a9
2026-03-26 22:56:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cb3c50>
2026-03-26 22:56:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a83606b-6a2f-5845-a171-3506d77c25a9/1a83606b-6a2f-5845-a171-3506d77c25a9_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:56:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F5346553d2a2248d495bdd06f4ef5aa2a%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/5346553d2a2248d495bdd06f4ef5aa2a/images/large/2.jpg saved to cache
2026-03-26 22:56:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1a83606b-6a2f-5845-a171-3506d77c25a9
2026-03-26 22:56:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: ed77adca-f00b-5d88-b37c-f5b42649bc36 with identifier: 1985627
2026-03-26 22:56:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: ed77adca-f00b-5d88-b37c-f5b42649bc36 with identifier: 1985627
2026-03-26 22:56:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: ed77adca-f00b-5d88-b37c-f5b42649bc36 with identifier: 1985627 to the API
2026-03-26 22:56:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:56:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:56:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2be/eb0883e9141141059271d6a94576b1c3/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'ed77adca-f00b-5d88-b37c-f5b42649bc36',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '2 SERIES ACTIVE TOURER',
 'odometer': 14625,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed77adca-f00b-5d88-b37c-f5b42649bc36/ed77adca-f00b-5d88-b37c-f5b42649bc36_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 391454,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/eb0883e9141141059271d6a94576b1c3/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed77adca-f00b-5d88-b37c-f5b42649bc36/ed77adca-f00b-5d88-b37c-f5b42649bc36_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 427099,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/eb0883e9141141059271d6a94576b1c3/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed77adca-f00b-5d88-b37c-f5b42649bc36/ed77adca-f00b-5d88-b37c-f5b42649bc36_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 370067,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/eb0883e9141141059271d6a94576b1c3/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed77adca-f00b-5d88-b37c-f5b42649bc36/ed77adca-f00b-5d88-b37c-f5b42649bc36_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 485928,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/eb0883e9141141059271d6a94576b1c3/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed77adca-f00b-5d88-b37c-f5b42649bc36/ed77adca-f00b-5d88-b37c-f5b42649bc36_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 197325,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/eb0883e9141141059271d6a94576b1c3/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed77adca-f00b-5d88-b37c-f5b42649bc36/ed77adca-f00b-5d88-b37c-f5b42649bc36_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 331689,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/eb0883e9141141059271d6a94576b1c3/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed77adca-f00b-5d88-b37c-f5b42649bc36/ed77adca-f00b-5d88-b37c-f5b42649bc36_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 382396,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/eb0883e9141141059271d6a94576b1c3/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed77adca-f00b-5d88-b37c-f5b42649bc36/ed77adca-f00b-5d88-b37c-f5b42649bc36_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 333133,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/eb0883e9141141059271d6a94576b1c3/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed77adca-f00b-5d88-b37c-f5b42649bc36/ed77adca-f00b-5d88-b37c-f5b42649bc36_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 269893,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/eb0883e9141141059271d6a94576b1c3/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed77adca-f00b-5d88-b37c-f5b42649bc36/ed77adca-f00b-5d88-b37c-f5b42649bc36_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 260392,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/eb0883e9141141059271d6a94576b1c3/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 2 SERIES ACTIVE TOURER 1.5 216I ACTIVE TOURER',
 'transmission': 'manual',
 'trim': '1.5 216I ACTIVE TOURER',
 'vin': None,
 'year': 2021}
2026-03-26 22:56:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985627%27 HTTP/1.1" 200 None
2026-03-26 22:56:50 [ayvens.be] INFO: Saving data for 1985627: {'created_time': 1774565810.558875, 'last_price_update_time': 1774565810.558884, 'auction_closing_time': 1774958400.0}
2026-03-26 22:56:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985627') HTTP/1.1" 204 0
2026-03-26 22:56:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Ff13b19f1ffb94788b515cc1994e544e1%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/f13b19f1ffb94788b515cc1994e544e1/images/large/2.jpg not downloaded yet
2026-03-26 22:56:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dd/5346553d2a2248d495bdd06f4ef5aa2a/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dd/5346553d2a2248d495bdd06f4ef5aa2a/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dd/5346553d2a2248d495bdd06f4ef5aa2a/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Ff13b19f1ffb94788b515cc1994e544e1%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/f13b19f1ffb94788b515cc1994e544e1/images/large/3.jpg not downloaded yet
2026-03-26 22:56:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dd/5346553d2a2248d495bdd06f4ef5aa2a/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Ff13b19f1ffb94788b515cc1994e544e1%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/f13b19f1ffb94788b515cc1994e544e1/images/large/4.jpg not downloaded yet
2026-03-26 22:56:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dd/5346553d2a2248d495bdd06f4ef5aa2a/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dd/5346553d2a2248d495bdd06f4ef5aa2a/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dd/5346553d2a2248d495bdd06f4ef5aa2a/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Ff13b19f1ffb94788b515cc1994e544e1%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/f13b19f1ffb94788b515cc1994e544e1/images/large/5.jpg not downloaded yet
2026-03-26 22:56:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Ff13b19f1ffb94788b515cc1994e544e1%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/f13b19f1ffb94788b515cc1994e544e1/images/large/6.jpg not downloaded yet
2026-03-26 22:56:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Ff13b19f1ffb94788b515cc1994e544e1%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/f13b19f1ffb94788b515cc1994e544e1/images/large/7.jpg not downloaded yet
2026-03-26 22:56:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Ff13b19f1ffb94788b515cc1994e544e1%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/f13b19f1ffb94788b515cc1994e544e1/images/large/8.jpg not downloaded yet
2026-03-26 22:56:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76e1f50>
2026-03-26 22:56:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a83606b-6a2f-5845-a171-3506d77c25a9/1a83606b-6a2f-5845-a171-3506d77c25a9_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:56:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F5346553d2a2248d495bdd06f4ef5aa2a%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/5346553d2a2248d495bdd06f4ef5aa2a/images/large/6.jpg saved to cache
2026-03-26 22:56:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1a83606b-6a2f-5845-a171-3506d77c25a9
2026-03-26 22:56:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Ff13b19f1ffb94788b515cc1994e544e1%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/f13b19f1ffb94788b515cc1994e544e1/images/large/9.jpg not downloaded yet
2026-03-26 22:56:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Ff13b19f1ffb94788b515cc1994e544e1%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/f13b19f1ffb94788b515cc1994e544e1/images/large/10.jpg not downloaded yet
2026-03-26 22:56:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6dd8550>
2026-03-26 22:56:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a83606b-6a2f-5845-a171-3506d77c25a9/1a83606b-6a2f-5845-a171-3506d77c25a9_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:56:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F5346553d2a2248d495bdd06f4ef5aa2a%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/5346553d2a2248d495bdd06f4ef5aa2a/images/large/3.jpg saved to cache
2026-03-26 22:56:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1a83606b-6a2f-5845-a171-3506d77c25a9
2026-03-26 22:56:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77bf1d0>
2026-03-26 22:56:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a83606b-6a2f-5845-a171-3506d77c25a9/1a83606b-6a2f-5845-a171-3506d77c25a9_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:56:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F5346553d2a2248d495bdd06f4ef5aa2a%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/5346553d2a2248d495bdd06f4ef5aa2a/images/large/5.jpg saved to cache
2026-03-26 22:56:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1a83606b-6a2f-5845-a171-3506d77c25a9
2026-03-26 22:56:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77ae590>
2026-03-26 22:56:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a83606b-6a2f-5845-a171-3506d77c25a9/1a83606b-6a2f-5845-a171-3506d77c25a9_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F5346553d2a2248d495bdd06f4ef5aa2a%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/5346553d2a2248d495bdd06f4ef5aa2a/images/large/7.jpg saved to cache
2026-03-26 22:56:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1a83606b-6a2f-5845-a171-3506d77c25a9
2026-03-26 22:56:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6dd8550>
2026-03-26 22:56:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a83606b-6a2f-5845-a171-3506d77c25a9/1a83606b-6a2f-5845-a171-3506d77c25a9_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F5346553d2a2248d495bdd06f4ef5aa2a%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/5346553d2a2248d495bdd06f4ef5aa2a/images/large/8.jpg saved to cache
2026-03-26 22:56:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1a83606b-6a2f-5845-a171-3506d77c25a9
2026-03-26 22:56:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7981090>
2026-03-26 22:56:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a83606b-6a2f-5845-a171-3506d77c25a9/1a83606b-6a2f-5845-a171-3506d77c25a9_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F5346553d2a2248d495bdd06f4ef5aa2a%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/5346553d2a2248d495bdd06f4ef5aa2a/images/large/9.jpg saved to cache
2026-03-26 22:56:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1a83606b-6a2f-5845-a171-3506d77c25a9
2026-03-26 22:56:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e29f50>
2026-03-26 22:56:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a83606b-6a2f-5845-a171-3506d77c25a9/1a83606b-6a2f-5845-a171-3506d77c25a9_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F5346553d2a2248d495bdd06f4ef5aa2a%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/5346553d2a2248d495bdd06f4ef5aa2a/images/large/4.jpg saved to cache
2026-03-26 22:56:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1a83606b-6a2f-5845-a171-3506d77c25a9
2026-03-26 22:56:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/f13b19f1ffb94788b515cc1994e544e1/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:51 [ayvens.be] INFO: Found listing with ID: 1985630
2026-03-26 22:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985630%27 HTTP/1.1" 200 None
2026-03-26 22:56:51 [ayvens.be] INFO: Scrape type for 1985630: 1
2026-03-26 22:56:51 [ayvens.be] INFO: Extracting data for car ID: 1985630
2026-03-26 22:56:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dddc1730-e2f6-59ba-acb6-05479044fc6d with identifier: 1985630
2026-03-26 22:56:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dddc1730-e2f6-59ba-acb6-05479044fc6d with scrape type 1
2026-03-26 22:56:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dddc1730-e2f6-59ba-acb6-05479044fc6d
2026-03-26 22:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F185b9ce1e4e5404ca5386352269a00fd%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/185b9ce1e4e5404ca5386352269a00fd/images/large/1.jpg not downloaded yet
2026-03-26 22:56:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/f13b19f1ffb94788b515cc1994e544e1/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/f13b19f1ffb94788b515cc1994e544e1/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dd/5346553d2a2248d495bdd06f4ef5aa2a/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F185b9ce1e4e5404ca5386352269a00fd%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/185b9ce1e4e5404ca5386352269a00fd/images/large/2.jpg not downloaded yet
2026-03-26 22:56:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/f13b19f1ffb94788b515cc1994e544e1/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/f13b19f1ffb94788b515cc1994e544e1/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/f13b19f1ffb94788b515cc1994e544e1/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F185b9ce1e4e5404ca5386352269a00fd%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/185b9ce1e4e5404ca5386352269a00fd/images/large/3.jpg not downloaded yet
2026-03-26 22:56:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/f13b19f1ffb94788b515cc1994e544e1/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F185b9ce1e4e5404ca5386352269a00fd%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/185b9ce1e4e5404ca5386352269a00fd/images/large/4.jpg not downloaded yet
2026-03-26 22:56:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b69e90>
2026-03-26 22:56:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4bf4fcc-1696-5beb-b3eb-da3894a8b24b/e4bf4fcc-1696-5beb-b3eb-da3894a8b24b_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Ff13b19f1ffb94788b515cc1994e544e1%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/f13b19f1ffb94788b515cc1994e544e1/images/large/6.jpg saved to cache
2026-03-26 22:56:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e4bf4fcc-1696-5beb-b3eb-da3894a8b24b
2026-03-26 22:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F185b9ce1e4e5404ca5386352269a00fd%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/185b9ce1e4e5404ca5386352269a00fd/images/large/5.jpg not downloaded yet
2026-03-26 22:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F185b9ce1e4e5404ca5386352269a00fd%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/185b9ce1e4e5404ca5386352269a00fd/images/large/6.jpg not downloaded yet
2026-03-26 22:56:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7981910>
2026-03-26 22:56:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4bf4fcc-1696-5beb-b3eb-da3894a8b24b/e4bf4fcc-1696-5beb-b3eb-da3894a8b24b_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Ff13b19f1ffb94788b515cc1994e544e1%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/f13b19f1ffb94788b515cc1994e544e1/images/large/2.jpg saved to cache
2026-03-26 22:56:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e4bf4fcc-1696-5beb-b3eb-da3894a8b24b
2026-03-26 22:56:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b777bd10>
2026-03-26 22:56:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4bf4fcc-1696-5beb-b3eb-da3894a8b24b/e4bf4fcc-1696-5beb-b3eb-da3894a8b24b_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Ff13b19f1ffb94788b515cc1994e544e1%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/f13b19f1ffb94788b515cc1994e544e1/images/large/5.jpg saved to cache
2026-03-26 22:56:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e4bf4fcc-1696-5beb-b3eb-da3894a8b24b
2026-03-26 22:56:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b781b9d0>
2026-03-26 22:56:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a83606b-6a2f-5845-a171-3506d77c25a9/1a83606b-6a2f-5845-a171-3506d77c25a9_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F5346553d2a2248d495bdd06f4ef5aa2a%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/5346553d2a2248d495bdd06f4ef5aa2a/images/large/10.jpg saved to cache
2026-03-26 22:56:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1a83606b-6a2f-5845-a171-3506d77c25a9
2026-03-26 22:56:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1a83606b-6a2f-5845-a171-3506d77c25a9, skipping ID generation
2026-03-26 22:56:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a83606b-6a2f-5845-a171-3506d77c25a9 with scrape type 1
2026-03-26 22:56:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1a83606b-6a2f-5845-a171-3506d77c25a9 sending to next pipeline
2026-03-26 22:56:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 1a83606b-6a2f-5845-a171-3506d77c25a9, identifier: 1985628
2026-03-26 22:56:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77ae950>
2026-03-26 22:56:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4bf4fcc-1696-5beb-b3eb-da3894a8b24b/e4bf4fcc-1696-5beb-b3eb-da3894a8b24b_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Ff13b19f1ffb94788b515cc1994e544e1%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/f13b19f1ffb94788b515cc1994e544e1/images/large/3.jpg saved to cache
2026-03-26 22:56:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e4bf4fcc-1696-5beb-b3eb-da3894a8b24b
2026-03-26 22:56:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6da5b10>
2026-03-26 22:56:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4bf4fcc-1696-5beb-b3eb-da3894a8b24b/e4bf4fcc-1696-5beb-b3eb-da3894a8b24b_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Ff13b19f1ffb94788b515cc1994e544e1%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/f13b19f1ffb94788b515cc1994e544e1/images/large/1.jpg saved to cache
2026-03-26 22:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e4bf4fcc-1696-5beb-b3eb-da3894a8b24b
2026-03-26 22:56:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7572290>
2026-03-26 22:56:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4bf4fcc-1696-5beb-b3eb-da3894a8b24b/e4bf4fcc-1696-5beb-b3eb-da3894a8b24b_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Ff13b19f1ffb94788b515cc1994e544e1%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/f13b19f1ffb94788b515cc1994e544e1/images/large/4.jpg saved to cache
2026-03-26 22:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e4bf4fcc-1696-5beb-b3eb-da3894a8b24b
2026-03-26 22:56:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74b4c90>
2026-03-26 22:56:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4bf4fcc-1696-5beb-b3eb-da3894a8b24b/e4bf4fcc-1696-5beb-b3eb-da3894a8b24b_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Ff13b19f1ffb94788b515cc1994e544e1%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/f13b19f1ffb94788b515cc1994e544e1/images/large/7.jpg saved to cache
2026-03-26 22:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e4bf4fcc-1696-5beb-b3eb-da3894a8b24b
2026-03-26 22:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F185b9ce1e4e5404ca5386352269a00fd%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/185b9ce1e4e5404ca5386352269a00fd/images/large/7.jpg not downloaded yet
2026-03-26 22:56:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 1a83606b-6a2f-5845-a171-3506d77c25a9 with identifier: 1985628
2026-03-26 22:56:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 1a83606b-6a2f-5845-a171-3506d77c25a9 with identifier: 1985628
2026-03-26 22:56:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 1a83606b-6a2f-5845-a171-3506d77c25a9 with identifier: 1985628 to the API
2026-03-26 22:56:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:56:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:56:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2dd/5346553d2a2248d495bdd06f4ef5aa2a/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '1a83606b-6a2f-5845-a171-3506d77c25a9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'SUPERB COMBI',
 'odometer': 106366,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a83606b-6a2f-5845-a171-3506d77c25a9/1a83606b-6a2f-5845-a171-3506d77c25a9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 552502,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dd/5346553d2a2248d495bdd06f4ef5aa2a/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a83606b-6a2f-5845-a171-3506d77c25a9/1a83606b-6a2f-5845-a171-3506d77c25a9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 554782,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dd/5346553d2a2248d495bdd06f4ef5aa2a/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a83606b-6a2f-5845-a171-3506d77c25a9/1a83606b-6a2f-5845-a171-3506d77c25a9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 619363,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dd/5346553d2a2248d495bdd06f4ef5aa2a/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a83606b-6a2f-5845-a171-3506d77c25a9/1a83606b-6a2f-5845-a171-3506d77c25a9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 588715,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dd/5346553d2a2248d495bdd06f4ef5aa2a/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a83606b-6a2f-5845-a171-3506d77c25a9/1a83606b-6a2f-5845-a171-3506d77c25a9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 359381,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dd/5346553d2a2248d495bdd06f4ef5aa2a/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a83606b-6a2f-5845-a171-3506d77c25a9/1a83606b-6a2f-5845-a171-3506d77c25a9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 301357,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dd/5346553d2a2248d495bdd06f4ef5aa2a/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a83606b-6a2f-5845-a171-3506d77c25a9/1a83606b-6a2f-5845-a171-3506d77c25a9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 503898,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dd/5346553d2a2248d495bdd06f4ef5aa2a/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a83606b-6a2f-5845-a171-3506d77c25a9/1a83606b-6a2f-5845-a171-3506d77c25a9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 351741,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dd/5346553d2a2248d495bdd06f4ef5aa2a/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a83606b-6a2f-5845-a171-3506d77c25a9/1a83606b-6a2f-5845-a171-3506d77c25a9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 343668,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dd/5346553d2a2248d495bdd06f4ef5aa2a/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a83606b-6a2f-5845-a171-3506d77c25a9/1a83606b-6a2f-5845-a171-3506d77c25a9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 294231,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dd/5346553d2a2248d495bdd06f4ef5aa2a/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA SUPERB COMBI 2.0 CRTDI 110KW DSG7 CLEVER',
 'transmission': 'automatic',
 'trim': '2.0 CRTDI 110KW DSG7 CLEVER',
 'vin': None,
 'year': 2023}
2026-03-26 22:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985628%27 HTTP/1.1" 200 None
2026-03-26 22:56:52 [ayvens.be] INFO: Saving data for 1985628: {'created_time': 1774565812.549675, 'last_price_update_time': 1774565812.549686, 'auction_closing_time': 1774958400.0}
2026-03-26 22:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985628') HTTP/1.1" 204 0
2026-03-26 22:56:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/f13b19f1ffb94788b515cc1994e544e1/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/f13b19f1ffb94788b515cc1994e544e1/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/f13b19f1ffb94788b515cc1994e544e1/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F185b9ce1e4e5404ca5386352269a00fd%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/185b9ce1e4e5404ca5386352269a00fd/images/large/8.jpg not downloaded yet
2026-03-26 22:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F185b9ce1e4e5404ca5386352269a00fd%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/185b9ce1e4e5404ca5386352269a00fd/images/large/9.jpg not downloaded yet
2026-03-26 22:56:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/185b9ce1e4e5404ca5386352269a00fd/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F185b9ce1e4e5404ca5386352269a00fd%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/185b9ce1e4e5404ca5386352269a00fd/images/large/10.jpg not downloaded yet
2026-03-26 22:56:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/185b9ce1e4e5404ca5386352269a00fd/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:52 [ayvens.be] INFO: Found listing with ID: 1985631
2026-03-26 22:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985631%27 HTTP/1.1" 200 None
2026-03-26 22:56:52 [ayvens.be] INFO: Scrape type for 1985631: 1
2026-03-26 22:56:52 [ayvens.be] INFO: Extracting data for car ID: 1985631
2026-03-26 22:56:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b0f1bfc-61ef-5df4-9193-0b96111023d6 with identifier: 1985631
2026-03-26 22:56:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b0f1bfc-61ef-5df4-9193-0b96111023d6 with scrape type 1
2026-03-26 22:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5b0f1bfc-61ef-5df4-9193-0b96111023d6
2026-03-26 22:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F4c7eeccd3ab2438c96befe3f2673deb3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/4c7eeccd3ab2438c96befe3f2673deb3/images/large/1.jpg not downloaded yet
2026-03-26 22:56:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/185b9ce1e4e5404ca5386352269a00fd/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/185b9ce1e4e5404ca5386352269a00fd/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/185b9ce1e4e5404ca5386352269a00fd/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F4c7eeccd3ab2438c96befe3f2673deb3%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/4c7eeccd3ab2438c96befe3f2673deb3/images/large/2.jpg not downloaded yet
2026-03-26 22:56:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7773c50>
2026-03-26 22:56:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4bf4fcc-1696-5beb-b3eb-da3894a8b24b/e4bf4fcc-1696-5beb-b3eb-da3894a8b24b_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Ff13b19f1ffb94788b515cc1994e544e1%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/f13b19f1ffb94788b515cc1994e544e1/images/large/9.jpg saved to cache
2026-03-26 22:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e4bf4fcc-1696-5beb-b3eb-da3894a8b24b
2026-03-26 22:56:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e022d0>
2026-03-26 22:56:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4bf4fcc-1696-5beb-b3eb-da3894a8b24b/e4bf4fcc-1696-5beb-b3eb-da3894a8b24b_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Ff13b19f1ffb94788b515cc1994e544e1%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/f13b19f1ffb94788b515cc1994e544e1/images/large/8.jpg saved to cache
2026-03-26 22:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e4bf4fcc-1696-5beb-b3eb-da3894a8b24b
2026-03-26 22:56:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76a7950>
2026-03-26 22:56:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4bf4fcc-1696-5beb-b3eb-da3894a8b24b/e4bf4fcc-1696-5beb-b3eb-da3894a8b24b_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Ff13b19f1ffb94788b515cc1994e544e1%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/f13b19f1ffb94788b515cc1994e544e1/images/large/10.jpg saved to cache
2026-03-26 22:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e4bf4fcc-1696-5beb-b3eb-da3894a8b24b
2026-03-26 22:56:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e4bf4fcc-1696-5beb-b3eb-da3894a8b24b, skipping ID generation
2026-03-26 22:56:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4bf4fcc-1696-5beb-b3eb-da3894a8b24b with scrape type 1
2026-03-26 22:56:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e4bf4fcc-1696-5beb-b3eb-da3894a8b24b sending to next pipeline
2026-03-26 22:56:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e4bf4fcc-1696-5beb-b3eb-da3894a8b24b, identifier: 1985629
2026-03-26 22:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F4c7eeccd3ab2438c96befe3f2673deb3%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/4c7eeccd3ab2438c96befe3f2673deb3/images/large/3.jpg not downloaded yet
2026-03-26 22:56:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e4bf4fcc-1696-5beb-b3eb-da3894a8b24b with identifier: 1985629
2026-03-26 22:56:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e4bf4fcc-1696-5beb-b3eb-da3894a8b24b with identifier: 1985629
2026-03-26 22:56:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e4bf4fcc-1696-5beb-b3eb-da3894a8b24b with identifier: 1985629 to the API
2026-03-26 22:56:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:56:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:56:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bh/f13b19f1ffb94788b515cc1994e544e1/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'e4bf4fcc-1696-5beb-b3eb-da3894a8b24b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '508 SW',
 'odometer': 137222,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4bf4fcc-1696-5beb-b3eb-da3894a8b24b/e4bf4fcc-1696-5beb-b3eb-da3894a8b24b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 541226,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/f13b19f1ffb94788b515cc1994e544e1/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4bf4fcc-1696-5beb-b3eb-da3894a8b24b/e4bf4fcc-1696-5beb-b3eb-da3894a8b24b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 532370,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/f13b19f1ffb94788b515cc1994e544e1/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4bf4fcc-1696-5beb-b3eb-da3894a8b24b/e4bf4fcc-1696-5beb-b3eb-da3894a8b24b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 508990,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/f13b19f1ffb94788b515cc1994e544e1/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4bf4fcc-1696-5beb-b3eb-da3894a8b24b/e4bf4fcc-1696-5beb-b3eb-da3894a8b24b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 481591,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/f13b19f1ffb94788b515cc1994e544e1/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4bf4fcc-1696-5beb-b3eb-da3894a8b24b/e4bf4fcc-1696-5beb-b3eb-da3894a8b24b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 296296,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/f13b19f1ffb94788b515cc1994e544e1/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4bf4fcc-1696-5beb-b3eb-da3894a8b24b/e4bf4fcc-1696-5beb-b3eb-da3894a8b24b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 231797,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/f13b19f1ffb94788b515cc1994e544e1/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4bf4fcc-1696-5beb-b3eb-da3894a8b24b/e4bf4fcc-1696-5beb-b3eb-da3894a8b24b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 387873,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/f13b19f1ffb94788b515cc1994e544e1/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4bf4fcc-1696-5beb-b3eb-da3894a8b24b/e4bf4fcc-1696-5beb-b3eb-da3894a8b24b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 338394,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/f13b19f1ffb94788b515cc1994e544e1/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4bf4fcc-1696-5beb-b3eb-da3894a8b24b/e4bf4fcc-1696-5beb-b3eb-da3894a8b24b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 421468,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/f13b19f1ffb94788b515cc1994e544e1/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4bf4fcc-1696-5beb-b3eb-da3894a8b24b/e4bf4fcc-1696-5beb-b3eb-da3894a8b24b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 270644,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/f13b19f1ffb94788b515cc1994e544e1/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 508 SW 1.6 PHEV 225 E-AUTO ALLURE PACK',
 'transmission': 'automatic',
 'trim': '1.6 PHEV 225 E-AUTO ALLURE PACK',
 'vin': None,
 'year': 2021}
2026-03-26 22:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985629%27 HTTP/1.1" 200 None
2026-03-26 22:56:53 [ayvens.be] INFO: Saving data for 1985629: {'created_time': 1774565813.333302, 'last_price_update_time': 1774565813.333312, 'auction_closing_time': 1774958400.0}
2026-03-26 22:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985629') HTTP/1.1" 204 0
2026-03-26 22:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F4c7eeccd3ab2438c96befe3f2673deb3%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/4c7eeccd3ab2438c96befe3f2673deb3/images/large/4.jpg not downloaded yet
2026-03-26 22:56:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7497f90>
2026-03-26 22:56:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dddc1730-e2f6-59ba-acb6-05479044fc6d/dddc1730-e2f6-59ba-acb6-05479044fc6d_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F185b9ce1e4e5404ca5386352269a00fd%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/185b9ce1e4e5404ca5386352269a00fd/images/large/5.jpg saved to cache
2026-03-26 22:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dddc1730-e2f6-59ba-acb6-05479044fc6d
2026-03-26 22:56:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b782de90>
2026-03-26 22:56:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dddc1730-e2f6-59ba-acb6-05479044fc6d/dddc1730-e2f6-59ba-acb6-05479044fc6d_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F185b9ce1e4e5404ca5386352269a00fd%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/185b9ce1e4e5404ca5386352269a00fd/images/large/2.jpg saved to cache
2026-03-26 22:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dddc1730-e2f6-59ba-acb6-05479044fc6d
2026-03-26 22:56:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b728ce50>
2026-03-26 22:56:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dddc1730-e2f6-59ba-acb6-05479044fc6d/dddc1730-e2f6-59ba-acb6-05479044fc6d_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F185b9ce1e4e5404ca5386352269a00fd%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/185b9ce1e4e5404ca5386352269a00fd/images/large/1.jpg saved to cache
2026-03-26 22:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dddc1730-e2f6-59ba-acb6-05479044fc6d
2026-03-26 22:56:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd134bd0>
2026-03-26 22:56:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dddc1730-e2f6-59ba-acb6-05479044fc6d/dddc1730-e2f6-59ba-acb6-05479044fc6d_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F185b9ce1e4e5404ca5386352269a00fd%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/185b9ce1e4e5404ca5386352269a00fd/images/large/3.jpg saved to cache
2026-03-26 22:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dddc1730-e2f6-59ba-acb6-05479044fc6d
2026-03-26 22:56:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b75a45d0>
2026-03-26 22:56:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dddc1730-e2f6-59ba-acb6-05479044fc6d/dddc1730-e2f6-59ba-acb6-05479044fc6d_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F185b9ce1e4e5404ca5386352269a00fd%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/185b9ce1e4e5404ca5386352269a00fd/images/large/4.jpg saved to cache
2026-03-26 22:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dddc1730-e2f6-59ba-acb6-05479044fc6d
2026-03-26 22:56:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/185b9ce1e4e5404ca5386352269a00fd/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/185b9ce1e4e5404ca5386352269a00fd/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/185b9ce1e4e5404ca5386352269a00fd/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F4c7eeccd3ab2438c96befe3f2673deb3%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/4c7eeccd3ab2438c96befe3f2673deb3/images/large/5.jpg not downloaded yet
2026-03-26 22:56:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/185b9ce1e4e5404ca5386352269a00fd/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/185b9ce1e4e5404ca5386352269a00fd/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F4c7eeccd3ab2438c96befe3f2673deb3%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/4c7eeccd3ab2438c96befe3f2673deb3/images/large/6.jpg not downloaded yet
2026-03-26 22:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F4c7eeccd3ab2438c96befe3f2673deb3%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/4c7eeccd3ab2438c96befe3f2673deb3/images/large/7.jpg not downloaded yet
2026-03-26 22:56:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/4c7eeccd3ab2438c96befe3f2673deb3/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/4c7eeccd3ab2438c96befe3f2673deb3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F4c7eeccd3ab2438c96befe3f2673deb3%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/4c7eeccd3ab2438c96befe3f2673deb3/images/large/8.jpg not downloaded yet
2026-03-26 22:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F4c7eeccd3ab2438c96befe3f2673deb3%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/4c7eeccd3ab2438c96befe3f2673deb3/images/large/9.jpg not downloaded yet
2026-03-26 22:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F4c7eeccd3ab2438c96befe3f2673deb3%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/4c7eeccd3ab2438c96befe3f2673deb3/images/large/10.jpg not downloaded yet
2026-03-26 22:56:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b746ec10>
2026-03-26 22:56:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dddc1730-e2f6-59ba-acb6-05479044fc6d/dddc1730-e2f6-59ba-acb6-05479044fc6d_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F185b9ce1e4e5404ca5386352269a00fd%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/185b9ce1e4e5404ca5386352269a00fd/images/large/7.jpg saved to cache
2026-03-26 22:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item dddc1730-e2f6-59ba-acb6-05479044fc6d
2026-03-26 22:56:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7aa3d50>
2026-03-26 22:56:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dddc1730-e2f6-59ba-acb6-05479044fc6d/dddc1730-e2f6-59ba-acb6-05479044fc6d_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F185b9ce1e4e5404ca5386352269a00fd%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/185b9ce1e4e5404ca5386352269a00fd/images/large/8.jpg saved to cache
2026-03-26 22:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item dddc1730-e2f6-59ba-acb6-05479044fc6d
2026-03-26 22:56:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b792d850>
2026-03-26 22:56:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dddc1730-e2f6-59ba-acb6-05479044fc6d/dddc1730-e2f6-59ba-acb6-05479044fc6d_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F185b9ce1e4e5404ca5386352269a00fd%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/185b9ce1e4e5404ca5386352269a00fd/images/large/6.jpg saved to cache
2026-03-26 22:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dddc1730-e2f6-59ba-acb6-05479044fc6d
2026-03-26 22:56:54 [ayvens.be] INFO: Found listing with ID: 1985632
2026-03-26 22:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985632%27 HTTP/1.1" 200 None
2026-03-26 22:56:54 [ayvens.be] INFO: Scrape type for 1985632: 1
2026-03-26 22:56:54 [ayvens.be] INFO: Extracting data for car ID: 1985632
2026-03-26 22:56:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 85724f90-0dfe-56d9-843c-ec02c68eed02 with identifier: 1985632
2026-03-26 22:56:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85724f90-0dfe-56d9-843c-ec02c68eed02 with scrape type 1
2026-03-26 22:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 85724f90-0dfe-56d9-843c-ec02c68eed02
2026-03-26 22:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F53b43c22097d439f900cec9a2e5e6510%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/53b43c22097d439f900cec9a2e5e6510/images/large/1.jpg not downloaded yet
2026-03-26 22:56:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b78a8c90>
2026-03-26 22:56:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dddc1730-e2f6-59ba-acb6-05479044fc6d/dddc1730-e2f6-59ba-acb6-05479044fc6d_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F185b9ce1e4e5404ca5386352269a00fd%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/185b9ce1e4e5404ca5386352269a00fd/images/large/10.jpg saved to cache
2026-03-26 22:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item dddc1730-e2f6-59ba-acb6-05479044fc6d
2026-03-26 22:56:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e4ddd0>
2026-03-26 22:56:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dddc1730-e2f6-59ba-acb6-05479044fc6d/dddc1730-e2f6-59ba-acb6-05479044fc6d_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F185b9ce1e4e5404ca5386352269a00fd%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/185b9ce1e4e5404ca5386352269a00fd/images/large/9.jpg saved to cache
2026-03-26 22:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item dddc1730-e2f6-59ba-acb6-05479044fc6d
2026-03-26 22:56:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dddc1730-e2f6-59ba-acb6-05479044fc6d, skipping ID generation
2026-03-26 22:56:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dddc1730-e2f6-59ba-acb6-05479044fc6d with scrape type 1
2026-03-26 22:56:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dddc1730-e2f6-59ba-acb6-05479044fc6d sending to next pipeline
2026-03-26 22:56:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: dddc1730-e2f6-59ba-acb6-05479044fc6d, identifier: 1985630
2026-03-26 22:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F53b43c22097d439f900cec9a2e5e6510%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/53b43c22097d439f900cec9a2e5e6510/images/large/2.jpg not downloaded yet
2026-03-26 22:56:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: dddc1730-e2f6-59ba-acb6-05479044fc6d with identifier: 1985630
2026-03-26 22:56:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: dddc1730-e2f6-59ba-acb6-05479044fc6d with identifier: 1985630
2026-03-26 22:56:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: dddc1730-e2f6-59ba-acb6-05479044fc6d with identifier: 1985630 to the API
2026-03-26 22:56:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:56:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:56:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bn/185b9ce1e4e5404ca5386352269a00fd/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'dddc1730-e2f6-59ba-acb6-05479044fc6d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A3',
 'odometer': 54057,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dddc1730-e2f6-59ba-acb6-05479044fc6d/dddc1730-e2f6-59ba-acb6-05479044fc6d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 686597,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/185b9ce1e4e5404ca5386352269a00fd/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dddc1730-e2f6-59ba-acb6-05479044fc6d/dddc1730-e2f6-59ba-acb6-05479044fc6d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 690403,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/185b9ce1e4e5404ca5386352269a00fd/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dddc1730-e2f6-59ba-acb6-05479044fc6d/dddc1730-e2f6-59ba-acb6-05479044fc6d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 588631,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/185b9ce1e4e5404ca5386352269a00fd/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dddc1730-e2f6-59ba-acb6-05479044fc6d/dddc1730-e2f6-59ba-acb6-05479044fc6d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 619739,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/185b9ce1e4e5404ca5386352269a00fd/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dddc1730-e2f6-59ba-acb6-05479044fc6d/dddc1730-e2f6-59ba-acb6-05479044fc6d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 293498,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/185b9ce1e4e5404ca5386352269a00fd/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dddc1730-e2f6-59ba-acb6-05479044fc6d/dddc1730-e2f6-59ba-acb6-05479044fc6d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 303061,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/185b9ce1e4e5404ca5386352269a00fd/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dddc1730-e2f6-59ba-acb6-05479044fc6d/dddc1730-e2f6-59ba-acb6-05479044fc6d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 348028,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/185b9ce1e4e5404ca5386352269a00fd/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dddc1730-e2f6-59ba-acb6-05479044fc6d/dddc1730-e2f6-59ba-acb6-05479044fc6d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 340188,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/185b9ce1e4e5404ca5386352269a00fd/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dddc1730-e2f6-59ba-acb6-05479044fc6d/dddc1730-e2f6-59ba-acb6-05479044fc6d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 272802,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/185b9ce1e4e5404ca5386352269a00fd/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dddc1730-e2f6-59ba-acb6-05479044fc6d/dddc1730-e2f6-59ba-acb6-05479044fc6d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 306544,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/185b9ce1e4e5404ca5386352269a00fd/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A3 1.4 40 TFSI E S TRON. ADVANCED SPORTBACK',
 'transmission': 'automatic',
 'trim': '1.4 40 TFSI E S TRON. ADVANCED SPORTBACK',
 'vin': None,
 'year': 2022}
2026-03-26 22:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985630%27 HTTP/1.1" 200 None
2026-03-26 22:56:54 [ayvens.be] INFO: Saving data for 1985630: {'created_time': 1774565814.953012, 'last_price_update_time': 1774565814.953021, 'auction_closing_time': 1774958400.0}
2026-03-26 22:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985630') HTTP/1.1" 204 0
2026-03-26 22:56:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/4c7eeccd3ab2438c96befe3f2673deb3/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/4c7eeccd3ab2438c96befe3f2673deb3/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F53b43c22097d439f900cec9a2e5e6510%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/53b43c22097d439f900cec9a2e5e6510/images/large/3.jpg not downloaded yet
2026-03-26 22:56:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b792ce90>
2026-03-26 22:56:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b0f1bfc-61ef-5df4-9193-0b96111023d6/5b0f1bfc-61ef-5df4-9193-0b96111023d6_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F4c7eeccd3ab2438c96befe3f2673deb3%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/4c7eeccd3ab2438c96befe3f2673deb3/images/large/2.jpg saved to cache
2026-03-26 22:56:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5b0f1bfc-61ef-5df4-9193-0b96111023d6
2026-03-26 22:56:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7913710>
2026-03-26 22:56:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b0f1bfc-61ef-5df4-9193-0b96111023d6/5b0f1bfc-61ef-5df4-9193-0b96111023d6_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F4c7eeccd3ab2438c96befe3f2673deb3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/4c7eeccd3ab2438c96befe3f2673deb3/images/large/1.jpg saved to cache
2026-03-26 22:56:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5b0f1bfc-61ef-5df4-9193-0b96111023d6
2026-03-26 22:56:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/4c7eeccd3ab2438c96befe3f2673deb3/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/4c7eeccd3ab2438c96befe3f2673deb3/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/4c7eeccd3ab2438c96befe3f2673deb3/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/4c7eeccd3ab2438c96befe3f2673deb3/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/4c7eeccd3ab2438c96befe3f2673deb3/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F53b43c22097d439f900cec9a2e5e6510%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/53b43c22097d439f900cec9a2e5e6510/images/large/4.jpg not downloaded yet
2026-03-26 22:56:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79f8210>
2026-03-26 22:56:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b0f1bfc-61ef-5df4-9193-0b96111023d6/5b0f1bfc-61ef-5df4-9193-0b96111023d6_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F4c7eeccd3ab2438c96befe3f2673deb3%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/4c7eeccd3ab2438c96befe3f2673deb3/images/large/3.jpg saved to cache
2026-03-26 22:56:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5b0f1bfc-61ef-5df4-9193-0b96111023d6
2026-03-26 22:56:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7459f90>
2026-03-26 22:56:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b0f1bfc-61ef-5df4-9193-0b96111023d6/5b0f1bfc-61ef-5df4-9193-0b96111023d6_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F4c7eeccd3ab2438c96befe3f2673deb3%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/4c7eeccd3ab2438c96befe3f2673deb3/images/large/5.jpg saved to cache
2026-03-26 22:56:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5b0f1bfc-61ef-5df4-9193-0b96111023d6
2026-03-26 22:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F53b43c22097d439f900cec9a2e5e6510%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/53b43c22097d439f900cec9a2e5e6510/images/large/5.jpg not downloaded yet
2026-03-26 22:56:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/4c7eeccd3ab2438c96befe3f2673deb3/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F53b43c22097d439f900cec9a2e5e6510%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/53b43c22097d439f900cec9a2e5e6510/images/large/6.jpg not downloaded yet
2026-03-26 22:56:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79ce3d0>
2026-03-26 22:56:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b0f1bfc-61ef-5df4-9193-0b96111023d6/5b0f1bfc-61ef-5df4-9193-0b96111023d6_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F4c7eeccd3ab2438c96befe3f2673deb3%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/4c7eeccd3ab2438c96befe3f2673deb3/images/large/6.jpg saved to cache
2026-03-26 22:56:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5b0f1bfc-61ef-5df4-9193-0b96111023d6
2026-03-26 22:56:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7ca8d90>
2026-03-26 22:56:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b0f1bfc-61ef-5df4-9193-0b96111023d6/5b0f1bfc-61ef-5df4-9193-0b96111023d6_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F4c7eeccd3ab2438c96befe3f2673deb3%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/4c7eeccd3ab2438c96befe3f2673deb3/images/large/7.jpg saved to cache
2026-03-26 22:56:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5b0f1bfc-61ef-5df4-9193-0b96111023d6
2026-03-26 22:56:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74a4c50>
2026-03-26 22:56:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b0f1bfc-61ef-5df4-9193-0b96111023d6/5b0f1bfc-61ef-5df4-9193-0b96111023d6_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F4c7eeccd3ab2438c96befe3f2673deb3%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/4c7eeccd3ab2438c96befe3f2673deb3/images/large/9.jpg saved to cache
2026-03-26 22:56:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5b0f1bfc-61ef-5df4-9193-0b96111023d6
2026-03-26 22:56:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c829d0>
2026-03-26 22:56:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b0f1bfc-61ef-5df4-9193-0b96111023d6/5b0f1bfc-61ef-5df4-9193-0b96111023d6_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F4c7eeccd3ab2438c96befe3f2673deb3%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/4c7eeccd3ab2438c96befe3f2673deb3/images/large/4.jpg saved to cache
2026-03-26 22:56:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5b0f1bfc-61ef-5df4-9193-0b96111023d6
2026-03-26 22:56:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b764a950>
2026-03-26 22:56:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b0f1bfc-61ef-5df4-9193-0b96111023d6/5b0f1bfc-61ef-5df4-9193-0b96111023d6_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F4c7eeccd3ab2438c96befe3f2673deb3%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/4c7eeccd3ab2438c96befe3f2673deb3/images/large/8.jpg saved to cache
2026-03-26 22:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5b0f1bfc-61ef-5df4-9193-0b96111023d6
2026-03-26 22:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F53b43c22097d439f900cec9a2e5e6510%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/53b43c22097d439f900cec9a2e5e6510/images/large/7.jpg not downloaded yet
2026-03-26 22:56:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7a81a90>
2026-03-26 22:56:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b0f1bfc-61ef-5df4-9193-0b96111023d6/5b0f1bfc-61ef-5df4-9193-0b96111023d6_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F4c7eeccd3ab2438c96befe3f2673deb3%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/4c7eeccd3ab2438c96befe3f2673deb3/images/large/10.jpg saved to cache
2026-03-26 22:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5b0f1bfc-61ef-5df4-9193-0b96111023d6
2026-03-26 22:56:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5b0f1bfc-61ef-5df4-9193-0b96111023d6, skipping ID generation
2026-03-26 22:56:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b0f1bfc-61ef-5df4-9193-0b96111023d6 with scrape type 1
2026-03-26 22:56:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5b0f1bfc-61ef-5df4-9193-0b96111023d6 sending to next pipeline
2026-03-26 22:56:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 5b0f1bfc-61ef-5df4-9193-0b96111023d6, identifier: 1985631
2026-03-26 22:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F53b43c22097d439f900cec9a2e5e6510%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/53b43c22097d439f900cec9a2e5e6510/images/large/8.jpg not downloaded yet
2026-03-26 22:56:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 5b0f1bfc-61ef-5df4-9193-0b96111023d6 with identifier: 1985631
2026-03-26 22:56:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 5b0f1bfc-61ef-5df4-9193-0b96111023d6 with identifier: 1985631
2026-03-26 22:56:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 5b0f1bfc-61ef-5df4-9193-0b96111023d6 with identifier: 1985631 to the API
2026-03-26 22:56:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:56:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:56:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bj/4c7eeccd3ab2438c96befe3f2673deb3/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '5b0f1bfc-61ef-5df4-9193-0b96111023d6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'Golf',
 'odometer': 123123,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b0f1bfc-61ef-5df4-9193-0b96111023d6/5b0f1bfc-61ef-5df4-9193-0b96111023d6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 456777,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/4c7eeccd3ab2438c96befe3f2673deb3/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b0f1bfc-61ef-5df4-9193-0b96111023d6/5b0f1bfc-61ef-5df4-9193-0b96111023d6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 410923,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/4c7eeccd3ab2438c96befe3f2673deb3/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b0f1bfc-61ef-5df4-9193-0b96111023d6/5b0f1bfc-61ef-5df4-9193-0b96111023d6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 391316,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/4c7eeccd3ab2438c96befe3f2673deb3/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b0f1bfc-61ef-5df4-9193-0b96111023d6/5b0f1bfc-61ef-5df4-9193-0b96111023d6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 390671,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/4c7eeccd3ab2438c96befe3f2673deb3/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b0f1bfc-61ef-5df4-9193-0b96111023d6/5b0f1bfc-61ef-5df4-9193-0b96111023d6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 356235,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/4c7eeccd3ab2438c96befe3f2673deb3/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b0f1bfc-61ef-5df4-9193-0b96111023d6/5b0f1bfc-61ef-5df4-9193-0b96111023d6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 388989,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/4c7eeccd3ab2438c96befe3f2673deb3/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b0f1bfc-61ef-5df4-9193-0b96111023d6/5b0f1bfc-61ef-5df4-9193-0b96111023d6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 342359,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/4c7eeccd3ab2438c96befe3f2673deb3/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b0f1bfc-61ef-5df4-9193-0b96111023d6/5b0f1bfc-61ef-5df4-9193-0b96111023d6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 352414,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/4c7eeccd3ab2438c96befe3f2673deb3/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b0f1bfc-61ef-5df4-9193-0b96111023d6/5b0f1bfc-61ef-5df4-9193-0b96111023d6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 254640,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/4c7eeccd3ab2438c96befe3f2673deb3/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b0f1bfc-61ef-5df4-9193-0b96111023d6/5b0f1bfc-61ef-5df4-9193-0b96111023d6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 314677,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/4c7eeccd3ab2438c96befe3f2673deb3/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN Golf 2.0 TDI 110KW DSG LIFE',
 'transmission': 'automatic',
 'trim': '2.0 TDI 110KW DSG LIFE',
 'vin': None,
 'year': 2021}
2026-03-26 22:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985631%27 HTTP/1.1" 200 None
2026-03-26 22:56:56 [ayvens.be] INFO: Saving data for 1985631: {'created_time': 1774565816.558923, 'last_price_update_time': 1774565816.558933, 'auction_closing_time': 1774958400.0}
2026-03-26 22:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985631') HTTP/1.1" 204 0
2026-03-26 22:56:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/53b43c22097d439f900cec9a2e5e6510/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/53b43c22097d439f900cec9a2e5e6510/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F53b43c22097d439f900cec9a2e5e6510%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/53b43c22097d439f900cec9a2e5e6510/images/large/9.jpg not downloaded yet
2026-03-26 22:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F53b43c22097d439f900cec9a2e5e6510%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/53b43c22097d439f900cec9a2e5e6510/images/large/10.jpg not downloaded yet
2026-03-26 22:56:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/53b43c22097d439f900cec9a2e5e6510/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/53b43c22097d439f900cec9a2e5e6510/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/53b43c22097d439f900cec9a2e5e6510/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:56 [ayvens.be] INFO: Found listing with ID: 1985633
2026-03-26 22:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985633%27 HTTP/1.1" 200 None
2026-03-26 22:56:56 [ayvens.be] INFO: Scrape type for 1985633: 1
2026-03-26 22:56:56 [ayvens.be] INFO: Extracting data for car ID: 1985633
2026-03-26 22:56:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d047eea3-306f-5f94-83ed-56eb33ac1de2 with identifier: 1985633
2026-03-26 22:56:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d047eea3-306f-5f94-83ed-56eb33ac1de2 with scrape type 1
2026-03-26 22:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d047eea3-306f-5f94-83ed-56eb33ac1de2
2026-03-26 22:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F7480c7db8d7e4558aa677de132664276%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/7480c7db8d7e4558aa677de132664276/images/large/1.jpg not downloaded yet
2026-03-26 22:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F7480c7db8d7e4558aa677de132664276%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/7480c7db8d7e4558aa677de132664276/images/large/2.jpg not downloaded yet
2026-03-26 22:56:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7ccc390>
2026-03-26 22:56:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85724f90-0dfe-56d9-843c-ec02c68eed02/85724f90-0dfe-56d9-843c-ec02c68eed02_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F53b43c22097d439f900cec9a2e5e6510%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/53b43c22097d439f900cec9a2e5e6510/images/large/2.jpg saved to cache
2026-03-26 22:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 85724f90-0dfe-56d9-843c-ec02c68eed02
2026-03-26 22:56:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c7cb50>
2026-03-26 22:56:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85724f90-0dfe-56d9-843c-ec02c68eed02/85724f90-0dfe-56d9-843c-ec02c68eed02_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F53b43c22097d439f900cec9a2e5e6510%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/53b43c22097d439f900cec9a2e5e6510/images/large/1.jpg saved to cache
2026-03-26 22:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 85724f90-0dfe-56d9-843c-ec02c68eed02
2026-03-26 22:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F7480c7db8d7e4558aa677de132664276%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/7480c7db8d7e4558aa677de132664276/images/large/3.jpg not downloaded yet
2026-03-26 22:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F7480c7db8d7e4558aa677de132664276%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/7480c7db8d7e4558aa677de132664276/images/large/4.jpg not downloaded yet
2026-03-26 22:56:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/53b43c22097d439f900cec9a2e5e6510/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c6b150>
2026-03-26 22:56:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85724f90-0dfe-56d9-843c-ec02c68eed02/85724f90-0dfe-56d9-843c-ec02c68eed02_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F53b43c22097d439f900cec9a2e5e6510%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/53b43c22097d439f900cec9a2e5e6510/images/large/3.jpg saved to cache
2026-03-26 22:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 85724f90-0dfe-56d9-843c-ec02c68eed02
2026-03-26 22:56:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cb3f90>
2026-03-26 22:56:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85724f90-0dfe-56d9-843c-ec02c68eed02/85724f90-0dfe-56d9-843c-ec02c68eed02_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F53b43c22097d439f900cec9a2e5e6510%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/53b43c22097d439f900cec9a2e5e6510/images/large/4.jpg saved to cache
2026-03-26 22:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 85724f90-0dfe-56d9-843c-ec02c68eed02
2026-03-26 22:56:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7769bd0>
2026-03-26 22:56:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85724f90-0dfe-56d9-843c-ec02c68eed02/85724f90-0dfe-56d9-843c-ec02c68eed02_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F53b43c22097d439f900cec9a2e5e6510%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/53b43c22097d439f900cec9a2e5e6510/images/large/5.jpg saved to cache
2026-03-26 22:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 85724f90-0dfe-56d9-843c-ec02c68eed02
2026-03-26 22:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F7480c7db8d7e4558aa677de132664276%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/7480c7db8d7e4558aa677de132664276/images/large/5.jpg not downloaded yet
2026-03-26 22:56:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/53b43c22097d439f900cec9a2e5e6510/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F7480c7db8d7e4558aa677de132664276%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/7480c7db8d7e4558aa677de132664276/images/large/6.jpg not downloaded yet
2026-03-26 22:56:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7947510>
2026-03-26 22:56:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85724f90-0dfe-56d9-843c-ec02c68eed02/85724f90-0dfe-56d9-843c-ec02c68eed02_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F53b43c22097d439f900cec9a2e5e6510%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/53b43c22097d439f900cec9a2e5e6510/images/large/9.jpg saved to cache
2026-03-26 22:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 85724f90-0dfe-56d9-843c-ec02c68eed02
2026-03-26 22:56:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/53b43c22097d439f900cec9a2e5e6510/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F7480c7db8d7e4558aa677de132664276%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/7480c7db8d7e4558aa677de132664276/images/large/7.jpg not downloaded yet
2026-03-26 22:56:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/53b43c22097d439f900cec9a2e5e6510/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F7480c7db8d7e4558aa677de132664276%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/7480c7db8d7e4558aa677de132664276/images/large/8.jpg not downloaded yet
2026-03-26 22:56:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b89b50>
2026-03-26 22:56:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85724f90-0dfe-56d9-843c-ec02c68eed02/85724f90-0dfe-56d9-843c-ec02c68eed02_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F53b43c22097d439f900cec9a2e5e6510%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/53b43c22097d439f900cec9a2e5e6510/images/large/7.jpg saved to cache
2026-03-26 22:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 85724f90-0dfe-56d9-843c-ec02c68eed02
2026-03-26 22:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F7480c7db8d7e4558aa677de132664276%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/7480c7db8d7e4558aa677de132664276/images/large/9.jpg not downloaded yet
2026-03-26 22:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F7480c7db8d7e4558aa677de132664276%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/7480c7db8d7e4558aa677de132664276/images/large/10.jpg not downloaded yet
2026-03-26 22:56:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/7480c7db8d7e4558aa677de132664276/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/53b43c22097d439f900cec9a2e5e6510/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/7480c7db8d7e4558aa677de132664276/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:57 [ayvens.be] INFO: Found listing with ID: 1985634
2026-03-26 22:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985634%27 HTTP/1.1" 200 None
2026-03-26 22:56:57 [ayvens.be] INFO: Scrape type for 1985634: 1
2026-03-26 22:56:57 [ayvens.be] INFO: Extracting data for car ID: 1985634
2026-03-26 22:56:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 70b87bb0-cccb-5170-837d-4e434418cb6c with identifier: 1985634
2026-03-26 22:56:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70b87bb0-cccb-5170-837d-4e434418cb6c with scrape type 1
2026-03-26 22:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 70b87bb0-cccb-5170-837d-4e434418cb6c
2026-03-26 22:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252F4634c461a35048f09007ed3bfe8ea287%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/4634c461a35048f09007ed3bfe8ea287/images/large/1.jpg not downloaded yet
2026-03-26 22:56:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76cfd50>
2026-03-26 22:56:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85724f90-0dfe-56d9-843c-ec02c68eed02/85724f90-0dfe-56d9-843c-ec02c68eed02_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F53b43c22097d439f900cec9a2e5e6510%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/53b43c22097d439f900cec9a2e5e6510/images/large/8.jpg saved to cache
2026-03-26 22:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 85724f90-0dfe-56d9-843c-ec02c68eed02
2026-03-26 22:56:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7a82d10>
2026-03-26 22:56:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85724f90-0dfe-56d9-843c-ec02c68eed02/85724f90-0dfe-56d9-843c-ec02c68eed02_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F53b43c22097d439f900cec9a2e5e6510%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/53b43c22097d439f900cec9a2e5e6510/images/large/10.jpg saved to cache
2026-03-26 22:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 85724f90-0dfe-56d9-843c-ec02c68eed02
2026-03-26 22:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252F4634c461a35048f09007ed3bfe8ea287%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/4634c461a35048f09007ed3bfe8ea287/images/large/2.jpg not downloaded yet
2026-03-26 22:56:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e14b10>
2026-03-26 22:56:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d047eea3-306f-5f94-83ed-56eb33ac1de2/d047eea3-306f-5f94-83ed-56eb33ac1de2_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F7480c7db8d7e4558aa677de132664276%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/7480c7db8d7e4558aa677de132664276/images/large/1.jpg saved to cache
2026-03-26 22:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d047eea3-306f-5f94-83ed-56eb33ac1de2
2026-03-26 22:56:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c5c390>
2026-03-26 22:56:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85724f90-0dfe-56d9-843c-ec02c68eed02/85724f90-0dfe-56d9-843c-ec02c68eed02_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F53b43c22097d439f900cec9a2e5e6510%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/53b43c22097d439f900cec9a2e5e6510/images/large/6.jpg saved to cache
2026-03-26 22:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 85724f90-0dfe-56d9-843c-ec02c68eed02
2026-03-26 22:56:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 85724f90-0dfe-56d9-843c-ec02c68eed02, skipping ID generation
2026-03-26 22:56:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85724f90-0dfe-56d9-843c-ec02c68eed02 with scrape type 1
2026-03-26 22:56:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 85724f90-0dfe-56d9-843c-ec02c68eed02 sending to next pipeline
2026-03-26 22:56:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 85724f90-0dfe-56d9-843c-ec02c68eed02, identifier: 1985632
2026-03-26 22:56:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7a60810>
2026-03-26 22:56:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d047eea3-306f-5f94-83ed-56eb33ac1de2/d047eea3-306f-5f94-83ed-56eb33ac1de2_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F7480c7db8d7e4558aa677de132664276%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/7480c7db8d7e4558aa677de132664276/images/large/2.jpg saved to cache
2026-03-26 22:56:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d047eea3-306f-5f94-83ed-56eb33ac1de2
2026-03-26 22:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252F4634c461a35048f09007ed3bfe8ea287%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/4634c461a35048f09007ed3bfe8ea287/images/large/3.jpg not downloaded yet
2026-03-26 22:56:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 85724f90-0dfe-56d9-843c-ec02c68eed02 with identifier: 1985632
2026-03-26 22:56:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 85724f90-0dfe-56d9-843c-ec02c68eed02 with identifier: 1985632
2026-03-26 22:56:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 85724f90-0dfe-56d9-843c-ec02c68eed02 with identifier: 1985632 to the API
2026-03-26 22:56:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:56:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:56:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bn/53b43c22097d439f900cec9a2e5e6510/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.3L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '85724f90-0dfe-56d9-843c-ec02c68eed02',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A-CLASS LIMOUSINE',
 'odometer': 126988,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85724f90-0dfe-56d9-843c-ec02c68eed02/85724f90-0dfe-56d9-843c-ec02c68eed02_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 526096,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/53b43c22097d439f900cec9a2e5e6510/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85724f90-0dfe-56d9-843c-ec02c68eed02/85724f90-0dfe-56d9-843c-ec02c68eed02_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 546961,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/53b43c22097d439f900cec9a2e5e6510/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85724f90-0dfe-56d9-843c-ec02c68eed02/85724f90-0dfe-56d9-843c-ec02c68eed02_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 551769,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/53b43c22097d439f900cec9a2e5e6510/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85724f90-0dfe-56d9-843c-ec02c68eed02/85724f90-0dfe-56d9-843c-ec02c68eed02_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 525626,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/53b43c22097d439f900cec9a2e5e6510/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85724f90-0dfe-56d9-843c-ec02c68eed02/85724f90-0dfe-56d9-843c-ec02c68eed02_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 349336,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/53b43c22097d439f900cec9a2e5e6510/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85724f90-0dfe-56d9-843c-ec02c68eed02/85724f90-0dfe-56d9-843c-ec02c68eed02_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 307734,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/53b43c22097d439f900cec9a2e5e6510/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85724f90-0dfe-56d9-843c-ec02c68eed02/85724f90-0dfe-56d9-843c-ec02c68eed02_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 459270,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/53b43c22097d439f900cec9a2e5e6510/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85724f90-0dfe-56d9-843c-ec02c68eed02/85724f90-0dfe-56d9-843c-ec02c68eed02_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 390563,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/53b43c22097d439f900cec9a2e5e6510/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85724f90-0dfe-56d9-843c-ec02c68eed02/85724f90-0dfe-56d9-843c-ec02c68eed02_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 299588,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/53b43c22097d439f900cec9a2e5e6510/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85724f90-0dfe-56d9-843c-ec02c68eed02/85724f90-0dfe-56d9-843c-ec02c68eed02_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 428437,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/53b43c22097d439f900cec9a2e5e6510/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ A-CLASS LIMOUSINE 1.3 A 180 BUSINESS SOLUTION',
 'transmission': 'manual',
 'trim': '1.3 A 180 BUSINESS SOLUTION',
 'vin': None,
 'year': 2022}
2026-03-26 22:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985632%27 HTTP/1.1" 200 None
2026-03-26 22:56:58 [ayvens.be] INFO: Saving data for 1985632: {'created_time': 1774565818.382628, 'last_price_update_time': 1774565818.382639, 'auction_closing_time': 1774958400.0}
2026-03-26 22:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985632') HTTP/1.1" 204 0
2026-03-26 22:56:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/7480c7db8d7e4558aa677de132664276/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252F4634c461a35048f09007ed3bfe8ea287%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/4634c461a35048f09007ed3bfe8ea287/images/large/4.jpg not downloaded yet
2026-03-26 22:56:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/7480c7db8d7e4558aa677de132664276/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/7480c7db8d7e4558aa677de132664276/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252F4634c461a35048f09007ed3bfe8ea287%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/4634c461a35048f09007ed3bfe8ea287/images/large/5.jpg not downloaded yet
2026-03-26 22:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252F4634c461a35048f09007ed3bfe8ea287%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/4634c461a35048f09007ed3bfe8ea287/images/large/6.jpg not downloaded yet
2026-03-26 22:56:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/7480c7db8d7e4558aa677de132664276/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252F4634c461a35048f09007ed3bfe8ea287%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/4634c461a35048f09007ed3bfe8ea287/images/large/7.jpg not downloaded yet
2026-03-26 22:56:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/7480c7db8d7e4558aa677de132664276/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252F4634c461a35048f09007ed3bfe8ea287%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/4634c461a35048f09007ed3bfe8ea287/images/large/8.jpg not downloaded yet
2026-03-26 22:56:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/7480c7db8d7e4558aa677de132664276/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252F4634c461a35048f09007ed3bfe8ea287%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/4634c461a35048f09007ed3bfe8ea287/images/large/9.jpg not downloaded yet
2026-03-26 22:56:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/7480c7db8d7e4558aa677de132664276/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/7480c7db8d7e4558aa677de132664276/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76c7f90>
2026-03-26 22:56:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d047eea3-306f-5f94-83ed-56eb33ac1de2/d047eea3-306f-5f94-83ed-56eb33ac1de2_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F7480c7db8d7e4558aa677de132664276%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/7480c7db8d7e4558aa677de132664276/images/large/3.jpg saved to cache
2026-03-26 22:56:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d047eea3-306f-5f94-83ed-56eb33ac1de2
2026-03-26 22:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252F4634c461a35048f09007ed3bfe8ea287%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/4634c461a35048f09007ed3bfe8ea287/images/large/10.jpg not downloaded yet
2026-03-26 22:56:58 [ayvens.be] INFO: Found listing with ID: 1985635
2026-03-26 22:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985635%27 HTTP/1.1" 200 None
2026-03-26 22:56:58 [ayvens.be] INFO: Scrape type for 1985635: 1
2026-03-26 22:56:58 [ayvens.be] INFO: Extracting data for car ID: 1985635
2026-03-26 22:56:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 641cc868-a13f-553c-85d9-2731744fa2f3 with identifier: 1985635
2026-03-26 22:56:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 641cc868-a13f-553c-85d9-2731744fa2f3 with scrape type 1
2026-03-26 22:56:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 641cc868-a13f-553c-85d9-2731744fa2f3
2026-03-26 22:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F670b978f8f8349369e4ddca8ff700145%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/670b978f8f8349369e4ddca8ff700145/images/large/1.jpg not downloaded yet
2026-03-26 22:56:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7495410>
2026-03-26 22:56:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d047eea3-306f-5f94-83ed-56eb33ac1de2/d047eea3-306f-5f94-83ed-56eb33ac1de2_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F7480c7db8d7e4558aa677de132664276%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/7480c7db8d7e4558aa677de132664276/images/large/4.jpg saved to cache
2026-03-26 22:56:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d047eea3-306f-5f94-83ed-56eb33ac1de2
2026-03-26 22:56:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e35750>
2026-03-26 22:56:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d047eea3-306f-5f94-83ed-56eb33ac1de2/d047eea3-306f-5f94-83ed-56eb33ac1de2_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F7480c7db8d7e4558aa677de132664276%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/7480c7db8d7e4558aa677de132664276/images/large/5.jpg saved to cache
2026-03-26 22:56:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d047eea3-306f-5f94-83ed-56eb33ac1de2
2026-03-26 22:56:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76887d0>
2026-03-26 22:56:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d047eea3-306f-5f94-83ed-56eb33ac1de2/d047eea3-306f-5f94-83ed-56eb33ac1de2_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F7480c7db8d7e4558aa677de132664276%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/7480c7db8d7e4558aa677de132664276/images/large/7.jpg saved to cache
2026-03-26 22:56:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d047eea3-306f-5f94-83ed-56eb33ac1de2
2026-03-26 22:56:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7689550>
2026-03-26 22:56:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d047eea3-306f-5f94-83ed-56eb33ac1de2/d047eea3-306f-5f94-83ed-56eb33ac1de2_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F7480c7db8d7e4558aa677de132664276%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/7480c7db8d7e4558aa677de132664276/images/large/6.jpg saved to cache
2026-03-26 22:56:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d047eea3-306f-5f94-83ed-56eb33ac1de2
2026-03-26 22:56:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7407d50>
2026-03-26 22:56:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d047eea3-306f-5f94-83ed-56eb33ac1de2/d047eea3-306f-5f94-83ed-56eb33ac1de2_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F7480c7db8d7e4558aa677de132664276%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/7480c7db8d7e4558aa677de132664276/images/large/10.jpg saved to cache
2026-03-26 22:56:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d047eea3-306f-5f94-83ed-56eb33ac1de2
2026-03-26 22:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F670b978f8f8349369e4ddca8ff700145%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/670b978f8f8349369e4ddca8ff700145/images/large/2.jpg not downloaded yet
2026-03-26 22:56:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74168d0>
2026-03-26 22:56:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d047eea3-306f-5f94-83ed-56eb33ac1de2/d047eea3-306f-5f94-83ed-56eb33ac1de2_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F7480c7db8d7e4558aa677de132664276%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/7480c7db8d7e4558aa677de132664276/images/large/9.jpg saved to cache
2026-03-26 22:56:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d047eea3-306f-5f94-83ed-56eb33ac1de2
2026-03-26 22:56:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7269390>
2026-03-26 22:56:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d047eea3-306f-5f94-83ed-56eb33ac1de2/d047eea3-306f-5f94-83ed-56eb33ac1de2_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F7480c7db8d7e4558aa677de132664276%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/7480c7db8d7e4558aa677de132664276/images/large/8.jpg saved to cache
2026-03-26 22:56:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d047eea3-306f-5f94-83ed-56eb33ac1de2
2026-03-26 22:56:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d047eea3-306f-5f94-83ed-56eb33ac1de2, skipping ID generation
2026-03-26 22:56:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d047eea3-306f-5f94-83ed-56eb33ac1de2 with scrape type 1
2026-03-26 22:56:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d047eea3-306f-5f94-83ed-56eb33ac1de2 sending to next pipeline
2026-03-26 22:56:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d047eea3-306f-5f94-83ed-56eb33ac1de2, identifier: 1985633
2026-03-26 22:56:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cb/4634c461a35048f09007ed3bfe8ea287/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F670b978f8f8349369e4ddca8ff700145%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/670b978f8f8349369e4ddca8ff700145/images/large/3.jpg not downloaded yet
2026-03-26 22:56:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d047eea3-306f-5f94-83ed-56eb33ac1de2 with identifier: 1985633
2026-03-26 22:56:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d047eea3-306f-5f94-83ed-56eb33ac1de2 with identifier: 1985633
2026-03-26 22:56:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d047eea3-306f-5f94-83ed-56eb33ac1de2 with identifier: 1985633 to the API
2026-03-26 22:56:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:56:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:56:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bs/7480c7db8d7e4558aa677de132664276/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'd047eea3-306f-5f94-83ed-56eb33ac1de2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '3 SERIES BERLINE',
 'odometer': 74124,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d047eea3-306f-5f94-83ed-56eb33ac1de2/d047eea3-306f-5f94-83ed-56eb33ac1de2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 714395,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/7480c7db8d7e4558aa677de132664276/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d047eea3-306f-5f94-83ed-56eb33ac1de2/d047eea3-306f-5f94-83ed-56eb33ac1de2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 729578,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/7480c7db8d7e4558aa677de132664276/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d047eea3-306f-5f94-83ed-56eb33ac1de2/d047eea3-306f-5f94-83ed-56eb33ac1de2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 695664,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/7480c7db8d7e4558aa677de132664276/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d047eea3-306f-5f94-83ed-56eb33ac1de2/d047eea3-306f-5f94-83ed-56eb33ac1de2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 740964,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/7480c7db8d7e4558aa677de132664276/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d047eea3-306f-5f94-83ed-56eb33ac1de2/d047eea3-306f-5f94-83ed-56eb33ac1de2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 725564,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/7480c7db8d7e4558aa677de132664276/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d047eea3-306f-5f94-83ed-56eb33ac1de2/d047eea3-306f-5f94-83ed-56eb33ac1de2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 817529,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/7480c7db8d7e4558aa677de132664276/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d047eea3-306f-5f94-83ed-56eb33ac1de2/d047eea3-306f-5f94-83ed-56eb33ac1de2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 645069,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/7480c7db8d7e4558aa677de132664276/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d047eea3-306f-5f94-83ed-56eb33ac1de2/d047eea3-306f-5f94-83ed-56eb33ac1de2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 796201,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/7480c7db8d7e4558aa677de132664276/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d047eea3-306f-5f94-83ed-56eb33ac1de2/d047eea3-306f-5f94-83ed-56eb33ac1de2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 820975,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/7480c7db8d7e4558aa677de132664276/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d047eea3-306f-5f94-83ed-56eb33ac1de2/d047eea3-306f-5f94-83ed-56eb33ac1de2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 701231,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/7480c7db8d7e4558aa677de132664276/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3 SERIES BERLINE 2.0 320E BERLINE',
 'transmission': 'automatic',
 'trim': '2.0 320E BERLINE',
 'vin': None,
 'year': 2022}
2026-03-26 22:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985633%27 HTTP/1.1" 200 None
2026-03-26 22:56:59 [ayvens.be] INFO: Saving data for 1985633: {'created_time': 1774565819.800965, 'last_price_update_time': 1774565819.800974, 'auction_closing_time': 1774958400.0}
2026-03-26 22:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985633') HTTP/1.1" 204 0
2026-03-26 22:56:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cb/4634c461a35048f09007ed3bfe8ea287/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cb/4634c461a35048f09007ed3bfe8ea287/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F670b978f8f8349369e4ddca8ff700145%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/670b978f8f8349369e4ddca8ff700145/images/large/4.jpg not downloaded yet
2026-03-26 22:56:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cb/4634c461a35048f09007ed3bfe8ea287/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5ca4ad0>
2026-03-26 22:56:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:56:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70b87bb0-cccb-5170-837d-4e434418cb6c/70b87bb0-cccb-5170-837d-4e434418cb6c_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252F4634c461a35048f09007ed3bfe8ea287%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:56:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/4634c461a35048f09007ed3bfe8ea287/images/large/1.jpg saved to cache
2026-03-26 22:56:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 70b87bb0-cccb-5170-837d-4e434418cb6c
2026-03-26 22:56:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cb/4634c461a35048f09007ed3bfe8ea287/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F670b978f8f8349369e4ddca8ff700145%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/670b978f8f8349369e4ddca8ff700145/images/large/5.jpg not downloaded yet
2026-03-26 22:56:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cb/4634c461a35048f09007ed3bfe8ea287/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F670b978f8f8349369e4ddca8ff700145%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:56:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/670b978f8f8349369e4ddca8ff700145/images/large/6.jpg not downloaded yet
2026-03-26 22:56:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:56:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77ac310>
2026-03-26 22:56:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:56:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:56:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70b87bb0-cccb-5170-837d-4e434418cb6c/70b87bb0-cccb-5170-837d-4e434418cb6c_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252F4634c461a35048f09007ed3bfe8ea287%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/4634c461a35048f09007ed3bfe8ea287/images/large/3.jpg saved to cache
2026-03-26 22:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 70b87bb0-cccb-5170-837d-4e434418cb6c
2026-03-26 22:57:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7416510>
2026-03-26 22:57:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70b87bb0-cccb-5170-837d-4e434418cb6c/70b87bb0-cccb-5170-837d-4e434418cb6c_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252F4634c461a35048f09007ed3bfe8ea287%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/4634c461a35048f09007ed3bfe8ea287/images/large/2.jpg saved to cache
2026-03-26 22:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 70b87bb0-cccb-5170-837d-4e434418cb6c
2026-03-26 22:57:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cb/4634c461a35048f09007ed3bfe8ea287/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F670b978f8f8349369e4ddca8ff700145%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/670b978f8f8349369e4ddca8ff700145/images/large/7.jpg not downloaded yet
2026-03-26 22:57:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7a60110>
2026-03-26 22:57:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70b87bb0-cccb-5170-837d-4e434418cb6c/70b87bb0-cccb-5170-837d-4e434418cb6c_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252F4634c461a35048f09007ed3bfe8ea287%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/4634c461a35048f09007ed3bfe8ea287/images/large/6.jpg saved to cache
2026-03-26 22:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 70b87bb0-cccb-5170-837d-4e434418cb6c
2026-03-26 22:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F670b978f8f8349369e4ddca8ff700145%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/670b978f8f8349369e4ddca8ff700145/images/large/8.jpg not downloaded yet
2026-03-26 22:57:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e00250>
2026-03-26 22:57:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70b87bb0-cccb-5170-837d-4e434418cb6c/70b87bb0-cccb-5170-837d-4e434418cb6c_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252F4634c461a35048f09007ed3bfe8ea287%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/4634c461a35048f09007ed3bfe8ea287/images/large/5.jpg saved to cache
2026-03-26 22:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 70b87bb0-cccb-5170-837d-4e434418cb6c
2026-03-26 22:57:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7591150>
2026-03-26 22:57:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70b87bb0-cccb-5170-837d-4e434418cb6c/70b87bb0-cccb-5170-837d-4e434418cb6c_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252F4634c461a35048f09007ed3bfe8ea287%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/4634c461a35048f09007ed3bfe8ea287/images/large/4.jpg saved to cache
2026-03-26 22:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 70b87bb0-cccb-5170-837d-4e434418cb6c
2026-03-26 22:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F670b978f8f8349369e4ddca8ff700145%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/670b978f8f8349369e4ddca8ff700145/images/large/9.jpg not downloaded yet
2026-03-26 22:57:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cb/4634c461a35048f09007ed3bfe8ea287/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F670b978f8f8349369e4ddca8ff700145%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/670b978f8f8349369e4ddca8ff700145/images/large/10.jpg not downloaded yet
2026-03-26 22:57:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7818990>
2026-03-26 22:57:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70b87bb0-cccb-5170-837d-4e434418cb6c/70b87bb0-cccb-5170-837d-4e434418cb6c_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252F4634c461a35048f09007ed3bfe8ea287%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/4634c461a35048f09007ed3bfe8ea287/images/large/7.jpg saved to cache
2026-03-26 22:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 70b87bb0-cccb-5170-837d-4e434418cb6c
2026-03-26 22:57:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cb/4634c461a35048f09007ed3bfe8ea287/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:00 [ayvens.be] INFO: Found listing with ID: 1985636
2026-03-26 22:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985636%27 HTTP/1.1" 200 None
2026-03-26 22:57:00 [ayvens.be] INFO: Scrape type for 1985636: 1
2026-03-26 22:57:00 [ayvens.be] INFO: Extracting data for car ID: 1985636
2026-03-26 22:57:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 86266e6c-be0f-5870-a58f-16ec6650520e with identifier: 1985636
2026-03-26 22:57:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 86266e6c-be0f-5870-a58f-16ec6650520e with scrape type 1
2026-03-26 22:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 86266e6c-be0f-5870-a58f-16ec6650520e
2026-03-26 22:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F7744493e16a349f39bb4adae937f9a94%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/7744493e16a349f39bb4adae937f9a94/images/large/1.jpg not downloaded yet
2026-03-26 22:57:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/670b978f8f8349369e4ddca8ff700145/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/670b978f8f8349369e4ddca8ff700145/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F7744493e16a349f39bb4adae937f9a94%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/7744493e16a349f39bb4adae937f9a94/images/large/2.jpg not downloaded yet
2026-03-26 22:57:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/670b978f8f8349369e4ddca8ff700145/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cb/4634c461a35048f09007ed3bfe8ea287/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F7744493e16a349f39bb4adae937f9a94%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/7744493e16a349f39bb4adae937f9a94/images/large/3.jpg not downloaded yet
2026-03-26 22:57:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7663910>
2026-03-26 22:57:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70b87bb0-cccb-5170-837d-4e434418cb6c/70b87bb0-cccb-5170-837d-4e434418cb6c_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252F4634c461a35048f09007ed3bfe8ea287%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/4634c461a35048f09007ed3bfe8ea287/images/large/9.jpg saved to cache
2026-03-26 22:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 70b87bb0-cccb-5170-837d-4e434418cb6c
2026-03-26 22:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F7744493e16a349f39bb4adae937f9a94%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/7744493e16a349f39bb4adae937f9a94/images/large/4.jpg not downloaded yet
2026-03-26 22:57:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/670b978f8f8349369e4ddca8ff700145/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F7744493e16a349f39bb4adae937f9a94%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/7744493e16a349f39bb4adae937f9a94/images/large/5.jpg not downloaded yet
2026-03-26 22:57:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7927050>
2026-03-26 22:57:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70b87bb0-cccb-5170-837d-4e434418cb6c/70b87bb0-cccb-5170-837d-4e434418cb6c_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252F4634c461a35048f09007ed3bfe8ea287%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/4634c461a35048f09007ed3bfe8ea287/images/large/10.jpg saved to cache
2026-03-26 22:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 70b87bb0-cccb-5170-837d-4e434418cb6c
2026-03-26 22:57:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6df2690>
2026-03-26 22:57:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_641cc868-a13f-553c-85d9-2731744fa2f3/641cc868-a13f-553c-85d9-2731744fa2f3_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F670b978f8f8349369e4ddca8ff700145%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/670b978f8f8349369e4ddca8ff700145/images/large/1.jpg saved to cache
2026-03-26 22:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 641cc868-a13f-553c-85d9-2731744fa2f3
2026-03-26 22:57:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c5c690>
2026-03-26 22:57:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_641cc868-a13f-553c-85d9-2731744fa2f3/641cc868-a13f-553c-85d9-2731744fa2f3_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F670b978f8f8349369e4ddca8ff700145%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/670b978f8f8349369e4ddca8ff700145/images/large/2.jpg saved to cache
2026-03-26 22:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 641cc868-a13f-553c-85d9-2731744fa2f3
2026-03-26 22:57:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74e7f10>
2026-03-26 22:57:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_641cc868-a13f-553c-85d9-2731744fa2f3/641cc868-a13f-553c-85d9-2731744fa2f3_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F670b978f8f8349369e4ddca8ff700145%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/670b978f8f8349369e4ddca8ff700145/images/large/3.jpg saved to cache
2026-03-26 22:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 641cc868-a13f-553c-85d9-2731744fa2f3
2026-03-26 22:57:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cb3910>
2026-03-26 22:57:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70b87bb0-cccb-5170-837d-4e434418cb6c/70b87bb0-cccb-5170-837d-4e434418cb6c_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252F4634c461a35048f09007ed3bfe8ea287%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/4634c461a35048f09007ed3bfe8ea287/images/large/8.jpg saved to cache
2026-03-26 22:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 70b87bb0-cccb-5170-837d-4e434418cb6c
2026-03-26 22:57:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 70b87bb0-cccb-5170-837d-4e434418cb6c, skipping ID generation
2026-03-26 22:57:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70b87bb0-cccb-5170-837d-4e434418cb6c with scrape type 1
2026-03-26 22:57:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 70b87bb0-cccb-5170-837d-4e434418cb6c sending to next pipeline
2026-03-26 22:57:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 70b87bb0-cccb-5170-837d-4e434418cb6c, identifier: 1985634
2026-03-26 22:57:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/670b978f8f8349369e4ddca8ff700145/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F7744493e16a349f39bb4adae937f9a94%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/7744493e16a349f39bb4adae937f9a94/images/large/6.jpg not downloaded yet
2026-03-26 22:57:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 70b87bb0-cccb-5170-837d-4e434418cb6c with identifier: 1985634
2026-03-26 22:57:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 70b87bb0-cccb-5170-837d-4e434418cb6c with identifier: 1985634
2026-03-26 22:57:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 70b87bb0-cccb-5170-837d-4e434418cb6c with identifier: 1985634 to the API
2026-03-26 22:57:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:57:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:57:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cb/4634c461a35048f09007ed3bfe8ea287/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '70b87bb0-cccb-5170-837d-4e434418cb6c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 75053,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70b87bb0-cccb-5170-837d-4e434418cb6c/70b87bb0-cccb-5170-837d-4e434418cb6c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 719967,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cb/4634c461a35048f09007ed3bfe8ea287/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70b87bb0-cccb-5170-837d-4e434418cb6c/70b87bb0-cccb-5170-837d-4e434418cb6c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 682274,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cb/4634c461a35048f09007ed3bfe8ea287/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70b87bb0-cccb-5170-837d-4e434418cb6c/70b87bb0-cccb-5170-837d-4e434418cb6c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 618378,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cb/4634c461a35048f09007ed3bfe8ea287/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70b87bb0-cccb-5170-837d-4e434418cb6c/70b87bb0-cccb-5170-837d-4e434418cb6c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 812841,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cb/4634c461a35048f09007ed3bfe8ea287/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70b87bb0-cccb-5170-837d-4e434418cb6c/70b87bb0-cccb-5170-837d-4e434418cb6c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 627179,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cb/4634c461a35048f09007ed3bfe8ea287/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70b87bb0-cccb-5170-837d-4e434418cb6c/70b87bb0-cccb-5170-837d-4e434418cb6c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 582223,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cb/4634c461a35048f09007ed3bfe8ea287/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70b87bb0-cccb-5170-837d-4e434418cb6c/70b87bb0-cccb-5170-837d-4e434418cb6c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 632893,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cb/4634c461a35048f09007ed3bfe8ea287/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70b87bb0-cccb-5170-837d-4e434418cb6c/70b87bb0-cccb-5170-837d-4e434418cb6c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 805974,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cb/4634c461a35048f09007ed3bfe8ea287/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70b87bb0-cccb-5170-837d-4e434418cb6c/70b87bb0-cccb-5170-837d-4e434418cb6c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 560123,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cb/4634c461a35048f09007ed3bfe8ea287/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70b87bb0-cccb-5170-837d-4e434418cb6c/70b87bb0-cccb-5170-837d-4e434418cb6c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 636618,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cb/4634c461a35048f09007ed3bfe8ea287/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T2 PLUS DARK DESIGN AUTO',
 'transmission': 'automatic',
 'trim': '1.5 T2 PLUS DARK DESIGN AUTO',
 'vin': None,
 'year': 2022}
2026-03-26 22:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985634%27 HTTP/1.1" 200 None
2026-03-26 22:57:01 [ayvens.be] INFO: Saving data for 1985634: {'created_time': 1774565821.679561, 'last_price_update_time': 1774565821.67957, 'auction_closing_time': 1774958400.0}
2026-03-26 22:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985634') HTTP/1.1" 204 0
2026-03-26 22:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F7744493e16a349f39bb4adae937f9a94%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/7744493e16a349f39bb4adae937f9a94/images/large/7.jpg not downloaded yet
2026-03-26 22:57:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/670b978f8f8349369e4ddca8ff700145/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F7744493e16a349f39bb4adae937f9a94%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/7744493e16a349f39bb4adae937f9a94/images/large/8.jpg not downloaded yet
2026-03-26 22:57:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74398d0>
2026-03-26 22:57:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_641cc868-a13f-553c-85d9-2731744fa2f3/641cc868-a13f-553c-85d9-2731744fa2f3_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F670b978f8f8349369e4ddca8ff700145%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/670b978f8f8349369e4ddca8ff700145/images/large/4.jpg saved to cache
2026-03-26 22:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 641cc868-a13f-553c-85d9-2731744fa2f3
2026-03-26 22:57:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76ec250>
2026-03-26 22:57:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_641cc868-a13f-553c-85d9-2731744fa2f3/641cc868-a13f-553c-85d9-2731744fa2f3_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F670b978f8f8349369e4ddca8ff700145%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/670b978f8f8349369e4ddca8ff700145/images/large/5.jpg saved to cache
2026-03-26 22:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 641cc868-a13f-553c-85d9-2731744fa2f3
2026-03-26 22:57:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/670b978f8f8349369e4ddca8ff700145/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F7744493e16a349f39bb4adae937f9a94%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/7744493e16a349f39bb4adae937f9a94/images/large/9.jpg not downloaded yet
2026-03-26 22:57:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/670b978f8f8349369e4ddca8ff700145/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/670b978f8f8349369e4ddca8ff700145/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F7744493e16a349f39bb4adae937f9a94%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/7744493e16a349f39bb4adae937f9a94/images/large/10.jpg not downloaded yet
2026-03-26 22:57:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/670b978f8f8349369e4ddca8ff700145/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76ec510>
2026-03-26 22:57:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_641cc868-a13f-553c-85d9-2731744fa2f3/641cc868-a13f-553c-85d9-2731744fa2f3_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:57:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F670b978f8f8349369e4ddca8ff700145%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/670b978f8f8349369e4ddca8ff700145/images/large/7.jpg saved to cache
2026-03-26 22:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 641cc868-a13f-553c-85d9-2731744fa2f3
2026-03-26 22:57:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/7744493e16a349f39bb4adae937f9a94/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:02 [ayvens.be] INFO: Found listing with ID: 1985637
2026-03-26 22:57:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985637%27 HTTP/1.1" 200 None
2026-03-26 22:57:02 [ayvens.be] INFO: Scrape type for 1985637: 1
2026-03-26 22:57:02 [ayvens.be] INFO: Extracting data for car ID: 1985637
2026-03-26 22:57:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 09a43b0a-c88e-5129-a2da-10bd3bc2cdeb with identifier: 1985637
2026-03-26 22:57:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09a43b0a-c88e-5129-a2da-10bd3bc2cdeb with scrape type 1
2026-03-26 22:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 09a43b0a-c88e-5129-a2da-10bd3bc2cdeb
2026-03-26 22:57:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F2a4f5b7942ed43f5a58e1546c0b602d9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/2a4f5b7942ed43f5a58e1546c0b602d9/images/large/1.jpg not downloaded yet
2026-03-26 22:57:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7aeb310>
2026-03-26 22:57:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_641cc868-a13f-553c-85d9-2731744fa2f3/641cc868-a13f-553c-85d9-2731744fa2f3_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:57:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F670b978f8f8349369e4ddca8ff700145%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/670b978f8f8349369e4ddca8ff700145/images/large/9.jpg saved to cache
2026-03-26 22:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 641cc868-a13f-553c-85d9-2731744fa2f3
2026-03-26 22:57:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/7744493e16a349f39bb4adae937f9a94/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F2a4f5b7942ed43f5a58e1546c0b602d9%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/2a4f5b7942ed43f5a58e1546c0b602d9/images/large/2.jpg not downloaded yet
2026-03-26 22:57:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F2a4f5b7942ed43f5a58e1546c0b602d9%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/2a4f5b7942ed43f5a58e1546c0b602d9/images/large/3.jpg not downloaded yet
2026-03-26 22:57:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79d4510>
2026-03-26 22:57:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_641cc868-a13f-553c-85d9-2731744fa2f3/641cc868-a13f-553c-85d9-2731744fa2f3_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:57:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F670b978f8f8349369e4ddca8ff700145%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/670b978f8f8349369e4ddca8ff700145/images/large/6.jpg saved to cache
2026-03-26 22:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 641cc868-a13f-553c-85d9-2731744fa2f3
2026-03-26 22:57:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b745b650>
2026-03-26 22:57:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_641cc868-a13f-553c-85d9-2731744fa2f3/641cc868-a13f-553c-85d9-2731744fa2f3_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:57:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F670b978f8f8349369e4ddca8ff700145%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/670b978f8f8349369e4ddca8ff700145/images/large/8.jpg saved to cache
2026-03-26 22:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 641cc868-a13f-553c-85d9-2731744fa2f3
2026-03-26 22:57:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7a60250>
2026-03-26 22:57:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_641cc868-a13f-553c-85d9-2731744fa2f3/641cc868-a13f-553c-85d9-2731744fa2f3_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:57:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F670b978f8f8349369e4ddca8ff700145%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/670b978f8f8349369e4ddca8ff700145/images/large/10.jpg saved to cache
2026-03-26 22:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 641cc868-a13f-553c-85d9-2731744fa2f3
2026-03-26 22:57:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 641cc868-a13f-553c-85d9-2731744fa2f3, skipping ID generation
2026-03-26 22:57:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 641cc868-a13f-553c-85d9-2731744fa2f3 with scrape type 1
2026-03-26 22:57:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 641cc868-a13f-553c-85d9-2731744fa2f3 sending to next pipeline
2026-03-26 22:57:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 641cc868-a13f-553c-85d9-2731744fa2f3, identifier: 1985635
2026-03-26 22:57:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b746c250>
2026-03-26 22:57:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86266e6c-be0f-5870-a58f-16ec6650520e/86266e6c-be0f-5870-a58f-16ec6650520e_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:57:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F7744493e16a349f39bb4adae937f9a94%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/7744493e16a349f39bb4adae937f9a94/images/large/1.jpg saved to cache
2026-03-26 22:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 86266e6c-be0f-5870-a58f-16ec6650520e
2026-03-26 22:57:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 641cc868-a13f-553c-85d9-2731744fa2f3 with identifier: 1985635
2026-03-26 22:57:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 641cc868-a13f-553c-85d9-2731744fa2f3 with identifier: 1985635
2026-03-26 22:57:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 641cc868-a13f-553c-85d9-2731744fa2f3 with identifier: 1985635 to the API
2026-03-26 22:57:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:57:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:57:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bh/670b978f8f8349369e4ddca8ff700145/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '641cc868-a13f-553c-85d9-2731744fa2f3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 116371,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_641cc868-a13f-553c-85d9-2731744fa2f3/641cc868-a13f-553c-85d9-2731744fa2f3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 722140,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/670b978f8f8349369e4ddca8ff700145/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_641cc868-a13f-553c-85d9-2731744fa2f3/641cc868-a13f-553c-85d9-2731744fa2f3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 699737,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/670b978f8f8349369e4ddca8ff700145/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_641cc868-a13f-553c-85d9-2731744fa2f3/641cc868-a13f-553c-85d9-2731744fa2f3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 722797,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/670b978f8f8349369e4ddca8ff700145/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_641cc868-a13f-553c-85d9-2731744fa2f3/641cc868-a13f-553c-85d9-2731744fa2f3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 754623,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/670b978f8f8349369e4ddca8ff700145/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_641cc868-a13f-553c-85d9-2731744fa2f3/641cc868-a13f-553c-85d9-2731744fa2f3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 728666,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/670b978f8f8349369e4ddca8ff700145/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_641cc868-a13f-553c-85d9-2731744fa2f3/641cc868-a13f-553c-85d9-2731744fa2f3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 784270,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/670b978f8f8349369e4ddca8ff700145/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_641cc868-a13f-553c-85d9-2731744fa2f3/641cc868-a13f-553c-85d9-2731744fa2f3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 580243,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/670b978f8f8349369e4ddca8ff700145/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_641cc868-a13f-553c-85d9-2731744fa2f3/641cc868-a13f-553c-85d9-2731744fa2f3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 813876,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/670b978f8f8349369e4ddca8ff700145/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_641cc868-a13f-553c-85d9-2731744fa2f3/641cc868-a13f-553c-85d9-2731744fa2f3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 709084,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/670b978f8f8349369e4ddca8ff700145/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_641cc868-a13f-553c-85d9-2731744fa2f3/641cc868-a13f-553c-85d9-2731744fa2f3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 565413,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/670b978f8f8349369e4ddca8ff700145/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 1.5 XDRIVE25E (162KW)',
 'transmission': 'automatic',
 'trim': '1.5 XDRIVE25E (162KW)',
 'vin': None,
 'year': 2021}
2026-03-26 22:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985635%27 HTTP/1.1" 200 None
2026-03-26 22:57:03 [ayvens.be] INFO: Saving data for 1985635: {'created_time': 1774565823.070913, 'last_price_update_time': 1774565823.070924, 'auction_closing_time': 1774958400.0}
2026-03-26 22:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985635') HTTP/1.1" 204 0
2026-03-26 22:57:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/7744493e16a349f39bb4adae937f9a94/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F2a4f5b7942ed43f5a58e1546c0b602d9%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/2a4f5b7942ed43f5a58e1546c0b602d9/images/large/4.jpg not downloaded yet
2026-03-26 22:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F2a4f5b7942ed43f5a58e1546c0b602d9%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/2a4f5b7942ed43f5a58e1546c0b602d9/images/large/5.jpg not downloaded yet
2026-03-26 22:57:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/7744493e16a349f39bb4adae937f9a94/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5ca5cd0>
2026-03-26 22:57:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86266e6c-be0f-5870-a58f-16ec6650520e/86266e6c-be0f-5870-a58f-16ec6650520e_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F7744493e16a349f39bb4adae937f9a94%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/7744493e16a349f39bb4adae937f9a94/images/large/2.jpg saved to cache
2026-03-26 22:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 86266e6c-be0f-5870-a58f-16ec6650520e
2026-03-26 22:57:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/7744493e16a349f39bb4adae937f9a94/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/7744493e16a349f39bb4adae937f9a94/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F2a4f5b7942ed43f5a58e1546c0b602d9%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/2a4f5b7942ed43f5a58e1546c0b602d9/images/large/6.jpg not downloaded yet
2026-03-26 22:57:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/7744493e16a349f39bb4adae937f9a94/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/7744493e16a349f39bb4adae937f9a94/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/7744493e16a349f39bb4adae937f9a94/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F2a4f5b7942ed43f5a58e1546c0b602d9%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/2a4f5b7942ed43f5a58e1546c0b602d9/images/large/7.jpg not downloaded yet
2026-03-26 22:57:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7771f10>
2026-03-26 22:57:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86266e6c-be0f-5870-a58f-16ec6650520e/86266e6c-be0f-5870-a58f-16ec6650520e_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F7744493e16a349f39bb4adae937f9a94%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/7744493e16a349f39bb4adae937f9a94/images/large/3.jpg saved to cache
2026-03-26 22:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 86266e6c-be0f-5870-a58f-16ec6650520e
2026-03-26 22:57:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7982e90>
2026-03-26 22:57:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86266e6c-be0f-5870-a58f-16ec6650520e/86266e6c-be0f-5870-a58f-16ec6650520e_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F7744493e16a349f39bb4adae937f9a94%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/7744493e16a349f39bb4adae937f9a94/images/large/6.jpg saved to cache
2026-03-26 22:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 86266e6c-be0f-5870-a58f-16ec6650520e
2026-03-26 22:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F2a4f5b7942ed43f5a58e1546c0b602d9%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/2a4f5b7942ed43f5a58e1546c0b602d9/images/large/8.jpg not downloaded yet
2026-03-26 22:57:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/2a4f5b7942ed43f5a58e1546c0b602d9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7585110>
2026-03-26 22:57:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86266e6c-be0f-5870-a58f-16ec6650520e/86266e6c-be0f-5870-a58f-16ec6650520e_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F7744493e16a349f39bb4adae937f9a94%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/7744493e16a349f39bb4adae937f9a94/images/large/4.jpg saved to cache
2026-03-26 22:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 86266e6c-be0f-5870-a58f-16ec6650520e
2026-03-26 22:57:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6dd8590>
2026-03-26 22:57:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86266e6c-be0f-5870-a58f-16ec6650520e/86266e6c-be0f-5870-a58f-16ec6650520e_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F7744493e16a349f39bb4adae937f9a94%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/7744493e16a349f39bb4adae937f9a94/images/large/5.jpg saved to cache
2026-03-26 22:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 86266e6c-be0f-5870-a58f-16ec6650520e
2026-03-26 22:57:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7724cd0>
2026-03-26 22:57:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86266e6c-be0f-5870-a58f-16ec6650520e/86266e6c-be0f-5870-a58f-16ec6650520e_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F7744493e16a349f39bb4adae937f9a94%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/7744493e16a349f39bb4adae937f9a94/images/large/7.jpg saved to cache
2026-03-26 22:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 86266e6c-be0f-5870-a58f-16ec6650520e
2026-03-26 22:57:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b726acd0>
2026-03-26 22:57:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86266e6c-be0f-5870-a58f-16ec6650520e/86266e6c-be0f-5870-a58f-16ec6650520e_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F7744493e16a349f39bb4adae937f9a94%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/7744493e16a349f39bb4adae937f9a94/images/large/9.jpg saved to cache
2026-03-26 22:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 86266e6c-be0f-5870-a58f-16ec6650520e
2026-03-26 22:57:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77aed50>
2026-03-26 22:57:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86266e6c-be0f-5870-a58f-16ec6650520e/86266e6c-be0f-5870-a58f-16ec6650520e_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F7744493e16a349f39bb4adae937f9a94%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/7744493e16a349f39bb4adae937f9a94/images/large/10.jpg saved to cache
2026-03-26 22:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 86266e6c-be0f-5870-a58f-16ec6650520e
2026-03-26 22:57:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/7744493e16a349f39bb4adae937f9a94/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F2a4f5b7942ed43f5a58e1546c0b602d9%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/2a4f5b7942ed43f5a58e1546c0b602d9/images/large/9.jpg not downloaded yet
2026-03-26 22:57:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/2a4f5b7942ed43f5a58e1546c0b602d9/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/2a4f5b7942ed43f5a58e1546c0b602d9/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F2a4f5b7942ed43f5a58e1546c0b602d9%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/2a4f5b7942ed43f5a58e1546c0b602d9/images/large/10.jpg not downloaded yet
2026-03-26 22:57:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e17250>
2026-03-26 22:57:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09a43b0a-c88e-5129-a2da-10bd3bc2cdeb/09a43b0a-c88e-5129-a2da-10bd3bc2cdeb_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:57:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F2a4f5b7942ed43f5a58e1546c0b602d9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/2a4f5b7942ed43f5a58e1546c0b602d9/images/large/1.jpg saved to cache
2026-03-26 22:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 09a43b0a-c88e-5129-a2da-10bd3bc2cdeb
2026-03-26 22:57:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/2a4f5b7942ed43f5a58e1546c0b602d9/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/2a4f5b7942ed43f5a58e1546c0b602d9/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:04 [ayvens.be] INFO: Found listing with ID: 1985638
2026-03-26 22:57:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985638%27 HTTP/1.1" 200 None
2026-03-26 22:57:04 [ayvens.be] INFO: Scrape type for 1985638: 1
2026-03-26 22:57:04 [ayvens.be] INFO: Extracting data for car ID: 1985638
2026-03-26 22:57:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17ed58f7-556f-5b74-8723-4dac22a8dc51 with identifier: 1985638
2026-03-26 22:57:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17ed58f7-556f-5b74-8723-4dac22a8dc51 with scrape type 1
2026-03-26 22:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 17ed58f7-556f-5b74-8723-4dac22a8dc51
2026-03-26 22:57:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fa585b2f8915443568ba1b71e892fe65b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/a585b2f8915443568ba1b71e892fe65b/images/large/1.jpg not downloaded yet
2026-03-26 22:57:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/2a4f5b7942ed43f5a58e1546c0b602d9/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fa585b2f8915443568ba1b71e892fe65b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/a585b2f8915443568ba1b71e892fe65b/images/large/2.jpg not downloaded yet
2026-03-26 22:57:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74040d0>
2026-03-26 22:57:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86266e6c-be0f-5870-a58f-16ec6650520e/86266e6c-be0f-5870-a58f-16ec6650520e_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:57:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F7744493e16a349f39bb4adae937f9a94%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/7744493e16a349f39bb4adae937f9a94/images/large/8.jpg saved to cache
2026-03-26 22:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 86266e6c-be0f-5870-a58f-16ec6650520e
2026-03-26 22:57:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 86266e6c-be0f-5870-a58f-16ec6650520e, skipping ID generation
2026-03-26 22:57:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 86266e6c-be0f-5870-a58f-16ec6650520e with scrape type 1
2026-03-26 22:57:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 86266e6c-be0f-5870-a58f-16ec6650520e sending to next pipeline
2026-03-26 22:57:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 86266e6c-be0f-5870-a58f-16ec6650520e, identifier: 1985636
2026-03-26 22:57:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6ddb610>
2026-03-26 22:57:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09a43b0a-c88e-5129-a2da-10bd3bc2cdeb/09a43b0a-c88e-5129-a2da-10bd3bc2cdeb_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:57:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F2a4f5b7942ed43f5a58e1546c0b602d9%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/2a4f5b7942ed43f5a58e1546c0b602d9/images/large/4.jpg saved to cache
2026-03-26 22:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 09a43b0a-c88e-5129-a2da-10bd3bc2cdeb
2026-03-26 22:57:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cb2ad0>
2026-03-26 22:57:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09a43b0a-c88e-5129-a2da-10bd3bc2cdeb/09a43b0a-c88e-5129-a2da-10bd3bc2cdeb_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:57:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F2a4f5b7942ed43f5a58e1546c0b602d9%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/2a4f5b7942ed43f5a58e1546c0b602d9/images/large/3.jpg saved to cache
2026-03-26 22:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 09a43b0a-c88e-5129-a2da-10bd3bc2cdeb
2026-03-26 22:57:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fa585b2f8915443568ba1b71e892fe65b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/a585b2f8915443568ba1b71e892fe65b/images/large/3.jpg not downloaded yet
2026-03-26 22:57:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 86266e6c-be0f-5870-a58f-16ec6650520e with identifier: 1985636
2026-03-26 22:57:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 86266e6c-be0f-5870-a58f-16ec6650520e with identifier: 1985636
2026-03-26 22:57:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 86266e6c-be0f-5870-a58f-16ec6650520e with identifier: 1985636 to the API
2026-03-26 22:57:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:57:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:57:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yw/7744493e16a349f39bb4adae937f9a94/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '86266e6c-be0f-5870-a58f-16ec6650520e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'CITROAu2039N',
 'model': 'C5 AIRCROSS',
 'odometer': 80193,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86266e6c-be0f-5870-a58f-16ec6650520e/86266e6c-be0f-5870-a58f-16ec6650520e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 684751,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/7744493e16a349f39bb4adae937f9a94/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86266e6c-be0f-5870-a58f-16ec6650520e/86266e6c-be0f-5870-a58f-16ec6650520e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 703783,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/7744493e16a349f39bb4adae937f9a94/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86266e6c-be0f-5870-a58f-16ec6650520e/86266e6c-be0f-5870-a58f-16ec6650520e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 668649,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/7744493e16a349f39bb4adae937f9a94/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86266e6c-be0f-5870-a58f-16ec6650520e/86266e6c-be0f-5870-a58f-16ec6650520e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 702109,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/7744493e16a349f39bb4adae937f9a94/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86266e6c-be0f-5870-a58f-16ec6650520e/86266e6c-be0f-5870-a58f-16ec6650520e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 577413,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/7744493e16a349f39bb4adae937f9a94/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86266e6c-be0f-5870-a58f-16ec6650520e/86266e6c-be0f-5870-a58f-16ec6650520e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 612682,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/7744493e16a349f39bb4adae937f9a94/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86266e6c-be0f-5870-a58f-16ec6650520e/86266e6c-be0f-5870-a58f-16ec6650520e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 590589,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/7744493e16a349f39bb4adae937f9a94/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86266e6c-be0f-5870-a58f-16ec6650520e/86266e6c-be0f-5870-a58f-16ec6650520e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 714901,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/7744493e16a349f39bb4adae937f9a94/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86266e6c-be0f-5870-a58f-16ec6650520e/86266e6c-be0f-5870-a58f-16ec6650520e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 417231,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/7744493e16a349f39bb4adae937f9a94/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86266e6c-be0f-5870-a58f-16ec6650520e/86266e6c-be0f-5870-a58f-16ec6650520e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 441619,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/7744493e16a349f39bb4adae937f9a94/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROAu2039N C5 AIRCROSS 1.6 HYBRID 225 E-EAT8 SHINE AUTO',
 'transmission': 'automatic',
 'trim': '1.6 HYBRID 225 E-EAT8 SHINE AUTO',
 'vin': None,
 'year': 2021}
2026-03-26 22:57:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985636%27 HTTP/1.1" 200 None
2026-03-26 22:57:04 [ayvens.be] INFO: Saving data for 1985636: {'created_time': 1774565824.767814, 'last_price_update_time': 1774565824.767825, 'auction_closing_time': 1774958400.0}
2026-03-26 22:57:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985636') HTTP/1.1" 204 0
2026-03-26 22:57:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/2a4f5b7942ed43f5a58e1546c0b602d9/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fa585b2f8915443568ba1b71e892fe65b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/a585b2f8915443568ba1b71e892fe65b/images/large/4.jpg not downloaded yet
2026-03-26 22:57:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/2a4f5b7942ed43f5a58e1546c0b602d9/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b75a6250>
2026-03-26 22:57:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09a43b0a-c88e-5129-a2da-10bd3bc2cdeb/09a43b0a-c88e-5129-a2da-10bd3bc2cdeb_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:57:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F2a4f5b7942ed43f5a58e1546c0b602d9%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/2a4f5b7942ed43f5a58e1546c0b602d9/images/large/2.jpg saved to cache
2026-03-26 22:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 09a43b0a-c88e-5129-a2da-10bd3bc2cdeb
2026-03-26 22:57:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74a43d0>
2026-03-26 22:57:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09a43b0a-c88e-5129-a2da-10bd3bc2cdeb/09a43b0a-c88e-5129-a2da-10bd3bc2cdeb_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:57:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F2a4f5b7942ed43f5a58e1546c0b602d9%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/2a4f5b7942ed43f5a58e1546c0b602d9/images/large/6.jpg saved to cache
2026-03-26 22:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 09a43b0a-c88e-5129-a2da-10bd3bc2cdeb
2026-03-26 22:57:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74a43d0>
2026-03-26 22:57:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09a43b0a-c88e-5129-a2da-10bd3bc2cdeb/09a43b0a-c88e-5129-a2da-10bd3bc2cdeb_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:57:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F2a4f5b7942ed43f5a58e1546c0b602d9%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/2a4f5b7942ed43f5a58e1546c0b602d9/images/large/5.jpg saved to cache
2026-03-26 22:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 09a43b0a-c88e-5129-a2da-10bd3bc2cdeb
2026-03-26 22:57:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fa585b2f8915443568ba1b71e892fe65b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/a585b2f8915443568ba1b71e892fe65b/images/large/5.jpg not downloaded yet
2026-03-26 22:57:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/2a4f5b7942ed43f5a58e1546c0b602d9/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fa585b2f8915443568ba1b71e892fe65b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/a585b2f8915443568ba1b71e892fe65b/images/large/6.jpg not downloaded yet
2026-03-26 22:57:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/2a4f5b7942ed43f5a58e1546c0b602d9/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7406a50>
2026-03-26 22:57:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09a43b0a-c88e-5129-a2da-10bd3bc2cdeb/09a43b0a-c88e-5129-a2da-10bd3bc2cdeb_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:57:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F2a4f5b7942ed43f5a58e1546c0b602d9%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/2a4f5b7942ed43f5a58e1546c0b602d9/images/large/7.jpg saved to cache
2026-03-26 22:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 09a43b0a-c88e-5129-a2da-10bd3bc2cdeb
2026-03-26 22:57:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7573fd0>
2026-03-26 22:57:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09a43b0a-c88e-5129-a2da-10bd3bc2cdeb/09a43b0a-c88e-5129-a2da-10bd3bc2cdeb_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:57:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F2a4f5b7942ed43f5a58e1546c0b602d9%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/2a4f5b7942ed43f5a58e1546c0b602d9/images/large/8.jpg saved to cache
2026-03-26 22:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 09a43b0a-c88e-5129-a2da-10bd3bc2cdeb
2026-03-26 22:57:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fa585b2f8915443568ba1b71e892fe65b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/a585b2f8915443568ba1b71e892fe65b/images/large/7.jpg not downloaded yet
2026-03-26 22:57:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/a585b2f8915443568ba1b71e892fe65b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fa585b2f8915443568ba1b71e892fe65b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/a585b2f8915443568ba1b71e892fe65b/images/large/8.jpg not downloaded yet
2026-03-26 22:57:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7660a90>
2026-03-26 22:57:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09a43b0a-c88e-5129-a2da-10bd3bc2cdeb/09a43b0a-c88e-5129-a2da-10bd3bc2cdeb_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:57:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F2a4f5b7942ed43f5a58e1546c0b602d9%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/2a4f5b7942ed43f5a58e1546c0b602d9/images/large/9.jpg saved to cache
2026-03-26 22:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 09a43b0a-c88e-5129-a2da-10bd3bc2cdeb
2026-03-26 22:57:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b740b2d0>
2026-03-26 22:57:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09a43b0a-c88e-5129-a2da-10bd3bc2cdeb/09a43b0a-c88e-5129-a2da-10bd3bc2cdeb_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:57:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F2a4f5b7942ed43f5a58e1546c0b602d9%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/2a4f5b7942ed43f5a58e1546c0b602d9/images/large/10.jpg saved to cache
2026-03-26 22:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 09a43b0a-c88e-5129-a2da-10bd3bc2cdeb
2026-03-26 22:57:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 09a43b0a-c88e-5129-a2da-10bd3bc2cdeb, skipping ID generation
2026-03-26 22:57:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09a43b0a-c88e-5129-a2da-10bd3bc2cdeb with scrape type 1
2026-03-26 22:57:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 09a43b0a-c88e-5129-a2da-10bd3bc2cdeb sending to next pipeline
2026-03-26 22:57:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 09a43b0a-c88e-5129-a2da-10bd3bc2cdeb, identifier: 1985637
2026-03-26 22:57:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fa585b2f8915443568ba1b71e892fe65b%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/a585b2f8915443568ba1b71e892fe65b/images/large/9.jpg not downloaded yet
2026-03-26 22:57:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 09a43b0a-c88e-5129-a2da-10bd3bc2cdeb with identifier: 1985637
2026-03-26 22:57:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 09a43b0a-c88e-5129-a2da-10bd3bc2cdeb with identifier: 1985637
2026-03-26 22:57:05 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 09a43b0a-c88e-5129-a2da-10bd3bc2cdeb with identifier: 1985637 to the API
2026-03-26 22:57:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:57:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:57:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yn/2a4f5b7942ed43f5a58e1546c0b602d9/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '09a43b0a-c88e-5129-a2da-10bd3bc2cdeb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLA - Klasse',
 'odometer': 83345,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09a43b0a-c88e-5129-a2da-10bd3bc2cdeb/09a43b0a-c88e-5129-a2da-10bd3bc2cdeb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 301904,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/2a4f5b7942ed43f5a58e1546c0b602d9/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09a43b0a-c88e-5129-a2da-10bd3bc2cdeb/09a43b0a-c88e-5129-a2da-10bd3bc2cdeb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 340843,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/2a4f5b7942ed43f5a58e1546c0b602d9/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09a43b0a-c88e-5129-a2da-10bd3bc2cdeb/09a43b0a-c88e-5129-a2da-10bd3bc2cdeb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 267206,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/2a4f5b7942ed43f5a58e1546c0b602d9/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09a43b0a-c88e-5129-a2da-10bd3bc2cdeb/09a43b0a-c88e-5129-a2da-10bd3bc2cdeb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 320804,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/2a4f5b7942ed43f5a58e1546c0b602d9/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09a43b0a-c88e-5129-a2da-10bd3bc2cdeb/09a43b0a-c88e-5129-a2da-10bd3bc2cdeb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 296206,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/2a4f5b7942ed43f5a58e1546c0b602d9/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09a43b0a-c88e-5129-a2da-10bd3bc2cdeb/09a43b0a-c88e-5129-a2da-10bd3bc2cdeb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 223148,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/2a4f5b7942ed43f5a58e1546c0b602d9/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09a43b0a-c88e-5129-a2da-10bd3bc2cdeb/09a43b0a-c88e-5129-a2da-10bd3bc2cdeb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 264788,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/2a4f5b7942ed43f5a58e1546c0b602d9/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09a43b0a-c88e-5129-a2da-10bd3bc2cdeb/09a43b0a-c88e-5129-a2da-10bd3bc2cdeb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 377702,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/2a4f5b7942ed43f5a58e1546c0b602d9/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09a43b0a-c88e-5129-a2da-10bd3bc2cdeb/09a43b0a-c88e-5129-a2da-10bd3bc2cdeb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 357317,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/2a4f5b7942ed43f5a58e1546c0b602d9/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09a43b0a-c88e-5129-a2da-10bd3bc2cdeb/09a43b0a-c88e-5129-a2da-10bd3bc2cdeb_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 450910,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/2a4f5b7942ed43f5a58e1546c0b602d9/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLA - Klasse 1.3 CLA 180 BUSINESS SOLUTION',
 'transmission': 'manual',
 'trim': '1.3 CLA 180 BUSINESS SOLUTION',
 'vin': None,
 'year': 2020}
2026-03-26 22:57:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985637%27 HTTP/1.1" 200 None
2026-03-26 22:57:05 [ayvens.be] INFO: Saving data for 1985637: {'created_time': 1774565825.807441, 'last_price_update_time': 1774565825.80745, 'auction_closing_time': 1774958400.0}
2026-03-26 22:57:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985637') HTTP/1.1" 204 0
2026-03-26 22:57:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/a585b2f8915443568ba1b71e892fe65b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fa585b2f8915443568ba1b71e892fe65b%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/a585b2f8915443568ba1b71e892fe65b/images/large/10.jpg not downloaded yet
2026-03-26 22:57:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76cf850>
2026-03-26 22:57:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17ed58f7-556f-5b74-8723-4dac22a8dc51/17ed58f7-556f-5b74-8723-4dac22a8dc51_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:57:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fa585b2f8915443568ba1b71e892fe65b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/a585b2f8915443568ba1b71e892fe65b/images/large/1.jpg saved to cache
2026-03-26 22:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 17ed58f7-556f-5b74-8723-4dac22a8dc51
2026-03-26 22:57:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/a585b2f8915443568ba1b71e892fe65b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:05 [ayvens.be] INFO: Found listing with ID: 1985639
2026-03-26 22:57:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985639%27 HTTP/1.1" 200 None
2026-03-26 22:57:05 [ayvens.be] INFO: Scrape type for 1985639: 1
2026-03-26 22:57:05 [ayvens.be] INFO: Extracting data for car ID: 1985639
2026-03-26 22:57:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8 with identifier: 1985639
2026-03-26 22:57:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8 with scrape type 1
2026-03-26 22:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8
2026-03-26 22:57:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F4e923cda20684323985b4d3c410e2e51%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/4e923cda20684323985b4d3c410e2e51/images/large/1.jpg not downloaded yet
2026-03-26 22:57:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/a585b2f8915443568ba1b71e892fe65b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/a585b2f8915443568ba1b71e892fe65b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F4e923cda20684323985b4d3c410e2e51%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/4e923cda20684323985b4d3c410e2e51/images/large/2.jpg not downloaded yet
2026-03-26 22:57:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/a585b2f8915443568ba1b71e892fe65b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74a4d10>
2026-03-26 22:57:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17ed58f7-556f-5b74-8723-4dac22a8dc51/17ed58f7-556f-5b74-8723-4dac22a8dc51_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fa585b2f8915443568ba1b71e892fe65b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/a585b2f8915443568ba1b71e892fe65b/images/large/2.jpg saved to cache
2026-03-26 22:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 17ed58f7-556f-5b74-8723-4dac22a8dc51
2026-03-26 22:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F4e923cda20684323985b4d3c410e2e51%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/4e923cda20684323985b4d3c410e2e51/images/large/3.jpg not downloaded yet
2026-03-26 22:57:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/a585b2f8915443568ba1b71e892fe65b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F4e923cda20684323985b4d3c410e2e51%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/4e923cda20684323985b4d3c410e2e51/images/large/4.jpg not downloaded yet
2026-03-26 22:57:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/a585b2f8915443568ba1b71e892fe65b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7572d50>
2026-03-26 22:57:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17ed58f7-556f-5b74-8723-4dac22a8dc51/17ed58f7-556f-5b74-8723-4dac22a8dc51_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fa585b2f8915443568ba1b71e892fe65b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/a585b2f8915443568ba1b71e892fe65b/images/large/4.jpg saved to cache
2026-03-26 22:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 17ed58f7-556f-5b74-8723-4dac22a8dc51
2026-03-26 22:57:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b741c7d0>
2026-03-26 22:57:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17ed58f7-556f-5b74-8723-4dac22a8dc51/17ed58f7-556f-5b74-8723-4dac22a8dc51_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fa585b2f8915443568ba1b71e892fe65b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/a585b2f8915443568ba1b71e892fe65b/images/large/5.jpg saved to cache
2026-03-26 22:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 17ed58f7-556f-5b74-8723-4dac22a8dc51
2026-03-26 22:57:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74df0d0>
2026-03-26 22:57:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17ed58f7-556f-5b74-8723-4dac22a8dc51/17ed58f7-556f-5b74-8723-4dac22a8dc51_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fa585b2f8915443568ba1b71e892fe65b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/a585b2f8915443568ba1b71e892fe65b/images/large/6.jpg saved to cache
2026-03-26 22:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 17ed58f7-556f-5b74-8723-4dac22a8dc51
2026-03-26 22:57:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77adb90>
2026-03-26 22:57:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17ed58f7-556f-5b74-8723-4dac22a8dc51/17ed58f7-556f-5b74-8723-4dac22a8dc51_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fa585b2f8915443568ba1b71e892fe65b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/a585b2f8915443568ba1b71e892fe65b/images/large/3.jpg saved to cache
2026-03-26 22:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 17ed58f7-556f-5b74-8723-4dac22a8dc51
2026-03-26 22:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F4e923cda20684323985b4d3c410e2e51%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/4e923cda20684323985b4d3c410e2e51/images/large/5.jpg not downloaded yet
2026-03-26 22:57:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/a585b2f8915443568ba1b71e892fe65b/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F4e923cda20684323985b4d3c410e2e51%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/4e923cda20684323985b4d3c410e2e51/images/large/6.jpg not downloaded yet
2026-03-26 22:57:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/a585b2f8915443568ba1b71e892fe65b/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74df810>
2026-03-26 22:57:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17ed58f7-556f-5b74-8723-4dac22a8dc51/17ed58f7-556f-5b74-8723-4dac22a8dc51_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fa585b2f8915443568ba1b71e892fe65b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/a585b2f8915443568ba1b71e892fe65b/images/large/7.jpg saved to cache
2026-03-26 22:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 17ed58f7-556f-5b74-8723-4dac22a8dc51
2026-03-26 22:57:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cb1bd0>
2026-03-26 22:57:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17ed58f7-556f-5b74-8723-4dac22a8dc51/17ed58f7-556f-5b74-8723-4dac22a8dc51_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fa585b2f8915443568ba1b71e892fe65b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/a585b2f8915443568ba1b71e892fe65b/images/large/8.jpg saved to cache
2026-03-26 22:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 17ed58f7-556f-5b74-8723-4dac22a8dc51
2026-03-26 22:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F4e923cda20684323985b4d3c410e2e51%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/4e923cda20684323985b4d3c410e2e51/images/large/7.jpg not downloaded yet
2026-03-26 22:57:06 [scrapy.extensions.logstats] INFO: Crawled 9 pages (at 1 pages/min), scraped 418 items (at 37 items/min)
2026-03-26 22:57:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 182MiB
2026-03-26 22:57:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2at/4e923cda20684323985b4d3c410e2e51/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F4e923cda20684323985b4d3c410e2e51%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/4e923cda20684323985b4d3c410e2e51/images/large/8.jpg not downloaded yet
2026-03-26 22:57:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7439bd0>
2026-03-26 22:57:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17ed58f7-556f-5b74-8723-4dac22a8dc51/17ed58f7-556f-5b74-8723-4dac22a8dc51_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fa585b2f8915443568ba1b71e892fe65b%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/a585b2f8915443568ba1b71e892fe65b/images/large/9.jpg saved to cache
2026-03-26 22:57:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 17ed58f7-556f-5b74-8723-4dac22a8dc51
2026-03-26 22:57:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74e7290>
2026-03-26 22:57:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17ed58f7-556f-5b74-8723-4dac22a8dc51/17ed58f7-556f-5b74-8723-4dac22a8dc51_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fa585b2f8915443568ba1b71e892fe65b%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/a585b2f8915443568ba1b71e892fe65b/images/large/10.jpg saved to cache
2026-03-26 22:57:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 17ed58f7-556f-5b74-8723-4dac22a8dc51
2026-03-26 22:57:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 17ed58f7-556f-5b74-8723-4dac22a8dc51, skipping ID generation
2026-03-26 22:57:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17ed58f7-556f-5b74-8723-4dac22a8dc51 with scrape type 1
2026-03-26 22:57:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 17ed58f7-556f-5b74-8723-4dac22a8dc51 sending to next pipeline
2026-03-26 22:57:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 17ed58f7-556f-5b74-8723-4dac22a8dc51, identifier: 1985638
2026-03-26 22:57:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2at/4e923cda20684323985b4d3c410e2e51/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F4e923cda20684323985b4d3c410e2e51%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/4e923cda20684323985b4d3c410e2e51/images/large/9.jpg not downloaded yet
2026-03-26 22:57:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 17ed58f7-556f-5b74-8723-4dac22a8dc51 with identifier: 1985638
2026-03-26 22:57:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 17ed58f7-556f-5b74-8723-4dac22a8dc51 with identifier: 1985638
2026-03-26 22:57:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 17ed58f7-556f-5b74-8723-4dac22a8dc51 with identifier: 1985638 to the API
2026-03-26 22:57:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:57:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:57:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bm/a585b2f8915443568ba1b71e892fe65b/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '17ed58f7-556f-5b74-8723-4dac22a8dc51',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 42721,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17ed58f7-556f-5b74-8723-4dac22a8dc51/17ed58f7-556f-5b74-8723-4dac22a8dc51_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 550746,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/a585b2f8915443568ba1b71e892fe65b/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17ed58f7-556f-5b74-8723-4dac22a8dc51/17ed58f7-556f-5b74-8723-4dac22a8dc51_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 602367,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/a585b2f8915443568ba1b71e892fe65b/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17ed58f7-556f-5b74-8723-4dac22a8dc51/17ed58f7-556f-5b74-8723-4dac22a8dc51_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 511254,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/a585b2f8915443568ba1b71e892fe65b/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17ed58f7-556f-5b74-8723-4dac22a8dc51/17ed58f7-556f-5b74-8723-4dac22a8dc51_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 521644,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/a585b2f8915443568ba1b71e892fe65b/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17ed58f7-556f-5b74-8723-4dac22a8dc51/17ed58f7-556f-5b74-8723-4dac22a8dc51_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 385131,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/a585b2f8915443568ba1b71e892fe65b/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17ed58f7-556f-5b74-8723-4dac22a8dc51/17ed58f7-556f-5b74-8723-4dac22a8dc51_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 329218,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/a585b2f8915443568ba1b71e892fe65b/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17ed58f7-556f-5b74-8723-4dac22a8dc51/17ed58f7-556f-5b74-8723-4dac22a8dc51_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 475070,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/a585b2f8915443568ba1b71e892fe65b/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17ed58f7-556f-5b74-8723-4dac22a8dc51/17ed58f7-556f-5b74-8723-4dac22a8dc51_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 388753,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/a585b2f8915443568ba1b71e892fe65b/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17ed58f7-556f-5b74-8723-4dac22a8dc51/17ed58f7-556f-5b74-8723-4dac22a8dc51_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 269892,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/a585b2f8915443568ba1b71e892fe65b/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17ed58f7-556f-5b74-8723-4dac22a8dc51/17ed58f7-556f-5b74-8723-4dac22a8dc51_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 413085,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/a585b2f8915443568ba1b71e892fe65b/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 1.6 PHEV 225 E-AUTO8 GT PACK',
 'transmission': 'automatic',
 'trim': '1.6 PHEV 225 E-AUTO8 GT PACK',
 'vin': None,
 'year': 2022}
2026-03-26 22:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985638%27 HTTP/1.1" 200 None
2026-03-26 22:57:07 [ayvens.be] INFO: Saving data for 1985638: {'created_time': 1774565827.550006, 'last_price_update_time': 1774565827.550016, 'auction_closing_time': 1774958400.0}
2026-03-26 22:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985638') HTTP/1.1" 204 0
2026-03-26 22:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F4e923cda20684323985b4d3c410e2e51%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/4e923cda20684323985b4d3c410e2e51/images/large/10.jpg not downloaded yet
2026-03-26 22:57:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76c5210>
2026-03-26 22:57:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8/33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F4e923cda20684323985b4d3c410e2e51%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/4e923cda20684323985b4d3c410e2e51/images/large/1.jpg saved to cache
2026-03-26 22:57:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8
2026-03-26 22:57:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74bc9d0>
2026-03-26 22:57:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8/33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F4e923cda20684323985b4d3c410e2e51%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/4e923cda20684323985b4d3c410e2e51/images/large/2.jpg saved to cache
2026-03-26 22:57:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8
2026-03-26 22:57:07 [ayvens.be] INFO: Found listing with ID: 1985640
2026-03-26 22:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985640%27 HTTP/1.1" 200 None
2026-03-26 22:57:07 [ayvens.be] INFO: Scrape type for 1985640: 1
2026-03-26 22:57:07 [ayvens.be] INFO: Extracting data for car ID: 1985640
2026-03-26 22:57:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1256ce21-2938-5b93-a2c3-c014e79ced2a with identifier: 1985640
2026-03-26 22:57:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1256ce21-2938-5b93-a2c3-c014e79ced2a with scrape type 1
2026-03-26 22:57:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1256ce21-2938-5b93-a2c3-c014e79ced2a
2026-03-26 22:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Fd2b71147c65c441ca0d5e16580a37d1a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/d2b71147c65c441ca0d5e16580a37d1a/images/large/1.jpg not downloaded yet
2026-03-26 22:57:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2at/4e923cda20684323985b4d3c410e2e51/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2at/4e923cda20684323985b4d3c410e2e51/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2at/4e923cda20684323985b4d3c410e2e51/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Fd2b71147c65c441ca0d5e16580a37d1a%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/d2b71147c65c441ca0d5e16580a37d1a/images/large/2.jpg not downloaded yet
2026-03-26 22:57:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2at/4e923cda20684323985b4d3c410e2e51/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Fd2b71147c65c441ca0d5e16580a37d1a%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/d2b71147c65c441ca0d5e16580a37d1a/images/large/3.jpg not downloaded yet
2026-03-26 22:57:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2at/4e923cda20684323985b4d3c410e2e51/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2at/4e923cda20684323985b4d3c410e2e51/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Fd2b71147c65c441ca0d5e16580a37d1a%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/d2b71147c65c441ca0d5e16580a37d1a/images/large/4.jpg not downloaded yet
2026-03-26 22:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Fd2b71147c65c441ca0d5e16580a37d1a%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/d2b71147c65c441ca0d5e16580a37d1a/images/large/5.jpg not downloaded yet
2026-03-26 22:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Fd2b71147c65c441ca0d5e16580a37d1a%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/d2b71147c65c441ca0d5e16580a37d1a/images/large/6.jpg not downloaded yet
2026-03-26 22:57:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2at/4e923cda20684323985b4d3c410e2e51/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Fd2b71147c65c441ca0d5e16580a37d1a%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/d2b71147c65c441ca0d5e16580a37d1a/images/large/7.jpg not downloaded yet
2026-03-26 22:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Fd2b71147c65c441ca0d5e16580a37d1a%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/d2b71147c65c441ca0d5e16580a37d1a/images/large/8.jpg not downloaded yet
2026-03-26 22:57:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74066d0>
2026-03-26 22:57:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8/33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F4e923cda20684323985b4d3c410e2e51%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/4e923cda20684323985b4d3c410e2e51/images/large/3.jpg saved to cache
2026-03-26 22:57:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8
2026-03-26 22:57:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74ade10>
2026-03-26 22:57:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8/33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:57:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F4e923cda20684323985b4d3c410e2e51%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/4e923cda20684323985b4d3c410e2e51/images/large/4.jpg saved to cache
2026-03-26 22:57:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8
2026-03-26 22:57:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76ed310>
2026-03-26 22:57:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8/33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:57:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F4e923cda20684323985b4d3c410e2e51%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/4e923cda20684323985b4d3c410e2e51/images/large/6.jpg saved to cache
2026-03-26 22:57:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8
2026-03-26 22:57:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Fd2b71147c65c441ca0d5e16580a37d1a%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/d2b71147c65c441ca0d5e16580a37d1a/images/large/9.jpg not downloaded yet
2026-03-26 22:57:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/d2b71147c65c441ca0d5e16580a37d1a/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Fd2b71147c65c441ca0d5e16580a37d1a%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/d2b71147c65c441ca0d5e16580a37d1a/images/large/10.jpg not downloaded yet
2026-03-26 22:57:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7443510>
2026-03-26 22:57:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8/33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:57:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F4e923cda20684323985b4d3c410e2e51%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/4e923cda20684323985b4d3c410e2e51/images/large/5.jpg saved to cache
2026-03-26 22:57:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8
2026-03-26 22:57:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7a63e50>
2026-03-26 22:57:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8/33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:57:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F4e923cda20684323985b4d3c410e2e51%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/4e923cda20684323985b4d3c410e2e51/images/large/7.jpg saved to cache
2026-03-26 22:57:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8
2026-03-26 22:57:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76ccf10>
2026-03-26 22:57:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8/33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:57:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F4e923cda20684323985b4d3c410e2e51%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/4e923cda20684323985b4d3c410e2e51/images/large/8.jpg saved to cache
2026-03-26 22:57:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8
2026-03-26 22:57:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd0d3310>
2026-03-26 22:57:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8/33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:57:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F4e923cda20684323985b4d3c410e2e51%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/4e923cda20684323985b4d3c410e2e51/images/large/9.jpg saved to cache
2026-03-26 22:57:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8
2026-03-26 22:57:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2at/4e923cda20684323985b4d3c410e2e51/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:08 [ayvens.be] INFO: Found listing with ID: 1985641
2026-03-26 22:57:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985641%27 HTTP/1.1" 200 None
2026-03-26 22:57:08 [ayvens.be] INFO: Scrape type for 1985641: 1
2026-03-26 22:57:08 [ayvens.be] INFO: Extracting data for car ID: 1985641
2026-03-26 22:57:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d291316e-e7fb-5331-8027-e134326c102a with identifier: 1985641
2026-03-26 22:57:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d291316e-e7fb-5331-8027-e134326c102a with scrape type 1
2026-03-26 22:57:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d291316e-e7fb-5331-8027-e134326c102a
2026-03-26 22:57:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252F44dd932052d74ae59a83c77b14ca82d8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/44dd932052d74ae59a83c77b14ca82d8/images/large/1.jpg not downloaded yet
2026-03-26 22:57:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/d2b71147c65c441ca0d5e16580a37d1a/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/d2b71147c65c441ca0d5e16580a37d1a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/d2b71147c65c441ca0d5e16580a37d1a/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252F44dd932052d74ae59a83c77b14ca82d8%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/44dd932052d74ae59a83c77b14ca82d8/images/large/2.jpg not downloaded yet
2026-03-26 22:57:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/d2b71147c65c441ca0d5e16580a37d1a/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/d2b71147c65c441ca0d5e16580a37d1a/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7414150>
2026-03-26 22:57:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1256ce21-2938-5b93-a2c3-c014e79ced2a/1256ce21-2938-5b93-a2c3-c014e79ced2a_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:57:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Fd2b71147c65c441ca0d5e16580a37d1a%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/d2b71147c65c441ca0d5e16580a37d1a/images/large/2.jpg saved to cache
2026-03-26 22:57:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1256ce21-2938-5b93-a2c3-c014e79ced2a
2026-03-26 22:57:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/d2b71147c65c441ca0d5e16580a37d1a/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252F44dd932052d74ae59a83c77b14ca82d8%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/44dd932052d74ae59a83c77b14ca82d8/images/large/3.jpg not downloaded yet
2026-03-26 22:57:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/d2b71147c65c441ca0d5e16580a37d1a/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b89a90>
2026-03-26 22:57:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8/33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:57:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F4e923cda20684323985b4d3c410e2e51%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/4e923cda20684323985b4d3c410e2e51/images/large/10.jpg saved to cache
2026-03-26 22:57:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8
2026-03-26 22:57:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8, skipping ID generation
2026-03-26 22:57:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8 with scrape type 1
2026-03-26 22:57:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8 sending to next pipeline
2026-03-26 22:57:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8, identifier: 1985639
2026-03-26 22:57:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252F44dd932052d74ae59a83c77b14ca82d8%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/44dd932052d74ae59a83c77b14ca82d8/images/large/4.jpg not downloaded yet
2026-03-26 22:57:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8 with identifier: 1985639
2026-03-26 22:57:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8 with identifier: 1985639
2026-03-26 22:57:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8 with identifier: 1985639 to the API
2026-03-26 22:57:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:57:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:57:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2at/4e923cda20684323985b4d3c410e2e51/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3',
 'odometer': 76254,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8/33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 374630,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2at/4e923cda20684323985b4d3c410e2e51/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8/33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 470550,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2at/4e923cda20684323985b4d3c410e2e51/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8/33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 568802,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2at/4e923cda20684323985b4d3c410e2e51/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8/33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 633917,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2at/4e923cda20684323985b4d3c410e2e51/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8/33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 432742,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2at/4e923cda20684323985b4d3c410e2e51/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8/33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 365822,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2at/4e923cda20684323985b4d3c410e2e51/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8/33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 525997,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2at/4e923cda20684323985b4d3c410e2e51/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8/33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 353190,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2at/4e923cda20684323985b4d3c410e2e51/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8/33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 401089,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2at/4e923cda20684323985b4d3c410e2e51/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8/33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 337800,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2at/4e923cda20684323985b4d3c410e2e51/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 1.4 45 TFSI E S TRONIC S LINE',
 'transmission': 'automatic',
 'trim': '1.4 45 TFSI E S TRONIC S LINE',
 'vin': None,
 'year': 2021}
2026-03-26 22:57:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985639%27 HTTP/1.1" 200 None
2026-03-26 22:57:09 [ayvens.be] INFO: Saving data for 1985639: {'created_time': 1774565829.443275, 'last_price_update_time': 1774565829.443284, 'auction_closing_time': 1774958400.0}
2026-03-26 22:57:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985639') HTTP/1.1" 204 0
2026-03-26 22:57:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7570390>
2026-03-26 22:57:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1256ce21-2938-5b93-a2c3-c014e79ced2a/1256ce21-2938-5b93-a2c3-c014e79ced2a_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:57:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Fd2b71147c65c441ca0d5e16580a37d1a%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/d2b71147c65c441ca0d5e16580a37d1a/images/large/3.jpg saved to cache
2026-03-26 22:57:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1256ce21-2938-5b93-a2c3-c014e79ced2a
2026-03-26 22:57:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77af150>
2026-03-26 22:57:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1256ce21-2938-5b93-a2c3-c014e79ced2a/1256ce21-2938-5b93-a2c3-c014e79ced2a_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:57:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Fd2b71147c65c441ca0d5e16580a37d1a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/d2b71147c65c441ca0d5e16580a37d1a/images/large/1.jpg saved to cache
2026-03-26 22:57:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1256ce21-2938-5b93-a2c3-c014e79ced2a
2026-03-26 22:57:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79f0b90>
2026-03-26 22:57:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1256ce21-2938-5b93-a2c3-c014e79ced2a/1256ce21-2938-5b93-a2c3-c014e79ced2a_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:57:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Fd2b71147c65c441ca0d5e16580a37d1a%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/d2b71147c65c441ca0d5e16580a37d1a/images/large/5.jpg saved to cache
2026-03-26 22:57:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1256ce21-2938-5b93-a2c3-c014e79ced2a
2026-03-26 22:57:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b72edf10>
2026-03-26 22:57:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1256ce21-2938-5b93-a2c3-c014e79ced2a/1256ce21-2938-5b93-a2c3-c014e79ced2a_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:57:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Fd2b71147c65c441ca0d5e16580a37d1a%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/d2b71147c65c441ca0d5e16580a37d1a/images/large/4.jpg saved to cache
2026-03-26 22:57:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1256ce21-2938-5b93-a2c3-c014e79ced2a
2026-03-26 22:57:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7ca9350>
2026-03-26 22:57:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1256ce21-2938-5b93-a2c3-c014e79ced2a/1256ce21-2938-5b93-a2c3-c014e79ced2a_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:57:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Fd2b71147c65c441ca0d5e16580a37d1a%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/d2b71147c65c441ca0d5e16580a37d1a/images/large/6.jpg saved to cache
2026-03-26 22:57:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1256ce21-2938-5b93-a2c3-c014e79ced2a
2026-03-26 22:57:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/d2b71147c65c441ca0d5e16580a37d1a/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252F44dd932052d74ae59a83c77b14ca82d8%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/44dd932052d74ae59a83c77b14ca82d8/images/large/5.jpg not downloaded yet
2026-03-26 22:57:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7413210>
2026-03-26 22:57:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1256ce21-2938-5b93-a2c3-c014e79ced2a/1256ce21-2938-5b93-a2c3-c014e79ced2a_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:57:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Fd2b71147c65c441ca0d5e16580a37d1a%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/d2b71147c65c441ca0d5e16580a37d1a/images/large/7.jpg saved to cache
2026-03-26 22:57:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1256ce21-2938-5b93-a2c3-c014e79ced2a
2026-03-26 22:57:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b728e110>
2026-03-26 22:57:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1256ce21-2938-5b93-a2c3-c014e79ced2a/1256ce21-2938-5b93-a2c3-c014e79ced2a_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:57:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Fd2b71147c65c441ca0d5e16580a37d1a%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/d2b71147c65c441ca0d5e16580a37d1a/images/large/10.jpg saved to cache
2026-03-26 22:57:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1256ce21-2938-5b93-a2c3-c014e79ced2a
2026-03-26 22:57:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/d2b71147c65c441ca0d5e16580a37d1a/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252F44dd932052d74ae59a83c77b14ca82d8%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/44dd932052d74ae59a83c77b14ca82d8/images/large/6.jpg not downloaded yet
2026-03-26 22:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252F44dd932052d74ae59a83c77b14ca82d8%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/44dd932052d74ae59a83c77b14ca82d8/images/large/7.jpg not downloaded yet
2026-03-26 22:57:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c827d0>
2026-03-26 22:57:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1256ce21-2938-5b93-a2c3-c014e79ced2a/1256ce21-2938-5b93-a2c3-c014e79ced2a_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Fd2b71147c65c441ca0d5e16580a37d1a%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/d2b71147c65c441ca0d5e16580a37d1a/images/large/8.jpg saved to cache
2026-03-26 22:57:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1256ce21-2938-5b93-a2c3-c014e79ced2a
2026-03-26 22:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252F44dd932052d74ae59a83c77b14ca82d8%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/44dd932052d74ae59a83c77b14ca82d8/images/large/8.jpg not downloaded yet
2026-03-26 22:57:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7912610>
2026-03-26 22:57:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1256ce21-2938-5b93-a2c3-c014e79ced2a/1256ce21-2938-5b93-a2c3-c014e79ced2a_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Fd2b71147c65c441ca0d5e16580a37d1a%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/d2b71147c65c441ca0d5e16580a37d1a/images/large/9.jpg saved to cache
2026-03-26 22:57:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1256ce21-2938-5b93-a2c3-c014e79ced2a
2026-03-26 22:57:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1256ce21-2938-5b93-a2c3-c014e79ced2a, skipping ID generation
2026-03-26 22:57:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1256ce21-2938-5b93-a2c3-c014e79ced2a with scrape type 1
2026-03-26 22:57:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1256ce21-2938-5b93-a2c3-c014e79ced2a sending to next pipeline
2026-03-26 22:57:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 1256ce21-2938-5b93-a2c3-c014e79ced2a, identifier: 1985640
2026-03-26 22:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252F44dd932052d74ae59a83c77b14ca82d8%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/44dd932052d74ae59a83c77b14ca82d8/images/large/9.jpg not downloaded yet
2026-03-26 22:57:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 1256ce21-2938-5b93-a2c3-c014e79ced2a with identifier: 1985640
2026-03-26 22:57:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 1256ce21-2938-5b93-a2c3-c014e79ced2a with identifier: 1985640
2026-03-26 22:57:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 1256ce21-2938-5b93-a2c3-c014e79ced2a with identifier: 1985640 to the API
2026-03-26 22:57:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:57:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:57:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2au/d2b71147c65c441ca0d5e16580a37d1a/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '1256ce21-2938-5b93-a2c3-c014e79ced2a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'LEON ST',
 'odometer': 49697,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1256ce21-2938-5b93-a2c3-c014e79ced2a/1256ce21-2938-5b93-a2c3-c014e79ced2a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 390235,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/d2b71147c65c441ca0d5e16580a37d1a/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1256ce21-2938-5b93-a2c3-c014e79ced2a/1256ce21-2938-5b93-a2c3-c014e79ced2a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 375078,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/d2b71147c65c441ca0d5e16580a37d1a/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1256ce21-2938-5b93-a2c3-c014e79ced2a/1256ce21-2938-5b93-a2c3-c014e79ced2a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 375043,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/d2b71147c65c441ca0d5e16580a37d1a/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1256ce21-2938-5b93-a2c3-c014e79ced2a/1256ce21-2938-5b93-a2c3-c014e79ced2a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 399941,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/d2b71147c65c441ca0d5e16580a37d1a/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1256ce21-2938-5b93-a2c3-c014e79ced2a/1256ce21-2938-5b93-a2c3-c014e79ced2a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 386916,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/d2b71147c65c441ca0d5e16580a37d1a/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1256ce21-2938-5b93-a2c3-c014e79ced2a/1256ce21-2938-5b93-a2c3-c014e79ced2a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 315767,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/d2b71147c65c441ca0d5e16580a37d1a/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1256ce21-2938-5b93-a2c3-c014e79ced2a/1256ce21-2938-5b93-a2c3-c014e79ced2a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 320248,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/d2b71147c65c441ca0d5e16580a37d1a/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1256ce21-2938-5b93-a2c3-c014e79ced2a/1256ce21-2938-5b93-a2c3-c014e79ced2a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 437615,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/d2b71147c65c441ca0d5e16580a37d1a/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1256ce21-2938-5b93-a2c3-c014e79ced2a/1256ce21-2938-5b93-a2c3-c014e79ced2a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 285007,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/d2b71147c65c441ca0d5e16580a37d1a/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1256ce21-2938-5b93-a2c3-c014e79ced2a/1256ce21-2938-5b93-a2c3-c014e79ced2a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 189847,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/d2b71147c65c441ca0d5e16580a37d1a/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT LEON ST 1.5 TSI 130 MOVE!',
 'transmission': 'manual',
 'trim': '1.5 TSI 130 MOVE!',
 'vin': None,
 'year': 2021}
2026-03-26 22:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985640%27 HTTP/1.1" 200 None
2026-03-26 22:57:10 [ayvens.be] INFO: Saving data for 1985640: {'created_time': 1774565830.710207, 'last_price_update_time': 1774565830.710216, 'auction_closing_time': 1774958400.0}
2026-03-26 22:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985640') HTTP/1.1" 204 0
2026-03-26 22:57:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/44dd932052d74ae59a83c77b14ca82d8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/44dd932052d74ae59a83c77b14ca82d8/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252F44dd932052d74ae59a83c77b14ca82d8%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/44dd932052d74ae59a83c77b14ca82d8/images/large/10.jpg not downloaded yet
2026-03-26 22:57:10 [ayvens.be] INFO: Found listing with ID: 1985642
2026-03-26 22:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985642%27 HTTP/1.1" 200 None
2026-03-26 22:57:10 [ayvens.be] INFO: Scrape type for 1985642: 1
2026-03-26 22:57:10 [ayvens.be] INFO: Extracting data for car ID: 1985642
2026-03-26 22:57:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19 with identifier: 1985642
2026-03-26 22:57:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19 with scrape type 1
2026-03-26 22:57:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19
2026-03-26 22:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Fbff75bb615904631850ace3418b33007%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/bff75bb615904631850ace3418b33007/images/large/1.jpg not downloaded yet
2026-03-26 22:57:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/44dd932052d74ae59a83c77b14ca82d8/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Fbff75bb615904631850ace3418b33007%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/bff75bb615904631850ace3418b33007/images/large/2.jpg not downloaded yet
2026-03-26 22:57:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/44dd932052d74ae59a83c77b14ca82d8/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Fbff75bb615904631850ace3418b33007%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/bff75bb615904631850ace3418b33007/images/large/3.jpg not downloaded yet
2026-03-26 22:57:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/44dd932052d74ae59a83c77b14ca82d8/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/44dd932052d74ae59a83c77b14ca82d8/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b777be50>
2026-03-26 22:57:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d291316e-e7fb-5331-8027-e134326c102a/d291316e-e7fb-5331-8027-e134326c102a_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252F44dd932052d74ae59a83c77b14ca82d8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/44dd932052d74ae59a83c77b14ca82d8/images/large/1.jpg saved to cache
2026-03-26 22:57:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d291316e-e7fb-5331-8027-e134326c102a
2026-03-26 22:57:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e3d210>
2026-03-26 22:57:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d291316e-e7fb-5331-8027-e134326c102a/d291316e-e7fb-5331-8027-e134326c102a_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252F44dd932052d74ae59a83c77b14ca82d8%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/44dd932052d74ae59a83c77b14ca82d8/images/large/2.jpg saved to cache
2026-03-26 22:57:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d291316e-e7fb-5331-8027-e134326c102a
2026-03-26 22:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Fbff75bb615904631850ace3418b33007%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/bff75bb615904631850ace3418b33007/images/large/4.jpg not downloaded yet
2026-03-26 22:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Fbff75bb615904631850ace3418b33007%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/bff75bb615904631850ace3418b33007/images/large/5.jpg not downloaded yet
2026-03-26 22:57:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5ca4ad0>
2026-03-26 22:57:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d291316e-e7fb-5331-8027-e134326c102a/d291316e-e7fb-5331-8027-e134326c102a_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252F44dd932052d74ae59a83c77b14ca82d8%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/44dd932052d74ae59a83c77b14ca82d8/images/large/3.jpg saved to cache
2026-03-26 22:57:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d291316e-e7fb-5331-8027-e134326c102a
2026-03-26 22:57:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7450750>
2026-03-26 22:57:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d291316e-e7fb-5331-8027-e134326c102a/d291316e-e7fb-5331-8027-e134326c102a_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252F44dd932052d74ae59a83c77b14ca82d8%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/44dd932052d74ae59a83c77b14ca82d8/images/large/4.jpg saved to cache
2026-03-26 22:57:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d291316e-e7fb-5331-8027-e134326c102a
2026-03-26 22:57:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7aa1310>
2026-03-26 22:57:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d291316e-e7fb-5331-8027-e134326c102a/d291316e-e7fb-5331-8027-e134326c102a_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252F44dd932052d74ae59a83c77b14ca82d8%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/44dd932052d74ae59a83c77b14ca82d8/images/large/5.jpg saved to cache
2026-03-26 22:57:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d291316e-e7fb-5331-8027-e134326c102a
2026-03-26 22:57:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6deeed0>
2026-03-26 22:57:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d291316e-e7fb-5331-8027-e134326c102a/d291316e-e7fb-5331-8027-e134326c102a_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252F44dd932052d74ae59a83c77b14ca82d8%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/44dd932052d74ae59a83c77b14ca82d8/images/large/6.jpg saved to cache
2026-03-26 22:57:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d291316e-e7fb-5331-8027-e134326c102a
2026-03-26 22:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Fbff75bb615904631850ace3418b33007%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/bff75bb615904631850ace3418b33007/images/large/6.jpg not downloaded yet
2026-03-26 22:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Fbff75bb615904631850ace3418b33007%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/bff75bb615904631850ace3418b33007/images/large/7.jpg not downloaded yet
2026-03-26 22:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Fbff75bb615904631850ace3418b33007%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/bff75bb615904631850ace3418b33007/images/large/8.jpg not downloaded yet
2026-03-26 22:57:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/44dd932052d74ae59a83c77b14ca82d8/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/44dd932052d74ae59a83c77b14ca82d8/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/44dd932052d74ae59a83c77b14ca82d8/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/44dd932052d74ae59a83c77b14ca82d8/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2af/bff75bb615904631850ace3418b33007/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Fbff75bb615904631850ace3418b33007%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/bff75bb615904631850ace3418b33007/images/large/9.jpg not downloaded yet
2026-03-26 22:57:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2af/bff75bb615904631850ace3418b33007/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Fbff75bb615904631850ace3418b33007%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/bff75bb615904631850ace3418b33007/images/large/10.jpg not downloaded yet
2026-03-26 22:57:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2af/bff75bb615904631850ace3418b33007/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:11 [ayvens.be] INFO: Found listing with ID: 1985643
2026-03-26 22:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985643%27 HTTP/1.1" 200 None
2026-03-26 22:57:11 [ayvens.be] INFO: Scrape type for 1985643: 1
2026-03-26 22:57:11 [ayvens.be] INFO: Extracting data for car ID: 1985643
2026-03-26 22:57:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db4811c8-bd53-558b-b1fd-f2e5723c3231 with identifier: 1985643
2026-03-26 22:57:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db4811c8-bd53-558b-b1fd-f2e5723c3231 with scrape type 1
2026-03-26 22:57:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item db4811c8-bd53-558b-b1fd-f2e5723c3231
2026-03-26 22:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Ff26cbb5146404f61910baf19dd689d3b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/f26cbb5146404f61910baf19dd689d3b/images/large/1.jpg not downloaded yet
2026-03-26 22:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Ff26cbb5146404f61910baf19dd689d3b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/f26cbb5146404f61910baf19dd689d3b/images/large/2.jpg not downloaded yet
2026-03-26 22:57:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7aa1cd0>
2026-03-26 22:57:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d291316e-e7fb-5331-8027-e134326c102a/d291316e-e7fb-5331-8027-e134326c102a_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252F44dd932052d74ae59a83c77b14ca82d8%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/44dd932052d74ae59a83c77b14ca82d8/images/large/8.jpg saved to cache
2026-03-26 22:57:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d291316e-e7fb-5331-8027-e134326c102a
2026-03-26 22:57:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79d7c90>
2026-03-26 22:57:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d291316e-e7fb-5331-8027-e134326c102a/d291316e-e7fb-5331-8027-e134326c102a_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252F44dd932052d74ae59a83c77b14ca82d8%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/44dd932052d74ae59a83c77b14ca82d8/images/large/7.jpg saved to cache
2026-03-26 22:57:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d291316e-e7fb-5331-8027-e134326c102a
2026-03-26 22:57:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b792eed0>
2026-03-26 22:57:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d291316e-e7fb-5331-8027-e134326c102a/d291316e-e7fb-5331-8027-e134326c102a_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252F44dd932052d74ae59a83c77b14ca82d8%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/44dd932052d74ae59a83c77b14ca82d8/images/large/9.jpg saved to cache
2026-03-26 22:57:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d291316e-e7fb-5331-8027-e134326c102a
2026-03-26 22:57:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e02b10>
2026-03-26 22:57:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d291316e-e7fb-5331-8027-e134326c102a/d291316e-e7fb-5331-8027-e134326c102a_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:57:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252F44dd932052d74ae59a83c77b14ca82d8%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/44dd932052d74ae59a83c77b14ca82d8/images/large/10.jpg saved to cache
2026-03-26 22:57:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d291316e-e7fb-5331-8027-e134326c102a
2026-03-26 22:57:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d291316e-e7fb-5331-8027-e134326c102a, skipping ID generation
2026-03-26 22:57:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d291316e-e7fb-5331-8027-e134326c102a with scrape type 1
2026-03-26 22:57:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d291316e-e7fb-5331-8027-e134326c102a sending to next pipeline
2026-03-26 22:57:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d291316e-e7fb-5331-8027-e134326c102a, identifier: 1985641
2026-03-26 22:57:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e4fe50>
2026-03-26 22:57:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19/f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:57:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Fbff75bb615904631850ace3418b33007%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/bff75bb615904631850ace3418b33007/images/large/3.jpg saved to cache
2026-03-26 22:57:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19
2026-03-26 22:57:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Ff26cbb5146404f61910baf19dd689d3b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/f26cbb5146404f61910baf19dd689d3b/images/large/3.jpg not downloaded yet
2026-03-26 22:57:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d291316e-e7fb-5331-8027-e134326c102a with identifier: 1985641
2026-03-26 22:57:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d291316e-e7fb-5331-8027-e134326c102a with identifier: 1985641
2026-03-26 22:57:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d291316e-e7fb-5331-8027-e134326c102a with identifier: 1985641 to the API
2026-03-26 22:57:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:57:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:57:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2au/44dd932052d74ae59a83c77b14ca82d8/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd291316e-e7fb-5331-8027-e134326c102a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLB',
 'odometer': 116540,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d291316e-e7fb-5331-8027-e134326c102a/d291316e-e7fb-5331-8027-e134326c102a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 639223,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/44dd932052d74ae59a83c77b14ca82d8/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d291316e-e7fb-5331-8027-e134326c102a/d291316e-e7fb-5331-8027-e134326c102a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 641410,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/44dd932052d74ae59a83c77b14ca82d8/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d291316e-e7fb-5331-8027-e134326c102a/d291316e-e7fb-5331-8027-e134326c102a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 668970,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/44dd932052d74ae59a83c77b14ca82d8/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d291316e-e7fb-5331-8027-e134326c102a/d291316e-e7fb-5331-8027-e134326c102a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 671851,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/44dd932052d74ae59a83c77b14ca82d8/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d291316e-e7fb-5331-8027-e134326c102a/d291316e-e7fb-5331-8027-e134326c102a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 607736,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/44dd932052d74ae59a83c77b14ca82d8/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d291316e-e7fb-5331-8027-e134326c102a/d291316e-e7fb-5331-8027-e134326c102a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 542035,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/44dd932052d74ae59a83c77b14ca82d8/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d291316e-e7fb-5331-8027-e134326c102a/d291316e-e7fb-5331-8027-e134326c102a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 675494,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/44dd932052d74ae59a83c77b14ca82d8/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d291316e-e7fb-5331-8027-e134326c102a/d291316e-e7fb-5331-8027-e134326c102a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 702265,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/44dd932052d74ae59a83c77b14ca82d8/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d291316e-e7fb-5331-8027-e134326c102a/d291316e-e7fb-5331-8027-e134326c102a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 591972,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/44dd932052d74ae59a83c77b14ca82d8/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d291316e-e7fb-5331-8027-e134326c102a/d291316e-e7fb-5331-8027-e134326c102a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 635129,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/44dd932052d74ae59a83c77b14ca82d8/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLB 2.0 GLB 180 D BUSINESS SOLUTION',
 'transmission': 'automatic',
 'trim': '2.0 GLB 180 D BUSINESS SOLUTION',
 'vin': None,
 'year': 2021}
2026-03-26 22:57:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985641%27 HTTP/1.1" 200 None
2026-03-26 22:57:12 [ayvens.be] INFO: Saving data for 1985641: {'created_time': 1774565832.587549, 'last_price_update_time': 1774565832.587558, 'auction_closing_time': 1774958400.0}
2026-03-26 22:57:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985641') HTTP/1.1" 204 0
2026-03-26 22:57:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b72eff10>
2026-03-26 22:57:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19/f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:57:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Fbff75bb615904631850ace3418b33007%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/bff75bb615904631850ace3418b33007/images/large/1.jpg saved to cache
2026-03-26 22:57:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19
2026-03-26 22:57:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Ff26cbb5146404f61910baf19dd689d3b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/f26cbb5146404f61910baf19dd689d3b/images/large/4.jpg not downloaded yet
2026-03-26 22:57:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2af/bff75bb615904631850ace3418b33007/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Ff26cbb5146404f61910baf19dd689d3b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/f26cbb5146404f61910baf19dd689d3b/images/large/5.jpg not downloaded yet
2026-03-26 22:57:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e2b4d0>
2026-03-26 22:57:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19/f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:57:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Fbff75bb615904631850ace3418b33007%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/bff75bb615904631850ace3418b33007/images/large/2.jpg saved to cache
2026-03-26 22:57:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19
2026-03-26 22:57:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2af/bff75bb615904631850ace3418b33007/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2af/bff75bb615904631850ace3418b33007/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2af/bff75bb615904631850ace3418b33007/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Ff26cbb5146404f61910baf19dd689d3b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/f26cbb5146404f61910baf19dd689d3b/images/large/6.jpg not downloaded yet
2026-03-26 22:57:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2af/bff75bb615904631850ace3418b33007/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2af/bff75bb615904631850ace3418b33007/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2af/bff75bb615904631850ace3418b33007/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Ff26cbb5146404f61910baf19dd689d3b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/f26cbb5146404f61910baf19dd689d3b/images/large/7.jpg not downloaded yet
2026-03-26 22:57:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74a4650>
2026-03-26 22:57:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19/f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:57:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Fbff75bb615904631850ace3418b33007%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/bff75bb615904631850ace3418b33007/images/large/7.jpg saved to cache
2026-03-26 22:57:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19
2026-03-26 22:57:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Ff26cbb5146404f61910baf19dd689d3b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/f26cbb5146404f61910baf19dd689d3b/images/large/8.jpg not downloaded yet
2026-03-26 22:57:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Ff26cbb5146404f61910baf19dd689d3b%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/f26cbb5146404f61910baf19dd689d3b/images/large/9.jpg not downloaded yet
2026-03-26 22:57:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7475610>
2026-03-26 22:57:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19/f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:57:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Fbff75bb615904631850ace3418b33007%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/bff75bb615904631850ace3418b33007/images/large/4.jpg saved to cache
2026-03-26 22:57:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19
2026-03-26 22:57:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7425d10>
2026-03-26 22:57:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19/f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:57:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Fbff75bb615904631850ace3418b33007%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/bff75bb615904631850ace3418b33007/images/large/9.jpg saved to cache
2026-03-26 22:57:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19
2026-03-26 22:57:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74144d0>
2026-03-26 22:57:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19/f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:57:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Fbff75bb615904631850ace3418b33007%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/bff75bb615904631850ace3418b33007/images/large/6.jpg saved to cache
2026-03-26 22:57:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19
2026-03-26 22:57:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7496c90>
2026-03-26 22:57:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19/f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:57:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Fbff75bb615904631850ace3418b33007%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/bff75bb615904631850ace3418b33007/images/large/8.jpg saved to cache
2026-03-26 22:57:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19
2026-03-26 22:57:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b78a9d50>
2026-03-26 22:57:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19/f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:57:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Fbff75bb615904631850ace3418b33007%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/bff75bb615904631850ace3418b33007/images/large/5.jpg saved to cache
2026-03-26 22:57:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19
2026-03-26 22:57:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74248d0>
2026-03-26 22:57:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19/f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:57:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Fbff75bb615904631850ace3418b33007%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/bff75bb615904631850ace3418b33007/images/large/10.jpg saved to cache
2026-03-26 22:57:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19
2026-03-26 22:57:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19, skipping ID generation
2026-03-26 22:57:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19 with scrape type 1
2026-03-26 22:57:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19 sending to next pipeline
2026-03-26 22:57:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19, identifier: 1985642
2026-03-26 22:57:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19 with identifier: 1985642
2026-03-26 22:57:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19 with identifier: 1985642
2026-03-26 22:57:13 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19 with identifier: 1985642 to the API
2026-03-26 22:57:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:57:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:57:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2af/bff75bb615904631850ace3418b33007/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 45,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X3 - 2018',
 'odometer': 100209,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19/f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 621822,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2af/bff75bb615904631850ace3418b33007/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19/f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 616563,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2af/bff75bb615904631850ace3418b33007/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19/f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 364183,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2af/bff75bb615904631850ace3418b33007/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19/f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 402763,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2af/bff75bb615904631850ace3418b33007/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19/f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 419924,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2af/bff75bb615904631850ace3418b33007/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19/f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 396204,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2af/bff75bb615904631850ace3418b33007/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19/f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 433270,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2af/bff75bb615904631850ace3418b33007/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19/f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 407753,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2af/bff75bb615904631850ace3418b33007/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19/f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 273999,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2af/bff75bb615904631850ace3418b33007/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19/f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 473279,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2af/bff75bb615904631850ace3418b33007/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X3 - 2018 2.0iA xDrive30e PHEV OPF',
 'transmission': 'automatic',
 'trim': '2.0iA xDrive30e PHEV OPF',
 'vin': None,
 'year': 2021}
2026-03-26 22:57:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985642%27 HTTP/1.1" 200 None
2026-03-26 22:57:14 [ayvens.be] INFO: Saving data for 1985642: {'created_time': 1774565834.003883, 'last_price_update_time': 1774565834.003893, 'auction_closing_time': 1774958400.0}
2026-03-26 22:57:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985642') HTTP/1.1" 204 0
2026-03-26 22:57:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/f26cbb5146404f61910baf19dd689d3b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Ff26cbb5146404f61910baf19dd689d3b%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/f26cbb5146404f61910baf19dd689d3b/images/large/10.jpg not downloaded yet
2026-03-26 22:57:14 [ayvens.be] INFO: Found listing with ID: 1985644
2026-03-26 22:57:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985644%27 HTTP/1.1" 200 None
2026-03-26 22:57:14 [ayvens.be] INFO: Scrape type for 1985644: 1
2026-03-26 22:57:14 [ayvens.be] INFO: Extracting data for car ID: 1985644
2026-03-26 22:57:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea4b1268-0e13-587a-9857-70ac9f7fa363 with identifier: 1985644
2026-03-26 22:57:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea4b1268-0e13-587a-9857-70ac9f7fa363 with scrape type 1
2026-03-26 22:57:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ea4b1268-0e13-587a-9857-70ac9f7fa363
2026-03-26 22:57:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F271787a1c6c748ea837ff3464f5f04c8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/271787a1c6c748ea837ff3464f5f04c8/images/large/1.jpg not downloaded yet
2026-03-26 22:57:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/f26cbb5146404f61910baf19dd689d3b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F271787a1c6c748ea837ff3464f5f04c8%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/271787a1c6c748ea837ff3464f5f04c8/images/large/2.jpg not downloaded yet
2026-03-26 22:57:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/f26cbb5146404f61910baf19dd689d3b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F271787a1c6c748ea837ff3464f5f04c8%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/271787a1c6c748ea837ff3464f5f04c8/images/large/3.jpg not downloaded yet
2026-03-26 22:57:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/f26cbb5146404f61910baf19dd689d3b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/f26cbb5146404f61910baf19dd689d3b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/f26cbb5146404f61910baf19dd689d3b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F271787a1c6c748ea837ff3464f5f04c8%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/271787a1c6c748ea837ff3464f5f04c8/images/large/4.jpg not downloaded yet
2026-03-26 22:57:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/f26cbb5146404f61910baf19dd689d3b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F271787a1c6c748ea837ff3464f5f04c8%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/271787a1c6c748ea837ff3464f5f04c8/images/large/5.jpg not downloaded yet
2026-03-26 22:57:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74979d0>
2026-03-26 22:57:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db4811c8-bd53-558b-b1fd-f2e5723c3231/db4811c8-bd53-558b-b1fd-f2e5723c3231_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:57:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Ff26cbb5146404f61910baf19dd689d3b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/f26cbb5146404f61910baf19dd689d3b/images/large/1.jpg saved to cache
2026-03-26 22:57:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item db4811c8-bd53-558b-b1fd-f2e5723c3231
2026-03-26 22:57:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F271787a1c6c748ea837ff3464f5f04c8%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/271787a1c6c748ea837ff3464f5f04c8/images/large/6.jpg not downloaded yet
2026-03-26 22:57:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/f26cbb5146404f61910baf19dd689d3b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F271787a1c6c748ea837ff3464f5f04c8%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/271787a1c6c748ea837ff3464f5f04c8/images/large/7.jpg not downloaded yet
2026-03-26 22:57:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/f26cbb5146404f61910baf19dd689d3b/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6da4610>
2026-03-26 22:57:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db4811c8-bd53-558b-b1fd-f2e5723c3231/db4811c8-bd53-558b-b1fd-f2e5723c3231_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:57:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Ff26cbb5146404f61910baf19dd689d3b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/f26cbb5146404f61910baf19dd689d3b/images/large/5.jpg saved to cache
2026-03-26 22:57:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item db4811c8-bd53-558b-b1fd-f2e5723c3231
2026-03-26 22:57:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b726b390>
2026-03-26 22:57:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db4811c8-bd53-558b-b1fd-f2e5723c3231/db4811c8-bd53-558b-b1fd-f2e5723c3231_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:57:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Ff26cbb5146404f61910baf19dd689d3b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/f26cbb5146404f61910baf19dd689d3b/images/large/6.jpg saved to cache
2026-03-26 22:57:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item db4811c8-bd53-558b-b1fd-f2e5723c3231
2026-03-26 22:57:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e2abd0>
2026-03-26 22:57:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db4811c8-bd53-558b-b1fd-f2e5723c3231/db4811c8-bd53-558b-b1fd-f2e5723c3231_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:57:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Ff26cbb5146404f61910baf19dd689d3b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/f26cbb5146404f61910baf19dd689d3b/images/large/7.jpg saved to cache
2026-03-26 22:57:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item db4811c8-bd53-558b-b1fd-f2e5723c3231
2026-03-26 22:57:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7428510>
2026-03-26 22:57:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db4811c8-bd53-558b-b1fd-f2e5723c3231/db4811c8-bd53-558b-b1fd-f2e5723c3231_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:57:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Ff26cbb5146404f61910baf19dd689d3b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/f26cbb5146404f61910baf19dd689d3b/images/large/3.jpg saved to cache
2026-03-26 22:57:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item db4811c8-bd53-558b-b1fd-f2e5723c3231
2026-03-26 22:57:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74e7e10>
2026-03-26 22:57:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db4811c8-bd53-558b-b1fd-f2e5723c3231/db4811c8-bd53-558b-b1fd-f2e5723c3231_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:57:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Ff26cbb5146404f61910baf19dd689d3b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/f26cbb5146404f61910baf19dd689d3b/images/large/4.jpg saved to cache
2026-03-26 22:57:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item db4811c8-bd53-558b-b1fd-f2e5723c3231
2026-03-26 22:57:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b792fa50>
2026-03-26 22:57:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db4811c8-bd53-558b-b1fd-f2e5723c3231/db4811c8-bd53-558b-b1fd-f2e5723c3231_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:57:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Ff26cbb5146404f61910baf19dd689d3b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/f26cbb5146404f61910baf19dd689d3b/images/large/2.jpg saved to cache
2026-03-26 22:57:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item db4811c8-bd53-558b-b1fd-f2e5723c3231
2026-03-26 22:57:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/f26cbb5146404f61910baf19dd689d3b/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F271787a1c6c748ea837ff3464f5f04c8%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/271787a1c6c748ea837ff3464f5f04c8/images/large/8.jpg not downloaded yet
2026-03-26 22:57:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F271787a1c6c748ea837ff3464f5f04c8%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/271787a1c6c748ea837ff3464f5f04c8/images/large/9.jpg not downloaded yet
2026-03-26 22:57:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6ded1d0>
2026-03-26 22:57:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db4811c8-bd53-558b-b1fd-f2e5723c3231/db4811c8-bd53-558b-b1fd-f2e5723c3231_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:57:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Ff26cbb5146404f61910baf19dd689d3b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/f26cbb5146404f61910baf19dd689d3b/images/large/8.jpg saved to cache
2026-03-26 22:57:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item db4811c8-bd53-558b-b1fd-f2e5723c3231
2026-03-26 22:57:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b792dfd0>
2026-03-26 22:57:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db4811c8-bd53-558b-b1fd-f2e5723c3231/db4811c8-bd53-558b-b1fd-f2e5723c3231_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:57:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Ff26cbb5146404f61910baf19dd689d3b%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/f26cbb5146404f61910baf19dd689d3b/images/large/10.jpg saved to cache
2026-03-26 22:57:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item db4811c8-bd53-558b-b1fd-f2e5723c3231
2026-03-26 22:57:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F271787a1c6c748ea837ff3464f5f04c8%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/271787a1c6c748ea837ff3464f5f04c8/images/large/10.jpg not downloaded yet
2026-03-26 22:57:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7411cd0>
2026-03-26 22:57:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db4811c8-bd53-558b-b1fd-f2e5723c3231/db4811c8-bd53-558b-b1fd-f2e5723c3231_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:57:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Ff26cbb5146404f61910baf19dd689d3b%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/f26cbb5146404f61910baf19dd689d3b/images/large/9.jpg saved to cache
2026-03-26 22:57:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item db4811c8-bd53-558b-b1fd-f2e5723c3231
2026-03-26 22:57:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: db4811c8-bd53-558b-b1fd-f2e5723c3231, skipping ID generation
2026-03-26 22:57:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db4811c8-bd53-558b-b1fd-f2e5723c3231 with scrape type 1
2026-03-26 22:57:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item db4811c8-bd53-558b-b1fd-f2e5723c3231 sending to next pipeline
2026-03-26 22:57:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: db4811c8-bd53-558b-b1fd-f2e5723c3231, identifier: 1985643
2026-03-26 22:57:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/271787a1c6c748ea837ff3464f5f04c8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:15 [ayvens.be] INFO: Found listing with ID: 1985645
2026-03-26 22:57:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985645%27 HTTP/1.1" 200 None
2026-03-26 22:57:15 [ayvens.be] INFO: Scrape type for 1985645: 1
2026-03-26 22:57:15 [ayvens.be] INFO: Extracting data for car ID: 1985645
2026-03-26 22:57:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30d9656e-2bff-5edd-a622-e761c0e64a36 with identifier: 1985645
2026-03-26 22:57:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30d9656e-2bff-5edd-a622-e761c0e64a36 with scrape type 1
2026-03-26 22:57:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 30d9656e-2bff-5edd-a622-e761c0e64a36
2026-03-26 22:57:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F27244a874184474c8ea51fb64134af72%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/27244a874184474c8ea51fb64134af72/images/large/1.jpg not downloaded yet
2026-03-26 22:57:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: db4811c8-bd53-558b-b1fd-f2e5723c3231 with identifier: 1985643
2026-03-26 22:57:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: db4811c8-bd53-558b-b1fd-f2e5723c3231 with identifier: 1985643
2026-03-26 22:57:15 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: db4811c8-bd53-558b-b1fd-f2e5723c3231 with identifier: 1985643 to the API
2026-03-26 22:57:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:57:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:57:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bg/f26cbb5146404f61910baf19dd689d3b/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.3L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'db4811c8-bd53-558b-b1fd-f2e5723c3231',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A-CLASS LIMOUSINE',
 'odometer': 65895,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db4811c8-bd53-558b-b1fd-f2e5723c3231/db4811c8-bd53-558b-b1fd-f2e5723c3231_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 800757,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/f26cbb5146404f61910baf19dd689d3b/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db4811c8-bd53-558b-b1fd-f2e5723c3231/db4811c8-bd53-558b-b1fd-f2e5723c3231_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 798640,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/f26cbb5146404f61910baf19dd689d3b/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db4811c8-bd53-558b-b1fd-f2e5723c3231/db4811c8-bd53-558b-b1fd-f2e5723c3231_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 743621,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/f26cbb5146404f61910baf19dd689d3b/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db4811c8-bd53-558b-b1fd-f2e5723c3231/db4811c8-bd53-558b-b1fd-f2e5723c3231_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 740269,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/f26cbb5146404f61910baf19dd689d3b/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db4811c8-bd53-558b-b1fd-f2e5723c3231/db4811c8-bd53-558b-b1fd-f2e5723c3231_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 429570,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/f26cbb5146404f61910baf19dd689d3b/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db4811c8-bd53-558b-b1fd-f2e5723c3231/db4811c8-bd53-558b-b1fd-f2e5723c3231_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 375707,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/f26cbb5146404f61910baf19dd689d3b/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db4811c8-bd53-558b-b1fd-f2e5723c3231/db4811c8-bd53-558b-b1fd-f2e5723c3231_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 501818,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/f26cbb5146404f61910baf19dd689d3b/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db4811c8-bd53-558b-b1fd-f2e5723c3231/db4811c8-bd53-558b-b1fd-f2e5723c3231_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 429215,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/f26cbb5146404f61910baf19dd689d3b/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db4811c8-bd53-558b-b1fd-f2e5723c3231/db4811c8-bd53-558b-b1fd-f2e5723c3231_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 404573,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/f26cbb5146404f61910baf19dd689d3b/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db4811c8-bd53-558b-b1fd-f2e5723c3231/db4811c8-bd53-558b-b1fd-f2e5723c3231_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 411709,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/f26cbb5146404f61910baf19dd689d3b/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ A-CLASS LIMOUSINE 1.3 A 250 E BUSINESS SOLUTION DCT',
 'transmission': 'automatic',
 'trim': '1.3 A 250 E BUSINESS SOLUTION DCT',
 'vin': None,
 'year': 2021}
2026-03-26 22:57:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985643%27 HTTP/1.1" 200 None
2026-03-26 22:57:16 [ayvens.be] INFO: Saving data for 1985643: {'created_time': 1774565836.526357, 'last_price_update_time': 1774565836.526366, 'auction_closing_time': 1774958400.0}
2026-03-26 22:57:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985643') HTTP/1.1" 204 0
2026-03-26 22:57:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/271787a1c6c748ea837ff3464f5f04c8/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F27244a874184474c8ea51fb64134af72%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/27244a874184474c8ea51fb64134af72/images/large/2.jpg not downloaded yet
2026-03-26 22:57:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F27244a874184474c8ea51fb64134af72%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/27244a874184474c8ea51fb64134af72/images/large/3.jpg not downloaded yet
2026-03-26 22:57:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b782d750>
2026-03-26 22:57:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea4b1268-0e13-587a-9857-70ac9f7fa363/ea4b1268-0e13-587a-9857-70ac9f7fa363_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:57:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F271787a1c6c748ea837ff3464f5f04c8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/271787a1c6c748ea837ff3464f5f04c8/images/large/1.jpg saved to cache
2026-03-26 22:57:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ea4b1268-0e13-587a-9857-70ac9f7fa363
2026-03-26 22:57:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/271787a1c6c748ea837ff3464f5f04c8/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/271787a1c6c748ea837ff3464f5f04c8/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/271787a1c6c748ea837ff3464f5f04c8/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F27244a874184474c8ea51fb64134af72%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/27244a874184474c8ea51fb64134af72/images/large/4.jpg not downloaded yet
2026-03-26 22:57:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/271787a1c6c748ea837ff3464f5f04c8/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F27244a874184474c8ea51fb64134af72%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/27244a874184474c8ea51fb64134af72/images/large/5.jpg not downloaded yet
2026-03-26 22:57:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74a59d0>
2026-03-26 22:57:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea4b1268-0e13-587a-9857-70ac9f7fa363/ea4b1268-0e13-587a-9857-70ac9f7fa363_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:57:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F271787a1c6c748ea837ff3464f5f04c8%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/271787a1c6c748ea837ff3464f5f04c8/images/large/2.jpg saved to cache
2026-03-26 22:57:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ea4b1268-0e13-587a-9857-70ac9f7fa363
2026-03-26 22:57:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F27244a874184474c8ea51fb64134af72%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/27244a874184474c8ea51fb64134af72/images/large/6.jpg not downloaded yet
2026-03-26 22:57:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/271787a1c6c748ea837ff3464f5f04c8/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F27244a874184474c8ea51fb64134af72%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/27244a874184474c8ea51fb64134af72/images/large/7.jpg not downloaded yet
2026-03-26 22:57:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7a82b10>
2026-03-26 22:57:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea4b1268-0e13-587a-9857-70ac9f7fa363/ea4b1268-0e13-587a-9857-70ac9f7fa363_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:57:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F271787a1c6c748ea837ff3464f5f04c8%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/271787a1c6c748ea837ff3464f5f04c8/images/large/4.jpg saved to cache
2026-03-26 22:57:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ea4b1268-0e13-587a-9857-70ac9f7fa363
2026-03-26 22:57:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e3fa10>
2026-03-26 22:57:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea4b1268-0e13-587a-9857-70ac9f7fa363/ea4b1268-0e13-587a-9857-70ac9f7fa363_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:57:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F271787a1c6c748ea837ff3464f5f04c8%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/271787a1c6c748ea837ff3464f5f04c8/images/large/3.jpg saved to cache
2026-03-26 22:57:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ea4b1268-0e13-587a-9857-70ac9f7fa363
2026-03-26 22:57:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c75c50>
2026-03-26 22:57:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea4b1268-0e13-587a-9857-70ac9f7fa363/ea4b1268-0e13-587a-9857-70ac9f7fa363_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:57:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F271787a1c6c748ea837ff3464f5f04c8%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/271787a1c6c748ea837ff3464f5f04c8/images/large/5.jpg saved to cache
2026-03-26 22:57:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ea4b1268-0e13-587a-9857-70ac9f7fa363
2026-03-26 22:57:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74e6a10>
2026-03-26 22:57:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea4b1268-0e13-587a-9857-70ac9f7fa363/ea4b1268-0e13-587a-9857-70ac9f7fa363_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:57:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F271787a1c6c748ea837ff3464f5f04c8%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/271787a1c6c748ea837ff3464f5f04c8/images/large/6.jpg saved to cache
2026-03-26 22:57:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ea4b1268-0e13-587a-9857-70ac9f7fa363
2026-03-26 22:57:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/271787a1c6c748ea837ff3464f5f04c8/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F27244a874184474c8ea51fb64134af72%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/27244a874184474c8ea51fb64134af72/images/large/8.jpg not downloaded yet
2026-03-26 22:57:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F27244a874184474c8ea51fb64134af72%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/27244a874184474c8ea51fb64134af72/images/large/9.jpg not downloaded yet
2026-03-26 22:57:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/27244a874184474c8ea51fb64134af72/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76cf690>
2026-03-26 22:57:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea4b1268-0e13-587a-9857-70ac9f7fa363/ea4b1268-0e13-587a-9857-70ac9f7fa363_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:57:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F271787a1c6c748ea837ff3464f5f04c8%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/271787a1c6c748ea837ff3464f5f04c8/images/large/7.jpg saved to cache
2026-03-26 22:57:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ea4b1268-0e13-587a-9857-70ac9f7fa363
2026-03-26 22:57:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/27244a874184474c8ea51fb64134af72/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F27244a874184474c8ea51fb64134af72%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/27244a874184474c8ea51fb64134af72/images/large/10.jpg not downloaded yet
2026-03-26 22:57:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/271787a1c6c748ea837ff3464f5f04c8/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/27244a874184474c8ea51fb64134af72/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/271787a1c6c748ea837ff3464f5f04c8/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:17 [ayvens.be] INFO: Found listing with ID: 1985646
2026-03-26 22:57:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985646%27 HTTP/1.1" 200 None
2026-03-26 22:57:17 [ayvens.be] INFO: Scrape type for 1985646: 1
2026-03-26 22:57:17 [ayvens.be] INFO: Extracting data for car ID: 1985646
2026-03-26 22:57:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 37c6d6d4-46ac-5dce-91da-cd77a59a61e2 with identifier: 1985646
2026-03-26 22:57:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 37c6d6d4-46ac-5dce-91da-cd77a59a61e2 with scrape type 1
2026-03-26 22:57:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 37c6d6d4-46ac-5dce-91da-cd77a59a61e2
2026-03-26 22:57:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc2e8634b7609434b9251da549c509696%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c2e8634b7609434b9251da549c509696/images/large/1.jpg not downloaded yet
2026-03-26 22:57:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/27244a874184474c8ea51fb64134af72/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79f0a50>
2026-03-26 22:57:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea4b1268-0e13-587a-9857-70ac9f7fa363/ea4b1268-0e13-587a-9857-70ac9f7fa363_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:57:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F271787a1c6c748ea837ff3464f5f04c8%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/271787a1c6c748ea837ff3464f5f04c8/images/large/8.jpg saved to cache
2026-03-26 22:57:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ea4b1268-0e13-587a-9857-70ac9f7fa363
2026-03-26 22:57:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7570410>
2026-03-26 22:57:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30d9656e-2bff-5edd-a622-e761c0e64a36/30d9656e-2bff-5edd-a622-e761c0e64a36_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:57:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F27244a874184474c8ea51fb64134af72%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/27244a874184474c8ea51fb64134af72/images/large/3.jpg saved to cache
2026-03-26 22:57:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 30d9656e-2bff-5edd-a622-e761c0e64a36
2026-03-26 22:57:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc2e8634b7609434b9251da549c509696%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c2e8634b7609434b9251da549c509696/images/large/2.jpg not downloaded yet
2026-03-26 22:57:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/27244a874184474c8ea51fb64134af72/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/27244a874184474c8ea51fb64134af72/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc2e8634b7609434b9251da549c509696%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c2e8634b7609434b9251da549c509696/images/large/3.jpg not downloaded yet
2026-03-26 22:57:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e17310>
2026-03-26 22:57:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30d9656e-2bff-5edd-a622-e761c0e64a36/30d9656e-2bff-5edd-a622-e761c0e64a36_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:57:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F27244a874184474c8ea51fb64134af72%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/27244a874184474c8ea51fb64134af72/images/large/1.jpg saved to cache
2026-03-26 22:57:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 30d9656e-2bff-5edd-a622-e761c0e64a36
2026-03-26 22:57:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7779050>
2026-03-26 22:57:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea4b1268-0e13-587a-9857-70ac9f7fa363/ea4b1268-0e13-587a-9857-70ac9f7fa363_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:57:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F271787a1c6c748ea837ff3464f5f04c8%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/271787a1c6c748ea837ff3464f5f04c8/images/large/10.jpg saved to cache
2026-03-26 22:57:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ea4b1268-0e13-587a-9857-70ac9f7fa363
2026-03-26 22:57:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b75929d0>
2026-03-26 22:57:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30d9656e-2bff-5edd-a622-e761c0e64a36/30d9656e-2bff-5edd-a622-e761c0e64a36_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:57:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F27244a874184474c8ea51fb64134af72%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/27244a874184474c8ea51fb64134af72/images/large/2.jpg saved to cache
2026-03-26 22:57:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 30d9656e-2bff-5edd-a622-e761c0e64a36
2026-03-26 22:57:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77736d0>
2026-03-26 22:57:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea4b1268-0e13-587a-9857-70ac9f7fa363/ea4b1268-0e13-587a-9857-70ac9f7fa363_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:57:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F271787a1c6c748ea837ff3464f5f04c8%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/271787a1c6c748ea837ff3464f5f04c8/images/large/9.jpg saved to cache
2026-03-26 22:57:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ea4b1268-0e13-587a-9857-70ac9f7fa363
2026-03-26 22:57:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ea4b1268-0e13-587a-9857-70ac9f7fa363, skipping ID generation
2026-03-26 22:57:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea4b1268-0e13-587a-9857-70ac9f7fa363 with scrape type 1
2026-03-26 22:57:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ea4b1268-0e13-587a-9857-70ac9f7fa363 sending to next pipeline
2026-03-26 22:57:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: ea4b1268-0e13-587a-9857-70ac9f7fa363, identifier: 1985644
2026-03-26 22:57:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b742a250>
2026-03-26 22:57:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30d9656e-2bff-5edd-a622-e761c0e64a36/30d9656e-2bff-5edd-a622-e761c0e64a36_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:57:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F27244a874184474c8ea51fb64134af72%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/27244a874184474c8ea51fb64134af72/images/large/4.jpg saved to cache
2026-03-26 22:57:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 30d9656e-2bff-5edd-a622-e761c0e64a36
2026-03-26 22:57:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/27244a874184474c8ea51fb64134af72/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc2e8634b7609434b9251da549c509696%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c2e8634b7609434b9251da549c509696/images/large/4.jpg not downloaded yet
2026-03-26 22:57:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: ea4b1268-0e13-587a-9857-70ac9f7fa363 with identifier: 1985644
2026-03-26 22:57:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: ea4b1268-0e13-587a-9857-70ac9f7fa363 with identifier: 1985644
2026-03-26 22:57:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: ea4b1268-0e13-587a-9857-70ac9f7fa363 with identifier: 1985644 to the API
2026-03-26 22:57:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:57:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:57:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bn/271787a1c6c748ea837ff3464f5f04c8/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'ea4b1268-0e13-587a-9857-70ac9f7fa363',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 80877,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea4b1268-0e13-587a-9857-70ac9f7fa363/ea4b1268-0e13-587a-9857-70ac9f7fa363_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 704026,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/271787a1c6c748ea837ff3464f5f04c8/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea4b1268-0e13-587a-9857-70ac9f7fa363/ea4b1268-0e13-587a-9857-70ac9f7fa363_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 699559,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/271787a1c6c748ea837ff3464f5f04c8/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea4b1268-0e13-587a-9857-70ac9f7fa363/ea4b1268-0e13-587a-9857-70ac9f7fa363_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 673475,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/271787a1c6c748ea837ff3464f5f04c8/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea4b1268-0e13-587a-9857-70ac9f7fa363/ea4b1268-0e13-587a-9857-70ac9f7fa363_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 702097,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/271787a1c6c748ea837ff3464f5f04c8/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea4b1268-0e13-587a-9857-70ac9f7fa363/ea4b1268-0e13-587a-9857-70ac9f7fa363_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 669163,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/271787a1c6c748ea837ff3464f5f04c8/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea4b1268-0e13-587a-9857-70ac9f7fa363/ea4b1268-0e13-587a-9857-70ac9f7fa363_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 765293,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/271787a1c6c748ea837ff3464f5f04c8/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea4b1268-0e13-587a-9857-70ac9f7fa363/ea4b1268-0e13-587a-9857-70ac9f7fa363_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 732640,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/271787a1c6c748ea837ff3464f5f04c8/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea4b1268-0e13-587a-9857-70ac9f7fa363/ea4b1268-0e13-587a-9857-70ac9f7fa363_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 787141,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/271787a1c6c748ea837ff3464f5f04c8/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea4b1268-0e13-587a-9857-70ac9f7fa363/ea4b1268-0e13-587a-9857-70ac9f7fa363_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 923858,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/271787a1c6c748ea837ff3464f5f04c8/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea4b1268-0e13-587a-9857-70ac9f7fa363/ea4b1268-0e13-587a-9857-70ac9f7fa363_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 854918,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/271787a1c6c748ea837ff3464f5f04c8/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T2 MOMENTUM PRO',
 'transmission': 'manual',
 'trim': '1.5 T2 MOMENTUM PRO',
 'vin': None,
 'year': 2022}
2026-03-26 22:57:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985644%27 HTTP/1.1" 200 None
2026-03-26 22:57:18 [ayvens.be] INFO: Saving data for 1985644: {'created_time': 1774565838.810208, 'last_price_update_time': 1774565838.81022, 'auction_closing_time': 1774958400.0}
2026-03-26 22:57:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985644') HTTP/1.1" 204 0
2026-03-26 22:57:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/27244a874184474c8ea51fb64134af72/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/27244a874184474c8ea51fb64134af72/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc2e8634b7609434b9251da549c509696%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c2e8634b7609434b9251da549c509696/images/large/5.jpg not downloaded yet
2026-03-26 22:57:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b773d0>
2026-03-26 22:57:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30d9656e-2bff-5edd-a622-e761c0e64a36/30d9656e-2bff-5edd-a622-e761c0e64a36_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:57:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F27244a874184474c8ea51fb64134af72%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/27244a874184474c8ea51fb64134af72/images/large/5.jpg saved to cache
2026-03-26 22:57:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 30d9656e-2bff-5edd-a622-e761c0e64a36
2026-03-26 22:57:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74a5850>
2026-03-26 22:57:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30d9656e-2bff-5edd-a622-e761c0e64a36/30d9656e-2bff-5edd-a622-e761c0e64a36_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:57:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F27244a874184474c8ea51fb64134af72%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/27244a874184474c8ea51fb64134af72/images/large/6.jpg saved to cache
2026-03-26 22:57:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 30d9656e-2bff-5edd-a622-e761c0e64a36
2026-03-26 22:57:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7a57690>
2026-03-26 22:57:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30d9656e-2bff-5edd-a622-e761c0e64a36/30d9656e-2bff-5edd-a622-e761c0e64a36_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:57:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F27244a874184474c8ea51fb64134af72%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/27244a874184474c8ea51fb64134af72/images/large/7.jpg saved to cache
2026-03-26 22:57:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 30d9656e-2bff-5edd-a622-e761c0e64a36
2026-03-26 22:57:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/27244a874184474c8ea51fb64134af72/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc2e8634b7609434b9251da549c509696%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c2e8634b7609434b9251da549c509696/images/large/6.jpg not downloaded yet
2026-03-26 22:57:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc2e8634b7609434b9251da549c509696%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c2e8634b7609434b9251da549c509696/images/large/7.jpg not downloaded yet
2026-03-26 22:57:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5ca0110>
2026-03-26 22:57:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30d9656e-2bff-5edd-a622-e761c0e64a36/30d9656e-2bff-5edd-a622-e761c0e64a36_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:57:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F27244a874184474c8ea51fb64134af72%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/27244a874184474c8ea51fb64134af72/images/large/9.jpg saved to cache
2026-03-26 22:57:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 30d9656e-2bff-5edd-a622-e761c0e64a36
2026-03-26 22:57:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7ccd3d0>
2026-03-26 22:57:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30d9656e-2bff-5edd-a622-e761c0e64a36/30d9656e-2bff-5edd-a622-e761c0e64a36_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:57:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F27244a874184474c8ea51fb64134af72%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/27244a874184474c8ea51fb64134af72/images/large/8.jpg saved to cache
2026-03-26 22:57:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 30d9656e-2bff-5edd-a622-e761c0e64a36
2026-03-26 22:57:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc2e8634b7609434b9251da549c509696%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c2e8634b7609434b9251da549c509696/images/large/8.jpg not downloaded yet
2026-03-26 22:57:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd0d3110>
2026-03-26 22:57:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30d9656e-2bff-5edd-a622-e761c0e64a36/30d9656e-2bff-5edd-a622-e761c0e64a36_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:57:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F27244a874184474c8ea51fb64134af72%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/27244a874184474c8ea51fb64134af72/images/large/10.jpg saved to cache
2026-03-26 22:57:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 30d9656e-2bff-5edd-a622-e761c0e64a36
2026-03-26 22:57:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 30d9656e-2bff-5edd-a622-e761c0e64a36, skipping ID generation
2026-03-26 22:57:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30d9656e-2bff-5edd-a622-e761c0e64a36 with scrape type 1
2026-03-26 22:57:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 30d9656e-2bff-5edd-a622-e761c0e64a36 sending to next pipeline
2026-03-26 22:57:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 30d9656e-2bff-5edd-a622-e761c0e64a36, identifier: 1985645
2026-03-26 22:57:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc2e8634b7609434b9251da549c509696%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c2e8634b7609434b9251da549c509696/images/large/9.jpg not downloaded yet
2026-03-26 22:57:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 30d9656e-2bff-5edd-a622-e761c0e64a36 with identifier: 1985645
2026-03-26 22:57:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 30d9656e-2bff-5edd-a622-e761c0e64a36 with identifier: 1985645
2026-03-26 22:57:19 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 30d9656e-2bff-5edd-a622-e761c0e64a36 with identifier: 1985645 to the API
2026-03-26 22:57:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:57:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:57:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yx/27244a874184474c8ea51fb64134af72/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '30d9656e-2bff-5edd-a622-e761c0e64a36',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '2-serie',
 'odometer': 84286,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30d9656e-2bff-5edd-a622-e761c0e64a36/30d9656e-2bff-5edd-a622-e761c0e64a36_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 468473,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/27244a874184474c8ea51fb64134af72/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30d9656e-2bff-5edd-a622-e761c0e64a36/30d9656e-2bff-5edd-a622-e761c0e64a36_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 472280,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/27244a874184474c8ea51fb64134af72/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30d9656e-2bff-5edd-a622-e761c0e64a36/30d9656e-2bff-5edd-a622-e761c0e64a36_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 435075,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/27244a874184474c8ea51fb64134af72/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30d9656e-2bff-5edd-a622-e761c0e64a36/30d9656e-2bff-5edd-a622-e761c0e64a36_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 473387,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/27244a874184474c8ea51fb64134af72/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30d9656e-2bff-5edd-a622-e761c0e64a36/30d9656e-2bff-5edd-a622-e761c0e64a36_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 375091,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/27244a874184474c8ea51fb64134af72/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30d9656e-2bff-5edd-a622-e761c0e64a36/30d9656e-2bff-5edd-a622-e761c0e64a36_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 271222,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/27244a874184474c8ea51fb64134af72/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30d9656e-2bff-5edd-a622-e761c0e64a36/30d9656e-2bff-5edd-a622-e761c0e64a36_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 271746,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/27244a874184474c8ea51fb64134af72/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30d9656e-2bff-5edd-a622-e761c0e64a36/30d9656e-2bff-5edd-a622-e761c0e64a36_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 350298,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/27244a874184474c8ea51fb64134af72/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30d9656e-2bff-5edd-a622-e761c0e64a36/30d9656e-2bff-5edd-a622-e761c0e64a36_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 296032,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/27244a874184474c8ea51fb64134af72/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30d9656e-2bff-5edd-a622-e761c0e64a36/30d9656e-2bff-5edd-a622-e761c0e64a36_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 286496,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/27244a874184474c8ea51fb64134af72/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 2-serie 1.5 216DA GRAN COUPE',
 'transmission': 'automatic',
 'trim': '1.5 216DA GRAN COUPE',
 'vin': None,
 'year': 2021}
2026-03-26 22:57:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985645%27 HTTP/1.1" 200 None
2026-03-26 22:57:19 [ayvens.be] INFO: Saving data for 1985645: {'created_time': 1774565839.836967, 'last_price_update_time': 1774565839.836976, 'auction_closing_time': 1774958400.0}
2026-03-26 22:57:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985645') HTTP/1.1" 204 0
2026-03-26 22:57:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc2e8634b7609434b9251da549c509696%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c2e8634b7609434b9251da549c509696/images/large/10.jpg not downloaded yet
2026-03-26 22:57:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/c2e8634b7609434b9251da549c509696/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/c2e8634b7609434b9251da549c509696/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:19 [ayvens.be] INFO: Found listing with ID: 1985647
2026-03-26 22:57:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985647%27 HTTP/1.1" 200 None
2026-03-26 22:57:19 [ayvens.be] INFO: Scrape type for 1985647: 1
2026-03-26 22:57:19 [ayvens.be] INFO: Extracting data for car ID: 1985647
2026-03-26 22:57:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c15c3042-dda2-5b63-a4f3-55042919f60f with identifier: 1985647
2026-03-26 22:57:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c15c3042-dda2-5b63-a4f3-55042919f60f with scrape type 1
2026-03-26 22:57:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c15c3042-dda2-5b63-a4f3-55042919f60f
2026-03-26 22:57:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fea649a53cc384c1ea9b01f6b97ce2919%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/ea649a53cc384c1ea9b01f6b97ce2919/images/large/1.jpg not downloaded yet
2026-03-26 22:57:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/c2e8634b7609434b9251da549c509696/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fea649a53cc384c1ea9b01f6b97ce2919%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/ea649a53cc384c1ea9b01f6b97ce2919/images/large/2.jpg not downloaded yet
2026-03-26 22:57:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/c2e8634b7609434b9251da549c509696/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fea649a53cc384c1ea9b01f6b97ce2919%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/ea649a53cc384c1ea9b01f6b97ce2919/images/large/3.jpg not downloaded yet
2026-03-26 22:57:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/c2e8634b7609434b9251da549c509696/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fea649a53cc384c1ea9b01f6b97ce2919%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/ea649a53cc384c1ea9b01f6b97ce2919/images/large/4.jpg not downloaded yet
2026-03-26 22:57:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/c2e8634b7609434b9251da549c509696/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fea649a53cc384c1ea9b01f6b97ce2919%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/ea649a53cc384c1ea9b01f6b97ce2919/images/large/5.jpg not downloaded yet
2026-03-26 22:57:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c69e50>
2026-03-26 22:57:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37c6d6d4-46ac-5dce-91da-cd77a59a61e2/37c6d6d4-46ac-5dce-91da-cd77a59a61e2_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc2e8634b7609434b9251da549c509696%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c2e8634b7609434b9251da549c509696/images/large/2.jpg saved to cache
2026-03-26 22:57:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 37c6d6d4-46ac-5dce-91da-cd77a59a61e2
2026-03-26 22:57:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7428f90>
2026-03-26 22:57:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37c6d6d4-46ac-5dce-91da-cd77a59a61e2/37c6d6d4-46ac-5dce-91da-cd77a59a61e2_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc2e8634b7609434b9251da549c509696%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c2e8634b7609434b9251da549c509696/images/large/1.jpg saved to cache
2026-03-26 22:57:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 37c6d6d4-46ac-5dce-91da-cd77a59a61e2
2026-03-26 22:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fea649a53cc384c1ea9b01f6b97ce2919%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/ea649a53cc384c1ea9b01f6b97ce2919/images/large/6.jpg not downloaded yet
2026-03-26 22:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fea649a53cc384c1ea9b01f6b97ce2919%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/ea649a53cc384c1ea9b01f6b97ce2919/images/large/7.jpg not downloaded yet
2026-03-26 22:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fea649a53cc384c1ea9b01f6b97ce2919%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/ea649a53cc384c1ea9b01f6b97ce2919/images/large/8.jpg not downloaded yet
2026-03-26 22:57:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b728f450>
2026-03-26 22:57:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37c6d6d4-46ac-5dce-91da-cd77a59a61e2/37c6d6d4-46ac-5dce-91da-cd77a59a61e2_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc2e8634b7609434b9251da549c509696%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c2e8634b7609434b9251da549c509696/images/large/3.jpg saved to cache
2026-03-26 22:57:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 37c6d6d4-46ac-5dce-91da-cd77a59a61e2
2026-03-26 22:57:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7a57fd0>
2026-03-26 22:57:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37c6d6d4-46ac-5dce-91da-cd77a59a61e2/37c6d6d4-46ac-5dce-91da-cd77a59a61e2_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc2e8634b7609434b9251da549c509696%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c2e8634b7609434b9251da549c509696/images/large/5.jpg saved to cache
2026-03-26 22:57:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 37c6d6d4-46ac-5dce-91da-cd77a59a61e2
2026-03-26 22:57:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7586a90>
2026-03-26 22:57:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37c6d6d4-46ac-5dce-91da-cd77a59a61e2/37c6d6d4-46ac-5dce-91da-cd77a59a61e2_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc2e8634b7609434b9251da549c509696%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c2e8634b7609434b9251da549c509696/images/large/4.jpg saved to cache
2026-03-26 22:57:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 37c6d6d4-46ac-5dce-91da-cd77a59a61e2
2026-03-26 22:57:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7779b90>
2026-03-26 22:57:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37c6d6d4-46ac-5dce-91da-cd77a59a61e2/37c6d6d4-46ac-5dce-91da-cd77a59a61e2_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc2e8634b7609434b9251da549c509696%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c2e8634b7609434b9251da549c509696/images/large/6.jpg saved to cache
2026-03-26 22:57:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 37c6d6d4-46ac-5dce-91da-cd77a59a61e2
2026-03-26 22:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fea649a53cc384c1ea9b01f6b97ce2919%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/ea649a53cc384c1ea9b01f6b97ce2919/images/large/9.jpg not downloaded yet
2026-03-26 22:57:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/ea649a53cc384c1ea9b01f6b97ce2919/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/ea649a53cc384c1ea9b01f6b97ce2919/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/c2e8634b7609434b9251da549c509696/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fea649a53cc384c1ea9b01f6b97ce2919%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/ea649a53cc384c1ea9b01f6b97ce2919/images/large/10.jpg not downloaded yet
2026-03-26 22:57:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/ea649a53cc384c1ea9b01f6b97ce2919/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:20 [ayvens.be] INFO: Found listing with ID: 1985648
2026-03-26 22:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985648%27 HTTP/1.1" 200 None
2026-03-26 22:57:20 [ayvens.be] INFO: Scrape type for 1985648: 1
2026-03-26 22:57:20 [ayvens.be] INFO: Extracting data for car ID: 1985648
2026-03-26 22:57:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89a98301-746b-5629-a92d-24d79beff483 with identifier: 1985648
2026-03-26 22:57:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89a98301-746b-5629-a92d-24d79beff483 with scrape type 1
2026-03-26 22:57:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 89a98301-746b-5629-a92d-24d79beff483
2026-03-26 22:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F5d267c0a3b41422e933e48ce454aedce%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/5d267c0a3b41422e933e48ce454aedce/images/large/1.jpg not downloaded yet
2026-03-26 22:57:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/c2e8634b7609434b9251da549c509696/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/ea649a53cc384c1ea9b01f6b97ce2919/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F5d267c0a3b41422e933e48ce454aedce%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/5d267c0a3b41422e933e48ce454aedce/images/large/2.jpg not downloaded yet
2026-03-26 22:57:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/c2e8634b7609434b9251da549c509696/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/c2e8634b7609434b9251da549c509696/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F5d267c0a3b41422e933e48ce454aedce%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/5d267c0a3b41422e933e48ce454aedce/images/large/3.jpg not downloaded yet
2026-03-26 22:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F5d267c0a3b41422e933e48ce454aedce%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/5d267c0a3b41422e933e48ce454aedce/images/large/4.jpg not downloaded yet
2026-03-26 22:57:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5ca7c10>
2026-03-26 22:57:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c15c3042-dda2-5b63-a4f3-55042919f60f/c15c3042-dda2-5b63-a4f3-55042919f60f_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fea649a53cc384c1ea9b01f6b97ce2919%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/ea649a53cc384c1ea9b01f6b97ce2919/images/large/1.jpg saved to cache
2026-03-26 22:57:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c15c3042-dda2-5b63-a4f3-55042919f60f
2026-03-26 22:57:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79a59d0>
2026-03-26 22:57:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c15c3042-dda2-5b63-a4f3-55042919f60f/c15c3042-dda2-5b63-a4f3-55042919f60f_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fea649a53cc384c1ea9b01f6b97ce2919%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/ea649a53cc384c1ea9b01f6b97ce2919/images/large/3.jpg saved to cache
2026-03-26 22:57:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c15c3042-dda2-5b63-a4f3-55042919f60f
2026-03-26 22:57:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7502390>
2026-03-26 22:57:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37c6d6d4-46ac-5dce-91da-cd77a59a61e2/37c6d6d4-46ac-5dce-91da-cd77a59a61e2_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc2e8634b7609434b9251da549c509696%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c2e8634b7609434b9251da549c509696/images/large/7.jpg saved to cache
2026-03-26 22:57:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 37c6d6d4-46ac-5dce-91da-cd77a59a61e2
2026-03-26 22:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F5d267c0a3b41422e933e48ce454aedce%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/5d267c0a3b41422e933e48ce454aedce/images/large/5.jpg not downloaded yet
2026-03-26 22:57:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7981250>
2026-03-26 22:57:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c15c3042-dda2-5b63-a4f3-55042919f60f/c15c3042-dda2-5b63-a4f3-55042919f60f_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fea649a53cc384c1ea9b01f6b97ce2919%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/ea649a53cc384c1ea9b01f6b97ce2919/images/large/2.jpg saved to cache
2026-03-26 22:57:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c15c3042-dda2-5b63-a4f3-55042919f60f
2026-03-26 22:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F5d267c0a3b41422e933e48ce454aedce%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/5d267c0a3b41422e933e48ce454aedce/images/large/6.jpg not downloaded yet
2026-03-26 22:57:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74e4c90>
2026-03-26 22:57:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37c6d6d4-46ac-5dce-91da-cd77a59a61e2/37c6d6d4-46ac-5dce-91da-cd77a59a61e2_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc2e8634b7609434b9251da549c509696%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c2e8634b7609434b9251da549c509696/images/large/8.jpg saved to cache
2026-03-26 22:57:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 37c6d6d4-46ac-5dce-91da-cd77a59a61e2
2026-03-26 22:57:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7ccfd50>
2026-03-26 22:57:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c15c3042-dda2-5b63-a4f3-55042919f60f/c15c3042-dda2-5b63-a4f3-55042919f60f_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fea649a53cc384c1ea9b01f6b97ce2919%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/ea649a53cc384c1ea9b01f6b97ce2919/images/large/4.jpg saved to cache
2026-03-26 22:57:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c15c3042-dda2-5b63-a4f3-55042919f60f
2026-03-26 22:57:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e44910>
2026-03-26 22:57:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37c6d6d4-46ac-5dce-91da-cd77a59a61e2/37c6d6d4-46ac-5dce-91da-cd77a59a61e2_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc2e8634b7609434b9251da549c509696%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c2e8634b7609434b9251da549c509696/images/large/10.jpg saved to cache
2026-03-26 22:57:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 37c6d6d4-46ac-5dce-91da-cd77a59a61e2
2026-03-26 22:57:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7503590>
2026-03-26 22:57:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37c6d6d4-46ac-5dce-91da-cd77a59a61e2/37c6d6d4-46ac-5dce-91da-cd77a59a61e2_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc2e8634b7609434b9251da549c509696%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c2e8634b7609434b9251da549c509696/images/large/9.jpg saved to cache
2026-03-26 22:57:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 37c6d6d4-46ac-5dce-91da-cd77a59a61e2
2026-03-26 22:57:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 37c6d6d4-46ac-5dce-91da-cd77a59a61e2, skipping ID generation
2026-03-26 22:57:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 37c6d6d4-46ac-5dce-91da-cd77a59a61e2 with scrape type 1
2026-03-26 22:57:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 37c6d6d4-46ac-5dce-91da-cd77a59a61e2 sending to next pipeline
2026-03-26 22:57:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 37c6d6d4-46ac-5dce-91da-cd77a59a61e2, identifier: 1985646
2026-03-26 22:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F5d267c0a3b41422e933e48ce454aedce%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/5d267c0a3b41422e933e48ce454aedce/images/large/7.jpg not downloaded yet
2026-03-26 22:57:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 37c6d6d4-46ac-5dce-91da-cd77a59a61e2 with identifier: 1985646
2026-03-26 22:57:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 37c6d6d4-46ac-5dce-91da-cd77a59a61e2 with identifier: 1985646
2026-03-26 22:57:21 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 37c6d6d4-46ac-5dce-91da-cd77a59a61e2 with identifier: 1985646 to the API
2026-03-26 22:57:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:57:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:57:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bg/c2e8634b7609434b9251da549c509696/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '37c6d6d4-46ac-5dce-91da-cd77a59a61e2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'OCTAVIA COMBI DIESEL - 2020',
 'odometer': 130237,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37c6d6d4-46ac-5dce-91da-cd77a59a61e2/37c6d6d4-46ac-5dce-91da-cd77a59a61e2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 735574,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/c2e8634b7609434b9251da549c509696/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37c6d6d4-46ac-5dce-91da-cd77a59a61e2/37c6d6d4-46ac-5dce-91da-cd77a59a61e2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 724117,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/c2e8634b7609434b9251da549c509696/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37c6d6d4-46ac-5dce-91da-cd77a59a61e2/37c6d6d4-46ac-5dce-91da-cd77a59a61e2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 734777,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/c2e8634b7609434b9251da549c509696/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37c6d6d4-46ac-5dce-91da-cd77a59a61e2/37c6d6d4-46ac-5dce-91da-cd77a59a61e2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 759721,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/c2e8634b7609434b9251da549c509696/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37c6d6d4-46ac-5dce-91da-cd77a59a61e2/37c6d6d4-46ac-5dce-91da-cd77a59a61e2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 693301,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/c2e8634b7609434b9251da549c509696/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37c6d6d4-46ac-5dce-91da-cd77a59a61e2/37c6d6d4-46ac-5dce-91da-cd77a59a61e2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 758657,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/c2e8634b7609434b9251da549c509696/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37c6d6d4-46ac-5dce-91da-cd77a59a61e2/37c6d6d4-46ac-5dce-91da-cd77a59a61e2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 688279,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/c2e8634b7609434b9251da549c509696/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37c6d6d4-46ac-5dce-91da-cd77a59a61e2/37c6d6d4-46ac-5dce-91da-cd77a59a61e2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 892658,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/c2e8634b7609434b9251da549c509696/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37c6d6d4-46ac-5dce-91da-cd77a59a61e2/37c6d6d4-46ac-5dce-91da-cd77a59a61e2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 879022,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/c2e8634b7609434b9251da549c509696/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37c6d6d4-46ac-5dce-91da-cd77a59a61e2/37c6d6d4-46ac-5dce-91da-cd77a59a61e2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 868445,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/c2e8634b7609434b9251da549c509696/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA OCTAVIA COMBI DIESEL - 2020 2.0 CR TDi EVO Style DSG',
 'transmission': 'automatic',
 'trim': '2.0 CR TDi EVO Style DSG',
 'vin': None,
 'year': 2021}
2026-03-26 22:57:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985646%27 HTTP/1.1" 200 None
2026-03-26 22:57:22 [ayvens.be] INFO: Saving data for 1985646: {'created_time': 1774565842.20205, 'last_price_update_time': 1774565842.202072, 'auction_closing_time': 1774958400.0}
2026-03-26 22:57:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985646') HTTP/1.1" 204 0
2026-03-26 22:57:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/ea649a53cc384c1ea9b01f6b97ce2919/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/ea649a53cc384c1ea9b01f6b97ce2919/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/ea649a53cc384c1ea9b01f6b97ce2919/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/ea649a53cc384c1ea9b01f6b97ce2919/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/ea649a53cc384c1ea9b01f6b97ce2919/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/ea649a53cc384c1ea9b01f6b97ce2919/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F5d267c0a3b41422e933e48ce454aedce%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/5d267c0a3b41422e933e48ce454aedce/images/large/8.jpg not downloaded yet
2026-03-26 22:57:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F5d267c0a3b41422e933e48ce454aedce%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/5d267c0a3b41422e933e48ce454aedce/images/large/9.jpg not downloaded yet
2026-03-26 22:57:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cl/5d267c0a3b41422e933e48ce454aedce/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cl/5d267c0a3b41422e933e48ce454aedce/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F5d267c0a3b41422e933e48ce454aedce%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/5d267c0a3b41422e933e48ce454aedce/images/large/10.jpg not downloaded yet
2026-03-26 22:57:22 [ayvens.be] INFO: Found listing with ID: 1985649
2026-03-26 22:57:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985649%27 HTTP/1.1" 200 None
2026-03-26 22:57:22 [ayvens.be] INFO: Scrape type for 1985649: 1
2026-03-26 22:57:22 [ayvens.be] INFO: Extracting data for car ID: 1985649
2026-03-26 22:57:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b228193-ed00-578f-b827-fc5266b7ddc0 with identifier: 1985649
2026-03-26 22:57:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b228193-ed00-578f-b827-fc5266b7ddc0 with scrape type 1
2026-03-26 22:57:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1b228193-ed00-578f-b827-fc5266b7ddc0
2026-03-26 22:57:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gb%252F7393c7b57c5843eea71f080b44b29a6b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gb/7393c7b57c5843eea71f080b44b29a6b/images/large/1.jpg not downloaded yet
2026-03-26 22:57:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gb%252F7393c7b57c5843eea71f080b44b29a6b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gb/7393c7b57c5843eea71f080b44b29a6b/images/large/2.jpg not downloaded yet
2026-03-26 22:57:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gb%252F7393c7b57c5843eea71f080b44b29a6b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gb/7393c7b57c5843eea71f080b44b29a6b/images/large/3.jpg not downloaded yet
2026-03-26 22:57:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cl/5d267c0a3b41422e933e48ce454aedce/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7cce610>
2026-03-26 22:57:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c15c3042-dda2-5b63-a4f3-55042919f60f/c15c3042-dda2-5b63-a4f3-55042919f60f_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:57:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fea649a53cc384c1ea9b01f6b97ce2919%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/ea649a53cc384c1ea9b01f6b97ce2919/images/large/6.jpg saved to cache
2026-03-26 22:57:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c15c3042-dda2-5b63-a4f3-55042919f60f
2026-03-26 22:57:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7cabc10>
2026-03-26 22:57:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c15c3042-dda2-5b63-a4f3-55042919f60f/c15c3042-dda2-5b63-a4f3-55042919f60f_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:57:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fea649a53cc384c1ea9b01f6b97ce2919%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/ea649a53cc384c1ea9b01f6b97ce2919/images/large/10.jpg saved to cache
2026-03-26 22:57:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c15c3042-dda2-5b63-a4f3-55042919f60f
2026-03-26 22:57:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b745a350>
2026-03-26 22:57:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c15c3042-dda2-5b63-a4f3-55042919f60f/c15c3042-dda2-5b63-a4f3-55042919f60f_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:57:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fea649a53cc384c1ea9b01f6b97ce2919%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/ea649a53cc384c1ea9b01f6b97ce2919/images/large/5.jpg saved to cache
2026-03-26 22:57:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c15c3042-dda2-5b63-a4f3-55042919f60f
2026-03-26 22:57:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b745bcd0>
2026-03-26 22:57:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c15c3042-dda2-5b63-a4f3-55042919f60f/c15c3042-dda2-5b63-a4f3-55042919f60f_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:57:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fea649a53cc384c1ea9b01f6b97ce2919%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/ea649a53cc384c1ea9b01f6b97ce2919/images/large/7.jpg saved to cache
2026-03-26 22:57:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c15c3042-dda2-5b63-a4f3-55042919f60f
2026-03-26 22:57:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79834d0>
2026-03-26 22:57:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c15c3042-dda2-5b63-a4f3-55042919f60f/c15c3042-dda2-5b63-a4f3-55042919f60f_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:57:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fea649a53cc384c1ea9b01f6b97ce2919%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/ea649a53cc384c1ea9b01f6b97ce2919/images/large/9.jpg saved to cache
2026-03-26 22:57:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c15c3042-dda2-5b63-a4f3-55042919f60f
2026-03-26 22:57:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7983c50>
2026-03-26 22:57:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c15c3042-dda2-5b63-a4f3-55042919f60f/c15c3042-dda2-5b63-a4f3-55042919f60f_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:57:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fea649a53cc384c1ea9b01f6b97ce2919%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/ea649a53cc384c1ea9b01f6b97ce2919/images/large/8.jpg saved to cache
2026-03-26 22:57:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c15c3042-dda2-5b63-a4f3-55042919f60f
2026-03-26 22:57:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c15c3042-dda2-5b63-a4f3-55042919f60f, skipping ID generation
2026-03-26 22:57:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c15c3042-dda2-5b63-a4f3-55042919f60f with scrape type 1
2026-03-26 22:57:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c15c3042-dda2-5b63-a4f3-55042919f60f sending to next pipeline
2026-03-26 22:57:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c15c3042-dda2-5b63-a4f3-55042919f60f, identifier: 1985647
2026-03-26 22:57:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gb%252F7393c7b57c5843eea71f080b44b29a6b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gb/7393c7b57c5843eea71f080b44b29a6b/images/large/4.jpg not downloaded yet
2026-03-26 22:57:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c15c3042-dda2-5b63-a4f3-55042919f60f with identifier: 1985647
2026-03-26 22:57:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c15c3042-dda2-5b63-a4f3-55042919f60f with identifier: 1985647
2026-03-26 22:57:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c15c3042-dda2-5b63-a4f3-55042919f60f with identifier: 1985647 to the API
2026-03-26 22:57:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:57:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:57:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bv/ea649a53cc384c1ea9b01f6b97ce2919/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'c15c3042-dda2-5b63-a4f3-55042919f60f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '1 SERIES HATCH',
 'odometer': 107933,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c15c3042-dda2-5b63-a4f3-55042919f60f/c15c3042-dda2-5b63-a4f3-55042919f60f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 501321,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/ea649a53cc384c1ea9b01f6b97ce2919/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c15c3042-dda2-5b63-a4f3-55042919f60f/c15c3042-dda2-5b63-a4f3-55042919f60f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 518856,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/ea649a53cc384c1ea9b01f6b97ce2919/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c15c3042-dda2-5b63-a4f3-55042919f60f/c15c3042-dda2-5b63-a4f3-55042919f60f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 433176,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/ea649a53cc384c1ea9b01f6b97ce2919/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c15c3042-dda2-5b63-a4f3-55042919f60f/c15c3042-dda2-5b63-a4f3-55042919f60f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 450370,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/ea649a53cc384c1ea9b01f6b97ce2919/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c15c3042-dda2-5b63-a4f3-55042919f60f/c15c3042-dda2-5b63-a4f3-55042919f60f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 353661,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/ea649a53cc384c1ea9b01f6b97ce2919/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c15c3042-dda2-5b63-a4f3-55042919f60f/c15c3042-dda2-5b63-a4f3-55042919f60f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 320663,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/ea649a53cc384c1ea9b01f6b97ce2919/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c15c3042-dda2-5b63-a4f3-55042919f60f/c15c3042-dda2-5b63-a4f3-55042919f60f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 390526,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/ea649a53cc384c1ea9b01f6b97ce2919/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c15c3042-dda2-5b63-a4f3-55042919f60f/c15c3042-dda2-5b63-a4f3-55042919f60f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 361231,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/ea649a53cc384c1ea9b01f6b97ce2919/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c15c3042-dda2-5b63-a4f3-55042919f60f/c15c3042-dda2-5b63-a4f3-55042919f60f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 347357,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/ea649a53cc384c1ea9b01f6b97ce2919/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c15c3042-dda2-5b63-a4f3-55042919f60f/c15c3042-dda2-5b63-a4f3-55042919f60f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 296500,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/ea649a53cc384c1ea9b01f6b97ce2919/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1 SERIES HATCH 1.5 116DA (85KW)',
 'transmission': 'automatic',
 'trim': '1.5 116DA (85KW)',
 'vin': None,
 'year': 2022}
2026-03-26 22:57:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985647%27 HTTP/1.1" 200 None
2026-03-26 22:57:23 [ayvens.be] INFO: Saving data for 1985647: {'created_time': 1774565843.22024, 'last_price_update_time': 1774565843.220249, 'auction_closing_time': 1774958400.0}
2026-03-26 22:57:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985647') HTTP/1.1" 204 0
2026-03-26 22:57:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cl/5d267c0a3b41422e933e48ce454aedce/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cl/5d267c0a3b41422e933e48ce454aedce/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gb%252F7393c7b57c5843eea71f080b44b29a6b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gb/7393c7b57c5843eea71f080b44b29a6b/images/large/5.jpg not downloaded yet
2026-03-26 22:57:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74588d0>
2026-03-26 22:57:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89a98301-746b-5629-a92d-24d79beff483/89a98301-746b-5629-a92d-24d79beff483_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:57:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F5d267c0a3b41422e933e48ce454aedce%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/5d267c0a3b41422e933e48ce454aedce/images/large/5.jpg saved to cache
2026-03-26 22:57:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 89a98301-746b-5629-a92d-24d79beff483
2026-03-26 22:57:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b727f150>
2026-03-26 22:57:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89a98301-746b-5629-a92d-24d79beff483/89a98301-746b-5629-a92d-24d79beff483_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:57:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F5d267c0a3b41422e933e48ce454aedce%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/5d267c0a3b41422e933e48ce454aedce/images/large/4.jpg saved to cache
2026-03-26 22:57:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 89a98301-746b-5629-a92d-24d79beff483
2026-03-26 22:57:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e1d850>
2026-03-26 22:57:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89a98301-746b-5629-a92d-24d79beff483/89a98301-746b-5629-a92d-24d79beff483_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:57:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F5d267c0a3b41422e933e48ce454aedce%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/5d267c0a3b41422e933e48ce454aedce/images/large/2.jpg saved to cache
2026-03-26 22:57:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 89a98301-746b-5629-a92d-24d79beff483
2026-03-26 22:57:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cl/5d267c0a3b41422e933e48ce454aedce/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cl/5d267c0a3b41422e933e48ce454aedce/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gb%252F7393c7b57c5843eea71f080b44b29a6b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gb/7393c7b57c5843eea71f080b44b29a6b/images/large/6.jpg not downloaded yet
2026-03-26 22:57:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cl/5d267c0a3b41422e933e48ce454aedce/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cl/5d267c0a3b41422e933e48ce454aedce/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cl/5d267c0a3b41422e933e48ce454aedce/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gb%252F7393c7b57c5843eea71f080b44b29a6b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gb/7393c7b57c5843eea71f080b44b29a6b/images/large/7.jpg not downloaded yet
2026-03-26 22:57:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c82b90>
2026-03-26 22:57:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89a98301-746b-5629-a92d-24d79beff483/89a98301-746b-5629-a92d-24d79beff483_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:57:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F5d267c0a3b41422e933e48ce454aedce%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/5d267c0a3b41422e933e48ce454aedce/images/large/1.jpg saved to cache
2026-03-26 22:57:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 89a98301-746b-5629-a92d-24d79beff483
2026-03-26 22:57:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7459990>
2026-03-26 22:57:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89a98301-746b-5629-a92d-24d79beff483/89a98301-746b-5629-a92d-24d79beff483_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:57:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F5d267c0a3b41422e933e48ce454aedce%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/5d267c0a3b41422e933e48ce454aedce/images/large/7.jpg saved to cache
2026-03-26 22:57:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 89a98301-746b-5629-a92d-24d79beff483
2026-03-26 22:57:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gb%252F7393c7b57c5843eea71f080b44b29a6b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gb/7393c7b57c5843eea71f080b44b29a6b/images/large/8.jpg not downloaded yet
2026-03-26 22:57:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gb/7393c7b57c5843eea71f080b44b29a6b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gb%252F7393c7b57c5843eea71f080b44b29a6b%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gb/7393c7b57c5843eea71f080b44b29a6b/images/large/9.jpg not downloaded yet
2026-03-26 22:57:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b741d750>
2026-03-26 22:57:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89a98301-746b-5629-a92d-24d79beff483/89a98301-746b-5629-a92d-24d79beff483_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:57:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F5d267c0a3b41422e933e48ce454aedce%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/5d267c0a3b41422e933e48ce454aedce/images/large/3.jpg saved to cache
2026-03-26 22:57:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 89a98301-746b-5629-a92d-24d79beff483
2026-03-26 22:57:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b792f650>
2026-03-26 22:57:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89a98301-746b-5629-a92d-24d79beff483/89a98301-746b-5629-a92d-24d79beff483_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:57:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F5d267c0a3b41422e933e48ce454aedce%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/5d267c0a3b41422e933e48ce454aedce/images/large/6.jpg saved to cache
2026-03-26 22:57:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 89a98301-746b-5629-a92d-24d79beff483
2026-03-26 22:57:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7662d10>
2026-03-26 22:57:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89a98301-746b-5629-a92d-24d79beff483/89a98301-746b-5629-a92d-24d79beff483_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:57:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F5d267c0a3b41422e933e48ce454aedce%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/5d267c0a3b41422e933e48ce454aedce/images/large/9.jpg saved to cache
2026-03-26 22:57:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 89a98301-746b-5629-a92d-24d79beff483
2026-03-26 22:57:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74bdad0>
2026-03-26 22:57:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89a98301-746b-5629-a92d-24d79beff483/89a98301-746b-5629-a92d-24d79beff483_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:57:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F5d267c0a3b41422e933e48ce454aedce%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/5d267c0a3b41422e933e48ce454aedce/images/large/8.jpg saved to cache
2026-03-26 22:57:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 89a98301-746b-5629-a92d-24d79beff483
2026-03-26 22:57:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7661e50>
2026-03-26 22:57:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89a98301-746b-5629-a92d-24d79beff483/89a98301-746b-5629-a92d-24d79beff483_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:57:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F5d267c0a3b41422e933e48ce454aedce%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/5d267c0a3b41422e933e48ce454aedce/images/large/10.jpg saved to cache
2026-03-26 22:57:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 89a98301-746b-5629-a92d-24d79beff483
2026-03-26 22:57:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 89a98301-746b-5629-a92d-24d79beff483, skipping ID generation
2026-03-26 22:57:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89a98301-746b-5629-a92d-24d79beff483 with scrape type 1
2026-03-26 22:57:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 89a98301-746b-5629-a92d-24d79beff483 sending to next pipeline
2026-03-26 22:57:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 89a98301-746b-5629-a92d-24d79beff483, identifier: 1985648
2026-03-26 22:57:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 89a98301-746b-5629-a92d-24d79beff483 with identifier: 1985648
2026-03-26 22:57:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 89a98301-746b-5629-a92d-24d79beff483 with identifier: 1985648
2026-03-26 22:57:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 89a98301-746b-5629-a92d-24d79beff483 with identifier: 1985648 to the API
2026-03-26 22:57:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:57:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:57:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cl/5d267c0a3b41422e933e48ce454aedce/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '89a98301-746b-5629-a92d-24d79beff483',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A-CLASS',
 'odometer': 77722,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89a98301-746b-5629-a92d-24d79beff483/89a98301-746b-5629-a92d-24d79beff483_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 279086,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cl/5d267c0a3b41422e933e48ce454aedce/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89a98301-746b-5629-a92d-24d79beff483/89a98301-746b-5629-a92d-24d79beff483_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 267689,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cl/5d267c0a3b41422e933e48ce454aedce/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89a98301-746b-5629-a92d-24d79beff483/89a98301-746b-5629-a92d-24d79beff483_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 277143,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cl/5d267c0a3b41422e933e48ce454aedce/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89a98301-746b-5629-a92d-24d79beff483/89a98301-746b-5629-a92d-24d79beff483_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 270564,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cl/5d267c0a3b41422e933e48ce454aedce/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89a98301-746b-5629-a92d-24d79beff483/89a98301-746b-5629-a92d-24d79beff483_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 312509,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cl/5d267c0a3b41422e933e48ce454aedce/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89a98301-746b-5629-a92d-24d79beff483/89a98301-746b-5629-a92d-24d79beff483_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 309677,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cl/5d267c0a3b41422e933e48ce454aedce/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89a98301-746b-5629-a92d-24d79beff483/89a98301-746b-5629-a92d-24d79beff483_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 279106,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cl/5d267c0a3b41422e933e48ce454aedce/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89a98301-746b-5629-a92d-24d79beff483/89a98301-746b-5629-a92d-24d79beff483_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 389883,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cl/5d267c0a3b41422e933e48ce454aedce/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89a98301-746b-5629-a92d-24d79beff483/89a98301-746b-5629-a92d-24d79beff483_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 329045,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cl/5d267c0a3b41422e933e48ce454aedce/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89a98301-746b-5629-a92d-24d79beff483/89a98301-746b-5629-a92d-24d79beff483_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 329067,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cl/5d267c0a3b41422e933e48ce454aedce/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ A-CLASS 2.0 A 180 D BUSINESS SOLUTION ESSENTIAL',
 'transmission': 'manual',
 'trim': '2.0 A 180 D BUSINESS SOLUTION ESSENTIAL',
 'vin': None,
 'year': 2022}
2026-03-26 22:57:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985648%27 HTTP/1.1" 200 None
2026-03-26 22:57:24 [ayvens.be] INFO: Saving data for 1985648: {'created_time': 1774565844.642511, 'last_price_update_time': 1774565844.642523, 'auction_closing_time': 1774958400.0}
2026-03-26 22:57:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985648') HTTP/1.1" 204 0
2026-03-26 22:57:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gb%252F7393c7b57c5843eea71f080b44b29a6b%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gb/7393c7b57c5843eea71f080b44b29a6b/images/large/10.jpg not downloaded yet
2026-03-26 22:57:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b782e150>
2026-03-26 22:57:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b228193-ed00-578f-b827-fc5266b7ddc0/1b228193-ed00-578f-b827-fc5266b7ddc0_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:57:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gb%252F7393c7b57c5843eea71f080b44b29a6b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gb/7393c7b57c5843eea71f080b44b29a6b/images/large/1.jpg saved to cache
2026-03-26 22:57:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1b228193-ed00-578f-b827-fc5266b7ddc0
2026-03-26 22:57:24 [ayvens.be] INFO: Found listing with ID: 1985650
2026-03-26 22:57:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985650%27 HTTP/1.1" 200 None
2026-03-26 22:57:24 [ayvens.be] INFO: Scrape type for 1985650: 1
2026-03-26 22:57:24 [ayvens.be] INFO: Extracting data for car ID: 1985650
2026-03-26 22:57:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a6125ccd-d4b3-506e-acae-78a769f08fc6 with identifier: 1985650
2026-03-26 22:57:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6125ccd-d4b3-506e-acae-78a769f08fc6 with scrape type 1
2026-03-26 22:57:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a6125ccd-d4b3-506e-acae-78a769f08fc6
2026-03-26 22:57:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F4ba8d23c0e22448ba0f0380f5a5d3aea%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/4ba8d23c0e22448ba0f0380f5a5d3aea/images/large/1.jpg not downloaded yet
2026-03-26 22:57:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gb/7393c7b57c5843eea71f080b44b29a6b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gb/7393c7b57c5843eea71f080b44b29a6b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F4ba8d23c0e22448ba0f0380f5a5d3aea%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/4ba8d23c0e22448ba0f0380f5a5d3aea/images/large/2.jpg not downloaded yet
2026-03-26 22:57:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gb/7393c7b57c5843eea71f080b44b29a6b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gb/7393c7b57c5843eea71f080b44b29a6b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F4ba8d23c0e22448ba0f0380f5a5d3aea%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/4ba8d23c0e22448ba0f0380f5a5d3aea/images/large/3.jpg not downloaded yet
2026-03-26 22:57:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F4ba8d23c0e22448ba0f0380f5a5d3aea%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/4ba8d23c0e22448ba0f0380f5a5d3aea/images/large/4.jpg not downloaded yet
2026-03-26 22:57:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gb/7393c7b57c5843eea71f080b44b29a6b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F4ba8d23c0e22448ba0f0380f5a5d3aea%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/4ba8d23c0e22448ba0f0380f5a5d3aea/images/large/5.jpg not downloaded yet
2026-03-26 22:57:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gb/7393c7b57c5843eea71f080b44b29a6b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F4ba8d23c0e22448ba0f0380f5a5d3aea%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/4ba8d23c0e22448ba0f0380f5a5d3aea/images/large/6.jpg not downloaded yet
2026-03-26 22:57:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c7cd90>
2026-03-26 22:57:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b228193-ed00-578f-b827-fc5266b7ddc0/1b228193-ed00-578f-b827-fc5266b7ddc0_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:57:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gb%252F7393c7b57c5843eea71f080b44b29a6b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gb/7393c7b57c5843eea71f080b44b29a6b/images/large/2.jpg saved to cache
2026-03-26 22:57:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1b228193-ed00-578f-b827-fc5266b7ddc0
2026-03-26 22:57:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F4ba8d23c0e22448ba0f0380f5a5d3aea%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/4ba8d23c0e22448ba0f0380f5a5d3aea/images/large/7.jpg not downloaded yet
2026-03-26 22:57:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79a08d0>
2026-03-26 22:57:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b228193-ed00-578f-b827-fc5266b7ddc0/1b228193-ed00-578f-b827-fc5266b7ddc0_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:57:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gb%252F7393c7b57c5843eea71f080b44b29a6b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gb/7393c7b57c5843eea71f080b44b29a6b/images/large/5.jpg saved to cache
2026-03-26 22:57:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1b228193-ed00-578f-b827-fc5266b7ddc0
2026-03-26 22:57:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gb/7393c7b57c5843eea71f080b44b29a6b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F4ba8d23c0e22448ba0f0380f5a5d3aea%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/4ba8d23c0e22448ba0f0380f5a5d3aea/images/large/8.jpg not downloaded yet
2026-03-26 22:57:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gb/7393c7b57c5843eea71f080b44b29a6b/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F4ba8d23c0e22448ba0f0380f5a5d3aea%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/4ba8d23c0e22448ba0f0380f5a5d3aea/images/large/9.jpg not downloaded yet
2026-03-26 22:57:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b8a010>
2026-03-26 22:57:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b228193-ed00-578f-b827-fc5266b7ddc0/1b228193-ed00-578f-b827-fc5266b7ddc0_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:57:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gb%252F7393c7b57c5843eea71f080b44b29a6b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gb/7393c7b57c5843eea71f080b44b29a6b/images/large/3.jpg saved to cache
2026-03-26 22:57:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1b228193-ed00-578f-b827-fc5266b7ddc0
2026-03-26 22:57:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e12790>
2026-03-26 22:57:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b228193-ed00-578f-b827-fc5266b7ddc0/1b228193-ed00-578f-b827-fc5266b7ddc0_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:57:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gb%252F7393c7b57c5843eea71f080b44b29a6b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gb/7393c7b57c5843eea71f080b44b29a6b/images/large/4.jpg saved to cache
2026-03-26 22:57:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1b228193-ed00-578f-b827-fc5266b7ddc0
2026-03-26 22:57:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7ca9750>
2026-03-26 22:57:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b228193-ed00-578f-b827-fc5266b7ddc0/1b228193-ed00-578f-b827-fc5266b7ddc0_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:57:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gb%252F7393c7b57c5843eea71f080b44b29a6b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gb/7393c7b57c5843eea71f080b44b29a6b/images/large/7.jpg saved to cache
2026-03-26 22:57:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1b228193-ed00-578f-b827-fc5266b7ddc0
2026-03-26 22:57:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e1dd50>
2026-03-26 22:57:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b228193-ed00-578f-b827-fc5266b7ddc0/1b228193-ed00-578f-b827-fc5266b7ddc0_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:57:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gb%252F7393c7b57c5843eea71f080b44b29a6b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gb/7393c7b57c5843eea71f080b44b29a6b/images/large/6.jpg saved to cache
2026-03-26 22:57:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1b228193-ed00-578f-b827-fc5266b7ddc0
2026-03-26 22:57:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/4ba8d23c0e22448ba0f0380f5a5d3aea/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/4ba8d23c0e22448ba0f0380f5a5d3aea/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F4ba8d23c0e22448ba0f0380f5a5d3aea%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/4ba8d23c0e22448ba0f0380f5a5d3aea/images/large/10.jpg not downloaded yet
2026-03-26 22:57:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/4ba8d23c0e22448ba0f0380f5a5d3aea/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:25 [ayvens.be] INFO: Found listing with ID: 1985651
2026-03-26 22:57:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985651%27 HTTP/1.1" 200 None
2026-03-26 22:57:25 [ayvens.be] INFO: Scrape type for 1985651: 1
2026-03-26 22:57:25 [ayvens.be] INFO: Extracting data for car ID: 1985651
2026-03-26 22:57:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc55a80c-dc69-57db-a80d-38f2613468b1 with identifier: 1985651
2026-03-26 22:57:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc55a80c-dc69-57db-a80d-38f2613468b1 with scrape type 1
2026-03-26 22:57:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fc55a80c-dc69-57db-a80d-38f2613468b1
2026-03-26 22:57:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252F0d64971206554006b219ba3d8e5a4abb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/0d64971206554006b219ba3d8e5a4abb/images/large/1.jpg not downloaded yet
2026-03-26 22:57:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7cab750>
2026-03-26 22:57:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b228193-ed00-578f-b827-fc5266b7ddc0/1b228193-ed00-578f-b827-fc5266b7ddc0_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:57:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gb%252F7393c7b57c5843eea71f080b44b29a6b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gb/7393c7b57c5843eea71f080b44b29a6b/images/large/8.jpg saved to cache
2026-03-26 22:57:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1b228193-ed00-578f-b827-fc5266b7ddc0
2026-03-26 22:57:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b745b750>
2026-03-26 22:57:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b228193-ed00-578f-b827-fc5266b7ddc0/1b228193-ed00-578f-b827-fc5266b7ddc0_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:57:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gb%252F7393c7b57c5843eea71f080b44b29a6b%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gb/7393c7b57c5843eea71f080b44b29a6b/images/large/10.jpg saved to cache
2026-03-26 22:57:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1b228193-ed00-578f-b827-fc5266b7ddc0
2026-03-26 22:57:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gb/7393c7b57c5843eea71f080b44b29a6b/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/4ba8d23c0e22448ba0f0380f5a5d3aea/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252F0d64971206554006b219ba3d8e5a4abb%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/0d64971206554006b219ba3d8e5a4abb/images/large/2.jpg not downloaded yet
2026-03-26 22:57:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/4ba8d23c0e22448ba0f0380f5a5d3aea/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/4ba8d23c0e22448ba0f0380f5a5d3aea/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c83cd0>
2026-03-26 22:57:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6125ccd-d4b3-506e-acae-78a769f08fc6/a6125ccd-d4b3-506e-acae-78a769f08fc6_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:57:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F4ba8d23c0e22448ba0f0380f5a5d3aea%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/4ba8d23c0e22448ba0f0380f5a5d3aea/images/large/1.jpg saved to cache
2026-03-26 22:57:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a6125ccd-d4b3-506e-acae-78a769f08fc6
2026-03-26 22:57:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b169d0>
2026-03-26 22:57:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6125ccd-d4b3-506e-acae-78a769f08fc6/a6125ccd-d4b3-506e-acae-78a769f08fc6_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:57:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F4ba8d23c0e22448ba0f0380f5a5d3aea%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/4ba8d23c0e22448ba0f0380f5a5d3aea/images/large/5.jpg saved to cache
2026-03-26 22:57:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a6125ccd-d4b3-506e-acae-78a769f08fc6
2026-03-26 22:57:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b726ae50>
2026-03-26 22:57:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6125ccd-d4b3-506e-acae-78a769f08fc6/a6125ccd-d4b3-506e-acae-78a769f08fc6_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:57:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F4ba8d23c0e22448ba0f0380f5a5d3aea%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/4ba8d23c0e22448ba0f0380f5a5d3aea/images/large/3.jpg saved to cache
2026-03-26 22:57:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a6125ccd-d4b3-506e-acae-78a769f08fc6
2026-03-26 22:57:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252F0d64971206554006b219ba3d8e5a4abb%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/0d64971206554006b219ba3d8e5a4abb/images/large/3.jpg not downloaded yet
2026-03-26 22:57:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252F0d64971206554006b219ba3d8e5a4abb%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/0d64971206554006b219ba3d8e5a4abb/images/large/4.jpg not downloaded yet
2026-03-26 22:57:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b17750>
2026-03-26 22:57:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b228193-ed00-578f-b827-fc5266b7ddc0/1b228193-ed00-578f-b827-fc5266b7ddc0_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:57:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gb%252F7393c7b57c5843eea71f080b44b29a6b%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gb/7393c7b57c5843eea71f080b44b29a6b/images/large/9.jpg saved to cache
2026-03-26 22:57:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1b228193-ed00-578f-b827-fc5266b7ddc0
2026-03-26 22:57:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1b228193-ed00-578f-b827-fc5266b7ddc0, skipping ID generation
2026-03-26 22:57:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b228193-ed00-578f-b827-fc5266b7ddc0 with scrape type 1
2026-03-26 22:57:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1b228193-ed00-578f-b827-fc5266b7ddc0 sending to next pipeline
2026-03-26 22:57:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 1b228193-ed00-578f-b827-fc5266b7ddc0, identifier: 1985649
2026-03-26 22:57:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77bed10>
2026-03-26 22:57:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6125ccd-d4b3-506e-acae-78a769f08fc6/a6125ccd-d4b3-506e-acae-78a769f08fc6_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:57:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F4ba8d23c0e22448ba0f0380f5a5d3aea%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/4ba8d23c0e22448ba0f0380f5a5d3aea/images/large/2.jpg saved to cache
2026-03-26 22:57:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a6125ccd-d4b3-506e-acae-78a769f08fc6
2026-03-26 22:57:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7474710>
2026-03-26 22:57:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6125ccd-d4b3-506e-acae-78a769f08fc6/a6125ccd-d4b3-506e-acae-78a769f08fc6_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:57:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F4ba8d23c0e22448ba0f0380f5a5d3aea%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/4ba8d23c0e22448ba0f0380f5a5d3aea/images/large/4.jpg saved to cache
2026-03-26 22:57:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a6125ccd-d4b3-506e-acae-78a769f08fc6
2026-03-26 22:57:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b727eed0>
2026-03-26 22:57:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6125ccd-d4b3-506e-acae-78a769f08fc6/a6125ccd-d4b3-506e-acae-78a769f08fc6_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:57:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F4ba8d23c0e22448ba0f0380f5a5d3aea%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/4ba8d23c0e22448ba0f0380f5a5d3aea/images/large/6.jpg saved to cache
2026-03-26 22:57:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a6125ccd-d4b3-506e-acae-78a769f08fc6
2026-03-26 22:57:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 1b228193-ed00-578f-b827-fc5266b7ddc0 with identifier: 1985649
2026-03-26 22:57:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 1b228193-ed00-578f-b827-fc5266b7ddc0 with identifier: 1985649
2026-03-26 22:57:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 1b228193-ed00-578f-b827-fc5266b7ddc0 with identifier: 1985649 to the API
2026-03-26 22:57:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:57:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:57:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2gb/7393c7b57c5843eea71f080b44b29a6b/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 22,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '1b228193-ed00-578f-b827-fc5266b7ddc0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'RAV4',
 'odometer': 39939,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b228193-ed00-578f-b827-fc5266b7ddc0/1b228193-ed00-578f-b827-fc5266b7ddc0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 580465,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gb/7393c7b57c5843eea71f080b44b29a6b/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b228193-ed00-578f-b827-fc5266b7ddc0/1b228193-ed00-578f-b827-fc5266b7ddc0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 519628,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gb/7393c7b57c5843eea71f080b44b29a6b/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b228193-ed00-578f-b827-fc5266b7ddc0/1b228193-ed00-578f-b827-fc5266b7ddc0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 595864,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gb/7393c7b57c5843eea71f080b44b29a6b/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b228193-ed00-578f-b827-fc5266b7ddc0/1b228193-ed00-578f-b827-fc5266b7ddc0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 587569,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gb/7393c7b57c5843eea71f080b44b29a6b/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b228193-ed00-578f-b827-fc5266b7ddc0/1b228193-ed00-578f-b827-fc5266b7ddc0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 516656,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gb/7393c7b57c5843eea71f080b44b29a6b/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b228193-ed00-578f-b827-fc5266b7ddc0/1b228193-ed00-578f-b827-fc5266b7ddc0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 787920,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gb/7393c7b57c5843eea71f080b44b29a6b/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b228193-ed00-578f-b827-fc5266b7ddc0/1b228193-ed00-578f-b827-fc5266b7ddc0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 684183,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gb/7393c7b57c5843eea71f080b44b29a6b/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b228193-ed00-578f-b827-fc5266b7ddc0/1b228193-ed00-578f-b827-fc5266b7ddc0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 852187,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gb/7393c7b57c5843eea71f080b44b29a6b/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b228193-ed00-578f-b827-fc5266b7ddc0/1b228193-ed00-578f-b827-fc5266b7ddc0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 825877,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gb/7393c7b57c5843eea71f080b44b29a6b/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b228193-ed00-578f-b827-fc5266b7ddc0/1b228193-ed00-578f-b827-fc5266b7ddc0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 685048,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gb/7393c7b57c5843eea71f080b44b29a6b/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-10-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA RAV4 2.5 PHEV 225KW STYLE PLUS E-CVT 4WD',
 'transmission': 'automatic',
 'trim': '2.5 PHEV 225KW STYLE PLUS E-CVT 4WD',
 'vin': None,
 'year': 2024}
2026-03-26 22:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985649%27 HTTP/1.1" 200 None
2026-03-26 22:57:27 [ayvens.be] INFO: Saving data for 1985649: {'created_time': 1774565847.096255, 'last_price_update_time': 1774565847.096265, 'auction_closing_time': 1774958400.0}
2026-03-26 22:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985649') HTTP/1.1" 204 0
2026-03-26 22:57:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/4ba8d23c0e22448ba0f0380f5a5d3aea/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252F0d64971206554006b219ba3d8e5a4abb%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/0d64971206554006b219ba3d8e5a4abb/images/large/5.jpg not downloaded yet
2026-03-26 22:57:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/4ba8d23c0e22448ba0f0380f5a5d3aea/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/4ba8d23c0e22448ba0f0380f5a5d3aea/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252F0d64971206554006b219ba3d8e5a4abb%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/0d64971206554006b219ba3d8e5a4abb/images/large/6.jpg not downloaded yet
2026-03-26 22:57:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/4ba8d23c0e22448ba0f0380f5a5d3aea/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252F0d64971206554006b219ba3d8e5a4abb%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/0d64971206554006b219ba3d8e5a4abb/images/large/7.jpg not downloaded yet
2026-03-26 22:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252F0d64971206554006b219ba3d8e5a4abb%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/0d64971206554006b219ba3d8e5a4abb/images/large/8.jpg not downloaded yet
2026-03-26 22:57:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cb/0d64971206554006b219ba3d8e5a4abb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cb/0d64971206554006b219ba3d8e5a4abb/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252F0d64971206554006b219ba3d8e5a4abb%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/0d64971206554006b219ba3d8e5a4abb/images/large/9.jpg not downloaded yet
2026-03-26 22:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252F0d64971206554006b219ba3d8e5a4abb%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/0d64971206554006b219ba3d8e5a4abb/images/large/10.jpg not downloaded yet
2026-03-26 22:57:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b726b810>
2026-03-26 22:57:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6125ccd-d4b3-506e-acae-78a769f08fc6/a6125ccd-d4b3-506e-acae-78a769f08fc6_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F4ba8d23c0e22448ba0f0380f5a5d3aea%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/4ba8d23c0e22448ba0f0380f5a5d3aea/images/large/8.jpg saved to cache
2026-03-26 22:57:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a6125ccd-d4b3-506e-acae-78a769f08fc6
2026-03-26 22:57:27 [ayvens.be] INFO: Found listing with ID: 1985652
2026-03-26 22:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985652%27 HTTP/1.1" 200 None
2026-03-26 22:57:27 [ayvens.be] INFO: Scrape type for 1985652: 1
2026-03-26 22:57:27 [ayvens.be] INFO: Extracting data for car ID: 1985652
2026-03-26 22:57:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f07f567-8437-5fba-a342-a04349f88e38 with identifier: 1985652
2026-03-26 22:57:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f07f567-8437-5fba-a342-a04349f88e38 with scrape type 1
2026-03-26 22:57:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9f07f567-8437-5fba-a342-a04349f88e38
2026-03-26 22:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dr%252Fa29a8238a2c048edb59282339ed51aa7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dr/a29a8238a2c048edb59282339ed51aa7/images/large/1.jpg not downloaded yet
2026-03-26 22:57:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79df590>
2026-03-26 22:57:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6125ccd-d4b3-506e-acae-78a769f08fc6/a6125ccd-d4b3-506e-acae-78a769f08fc6_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F4ba8d23c0e22448ba0f0380f5a5d3aea%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/4ba8d23c0e22448ba0f0380f5a5d3aea/images/large/10.jpg saved to cache
2026-03-26 22:57:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a6125ccd-d4b3-506e-acae-78a769f08fc6
2026-03-26 22:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dr%252Fa29a8238a2c048edb59282339ed51aa7%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dr/a29a8238a2c048edb59282339ed51aa7/images/large/2.jpg not downloaded yet
2026-03-26 22:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dr%252Fa29a8238a2c048edb59282339ed51aa7%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dr/a29a8238a2c048edb59282339ed51aa7/images/large/3.jpg not downloaded yet
2026-03-26 22:57:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd857350>
2026-03-26 22:57:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6125ccd-d4b3-506e-acae-78a769f08fc6/a6125ccd-d4b3-506e-acae-78a769f08fc6_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F4ba8d23c0e22448ba0f0380f5a5d3aea%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/4ba8d23c0e22448ba0f0380f5a5d3aea/images/large/7.jpg saved to cache
2026-03-26 22:57:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a6125ccd-d4b3-506e-acae-78a769f08fc6
2026-03-26 22:57:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b726a810>
2026-03-26 22:57:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6125ccd-d4b3-506e-acae-78a769f08fc6/a6125ccd-d4b3-506e-acae-78a769f08fc6_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F4ba8d23c0e22448ba0f0380f5a5d3aea%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/4ba8d23c0e22448ba0f0380f5a5d3aea/images/large/9.jpg saved to cache
2026-03-26 22:57:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a6125ccd-d4b3-506e-acae-78a769f08fc6
2026-03-26 22:57:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a6125ccd-d4b3-506e-acae-78a769f08fc6, skipping ID generation
2026-03-26 22:57:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6125ccd-d4b3-506e-acae-78a769f08fc6 with scrape type 1
2026-03-26 22:57:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a6125ccd-d4b3-506e-acae-78a769f08fc6 sending to next pipeline
2026-03-26 22:57:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a6125ccd-d4b3-506e-acae-78a769f08fc6, identifier: 1985650
2026-03-26 22:57:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7caac10>
2026-03-26 22:57:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc55a80c-dc69-57db-a80d-38f2613468b1/fc55a80c-dc69-57db-a80d-38f2613468b1_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252F0d64971206554006b219ba3d8e5a4abb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/0d64971206554006b219ba3d8e5a4abb/images/large/1.jpg saved to cache
2026-03-26 22:57:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fc55a80c-dc69-57db-a80d-38f2613468b1
2026-03-26 22:57:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6df3dd0>
2026-03-26 22:57:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc55a80c-dc69-57db-a80d-38f2613468b1/fc55a80c-dc69-57db-a80d-38f2613468b1_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252F0d64971206554006b219ba3d8e5a4abb%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/0d64971206554006b219ba3d8e5a4abb/images/large/2.jpg saved to cache
2026-03-26 22:57:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fc55a80c-dc69-57db-a80d-38f2613468b1
2026-03-26 22:57:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a6125ccd-d4b3-506e-acae-78a769f08fc6 with identifier: 1985650
2026-03-26 22:57:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a6125ccd-d4b3-506e-acae-78a769f08fc6 with identifier: 1985650
2026-03-26 22:57:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a6125ccd-d4b3-506e-acae-78a769f08fc6 with identifier: 1985650 to the API
2026-03-26 22:57:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:57:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:57:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bh/4ba8d23c0e22448ba0f0380f5a5d3aea/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'a6125ccd-d4b3-506e-acae-78a769f08fc6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC60',
 'odometer': 79130,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6125ccd-d4b3-506e-acae-78a769f08fc6/a6125ccd-d4b3-506e-acae-78a769f08fc6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 423170,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/4ba8d23c0e22448ba0f0380f5a5d3aea/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6125ccd-d4b3-506e-acae-78a769f08fc6/a6125ccd-d4b3-506e-acae-78a769f08fc6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 558119,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/4ba8d23c0e22448ba0f0380f5a5d3aea/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6125ccd-d4b3-506e-acae-78a769f08fc6/a6125ccd-d4b3-506e-acae-78a769f08fc6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 498416,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/4ba8d23c0e22448ba0f0380f5a5d3aea/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6125ccd-d4b3-506e-acae-78a769f08fc6/a6125ccd-d4b3-506e-acae-78a769f08fc6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 548913,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/4ba8d23c0e22448ba0f0380f5a5d3aea/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6125ccd-d4b3-506e-acae-78a769f08fc6/a6125ccd-d4b3-506e-acae-78a769f08fc6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 254553,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/4ba8d23c0e22448ba0f0380f5a5d3aea/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6125ccd-d4b3-506e-acae-78a769f08fc6/a6125ccd-d4b3-506e-acae-78a769f08fc6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 340945,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/4ba8d23c0e22448ba0f0380f5a5d3aea/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6125ccd-d4b3-506e-acae-78a769f08fc6/a6125ccd-d4b3-506e-acae-78a769f08fc6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 524440,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/4ba8d23c0e22448ba0f0380f5a5d3aea/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6125ccd-d4b3-506e-acae-78a769f08fc6/a6125ccd-d4b3-506e-acae-78a769f08fc6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 401299,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/4ba8d23c0e22448ba0f0380f5a5d3aea/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6125ccd-d4b3-506e-acae-78a769f08fc6/a6125ccd-d4b3-506e-acae-78a769f08fc6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 442108,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/4ba8d23c0e22448ba0f0380f5a5d3aea/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6125ccd-d4b3-506e-acae-78a769f08fc6/a6125ccd-d4b3-506e-acae-78a769f08fc6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 300767,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/4ba8d23c0e22448ba0f0380f5a5d3aea/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC60 2.0 T6 PHEV INSCRIPTION EXPR. AUTO 4WD',
 'transmission': 'automatic',
 'trim': '2.0 T6 PHEV INSCRIPTION EXPR. AUTO 4WD',
 'vin': None,
 'year': 2021}
2026-03-26 22:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985650%27 HTTP/1.1" 200 None
2026-03-26 22:57:28 [ayvens.be] INFO: Saving data for 1985650: {'created_time': 1774565848.31278, 'last_price_update_time': 1774565848.312789, 'auction_closing_time': 1774958400.0}
2026-03-26 22:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985650') HTTP/1.1" 204 0
2026-03-26 22:57:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cb/0d64971206554006b219ba3d8e5a4abb/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dr%252Fa29a8238a2c048edb59282339ed51aa7%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dr/a29a8238a2c048edb59282339ed51aa7/images/large/4.jpg not downloaded yet
2026-03-26 22:57:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cb/0d64971206554006b219ba3d8e5a4abb/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dr%252Fa29a8238a2c048edb59282339ed51aa7%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dr/a29a8238a2c048edb59282339ed51aa7/images/large/5.jpg not downloaded yet
2026-03-26 22:57:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cb/0d64971206554006b219ba3d8e5a4abb/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dr%252Fa29a8238a2c048edb59282339ed51aa7%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dr/a29a8238a2c048edb59282339ed51aa7/images/large/6.jpg not downloaded yet
2026-03-26 22:57:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cb/0d64971206554006b219ba3d8e5a4abb/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cb/0d64971206554006b219ba3d8e5a4abb/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dr%252Fa29a8238a2c048edb59282339ed51aa7%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dr/a29a8238a2c048edb59282339ed51aa7/images/large/7.jpg not downloaded yet
2026-03-26 22:57:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cb/0d64971206554006b219ba3d8e5a4abb/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dr%252Fa29a8238a2c048edb59282339ed51aa7%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dr/a29a8238a2c048edb59282339ed51aa7/images/large/8.jpg not downloaded yet
2026-03-26 22:57:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cb/0d64971206554006b219ba3d8e5a4abb/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cb/0d64971206554006b219ba3d8e5a4abb/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dr%252Fa29a8238a2c048edb59282339ed51aa7%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dr/a29a8238a2c048edb59282339ed51aa7/images/large/9.jpg not downloaded yet
2026-03-26 22:57:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b792eb10>
2026-03-26 22:57:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc55a80c-dc69-57db-a80d-38f2613468b1/fc55a80c-dc69-57db-a80d-38f2613468b1_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252F0d64971206554006b219ba3d8e5a4abb%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/0d64971206554006b219ba3d8e5a4abb/images/large/3.jpg saved to cache
2026-03-26 22:57:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fc55a80c-dc69-57db-a80d-38f2613468b1
2026-03-26 22:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dr%252Fa29a8238a2c048edb59282339ed51aa7%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dr/a29a8238a2c048edb59282339ed51aa7/images/large/10.jpg not downloaded yet
2026-03-26 22:57:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e03c90>
2026-03-26 22:57:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc55a80c-dc69-57db-a80d-38f2613468b1/fc55a80c-dc69-57db-a80d-38f2613468b1_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252F0d64971206554006b219ba3d8e5a4abb%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/0d64971206554006b219ba3d8e5a4abb/images/large/5.jpg saved to cache
2026-03-26 22:57:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fc55a80c-dc69-57db-a80d-38f2613468b1
2026-03-26 22:57:28 [ayvens.be] INFO: Found listing with ID: 1985653
2026-03-26 22:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985653%27 HTTP/1.1" 200 None
2026-03-26 22:57:28 [ayvens.be] INFO: Scrape type for 1985653: 1
2026-03-26 22:57:28 [ayvens.be] INFO: Extracting data for car ID: 1985653
2026-03-26 22:57:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f63b011-6860-565a-b21b-4983970a2e6c with identifier: 1985653
2026-03-26 22:57:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f63b011-6860-565a-b21b-4983970a2e6c with scrape type 1
2026-03-26 22:57:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8f63b011-6860-565a-b21b-4983970a2e6c
2026-03-26 22:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ex%252F032b158c5a4243ce9e9855fa4467e153%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ex/032b158c5a4243ce9e9855fa4467e153/images/large/1.jpg not downloaded yet
2026-03-26 22:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ex%252F032b158c5a4243ce9e9855fa4467e153%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ex/032b158c5a4243ce9e9855fa4467e153/images/large/2.jpg not downloaded yet
2026-03-26 22:57:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7a55a50>
2026-03-26 22:57:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc55a80c-dc69-57db-a80d-38f2613468b1/fc55a80c-dc69-57db-a80d-38f2613468b1_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252F0d64971206554006b219ba3d8e5a4abb%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/0d64971206554006b219ba3d8e5a4abb/images/large/4.jpg saved to cache
2026-03-26 22:57:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fc55a80c-dc69-57db-a80d-38f2613468b1
2026-03-26 22:57:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7877210>
2026-03-26 22:57:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc55a80c-dc69-57db-a80d-38f2613468b1/fc55a80c-dc69-57db-a80d-38f2613468b1_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252F0d64971206554006b219ba3d8e5a4abb%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/0d64971206554006b219ba3d8e5a4abb/images/large/6.jpg saved to cache
2026-03-26 22:57:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fc55a80c-dc69-57db-a80d-38f2613468b1
2026-03-26 22:57:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b15e10>
2026-03-26 22:57:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc55a80c-dc69-57db-a80d-38f2613468b1/fc55a80c-dc69-57db-a80d-38f2613468b1_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252F0d64971206554006b219ba3d8e5a4abb%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/0d64971206554006b219ba3d8e5a4abb/images/large/7.jpg saved to cache
2026-03-26 22:57:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fc55a80c-dc69-57db-a80d-38f2613468b1
2026-03-26 22:57:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c7f410>
2026-03-26 22:57:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc55a80c-dc69-57db-a80d-38f2613468b1/fc55a80c-dc69-57db-a80d-38f2613468b1_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:57:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252F0d64971206554006b219ba3d8e5a4abb%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/0d64971206554006b219ba3d8e5a4abb/images/large/8.jpg saved to cache
2026-03-26 22:57:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fc55a80c-dc69-57db-a80d-38f2613468b1
2026-03-26 22:57:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74ac310>
2026-03-26 22:57:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc55a80c-dc69-57db-a80d-38f2613468b1/fc55a80c-dc69-57db-a80d-38f2613468b1_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:57:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252F0d64971206554006b219ba3d8e5a4abb%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/0d64971206554006b219ba3d8e5a4abb/images/large/9.jpg saved to cache
2026-03-26 22:57:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fc55a80c-dc69-57db-a80d-38f2613468b1
2026-03-26 22:57:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7440090>
2026-03-26 22:57:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc55a80c-dc69-57db-a80d-38f2613468b1/fc55a80c-dc69-57db-a80d-38f2613468b1_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:57:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252F0d64971206554006b219ba3d8e5a4abb%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/0d64971206554006b219ba3d8e5a4abb/images/large/10.jpg saved to cache
2026-03-26 22:57:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fc55a80c-dc69-57db-a80d-38f2613468b1
2026-03-26 22:57:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fc55a80c-dc69-57db-a80d-38f2613468b1, skipping ID generation
2026-03-26 22:57:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc55a80c-dc69-57db-a80d-38f2613468b1 with scrape type 1
2026-03-26 22:57:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fc55a80c-dc69-57db-a80d-38f2613468b1 sending to next pipeline
2026-03-26 22:57:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: fc55a80c-dc69-57db-a80d-38f2613468b1, identifier: 1985651
2026-03-26 22:57:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: fc55a80c-dc69-57db-a80d-38f2613468b1 with identifier: 1985651
2026-03-26 22:57:29 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 22:57:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 22:57:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: fc55a80c-dc69-57db-a80d-38f2613468b1 with identifier: 1985651
2026-03-26 22:57:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: fc55a80c-dc69-57db-a80d-38f2613468b1 with identifier: 1985651 to the API
2026-03-26 22:57:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:57:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:57:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cb/0d64971206554006b219ba3d8e5a4abb/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 22,
 'color': 'DENIMBLAUW',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.3L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'fc55a80c-dc69-57db-a80d-38f2613468b1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLA',
 'odometer': 102962,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc55a80c-dc69-57db-a80d-38f2613468b1/fc55a80c-dc69-57db-a80d-38f2613468b1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 566010,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cb/0d64971206554006b219ba3d8e5a4abb/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc55a80c-dc69-57db-a80d-38f2613468b1/fc55a80c-dc69-57db-a80d-38f2613468b1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 580419,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cb/0d64971206554006b219ba3d8e5a4abb/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc55a80c-dc69-57db-a80d-38f2613468b1/fc55a80c-dc69-57db-a80d-38f2613468b1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 557803,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cb/0d64971206554006b219ba3d8e5a4abb/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc55a80c-dc69-57db-a80d-38f2613468b1/fc55a80c-dc69-57db-a80d-38f2613468b1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 570706,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cb/0d64971206554006b219ba3d8e5a4abb/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc55a80c-dc69-57db-a80d-38f2613468b1/fc55a80c-dc69-57db-a80d-38f2613468b1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 536298,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cb/0d64971206554006b219ba3d8e5a4abb/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc55a80c-dc69-57db-a80d-38f2613468b1/fc55a80c-dc69-57db-a80d-38f2613468b1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 708738,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cb/0d64971206554006b219ba3d8e5a4abb/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc55a80c-dc69-57db-a80d-38f2613468b1/fc55a80c-dc69-57db-a80d-38f2613468b1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 688907,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cb/0d64971206554006b219ba3d8e5a4abb/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc55a80c-dc69-57db-a80d-38f2613468b1/fc55a80c-dc69-57db-a80d-38f2613468b1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 867826,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cb/0d64971206554006b219ba3d8e5a4abb/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc55a80c-dc69-57db-a80d-38f2613468b1/fc55a80c-dc69-57db-a80d-38f2613468b1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 842951,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cb/0d64971206554006b219ba3d8e5a4abb/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc55a80c-dc69-57db-a80d-38f2613468b1/fc55a80c-dc69-57db-a80d-38f2613468b1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 653182,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cb/0d64971206554006b219ba3d8e5a4abb/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLA 1.3 CLA 250 E BUSINESS SOLUTION DCT',
 'transmission': 'automatic',
 'trim': '1.3 CLA 250 E BUSINESS SOLUTION DCT',
 'vin': None,
 'year': 2022}
2026-03-26 22:57:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985651%27 HTTP/1.1" 200 None
2026-03-26 22:57:29 [ayvens.be] INFO: Saving data for 1985651: {'created_time': 1774565849.759795, 'last_price_update_time': 1774565849.759804, 'auction_closing_time': 1774958400.0}
2026-03-26 22:57:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985651') HTTP/1.1" 204 0
2026-03-26 22:57:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ex%252F032b158c5a4243ce9e9855fa4467e153%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ex/032b158c5a4243ce9e9855fa4467e153/images/large/3.jpg not downloaded yet
2026-03-26 22:57:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ex%252F032b158c5a4243ce9e9855fa4467e153%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ex/032b158c5a4243ce9e9855fa4467e153/images/large/4.jpg not downloaded yet
2026-03-26 22:57:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dr/a29a8238a2c048edb59282339ed51aa7/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dr/a29a8238a2c048edb59282339ed51aa7/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dr/a29a8238a2c048edb59282339ed51aa7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ex%252F032b158c5a4243ce9e9855fa4467e153%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ex/032b158c5a4243ce9e9855fa4467e153/images/large/5.jpg not downloaded yet
2026-03-26 22:57:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dr/a29a8238a2c048edb59282339ed51aa7/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dr/a29a8238a2c048edb59282339ed51aa7/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ex%252F032b158c5a4243ce9e9855fa4467e153%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ex/032b158c5a4243ce9e9855fa4467e153/images/large/6.jpg not downloaded yet
2026-03-26 22:57:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dr/a29a8238a2c048edb59282339ed51aa7/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ex%252F032b158c5a4243ce9e9855fa4467e153%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ex/032b158c5a4243ce9e9855fa4467e153/images/large/7.jpg not downloaded yet
2026-03-26 22:57:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ex%252F032b158c5a4243ce9e9855fa4467e153%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ex/032b158c5a4243ce9e9855fa4467e153/images/large/8.jpg not downloaded yet
2026-03-26 22:57:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ex%252F032b158c5a4243ce9e9855fa4467e153%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ex/032b158c5a4243ce9e9855fa4467e153/images/large/9.jpg not downloaded yet
2026-03-26 22:57:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ex%252F032b158c5a4243ce9e9855fa4467e153%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ex/032b158c5a4243ce9e9855fa4467e153/images/large/10.jpg not downloaded yet
2026-03-26 22:57:29 [ayvens.be] INFO: Found listing with ID: 1985654
2026-03-26 22:57:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985654%27 HTTP/1.1" 200 None
2026-03-26 22:57:29 [ayvens.be] INFO: Scrape type for 1985654: 1
2026-03-26 22:57:29 [ayvens.be] INFO: Extracting data for car ID: 1985654
2026-03-26 22:57:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4acde836-8759-5802-85f5-e7e4c5e1beca with identifier: 1985654
2026-03-26 22:57:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4acde836-8759-5802-85f5-e7e4c5e1beca with scrape type 1
2026-03-26 22:57:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4acde836-8759-5802-85f5-e7e4c5e1beca
2026-03-26 22:57:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252Fd61b88fe84134b05afb1a1cffddfd4fe%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/d61b88fe84134b05afb1a1cffddfd4fe/images/large/1.jpg not downloaded yet
2026-03-26 22:57:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79dcc10>
2026-03-26 22:57:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f07f567-8437-5fba-a342-a04349f88e38/9f07f567-8437-5fba-a342-a04349f88e38_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dr%252Fa29a8238a2c048edb59282339ed51aa7%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dr/a29a8238a2c048edb59282339ed51aa7/images/large/3.jpg saved to cache
2026-03-26 22:57:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9f07f567-8437-5fba-a342-a04349f88e38
2026-03-26 22:57:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e1efd0>
2026-03-26 22:57:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f07f567-8437-5fba-a342-a04349f88e38/9f07f567-8437-5fba-a342-a04349f88e38_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dr%252Fa29a8238a2c048edb59282339ed51aa7%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dr/a29a8238a2c048edb59282339ed51aa7/images/large/2.jpg saved to cache
2026-03-26 22:57:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9f07f567-8437-5fba-a342-a04349f88e38
2026-03-26 22:57:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e455d0>
2026-03-26 22:57:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f07f567-8437-5fba-a342-a04349f88e38/9f07f567-8437-5fba-a342-a04349f88e38_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dr%252Fa29a8238a2c048edb59282339ed51aa7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dr/a29a8238a2c048edb59282339ed51aa7/images/large/1.jpg saved to cache
2026-03-26 22:57:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9f07f567-8437-5fba-a342-a04349f88e38
2026-03-26 22:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252Fd61b88fe84134b05afb1a1cffddfd4fe%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/d61b88fe84134b05afb1a1cffddfd4fe/images/large/2.jpg not downloaded yet
2026-03-26 22:57:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79de090>
2026-03-26 22:57:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f07f567-8437-5fba-a342-a04349f88e38/9f07f567-8437-5fba-a342-a04349f88e38_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dr%252Fa29a8238a2c048edb59282339ed51aa7%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dr/a29a8238a2c048edb59282339ed51aa7/images/large/4.jpg saved to cache
2026-03-26 22:57:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9f07f567-8437-5fba-a342-a04349f88e38
2026-03-26 22:57:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7501050>
2026-03-26 22:57:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f07f567-8437-5fba-a342-a04349f88e38/9f07f567-8437-5fba-a342-a04349f88e38_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dr%252Fa29a8238a2c048edb59282339ed51aa7%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dr/a29a8238a2c048edb59282339ed51aa7/images/large/5.jpg saved to cache
2026-03-26 22:57:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9f07f567-8437-5fba-a342-a04349f88e38
2026-03-26 22:57:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b76d90>
2026-03-26 22:57:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f07f567-8437-5fba-a342-a04349f88e38/9f07f567-8437-5fba-a342-a04349f88e38_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dr%252Fa29a8238a2c048edb59282339ed51aa7%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dr/a29a8238a2c048edb59282339ed51aa7/images/large/6.jpg saved to cache
2026-03-26 22:57:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9f07f567-8437-5fba-a342-a04349f88e38
2026-03-26 22:57:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ex/032b158c5a4243ce9e9855fa4467e153/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252Fd61b88fe84134b05afb1a1cffddfd4fe%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/d61b88fe84134b05afb1a1cffddfd4fe/images/large/3.jpg not downloaded yet
2026-03-26 22:57:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dr/a29a8238a2c048edb59282339ed51aa7/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252Fd61b88fe84134b05afb1a1cffddfd4fe%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/d61b88fe84134b05afb1a1cffddfd4fe/images/large/4.jpg not downloaded yet
2026-03-26 22:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252Fd61b88fe84134b05afb1a1cffddfd4fe%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/d61b88fe84134b05afb1a1cffddfd4fe/images/large/5.jpg not downloaded yet
2026-03-26 22:57:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ex/032b158c5a4243ce9e9855fa4467e153/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dr/a29a8238a2c048edb59282339ed51aa7/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ex/032b158c5a4243ce9e9855fa4467e153/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dr/a29a8238a2c048edb59282339ed51aa7/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252Fd61b88fe84134b05afb1a1cffddfd4fe%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/d61b88fe84134b05afb1a1cffddfd4fe/images/large/6.jpg not downloaded yet
2026-03-26 22:57:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dr/a29a8238a2c048edb59282339ed51aa7/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ex/032b158c5a4243ce9e9855fa4467e153/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252Fd61b88fe84134b05afb1a1cffddfd4fe%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/d61b88fe84134b05afb1a1cffddfd4fe/images/large/7.jpg not downloaded yet
2026-03-26 22:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252Fd61b88fe84134b05afb1a1cffddfd4fe%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/d61b88fe84134b05afb1a1cffddfd4fe/images/large/8.jpg not downloaded yet
2026-03-26 22:57:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7a55290>
2026-03-26 22:57:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f63b011-6860-565a-b21b-4983970a2e6c/8f63b011-6860-565a-b21b-4983970a2e6c_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ex%252F032b158c5a4243ce9e9855fa4467e153%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ex/032b158c5a4243ce9e9855fa4467e153/images/large/1.jpg saved to cache
2026-03-26 22:57:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8f63b011-6860-565a-b21b-4983970a2e6c
2026-03-26 22:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252Fd61b88fe84134b05afb1a1cffddfd4fe%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/d61b88fe84134b05afb1a1cffddfd4fe/images/large/9.jpg not downloaded yet
2026-03-26 22:57:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7474510>
2026-03-26 22:57:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f07f567-8437-5fba-a342-a04349f88e38/9f07f567-8437-5fba-a342-a04349f88e38_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dr%252Fa29a8238a2c048edb59282339ed51aa7%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dr/a29a8238a2c048edb59282339ed51aa7/images/large/10.jpg saved to cache
2026-03-26 22:57:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9f07f567-8437-5fba-a342-a04349f88e38
2026-03-26 22:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252Fd61b88fe84134b05afb1a1cffddfd4fe%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/d61b88fe84134b05afb1a1cffddfd4fe/images/large/10.jpg not downloaded yet
2026-03-26 22:57:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/d61b88fe84134b05afb1a1cffddfd4fe/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:30 [ayvens.be] INFO: Found listing with ID: 1985655
2026-03-26 22:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985655%27 HTTP/1.1" 200 None
2026-03-26 22:57:30 [ayvens.be] INFO: Scrape type for 1985655: 1
2026-03-26 22:57:30 [ayvens.be] INFO: Extracting data for car ID: 1985655
2026-03-26 22:57:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f4663043-cff4-5c88-8a1a-8bd891f8805c with identifier: 1985655
2026-03-26 22:57:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4663043-cff4-5c88-8a1a-8bd891f8805c with scrape type 1
2026-03-26 22:57:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f4663043-cff4-5c88-8a1a-8bd891f8805c
2026-03-26 22:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Faadc4f6f30324dcd8c0a6e41d8096816%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/aadc4f6f30324dcd8c0a6e41d8096816/images/large/1.jpg not downloaded yet
2026-03-26 22:57:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7488410>
2026-03-26 22:57:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f63b011-6860-565a-b21b-4983970a2e6c/8f63b011-6860-565a-b21b-4983970a2e6c_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ex%252F032b158c5a4243ce9e9855fa4467e153%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ex/032b158c5a4243ce9e9855fa4467e153/images/large/3.jpg saved to cache
2026-03-26 22:57:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8f63b011-6860-565a-b21b-4983970a2e6c
2026-03-26 22:57:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c7dc50>
2026-03-26 22:57:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f07f567-8437-5fba-a342-a04349f88e38/9f07f567-8437-5fba-a342-a04349f88e38_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dr%252Fa29a8238a2c048edb59282339ed51aa7%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dr/a29a8238a2c048edb59282339ed51aa7/images/large/9.jpg saved to cache
2026-03-26 22:57:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9f07f567-8437-5fba-a342-a04349f88e38
2026-03-26 22:57:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7441290>
2026-03-26 22:57:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f63b011-6860-565a-b21b-4983970a2e6c/8f63b011-6860-565a-b21b-4983970a2e6c_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ex%252F032b158c5a4243ce9e9855fa4467e153%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ex/032b158c5a4243ce9e9855fa4467e153/images/large/2.jpg saved to cache
2026-03-26 22:57:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8f63b011-6860-565a-b21b-4983970a2e6c
2026-03-26 22:57:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c7f610>
2026-03-26 22:57:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f07f567-8437-5fba-a342-a04349f88e38/9f07f567-8437-5fba-a342-a04349f88e38_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dr%252Fa29a8238a2c048edb59282339ed51aa7%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dr/a29a8238a2c048edb59282339ed51aa7/images/large/8.jpg saved to cache
2026-03-26 22:57:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9f07f567-8437-5fba-a342-a04349f88e38
2026-03-26 22:57:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c68710>
2026-03-26 22:57:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f07f567-8437-5fba-a342-a04349f88e38/9f07f567-8437-5fba-a342-a04349f88e38_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dr%252Fa29a8238a2c048edb59282339ed51aa7%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dr/a29a8238a2c048edb59282339ed51aa7/images/large/7.jpg saved to cache
2026-03-26 22:57:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9f07f567-8437-5fba-a342-a04349f88e38
2026-03-26 22:57:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9f07f567-8437-5fba-a342-a04349f88e38, skipping ID generation
2026-03-26 22:57:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f07f567-8437-5fba-a342-a04349f88e38 with scrape type 1
2026-03-26 22:57:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9f07f567-8437-5fba-a342-a04349f88e38 sending to next pipeline
2026-03-26 22:57:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 9f07f567-8437-5fba-a342-a04349f88e38, identifier: 1985652
2026-03-26 22:57:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd5b1990>
2026-03-26 22:57:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f63b011-6860-565a-b21b-4983970a2e6c/8f63b011-6860-565a-b21b-4983970a2e6c_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ex%252F032b158c5a4243ce9e9855fa4467e153%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ex/032b158c5a4243ce9e9855fa4467e153/images/large/4.jpg saved to cache
2026-03-26 22:57:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8f63b011-6860-565a-b21b-4983970a2e6c
2026-03-26 22:57:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ex/032b158c5a4243ce9e9855fa4467e153/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 9f07f567-8437-5fba-a342-a04349f88e38 with identifier: 1985652
2026-03-26 22:57:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 9f07f567-8437-5fba-a342-a04349f88e38 with identifier: 1985652
2026-03-26 22:57:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 9f07f567-8437-5fba-a342-a04349f88e38 with identifier: 1985652 to the API
2026-03-26 22:57:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:57:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:57:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2dr/a29a8238a2c048edb59282339ed51aa7/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.3L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '9f07f567-8437-5fba-a342-a04349f88e38',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A-CLASS LIMOUSINE',
 'odometer': 30338,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f07f567-8437-5fba-a342-a04349f88e38/9f07f567-8437-5fba-a342-a04349f88e38_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 733717,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dr/a29a8238a2c048edb59282339ed51aa7/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f07f567-8437-5fba-a342-a04349f88e38/9f07f567-8437-5fba-a342-a04349f88e38_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 711398,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dr/a29a8238a2c048edb59282339ed51aa7/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f07f567-8437-5fba-a342-a04349f88e38/9f07f567-8437-5fba-a342-a04349f88e38_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 746689,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dr/a29a8238a2c048edb59282339ed51aa7/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f07f567-8437-5fba-a342-a04349f88e38/9f07f567-8437-5fba-a342-a04349f88e38_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 771532,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dr/a29a8238a2c048edb59282339ed51aa7/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f07f567-8437-5fba-a342-a04349f88e38/9f07f567-8437-5fba-a342-a04349f88e38_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 726949,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dr/a29a8238a2c048edb59282339ed51aa7/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f07f567-8437-5fba-a342-a04349f88e38/9f07f567-8437-5fba-a342-a04349f88e38_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 799471,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dr/a29a8238a2c048edb59282339ed51aa7/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f07f567-8437-5fba-a342-a04349f88e38/9f07f567-8437-5fba-a342-a04349f88e38_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 694115,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dr/a29a8238a2c048edb59282339ed51aa7/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f07f567-8437-5fba-a342-a04349f88e38/9f07f567-8437-5fba-a342-a04349f88e38_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 774796,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dr/a29a8238a2c048edb59282339ed51aa7/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f07f567-8437-5fba-a342-a04349f88e38/9f07f567-8437-5fba-a342-a04349f88e38_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 783397,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dr/a29a8238a2c048edb59282339ed51aa7/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f07f567-8437-5fba-a342-a04349f88e38/9f07f567-8437-5fba-a342-a04349f88e38_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 824976,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dr/a29a8238a2c048edb59282339ed51aa7/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ A-CLASS LIMOUSINE 1.3 A 250 E BUSINESS SOLUTION DCT',
 'transmission': 'automatic',
 'trim': '1.3 A 250 E BUSINESS SOLUTION DCT',
 'vin': None,
 'year': 2023}
2026-03-26 22:57:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985652%27 HTTP/1.1" 200 None
2026-03-26 22:57:32 [ayvens.be] INFO: Saving data for 1985652: {'created_time': 1774565852.305598, 'last_price_update_time': 1774565852.305611, 'auction_closing_time': 1774958400.0}
2026-03-26 22:57:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985652') HTTP/1.1" 204 0
2026-03-26 22:57:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/d61b88fe84134b05afb1a1cffddfd4fe/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Faadc4f6f30324dcd8c0a6e41d8096816%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/aadc4f6f30324dcd8c0a6e41d8096816/images/large/2.jpg not downloaded yet
2026-03-26 22:57:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ex/032b158c5a4243ce9e9855fa4467e153/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Faadc4f6f30324dcd8c0a6e41d8096816%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/aadc4f6f30324dcd8c0a6e41d8096816/images/large/3.jpg not downloaded yet
2026-03-26 22:57:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ex/032b158c5a4243ce9e9855fa4467e153/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76e2d90>
2026-03-26 22:57:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4acde836-8759-5802-85f5-e7e4c5e1beca/4acde836-8759-5802-85f5-e7e4c5e1beca_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:57:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252Fd61b88fe84134b05afb1a1cffddfd4fe%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/d61b88fe84134b05afb1a1cffddfd4fe/images/large/2.jpg saved to cache
2026-03-26 22:57:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4acde836-8759-5802-85f5-e7e4c5e1beca
2026-03-26 22:57:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b788f890>
2026-03-26 22:57:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f63b011-6860-565a-b21b-4983970a2e6c/8f63b011-6860-565a-b21b-4983970a2e6c_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:57:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ex%252F032b158c5a4243ce9e9855fa4467e153%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ex/032b158c5a4243ce9e9855fa4467e153/images/large/5.jpg saved to cache
2026-03-26 22:57:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8f63b011-6860-565a-b21b-4983970a2e6c
2026-03-26 22:57:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ex/032b158c5a4243ce9e9855fa4467e153/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/d61b88fe84134b05afb1a1cffddfd4fe/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Faadc4f6f30324dcd8c0a6e41d8096816%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/aadc4f6f30324dcd8c0a6e41d8096816/images/large/4.jpg not downloaded yet
2026-03-26 22:57:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ex/032b158c5a4243ce9e9855fa4467e153/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ex/032b158c5a4243ce9e9855fa4467e153/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Faadc4f6f30324dcd8c0a6e41d8096816%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/aadc4f6f30324dcd8c0a6e41d8096816/images/large/5.jpg not downloaded yet
2026-03-26 22:57:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7744610>
2026-03-26 22:57:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4acde836-8759-5802-85f5-e7e4c5e1beca/4acde836-8759-5802-85f5-e7e4c5e1beca_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:57:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252Fd61b88fe84134b05afb1a1cffddfd4fe%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/d61b88fe84134b05afb1a1cffddfd4fe/images/large/1.jpg saved to cache
2026-03-26 22:57:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4acde836-8759-5802-85f5-e7e4c5e1beca
2026-03-26 22:57:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7ccd750>
2026-03-26 22:57:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f63b011-6860-565a-b21b-4983970a2e6c/8f63b011-6860-565a-b21b-4983970a2e6c_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:57:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ex%252F032b158c5a4243ce9e9855fa4467e153%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ex/032b158c5a4243ce9e9855fa4467e153/images/large/9.jpg saved to cache
2026-03-26 22:57:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8f63b011-6860-565a-b21b-4983970a2e6c
2026-03-26 22:57:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7279e10>
2026-03-26 22:57:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f63b011-6860-565a-b21b-4983970a2e6c/8f63b011-6860-565a-b21b-4983970a2e6c_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:57:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ex%252F032b158c5a4243ce9e9855fa4467e153%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ex/032b158c5a4243ce9e9855fa4467e153/images/large/6.jpg saved to cache
2026-03-26 22:57:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8f63b011-6860-565a-b21b-4983970a2e6c
2026-03-26 22:57:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/d61b88fe84134b05afb1a1cffddfd4fe/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Faadc4f6f30324dcd8c0a6e41d8096816%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/aadc4f6f30324dcd8c0a6e41d8096816/images/large/6.jpg not downloaded yet
2026-03-26 22:57:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/d61b88fe84134b05afb1a1cffddfd4fe/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Faadc4f6f30324dcd8c0a6e41d8096816%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/aadc4f6f30324dcd8c0a6e41d8096816/images/large/7.jpg not downloaded yet
2026-03-26 22:57:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/d61b88fe84134b05afb1a1cffddfd4fe/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/d61b88fe84134b05afb1a1cffddfd4fe/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74b5390>
2026-03-26 22:57:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f63b011-6860-565a-b21b-4983970a2e6c/8f63b011-6860-565a-b21b-4983970a2e6c_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ex%252F032b158c5a4243ce9e9855fa4467e153%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ex/032b158c5a4243ce9e9855fa4467e153/images/large/7.jpg saved to cache
2026-03-26 22:57:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8f63b011-6860-565a-b21b-4983970a2e6c
2026-03-26 22:57:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd48e850>
2026-03-26 22:57:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4acde836-8759-5802-85f5-e7e4c5e1beca/4acde836-8759-5802-85f5-e7e4c5e1beca_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252Fd61b88fe84134b05afb1a1cffddfd4fe%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/d61b88fe84134b05afb1a1cffddfd4fe/images/large/3.jpg saved to cache
2026-03-26 22:57:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4acde836-8759-5802-85f5-e7e4c5e1beca
2026-03-26 22:57:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e363d0>
2026-03-26 22:57:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f63b011-6860-565a-b21b-4983970a2e6c/8f63b011-6860-565a-b21b-4983970a2e6c_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ex%252F032b158c5a4243ce9e9855fa4467e153%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ex/032b158c5a4243ce9e9855fa4467e153/images/large/8.jpg saved to cache
2026-03-26 22:57:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8f63b011-6860-565a-b21b-4983970a2e6c
2026-03-26 22:57:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79f8410>
2026-03-26 22:57:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f63b011-6860-565a-b21b-4983970a2e6c/8f63b011-6860-565a-b21b-4983970a2e6c_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ex%252F032b158c5a4243ce9e9855fa4467e153%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ex/032b158c5a4243ce9e9855fa4467e153/images/large/10.jpg saved to cache
2026-03-26 22:57:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8f63b011-6860-565a-b21b-4983970a2e6c
2026-03-26 22:57:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8f63b011-6860-565a-b21b-4983970a2e6c, skipping ID generation
2026-03-26 22:57:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f63b011-6860-565a-b21b-4983970a2e6c with scrape type 1
2026-03-26 22:57:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8f63b011-6860-565a-b21b-4983970a2e6c sending to next pipeline
2026-03-26 22:57:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 8f63b011-6860-565a-b21b-4983970a2e6c, identifier: 1985653
2026-03-26 22:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Faadc4f6f30324dcd8c0a6e41d8096816%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/aadc4f6f30324dcd8c0a6e41d8096816/images/large/8.jpg not downloaded yet
2026-03-26 22:57:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 8f63b011-6860-565a-b21b-4983970a2e6c with identifier: 1985653
2026-03-26 22:57:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 8f63b011-6860-565a-b21b-4983970a2e6c with identifier: 1985653
2026-03-26 22:57:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 8f63b011-6860-565a-b21b-4983970a2e6c with identifier: 1985653 to the API
2026-03-26 22:57:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:57:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:57:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ex/032b158c5a4243ce9e9855fa4467e153/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '8f63b011-6860-565a-b21b-4983970a2e6c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '308 SW',
 'odometer': 24335,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f63b011-6860-565a-b21b-4983970a2e6c/8f63b011-6860-565a-b21b-4983970a2e6c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 654919,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ex/032b158c5a4243ce9e9855fa4467e153/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f63b011-6860-565a-b21b-4983970a2e6c/8f63b011-6860-565a-b21b-4983970a2e6c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 630603,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ex/032b158c5a4243ce9e9855fa4467e153/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f63b011-6860-565a-b21b-4983970a2e6c/8f63b011-6860-565a-b21b-4983970a2e6c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 610633,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ex/032b158c5a4243ce9e9855fa4467e153/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f63b011-6860-565a-b21b-4983970a2e6c/8f63b011-6860-565a-b21b-4983970a2e6c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 643353,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ex/032b158c5a4243ce9e9855fa4467e153/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f63b011-6860-565a-b21b-4983970a2e6c/8f63b011-6860-565a-b21b-4983970a2e6c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 523215,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ex/032b158c5a4243ce9e9855fa4467e153/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f63b011-6860-565a-b21b-4983970a2e6c/8f63b011-6860-565a-b21b-4983970a2e6c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 602045,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ex/032b158c5a4243ce9e9855fa4467e153/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f63b011-6860-565a-b21b-4983970a2e6c/8f63b011-6860-565a-b21b-4983970a2e6c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 593853,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ex/032b158c5a4243ce9e9855fa4467e153/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f63b011-6860-565a-b21b-4983970a2e6c/8f63b011-6860-565a-b21b-4983970a2e6c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 667019,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ex/032b158c5a4243ce9e9855fa4467e153/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f63b011-6860-565a-b21b-4983970a2e6c/8f63b011-6860-565a-b21b-4983970a2e6c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 418424,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ex/032b158c5a4243ce9e9855fa4467e153/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f63b011-6860-565a-b21b-4983970a2e6c/8f63b011-6860-565a-b21b-4983970a2e6c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 593565,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ex/032b158c5a4243ce9e9855fa4467e153/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-02-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 308 SW 1.6 PHEV 180 S-S AUTO ALLURE PACK',
 'transmission': 'automatic',
 'trim': '1.6 PHEV 180 S-S AUTO ALLURE PACK',
 'vin': None,
 'year': 2024}
2026-03-26 22:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985653%27 HTTP/1.1" 200 None
2026-03-26 22:57:33 [ayvens.be] INFO: Saving data for 1985653: {'created_time': 1774565853.883279, 'last_price_update_time': 1774565853.883288, 'auction_closing_time': 1774958400.0}
2026-03-26 22:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985653') HTTP/1.1" 204 0
2026-03-26 22:57:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/d61b88fe84134b05afb1a1cffddfd4fe/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/d61b88fe84134b05afb1a1cffddfd4fe/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Faadc4f6f30324dcd8c0a6e41d8096816%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/aadc4f6f30324dcd8c0a6e41d8096816/images/large/9.jpg not downloaded yet
2026-03-26 22:57:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/d61b88fe84134b05afb1a1cffddfd4fe/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/aadc4f6f30324dcd8c0a6e41d8096816/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/aadc4f6f30324dcd8c0a6e41d8096816/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Faadc4f6f30324dcd8c0a6e41d8096816%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/aadc4f6f30324dcd8c0a6e41d8096816/images/large/10.jpg not downloaded yet
2026-03-26 22:57:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b75a5510>
2026-03-26 22:57:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4acde836-8759-5802-85f5-e7e4c5e1beca/4acde836-8759-5802-85f5-e7e4c5e1beca_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252Fd61b88fe84134b05afb1a1cffddfd4fe%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/d61b88fe84134b05afb1a1cffddfd4fe/images/large/4.jpg saved to cache
2026-03-26 22:57:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4acde836-8759-5802-85f5-e7e4c5e1beca
2026-03-26 22:57:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7429850>
2026-03-26 22:57:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4acde836-8759-5802-85f5-e7e4c5e1beca/4acde836-8759-5802-85f5-e7e4c5e1beca_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252Fd61b88fe84134b05afb1a1cffddfd4fe%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/d61b88fe84134b05afb1a1cffddfd4fe/images/large/9.jpg saved to cache
2026-03-26 22:57:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4acde836-8759-5802-85f5-e7e4c5e1beca
2026-03-26 22:57:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79cd690>
2026-03-26 22:57:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4acde836-8759-5802-85f5-e7e4c5e1beca/4acde836-8759-5802-85f5-e7e4c5e1beca_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252Fd61b88fe84134b05afb1a1cffddfd4fe%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/d61b88fe84134b05afb1a1cffddfd4fe/images/large/7.jpg saved to cache
2026-03-26 22:57:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4acde836-8759-5802-85f5-e7e4c5e1beca
2026-03-26 22:57:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e29410>
2026-03-26 22:57:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4acde836-8759-5802-85f5-e7e4c5e1beca/4acde836-8759-5802-85f5-e7e4c5e1beca_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252Fd61b88fe84134b05afb1a1cffddfd4fe%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/d61b88fe84134b05afb1a1cffddfd4fe/images/large/6.jpg saved to cache
2026-03-26 22:57:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4acde836-8759-5802-85f5-e7e4c5e1beca
2026-03-26 22:57:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/aadc4f6f30324dcd8c0a6e41d8096816/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/aadc4f6f30324dcd8c0a6e41d8096816/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:34 [ayvens.be] INFO: Found listing with ID: 1985656
2026-03-26 22:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985656%27 HTTP/1.1" 200 None
2026-03-26 22:57:34 [ayvens.be] INFO: Scrape type for 1985656: 1
2026-03-26 22:57:34 [ayvens.be] INFO: Extracting data for car ID: 1985656
2026-03-26 22:57:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8 with identifier: 1985656
2026-03-26 22:57:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8 with scrape type 1
2026-03-26 22:57:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8
2026-03-26 22:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F84e04c42a2cd40b6b6fddb68f8be153c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/84e04c42a2cd40b6b6fddb68f8be153c/images/large/1.jpg not downloaded yet
2026-03-26 22:57:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/aadc4f6f30324dcd8c0a6e41d8096816/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6dec4d0>
2026-03-26 22:57:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4acde836-8759-5802-85f5-e7e4c5e1beca/4acde836-8759-5802-85f5-e7e4c5e1beca_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252Fd61b88fe84134b05afb1a1cffddfd4fe%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/d61b88fe84134b05afb1a1cffddfd4fe/images/large/10.jpg saved to cache
2026-03-26 22:57:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4acde836-8759-5802-85f5-e7e4c5e1beca
2026-03-26 22:57:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7688410>
2026-03-26 22:57:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4acde836-8759-5802-85f5-e7e4c5e1beca/4acde836-8759-5802-85f5-e7e4c5e1beca_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252Fd61b88fe84134b05afb1a1cffddfd4fe%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/d61b88fe84134b05afb1a1cffddfd4fe/images/large/8.jpg saved to cache
2026-03-26 22:57:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4acde836-8759-5802-85f5-e7e4c5e1beca
2026-03-26 22:57:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e4c750>
2026-03-26 22:57:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4acde836-8759-5802-85f5-e7e4c5e1beca/4acde836-8759-5802-85f5-e7e4c5e1beca_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252Fd61b88fe84134b05afb1a1cffddfd4fe%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/d61b88fe84134b05afb1a1cffddfd4fe/images/large/5.jpg saved to cache
2026-03-26 22:57:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4acde836-8759-5802-85f5-e7e4c5e1beca
2026-03-26 22:57:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4acde836-8759-5802-85f5-e7e4c5e1beca, skipping ID generation
2026-03-26 22:57:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4acde836-8759-5802-85f5-e7e4c5e1beca with scrape type 1
2026-03-26 22:57:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4acde836-8759-5802-85f5-e7e4c5e1beca sending to next pipeline
2026-03-26 22:57:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 4acde836-8759-5802-85f5-e7e4c5e1beca, identifier: 1985654
2026-03-26 22:57:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74acd90>
2026-03-26 22:57:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4663043-cff4-5c88-8a1a-8bd891f8805c/f4663043-cff4-5c88-8a1a-8bd891f8805c_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Faadc4f6f30324dcd8c0a6e41d8096816%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/aadc4f6f30324dcd8c0a6e41d8096816/images/large/1.jpg saved to cache
2026-03-26 22:57:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f4663043-cff4-5c88-8a1a-8bd891f8805c
2026-03-26 22:57:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c7c990>
2026-03-26 22:57:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4663043-cff4-5c88-8a1a-8bd891f8805c/f4663043-cff4-5c88-8a1a-8bd891f8805c_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Faadc4f6f30324dcd8c0a6e41d8096816%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/aadc4f6f30324dcd8c0a6e41d8096816/images/large/2.jpg saved to cache
2026-03-26 22:57:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f4663043-cff4-5c88-8a1a-8bd891f8805c
2026-03-26 22:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F84e04c42a2cd40b6b6fddb68f8be153c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/84e04c42a2cd40b6b6fddb68f8be153c/images/large/2.jpg not downloaded yet
2026-03-26 22:57:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 4acde836-8759-5802-85f5-e7e4c5e1beca with identifier: 1985654
2026-03-26 22:57:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 4acde836-8759-5802-85f5-e7e4c5e1beca with identifier: 1985654
2026-03-26 22:57:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 4acde836-8759-5802-85f5-e7e4c5e1beca with identifier: 1985654 to the API
2026-03-26 22:57:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:57:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:57:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2dl/d61b88fe84134b05afb1a1cffddfd4fe/images/large/5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '4acde836-8759-5802-85f5-e7e4c5e1beca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'MINI',
 'model': 'COUNTRYMAN',
 'odometer': 100298,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4acde836-8759-5802-85f5-e7e4c5e1beca/4acde836-8759-5802-85f5-e7e4c5e1beca_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 235661,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/d61b88fe84134b05afb1a1cffddfd4fe/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4acde836-8759-5802-85f5-e7e4c5e1beca/4acde836-8759-5802-85f5-e7e4c5e1beca_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 230630,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/d61b88fe84134b05afb1a1cffddfd4fe/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4acde836-8759-5802-85f5-e7e4c5e1beca/4acde836-8759-5802-85f5-e7e4c5e1beca_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 258283,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/d61b88fe84134b05afb1a1cffddfd4fe/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4acde836-8759-5802-85f5-e7e4c5e1beca/4acde836-8759-5802-85f5-e7e4c5e1beca_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 258797,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/d61b88fe84134b05afb1a1cffddfd4fe/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4acde836-8759-5802-85f5-e7e4c5e1beca/4acde836-8759-5802-85f5-e7e4c5e1beca_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 247147,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/d61b88fe84134b05afb1a1cffddfd4fe/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4acde836-8759-5802-85f5-e7e4c5e1beca/4acde836-8759-5802-85f5-e7e4c5e1beca_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 216448,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/d61b88fe84134b05afb1a1cffddfd4fe/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4acde836-8759-5802-85f5-e7e4c5e1beca/4acde836-8759-5802-85f5-e7e4c5e1beca_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 240045,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/d61b88fe84134b05afb1a1cffddfd4fe/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4acde836-8759-5802-85f5-e7e4c5e1beca/4acde836-8759-5802-85f5-e7e4c5e1beca_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 340980,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/d61b88fe84134b05afb1a1cffddfd4fe/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4acde836-8759-5802-85f5-e7e4c5e1beca/4acde836-8759-5802-85f5-e7e4c5e1beca_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 308239,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/d61b88fe84134b05afb1a1cffddfd4fe/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4acde836-8759-5802-85f5-e7e4c5e1beca/4acde836-8759-5802-85f5-e7e4c5e1beca_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 390459,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/d61b88fe84134b05afb1a1cffddfd4fe/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-04-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI COUNTRYMAN 1.5 COOPER S E 4WD AUTO',
 'transmission': 'automatic',
 'trim': '1.5 COOPER S E 4WD AUTO',
 'vin': None,
 'year': 2023}
2026-03-26 22:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985654%27 HTTP/1.1" 200 None
2026-03-26 22:57:35 [ayvens.be] INFO: Saving data for 1985654: {'created_time': 1774565855.088108, 'last_price_update_time': 1774565855.088118, 'auction_closing_time': 1774958400.0}
2026-03-26 22:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985654') HTTP/1.1" 204 0
2026-03-26 22:57:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/aadc4f6f30324dcd8c0a6e41d8096816/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/aadc4f6f30324dcd8c0a6e41d8096816/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F84e04c42a2cd40b6b6fddb68f8be153c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/84e04c42a2cd40b6b6fddb68f8be153c/images/large/3.jpg not downloaded yet
2026-03-26 22:57:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c5ca90>
2026-03-26 22:57:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4663043-cff4-5c88-8a1a-8bd891f8805c/f4663043-cff4-5c88-8a1a-8bd891f8805c_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Faadc4f6f30324dcd8c0a6e41d8096816%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/aadc4f6f30324dcd8c0a6e41d8096816/images/large/3.jpg saved to cache
2026-03-26 22:57:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f4663043-cff4-5c88-8a1a-8bd891f8805c
2026-03-26 22:57:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b764aa90>
2026-03-26 22:57:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4663043-cff4-5c88-8a1a-8bd891f8805c/f4663043-cff4-5c88-8a1a-8bd891f8805c_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Faadc4f6f30324dcd8c0a6e41d8096816%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/aadc4f6f30324dcd8c0a6e41d8096816/images/large/4.jpg saved to cache
2026-03-26 22:57:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f4663043-cff4-5c88-8a1a-8bd891f8805c
2026-03-26 22:57:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7474d10>
2026-03-26 22:57:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4663043-cff4-5c88-8a1a-8bd891f8805c/f4663043-cff4-5c88-8a1a-8bd891f8805c_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Faadc4f6f30324dcd8c0a6e41d8096816%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/aadc4f6f30324dcd8c0a6e41d8096816/images/large/5.jpg saved to cache
2026-03-26 22:57:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f4663043-cff4-5c88-8a1a-8bd891f8805c
2026-03-26 22:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F84e04c42a2cd40b6b6fddb68f8be153c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/84e04c42a2cd40b6b6fddb68f8be153c/images/large/4.jpg not downloaded yet
2026-03-26 22:57:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76c7350>
2026-03-26 22:57:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4663043-cff4-5c88-8a1a-8bd891f8805c/f4663043-cff4-5c88-8a1a-8bd891f8805c_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Faadc4f6f30324dcd8c0a6e41d8096816%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/aadc4f6f30324dcd8c0a6e41d8096816/images/large/6.jpg saved to cache
2026-03-26 22:57:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f4663043-cff4-5c88-8a1a-8bd891f8805c
2026-03-26 22:57:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b6b990>
2026-03-26 22:57:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4663043-cff4-5c88-8a1a-8bd891f8805c/f4663043-cff4-5c88-8a1a-8bd891f8805c_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Faadc4f6f30324dcd8c0a6e41d8096816%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/aadc4f6f30324dcd8c0a6e41d8096816/images/large/7.jpg saved to cache
2026-03-26 22:57:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f4663043-cff4-5c88-8a1a-8bd891f8805c
2026-03-26 22:57:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/aadc4f6f30324dcd8c0a6e41d8096816/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/aadc4f6f30324dcd8c0a6e41d8096816/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F84e04c42a2cd40b6b6fddb68f8be153c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/84e04c42a2cd40b6b6fddb68f8be153c/images/large/5.jpg not downloaded yet
2026-03-26 22:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F84e04c42a2cd40b6b6fddb68f8be153c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/84e04c42a2cd40b6b6fddb68f8be153c/images/large/6.jpg not downloaded yet
2026-03-26 22:57:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/aadc4f6f30324dcd8c0a6e41d8096816/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F84e04c42a2cd40b6b6fddb68f8be153c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/84e04c42a2cd40b6b6fddb68f8be153c/images/large/7.jpg not downloaded yet
2026-03-26 22:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F84e04c42a2cd40b6b6fddb68f8be153c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/84e04c42a2cd40b6b6fddb68f8be153c/images/large/8.jpg not downloaded yet
2026-03-26 22:57:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/84e04c42a2cd40b6b6fddb68f8be153c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F84e04c42a2cd40b6b6fddb68f8be153c%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/84e04c42a2cd40b6b6fddb68f8be153c/images/large/9.jpg not downloaded yet
2026-03-26 22:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F84e04c42a2cd40b6b6fddb68f8be153c%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/84e04c42a2cd40b6b6fddb68f8be153c/images/large/10.jpg not downloaded yet
2026-03-26 22:57:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/84e04c42a2cd40b6b6fddb68f8be153c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:35 [ayvens.be] INFO: Found listing with ID: 1985657
2026-03-26 22:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985657%27 HTTP/1.1" 200 None
2026-03-26 22:57:35 [ayvens.be] INFO: Scrape type for 1985657: 1
2026-03-26 22:57:35 [ayvens.be] INFO: Extracting data for car ID: 1985657
2026-03-26 22:57:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79 with identifier: 1985657
2026-03-26 22:57:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79 with scrape type 1
2026-03-26 22:57:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79
2026-03-26 22:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F16e6f9532cff4c3bb1e515c977796539%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/16e6f9532cff4c3bb1e515c977796539/images/large/1.jpg not downloaded yet
2026-03-26 22:57:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74bfbd0>
2026-03-26 22:57:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4663043-cff4-5c88-8a1a-8bd891f8805c/f4663043-cff4-5c88-8a1a-8bd891f8805c_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Faadc4f6f30324dcd8c0a6e41d8096816%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/aadc4f6f30324dcd8c0a6e41d8096816/images/large/8.jpg saved to cache
2026-03-26 22:57:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f4663043-cff4-5c88-8a1a-8bd891f8805c
2026-03-26 22:57:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7587b90>
2026-03-26 22:57:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4663043-cff4-5c88-8a1a-8bd891f8805c/f4663043-cff4-5c88-8a1a-8bd891f8805c_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Faadc4f6f30324dcd8c0a6e41d8096816%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/aadc4f6f30324dcd8c0a6e41d8096816/images/large/9.jpg saved to cache
2026-03-26 22:57:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f4663043-cff4-5c88-8a1a-8bd891f8805c
2026-03-26 22:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F16e6f9532cff4c3bb1e515c977796539%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/16e6f9532cff4c3bb1e515c977796539/images/large/2.jpg not downloaded yet
2026-03-26 22:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F16e6f9532cff4c3bb1e515c977796539%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/16e6f9532cff4c3bb1e515c977796539/images/large/3.jpg not downloaded yet
2026-03-26 22:57:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c83890>
2026-03-26 22:57:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4663043-cff4-5c88-8a1a-8bd891f8805c/f4663043-cff4-5c88-8a1a-8bd891f8805c_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Faadc4f6f30324dcd8c0a6e41d8096816%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/aadc4f6f30324dcd8c0a6e41d8096816/images/large/10.jpg saved to cache
2026-03-26 22:57:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f4663043-cff4-5c88-8a1a-8bd891f8805c
2026-03-26 22:57:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f4663043-cff4-5c88-8a1a-8bd891f8805c, skipping ID generation
2026-03-26 22:57:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4663043-cff4-5c88-8a1a-8bd891f8805c with scrape type 1
2026-03-26 22:57:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f4663043-cff4-5c88-8a1a-8bd891f8805c sending to next pipeline
2026-03-26 22:57:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f4663043-cff4-5c88-8a1a-8bd891f8805c, identifier: 1985655
2026-03-26 22:57:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76a7010>
2026-03-26 22:57:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8/b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F84e04c42a2cd40b6b6fddb68f8be153c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/84e04c42a2cd40b6b6fddb68f8be153c/images/large/1.jpg saved to cache
2026-03-26 22:57:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8
2026-03-26 22:57:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b764a1d0>
2026-03-26 22:57:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8/b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F84e04c42a2cd40b6b6fddb68f8be153c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/84e04c42a2cd40b6b6fddb68f8be153c/images/large/2.jpg saved to cache
2026-03-26 22:57:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8
2026-03-26 22:57:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f4663043-cff4-5c88-8a1a-8bd891f8805c with identifier: 1985655
2026-03-26 22:57:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f4663043-cff4-5c88-8a1a-8bd891f8805c with identifier: 1985655
2026-03-26 22:57:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f4663043-cff4-5c88-8a1a-8bd891f8805c with identifier: 1985655 to the API
2026-03-26 22:57:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:57:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:57:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2dt/aadc4f6f30324dcd8c0a6e41d8096816/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'f4663043-cff4-5c88-8a1a-8bd891f8805c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 179930,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4663043-cff4-5c88-8a1a-8bd891f8805c/f4663043-cff4-5c88-8a1a-8bd891f8805c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 278251,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/aadc4f6f30324dcd8c0a6e41d8096816/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4663043-cff4-5c88-8a1a-8bd891f8805c/f4663043-cff4-5c88-8a1a-8bd891f8805c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 275058,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/aadc4f6f30324dcd8c0a6e41d8096816/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4663043-cff4-5c88-8a1a-8bd891f8805c/f4663043-cff4-5c88-8a1a-8bd891f8805c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 264082,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/aadc4f6f30324dcd8c0a6e41d8096816/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4663043-cff4-5c88-8a1a-8bd891f8805c/f4663043-cff4-5c88-8a1a-8bd891f8805c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 271467,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/aadc4f6f30324dcd8c0a6e41d8096816/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4663043-cff4-5c88-8a1a-8bd891f8805c/f4663043-cff4-5c88-8a1a-8bd891f8805c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 343784,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/aadc4f6f30324dcd8c0a6e41d8096816/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4663043-cff4-5c88-8a1a-8bd891f8805c/f4663043-cff4-5c88-8a1a-8bd891f8805c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 303010,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/aadc4f6f30324dcd8c0a6e41d8096816/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4663043-cff4-5c88-8a1a-8bd891f8805c/f4663043-cff4-5c88-8a1a-8bd891f8805c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 324212,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/aadc4f6f30324dcd8c0a6e41d8096816/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4663043-cff4-5c88-8a1a-8bd891f8805c/f4663043-cff4-5c88-8a1a-8bd891f8805c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 360415,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/aadc4f6f30324dcd8c0a6e41d8096816/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4663043-cff4-5c88-8a1a-8bd891f8805c/f4663043-cff4-5c88-8a1a-8bd891f8805c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 333599,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/aadc4f6f30324dcd8c0a6e41d8096816/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4663043-cff4-5c88-8a1a-8bd891f8805c/f4663043-cff4-5c88-8a1a-8bd891f8805c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 385148,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/aadc4f6f30324dcd8c0a6e41d8096816/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 1.6 PHEV 180 E-AUTO8 ACTIVE PACK',
 'transmission': 'automatic',
 'trim': '1.6 PHEV 180 E-AUTO8 ACTIVE PACK',
 'vin': None,
 'year': 2023}
2026-03-26 22:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985655%27 HTTP/1.1" 200 None
2026-03-26 22:57:36 [ayvens.be] INFO: Saving data for 1985655: {'created_time': 1774565856.806263, 'last_price_update_time': 1774565856.806276, 'auction_closing_time': 1774958400.0}
2026-03-26 22:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985655') HTTP/1.1" 204 0
2026-03-26 22:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F16e6f9532cff4c3bb1e515c977796539%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/16e6f9532cff4c3bb1e515c977796539/images/large/4.jpg not downloaded yet
2026-03-26 22:57:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/84e04c42a2cd40b6b6fddb68f8be153c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F16e6f9532cff4c3bb1e515c977796539%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/16e6f9532cff4c3bb1e515c977796539/images/large/5.jpg not downloaded yet
2026-03-26 22:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F16e6f9532cff4c3bb1e515c977796539%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/16e6f9532cff4c3bb1e515c977796539/images/large/6.jpg not downloaded yet
2026-03-26 22:57:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/84e04c42a2cd40b6b6fddb68f8be153c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/84e04c42a2cd40b6b6fddb68f8be153c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/84e04c42a2cd40b6b6fddb68f8be153c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/84e04c42a2cd40b6b6fddb68f8be153c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F16e6f9532cff4c3bb1e515c977796539%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/16e6f9532cff4c3bb1e515c977796539/images/large/7.jpg not downloaded yet
2026-03-26 22:57:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/84e04c42a2cd40b6b6fddb68f8be153c/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/84e04c42a2cd40b6b6fddb68f8be153c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F16e6f9532cff4c3bb1e515c977796539%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/16e6f9532cff4c3bb1e515c977796539/images/large/8.jpg not downloaded yet
2026-03-26 22:57:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/84e04c42a2cd40b6b6fddb68f8be153c/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F16e6f9532cff4c3bb1e515c977796539%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/16e6f9532cff4c3bb1e515c977796539/images/large/9.jpg not downloaded yet
2026-03-26 22:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F16e6f9532cff4c3bb1e515c977796539%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/16e6f9532cff4c3bb1e515c977796539/images/large/10.jpg not downloaded yet
2026-03-26 22:57:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7405f90>
2026-03-26 22:57:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8/b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:57:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F84e04c42a2cd40b6b6fddb68f8be153c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/84e04c42a2cd40b6b6fddb68f8be153c/images/large/3.jpg saved to cache
2026-03-26 22:57:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8
2026-03-26 22:57:37 [ayvens.be] INFO: Found listing with ID: 1985658
2026-03-26 22:57:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985658%27 HTTP/1.1" 200 None
2026-03-26 22:57:37 [ayvens.be] INFO: Scrape type for 1985658: 1
2026-03-26 22:57:37 [ayvens.be] INFO: Extracting data for car ID: 1985658
2026-03-26 22:57:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b6479a13-66d2-51e7-b80a-e69b1d185324 with identifier: 1985658
2026-03-26 22:57:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6479a13-66d2-51e7-b80a-e69b1d185324 with scrape type 1
2026-03-26 22:57:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b6479a13-66d2-51e7-b80a-e69b1d185324
2026-03-26 22:57:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F557e530f2eab4326921773d71b3611fe%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/557e530f2eab4326921773d71b3611fe/images/large/1.jpg not downloaded yet
2026-03-26 22:57:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F557e530f2eab4326921773d71b3611fe%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/557e530f2eab4326921773d71b3611fe/images/large/2.jpg not downloaded yet
2026-03-26 22:57:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79f0650>
2026-03-26 22:57:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8/b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:57:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F84e04c42a2cd40b6b6fddb68f8be153c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/84e04c42a2cd40b6b6fddb68f8be153c/images/large/7.jpg saved to cache
2026-03-26 22:57:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8
2026-03-26 22:57:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b75e90>
2026-03-26 22:57:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8/b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:57:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F84e04c42a2cd40b6b6fddb68f8be153c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/84e04c42a2cd40b6b6fddb68f8be153c/images/large/5.jpg saved to cache
2026-03-26 22:57:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8
2026-03-26 22:57:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76ce150>
2026-03-26 22:57:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8/b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:57:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F84e04c42a2cd40b6b6fddb68f8be153c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/84e04c42a2cd40b6b6fddb68f8be153c/images/large/6.jpg saved to cache
2026-03-26 22:57:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8
2026-03-26 22:57:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77705d0>
2026-03-26 22:57:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8/b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:57:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F84e04c42a2cd40b6b6fddb68f8be153c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/84e04c42a2cd40b6b6fddb68f8be153c/images/large/4.jpg saved to cache
2026-03-26 22:57:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8
2026-03-26 22:57:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c95510>
2026-03-26 22:57:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8/b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:57:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F84e04c42a2cd40b6b6fddb68f8be153c%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/84e04c42a2cd40b6b6fddb68f8be153c/images/large/9.jpg saved to cache
2026-03-26 22:57:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8
2026-03-26 22:57:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c965d0>
2026-03-26 22:57:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8/b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:57:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F84e04c42a2cd40b6b6fddb68f8be153c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/84e04c42a2cd40b6b6fddb68f8be153c/images/large/8.jpg saved to cache
2026-03-26 22:57:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8
2026-03-26 22:57:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd0c7510>
2026-03-26 22:57:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8/b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:57:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F84e04c42a2cd40b6b6fddb68f8be153c%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/84e04c42a2cd40b6b6fddb68f8be153c/images/large/10.jpg saved to cache
2026-03-26 22:57:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8
2026-03-26 22:57:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8, skipping ID generation
2026-03-26 22:57:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8 with scrape type 1
2026-03-26 22:57:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8 sending to next pipeline
2026-03-26 22:57:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8, identifier: 1985656
2026-03-26 22:57:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F557e530f2eab4326921773d71b3611fe%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/557e530f2eab4326921773d71b3611fe/images/large/3.jpg not downloaded yet
2026-03-26 22:57:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8 with identifier: 1985656
2026-03-26 22:57:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8 with identifier: 1985656
2026-03-26 22:57:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8 with identifier: 1985656 to the API
2026-03-26 22:57:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:57:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:57:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bu/84e04c42a2cd40b6b6fddb68f8be153c/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3 Sportback',
 'odometer': 87882,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8/b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 679865,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/84e04c42a2cd40b6b6fddb68f8be153c/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8/b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 684872,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/84e04c42a2cd40b6b6fddb68f8be153c/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8/b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 661798,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/84e04c42a2cd40b6b6fddb68f8be153c/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8/b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 668849,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/84e04c42a2cd40b6b6fddb68f8be153c/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8/b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 676041,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/84e04c42a2cd40b6b6fddb68f8be153c/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8/b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 704835,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/84e04c42a2cd40b6b6fddb68f8be153c/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8/b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 600254,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/84e04c42a2cd40b6b6fddb68f8be153c/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8/b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 677986,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/84e04c42a2cd40b6b6fddb68f8be153c/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8/b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 706311,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/84e04c42a2cd40b6b6fddb68f8be153c/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8/b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 653666,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/84e04c42a2cd40b6b6fddb68f8be153c/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 Sportback 1.4 45 TFSI E S TRONIC',
 'transmission': 'automatic',
 'trim': '1.4 45 TFSI E S TRONIC',
 'vin': None,
 'year': 2022}
2026-03-26 22:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985656%27 HTTP/1.1" 200 None
2026-03-26 22:57:38 [ayvens.be] INFO: Saving data for 1985656: {'created_time': 1774565858.193853, 'last_price_update_time': 1774565858.193861, 'auction_closing_time': 1774958400.0}
2026-03-26 22:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985656') HTTP/1.1" 204 0
2026-03-26 22:57:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/16e6f9532cff4c3bb1e515c977796539/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F557e530f2eab4326921773d71b3611fe%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/557e530f2eab4326921773d71b3611fe/images/large/4.jpg not downloaded yet
2026-03-26 22:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F557e530f2eab4326921773d71b3611fe%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/557e530f2eab4326921773d71b3611fe/images/large/5.jpg not downloaded yet
2026-03-26 22:57:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/16e6f9532cff4c3bb1e515c977796539/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/557e530f2eab4326921773d71b3611fe/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/16e6f9532cff4c3bb1e515c977796539/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F557e530f2eab4326921773d71b3611fe%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/557e530f2eab4326921773d71b3611fe/images/large/6.jpg not downloaded yet
2026-03-26 22:57:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/16e6f9532cff4c3bb1e515c977796539/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/16e6f9532cff4c3bb1e515c977796539/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/16e6f9532cff4c3bb1e515c977796539/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F557e530f2eab4326921773d71b3611fe%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/557e530f2eab4326921773d71b3611fe/images/large/7.jpg not downloaded yet
2026-03-26 22:57:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/16e6f9532cff4c3bb1e515c977796539/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F557e530f2eab4326921773d71b3611fe%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/557e530f2eab4326921773d71b3611fe/images/large/8.jpg not downloaded yet
2026-03-26 22:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F557e530f2eab4326921773d71b3611fe%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/557e530f2eab4326921773d71b3611fe/images/large/9.jpg not downloaded yet
2026-03-26 22:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F557e530f2eab4326921773d71b3611fe%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/557e530f2eab4326921773d71b3611fe/images/large/10.jpg not downloaded yet
2026-03-26 22:57:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cb0910>
2026-03-26 22:57:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79/d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F16e6f9532cff4c3bb1e515c977796539%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/16e6f9532cff4c3bb1e515c977796539/images/large/1.jpg saved to cache
2026-03-26 22:57:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79
2026-03-26 22:57:38 [ayvens.be] INFO: Found listing with ID: 1985659
2026-03-26 22:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985659%27 HTTP/1.1" 200 None
2026-03-26 22:57:38 [ayvens.be] INFO: Scrape type for 1985659: 1
2026-03-26 22:57:38 [ayvens.be] INFO: Extracting data for car ID: 1985659
2026-03-26 22:57:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 475ee9c4-092b-5843-b6ad-2aa8911b972e with identifier: 1985659
2026-03-26 22:57:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 475ee9c4-092b-5843-b6ad-2aa8911b972e with scrape type 1
2026-03-26 22:57:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 475ee9c4-092b-5843-b6ad-2aa8911b972e
2026-03-26 22:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fbbfe2d2f87ae4cecaff3a129dd993b1b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/bbfe2d2f87ae4cecaff3a129dd993b1b/images/large/1.jpg not downloaded yet
2026-03-26 22:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fbbfe2d2f87ae4cecaff3a129dd993b1b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/bbfe2d2f87ae4cecaff3a129dd993b1b/images/large/2.jpg not downloaded yet
2026-03-26 22:57:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/557e530f2eab4326921773d71b3611fe/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fbbfe2d2f87ae4cecaff3a129dd993b1b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/bbfe2d2f87ae4cecaff3a129dd993b1b/images/large/3.jpg not downloaded yet
2026-03-26 22:57:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6dd9010>
2026-03-26 22:57:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79/d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F16e6f9532cff4c3bb1e515c977796539%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/16e6f9532cff4c3bb1e515c977796539/images/large/6.jpg saved to cache
2026-03-26 22:57:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79
2026-03-26 22:57:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76cf210>
2026-03-26 22:57:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6479a13-66d2-51e7-b80a-e69b1d185324/b6479a13-66d2-51e7-b80a-e69b1d185324_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F557e530f2eab4326921773d71b3611fe%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/557e530f2eab4326921773d71b3611fe/images/large/1.jpg saved to cache
2026-03-26 22:57:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b6479a13-66d2-51e7-b80a-e69b1d185324
2026-03-26 22:57:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b75a62d0>
2026-03-26 22:57:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79/d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F16e6f9532cff4c3bb1e515c977796539%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/16e6f9532cff4c3bb1e515c977796539/images/large/5.jpg saved to cache
2026-03-26 22:57:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79
2026-03-26 22:57:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b787dad0>
2026-03-26 22:57:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79/d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F16e6f9532cff4c3bb1e515c977796539%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/16e6f9532cff4c3bb1e515c977796539/images/large/4.jpg saved to cache
2026-03-26 22:57:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79
2026-03-26 22:57:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76cc0d0>
2026-03-26 22:57:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79/d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F16e6f9532cff4c3bb1e515c977796539%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/16e6f9532cff4c3bb1e515c977796539/images/large/7.jpg saved to cache
2026-03-26 22:57:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79
2026-03-26 22:57:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e13650>
2026-03-26 22:57:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79/d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F16e6f9532cff4c3bb1e515c977796539%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/16e6f9532cff4c3bb1e515c977796539/images/large/3.jpg saved to cache
2026-03-26 22:57:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79
2026-03-26 22:57:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b728f210>
2026-03-26 22:57:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79/d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F16e6f9532cff4c3bb1e515c977796539%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/16e6f9532cff4c3bb1e515c977796539/images/large/2.jpg saved to cache
2026-03-26 22:57:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79
2026-03-26 22:57:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/557e530f2eab4326921773d71b3611fe/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fbbfe2d2f87ae4cecaff3a129dd993b1b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/bbfe2d2f87ae4cecaff3a129dd993b1b/images/large/4.jpg not downloaded yet
2026-03-26 22:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fbbfe2d2f87ae4cecaff3a129dd993b1b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/bbfe2d2f87ae4cecaff3a129dd993b1b/images/large/5.jpg not downloaded yet
2026-03-26 22:57:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b787e050>
2026-03-26 22:57:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6479a13-66d2-51e7-b80a-e69b1d185324/b6479a13-66d2-51e7-b80a-e69b1d185324_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F557e530f2eab4326921773d71b3611fe%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/557e530f2eab4326921773d71b3611fe/images/large/2.jpg saved to cache
2026-03-26 22:57:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b6479a13-66d2-51e7-b80a-e69b1d185324
2026-03-26 22:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fbbfe2d2f87ae4cecaff3a129dd993b1b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/bbfe2d2f87ae4cecaff3a129dd993b1b/images/large/6.jpg not downloaded yet
2026-03-26 22:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fbbfe2d2f87ae4cecaff3a129dd993b1b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/bbfe2d2f87ae4cecaff3a129dd993b1b/images/large/7.jpg not downloaded yet
2026-03-26 22:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fbbfe2d2f87ae4cecaff3a129dd993b1b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/bbfe2d2f87ae4cecaff3a129dd993b1b/images/large/8.jpg not downloaded yet
2026-03-26 22:57:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76c6990>
2026-03-26 22:57:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6479a13-66d2-51e7-b80a-e69b1d185324/b6479a13-66d2-51e7-b80a-e69b1d185324_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F557e530f2eab4326921773d71b3611fe%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/557e530f2eab4326921773d71b3611fe/images/large/5.jpg saved to cache
2026-03-26 22:57:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b6479a13-66d2-51e7-b80a-e69b1d185324
2026-03-26 22:57:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/557e530f2eab4326921773d71b3611fe/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fbbfe2d2f87ae4cecaff3a129dd993b1b%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/bbfe2d2f87ae4cecaff3a129dd993b1b/images/large/9.jpg not downloaded yet
2026-03-26 22:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fbbfe2d2f87ae4cecaff3a129dd993b1b%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/bbfe2d2f87ae4cecaff3a129dd993b1b/images/large/10.jpg not downloaded yet
2026-03-26 22:57:39 [ayvens.be] INFO: Found listing with ID: 1985660
2026-03-26 22:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985660%27 HTTP/1.1" 200 None
2026-03-26 22:57:39 [ayvens.be] INFO: Scrape type for 1985660: 1
2026-03-26 22:57:39 [ayvens.be] INFO: Extracting data for car ID: 1985660
2026-03-26 22:57:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77 with identifier: 1985660
2026-03-26 22:57:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77 with scrape type 1
2026-03-26 22:57:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77
2026-03-26 22:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Ffa9c20e7f034458591b568c084e135d1%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/fa9c20e7f034458591b568c084e135d1/images/large/1.jpg not downloaded yet
2026-03-26 22:57:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/16e6f9532cff4c3bb1e515c977796539/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/557e530f2eab4326921773d71b3611fe/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Ffa9c20e7f034458591b568c084e135d1%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/fa9c20e7f034458591b568c084e135d1/images/large/2.jpg not downloaded yet
2026-03-26 22:57:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c698d0>
2026-03-26 22:57:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6479a13-66d2-51e7-b80a-e69b1d185324/b6479a13-66d2-51e7-b80a-e69b1d185324_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F557e530f2eab4326921773d71b3611fe%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/557e530f2eab4326921773d71b3611fe/images/large/10.jpg saved to cache
2026-03-26 22:57:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b6479a13-66d2-51e7-b80a-e69b1d185324
2026-03-26 22:57:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/16e6f9532cff4c3bb1e515c977796539/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Ffa9c20e7f034458591b568c084e135d1%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/fa9c20e7f034458591b568c084e135d1/images/large/3.jpg not downloaded yet
2026-03-26 22:57:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/557e530f2eab4326921773d71b3611fe/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/557e530f2eab4326921773d71b3611fe/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/557e530f2eab4326921773d71b3611fe/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Ffa9c20e7f034458591b568c084e135d1%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/fa9c20e7f034458591b568c084e135d1/images/large/4.jpg not downloaded yet
2026-03-26 22:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Ffa9c20e7f034458591b568c084e135d1%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/fa9c20e7f034458591b568c084e135d1/images/large/5.jpg not downloaded yet
2026-03-26 22:57:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/557e530f2eab4326921773d71b3611fe/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/557e530f2eab4326921773d71b3611fe/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Ffa9c20e7f034458591b568c084e135d1%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/fa9c20e7f034458591b568c084e135d1/images/large/6.jpg not downloaded yet
2026-03-26 22:57:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b788e8d0>
2026-03-26 22:57:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79/d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F16e6f9532cff4c3bb1e515c977796539%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/16e6f9532cff4c3bb1e515c977796539/images/large/10.jpg saved to cache
2026-03-26 22:57:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79
2026-03-26 22:57:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c83610>
2026-03-26 22:57:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6479a13-66d2-51e7-b80a-e69b1d185324/b6479a13-66d2-51e7-b80a-e69b1d185324_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F557e530f2eab4326921773d71b3611fe%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/557e530f2eab4326921773d71b3611fe/images/large/6.jpg saved to cache
2026-03-26 22:57:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b6479a13-66d2-51e7-b80a-e69b1d185324
2026-03-26 22:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Ffa9c20e7f034458591b568c084e135d1%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/fa9c20e7f034458591b568c084e135d1/images/large/7.jpg not downloaded yet
2026-03-26 22:57:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/16e6f9532cff4c3bb1e515c977796539/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Ffa9c20e7f034458591b568c084e135d1%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/fa9c20e7f034458591b568c084e135d1/images/large/8.jpg not downloaded yet
2026-03-26 22:57:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7495fd0>
2026-03-26 22:57:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79/d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F16e6f9532cff4c3bb1e515c977796539%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/16e6f9532cff4c3bb1e515c977796539/images/large/9.jpg saved to cache
2026-03-26 22:57:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79
2026-03-26 22:57:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76a4ed0>
2026-03-26 22:57:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6479a13-66d2-51e7-b80a-e69b1d185324/b6479a13-66d2-51e7-b80a-e69b1d185324_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F557e530f2eab4326921773d71b3611fe%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/557e530f2eab4326921773d71b3611fe/images/large/4.jpg saved to cache
2026-03-26 22:57:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b6479a13-66d2-51e7-b80a-e69b1d185324
2026-03-26 22:57:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e34dd0>
2026-03-26 22:57:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6479a13-66d2-51e7-b80a-e69b1d185324/b6479a13-66d2-51e7-b80a-e69b1d185324_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:57:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F557e530f2eab4326921773d71b3611fe%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/557e530f2eab4326921773d71b3611fe/images/large/3.jpg saved to cache
2026-03-26 22:57:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b6479a13-66d2-51e7-b80a-e69b1d185324
2026-03-26 22:57:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77798d0>
2026-03-26 22:57:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6479a13-66d2-51e7-b80a-e69b1d185324/b6479a13-66d2-51e7-b80a-e69b1d185324_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:57:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F557e530f2eab4326921773d71b3611fe%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/557e530f2eab4326921773d71b3611fe/images/large/9.jpg saved to cache
2026-03-26 22:57:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b6479a13-66d2-51e7-b80a-e69b1d185324
2026-03-26 22:57:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74bc710>
2026-03-26 22:57:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6479a13-66d2-51e7-b80a-e69b1d185324/b6479a13-66d2-51e7-b80a-e69b1d185324_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:57:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F557e530f2eab4326921773d71b3611fe%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/557e530f2eab4326921773d71b3611fe/images/large/8.jpg saved to cache
2026-03-26 22:57:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b6479a13-66d2-51e7-b80a-e69b1d185324
2026-03-26 22:57:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74ae810>
2026-03-26 22:57:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6479a13-66d2-51e7-b80a-e69b1d185324/b6479a13-66d2-51e7-b80a-e69b1d185324_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:57:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F557e530f2eab4326921773d71b3611fe%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/557e530f2eab4326921773d71b3611fe/images/large/7.jpg saved to cache
2026-03-26 22:57:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b6479a13-66d2-51e7-b80a-e69b1d185324
2026-03-26 22:57:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b6479a13-66d2-51e7-b80a-e69b1d185324, skipping ID generation
2026-03-26 22:57:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6479a13-66d2-51e7-b80a-e69b1d185324 with scrape type 1
2026-03-26 22:57:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b6479a13-66d2-51e7-b80a-e69b1d185324 sending to next pipeline
2026-03-26 22:57:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b6479a13-66d2-51e7-b80a-e69b1d185324, identifier: 1985658
2026-03-26 22:57:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/bbfe2d2f87ae4cecaff3a129dd993b1b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Ffa9c20e7f034458591b568c084e135d1%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/fa9c20e7f034458591b568c084e135d1/images/large/9.jpg not downloaded yet
2026-03-26 22:57:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b6479a13-66d2-51e7-b80a-e69b1d185324 with identifier: 1985658
2026-03-26 22:57:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b6479a13-66d2-51e7-b80a-e69b1d185324 with identifier: 1985658
2026-03-26 22:57:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b6479a13-66d2-51e7-b80a-e69b1d185324 with identifier: 1985658 to the API
2026-03-26 22:57:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:57:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:57:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bl/557e530f2eab4326921773d71b3611fe/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 47,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'b6479a13-66d2-51e7-b80a-e69b1d185324',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 104277,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6479a13-66d2-51e7-b80a-e69b1d185324/b6479a13-66d2-51e7-b80a-e69b1d185324_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 244735,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/557e530f2eab4326921773d71b3611fe/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6479a13-66d2-51e7-b80a-e69b1d185324/b6479a13-66d2-51e7-b80a-e69b1d185324_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 228875,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/557e530f2eab4326921773d71b3611fe/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6479a13-66d2-51e7-b80a-e69b1d185324/b6479a13-66d2-51e7-b80a-e69b1d185324_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 269052,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/557e530f2eab4326921773d71b3611fe/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6479a13-66d2-51e7-b80a-e69b1d185324/b6479a13-66d2-51e7-b80a-e69b1d185324_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 277932,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/557e530f2eab4326921773d71b3611fe/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6479a13-66d2-51e7-b80a-e69b1d185324/b6479a13-66d2-51e7-b80a-e69b1d185324_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 324885,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/557e530f2eab4326921773d71b3611fe/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6479a13-66d2-51e7-b80a-e69b1d185324/b6479a13-66d2-51e7-b80a-e69b1d185324_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 305244,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/557e530f2eab4326921773d71b3611fe/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6479a13-66d2-51e7-b80a-e69b1d185324/b6479a13-66d2-51e7-b80a-e69b1d185324_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 330523,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/557e530f2eab4326921773d71b3611fe/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6479a13-66d2-51e7-b80a-e69b1d185324/b6479a13-66d2-51e7-b80a-e69b1d185324_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 322697,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/557e530f2eab4326921773d71b3611fe/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6479a13-66d2-51e7-b80a-e69b1d185324/b6479a13-66d2-51e7-b80a-e69b1d185324_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 318711,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/557e530f2eab4326921773d71b3611fe/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6479a13-66d2-51e7-b80a-e69b1d185324/b6479a13-66d2-51e7-b80a-e69b1d185324_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 208062,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/557e530f2eab4326921773d71b3611fe/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T5 PHEV Inscription Expres.',
 'transmission': 'automatic',
 'trim': '1.5 T5 PHEV Inscription Expres.',
 'vin': None,
 'year': 2021}
2026-03-26 22:57:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985658%27 HTTP/1.1" 200 None
2026-03-26 22:57:40 [ayvens.be] INFO: Saving data for 1985658: {'created_time': 1774565860.76812, 'last_price_update_time': 1774565860.76813, 'auction_closing_time': 1774958400.0}
2026-03-26 22:57:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985658') HTTP/1.1" 204 0
2026-03-26 22:57:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Ffa9c20e7f034458591b568c084e135d1%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/fa9c20e7f034458591b568c084e135d1/images/large/10.jpg not downloaded yet
2026-03-26 22:57:40 [ayvens.be] INFO: Found listing with ID: 1985661
2026-03-26 22:57:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985661%27 HTTP/1.1" 200 None
2026-03-26 22:57:40 [ayvens.be] INFO: Scrape type for 1985661: 1
2026-03-26 22:57:40 [ayvens.be] INFO: Extracting data for car ID: 1985661
2026-03-26 22:57:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 31776f69-743f-5210-afca-b1b6483e3e9e with identifier: 1985661
2026-03-26 22:57:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31776f69-743f-5210-afca-b1b6483e3e9e with scrape type 1
2026-03-26 22:57:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 31776f69-743f-5210-afca-b1b6483e3e9e
2026-03-26 22:57:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252F1bb291dd2c2b400bada3a7462ba121a7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/1bb291dd2c2b400bada3a7462ba121a7/images/large/1.jpg not downloaded yet
2026-03-26 22:57:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74a4690>
2026-03-26 22:57:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79/d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:57:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F16e6f9532cff4c3bb1e515c977796539%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/16e6f9532cff4c3bb1e515c977796539/images/large/8.jpg saved to cache
2026-03-26 22:57:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79
2026-03-26 22:57:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79, skipping ID generation
2026-03-26 22:57:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79 with scrape type 1
2026-03-26 22:57:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79 sending to next pipeline
2026-03-26 22:57:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79, identifier: 1985657
2026-03-26 22:57:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e16d90>
2026-03-26 22:57:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_475ee9c4-092b-5843-b6ad-2aa8911b972e/475ee9c4-092b-5843-b6ad-2aa8911b972e_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fbbfe2d2f87ae4cecaff3a129dd993b1b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/bbfe2d2f87ae4cecaff3a129dd993b1b/images/large/1.jpg saved to cache
2026-03-26 22:57:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 475ee9c4-092b-5843-b6ad-2aa8911b972e
2026-03-26 22:57:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/bbfe2d2f87ae4cecaff3a129dd993b1b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/bbfe2d2f87ae4cecaff3a129dd993b1b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79 with identifier: 1985657
2026-03-26 22:57:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79 with identifier: 1985657
2026-03-26 22:57:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79 with identifier: 1985657 to the API
2026-03-26 22:57:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:57:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:57:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bp/16e6f9532cff4c3bb1e515c977796539/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'd1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 107217,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 19,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79/d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 712700,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/16e6f9532cff4c3bb1e515c977796539/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79/d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 690645,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/16e6f9532cff4c3bb1e515c977796539/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79/d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 741236,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/16e6f9532cff4c3bb1e515c977796539/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79/d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 682247,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/16e6f9532cff4c3bb1e515c977796539/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79/d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 656404,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/16e6f9532cff4c3bb1e515c977796539/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79/d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 586667,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/16e6f9532cff4c3bb1e515c977796539/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79/d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 700172,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/16e6f9532cff4c3bb1e515c977796539/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79/d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 689128,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/16e6f9532cff4c3bb1e515c977796539/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79/d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 462411,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/16e6f9532cff4c3bb1e515c977796539/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79/d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 476076,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/16e6f9532cff4c3bb1e515c977796539/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T4 PHEV INSCRIPTION EXPR. DCT',
 'transmission': 'automatic',
 'trim': '1.5 T4 PHEV INSCRIPTION EXPR. DCT',
 'vin': None,
 'year': 2022}
2026-03-26 22:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985657%27 HTTP/1.1" 200 None
2026-03-26 22:57:41 [ayvens.be] INFO: Saving data for 1985657: {'created_time': 1774565861.540428, 'last_price_update_time': 1774565861.540438, 'auction_closing_time': 1774958400.0}
2026-03-26 22:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985657') HTTP/1.1" 204 0
2026-03-26 22:57:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/bbfe2d2f87ae4cecaff3a129dd993b1b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252F1bb291dd2c2b400bada3a7462ba121a7%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/1bb291dd2c2b400bada3a7462ba121a7/images/large/2.jpg not downloaded yet
2026-03-26 22:57:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/bbfe2d2f87ae4cecaff3a129dd993b1b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252F1bb291dd2c2b400bada3a7462ba121a7%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/1bb291dd2c2b400bada3a7462ba121a7/images/large/3.jpg not downloaded yet
2026-03-26 22:57:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79ccf10>
2026-03-26 22:57:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_475ee9c4-092b-5843-b6ad-2aa8911b972e/475ee9c4-092b-5843-b6ad-2aa8911b972e_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fbbfe2d2f87ae4cecaff3a129dd993b1b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/bbfe2d2f87ae4cecaff3a129dd993b1b/images/large/2.jpg saved to cache
2026-03-26 22:57:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 475ee9c4-092b-5843-b6ad-2aa8911b972e
2026-03-26 22:57:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7ce8290>
2026-03-26 22:57:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_475ee9c4-092b-5843-b6ad-2aa8911b972e/475ee9c4-092b-5843-b6ad-2aa8911b972e_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fbbfe2d2f87ae4cecaff3a129dd993b1b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/bbfe2d2f87ae4cecaff3a129dd993b1b/images/large/5.jpg saved to cache
2026-03-26 22:57:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 475ee9c4-092b-5843-b6ad-2aa8911b972e
2026-03-26 22:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252F1bb291dd2c2b400bada3a7462ba121a7%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/1bb291dd2c2b400bada3a7462ba121a7/images/large/4.jpg not downloaded yet
2026-03-26 22:57:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/bbfe2d2f87ae4cecaff3a129dd993b1b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252F1bb291dd2c2b400bada3a7462ba121a7%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/1bb291dd2c2b400bada3a7462ba121a7/images/large/5.jpg not downloaded yet
2026-03-26 22:57:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76e3610>
2026-03-26 22:57:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_475ee9c4-092b-5843-b6ad-2aa8911b972e/475ee9c4-092b-5843-b6ad-2aa8911b972e_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fbbfe2d2f87ae4cecaff3a129dd993b1b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/bbfe2d2f87ae4cecaff3a129dd993b1b/images/large/3.jpg saved to cache
2026-03-26 22:57:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 475ee9c4-092b-5843-b6ad-2aa8911b972e
2026-03-26 22:57:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7a607d0>
2026-03-26 22:57:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_475ee9c4-092b-5843-b6ad-2aa8911b972e/475ee9c4-092b-5843-b6ad-2aa8911b972e_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fbbfe2d2f87ae4cecaff3a129dd993b1b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/bbfe2d2f87ae4cecaff3a129dd993b1b/images/large/4.jpg saved to cache
2026-03-26 22:57:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 475ee9c4-092b-5843-b6ad-2aa8911b972e
2026-03-26 22:57:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/bbfe2d2f87ae4cecaff3a129dd993b1b/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/bbfe2d2f87ae4cecaff3a129dd993b1b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/fa9c20e7f034458591b568c084e135d1/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/fa9c20e7f034458591b568c084e135d1/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252F1bb291dd2c2b400bada3a7462ba121a7%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/1bb291dd2c2b400bada3a7462ba121a7/images/large/6.jpg not downloaded yet
2026-03-26 22:57:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/fa9c20e7f034458591b568c084e135d1/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252F1bb291dd2c2b400bada3a7462ba121a7%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/1bb291dd2c2b400bada3a7462ba121a7/images/large/7.jpg not downloaded yet
2026-03-26 22:57:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b6bb10>
2026-03-26 22:57:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_475ee9c4-092b-5843-b6ad-2aa8911b972e/475ee9c4-092b-5843-b6ad-2aa8911b972e_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fbbfe2d2f87ae4cecaff3a129dd993b1b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/bbfe2d2f87ae4cecaff3a129dd993b1b/images/large/6.jpg saved to cache
2026-03-26 22:57:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 475ee9c4-092b-5843-b6ad-2aa8911b972e
2026-03-26 22:57:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/bbfe2d2f87ae4cecaff3a129dd993b1b/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252F1bb291dd2c2b400bada3a7462ba121a7%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/1bb291dd2c2b400bada3a7462ba121a7/images/large/8.jpg not downloaded yet
2026-03-26 22:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252F1bb291dd2c2b400bada3a7462ba121a7%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/1bb291dd2c2b400bada3a7462ba121a7/images/large/9.jpg not downloaded yet
2026-03-26 22:57:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/bbfe2d2f87ae4cecaff3a129dd993b1b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/fa9c20e7f034458591b568c084e135d1/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/fa9c20e7f034458591b568c084e135d1/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252F1bb291dd2c2b400bada3a7462ba121a7%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/1bb291dd2c2b400bada3a7462ba121a7/images/large/10.jpg not downloaded yet
2026-03-26 22:57:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7425850>
2026-03-26 22:57:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_475ee9c4-092b-5843-b6ad-2aa8911b972e/475ee9c4-092b-5843-b6ad-2aa8911b972e_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fbbfe2d2f87ae4cecaff3a129dd993b1b%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/bbfe2d2f87ae4cecaff3a129dd993b1b/images/large/10.jpg saved to cache
2026-03-26 22:57:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 475ee9c4-092b-5843-b6ad-2aa8911b972e
2026-03-26 22:57:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7ae9c50>
2026-03-26 22:57:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_475ee9c4-092b-5843-b6ad-2aa8911b972e/475ee9c4-092b-5843-b6ad-2aa8911b972e_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fbbfe2d2f87ae4cecaff3a129dd993b1b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/bbfe2d2f87ae4cecaff3a129dd993b1b/images/large/8.jpg saved to cache
2026-03-26 22:57:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 475ee9c4-092b-5843-b6ad-2aa8911b972e
2026-03-26 22:57:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7771090>
2026-03-26 22:57:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77/9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Ffa9c20e7f034458591b568c084e135d1%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/fa9c20e7f034458591b568c084e135d1/images/large/2.jpg saved to cache
2026-03-26 22:57:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77
2026-03-26 22:57:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c74610>
2026-03-26 22:57:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77/9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Ffa9c20e7f034458591b568c084e135d1%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/fa9c20e7f034458591b568c084e135d1/images/large/3.jpg saved to cache
2026-03-26 22:57:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77
2026-03-26 22:57:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74515d0>
2026-03-26 22:57:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77/9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Ffa9c20e7f034458591b568c084e135d1%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/fa9c20e7f034458591b568c084e135d1/images/large/1.jpg saved to cache
2026-03-26 22:57:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77
2026-03-26 22:57:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/fa9c20e7f034458591b568c084e135d1/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:42 [ayvens.be] INFO: Found listing with ID: 1985662
2026-03-26 22:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985662%27 HTTP/1.1" 200 None
2026-03-26 22:57:42 [ayvens.be] INFO: Scrape type for 1985662: 1
2026-03-26 22:57:42 [ayvens.be] INFO: Extracting data for car ID: 1985662
2026-03-26 22:57:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b6d58cdd-aa50-5952-b531-46485dc8de9c with identifier: 1985662
2026-03-26 22:57:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6d58cdd-aa50-5952-b531-46485dc8de9c with scrape type 1
2026-03-26 22:57:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b6d58cdd-aa50-5952-b531-46485dc8de9c
2026-03-26 22:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Ffcb55fc9449a4922add1997cd3957de8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/fcb55fc9449a4922add1997cd3957de8/images/large/1.jpg not downloaded yet
2026-03-26 22:57:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/fa9c20e7f034458591b568c084e135d1/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6da4b50>
2026-03-26 22:57:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_475ee9c4-092b-5843-b6ad-2aa8911b972e/475ee9c4-092b-5843-b6ad-2aa8911b972e_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fbbfe2d2f87ae4cecaff3a129dd993b1b%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/bbfe2d2f87ae4cecaff3a129dd993b1b/images/large/9.jpg saved to cache
2026-03-26 22:57:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 475ee9c4-092b-5843-b6ad-2aa8911b972e
2026-03-26 22:57:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74a6ad0>
2026-03-26 22:57:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_475ee9c4-092b-5843-b6ad-2aa8911b972e/475ee9c4-092b-5843-b6ad-2aa8911b972e_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fbbfe2d2f87ae4cecaff3a129dd993b1b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/bbfe2d2f87ae4cecaff3a129dd993b1b/images/large/7.jpg saved to cache
2026-03-26 22:57:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 475ee9c4-092b-5843-b6ad-2aa8911b972e
2026-03-26 22:57:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 475ee9c4-092b-5843-b6ad-2aa8911b972e, skipping ID generation
2026-03-26 22:57:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 475ee9c4-092b-5843-b6ad-2aa8911b972e with scrape type 1
2026-03-26 22:57:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 475ee9c4-092b-5843-b6ad-2aa8911b972e sending to next pipeline
2026-03-26 22:57:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 475ee9c4-092b-5843-b6ad-2aa8911b972e, identifier: 1985659
2026-03-26 22:57:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74ad610>
2026-03-26 22:57:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77/9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Ffa9c20e7f034458591b568c084e135d1%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/fa9c20e7f034458591b568c084e135d1/images/large/5.jpg saved to cache
2026-03-26 22:57:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77
2026-03-26 22:57:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7ce8490>
2026-03-26 22:57:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77/9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Ffa9c20e7f034458591b568c084e135d1%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/fa9c20e7f034458591b568c084e135d1/images/large/6.jpg saved to cache
2026-03-26 22:57:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77
2026-03-26 22:57:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/fa9c20e7f034458591b568c084e135d1/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Ffcb55fc9449a4922add1997cd3957de8%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/fcb55fc9449a4922add1997cd3957de8/images/large/2.jpg not downloaded yet
2026-03-26 22:57:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 475ee9c4-092b-5843-b6ad-2aa8911b972e with identifier: 1985659
2026-03-26 22:57:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 475ee9c4-092b-5843-b6ad-2aa8911b972e with identifier: 1985659
2026-03-26 22:57:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 475ee9c4-092b-5843-b6ad-2aa8911b972e with identifier: 1985659 to the API
2026-03-26 22:57:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:57:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:57:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bl/bbfe2d2f87ae4cecaff3a129dd993b1b/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '475ee9c4-092b-5843-b6ad-2aa8911b972e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '3 SERIES TOURING',
 'odometer': 158208,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_475ee9c4-092b-5843-b6ad-2aa8911b972e/475ee9c4-092b-5843-b6ad-2aa8911b972e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 727028,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/bbfe2d2f87ae4cecaff3a129dd993b1b/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_475ee9c4-092b-5843-b6ad-2aa8911b972e/475ee9c4-092b-5843-b6ad-2aa8911b972e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 738366,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/bbfe2d2f87ae4cecaff3a129dd993b1b/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_475ee9c4-092b-5843-b6ad-2aa8911b972e/475ee9c4-092b-5843-b6ad-2aa8911b972e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 689025,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/bbfe2d2f87ae4cecaff3a129dd993b1b/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_475ee9c4-092b-5843-b6ad-2aa8911b972e/475ee9c4-092b-5843-b6ad-2aa8911b972e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 727046,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/bbfe2d2f87ae4cecaff3a129dd993b1b/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_475ee9c4-092b-5843-b6ad-2aa8911b972e/475ee9c4-092b-5843-b6ad-2aa8911b972e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 652704,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/bbfe2d2f87ae4cecaff3a129dd993b1b/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_475ee9c4-092b-5843-b6ad-2aa8911b972e/475ee9c4-092b-5843-b6ad-2aa8911b972e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 730281,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/bbfe2d2f87ae4cecaff3a129dd993b1b/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_475ee9c4-092b-5843-b6ad-2aa8911b972e/475ee9c4-092b-5843-b6ad-2aa8911b972e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 586098,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/bbfe2d2f87ae4cecaff3a129dd993b1b/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_475ee9c4-092b-5843-b6ad-2aa8911b972e/475ee9c4-092b-5843-b6ad-2aa8911b972e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 853051,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/bbfe2d2f87ae4cecaff3a129dd993b1b/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_475ee9c4-092b-5843-b6ad-2aa8911b972e/475ee9c4-092b-5843-b6ad-2aa8911b972e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 846423,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/bbfe2d2f87ae4cecaff3a129dd993b1b/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_475ee9c4-092b-5843-b6ad-2aa8911b972e/475ee9c4-092b-5843-b6ad-2aa8911b972e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 813083,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/bbfe2d2f87ae4cecaff3a129dd993b1b/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3 SERIES TOURING 2.0 316D (90KW) TOURING',
 'transmission': 'manual',
 'trim': '2.0 316D (90KW) TOURING',
 'vin': None,
 'year': 2022}
2026-03-26 22:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985659%27 HTTP/1.1" 200 None
2026-03-26 22:57:43 [ayvens.be] INFO: Saving data for 1985659: {'created_time': 1774565863.285197, 'last_price_update_time': 1774565863.285206, 'auction_closing_time': 1774958400.0}
2026-03-26 22:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985659') HTTP/1.1" 204 0
2026-03-26 22:57:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/fa9c20e7f034458591b568c084e135d1/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Ffcb55fc9449a4922add1997cd3957de8%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/fcb55fc9449a4922add1997cd3957de8/images/large/3.jpg not downloaded yet
2026-03-26 22:57:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c612d0>
2026-03-26 22:57:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77/9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Ffa9c20e7f034458591b568c084e135d1%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/fa9c20e7f034458591b568c084e135d1/images/large/8.jpg saved to cache
2026-03-26 22:57:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77
2026-03-26 22:57:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e11dd0>
2026-03-26 22:57:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77/9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Ffa9c20e7f034458591b568c084e135d1%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/fa9c20e7f034458591b568c084e135d1/images/large/4.jpg saved to cache
2026-03-26 22:57:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77
2026-03-26 22:57:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cg/1bb291dd2c2b400bada3a7462ba121a7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/fa9c20e7f034458591b568c084e135d1/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Ffcb55fc9449a4922add1997cd3957de8%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/fcb55fc9449a4922add1997cd3957de8/images/large/4.jpg not downloaded yet
2026-03-26 22:57:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c60c10>
2026-03-26 22:57:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77/9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Ffa9c20e7f034458591b568c084e135d1%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/fa9c20e7f034458591b568c084e135d1/images/large/9.jpg saved to cache
2026-03-26 22:57:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77
2026-03-26 22:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Ffcb55fc9449a4922add1997cd3957de8%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/fcb55fc9449a4922add1997cd3957de8/images/large/5.jpg not downloaded yet
2026-03-26 22:57:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74fb890>
2026-03-26 22:57:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77/9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Ffa9c20e7f034458591b568c084e135d1%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/fa9c20e7f034458591b568c084e135d1/images/large/10.jpg saved to cache
2026-03-26 22:57:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77
2026-03-26 22:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Ffcb55fc9449a4922add1997cd3957de8%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/fcb55fc9449a4922add1997cd3957de8/images/large/6.jpg not downloaded yet
2026-03-26 22:57:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cg/1bb291dd2c2b400bada3a7462ba121a7/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cg/1bb291dd2c2b400bada3a7462ba121a7/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cg/1bb291dd2c2b400bada3a7462ba121a7/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Ffcb55fc9449a4922add1997cd3957de8%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/fcb55fc9449a4922add1997cd3957de8/images/large/7.jpg not downloaded yet
2026-03-26 22:57:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd12d850>
2026-03-26 22:57:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31776f69-743f-5210-afca-b1b6483e3e9e/31776f69-743f-5210-afca-b1b6483e3e9e_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252F1bb291dd2c2b400bada3a7462ba121a7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/1bb291dd2c2b400bada3a7462ba121a7/images/large/1.jpg saved to cache
2026-03-26 22:57:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 31776f69-743f-5210-afca-b1b6483e3e9e
2026-03-26 22:57:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74a6050>
2026-03-26 22:57:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77/9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Ffa9c20e7f034458591b568c084e135d1%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/fa9c20e7f034458591b568c084e135d1/images/large/7.jpg saved to cache
2026-03-26 22:57:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77
2026-03-26 22:57:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77, skipping ID generation
2026-03-26 22:57:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77 with scrape type 1
2026-03-26 22:57:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77 sending to next pipeline
2026-03-26 22:57:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77, identifier: 1985660
2026-03-26 22:57:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77 with identifier: 1985660
2026-03-26 22:57:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77 with identifier: 1985660
2026-03-26 22:57:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77 with identifier: 1985660 to the API
2026-03-26 22:57:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:57:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:57:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yx/fa9c20e7f034458591b568c084e135d1/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X2 DIESEL',
 'odometer': 85006,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77/9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 220012,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/fa9c20e7f034458591b568c084e135d1/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77/9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 211356,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/fa9c20e7f034458591b568c084e135d1/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77/9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 213275,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/fa9c20e7f034458591b568c084e135d1/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77/9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 211452,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/fa9c20e7f034458591b568c084e135d1/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77/9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 259207,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/fa9c20e7f034458591b568c084e135d1/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77/9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 209382,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/fa9c20e7f034458591b568c084e135d1/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77/9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 233021,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/fa9c20e7f034458591b568c084e135d1/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77/9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 283849,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/fa9c20e7f034458591b568c084e135d1/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77/9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 247795,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/fa9c20e7f034458591b568c084e135d1/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77/9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 292448,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/fa9c20e7f034458591b568c084e135d1/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X2 DIESEL 1.5 dA sDrive16',
 'transmission': 'automatic',
 'trim': '1.5 dA sDrive16',
 'vin': None,
 'year': 2021}
2026-03-26 22:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985660%27 HTTP/1.1" 200 None
2026-03-26 22:57:44 [ayvens.be] INFO: Saving data for 1985660: {'created_time': 1774565864.112787, 'last_price_update_time': 1774565864.112796, 'auction_closing_time': 1774958400.0}
2026-03-26 22:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985660') HTTP/1.1" 204 0
2026-03-26 22:57:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cg/1bb291dd2c2b400bada3a7462ba121a7/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Ffcb55fc9449a4922add1997cd3957de8%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/fcb55fc9449a4922add1997cd3957de8/images/large/8.jpg not downloaded yet
2026-03-26 22:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Ffcb55fc9449a4922add1997cd3957de8%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/fcb55fc9449a4922add1997cd3957de8/images/large/9.jpg not downloaded yet
2026-03-26 22:57:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cg/1bb291dd2c2b400bada3a7462ba121a7/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74ac7d0>
2026-03-26 22:57:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31776f69-743f-5210-afca-b1b6483e3e9e/31776f69-743f-5210-afca-b1b6483e3e9e_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252F1bb291dd2c2b400bada3a7462ba121a7%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/1bb291dd2c2b400bada3a7462ba121a7/images/large/3.jpg saved to cache
2026-03-26 22:57:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 31776f69-743f-5210-afca-b1b6483e3e9e
2026-03-26 22:57:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e1f950>
2026-03-26 22:57:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31776f69-743f-5210-afca-b1b6483e3e9e/31776f69-743f-5210-afca-b1b6483e3e9e_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252F1bb291dd2c2b400bada3a7462ba121a7%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/1bb291dd2c2b400bada3a7462ba121a7/images/large/4.jpg saved to cache
2026-03-26 22:57:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 31776f69-743f-5210-afca-b1b6483e3e9e
2026-03-26 22:57:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79f0510>
2026-03-26 22:57:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31776f69-743f-5210-afca-b1b6483e3e9e/31776f69-743f-5210-afca-b1b6483e3e9e_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252F1bb291dd2c2b400bada3a7462ba121a7%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/1bb291dd2c2b400bada3a7462ba121a7/images/large/5.jpg saved to cache
2026-03-26 22:57:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 31776f69-743f-5210-afca-b1b6483e3e9e
2026-03-26 22:57:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/fcb55fc9449a4922add1997cd3957de8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/fcb55fc9449a4922add1997cd3957de8/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Ffcb55fc9449a4922add1997cd3957de8%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/fcb55fc9449a4922add1997cd3957de8/images/large/10.jpg not downloaded yet
2026-03-26 22:57:44 [ayvens.be] INFO: Found listing with ID: 1985663
2026-03-26 22:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985663%27 HTTP/1.1" 200 None
2026-03-26 22:57:44 [ayvens.be] INFO: Scrape type for 1985663: 1
2026-03-26 22:57:44 [ayvens.be] INFO: Extracting data for car ID: 1985663
2026-03-26 22:57:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e0caed5-1fb6-58fb-a2e6-65e6018b09cf with identifier: 1985663
2026-03-26 22:57:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e0caed5-1fb6-58fb-a2e6-65e6018b09cf with scrape type 1
2026-03-26 22:57:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5e0caed5-1fb6-58fb-a2e6-65e6018b09cf
2026-03-26 22:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F7fa6a60fa545496cb30a760a120599e9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/7fa6a60fa545496cb30a760a120599e9/images/large/1.jpg not downloaded yet
2026-03-26 22:57:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7474a50>
2026-03-26 22:57:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31776f69-743f-5210-afca-b1b6483e3e9e/31776f69-743f-5210-afca-b1b6483e3e9e_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252F1bb291dd2c2b400bada3a7462ba121a7%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/1bb291dd2c2b400bada3a7462ba121a7/images/large/2.jpg saved to cache
2026-03-26 22:57:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 31776f69-743f-5210-afca-b1b6483e3e9e
2026-03-26 22:57:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c5c610>
2026-03-26 22:57:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31776f69-743f-5210-afca-b1b6483e3e9e/31776f69-743f-5210-afca-b1b6483e3e9e_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252F1bb291dd2c2b400bada3a7462ba121a7%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/1bb291dd2c2b400bada3a7462ba121a7/images/large/6.jpg saved to cache
2026-03-26 22:57:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 31776f69-743f-5210-afca-b1b6483e3e9e
2026-03-26 22:57:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cg/1bb291dd2c2b400bada3a7462ba121a7/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/fcb55fc9449a4922add1997cd3957de8/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F7fa6a60fa545496cb30a760a120599e9%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/7fa6a60fa545496cb30a760a120599e9/images/large/2.jpg not downloaded yet
2026-03-26 22:57:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cg/1bb291dd2c2b400bada3a7462ba121a7/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F7fa6a60fa545496cb30a760a120599e9%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/7fa6a60fa545496cb30a760a120599e9/images/large/3.jpg not downloaded yet
2026-03-26 22:57:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cg/1bb291dd2c2b400bada3a7462ba121a7/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/fcb55fc9449a4922add1997cd3957de8/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/fcb55fc9449a4922add1997cd3957de8/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/fcb55fc9449a4922add1997cd3957de8/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7661810>
2026-03-26 22:57:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6d58cdd-aa50-5952-b531-46485dc8de9c/b6d58cdd-aa50-5952-b531-46485dc8de9c_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Ffcb55fc9449a4922add1997cd3957de8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/fcb55fc9449a4922add1997cd3957de8/images/large/1.jpg saved to cache
2026-03-26 22:57:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b6d58cdd-aa50-5952-b531-46485dc8de9c
2026-03-26 22:57:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79f15d0>
2026-03-26 22:57:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6d58cdd-aa50-5952-b531-46485dc8de9c/b6d58cdd-aa50-5952-b531-46485dc8de9c_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Ffcb55fc9449a4922add1997cd3957de8%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/fcb55fc9449a4922add1997cd3957de8/images/large/2.jpg saved to cache
2026-03-26 22:57:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b6d58cdd-aa50-5952-b531-46485dc8de9c
2026-03-26 22:57:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cg/1bb291dd2c2b400bada3a7462ba121a7/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F7fa6a60fa545496cb30a760a120599e9%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/7fa6a60fa545496cb30a760a120599e9/images/large/4.jpg not downloaded yet
2026-03-26 22:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F7fa6a60fa545496cb30a760a120599e9%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/7fa6a60fa545496cb30a760a120599e9/images/large/5.jpg not downloaded yet
2026-03-26 22:57:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7592fd0>
2026-03-26 22:57:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31776f69-743f-5210-afca-b1b6483e3e9e/31776f69-743f-5210-afca-b1b6483e3e9e_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252F1bb291dd2c2b400bada3a7462ba121a7%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/1bb291dd2c2b400bada3a7462ba121a7/images/large/7.jpg saved to cache
2026-03-26 22:57:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 31776f69-743f-5210-afca-b1b6483e3e9e
2026-03-26 22:57:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b14750>
2026-03-26 22:57:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6d58cdd-aa50-5952-b531-46485dc8de9c/b6d58cdd-aa50-5952-b531-46485dc8de9c_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Ffcb55fc9449a4922add1997cd3957de8%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/fcb55fc9449a4922add1997cd3957de8/images/large/3.jpg saved to cache
2026-03-26 22:57:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b6d58cdd-aa50-5952-b531-46485dc8de9c
2026-03-26 22:57:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7449050>
2026-03-26 22:57:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31776f69-743f-5210-afca-b1b6483e3e9e/31776f69-743f-5210-afca-b1b6483e3e9e_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252F1bb291dd2c2b400bada3a7462ba121a7%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/1bb291dd2c2b400bada3a7462ba121a7/images/large/8.jpg saved to cache
2026-03-26 22:57:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 31776f69-743f-5210-afca-b1b6483e3e9e
2026-03-26 22:57:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b746e4d0>
2026-03-26 22:57:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31776f69-743f-5210-afca-b1b6483e3e9e/31776f69-743f-5210-afca-b1b6483e3e9e_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252F1bb291dd2c2b400bada3a7462ba121a7%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/1bb291dd2c2b400bada3a7462ba121a7/images/large/9.jpg saved to cache
2026-03-26 22:57:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 31776f69-743f-5210-afca-b1b6483e3e9e
2026-03-26 22:57:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e29b10>
2026-03-26 22:57:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6d58cdd-aa50-5952-b531-46485dc8de9c/b6d58cdd-aa50-5952-b531-46485dc8de9c_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Ffcb55fc9449a4922add1997cd3957de8%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/fcb55fc9449a4922add1997cd3957de8/images/large/4.jpg saved to cache
2026-03-26 22:57:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b6d58cdd-aa50-5952-b531-46485dc8de9c
2026-03-26 22:57:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7449550>
2026-03-26 22:57:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6d58cdd-aa50-5952-b531-46485dc8de9c/b6d58cdd-aa50-5952-b531-46485dc8de9c_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Ffcb55fc9449a4922add1997cd3957de8%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/fcb55fc9449a4922add1997cd3957de8/images/large/6.jpg saved to cache
2026-03-26 22:57:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b6d58cdd-aa50-5952-b531-46485dc8de9c
2026-03-26 22:57:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7425850>
2026-03-26 22:57:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6d58cdd-aa50-5952-b531-46485dc8de9c/b6d58cdd-aa50-5952-b531-46485dc8de9c_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Ffcb55fc9449a4922add1997cd3957de8%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/fcb55fc9449a4922add1997cd3957de8/images/large/5.jpg saved to cache
2026-03-26 22:57:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b6d58cdd-aa50-5952-b531-46485dc8de9c
2026-03-26 22:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F7fa6a60fa545496cb30a760a120599e9%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/7fa6a60fa545496cb30a760a120599e9/images/large/6.jpg not downloaded yet
2026-03-26 22:57:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7488e90>
2026-03-26 22:57:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31776f69-743f-5210-afca-b1b6483e3e9e/31776f69-743f-5210-afca-b1b6483e3e9e_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252F1bb291dd2c2b400bada3a7462ba121a7%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/1bb291dd2c2b400bada3a7462ba121a7/images/large/10.jpg saved to cache
2026-03-26 22:57:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 31776f69-743f-5210-afca-b1b6483e3e9e
2026-03-26 22:57:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 31776f69-743f-5210-afca-b1b6483e3e9e, skipping ID generation
2026-03-26 22:57:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31776f69-743f-5210-afca-b1b6483e3e9e with scrape type 1
2026-03-26 22:57:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 31776f69-743f-5210-afca-b1b6483e3e9e sending to next pipeline
2026-03-26 22:57:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 31776f69-743f-5210-afca-b1b6483e3e9e, identifier: 1985661
2026-03-26 22:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F7fa6a60fa545496cb30a760a120599e9%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/7fa6a60fa545496cb30a760a120599e9/images/large/7.jpg not downloaded yet
2026-03-26 22:57:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 31776f69-743f-5210-afca-b1b6483e3e9e with identifier: 1985661
2026-03-26 22:57:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 31776f69-743f-5210-afca-b1b6483e3e9e with identifier: 1985661
2026-03-26 22:57:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 31776f69-743f-5210-afca-b1b6483e3e9e with identifier: 1985661 to the API
2026-03-26 22:57:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:57:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:57:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cg/1bb291dd2c2b400bada3a7462ba121a7/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.3L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '31776f69-743f-5210-afca-b1b6483e3e9e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A-CLASS LIMOUSINE',
 'odometer': 140122,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31776f69-743f-5210-afca-b1b6483e3e9e/31776f69-743f-5210-afca-b1b6483e3e9e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 663376,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cg/1bb291dd2c2b400bada3a7462ba121a7/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31776f69-743f-5210-afca-b1b6483e3e9e/31776f69-743f-5210-afca-b1b6483e3e9e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 661632,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cg/1bb291dd2c2b400bada3a7462ba121a7/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31776f69-743f-5210-afca-b1b6483e3e9e/31776f69-743f-5210-afca-b1b6483e3e9e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 655437,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cg/1bb291dd2c2b400bada3a7462ba121a7/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31776f69-743f-5210-afca-b1b6483e3e9e/31776f69-743f-5210-afca-b1b6483e3e9e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 696293,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cg/1bb291dd2c2b400bada3a7462ba121a7/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31776f69-743f-5210-afca-b1b6483e3e9e/31776f69-743f-5210-afca-b1b6483e3e9e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 712212,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cg/1bb291dd2c2b400bada3a7462ba121a7/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31776f69-743f-5210-afca-b1b6483e3e9e/31776f69-743f-5210-afca-b1b6483e3e9e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 734436,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cg/1bb291dd2c2b400bada3a7462ba121a7/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31776f69-743f-5210-afca-b1b6483e3e9e/31776f69-743f-5210-afca-b1b6483e3e9e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 633572,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cg/1bb291dd2c2b400bada3a7462ba121a7/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31776f69-743f-5210-afca-b1b6483e3e9e/31776f69-743f-5210-afca-b1b6483e3e9e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 665756,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cg/1bb291dd2c2b400bada3a7462ba121a7/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31776f69-743f-5210-afca-b1b6483e3e9e/31776f69-743f-5210-afca-b1b6483e3e9e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 728743,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cg/1bb291dd2c2b400bada3a7462ba121a7/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31776f69-743f-5210-afca-b1b6483e3e9e/31776f69-743f-5210-afca-b1b6483e3e9e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 766402,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cg/1bb291dd2c2b400bada3a7462ba121a7/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ A-CLASS LIMOUSINE 1.3 A 250 E BUSINESS SOLUTION DCT',
 'transmission': 'automatic',
 'trim': '1.3 A 250 E BUSINESS SOLUTION DCT',
 'vin': None,
 'year': 2022}
2026-03-26 22:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985661%27 HTTP/1.1" 200 None
2026-03-26 22:57:46 [ayvens.be] INFO: Saving data for 1985661: {'created_time': 1774565866.136462, 'last_price_update_time': 1774565866.136472, 'auction_closing_time': 1774958400.0}
2026-03-26 22:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985661') HTTP/1.1" 204 0
2026-03-26 22:57:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/fcb55fc9449a4922add1997cd3957de8/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/fcb55fc9449a4922add1997cd3957de8/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/fcb55fc9449a4922add1997cd3957de8/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/fcb55fc9449a4922add1997cd3957de8/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F7fa6a60fa545496cb30a760a120599e9%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/7fa6a60fa545496cb30a760a120599e9/images/large/8.jpg not downloaded yet
2026-03-26 22:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F7fa6a60fa545496cb30a760a120599e9%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/7fa6a60fa545496cb30a760a120599e9/images/large/9.jpg not downloaded yet
2026-03-26 22:57:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aj/7fa6a60fa545496cb30a760a120599e9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F7fa6a60fa545496cb30a760a120599e9%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/7fa6a60fa545496cb30a760a120599e9/images/large/10.jpg not downloaded yet
2026-03-26 22:57:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aj/7fa6a60fa545496cb30a760a120599e9/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aj/7fa6a60fa545496cb30a760a120599e9/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:46 [ayvens.be] INFO: Found listing with ID: 1985664
2026-03-26 22:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985664%27 HTTP/1.1" 200 None
2026-03-26 22:57:46 [ayvens.be] INFO: Scrape type for 1985664: 1
2026-03-26 22:57:46 [ayvens.be] INFO: Extracting data for car ID: 1985664
2026-03-26 22:57:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8897836b-5393-5b54-b0d9-9b410fbd8588 with identifier: 1985664
2026-03-26 22:57:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8897836b-5393-5b54-b0d9-9b410fbd8588 with scrape type 1
2026-03-26 22:57:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8897836b-5393-5b54-b0d9-9b410fbd8588
2026-03-26 22:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F27b0b68f9afb401284b1c16c17fe7c68%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/27b0b68f9afb401284b1c16c17fe7c68/images/large/1.jpg not downloaded yet
2026-03-26 22:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F27b0b68f9afb401284b1c16c17fe7c68%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/27b0b68f9afb401284b1c16c17fe7c68/images/large/2.jpg not downloaded yet
2026-03-26 22:57:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aj/7fa6a60fa545496cb30a760a120599e9/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7ca8090>
2026-03-26 22:57:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6d58cdd-aa50-5952-b531-46485dc8de9c/b6d58cdd-aa50-5952-b531-46485dc8de9c_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Ffcb55fc9449a4922add1997cd3957de8%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/fcb55fc9449a4922add1997cd3957de8/images/large/10.jpg saved to cache
2026-03-26 22:57:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b6d58cdd-aa50-5952-b531-46485dc8de9c
2026-03-26 22:57:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c83210>
2026-03-26 22:57:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6d58cdd-aa50-5952-b531-46485dc8de9c/b6d58cdd-aa50-5952-b531-46485dc8de9c_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Ffcb55fc9449a4922add1997cd3957de8%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/fcb55fc9449a4922add1997cd3957de8/images/large/8.jpg saved to cache
2026-03-26 22:57:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b6d58cdd-aa50-5952-b531-46485dc8de9c
2026-03-26 22:57:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c74d10>
2026-03-26 22:57:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6d58cdd-aa50-5952-b531-46485dc8de9c/b6d58cdd-aa50-5952-b531-46485dc8de9c_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Ffcb55fc9449a4922add1997cd3957de8%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/fcb55fc9449a4922add1997cd3957de8/images/large/7.jpg saved to cache
2026-03-26 22:57:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b6d58cdd-aa50-5952-b531-46485dc8de9c
2026-03-26 22:57:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7279050>
2026-03-26 22:57:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6d58cdd-aa50-5952-b531-46485dc8de9c/b6d58cdd-aa50-5952-b531-46485dc8de9c_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Ffcb55fc9449a4922add1997cd3957de8%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/fcb55fc9449a4922add1997cd3957de8/images/large/9.jpg saved to cache
2026-03-26 22:57:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b6d58cdd-aa50-5952-b531-46485dc8de9c
2026-03-26 22:57:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b6d58cdd-aa50-5952-b531-46485dc8de9c, skipping ID generation
2026-03-26 22:57:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6d58cdd-aa50-5952-b531-46485dc8de9c with scrape type 1
2026-03-26 22:57:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b6d58cdd-aa50-5952-b531-46485dc8de9c sending to next pipeline
2026-03-26 22:57:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b6d58cdd-aa50-5952-b531-46485dc8de9c, identifier: 1985662
2026-03-26 22:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F27b0b68f9afb401284b1c16c17fe7c68%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/27b0b68f9afb401284b1c16c17fe7c68/images/large/3.jpg not downloaded yet
2026-03-26 22:57:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b6d58cdd-aa50-5952-b531-46485dc8de9c with identifier: 1985662
2026-03-26 22:57:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b6d58cdd-aa50-5952-b531-46485dc8de9c with identifier: 1985662
2026-03-26 22:57:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b6d58cdd-aa50-5952-b531-46485dc8de9c with identifier: 1985662 to the API
2026-03-26 22:57:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:57:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:57:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bv/fcb55fc9449a4922add1997cd3957de8/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b6d58cdd-aa50-5952-b531-46485dc8de9c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 79497,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6d58cdd-aa50-5952-b531-46485dc8de9c/b6d58cdd-aa50-5952-b531-46485dc8de9c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 224693,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/fcb55fc9449a4922add1997cd3957de8/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6d58cdd-aa50-5952-b531-46485dc8de9c/b6d58cdd-aa50-5952-b531-46485dc8de9c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 236656,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/fcb55fc9449a4922add1997cd3957de8/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6d58cdd-aa50-5952-b531-46485dc8de9c/b6d58cdd-aa50-5952-b531-46485dc8de9c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 260312,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/fcb55fc9449a4922add1997cd3957de8/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6d58cdd-aa50-5952-b531-46485dc8de9c/b6d58cdd-aa50-5952-b531-46485dc8de9c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 245614,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/fcb55fc9449a4922add1997cd3957de8/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6d58cdd-aa50-5952-b531-46485dc8de9c/b6d58cdd-aa50-5952-b531-46485dc8de9c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 255838,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/fcb55fc9449a4922add1997cd3957de8/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6d58cdd-aa50-5952-b531-46485dc8de9c/b6d58cdd-aa50-5952-b531-46485dc8de9c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 244865,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/fcb55fc9449a4922add1997cd3957de8/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6d58cdd-aa50-5952-b531-46485dc8de9c/b6d58cdd-aa50-5952-b531-46485dc8de9c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 289952,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/fcb55fc9449a4922add1997cd3957de8/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6d58cdd-aa50-5952-b531-46485dc8de9c/b6d58cdd-aa50-5952-b531-46485dc8de9c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 269535,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/fcb55fc9449a4922add1997cd3957de8/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6d58cdd-aa50-5952-b531-46485dc8de9c/b6d58cdd-aa50-5952-b531-46485dc8de9c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 265954,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/fcb55fc9449a4922add1997cd3957de8/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6d58cdd-aa50-5952-b531-46485dc8de9c/b6d58cdd-aa50-5952-b531-46485dc8de9c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 226616,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/fcb55fc9449a4922add1997cd3957de8/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 1.5 SDRIVE16D',
 'transmission': 'manual',
 'trim': '1.5 SDRIVE16D',
 'vin': None,
 'year': 2022}
2026-03-26 22:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985662%27 HTTP/1.1" 200 None
2026-03-26 22:57:46 [ayvens.be] INFO: Saving data for 1985662: {'created_time': 1774565866.987224, 'last_price_update_time': 1774565866.987235, 'auction_closing_time': 1774958400.0}
2026-03-26 22:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985662') HTTP/1.1" 204 0
2026-03-26 22:57:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7497dd0>
2026-03-26 22:57:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e0caed5-1fb6-58fb-a2e6-65e6018b09cf/5e0caed5-1fb6-58fb-a2e6-65e6018b09cf_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:57:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F7fa6a60fa545496cb30a760a120599e9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/7fa6a60fa545496cb30a760a120599e9/images/large/1.jpg saved to cache
2026-03-26 22:57:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5e0caed5-1fb6-58fb-a2e6-65e6018b09cf
2026-03-26 22:57:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F27b0b68f9afb401284b1c16c17fe7c68%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/27b0b68f9afb401284b1c16c17fe7c68/images/large/4.jpg not downloaded yet
2026-03-26 22:57:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7caa650>
2026-03-26 22:57:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e0caed5-1fb6-58fb-a2e6-65e6018b09cf/5e0caed5-1fb6-58fb-a2e6-65e6018b09cf_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:57:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F7fa6a60fa545496cb30a760a120599e9%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/7fa6a60fa545496cb30a760a120599e9/images/large/2.jpg saved to cache
2026-03-26 22:57:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5e0caed5-1fb6-58fb-a2e6-65e6018b09cf
2026-03-26 22:57:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76ceb90>
2026-03-26 22:57:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e0caed5-1fb6-58fb-a2e6-65e6018b09cf/5e0caed5-1fb6-58fb-a2e6-65e6018b09cf_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:57:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F7fa6a60fa545496cb30a760a120599e9%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/7fa6a60fa545496cb30a760a120599e9/images/large/3.jpg saved to cache
2026-03-26 22:57:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5e0caed5-1fb6-58fb-a2e6-65e6018b09cf
2026-03-26 22:57:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b768b2d0>
2026-03-26 22:57:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e0caed5-1fb6-58fb-a2e6-65e6018b09cf/5e0caed5-1fb6-58fb-a2e6-65e6018b09cf_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:57:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F7fa6a60fa545496cb30a760a120599e9%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/7fa6a60fa545496cb30a760a120599e9/images/large/4.jpg saved to cache
2026-03-26 22:57:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5e0caed5-1fb6-58fb-a2e6-65e6018b09cf
2026-03-26 22:57:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F27b0b68f9afb401284b1c16c17fe7c68%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/27b0b68f9afb401284b1c16c17fe7c68/images/large/5.jpg not downloaded yet
2026-03-26 22:57:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/27b0b68f9afb401284b1c16c17fe7c68/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F27b0b68f9afb401284b1c16c17fe7c68%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/27b0b68f9afb401284b1c16c17fe7c68/images/large/6.jpg not downloaded yet
2026-03-26 22:57:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/27b0b68f9afb401284b1c16c17fe7c68/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aj/7fa6a60fa545496cb30a760a120599e9/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aj/7fa6a60fa545496cb30a760a120599e9/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F27b0b68f9afb401284b1c16c17fe7c68%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/27b0b68f9afb401284b1c16c17fe7c68/images/large/7.jpg not downloaded yet
2026-03-26 22:57:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aj/7fa6a60fa545496cb30a760a120599e9/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aj/7fa6a60fa545496cb30a760a120599e9/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aj/7fa6a60fa545496cb30a760a120599e9/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aj/7fa6a60fa545496cb30a760a120599e9/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F27b0b68f9afb401284b1c16c17fe7c68%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/27b0b68f9afb401284b1c16c17fe7c68/images/large/8.jpg not downloaded yet
2026-03-26 22:57:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F27b0b68f9afb401284b1c16c17fe7c68%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/27b0b68f9afb401284b1c16c17fe7c68/images/large/9.jpg not downloaded yet
2026-03-26 22:57:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F27b0b68f9afb401284b1c16c17fe7c68%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/27b0b68f9afb401284b1c16c17fe7c68/images/large/10.jpg not downloaded yet
2026-03-26 22:57:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/27b0b68f9afb401284b1c16c17fe7c68/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:47 [ayvens.be] INFO: Found listing with ID: 1985665
2026-03-26 22:57:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985665%27 HTTP/1.1" 200 None
2026-03-26 22:57:47 [ayvens.be] INFO: Scrape type for 1985665: 1
2026-03-26 22:57:47 [ayvens.be] INFO: Extracting data for car ID: 1985665
2026-03-26 22:57:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a86c029b-7f83-5f8f-b81d-a7e0e4164053 with identifier: 1985665
2026-03-26 22:57:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a86c029b-7f83-5f8f-b81d-a7e0e4164053 with scrape type 1
2026-03-26 22:57:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a86c029b-7f83-5f8f-b81d-a7e0e4164053
2026-03-26 22:57:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Fb374861f6715435a8beec443b89b0423%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/b374861f6715435a8beec443b89b0423/images/large/1.jpg not downloaded yet
2026-03-26 22:57:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/27b0b68f9afb401284b1c16c17fe7c68/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74e7d90>
2026-03-26 22:57:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8897836b-5393-5b54-b0d9-9b410fbd8588/8897836b-5393-5b54-b0d9-9b410fbd8588_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:57:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F27b0b68f9afb401284b1c16c17fe7c68%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/27b0b68f9afb401284b1c16c17fe7c68/images/large/1.jpg saved to cache
2026-03-26 22:57:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8897836b-5393-5b54-b0d9-9b410fbd8588
2026-03-26 22:57:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Fb374861f6715435a8beec443b89b0423%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/b374861f6715435a8beec443b89b0423/images/large/2.jpg not downloaded yet
2026-03-26 22:57:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c6b490>
2026-03-26 22:57:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8897836b-5393-5b54-b0d9-9b410fbd8588/8897836b-5393-5b54-b0d9-9b410fbd8588_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:57:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F27b0b68f9afb401284b1c16c17fe7c68%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/27b0b68f9afb401284b1c16c17fe7c68/images/large/2.jpg saved to cache
2026-03-26 22:57:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8897836b-5393-5b54-b0d9-9b410fbd8588
2026-03-26 22:57:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e34b50>
2026-03-26 22:57:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e0caed5-1fb6-58fb-a2e6-65e6018b09cf/5e0caed5-1fb6-58fb-a2e6-65e6018b09cf_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:57:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F7fa6a60fa545496cb30a760a120599e9%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/7fa6a60fa545496cb30a760a120599e9/images/large/8.jpg saved to cache
2026-03-26 22:57:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5e0caed5-1fb6-58fb-a2e6-65e6018b09cf
2026-03-26 22:57:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7403290>
2026-03-26 22:57:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e0caed5-1fb6-58fb-a2e6-65e6018b09cf/5e0caed5-1fb6-58fb-a2e6-65e6018b09cf_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F7fa6a60fa545496cb30a760a120599e9%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/7fa6a60fa545496cb30a760a120599e9/images/large/5.jpg saved to cache
2026-03-26 22:57:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5e0caed5-1fb6-58fb-a2e6-65e6018b09cf
2026-03-26 22:57:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e372d0>
2026-03-26 22:57:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e0caed5-1fb6-58fb-a2e6-65e6018b09cf/5e0caed5-1fb6-58fb-a2e6-65e6018b09cf_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F7fa6a60fa545496cb30a760a120599e9%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/7fa6a60fa545496cb30a760a120599e9/images/large/10.jpg saved to cache
2026-03-26 22:57:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5e0caed5-1fb6-58fb-a2e6-65e6018b09cf
2026-03-26 22:57:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b32bd0>
2026-03-26 22:57:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e0caed5-1fb6-58fb-a2e6-65e6018b09cf/5e0caed5-1fb6-58fb-a2e6-65e6018b09cf_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F7fa6a60fa545496cb30a760a120599e9%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/7fa6a60fa545496cb30a760a120599e9/images/large/9.jpg saved to cache
2026-03-26 22:57:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5e0caed5-1fb6-58fb-a2e6-65e6018b09cf
2026-03-26 22:57:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b402d0>
2026-03-26 22:57:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e0caed5-1fb6-58fb-a2e6-65e6018b09cf/5e0caed5-1fb6-58fb-a2e6-65e6018b09cf_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F7fa6a60fa545496cb30a760a120599e9%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/7fa6a60fa545496cb30a760a120599e9/images/large/6.jpg saved to cache
2026-03-26 22:57:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5e0caed5-1fb6-58fb-a2e6-65e6018b09cf
2026-03-26 22:57:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e37510>
2026-03-26 22:57:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e0caed5-1fb6-58fb-a2e6-65e6018b09cf/5e0caed5-1fb6-58fb-a2e6-65e6018b09cf_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F7fa6a60fa545496cb30a760a120599e9%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/7fa6a60fa545496cb30a760a120599e9/images/large/7.jpg saved to cache
2026-03-26 22:57:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5e0caed5-1fb6-58fb-a2e6-65e6018b09cf
2026-03-26 22:57:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5e0caed5-1fb6-58fb-a2e6-65e6018b09cf, skipping ID generation
2026-03-26 22:57:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e0caed5-1fb6-58fb-a2e6-65e6018b09cf with scrape type 1
2026-03-26 22:57:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5e0caed5-1fb6-58fb-a2e6-65e6018b09cf sending to next pipeline
2026-03-26 22:57:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 5e0caed5-1fb6-58fb-a2e6-65e6018b09cf, identifier: 1985663
2026-03-26 22:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Fb374861f6715435a8beec443b89b0423%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/b374861f6715435a8beec443b89b0423/images/large/3.jpg not downloaded yet
2026-03-26 22:57:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 5e0caed5-1fb6-58fb-a2e6-65e6018b09cf with identifier: 1985663
2026-03-26 22:57:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 5e0caed5-1fb6-58fb-a2e6-65e6018b09cf with identifier: 1985663
2026-03-26 22:57:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 5e0caed5-1fb6-58fb-a2e6-65e6018b09cf with identifier: 1985663 to the API
2026-03-26 22:57:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:57:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:57:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2aj/7fa6a60fa545496cb30a760a120599e9/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '5e0caed5-1fb6-58fb-a2e6-65e6018b09cf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X2',
 'odometer': 121863,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e0caed5-1fb6-58fb-a2e6-65e6018b09cf/5e0caed5-1fb6-58fb-a2e6-65e6018b09cf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 631394,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aj/7fa6a60fa545496cb30a760a120599e9/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e0caed5-1fb6-58fb-a2e6-65e6018b09cf/5e0caed5-1fb6-58fb-a2e6-65e6018b09cf_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 643238,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aj/7fa6a60fa545496cb30a760a120599e9/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e0caed5-1fb6-58fb-a2e6-65e6018b09cf/5e0caed5-1fb6-58fb-a2e6-65e6018b09cf_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 669461,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aj/7fa6a60fa545496cb30a760a120599e9/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e0caed5-1fb6-58fb-a2e6-65e6018b09cf/5e0caed5-1fb6-58fb-a2e6-65e6018b09cf_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 686253,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aj/7fa6a60fa545496cb30a760a120599e9/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e0caed5-1fb6-58fb-a2e6-65e6018b09cf/5e0caed5-1fb6-58fb-a2e6-65e6018b09cf_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 551475,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aj/7fa6a60fa545496cb30a760a120599e9/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e0caed5-1fb6-58fb-a2e6-65e6018b09cf/5e0caed5-1fb6-58fb-a2e6-65e6018b09cf_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 614824,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aj/7fa6a60fa545496cb30a760a120599e9/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e0caed5-1fb6-58fb-a2e6-65e6018b09cf/5e0caed5-1fb6-58fb-a2e6-65e6018b09cf_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 596101,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aj/7fa6a60fa545496cb30a760a120599e9/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e0caed5-1fb6-58fb-a2e6-65e6018b09cf/5e0caed5-1fb6-58fb-a2e6-65e6018b09cf_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 678121,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aj/7fa6a60fa545496cb30a760a120599e9/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e0caed5-1fb6-58fb-a2e6-65e6018b09cf/5e0caed5-1fb6-58fb-a2e6-65e6018b09cf_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 567436,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aj/7fa6a60fa545496cb30a760a120599e9/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e0caed5-1fb6-58fb-a2e6-65e6018b09cf/5e0caed5-1fb6-58fb-a2e6-65e6018b09cf_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 539983,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aj/7fa6a60fa545496cb30a760a120599e9/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X2 1.5iA xDrive25e PHEV OPF',
 'transmission': 'automatic',
 'trim': '1.5iA xDrive25e PHEV OPF',
 'vin': None,
 'year': 2021}
2026-03-26 22:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985663%27 HTTP/1.1" 200 None
2026-03-26 22:57:48 [ayvens.be] INFO: Saving data for 1985663: {'created_time': 1774565868.770496, 'last_price_update_time': 1774565868.770511, 'auction_closing_time': 1774958400.0}
2026-03-26 22:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985663') HTTP/1.1" 204 0
2026-03-26 22:57:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7401c10>
2026-03-26 22:57:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8897836b-5393-5b54-b0d9-9b410fbd8588/8897836b-5393-5b54-b0d9-9b410fbd8588_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F27b0b68f9afb401284b1c16c17fe7c68%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/27b0b68f9afb401284b1c16c17fe7c68/images/large/3.jpg saved to cache
2026-03-26 22:57:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8897836b-5393-5b54-b0d9-9b410fbd8588
2026-03-26 22:57:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7dd1950>
2026-03-26 22:57:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8897836b-5393-5b54-b0d9-9b410fbd8588/8897836b-5393-5b54-b0d9-9b410fbd8588_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F27b0b68f9afb401284b1c16c17fe7c68%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/27b0b68f9afb401284b1c16c17fe7c68/images/large/4.jpg saved to cache
2026-03-26 22:57:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8897836b-5393-5b54-b0d9-9b410fbd8588
2026-03-26 22:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Fb374861f6715435a8beec443b89b0423%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/b374861f6715435a8beec443b89b0423/images/large/4.jpg not downloaded yet
2026-03-26 22:57:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/27b0b68f9afb401284b1c16c17fe7c68/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/27b0b68f9afb401284b1c16c17fe7c68/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/27b0b68f9afb401284b1c16c17fe7c68/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/27b0b68f9afb401284b1c16c17fe7c68/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/27b0b68f9afb401284b1c16c17fe7c68/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Fb374861f6715435a8beec443b89b0423%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/b374861f6715435a8beec443b89b0423/images/large/5.jpg not downloaded yet
2026-03-26 22:57:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/27b0b68f9afb401284b1c16c17fe7c68/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/b374861f6715435a8beec443b89b0423/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Fb374861f6715435a8beec443b89b0423%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/b374861f6715435a8beec443b89b0423/images/large/6.jpg not downloaded yet
2026-03-26 22:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Fb374861f6715435a8beec443b89b0423%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/b374861f6715435a8beec443b89b0423/images/large/7.jpg not downloaded yet
2026-03-26 22:57:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Fb374861f6715435a8beec443b89b0423%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/b374861f6715435a8beec443b89b0423/images/large/8.jpg not downloaded yet
2026-03-26 22:57:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Fb374861f6715435a8beec443b89b0423%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/b374861f6715435a8beec443b89b0423/images/large/9.jpg not downloaded yet
2026-03-26 22:57:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Fb374861f6715435a8beec443b89b0423%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/b374861f6715435a8beec443b89b0423/images/large/10.jpg not downloaded yet
2026-03-26 22:57:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7ddf6d0>
2026-03-26 22:57:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8897836b-5393-5b54-b0d9-9b410fbd8588/8897836b-5393-5b54-b0d9-9b410fbd8588_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:57:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F27b0b68f9afb401284b1c16c17fe7c68%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/27b0b68f9afb401284b1c16c17fe7c68/images/large/5.jpg saved to cache
2026-03-26 22:57:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8897836b-5393-5b54-b0d9-9b410fbd8588
2026-03-26 22:57:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e00810>
2026-03-26 22:57:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8897836b-5393-5b54-b0d9-9b410fbd8588/8897836b-5393-5b54-b0d9-9b410fbd8588_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:57:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F27b0b68f9afb401284b1c16c17fe7c68%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/27b0b68f9afb401284b1c16c17fe7c68/images/large/8.jpg saved to cache
2026-03-26 22:57:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8897836b-5393-5b54-b0d9-9b410fbd8588
2026-03-26 22:57:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e4c150>
2026-03-26 22:57:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8897836b-5393-5b54-b0d9-9b410fbd8588/8897836b-5393-5b54-b0d9-9b410fbd8588_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:57:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F27b0b68f9afb401284b1c16c17fe7c68%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/27b0b68f9afb401284b1c16c17fe7c68/images/large/7.jpg saved to cache
2026-03-26 22:57:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8897836b-5393-5b54-b0d9-9b410fbd8588
2026-03-26 22:57:49 [ayvens.be] INFO: Found listing with ID: 1985666
2026-03-26 22:57:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985666%27 HTTP/1.1" 200 None
2026-03-26 22:57:49 [ayvens.be] INFO: Scrape type for 1985666: 1
2026-03-26 22:57:49 [ayvens.be] INFO: Extracting data for car ID: 1985666
2026-03-26 22:57:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7320108-93e1-5815-b2ae-f9adc20ddb67 with identifier: 1985666
2026-03-26 22:57:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7320108-93e1-5815-b2ae-f9adc20ddb67 with scrape type 1
2026-03-26 22:57:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a7320108-93e1-5815-b2ae-f9adc20ddb67
2026-03-26 22:57:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F7f2f7cdf758e4babae80469f65f05b24%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/7f2f7cdf758e4babae80469f65f05b24/images/large/1.jpg not downloaded yet
2026-03-26 22:57:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/b374861f6715435a8beec443b89b0423/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/b374861f6715435a8beec443b89b0423/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F7f2f7cdf758e4babae80469f65f05b24%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/7f2f7cdf758e4babae80469f65f05b24/images/large/2.jpg not downloaded yet
2026-03-26 22:57:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b764b890>
2026-03-26 22:57:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8897836b-5393-5b54-b0d9-9b410fbd8588/8897836b-5393-5b54-b0d9-9b410fbd8588_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:57:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F27b0b68f9afb401284b1c16c17fe7c68%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/27b0b68f9afb401284b1c16c17fe7c68/images/large/6.jpg saved to cache
2026-03-26 22:57:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8897836b-5393-5b54-b0d9-9b410fbd8588
2026-03-26 22:57:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6dec250>
2026-03-26 22:57:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8897836b-5393-5b54-b0d9-9b410fbd8588/8897836b-5393-5b54-b0d9-9b410fbd8588_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:57:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F27b0b68f9afb401284b1c16c17fe7c68%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/27b0b68f9afb401284b1c16c17fe7c68/images/large/9.jpg saved to cache
2026-03-26 22:57:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8897836b-5393-5b54-b0d9-9b410fbd8588
2026-03-26 22:57:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7a629d0>
2026-03-26 22:57:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8897836b-5393-5b54-b0d9-9b410fbd8588/8897836b-5393-5b54-b0d9-9b410fbd8588_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:57:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F27b0b68f9afb401284b1c16c17fe7c68%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/27b0b68f9afb401284b1c16c17fe7c68/images/large/10.jpg saved to cache
2026-03-26 22:57:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8897836b-5393-5b54-b0d9-9b410fbd8588
2026-03-26 22:57:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8897836b-5393-5b54-b0d9-9b410fbd8588, skipping ID generation
2026-03-26 22:57:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8897836b-5393-5b54-b0d9-9b410fbd8588 with scrape type 1
2026-03-26 22:57:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8897836b-5393-5b54-b0d9-9b410fbd8588 sending to next pipeline
2026-03-26 22:57:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 8897836b-5393-5b54-b0d9-9b410fbd8588, identifier: 1985664
2026-03-26 22:57:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c5e090>
2026-03-26 22:57:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a86c029b-7f83-5f8f-b81d-a7e0e4164053/a86c029b-7f83-5f8f-b81d-a7e0e4164053_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:57:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Fb374861f6715435a8beec443b89b0423%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/b374861f6715435a8beec443b89b0423/images/large/1.jpg saved to cache
2026-03-26 22:57:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a86c029b-7f83-5f8f-b81d-a7e0e4164053
2026-03-26 22:57:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 8897836b-5393-5b54-b0d9-9b410fbd8588 with identifier: 1985664
2026-03-26 22:57:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 8897836b-5393-5b54-b0d9-9b410fbd8588 with identifier: 1985664
2026-03-26 22:57:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 8897836b-5393-5b54-b0d9-9b410fbd8588 with identifier: 1985664 to the API
2026-03-26 22:57:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:57:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:57:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2dl/27b0b68f9afb401284b1c16c17fe7c68/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '8897836b-5393-5b54-b0d9-9b410fbd8588',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'MINI',
 'model': 'COUNTRYMAN',
 'odometer': 101953,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8897836b-5393-5b54-b0d9-9b410fbd8588/8897836b-5393-5b54-b0d9-9b410fbd8588_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 257725,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/27b0b68f9afb401284b1c16c17fe7c68/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8897836b-5393-5b54-b0d9-9b410fbd8588/8897836b-5393-5b54-b0d9-9b410fbd8588_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 242004,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/27b0b68f9afb401284b1c16c17fe7c68/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8897836b-5393-5b54-b0d9-9b410fbd8588/8897836b-5393-5b54-b0d9-9b410fbd8588_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 262753,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/27b0b68f9afb401284b1c16c17fe7c68/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8897836b-5393-5b54-b0d9-9b410fbd8588/8897836b-5393-5b54-b0d9-9b410fbd8588_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 258951,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/27b0b68f9afb401284b1c16c17fe7c68/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8897836b-5393-5b54-b0d9-9b410fbd8588/8897836b-5393-5b54-b0d9-9b410fbd8588_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 359636,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/27b0b68f9afb401284b1c16c17fe7c68/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8897836b-5393-5b54-b0d9-9b410fbd8588/8897836b-5393-5b54-b0d9-9b410fbd8588_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 311667,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/27b0b68f9afb401284b1c16c17fe7c68/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8897836b-5393-5b54-b0d9-9b410fbd8588/8897836b-5393-5b54-b0d9-9b410fbd8588_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 346247,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/27b0b68f9afb401284b1c16c17fe7c68/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8897836b-5393-5b54-b0d9-9b410fbd8588/8897836b-5393-5b54-b0d9-9b410fbd8588_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 349855,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/27b0b68f9afb401284b1c16c17fe7c68/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8897836b-5393-5b54-b0d9-9b410fbd8588/8897836b-5393-5b54-b0d9-9b410fbd8588_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 398353,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/27b0b68f9afb401284b1c16c17fe7c68/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8897836b-5393-5b54-b0d9-9b410fbd8588/8897836b-5393-5b54-b0d9-9b410fbd8588_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 330429,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/27b0b68f9afb401284b1c16c17fe7c68/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-04-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI COUNTRYMAN 1.5 COOPER S E 4WD AUTO',
 'transmission': 'automatic',
 'trim': '1.5 COOPER S E 4WD AUTO',
 'vin': None,
 'year': 2023}
2026-03-26 22:57:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985664%27 HTTP/1.1" 200 None
2026-03-26 22:57:50 [ayvens.be] INFO: Saving data for 1985664: {'created_time': 1774565870.315604, 'last_price_update_time': 1774565870.315616, 'auction_closing_time': 1774958400.0}
2026-03-26 22:57:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985664') HTTP/1.1" 204 0
2026-03-26 22:57:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/b374861f6715435a8beec443b89b0423/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/b374861f6715435a8beec443b89b0423/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/b374861f6715435a8beec443b89b0423/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/b374861f6715435a8beec443b89b0423/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F7f2f7cdf758e4babae80469f65f05b24%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/7f2f7cdf758e4babae80469f65f05b24/images/large/3.jpg not downloaded yet
2026-03-26 22:57:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/b374861f6715435a8beec443b89b0423/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd3bbd10>
2026-03-26 22:57:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a86c029b-7f83-5f8f-b81d-a7e0e4164053/a86c029b-7f83-5f8f-b81d-a7e0e4164053_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:57:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Fb374861f6715435a8beec443b89b0423%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/b374861f6715435a8beec443b89b0423/images/large/2.jpg saved to cache
2026-03-26 22:57:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a86c029b-7f83-5f8f-b81d-a7e0e4164053
2026-03-26 22:57:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76a5490>
2026-03-26 22:57:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a86c029b-7f83-5f8f-b81d-a7e0e4164053/a86c029b-7f83-5f8f-b81d-a7e0e4164053_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:57:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Fb374861f6715435a8beec443b89b0423%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/b374861f6715435a8beec443b89b0423/images/large/3.jpg saved to cache
2026-03-26 22:57:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a86c029b-7f83-5f8f-b81d-a7e0e4164053
2026-03-26 22:57:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F7f2f7cdf758e4babae80469f65f05b24%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/7f2f7cdf758e4babae80469f65f05b24/images/large/4.jpg not downloaded yet
2026-03-26 22:57:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/b374861f6715435a8beec443b89b0423/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F7f2f7cdf758e4babae80469f65f05b24%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/7f2f7cdf758e4babae80469f65f05b24/images/large/5.jpg not downloaded yet
2026-03-26 22:57:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b78c2e90>
2026-03-26 22:57:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a86c029b-7f83-5f8f-b81d-a7e0e4164053/a86c029b-7f83-5f8f-b81d-a7e0e4164053_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:57:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Fb374861f6715435a8beec443b89b0423%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/b374861f6715435a8beec443b89b0423/images/large/4.jpg saved to cache
2026-03-26 22:57:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a86c029b-7f83-5f8f-b81d-a7e0e4164053
2026-03-26 22:57:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77cb1d0>
2026-03-26 22:57:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a86c029b-7f83-5f8f-b81d-a7e0e4164053/a86c029b-7f83-5f8f-b81d-a7e0e4164053_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:57:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Fb374861f6715435a8beec443b89b0423%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/b374861f6715435a8beec443b89b0423/images/large/5.jpg saved to cache
2026-03-26 22:57:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a86c029b-7f83-5f8f-b81d-a7e0e4164053
2026-03-26 22:57:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7279b10>
2026-03-26 22:57:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a86c029b-7f83-5f8f-b81d-a7e0e4164053/a86c029b-7f83-5f8f-b81d-a7e0e4164053_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:57:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Fb374861f6715435a8beec443b89b0423%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/b374861f6715435a8beec443b89b0423/images/large/6.jpg saved to cache
2026-03-26 22:57:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a86c029b-7f83-5f8f-b81d-a7e0e4164053
2026-03-26 22:57:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77c8250>
2026-03-26 22:57:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a86c029b-7f83-5f8f-b81d-a7e0e4164053/a86c029b-7f83-5f8f-b81d-a7e0e4164053_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:57:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Fb374861f6715435a8beec443b89b0423%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/b374861f6715435a8beec443b89b0423/images/large/8.jpg saved to cache
2026-03-26 22:57:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a86c029b-7f83-5f8f-b81d-a7e0e4164053
2026-03-26 22:57:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b792c910>
2026-03-26 22:57:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a86c029b-7f83-5f8f-b81d-a7e0e4164053/a86c029b-7f83-5f8f-b81d-a7e0e4164053_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:57:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Fb374861f6715435a8beec443b89b0423%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/b374861f6715435a8beec443b89b0423/images/large/7.jpg saved to cache
2026-03-26 22:57:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a86c029b-7f83-5f8f-b81d-a7e0e4164053
2026-03-26 22:57:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/b374861f6715435a8beec443b89b0423/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/7f2f7cdf758e4babae80469f65f05b24/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F7f2f7cdf758e4babae80469f65f05b24%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/7f2f7cdf758e4babae80469f65f05b24/images/large/6.jpg not downloaded yet
2026-03-26 22:57:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74aed10>
2026-03-26 22:57:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a86c029b-7f83-5f8f-b81d-a7e0e4164053/a86c029b-7f83-5f8f-b81d-a7e0e4164053_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:57:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Fb374861f6715435a8beec443b89b0423%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/b374861f6715435a8beec443b89b0423/images/large/9.jpg saved to cache
2026-03-26 22:57:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a86c029b-7f83-5f8f-b81d-a7e0e4164053
2026-03-26 22:57:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F7f2f7cdf758e4babae80469f65f05b24%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/7f2f7cdf758e4babae80469f65f05b24/images/large/7.jpg not downloaded yet
2026-03-26 22:57:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/7f2f7cdf758e4babae80469f65f05b24/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/7f2f7cdf758e4babae80469f65f05b24/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F7f2f7cdf758e4babae80469f65f05b24%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/7f2f7cdf758e4babae80469f65f05b24/images/large/8.jpg not downloaded yet
2026-03-26 22:57:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7482b10>
2026-03-26 22:57:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a86c029b-7f83-5f8f-b81d-a7e0e4164053/a86c029b-7f83-5f8f-b81d-a7e0e4164053_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:57:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Fb374861f6715435a8beec443b89b0423%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/b374861f6715435a8beec443b89b0423/images/large/10.jpg saved to cache
2026-03-26 22:57:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a86c029b-7f83-5f8f-b81d-a7e0e4164053
2026-03-26 22:57:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a86c029b-7f83-5f8f-b81d-a7e0e4164053, skipping ID generation
2026-03-26 22:57:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a86c029b-7f83-5f8f-b81d-a7e0e4164053 with scrape type 1
2026-03-26 22:57:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a86c029b-7f83-5f8f-b81d-a7e0e4164053 sending to next pipeline
2026-03-26 22:57:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a86c029b-7f83-5f8f-b81d-a7e0e4164053, identifier: 1985665
2026-03-26 22:57:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74ac890>
2026-03-26 22:57:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7320108-93e1-5815-b2ae-f9adc20ddb67/a7320108-93e1-5815-b2ae-f9adc20ddb67_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:57:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F7f2f7cdf758e4babae80469f65f05b24%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/7f2f7cdf758e4babae80469f65f05b24/images/large/1.jpg saved to cache
2026-03-26 22:57:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a7320108-93e1-5815-b2ae-f9adc20ddb67
2026-03-26 22:57:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F7f2f7cdf758e4babae80469f65f05b24%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/7f2f7cdf758e4babae80469f65f05b24/images/large/9.jpg not downloaded yet
2026-03-26 22:57:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a86c029b-7f83-5f8f-b81d-a7e0e4164053 with identifier: 1985665
2026-03-26 22:57:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a86c029b-7f83-5f8f-b81d-a7e0e4164053 with identifier: 1985665
2026-03-26 22:57:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a86c029b-7f83-5f8f-b81d-a7e0e4164053 with identifier: 1985665 to the API
2026-03-26 22:57:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:57:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:57:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ae/b374861f6715435a8beec443b89b0423/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'a86c029b-7f83-5f8f-b81d-a7e0e4164053',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 93071,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a86c029b-7f83-5f8f-b81d-a7e0e4164053/a86c029b-7f83-5f8f-b81d-a7e0e4164053_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 262524,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/b374861f6715435a8beec443b89b0423/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a86c029b-7f83-5f8f-b81d-a7e0e4164053/a86c029b-7f83-5f8f-b81d-a7e0e4164053_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 268706,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/b374861f6715435a8beec443b89b0423/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a86c029b-7f83-5f8f-b81d-a7e0e4164053/a86c029b-7f83-5f8f-b81d-a7e0e4164053_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 304445,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/b374861f6715435a8beec443b89b0423/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a86c029b-7f83-5f8f-b81d-a7e0e4164053/a86c029b-7f83-5f8f-b81d-a7e0e4164053_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 283608,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/b374861f6715435a8beec443b89b0423/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a86c029b-7f83-5f8f-b81d-a7e0e4164053/a86c029b-7f83-5f8f-b81d-a7e0e4164053_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 251024,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/b374861f6715435a8beec443b89b0423/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a86c029b-7f83-5f8f-b81d-a7e0e4164053/a86c029b-7f83-5f8f-b81d-a7e0e4164053_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 198877,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/b374861f6715435a8beec443b89b0423/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a86c029b-7f83-5f8f-b81d-a7e0e4164053/a86c029b-7f83-5f8f-b81d-a7e0e4164053_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 303984,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/b374861f6715435a8beec443b89b0423/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a86c029b-7f83-5f8f-b81d-a7e0e4164053/a86c029b-7f83-5f8f-b81d-a7e0e4164053_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 249087,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/b374861f6715435a8beec443b89b0423/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a86c029b-7f83-5f8f-b81d-a7e0e4164053/a86c029b-7f83-5f8f-b81d-a7e0e4164053_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 278799,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/b374861f6715435a8beec443b89b0423/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a86c029b-7f83-5f8f-b81d-a7e0e4164053/a86c029b-7f83-5f8f-b81d-a7e0e4164053_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 309211,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/b374861f6715435a8beec443b89b0423/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T5 RECHARGE GEARTR. INSCRIPTION EXPR',
 'transmission': 'automatic',
 'trim': '1.5 T5 RECHARGE GEARTR. INSCRIPTION EXPR',
 'vin': None,
 'year': 2021}
2026-03-26 22:57:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985665%27 HTTP/1.1" 200 None
2026-03-26 22:57:51 [ayvens.be] INFO: Saving data for 1985665: {'created_time': 1774565871.686499, 'last_price_update_time': 1774565871.686508, 'auction_closing_time': 1774958400.0}
2026-03-26 22:57:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985665') HTTP/1.1" 204 0
2026-03-26 22:57:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F7f2f7cdf758e4babae80469f65f05b24%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/7f2f7cdf758e4babae80469f65f05b24/images/large/10.jpg not downloaded yet
2026-03-26 22:57:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7ccf410>
2026-03-26 22:57:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7320108-93e1-5815-b2ae-f9adc20ddb67/a7320108-93e1-5815-b2ae-f9adc20ddb67_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:57:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F7f2f7cdf758e4babae80469f65f05b24%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/7f2f7cdf758e4babae80469f65f05b24/images/large/2.jpg saved to cache
2026-03-26 22:57:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a7320108-93e1-5815-b2ae-f9adc20ddb67
2026-03-26 22:57:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7772fd0>
2026-03-26 22:57:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7320108-93e1-5815-b2ae-f9adc20ddb67/a7320108-93e1-5815-b2ae-f9adc20ddb67_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:57:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F7f2f7cdf758e4babae80469f65f05b24%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/7f2f7cdf758e4babae80469f65f05b24/images/large/3.jpg saved to cache
2026-03-26 22:57:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a7320108-93e1-5815-b2ae-f9adc20ddb67
2026-03-26 22:57:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/7f2f7cdf758e4babae80469f65f05b24/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/7f2f7cdf758e4babae80469f65f05b24/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:51 [ayvens.be] INFO: Found listing with ID: 1985667
2026-03-26 22:57:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985667%27 HTTP/1.1" 200 None
2026-03-26 22:57:51 [ayvens.be] INFO: Scrape type for 1985667: 1
2026-03-26 22:57:51 [ayvens.be] INFO: Extracting data for car ID: 1985667
2026-03-26 22:57:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e7a90720-4e95-5ec8-a958-7d17809d3896 with identifier: 1985667
2026-03-26 22:57:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7a90720-4e95-5ec8-a958-7d17809d3896 with scrape type 1
2026-03-26 22:57:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e7a90720-4e95-5ec8-a958-7d17809d3896
2026-03-26 22:57:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fb5093cd365a14433a5f50163d6820be2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/b5093cd365a14433a5f50163d6820be2/images/large/1.jpg not downloaded yet
2026-03-26 22:57:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/7f2f7cdf758e4babae80469f65f05b24/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fb5093cd365a14433a5f50163d6820be2%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/b5093cd365a14433a5f50163d6820be2/images/large/2.jpg not downloaded yet
2026-03-26 22:57:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/7f2f7cdf758e4babae80469f65f05b24/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fb5093cd365a14433a5f50163d6820be2%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/b5093cd365a14433a5f50163d6820be2/images/large/3.jpg not downloaded yet
2026-03-26 22:57:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/7f2f7cdf758e4babae80469f65f05b24/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77690d0>
2026-03-26 22:57:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7320108-93e1-5815-b2ae-f9adc20ddb67/a7320108-93e1-5815-b2ae-f9adc20ddb67_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:57:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F7f2f7cdf758e4babae80469f65f05b24%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/7f2f7cdf758e4babae80469f65f05b24/images/large/4.jpg saved to cache
2026-03-26 22:57:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a7320108-93e1-5815-b2ae-f9adc20ddb67
2026-03-26 22:57:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b69c10>
2026-03-26 22:57:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7320108-93e1-5815-b2ae-f9adc20ddb67/a7320108-93e1-5815-b2ae-f9adc20ddb67_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:57:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F7f2f7cdf758e4babae80469f65f05b24%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/7f2f7cdf758e4babae80469f65f05b24/images/large/6.jpg saved to cache
2026-03-26 22:57:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a7320108-93e1-5815-b2ae-f9adc20ddb67
2026-03-26 22:57:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fb5093cd365a14433a5f50163d6820be2%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/b5093cd365a14433a5f50163d6820be2/images/large/4.jpg not downloaded yet
2026-03-26 22:57:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fb5093cd365a14433a5f50163d6820be2%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/b5093cd365a14433a5f50163d6820be2/images/large/5.jpg not downloaded yet
2026-03-26 22:57:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7477010>
2026-03-26 22:57:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7320108-93e1-5815-b2ae-f9adc20ddb67/a7320108-93e1-5815-b2ae-f9adc20ddb67_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:57:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F7f2f7cdf758e4babae80469f65f05b24%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/7f2f7cdf758e4babae80469f65f05b24/images/large/5.jpg saved to cache
2026-03-26 22:57:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a7320108-93e1-5815-b2ae-f9adc20ddb67
2026-03-26 22:57:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7818410>
2026-03-26 22:57:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7320108-93e1-5815-b2ae-f9adc20ddb67/a7320108-93e1-5815-b2ae-f9adc20ddb67_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:57:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F7f2f7cdf758e4babae80469f65f05b24%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/7f2f7cdf758e4babae80469f65f05b24/images/large/8.jpg saved to cache
2026-03-26 22:57:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a7320108-93e1-5815-b2ae-f9adc20ddb67
2026-03-26 22:57:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7ce9fd0>
2026-03-26 22:57:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7320108-93e1-5815-b2ae-f9adc20ddb67/a7320108-93e1-5815-b2ae-f9adc20ddb67_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:57:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F7f2f7cdf758e4babae80469f65f05b24%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/7f2f7cdf758e4babae80469f65f05b24/images/large/7.jpg saved to cache
2026-03-26 22:57:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a7320108-93e1-5815-b2ae-f9adc20ddb67
2026-03-26 22:57:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fb5093cd365a14433a5f50163d6820be2%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/b5093cd365a14433a5f50163d6820be2/images/large/6.jpg not downloaded yet
2026-03-26 22:57:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/7f2f7cdf758e4babae80469f65f05b24/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/7f2f7cdf758e4babae80469f65f05b24/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fb5093cd365a14433a5f50163d6820be2%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/b5093cd365a14433a5f50163d6820be2/images/large/7.jpg not downloaded yet
2026-03-26 22:57:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fb5093cd365a14433a5f50163d6820be2%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/b5093cd365a14433a5f50163d6820be2/images/large/8.jpg not downloaded yet
2026-03-26 22:57:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fb5093cd365a14433a5f50163d6820be2%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/b5093cd365a14433a5f50163d6820be2/images/large/9.jpg not downloaded yet
2026-03-26 22:57:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/b5093cd365a14433a5f50163d6820be2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fb5093cd365a14433a5f50163d6820be2%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/b5093cd365a14433a5f50163d6820be2/images/large/10.jpg not downloaded yet
2026-03-26 22:57:52 [ayvens.be] INFO: Found listing with ID: 1985668
2026-03-26 22:57:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985668%27 HTTP/1.1" 200 None
2026-03-26 22:57:52 [ayvens.be] INFO: Scrape type for 1985668: 1
2026-03-26 22:57:52 [ayvens.be] INFO: Extracting data for car ID: 1985668
2026-03-26 22:57:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 575acd25-7abc-59a1-b3eb-26695f75fd69 with identifier: 1985668
2026-03-26 22:57:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 575acd25-7abc-59a1-b3eb-26695f75fd69 with scrape type 1
2026-03-26 22:57:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 575acd25-7abc-59a1-b3eb-26695f75fd69
2026-03-26 22:57:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F82edcbb9f35340a2819519458c4d6859%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/82edcbb9f35340a2819519458c4d6859/images/large/1.jpg not downloaded yet
2026-03-26 22:57:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F82edcbb9f35340a2819519458c4d6859%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/82edcbb9f35340a2819519458c4d6859/images/large/2.jpg not downloaded yet
2026-03-26 22:57:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F82edcbb9f35340a2819519458c4d6859%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/82edcbb9f35340a2819519458c4d6859/images/large/3.jpg not downloaded yet
2026-03-26 22:57:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79a1110>
2026-03-26 22:57:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7320108-93e1-5815-b2ae-f9adc20ddb67/a7320108-93e1-5815-b2ae-f9adc20ddb67_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:57:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F7f2f7cdf758e4babae80469f65f05b24%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/7f2f7cdf758e4babae80469f65f05b24/images/large/9.jpg saved to cache
2026-03-26 22:57:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a7320108-93e1-5815-b2ae-f9adc20ddb67
2026-03-26 22:57:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7649610>
2026-03-26 22:57:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7320108-93e1-5815-b2ae-f9adc20ddb67/a7320108-93e1-5815-b2ae-f9adc20ddb67_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:57:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F7f2f7cdf758e4babae80469f65f05b24%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/7f2f7cdf758e4babae80469f65f05b24/images/large/10.jpg saved to cache
2026-03-26 22:57:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a7320108-93e1-5815-b2ae-f9adc20ddb67
2026-03-26 22:57:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a7320108-93e1-5815-b2ae-f9adc20ddb67, skipping ID generation
2026-03-26 22:57:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7320108-93e1-5815-b2ae-f9adc20ddb67 with scrape type 1
2026-03-26 22:57:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a7320108-93e1-5815-b2ae-f9adc20ddb67 sending to next pipeline
2026-03-26 22:57:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a7320108-93e1-5815-b2ae-f9adc20ddb67, identifier: 1985666
2026-03-26 22:57:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/b5093cd365a14433a5f50163d6820be2/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F82edcbb9f35340a2819519458c4d6859%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/82edcbb9f35340a2819519458c4d6859/images/large/4.jpg not downloaded yet
2026-03-26 22:57:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a7320108-93e1-5815-b2ae-f9adc20ddb67 with identifier: 1985666
2026-03-26 22:57:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a7320108-93e1-5815-b2ae-f9adc20ddb67 with identifier: 1985666
2026-03-26 22:57:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a7320108-93e1-5815-b2ae-f9adc20ddb67 with identifier: 1985666 to the API
2026-03-26 22:57:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:57:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:57:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2dl/7f2f7cdf758e4babae80469f65f05b24/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'a7320108-93e1-5815-b2ae-f9adc20ddb67',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'MINI',
 'model': 'COUNTRYMAN',
 'odometer': 117996,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7320108-93e1-5815-b2ae-f9adc20ddb67/a7320108-93e1-5815-b2ae-f9adc20ddb67_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 251178,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/7f2f7cdf758e4babae80469f65f05b24/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7320108-93e1-5815-b2ae-f9adc20ddb67/a7320108-93e1-5815-b2ae-f9adc20ddb67_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 244818,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/7f2f7cdf758e4babae80469f65f05b24/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7320108-93e1-5815-b2ae-f9adc20ddb67/a7320108-93e1-5815-b2ae-f9adc20ddb67_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 266735,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/7f2f7cdf758e4babae80469f65f05b24/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7320108-93e1-5815-b2ae-f9adc20ddb67/a7320108-93e1-5815-b2ae-f9adc20ddb67_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 257328,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/7f2f7cdf758e4babae80469f65f05b24/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7320108-93e1-5815-b2ae-f9adc20ddb67/a7320108-93e1-5815-b2ae-f9adc20ddb67_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 273462,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/7f2f7cdf758e4babae80469f65f05b24/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7320108-93e1-5815-b2ae-f9adc20ddb67/a7320108-93e1-5815-b2ae-f9adc20ddb67_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 260458,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/7f2f7cdf758e4babae80469f65f05b24/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7320108-93e1-5815-b2ae-f9adc20ddb67/a7320108-93e1-5815-b2ae-f9adc20ddb67_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 327067,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/7f2f7cdf758e4babae80469f65f05b24/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7320108-93e1-5815-b2ae-f9adc20ddb67/a7320108-93e1-5815-b2ae-f9adc20ddb67_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 305558,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/7f2f7cdf758e4babae80469f65f05b24/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7320108-93e1-5815-b2ae-f9adc20ddb67/a7320108-93e1-5815-b2ae-f9adc20ddb67_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 399371,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/7f2f7cdf758e4babae80469f65f05b24/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7320108-93e1-5815-b2ae-f9adc20ddb67/a7320108-93e1-5815-b2ae-f9adc20ddb67_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 285221,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/7f2f7cdf758e4babae80469f65f05b24/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-04-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI COUNTRYMAN 1.5 COOPER S E 4WD AUTO',
 'transmission': 'automatic',
 'trim': '1.5 COOPER S E 4WD AUTO',
 'vin': None,
 'year': 2023}
2026-03-26 22:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985666%27 HTTP/1.1" 200 None
2026-03-26 22:57:53 [ayvens.be] INFO: Saving data for 1985666: {'created_time': 1774565873.142429, 'last_price_update_time': 1774565873.142442, 'auction_closing_time': 1774958400.0}
2026-03-26 22:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985666') HTTP/1.1" 204 0
2026-03-26 22:57:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/b5093cd365a14433a5f50163d6820be2/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F82edcbb9f35340a2819519458c4d6859%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/82edcbb9f35340a2819519458c4d6859/images/large/5.jpg not downloaded yet
2026-03-26 22:57:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/b5093cd365a14433a5f50163d6820be2/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F82edcbb9f35340a2819519458c4d6859%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/82edcbb9f35340a2819519458c4d6859/images/large/6.jpg not downloaded yet
2026-03-26 22:57:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd0d1810>
2026-03-26 22:57:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7a90720-4e95-5ec8-a958-7d17809d3896/e7a90720-4e95-5ec8-a958-7d17809d3896_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fb5093cd365a14433a5f50163d6820be2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/b5093cd365a14433a5f50163d6820be2/images/large/1.jpg saved to cache
2026-03-26 22:57:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e7a90720-4e95-5ec8-a958-7d17809d3896
2026-03-26 22:57:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7400f50>
2026-03-26 22:57:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7a90720-4e95-5ec8-a958-7d17809d3896/e7a90720-4e95-5ec8-a958-7d17809d3896_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fb5093cd365a14433a5f50163d6820be2%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/b5093cd365a14433a5f50163d6820be2/images/large/2.jpg saved to cache
2026-03-26 22:57:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e7a90720-4e95-5ec8-a958-7d17809d3896
2026-03-26 22:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F82edcbb9f35340a2819519458c4d6859%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/82edcbb9f35340a2819519458c4d6859/images/large/7.jpg not downloaded yet
2026-03-26 22:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F82edcbb9f35340a2819519458c4d6859%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/82edcbb9f35340a2819519458c4d6859/images/large/8.jpg not downloaded yet
2026-03-26 22:57:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/82edcbb9f35340a2819519458c4d6859/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6dd8b90>
2026-03-26 22:57:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7a90720-4e95-5ec8-a958-7d17809d3896/e7a90720-4e95-5ec8-a958-7d17809d3896_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fb5093cd365a14433a5f50163d6820be2%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/b5093cd365a14433a5f50163d6820be2/images/large/3.jpg saved to cache
2026-03-26 22:57:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e7a90720-4e95-5ec8-a958-7d17809d3896
2026-03-26 22:57:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77701d0>
2026-03-26 22:57:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7a90720-4e95-5ec8-a958-7d17809d3896/e7a90720-4e95-5ec8-a958-7d17809d3896_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fb5093cd365a14433a5f50163d6820be2%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/b5093cd365a14433a5f50163d6820be2/images/large/5.jpg saved to cache
2026-03-26 22:57:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e7a90720-4e95-5ec8-a958-7d17809d3896
2026-03-26 22:57:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/b5093cd365a14433a5f50163d6820be2/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/b5093cd365a14433a5f50163d6820be2/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F82edcbb9f35340a2819519458c4d6859%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/82edcbb9f35340a2819519458c4d6859/images/large/9.jpg not downloaded yet
2026-03-26 22:57:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/b5093cd365a14433a5f50163d6820be2/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/b5093cd365a14433a5f50163d6820be2/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/b5093cd365a14433a5f50163d6820be2/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F82edcbb9f35340a2819519458c4d6859%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/82edcbb9f35340a2819519458c4d6859/images/large/10.jpg not downloaded yet
2026-03-26 22:57:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/82edcbb9f35340a2819519458c4d6859/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:53 [ayvens.be] INFO: Found listing with ID: 1985669
2026-03-26 22:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985669%27 HTTP/1.1" 200 None
2026-03-26 22:57:53 [ayvens.be] INFO: Scrape type for 1985669: 1
2026-03-26 22:57:53 [ayvens.be] INFO: Extracting data for car ID: 1985669
2026-03-26 22:57:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00efd6d5-bab1-54f3-8526-5077d1dd40f2 with identifier: 1985669
2026-03-26 22:57:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00efd6d5-bab1-54f3-8526-5077d1dd40f2 with scrape type 1
2026-03-26 22:57:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 00efd6d5-bab1-54f3-8526-5077d1dd40f2
2026-03-26 22:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F9c6ef6a638f543bf84682ddb5e25f3d6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/9c6ef6a638f543bf84682ddb5e25f3d6/images/large/1.jpg not downloaded yet
2026-03-26 22:57:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7448b90>
2026-03-26 22:57:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_575acd25-7abc-59a1-b3eb-26695f75fd69/575acd25-7abc-59a1-b3eb-26695f75fd69_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F82edcbb9f35340a2819519458c4d6859%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/82edcbb9f35340a2819519458c4d6859/images/large/1.jpg saved to cache
2026-03-26 22:57:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 575acd25-7abc-59a1-b3eb-26695f75fd69
2026-03-26 22:57:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/b5093cd365a14433a5f50163d6820be2/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F9c6ef6a638f543bf84682ddb5e25f3d6%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/9c6ef6a638f543bf84682ddb5e25f3d6/images/large/2.jpg not downloaded yet
2026-03-26 22:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F9c6ef6a638f543bf84682ddb5e25f3d6%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/9c6ef6a638f543bf84682ddb5e25f3d6/images/large/3.jpg not downloaded yet
2026-03-26 22:57:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/82edcbb9f35340a2819519458c4d6859/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/82edcbb9f35340a2819519458c4d6859/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b741d5d0>
2026-03-26 22:57:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7a90720-4e95-5ec8-a958-7d17809d3896/e7a90720-4e95-5ec8-a958-7d17809d3896_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fb5093cd365a14433a5f50163d6820be2%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/b5093cd365a14433a5f50163d6820be2/images/large/6.jpg saved to cache
2026-03-26 22:57:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e7a90720-4e95-5ec8-a958-7d17809d3896
2026-03-26 22:57:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7dd1250>
2026-03-26 22:57:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7a90720-4e95-5ec8-a958-7d17809d3896/e7a90720-4e95-5ec8-a958-7d17809d3896_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fb5093cd365a14433a5f50163d6820be2%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/b5093cd365a14433a5f50163d6820be2/images/large/4.jpg saved to cache
2026-03-26 22:57:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e7a90720-4e95-5ec8-a958-7d17809d3896
2026-03-26 22:57:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b760d0>
2026-03-26 22:57:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7a90720-4e95-5ec8-a958-7d17809d3896/e7a90720-4e95-5ec8-a958-7d17809d3896_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:57:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fb5093cd365a14433a5f50163d6820be2%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/b5093cd365a14433a5f50163d6820be2/images/large/8.jpg saved to cache
2026-03-26 22:57:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e7a90720-4e95-5ec8-a958-7d17809d3896
2026-03-26 22:57:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6dc0590>
2026-03-26 22:57:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7a90720-4e95-5ec8-a958-7d17809d3896/e7a90720-4e95-5ec8-a958-7d17809d3896_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:57:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fb5093cd365a14433a5f50163d6820be2%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/b5093cd365a14433a5f50163d6820be2/images/large/9.jpg saved to cache
2026-03-26 22:57:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e7a90720-4e95-5ec8-a958-7d17809d3896
2026-03-26 22:57:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7489f90>
2026-03-26 22:57:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7a90720-4e95-5ec8-a958-7d17809d3896/e7a90720-4e95-5ec8-a958-7d17809d3896_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:57:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fb5093cd365a14433a5f50163d6820be2%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/b5093cd365a14433a5f50163d6820be2/images/large/7.jpg saved to cache
2026-03-26 22:57:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e7a90720-4e95-5ec8-a958-7d17809d3896
2026-03-26 22:57:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/82edcbb9f35340a2819519458c4d6859/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/82edcbb9f35340a2819519458c4d6859/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/82edcbb9f35340a2819519458c4d6859/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F9c6ef6a638f543bf84682ddb5e25f3d6%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/9c6ef6a638f543bf84682ddb5e25f3d6/images/large/4.jpg not downloaded yet
2026-03-26 22:57:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79278d0>
2026-03-26 22:57:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_575acd25-7abc-59a1-b3eb-26695f75fd69/575acd25-7abc-59a1-b3eb-26695f75fd69_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:57:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F82edcbb9f35340a2819519458c4d6859%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/82edcbb9f35340a2819519458c4d6859/images/large/2.jpg saved to cache
2026-03-26 22:57:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 575acd25-7abc-59a1-b3eb-26695f75fd69
2026-03-26 22:57:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F9c6ef6a638f543bf84682ddb5e25f3d6%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/9c6ef6a638f543bf84682ddb5e25f3d6/images/large/5.jpg not downloaded yet
2026-03-26 22:57:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b728e3d0>
2026-03-26 22:57:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7a90720-4e95-5ec8-a958-7d17809d3896/e7a90720-4e95-5ec8-a958-7d17809d3896_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:57:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fb5093cd365a14433a5f50163d6820be2%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/b5093cd365a14433a5f50163d6820be2/images/large/10.jpg saved to cache
2026-03-26 22:57:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e7a90720-4e95-5ec8-a958-7d17809d3896
2026-03-26 22:57:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e7a90720-4e95-5ec8-a958-7d17809d3896, skipping ID generation
2026-03-26 22:57:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7a90720-4e95-5ec8-a958-7d17809d3896 with scrape type 1
2026-03-26 22:57:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e7a90720-4e95-5ec8-a958-7d17809d3896 sending to next pipeline
2026-03-26 22:57:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e7a90720-4e95-5ec8-a958-7d17809d3896, identifier: 1985667
2026-03-26 22:57:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b75733d0>
2026-03-26 22:57:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_575acd25-7abc-59a1-b3eb-26695f75fd69/575acd25-7abc-59a1-b3eb-26695f75fd69_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:57:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F82edcbb9f35340a2819519458c4d6859%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/82edcbb9f35340a2819519458c4d6859/images/large/3.jpg saved to cache
2026-03-26 22:57:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 575acd25-7abc-59a1-b3eb-26695f75fd69
2026-03-26 22:57:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b78c2f90>
2026-03-26 22:57:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_575acd25-7abc-59a1-b3eb-26695f75fd69/575acd25-7abc-59a1-b3eb-26695f75fd69_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:57:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F82edcbb9f35340a2819519458c4d6859%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/82edcbb9f35340a2819519458c4d6859/images/large/4.jpg saved to cache
2026-03-26 22:57:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 575acd25-7abc-59a1-b3eb-26695f75fd69
2026-03-26 22:57:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/82edcbb9f35340a2819519458c4d6859/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/82edcbb9f35340a2819519458c4d6859/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F9c6ef6a638f543bf84682ddb5e25f3d6%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/9c6ef6a638f543bf84682ddb5e25f3d6/images/large/6.jpg not downloaded yet
2026-03-26 22:57:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e7a90720-4e95-5ec8-a958-7d17809d3896 with identifier: 1985667
2026-03-26 22:57:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e7a90720-4e95-5ec8-a958-7d17809d3896 with identifier: 1985667
2026-03-26 22:57:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e7a90720-4e95-5ec8-a958-7d17809d3896 with identifier: 1985667 to the API
2026-03-26 22:57:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:57:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:57:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bt/b5093cd365a14433a5f50163d6820be2/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'e7a90720-4e95-5ec8-a958-7d17809d3896',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'SUPERB COMBI',
 'odometer': 95871,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7a90720-4e95-5ec8-a958-7d17809d3896/e7a90720-4e95-5ec8-a958-7d17809d3896_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 774138,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/b5093cd365a14433a5f50163d6820be2/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7a90720-4e95-5ec8-a958-7d17809d3896/e7a90720-4e95-5ec8-a958-7d17809d3896_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 725975,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/b5093cd365a14433a5f50163d6820be2/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7a90720-4e95-5ec8-a958-7d17809d3896/e7a90720-4e95-5ec8-a958-7d17809d3896_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 716148,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/b5093cd365a14433a5f50163d6820be2/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7a90720-4e95-5ec8-a958-7d17809d3896/e7a90720-4e95-5ec8-a958-7d17809d3896_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 717906,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/b5093cd365a14433a5f50163d6820be2/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7a90720-4e95-5ec8-a958-7d17809d3896/e7a90720-4e95-5ec8-a958-7d17809d3896_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 709152,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/b5093cd365a14433a5f50163d6820be2/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7a90720-4e95-5ec8-a958-7d17809d3896/e7a90720-4e95-5ec8-a958-7d17809d3896_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 803878,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/b5093cd365a14433a5f50163d6820be2/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7a90720-4e95-5ec8-a958-7d17809d3896/e7a90720-4e95-5ec8-a958-7d17809d3896_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 720645,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/b5093cd365a14433a5f50163d6820be2/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7a90720-4e95-5ec8-a958-7d17809d3896/e7a90720-4e95-5ec8-a958-7d17809d3896_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 784050,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/b5093cd365a14433a5f50163d6820be2/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7a90720-4e95-5ec8-a958-7d17809d3896/e7a90720-4e95-5ec8-a958-7d17809d3896_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 764994,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/b5093cd365a14433a5f50163d6820be2/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7a90720-4e95-5ec8-a958-7d17809d3896/e7a90720-4e95-5ec8-a958-7d17809d3896_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 651424,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/b5093cd365a14433a5f50163d6820be2/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA SUPERB COMBI 1.4 TSI PHEV 160KW DSG6 CLEVER',
 'transmission': 'automatic',
 'trim': '1.4 TSI PHEV 160KW DSG6 CLEVER',
 'vin': None,
 'year': 2022}
2026-03-26 22:57:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985667%27 HTTP/1.1" 200 None
2026-03-26 22:57:54 [ayvens.be] INFO: Saving data for 1985667: {'created_time': 1774565874.988514, 'last_price_update_time': 1774565874.988524, 'auction_closing_time': 1774958400.0}
2026-03-26 22:57:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985667') HTTP/1.1" 204 0
2026-03-26 22:57:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/82edcbb9f35340a2819519458c4d6859/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F9c6ef6a638f543bf84682ddb5e25f3d6%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/9c6ef6a638f543bf84682ddb5e25f3d6/images/large/7.jpg not downloaded yet
2026-03-26 22:57:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7770ed0>
2026-03-26 22:57:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_575acd25-7abc-59a1-b3eb-26695f75fd69/575acd25-7abc-59a1-b3eb-26695f75fd69_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:57:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F82edcbb9f35340a2819519458c4d6859%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/82edcbb9f35340a2819519458c4d6859/images/large/5.jpg saved to cache
2026-03-26 22:57:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 575acd25-7abc-59a1-b3eb-26695f75fd69
2026-03-26 22:57:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7ddf190>
2026-03-26 22:57:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_575acd25-7abc-59a1-b3eb-26695f75fd69/575acd25-7abc-59a1-b3eb-26695f75fd69_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:57:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F82edcbb9f35340a2819519458c4d6859%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/82edcbb9f35340a2819519458c4d6859/images/large/6.jpg saved to cache
2026-03-26 22:57:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 575acd25-7abc-59a1-b3eb-26695f75fd69
2026-03-26 22:57:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7428650>
2026-03-26 22:57:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_575acd25-7abc-59a1-b3eb-26695f75fd69/575acd25-7abc-59a1-b3eb-26695f75fd69_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:57:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F82edcbb9f35340a2819519458c4d6859%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/82edcbb9f35340a2819519458c4d6859/images/large/7.jpg saved to cache
2026-03-26 22:57:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 575acd25-7abc-59a1-b3eb-26695f75fd69
2026-03-26 22:57:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7dde410>
2026-03-26 22:57:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_575acd25-7abc-59a1-b3eb-26695f75fd69/575acd25-7abc-59a1-b3eb-26695f75fd69_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:57:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F82edcbb9f35340a2819519458c4d6859%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/82edcbb9f35340a2819519458c4d6859/images/large/8.jpg saved to cache
2026-03-26 22:57:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 575acd25-7abc-59a1-b3eb-26695f75fd69
2026-03-26 22:57:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b788c990>
2026-03-26 22:57:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_575acd25-7abc-59a1-b3eb-26695f75fd69/575acd25-7abc-59a1-b3eb-26695f75fd69_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:57:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F82edcbb9f35340a2819519458c4d6859%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/82edcbb9f35340a2819519458c4d6859/images/large/9.jpg saved to cache
2026-03-26 22:57:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 575acd25-7abc-59a1-b3eb-26695f75fd69
2026-03-26 22:57:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/9c6ef6a638f543bf84682ddb5e25f3d6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F9c6ef6a638f543bf84682ddb5e25f3d6%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/9c6ef6a638f543bf84682ddb5e25f3d6/images/large/8.jpg not downloaded yet
2026-03-26 22:57:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/9c6ef6a638f543bf84682ddb5e25f3d6/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/9c6ef6a638f543bf84682ddb5e25f3d6/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/9c6ef6a638f543bf84682ddb5e25f3d6/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F9c6ef6a638f543bf84682ddb5e25f3d6%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/9c6ef6a638f543bf84682ddb5e25f3d6/images/large/9.jpg not downloaded yet
2026-03-26 22:57:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7443590>
2026-03-26 22:57:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_575acd25-7abc-59a1-b3eb-26695f75fd69/575acd25-7abc-59a1-b3eb-26695f75fd69_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:57:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F82edcbb9f35340a2819519458c4d6859%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/82edcbb9f35340a2819519458c4d6859/images/large/10.jpg saved to cache
2026-03-26 22:57:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 575acd25-7abc-59a1-b3eb-26695f75fd69
2026-03-26 22:57:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 575acd25-7abc-59a1-b3eb-26695f75fd69, skipping ID generation
2026-03-26 22:57:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 575acd25-7abc-59a1-b3eb-26695f75fd69 with scrape type 1
2026-03-26 22:57:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 575acd25-7abc-59a1-b3eb-26695f75fd69 sending to next pipeline
2026-03-26 22:57:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 575acd25-7abc-59a1-b3eb-26695f75fd69, identifier: 1985668
2026-03-26 22:57:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F9c6ef6a638f543bf84682ddb5e25f3d6%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/9c6ef6a638f543bf84682ddb5e25f3d6/images/large/10.jpg not downloaded yet
2026-03-26 22:57:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 575acd25-7abc-59a1-b3eb-26695f75fd69 with identifier: 1985668
2026-03-26 22:57:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 575acd25-7abc-59a1-b3eb-26695f75fd69 with identifier: 1985668
2026-03-26 22:57:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 575acd25-7abc-59a1-b3eb-26695f75fd69 with identifier: 1985668 to the API
2026-03-26 22:57:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:57:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:57:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bs/82edcbb9f35340a2819519458c4d6859/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '575acd25-7abc-59a1-b3eb-26695f75fd69',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A3 SPORTBACK',
 'odometer': 51428,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_575acd25-7abc-59a1-b3eb-26695f75fd69/575acd25-7abc-59a1-b3eb-26695f75fd69_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 218225,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/82edcbb9f35340a2819519458c4d6859/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_575acd25-7abc-59a1-b3eb-26695f75fd69/575acd25-7abc-59a1-b3eb-26695f75fd69_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 209202,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/82edcbb9f35340a2819519458c4d6859/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_575acd25-7abc-59a1-b3eb-26695f75fd69/575acd25-7abc-59a1-b3eb-26695f75fd69_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 225107,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/82edcbb9f35340a2819519458c4d6859/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_575acd25-7abc-59a1-b3eb-26695f75fd69/575acd25-7abc-59a1-b3eb-26695f75fd69_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 219998,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/82edcbb9f35340a2819519458c4d6859/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_575acd25-7abc-59a1-b3eb-26695f75fd69/575acd25-7abc-59a1-b3eb-26695f75fd69_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 266558,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/82edcbb9f35340a2819519458c4d6859/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_575acd25-7abc-59a1-b3eb-26695f75fd69/575acd25-7abc-59a1-b3eb-26695f75fd69_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 266098,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/82edcbb9f35340a2819519458c4d6859/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_575acd25-7abc-59a1-b3eb-26695f75fd69/575acd25-7abc-59a1-b3eb-26695f75fd69_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 308110,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/82edcbb9f35340a2819519458c4d6859/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_575acd25-7abc-59a1-b3eb-26695f75fd69/575acd25-7abc-59a1-b3eb-26695f75fd69_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 271849,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/82edcbb9f35340a2819519458c4d6859/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_575acd25-7abc-59a1-b3eb-26695f75fd69/575acd25-7abc-59a1-b3eb-26695f75fd69_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 278958,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/82edcbb9f35340a2819519458c4d6859/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_575acd25-7abc-59a1-b3eb-26695f75fd69/575acd25-7abc-59a1-b3eb-26695f75fd69_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 272552,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/82edcbb9f35340a2819519458c4d6859/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A3 SPORTBACK 1.4 40 TFSI E S TRONIC SPORTBACK',
 'transmission': 'automatic',
 'trim': '1.4 40 TFSI E S TRONIC SPORTBACK',
 'vin': None,
 'year': 2022}
2026-03-26 22:57:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985668%27 HTTP/1.1" 200 None
2026-03-26 22:57:56 [ayvens.be] INFO: Saving data for 1985668: {'created_time': 1774565876.064927, 'last_price_update_time': 1774565876.064937, 'auction_closing_time': 1774958400.0}
2026-03-26 22:57:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985668') HTTP/1.1" 204 0
2026-03-26 22:57:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/9c6ef6a638f543bf84682ddb5e25f3d6/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:56 [ayvens.be] INFO: Found listing with ID: 1985670
2026-03-26 22:57:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985670%27 HTTP/1.1" 200 None
2026-03-26 22:57:56 [ayvens.be] INFO: Scrape type for 1985670: 1
2026-03-26 22:57:56 [ayvens.be] INFO: Extracting data for car ID: 1985670
2026-03-26 22:57:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 313dd6d5-92c8-50d8-8204-aa92b87058e7 with identifier: 1985670
2026-03-26 22:57:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 313dd6d5-92c8-50d8-8204-aa92b87058e7 with scrape type 1
2026-03-26 22:57:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 313dd6d5-92c8-50d8-8204-aa92b87058e7
2026-03-26 22:57:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F2d29ce29c72b4ab6b3c327ca4fdd136f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/2d29ce29c72b4ab6b3c327ca4fdd136f/images/large/1.jpg not downloaded yet
2026-03-26 22:57:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b6a250>
2026-03-26 22:57:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00efd6d5-bab1-54f3-8526-5077d1dd40f2/00efd6d5-bab1-54f3-8526-5077d1dd40f2_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:57:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F9c6ef6a638f543bf84682ddb5e25f3d6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/9c6ef6a638f543bf84682ddb5e25f3d6/images/large/1.jpg saved to cache
2026-03-26 22:57:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 00efd6d5-bab1-54f3-8526-5077d1dd40f2
2026-03-26 22:57:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74ce050>
2026-03-26 22:57:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00efd6d5-bab1-54f3-8526-5077d1dd40f2/00efd6d5-bab1-54f3-8526-5077d1dd40f2_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:57:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F9c6ef6a638f543bf84682ddb5e25f3d6%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/9c6ef6a638f543bf84682ddb5e25f3d6/images/large/2.jpg saved to cache
2026-03-26 22:57:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 00efd6d5-bab1-54f3-8526-5077d1dd40f2
2026-03-26 22:57:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd3abf50>
2026-03-26 22:57:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00efd6d5-bab1-54f3-8526-5077d1dd40f2/00efd6d5-bab1-54f3-8526-5077d1dd40f2_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:57:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F9c6ef6a638f543bf84682ddb5e25f3d6%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/9c6ef6a638f543bf84682ddb5e25f3d6/images/large/4.jpg saved to cache
2026-03-26 22:57:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 00efd6d5-bab1-54f3-8526-5077d1dd40f2
2026-03-26 22:57:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e1f510>
2026-03-26 22:57:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00efd6d5-bab1-54f3-8526-5077d1dd40f2/00efd6d5-bab1-54f3-8526-5077d1dd40f2_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:57:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F9c6ef6a638f543bf84682ddb5e25f3d6%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/9c6ef6a638f543bf84682ddb5e25f3d6/images/large/3.jpg saved to cache
2026-03-26 22:57:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 00efd6d5-bab1-54f3-8526-5077d1dd40f2
2026-03-26 22:57:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F2d29ce29c72b4ab6b3c327ca4fdd136f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/2d29ce29c72b4ab6b3c327ca4fdd136f/images/large/2.jpg not downloaded yet
2026-03-26 22:57:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/9c6ef6a638f543bf84682ddb5e25f3d6/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b78c2510>
2026-03-26 22:57:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00efd6d5-bab1-54f3-8526-5077d1dd40f2/00efd6d5-bab1-54f3-8526-5077d1dd40f2_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:57:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F9c6ef6a638f543bf84682ddb5e25f3d6%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/9c6ef6a638f543bf84682ddb5e25f3d6/images/large/5.jpg saved to cache
2026-03-26 22:57:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 00efd6d5-bab1-54f3-8526-5077d1dd40f2
2026-03-26 22:57:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/9c6ef6a638f543bf84682ddb5e25f3d6/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F2d29ce29c72b4ab6b3c327ca4fdd136f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/2d29ce29c72b4ab6b3c327ca4fdd136f/images/large/3.jpg not downloaded yet
2026-03-26 22:57:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/9c6ef6a638f543bf84682ddb5e25f3d6/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F2d29ce29c72b4ab6b3c327ca4fdd136f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/2d29ce29c72b4ab6b3c327ca4fdd136f/images/large/4.jpg not downloaded yet
2026-03-26 22:57:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/9c6ef6a638f543bf84682ddb5e25f3d6/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F2d29ce29c72b4ab6b3c327ca4fdd136f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/2d29ce29c72b4ab6b3c327ca4fdd136f/images/large/5.jpg not downloaded yet
2026-03-26 22:57:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/9c6ef6a638f543bf84682ddb5e25f3d6/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F2d29ce29c72b4ab6b3c327ca4fdd136f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/2d29ce29c72b4ab6b3c327ca4fdd136f/images/large/6.jpg not downloaded yet
2026-03-26 22:57:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd3c40d0>
2026-03-26 22:57:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00efd6d5-bab1-54f3-8526-5077d1dd40f2/00efd6d5-bab1-54f3-8526-5077d1dd40f2_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:57:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F9c6ef6a638f543bf84682ddb5e25f3d6%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/9c6ef6a638f543bf84682ddb5e25f3d6/images/large/6.jpg saved to cache
2026-03-26 22:57:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 00efd6d5-bab1-54f3-8526-5077d1dd40f2
2026-03-26 22:57:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F2d29ce29c72b4ab6b3c327ca4fdd136f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/2d29ce29c72b4ab6b3c327ca4fdd136f/images/large/7.jpg not downloaded yet
2026-03-26 22:57:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F2d29ce29c72b4ab6b3c327ca4fdd136f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/2d29ce29c72b4ab6b3c327ca4fdd136f/images/large/8.jpg not downloaded yet
2026-03-26 22:57:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76a4050>
2026-03-26 22:57:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00efd6d5-bab1-54f3-8526-5077d1dd40f2/00efd6d5-bab1-54f3-8526-5077d1dd40f2_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:57:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F9c6ef6a638f543bf84682ddb5e25f3d6%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/9c6ef6a638f543bf84682ddb5e25f3d6/images/large/7.jpg saved to cache
2026-03-26 22:57:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 00efd6d5-bab1-54f3-8526-5077d1dd40f2
2026-03-26 22:57:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7482190>
2026-03-26 22:57:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00efd6d5-bab1-54f3-8526-5077d1dd40f2/00efd6d5-bab1-54f3-8526-5077d1dd40f2_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:57:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F9c6ef6a638f543bf84682ddb5e25f3d6%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/9c6ef6a638f543bf84682ddb5e25f3d6/images/large/8.jpg saved to cache
2026-03-26 22:57:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 00efd6d5-bab1-54f3-8526-5077d1dd40f2
2026-03-26 22:57:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76ed190>
2026-03-26 22:57:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00efd6d5-bab1-54f3-8526-5077d1dd40f2/00efd6d5-bab1-54f3-8526-5077d1dd40f2_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:57:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F9c6ef6a638f543bf84682ddb5e25f3d6%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/9c6ef6a638f543bf84682ddb5e25f3d6/images/large/9.jpg saved to cache
2026-03-26 22:57:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 00efd6d5-bab1-54f3-8526-5077d1dd40f2
2026-03-26 22:57:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77c9710>
2026-03-26 22:57:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00efd6d5-bab1-54f3-8526-5077d1dd40f2/00efd6d5-bab1-54f3-8526-5077d1dd40f2_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:57:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F9c6ef6a638f543bf84682ddb5e25f3d6%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/9c6ef6a638f543bf84682ddb5e25f3d6/images/large/10.jpg saved to cache
2026-03-26 22:57:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 00efd6d5-bab1-54f3-8526-5077d1dd40f2
2026-03-26 22:57:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 00efd6d5-bab1-54f3-8526-5077d1dd40f2, skipping ID generation
2026-03-26 22:57:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00efd6d5-bab1-54f3-8526-5077d1dd40f2 with scrape type 1
2026-03-26 22:57:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 00efd6d5-bab1-54f3-8526-5077d1dd40f2 sending to next pipeline
2026-03-26 22:57:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 00efd6d5-bab1-54f3-8526-5077d1dd40f2, identifier: 1985669
2026-03-26 22:57:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F2d29ce29c72b4ab6b3c327ca4fdd136f%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/2d29ce29c72b4ab6b3c327ca4fdd136f/images/large/9.jpg not downloaded yet
2026-03-26 22:57:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 00efd6d5-bab1-54f3-8526-5077d1dd40f2 with identifier: 1985669
2026-03-26 22:57:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 00efd6d5-bab1-54f3-8526-5077d1dd40f2 with identifier: 1985669
2026-03-26 22:57:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 00efd6d5-bab1-54f3-8526-5077d1dd40f2 with identifier: 1985669 to the API
2026-03-26 22:57:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:57:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:57:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2dl/9c6ef6a638f543bf84682ddb5e25f3d6/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '00efd6d5-bab1-54f3-8526-5077d1dd40f2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT',
 'odometer': 78888,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00efd6d5-bab1-54f3-8526-5077d1dd40f2/00efd6d5-bab1-54f3-8526-5077d1dd40f2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 235915,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/9c6ef6a638f543bf84682ddb5e25f3d6/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00efd6d5-bab1-54f3-8526-5077d1dd40f2/00efd6d5-bab1-54f3-8526-5077d1dd40f2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 231291,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/9c6ef6a638f543bf84682ddb5e25f3d6/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00efd6d5-bab1-54f3-8526-5077d1dd40f2/00efd6d5-bab1-54f3-8526-5077d1dd40f2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 213827,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/9c6ef6a638f543bf84682ddb5e25f3d6/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00efd6d5-bab1-54f3-8526-5077d1dd40f2/00efd6d5-bab1-54f3-8526-5077d1dd40f2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 215562,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/9c6ef6a638f543bf84682ddb5e25f3d6/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00efd6d5-bab1-54f3-8526-5077d1dd40f2/00efd6d5-bab1-54f3-8526-5077d1dd40f2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 282898,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/9c6ef6a638f543bf84682ddb5e25f3d6/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00efd6d5-bab1-54f3-8526-5077d1dd40f2/00efd6d5-bab1-54f3-8526-5077d1dd40f2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 268497,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/9c6ef6a638f543bf84682ddb5e25f3d6/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00efd6d5-bab1-54f3-8526-5077d1dd40f2/00efd6d5-bab1-54f3-8526-5077d1dd40f2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 328783,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/9c6ef6a638f543bf84682ddb5e25f3d6/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00efd6d5-bab1-54f3-8526-5077d1dd40f2/00efd6d5-bab1-54f3-8526-5077d1dd40f2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 270457,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/9c6ef6a638f543bf84682ddb5e25f3d6/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00efd6d5-bab1-54f3-8526-5077d1dd40f2/00efd6d5-bab1-54f3-8526-5077d1dd40f2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 332162,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/9c6ef6a638f543bf84682ddb5e25f3d6/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00efd6d5-bab1-54f3-8526-5077d1dd40f2/00efd6d5-bab1-54f3-8526-5077d1dd40f2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 251096,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/9c6ef6a638f543bf84682ddb5e25f3d6/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-14',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FORD TRANSIT 2.0TDCI 96KW TREND 350L',
 'transmission': 'manual',
 'trim': '2.0TDCI 96KW TREND 350L',
 'vin': None,
 'year': 2022}
2026-03-26 22:57:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985669%27 HTTP/1.1" 200 None
2026-03-26 22:57:57 [ayvens.be] INFO: Saving data for 1985669: {'created_time': 1774565877.4607, 'last_price_update_time': 1774565877.460711, 'auction_closing_time': 1774958400.0}
2026-03-26 22:57:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985669') HTTP/1.1" 204 0
2026-03-26 22:57:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F2d29ce29c72b4ab6b3c327ca4fdd136f%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/2d29ce29c72b4ab6b3c327ca4fdd136f/images/large/10.jpg not downloaded yet
2026-03-26 22:57:57 [ayvens.be] INFO: Found listing with ID: 1985671
2026-03-26 22:57:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985671%27 HTTP/1.1" 200 None
2026-03-26 22:57:57 [ayvens.be] INFO: Scrape type for 1985671: 1
2026-03-26 22:57:57 [ayvens.be] INFO: Extracting data for car ID: 1985671
2026-03-26 22:57:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b98af7d6-f024-5aa3-97ef-40e680410d5e with identifier: 1985671
2026-03-26 22:57:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b98af7d6-f024-5aa3-97ef-40e680410d5e with scrape type 1
2026-03-26 22:57:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b98af7d6-f024-5aa3-97ef-40e680410d5e
2026-03-26 22:57:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vu%252Fe11b5b6f938849efbb31dcd8d41a2ad6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vu/e11b5b6f938849efbb31dcd8d41a2ad6/images/large/1.jpg not downloaded yet
2026-03-26 22:57:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/2d29ce29c72b4ab6b3c327ca4fdd136f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/2d29ce29c72b4ab6b3c327ca4fdd136f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vu%252Fe11b5b6f938849efbb31dcd8d41a2ad6%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vu/e11b5b6f938849efbb31dcd8d41a2ad6/images/large/2.jpg not downloaded yet
2026-03-26 22:57:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/2d29ce29c72b4ab6b3c327ca4fdd136f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/2d29ce29c72b4ab6b3c327ca4fdd136f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vu%252Fe11b5b6f938849efbb31dcd8d41a2ad6%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vu/e11b5b6f938849efbb31dcd8d41a2ad6/images/large/3.jpg not downloaded yet
2026-03-26 22:57:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vu%252Fe11b5b6f938849efbb31dcd8d41a2ad6%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vu/e11b5b6f938849efbb31dcd8d41a2ad6/images/large/4.jpg not downloaded yet
2026-03-26 22:57:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/2d29ce29c72b4ab6b3c327ca4fdd136f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/2d29ce29c72b4ab6b3c327ca4fdd136f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/2d29ce29c72b4ab6b3c327ca4fdd136f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vu%252Fe11b5b6f938849efbb31dcd8d41a2ad6%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vu/e11b5b6f938849efbb31dcd8d41a2ad6/images/large/5.jpg not downloaded yet
2026-03-26 22:57:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vu%252Fe11b5b6f938849efbb31dcd8d41a2ad6%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vu/e11b5b6f938849efbb31dcd8d41a2ad6/images/large/6.jpg not downloaded yet
2026-03-26 22:57:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vu%252Fe11b5b6f938849efbb31dcd8d41a2ad6%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vu/e11b5b6f938849efbb31dcd8d41a2ad6/images/large/7.jpg not downloaded yet
2026-03-26 22:57:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/2d29ce29c72b4ab6b3c327ca4fdd136f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vu%252Fe11b5b6f938849efbb31dcd8d41a2ad6%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vu/e11b5b6f938849efbb31dcd8d41a2ad6/images/large/8.jpg not downloaded yet
2026-03-26 22:57:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vu%252Fe11b5b6f938849efbb31dcd8d41a2ad6%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vu/e11b5b6f938849efbb31dcd8d41a2ad6/images/large/9.jpg not downloaded yet
2026-03-26 22:57:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/2d29ce29c72b4ab6b3c327ca4fdd136f/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1vu/e11b5b6f938849efbb31dcd8d41a2ad6/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76ee8d0>
2026-03-26 22:57:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_313dd6d5-92c8-50d8-8204-aa92b87058e7/313dd6d5-92c8-50d8-8204-aa92b87058e7_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:57:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F2d29ce29c72b4ab6b3c327ca4fdd136f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/2d29ce29c72b4ab6b3c327ca4fdd136f/images/large/1.jpg saved to cache
2026-03-26 22:57:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 313dd6d5-92c8-50d8-8204-aa92b87058e7
2026-03-26 22:57:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd3c4350>
2026-03-26 22:57:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_313dd6d5-92c8-50d8-8204-aa92b87058e7/313dd6d5-92c8-50d8-8204-aa92b87058e7_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:57:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F2d29ce29c72b4ab6b3c327ca4fdd136f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/2d29ce29c72b4ab6b3c327ca4fdd136f/images/large/3.jpg saved to cache
2026-03-26 22:57:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 313dd6d5-92c8-50d8-8204-aa92b87058e7
2026-03-26 22:57:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7474510>
2026-03-26 22:57:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_313dd6d5-92c8-50d8-8204-aa92b87058e7/313dd6d5-92c8-50d8-8204-aa92b87058e7_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:57:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F2d29ce29c72b4ab6b3c327ca4fdd136f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/2d29ce29c72b4ab6b3c327ca4fdd136f/images/large/4.jpg saved to cache
2026-03-26 22:57:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 313dd6d5-92c8-50d8-8204-aa92b87058e7
2026-03-26 22:57:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b742b110>
2026-03-26 22:57:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_313dd6d5-92c8-50d8-8204-aa92b87058e7/313dd6d5-92c8-50d8-8204-aa92b87058e7_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:57:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F2d29ce29c72b4ab6b3c327ca4fdd136f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/2d29ce29c72b4ab6b3c327ca4fdd136f/images/large/5.jpg saved to cache
2026-03-26 22:57:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 313dd6d5-92c8-50d8-8204-aa92b87058e7
2026-03-26 22:57:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/2d29ce29c72b4ab6b3c327ca4fdd136f/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vu%252Fe11b5b6f938849efbb31dcd8d41a2ad6%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vu/e11b5b6f938849efbb31dcd8d41a2ad6/images/large/10.jpg not downloaded yet
2026-03-26 22:57:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1vu/e11b5b6f938849efbb31dcd8d41a2ad6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:58 [ayvens.be] INFO: Found listing with ID: 1985672
2026-03-26 22:57:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985672%27 HTTP/1.1" 200 None
2026-03-26 22:57:58 [ayvens.be] INFO: Scrape type for 1985672: 1
2026-03-26 22:57:58 [ayvens.be] INFO: Extracting data for car ID: 1985672
2026-03-26 22:57:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eed05e3d-f763-50bb-8774-2ad0b64eac8d with identifier: 1985672
2026-03-26 22:57:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eed05e3d-f763-50bb-8774-2ad0b64eac8d with scrape type 1
2026-03-26 22:57:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item eed05e3d-f763-50bb-8774-2ad0b64eac8d
2026-03-26 22:57:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F26c1073117544068ba22af0645ab30ca%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/26c1073117544068ba22af0645ab30ca/images/large/1.jpg not downloaded yet
2026-03-26 22:57:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74ac610>
2026-03-26 22:57:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_313dd6d5-92c8-50d8-8204-aa92b87058e7/313dd6d5-92c8-50d8-8204-aa92b87058e7_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:57:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F2d29ce29c72b4ab6b3c327ca4fdd136f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/2d29ce29c72b4ab6b3c327ca4fdd136f/images/large/2.jpg saved to cache
2026-03-26 22:57:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 313dd6d5-92c8-50d8-8204-aa92b87058e7
2026-03-26 22:57:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74e7a50>
2026-03-26 22:57:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_313dd6d5-92c8-50d8-8204-aa92b87058e7/313dd6d5-92c8-50d8-8204-aa92b87058e7_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:57:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F2d29ce29c72b4ab6b3c327ca4fdd136f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/2d29ce29c72b4ab6b3c327ca4fdd136f/images/large/6.jpg saved to cache
2026-03-26 22:57:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 313dd6d5-92c8-50d8-8204-aa92b87058e7
2026-03-26 22:57:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e01810>
2026-03-26 22:57:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_313dd6d5-92c8-50d8-8204-aa92b87058e7/313dd6d5-92c8-50d8-8204-aa92b87058e7_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:57:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F2d29ce29c72b4ab6b3c327ca4fdd136f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/2d29ce29c72b4ab6b3c327ca4fdd136f/images/large/7.jpg saved to cache
2026-03-26 22:57:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 313dd6d5-92c8-50d8-8204-aa92b87058e7
2026-03-26 22:57:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b741f150>
2026-03-26 22:57:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_313dd6d5-92c8-50d8-8204-aa92b87058e7/313dd6d5-92c8-50d8-8204-aa92b87058e7_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:57:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F2d29ce29c72b4ab6b3c327ca4fdd136f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/2d29ce29c72b4ab6b3c327ca4fdd136f/images/large/8.jpg saved to cache
2026-03-26 22:57:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 313dd6d5-92c8-50d8-8204-aa92b87058e7
2026-03-26 22:57:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd3b8d10>
2026-03-26 22:57:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_313dd6d5-92c8-50d8-8204-aa92b87058e7/313dd6d5-92c8-50d8-8204-aa92b87058e7_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:57:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F2d29ce29c72b4ab6b3c327ca4fdd136f%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/2d29ce29c72b4ab6b3c327ca4fdd136f/images/large/9.jpg saved to cache
2026-03-26 22:57:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 313dd6d5-92c8-50d8-8204-aa92b87058e7
2026-03-26 22:57:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74e5fd0>
2026-03-26 22:57:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b98af7d6-f024-5aa3-97ef-40e680410d5e/b98af7d6-f024-5aa3-97ef-40e680410d5e_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:57:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vu%252Fe11b5b6f938849efbb31dcd8d41a2ad6%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vu/e11b5b6f938849efbb31dcd8d41a2ad6/images/large/2.jpg saved to cache
2026-03-26 22:57:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b98af7d6-f024-5aa3-97ef-40e680410d5e
2026-03-26 22:57:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1vu/e11b5b6f938849efbb31dcd8d41a2ad6/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F26c1073117544068ba22af0645ab30ca%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/26c1073117544068ba22af0645ab30ca/images/large/2.jpg not downloaded yet
2026-03-26 22:57:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1vu/e11b5b6f938849efbb31dcd8d41a2ad6/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1vu/e11b5b6f938849efbb31dcd8d41a2ad6/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1vu/e11b5b6f938849efbb31dcd8d41a2ad6/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c6ae90>
2026-03-26 22:57:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_313dd6d5-92c8-50d8-8204-aa92b87058e7/313dd6d5-92c8-50d8-8204-aa92b87058e7_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:57:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F2d29ce29c72b4ab6b3c327ca4fdd136f%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/2d29ce29c72b4ab6b3c327ca4fdd136f/images/large/10.jpg saved to cache
2026-03-26 22:57:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 313dd6d5-92c8-50d8-8204-aa92b87058e7
2026-03-26 22:57:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 313dd6d5-92c8-50d8-8204-aa92b87058e7, skipping ID generation
2026-03-26 22:57:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 313dd6d5-92c8-50d8-8204-aa92b87058e7 with scrape type 1
2026-03-26 22:57:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 313dd6d5-92c8-50d8-8204-aa92b87058e7 sending to next pipeline
2026-03-26 22:57:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 313dd6d5-92c8-50d8-8204-aa92b87058e7, identifier: 1985670
2026-03-26 22:57:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79dc3d0>
2026-03-26 22:57:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b98af7d6-f024-5aa3-97ef-40e680410d5e/b98af7d6-f024-5aa3-97ef-40e680410d5e_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:57:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vu%252Fe11b5b6f938849efbb31dcd8d41a2ad6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vu/e11b5b6f938849efbb31dcd8d41a2ad6/images/large/1.jpg saved to cache
2026-03-26 22:57:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b98af7d6-f024-5aa3-97ef-40e680410d5e
2026-03-26 22:57:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F26c1073117544068ba22af0645ab30ca%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/26c1073117544068ba22af0645ab30ca/images/large/3.jpg not downloaded yet
2026-03-26 22:57:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 313dd6d5-92c8-50d8-8204-aa92b87058e7 with identifier: 1985670
2026-03-26 22:57:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 313dd6d5-92c8-50d8-8204-aa92b87058e7 with identifier: 1985670
2026-03-26 22:57:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 313dd6d5-92c8-50d8-8204-aa92b87058e7 with identifier: 1985670 to the API
2026-03-26 22:57:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:57:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:57:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yr/2d29ce29c72b4ab6b3c327ca4fdd136f/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'electric',
 'id': '313dd6d5-92c8-50d8-8204-aa92b87058e7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'HYUNDAI',
 'model': 'KONA',
 'odometer': 63230,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_313dd6d5-92c8-50d8-8204-aa92b87058e7/313dd6d5-92c8-50d8-8204-aa92b87058e7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 672914,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/2d29ce29c72b4ab6b3c327ca4fdd136f/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_313dd6d5-92c8-50d8-8204-aa92b87058e7/313dd6d5-92c8-50d8-8204-aa92b87058e7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 666376,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/2d29ce29c72b4ab6b3c327ca4fdd136f/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_313dd6d5-92c8-50d8-8204-aa92b87058e7/313dd6d5-92c8-50d8-8204-aa92b87058e7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 643345,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/2d29ce29c72b4ab6b3c327ca4fdd136f/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_313dd6d5-92c8-50d8-8204-aa92b87058e7/313dd6d5-92c8-50d8-8204-aa92b87058e7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 680347,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/2d29ce29c72b4ab6b3c327ca4fdd136f/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_313dd6d5-92c8-50d8-8204-aa92b87058e7/313dd6d5-92c8-50d8-8204-aa92b87058e7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 546489,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/2d29ce29c72b4ab6b3c327ca4fdd136f/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_313dd6d5-92c8-50d8-8204-aa92b87058e7/313dd6d5-92c8-50d8-8204-aa92b87058e7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 664874,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/2d29ce29c72b4ab6b3c327ca4fdd136f/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_313dd6d5-92c8-50d8-8204-aa92b87058e7/313dd6d5-92c8-50d8-8204-aa92b87058e7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 653125,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/2d29ce29c72b4ab6b3c327ca4fdd136f/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_313dd6d5-92c8-50d8-8204-aa92b87058e7/313dd6d5-92c8-50d8-8204-aa92b87058e7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 714736,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/2d29ce29c72b4ab6b3c327ca4fdd136f/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_313dd6d5-92c8-50d8-8204-aa92b87058e7/313dd6d5-92c8-50d8-8204-aa92b87058e7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 521293,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/2d29ce29c72b4ab6b3c327ca4fdd136f/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_313dd6d5-92c8-50d8-8204-aa92b87058e7/313dd6d5-92c8-50d8-8204-aa92b87058e7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 573103,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/2d29ce29c72b4ab6b3c327ca4fdd136f/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'HYUNDAI KONA 64 KWH ELECTRIC SKY',
 'transmission': 'automatic',
 'trim': '64 KWH ELECTRIC SKY',
 'vin': None,
 'year': 2020}
2026-03-26 22:57:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985670%27 HTTP/1.1" 200 None
2026-03-26 22:57:59 [ayvens.be] INFO: Saving data for 1985670: {'created_time': 1774565879.292901, 'last_price_update_time': 1774565879.292912, 'auction_closing_time': 1774958400.0}
2026-03-26 22:57:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985670') HTTP/1.1" 204 0
2026-03-26 22:57:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F26c1073117544068ba22af0645ab30ca%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/26c1073117544068ba22af0645ab30ca/images/large/4.jpg not downloaded yet
2026-03-26 22:57:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c69a50>
2026-03-26 22:57:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b98af7d6-f024-5aa3-97ef-40e680410d5e/b98af7d6-f024-5aa3-97ef-40e680410d5e_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:57:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vu%252Fe11b5b6f938849efbb31dcd8d41a2ad6%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vu/e11b5b6f938849efbb31dcd8d41a2ad6/images/large/3.jpg saved to cache
2026-03-26 22:57:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b98af7d6-f024-5aa3-97ef-40e680410d5e
2026-03-26 22:57:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b4f6d0>
2026-03-26 22:57:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b98af7d6-f024-5aa3-97ef-40e680410d5e/b98af7d6-f024-5aa3-97ef-40e680410d5e_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:57:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vu%252Fe11b5b6f938849efbb31dcd8d41a2ad6%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vu/e11b5b6f938849efbb31dcd8d41a2ad6/images/large/6.jpg saved to cache
2026-03-26 22:57:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b98af7d6-f024-5aa3-97ef-40e680410d5e
2026-03-26 22:57:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7ce9010>
2026-03-26 22:57:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b98af7d6-f024-5aa3-97ef-40e680410d5e/b98af7d6-f024-5aa3-97ef-40e680410d5e_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:57:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vu%252Fe11b5b6f938849efbb31dcd8d41a2ad6%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vu/e11b5b6f938849efbb31dcd8d41a2ad6/images/large/4.jpg saved to cache
2026-03-26 22:57:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b98af7d6-f024-5aa3-97ef-40e680410d5e
2026-03-26 22:57:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b4e6d0>
2026-03-26 22:57:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b98af7d6-f024-5aa3-97ef-40e680410d5e/b98af7d6-f024-5aa3-97ef-40e680410d5e_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:57:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vu%252Fe11b5b6f938849efbb31dcd8d41a2ad6%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vu/e11b5b6f938849efbb31dcd8d41a2ad6/images/large/5.jpg saved to cache
2026-03-26 22:57:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b98af7d6-f024-5aa3-97ef-40e680410d5e
2026-03-26 22:57:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F26c1073117544068ba22af0645ab30ca%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/26c1073117544068ba22af0645ab30ca/images/large/5.jpg not downloaded yet
2026-03-26 22:57:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1vu/e11b5b6f938849efbb31dcd8d41a2ad6/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1vu/e11b5b6f938849efbb31dcd8d41a2ad6/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1vu/e11b5b6f938849efbb31dcd8d41a2ad6/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1vu/e11b5b6f938849efbb31dcd8d41a2ad6/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F26c1073117544068ba22af0645ab30ca%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/26c1073117544068ba22af0645ab30ca/images/large/6.jpg not downloaded yet
2026-03-26 22:57:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F26c1073117544068ba22af0645ab30ca%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/26c1073117544068ba22af0645ab30ca/images/large/7.jpg not downloaded yet
2026-03-26 22:57:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F26c1073117544068ba22af0645ab30ca%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/26c1073117544068ba22af0645ab30ca/images/large/8.jpg not downloaded yet
2026-03-26 22:57:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F26c1073117544068ba22af0645ab30ca%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/26c1073117544068ba22af0645ab30ca/images/large/9.jpg not downloaded yet
2026-03-26 22:57:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/26c1073117544068ba22af0645ab30ca/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/26c1073117544068ba22af0645ab30ca/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:57:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F26c1073117544068ba22af0645ab30ca%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/26c1073117544068ba22af0645ab30ca/images/large/10.jpg not downloaded yet
2026-03-26 22:57:59 [ayvens.be] INFO: Found listing with ID: 1985673
2026-03-26 22:57:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985673%27 HTTP/1.1" 200 None
2026-03-26 22:57:59 [ayvens.be] INFO: Scrape type for 1985673: 1
2026-03-26 22:57:59 [ayvens.be] INFO: Extracting data for car ID: 1985673
2026-03-26 22:57:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43bfe296-351d-5e28-8a25-5f5aae11d602 with identifier: 1985673
2026-03-26 22:57:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43bfe296-351d-5e28-8a25-5f5aae11d602 with scrape type 1
2026-03-26 22:57:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 43bfe296-351d-5e28-8a25-5f5aae11d602
2026-03-26 22:57:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252Faa292cb90d15412bad92aff958187080%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/aa292cb90d15412bad92aff958187080/images/large/1.jpg not downloaded yet
2026-03-26 22:57:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252Faa292cb90d15412bad92aff958187080%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:57:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/aa292cb90d15412bad92aff958187080/images/large/2.jpg not downloaded yet
2026-03-26 22:57:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b69e50>
2026-03-26 22:57:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b98af7d6-f024-5aa3-97ef-40e680410d5e/b98af7d6-f024-5aa3-97ef-40e680410d5e_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:57:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:57:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vu%252Fe11b5b6f938849efbb31dcd8d41a2ad6%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:57:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vu/e11b5b6f938849efbb31dcd8d41a2ad6/images/large/10.jpg saved to cache
2026-03-26 22:57:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b98af7d6-f024-5aa3-97ef-40e680410d5e
2026-03-26 22:57:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:57:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7ce92d0>
2026-03-26 22:57:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:57:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:57:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:57:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b98af7d6-f024-5aa3-97ef-40e680410d5e/b98af7d6-f024-5aa3-97ef-40e680410d5e_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:57:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vu%252Fe11b5b6f938849efbb31dcd8d41a2ad6%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vu/e11b5b6f938849efbb31dcd8d41a2ad6/images/large/8.jpg saved to cache
2026-03-26 22:58:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b98af7d6-f024-5aa3-97ef-40e680410d5e
2026-03-26 22:58:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b742b990>
2026-03-26 22:58:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b98af7d6-f024-5aa3-97ef-40e680410d5e/b98af7d6-f024-5aa3-97ef-40e680410d5e_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vu%252Fe11b5b6f938849efbb31dcd8d41a2ad6%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vu/e11b5b6f938849efbb31dcd8d41a2ad6/images/large/9.jpg saved to cache
2026-03-26 22:58:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b98af7d6-f024-5aa3-97ef-40e680410d5e
2026-03-26 22:58:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80beac6d90>
2026-03-26 22:58:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b98af7d6-f024-5aa3-97ef-40e680410d5e/b98af7d6-f024-5aa3-97ef-40e680410d5e_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vu%252Fe11b5b6f938849efbb31dcd8d41a2ad6%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vu/e11b5b6f938849efbb31dcd8d41a2ad6/images/large/7.jpg saved to cache
2026-03-26 22:58:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b98af7d6-f024-5aa3-97ef-40e680410d5e
2026-03-26 22:58:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b98af7d6-f024-5aa3-97ef-40e680410d5e, skipping ID generation
2026-03-26 22:58:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b98af7d6-f024-5aa3-97ef-40e680410d5e with scrape type 1
2026-03-26 22:58:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b98af7d6-f024-5aa3-97ef-40e680410d5e sending to next pipeline
2026-03-26 22:58:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b98af7d6-f024-5aa3-97ef-40e680410d5e, identifier: 1985671
2026-03-26 22:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252Faa292cb90d15412bad92aff958187080%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/aa292cb90d15412bad92aff958187080/images/large/3.jpg not downloaded yet
2026-03-26 22:58:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b98af7d6-f024-5aa3-97ef-40e680410d5e with identifier: 1985671
2026-03-26 22:58:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b98af7d6-f024-5aa3-97ef-40e680410d5e with identifier: 1985671
2026-03-26 22:58:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b98af7d6-f024-5aa3-97ef-40e680410d5e with identifier: 1985671 to the API
2026-03-26 22:58:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:58:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:58:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1vu/e11b5b6f938849efbb31dcd8d41a2ad6/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 182,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b98af7d6-f024-5aa3-97ef-40e680410d5e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT 2T 350M FOU MWB HR DSL',
 'odometer': 40473,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b98af7d6-f024-5aa3-97ef-40e680410d5e/b98af7d6-f024-5aa3-97ef-40e680410d5e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 252382,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1vu/e11b5b6f938849efbb31dcd8d41a2ad6/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b98af7d6-f024-5aa3-97ef-40e680410d5e/b98af7d6-f024-5aa3-97ef-40e680410d5e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 264946,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1vu/e11b5b6f938849efbb31dcd8d41a2ad6/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b98af7d6-f024-5aa3-97ef-40e680410d5e/b98af7d6-f024-5aa3-97ef-40e680410d5e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 246230,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1vu/e11b5b6f938849efbb31dcd8d41a2ad6/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b98af7d6-f024-5aa3-97ef-40e680410d5e/b98af7d6-f024-5aa3-97ef-40e680410d5e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 275997,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1vu/e11b5b6f938849efbb31dcd8d41a2ad6/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b98af7d6-f024-5aa3-97ef-40e680410d5e/b98af7d6-f024-5aa3-97ef-40e680410d5e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 277274,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1vu/e11b5b6f938849efbb31dcd8d41a2ad6/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b98af7d6-f024-5aa3-97ef-40e680410d5e/b98af7d6-f024-5aa3-97ef-40e680410d5e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 315407,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1vu/e11b5b6f938849efbb31dcd8d41a2ad6/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b98af7d6-f024-5aa3-97ef-40e680410d5e/b98af7d6-f024-5aa3-97ef-40e680410d5e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 375747,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1vu/e11b5b6f938849efbb31dcd8d41a2ad6/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b98af7d6-f024-5aa3-97ef-40e680410d5e/b98af7d6-f024-5aa3-97ef-40e680410d5e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 262792,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1vu/e11b5b6f938849efbb31dcd8d41a2ad6/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b98af7d6-f024-5aa3-97ef-40e680410d5e/b98af7d6-f024-5aa3-97ef-40e680410d5e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 261443,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1vu/e11b5b6f938849efbb31dcd8d41a2ad6/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b98af7d6-f024-5aa3-97ef-40e680410d5e/b98af7d6-f024-5aa3-97ef-40e680410d5e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 300237,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1vu/e11b5b6f938849efbb31dcd8d41a2ad6/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-05',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FORD TRANSIT 2T 350M FOU MWB HR DSL 2.0 TDCi L2H2 Trend STOCK',
 'transmission': 'manual',
 'trim': '2.0 TDCi L2H2 Trend STOCK',
 'vin': None,
 'year': 2019}
2026-03-26 22:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985671%27 HTTP/1.1" 200 None
2026-03-26 22:58:00 [ayvens.be] INFO: Saving data for 1985671: {'created_time': 1774565880.636502, 'last_price_update_time': 1774565880.636512, 'auction_closing_time': 1774958400.0}
2026-03-26 22:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985671') HTTP/1.1" 204 0
2026-03-26 22:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252Faa292cb90d15412bad92aff958187080%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/aa292cb90d15412bad92aff958187080/images/large/4.jpg not downloaded yet
2026-03-26 22:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252Faa292cb90d15412bad92aff958187080%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/aa292cb90d15412bad92aff958187080/images/large/5.jpg not downloaded yet
2026-03-26 22:58:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b741e250>
2026-03-26 22:58:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eed05e3d-f763-50bb-8774-2ad0b64eac8d/eed05e3d-f763-50bb-8774-2ad0b64eac8d_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F26c1073117544068ba22af0645ab30ca%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/26c1073117544068ba22af0645ab30ca/images/large/1.jpg saved to cache
2026-03-26 22:58:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item eed05e3d-f763-50bb-8774-2ad0b64eac8d
2026-03-26 22:58:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b6a390>
2026-03-26 22:58:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eed05e3d-f763-50bb-8774-2ad0b64eac8d/eed05e3d-f763-50bb-8774-2ad0b64eac8d_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F26c1073117544068ba22af0645ab30ca%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/26c1073117544068ba22af0645ab30ca/images/large/2.jpg saved to cache
2026-03-26 22:58:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item eed05e3d-f763-50bb-8774-2ad0b64eac8d
2026-03-26 22:58:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/26c1073117544068ba22af0645ab30ca/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252Faa292cb90d15412bad92aff958187080%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/aa292cb90d15412bad92aff958187080/images/large/6.jpg not downloaded yet
2026-03-26 22:58:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/26c1073117544068ba22af0645ab30ca/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/26c1073117544068ba22af0645ab30ca/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252Faa292cb90d15412bad92aff958187080%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/aa292cb90d15412bad92aff958187080/images/large/7.jpg not downloaded yet
2026-03-26 22:58:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/26c1073117544068ba22af0645ab30ca/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/26c1073117544068ba22af0645ab30ca/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/26c1073117544068ba22af0645ab30ca/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252Faa292cb90d15412bad92aff958187080%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/aa292cb90d15412bad92aff958187080/images/large/8.jpg not downloaded yet
2026-03-26 22:58:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/26c1073117544068ba22af0645ab30ca/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/26c1073117544068ba22af0645ab30ca/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252Faa292cb90d15412bad92aff958187080%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/aa292cb90d15412bad92aff958187080/images/large/9.jpg not downloaded yet
2026-03-26 22:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252Faa292cb90d15412bad92aff958187080%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/aa292cb90d15412bad92aff958187080/images/large/10.jpg not downloaded yet
2026-03-26 22:58:00 [ayvens.be] INFO: Found listing with ID: 1985674
2026-03-26 22:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985674%27 HTTP/1.1" 200 None
2026-03-26 22:58:01 [ayvens.be] INFO: Scrape type for 1985674: 1
2026-03-26 22:58:01 [ayvens.be] INFO: Extracting data for car ID: 1985674
2026-03-26 22:58:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d83f80e-b981-55eb-ba32-3dbbda630b16 with identifier: 1985674
2026-03-26 22:58:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d83f80e-b981-55eb-ba32-3dbbda630b16 with scrape type 1
2026-03-26 22:58:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7d83f80e-b981-55eb-ba32-3dbbda630b16
2026-03-26 22:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2du%252F13ad8fcad1ea4f368641647522520f6e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2du/13ad8fcad1ea4f368641647522520f6e/images/large/1.jpg not downloaded yet
2026-03-26 22:58:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7aa39d0>
2026-03-26 22:58:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eed05e3d-f763-50bb-8774-2ad0b64eac8d/eed05e3d-f763-50bb-8774-2ad0b64eac8d_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F26c1073117544068ba22af0645ab30ca%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/26c1073117544068ba22af0645ab30ca/images/large/3.jpg saved to cache
2026-03-26 22:58:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item eed05e3d-f763-50bb-8774-2ad0b64eac8d
2026-03-26 22:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2du%252F13ad8fcad1ea4f368641647522520f6e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2du/13ad8fcad1ea4f368641647522520f6e/images/large/2.jpg not downloaded yet
2026-03-26 22:58:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b69a90>
2026-03-26 22:58:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eed05e3d-f763-50bb-8774-2ad0b64eac8d/eed05e3d-f763-50bb-8774-2ad0b64eac8d_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F26c1073117544068ba22af0645ab30ca%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/26c1073117544068ba22af0645ab30ca/images/large/10.jpg saved to cache
2026-03-26 22:58:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item eed05e3d-f763-50bb-8774-2ad0b64eac8d
2026-03-26 22:58:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7cab310>
2026-03-26 22:58:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eed05e3d-f763-50bb-8774-2ad0b64eac8d/eed05e3d-f763-50bb-8774-2ad0b64eac8d_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F26c1073117544068ba22af0645ab30ca%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/26c1073117544068ba22af0645ab30ca/images/large/9.jpg saved to cache
2026-03-26 22:58:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item eed05e3d-f763-50bb-8774-2ad0b64eac8d
2026-03-26 22:58:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74bcfd0>
2026-03-26 22:58:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eed05e3d-f763-50bb-8774-2ad0b64eac8d/eed05e3d-f763-50bb-8774-2ad0b64eac8d_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F26c1073117544068ba22af0645ab30ca%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/26c1073117544068ba22af0645ab30ca/images/large/5.jpg saved to cache
2026-03-26 22:58:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item eed05e3d-f763-50bb-8774-2ad0b64eac8d
2026-03-26 22:58:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cb1410>
2026-03-26 22:58:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eed05e3d-f763-50bb-8774-2ad0b64eac8d/eed05e3d-f763-50bb-8774-2ad0b64eac8d_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F26c1073117544068ba22af0645ab30ca%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/26c1073117544068ba22af0645ab30ca/images/large/8.jpg saved to cache
2026-03-26 22:58:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item eed05e3d-f763-50bb-8774-2ad0b64eac8d
2026-03-26 22:58:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77ea750>
2026-03-26 22:58:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eed05e3d-f763-50bb-8774-2ad0b64eac8d/eed05e3d-f763-50bb-8774-2ad0b64eac8d_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F26c1073117544068ba22af0645ab30ca%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/26c1073117544068ba22af0645ab30ca/images/large/6.jpg saved to cache
2026-03-26 22:58:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item eed05e3d-f763-50bb-8774-2ad0b64eac8d
2026-03-26 22:58:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7caa810>
2026-03-26 22:58:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eed05e3d-f763-50bb-8774-2ad0b64eac8d/eed05e3d-f763-50bb-8774-2ad0b64eac8d_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F26c1073117544068ba22af0645ab30ca%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/26c1073117544068ba22af0645ab30ca/images/large/7.jpg saved to cache
2026-03-26 22:58:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item eed05e3d-f763-50bb-8774-2ad0b64eac8d
2026-03-26 22:58:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7a839d0>
2026-03-26 22:58:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eed05e3d-f763-50bb-8774-2ad0b64eac8d/eed05e3d-f763-50bb-8774-2ad0b64eac8d_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F26c1073117544068ba22af0645ab30ca%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/26c1073117544068ba22af0645ab30ca/images/large/4.jpg saved to cache
2026-03-26 22:58:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item eed05e3d-f763-50bb-8774-2ad0b64eac8d
2026-03-26 22:58:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: eed05e3d-f763-50bb-8774-2ad0b64eac8d, skipping ID generation
2026-03-26 22:58:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eed05e3d-f763-50bb-8774-2ad0b64eac8d with scrape type 1
2026-03-26 22:58:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item eed05e3d-f763-50bb-8774-2ad0b64eac8d sending to next pipeline
2026-03-26 22:58:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: eed05e3d-f763-50bb-8774-2ad0b64eac8d, identifier: 1985672
2026-03-26 22:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2du%252F13ad8fcad1ea4f368641647522520f6e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2du/13ad8fcad1ea4f368641647522520f6e/images/large/3.jpg not downloaded yet
2026-03-26 22:58:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: eed05e3d-f763-50bb-8774-2ad0b64eac8d with identifier: 1985672
2026-03-26 22:58:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: eed05e3d-f763-50bb-8774-2ad0b64eac8d with identifier: 1985672
2026-03-26 22:58:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: eed05e3d-f763-50bb-8774-2ad0b64eac8d with identifier: 1985672 to the API
2026-03-26 22:58:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:58:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:58:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2dt/26c1073117544068ba22af0645ab30ca/images/large/4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'eed05e3d-f763-50bb-8774-2ad0b64eac8d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF VIII',
 'odometer': 81231,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 18,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eed05e3d-f763-50bb-8774-2ad0b64eac8d/eed05e3d-f763-50bb-8774-2ad0b64eac8d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 690425,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/26c1073117544068ba22af0645ab30ca/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eed05e3d-f763-50bb-8774-2ad0b64eac8d/eed05e3d-f763-50bb-8774-2ad0b64eac8d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 679752,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/26c1073117544068ba22af0645ab30ca/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eed05e3d-f763-50bb-8774-2ad0b64eac8d/eed05e3d-f763-50bb-8774-2ad0b64eac8d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 758331,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/26c1073117544068ba22af0645ab30ca/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eed05e3d-f763-50bb-8774-2ad0b64eac8d/eed05e3d-f763-50bb-8774-2ad0b64eac8d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 713136,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/26c1073117544068ba22af0645ab30ca/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eed05e3d-f763-50bb-8774-2ad0b64eac8d/eed05e3d-f763-50bb-8774-2ad0b64eac8d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 693470,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/26c1073117544068ba22af0645ab30ca/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eed05e3d-f763-50bb-8774-2ad0b64eac8d/eed05e3d-f763-50bb-8774-2ad0b64eac8d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 672725,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/26c1073117544068ba22af0645ab30ca/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eed05e3d-f763-50bb-8774-2ad0b64eac8d/eed05e3d-f763-50bb-8774-2ad0b64eac8d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 732545,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/26c1073117544068ba22af0645ab30ca/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eed05e3d-f763-50bb-8774-2ad0b64eac8d/eed05e3d-f763-50bb-8774-2ad0b64eac8d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 719537,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/26c1073117544068ba22af0645ab30ca/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eed05e3d-f763-50bb-8774-2ad0b64eac8d/eed05e3d-f763-50bb-8774-2ad0b64eac8d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 501984,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/26c1073117544068ba22af0645ab30ca/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eed05e3d-f763-50bb-8774-2ad0b64eac8d/eed05e3d-f763-50bb-8774-2ad0b64eac8d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 452408,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/26c1073117544068ba22af0645ab30ca/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF VIII 1.4 EHYBRID STYLE BUSINESS DSG',
 'transmission': 'automatic',
 'trim': '1.4 EHYBRID STYLE BUSINESS DSG',
 'vin': None,
 'year': 2023}
2026-03-26 22:58:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985672%27 HTTP/1.1" 200 None
2026-03-26 22:58:02 [ayvens.be] INFO: Saving data for 1985672: {'created_time': 1774565882.280723, 'last_price_update_time': 1774565882.280732, 'auction_closing_time': 1774958400.0}
2026-03-26 22:58:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985672') HTTP/1.1" 204 0
2026-03-26 22:58:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2du%252F13ad8fcad1ea4f368641647522520f6e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2du/13ad8fcad1ea4f368641647522520f6e/images/large/4.jpg not downloaded yet
2026-03-26 22:58:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2du%252F13ad8fcad1ea4f368641647522520f6e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2du/13ad8fcad1ea4f368641647522520f6e/images/large/5.jpg not downloaded yet
2026-03-26 22:58:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2du%252F13ad8fcad1ea4f368641647522520f6e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2du/13ad8fcad1ea4f368641647522520f6e/images/large/6.jpg not downloaded yet
2026-03-26 22:58:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/aa292cb90d15412bad92aff958187080/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/aa292cb90d15412bad92aff958187080/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/aa292cb90d15412bad92aff958187080/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/aa292cb90d15412bad92aff958187080/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/aa292cb90d15412bad92aff958187080/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2du%252F13ad8fcad1ea4f368641647522520f6e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2du/13ad8fcad1ea4f368641647522520f6e/images/large/7.jpg not downloaded yet
2026-03-26 22:58:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/aa292cb90d15412bad92aff958187080/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2du%252F13ad8fcad1ea4f368641647522520f6e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2du/13ad8fcad1ea4f368641647522520f6e/images/large/8.jpg not downloaded yet
2026-03-26 22:58:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2du%252F13ad8fcad1ea4f368641647522520f6e%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2du/13ad8fcad1ea4f368641647522520f6e/images/large/9.jpg not downloaded yet
2026-03-26 22:58:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2du%252F13ad8fcad1ea4f368641647522520f6e%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2du/13ad8fcad1ea4f368641647522520f6e/images/large/10.jpg not downloaded yet
2026-03-26 22:58:02 [ayvens.be] INFO: Found listing with ID: 1985675
2026-03-26 22:58:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985675%27 HTTP/1.1" 200 None
2026-03-26 22:58:02 [ayvens.be] INFO: Scrape type for 1985675: 1
2026-03-26 22:58:02 [ayvens.be] INFO: Extracting data for car ID: 1985675
2026-03-26 22:58:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b3f96dd9-a309-5d3d-b9f0-8186628076bd with identifier: 1985675
2026-03-26 22:58:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3f96dd9-a309-5d3d-b9f0-8186628076bd with scrape type 1
2026-03-26 22:58:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b3f96dd9-a309-5d3d-b9f0-8186628076bd
2026-03-26 22:58:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fdbc9765a1bc64025aaebdff11d3d15ab%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/dbc9765a1bc64025aaebdff11d3d15ab/images/large/1.jpg not downloaded yet
2026-03-26 22:58:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fdbc9765a1bc64025aaebdff11d3d15ab%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/dbc9765a1bc64025aaebdff11d3d15ab/images/large/2.jpg not downloaded yet
2026-03-26 22:58:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7415f10>
2026-03-26 22:58:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43bfe296-351d-5e28-8a25-5f5aae11d602/43bfe296-351d-5e28-8a25-5f5aae11d602_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:58:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252Faa292cb90d15412bad92aff958187080%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/aa292cb90d15412bad92aff958187080/images/large/4.jpg saved to cache
2026-03-26 22:58:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 43bfe296-351d-5e28-8a25-5f5aae11d602
2026-03-26 22:58:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77c9fd0>
2026-03-26 22:58:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43bfe296-351d-5e28-8a25-5f5aae11d602/43bfe296-351d-5e28-8a25-5f5aae11d602_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:58:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252Faa292cb90d15412bad92aff958187080%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/aa292cb90d15412bad92aff958187080/images/large/6.jpg saved to cache
2026-03-26 22:58:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 43bfe296-351d-5e28-8a25-5f5aae11d602
2026-03-26 22:58:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7660090>
2026-03-26 22:58:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43bfe296-351d-5e28-8a25-5f5aae11d602/43bfe296-351d-5e28-8a25-5f5aae11d602_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:58:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252Faa292cb90d15412bad92aff958187080%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/aa292cb90d15412bad92aff958187080/images/large/3.jpg saved to cache
2026-03-26 22:58:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 43bfe296-351d-5e28-8a25-5f5aae11d602
2026-03-26 22:58:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7429690>
2026-03-26 22:58:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43bfe296-351d-5e28-8a25-5f5aae11d602/43bfe296-351d-5e28-8a25-5f5aae11d602_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:58:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252Faa292cb90d15412bad92aff958187080%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/aa292cb90d15412bad92aff958187080/images/large/5.jpg saved to cache
2026-03-26 22:58:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 43bfe296-351d-5e28-8a25-5f5aae11d602
2026-03-26 22:58:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b78c1f50>
2026-03-26 22:58:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43bfe296-351d-5e28-8a25-5f5aae11d602/43bfe296-351d-5e28-8a25-5f5aae11d602_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:58:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252Faa292cb90d15412bad92aff958187080%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/aa292cb90d15412bad92aff958187080/images/large/2.jpg saved to cache
2026-03-26 22:58:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 43bfe296-351d-5e28-8a25-5f5aae11d602
2026-03-26 22:58:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2du/13ad8fcad1ea4f368641647522520f6e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fdbc9765a1bc64025aaebdff11d3d15ab%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/dbc9765a1bc64025aaebdff11d3d15ab/images/large/3.jpg not downloaded yet
2026-03-26 22:58:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b73044d0>
2026-03-26 22:58:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43bfe296-351d-5e28-8a25-5f5aae11d602/43bfe296-351d-5e28-8a25-5f5aae11d602_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:58:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252Faa292cb90d15412bad92aff958187080%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/aa292cb90d15412bad92aff958187080/images/large/1.jpg saved to cache
2026-03-26 22:58:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 43bfe296-351d-5e28-8a25-5f5aae11d602
2026-03-26 22:58:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fdbc9765a1bc64025aaebdff11d3d15ab%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/dbc9765a1bc64025aaebdff11d3d15ab/images/large/4.jpg not downloaded yet
2026-03-26 22:58:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fdbc9765a1bc64025aaebdff11d3d15ab%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/dbc9765a1bc64025aaebdff11d3d15ab/images/large/5.jpg not downloaded yet
2026-03-26 22:58:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fdbc9765a1bc64025aaebdff11d3d15ab%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/dbc9765a1bc64025aaebdff11d3d15ab/images/large/6.jpg not downloaded yet
2026-03-26 22:58:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/aa292cb90d15412bad92aff958187080/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74ce350>
2026-03-26 22:58:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d83f80e-b981-55eb-ba32-3dbbda630b16/7d83f80e-b981-55eb-ba32-3dbbda630b16_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:58:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2du%252F13ad8fcad1ea4f368641647522520f6e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2du/13ad8fcad1ea4f368641647522520f6e/images/large/2.jpg saved to cache
2026-03-26 22:58:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7d83f80e-b981-55eb-ba32-3dbbda630b16
2026-03-26 22:58:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/aa292cb90d15412bad92aff958187080/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/aa292cb90d15412bad92aff958187080/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fdbc9765a1bc64025aaebdff11d3d15ab%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/dbc9765a1bc64025aaebdff11d3d15ab/images/large/7.jpg not downloaded yet
2026-03-26 22:58:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/aa292cb90d15412bad92aff958187080/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2du/13ad8fcad1ea4f368641647522520f6e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2du/13ad8fcad1ea4f368641647522520f6e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fdbc9765a1bc64025aaebdff11d3d15ab%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/dbc9765a1bc64025aaebdff11d3d15ab/images/large/8.jpg not downloaded yet
2026-03-26 22:58:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2du/13ad8fcad1ea4f368641647522520f6e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fdbc9765a1bc64025aaebdff11d3d15ab%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/dbc9765a1bc64025aaebdff11d3d15ab/images/large/9.jpg not downloaded yet
2026-03-26 22:58:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e02cd0>
2026-03-26 22:58:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43bfe296-351d-5e28-8a25-5f5aae11d602/43bfe296-351d-5e28-8a25-5f5aae11d602_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:58:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252Faa292cb90d15412bad92aff958187080%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/aa292cb90d15412bad92aff958187080/images/large/7.jpg saved to cache
2026-03-26 22:58:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 43bfe296-351d-5e28-8a25-5f5aae11d602
2026-03-26 22:58:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fdbc9765a1bc64025aaebdff11d3d15ab%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/dbc9765a1bc64025aaebdff11d3d15ab/images/large/10.jpg not downloaded yet
2026-03-26 22:58:03 [ayvens.be] INFO: Found listing with ID: 1985676
2026-03-26 22:58:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985676%27 HTTP/1.1" 200 None
2026-03-26 22:58:03 [ayvens.be] INFO: Scrape type for 1985676: 1
2026-03-26 22:58:03 [ayvens.be] INFO: Extracting data for car ID: 1985676
2026-03-26 22:58:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a020241f-9671-558c-b1cb-37c2c25a38ed with identifier: 1985676
2026-03-26 22:58:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a020241f-9671-558c-b1cb-37c2c25a38ed with scrape type 1
2026-03-26 22:58:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a020241f-9671-558c-b1cb-37c2c25a38ed
2026-03-26 22:58:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252Fa4e8a6002a164ea99aed05581cf04e47%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/a4e8a6002a164ea99aed05581cf04e47/images/large/1.jpg not downloaded yet
2026-03-26 22:58:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2du/13ad8fcad1ea4f368641647522520f6e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c83250>
2026-03-26 22:58:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43bfe296-351d-5e28-8a25-5f5aae11d602/43bfe296-351d-5e28-8a25-5f5aae11d602_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:58:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252Faa292cb90d15412bad92aff958187080%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/aa292cb90d15412bad92aff958187080/images/large/10.jpg saved to cache
2026-03-26 22:58:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 43bfe296-351d-5e28-8a25-5f5aae11d602
2026-03-26 22:58:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74df410>
2026-03-26 22:58:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43bfe296-351d-5e28-8a25-5f5aae11d602/43bfe296-351d-5e28-8a25-5f5aae11d602_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:58:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252Faa292cb90d15412bad92aff958187080%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/aa292cb90d15412bad92aff958187080/images/large/9.jpg saved to cache
2026-03-26 22:58:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 43bfe296-351d-5e28-8a25-5f5aae11d602
2026-03-26 22:58:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cbda10>
2026-03-26 22:58:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43bfe296-351d-5e28-8a25-5f5aae11d602/43bfe296-351d-5e28-8a25-5f5aae11d602_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:58:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252Faa292cb90d15412bad92aff958187080%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/aa292cb90d15412bad92aff958187080/images/large/8.jpg saved to cache
2026-03-26 22:58:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 43bfe296-351d-5e28-8a25-5f5aae11d602
2026-03-26 22:58:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 43bfe296-351d-5e28-8a25-5f5aae11d602, skipping ID generation
2026-03-26 22:58:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43bfe296-351d-5e28-8a25-5f5aae11d602 with scrape type 1
2026-03-26 22:58:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 43bfe296-351d-5e28-8a25-5f5aae11d602 sending to next pipeline
2026-03-26 22:58:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 43bfe296-351d-5e28-8a25-5f5aae11d602, identifier: 1985673
2026-03-26 22:58:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74a7a10>
2026-03-26 22:58:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d83f80e-b981-55eb-ba32-3dbbda630b16/7d83f80e-b981-55eb-ba32-3dbbda630b16_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2du%252F13ad8fcad1ea4f368641647522520f6e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2du/13ad8fcad1ea4f368641647522520f6e/images/large/4.jpg saved to cache
2026-03-26 22:58:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7d83f80e-b981-55eb-ba32-3dbbda630b16
2026-03-26 22:58:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7416590>
2026-03-26 22:58:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d83f80e-b981-55eb-ba32-3dbbda630b16/7d83f80e-b981-55eb-ba32-3dbbda630b16_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2du%252F13ad8fcad1ea4f368641647522520f6e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2du/13ad8fcad1ea4f368641647522520f6e/images/large/1.jpg saved to cache
2026-03-26 22:58:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7d83f80e-b981-55eb-ba32-3dbbda630b16
2026-03-26 22:58:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6dec510>
2026-03-26 22:58:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d83f80e-b981-55eb-ba32-3dbbda630b16/7d83f80e-b981-55eb-ba32-3dbbda630b16_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2du%252F13ad8fcad1ea4f368641647522520f6e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2du/13ad8fcad1ea4f368641647522520f6e/images/large/3.jpg saved to cache
2026-03-26 22:58:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7d83f80e-b981-55eb-ba32-3dbbda630b16
2026-03-26 22:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252Fa4e8a6002a164ea99aed05581cf04e47%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/a4e8a6002a164ea99aed05581cf04e47/images/large/2.jpg not downloaded yet
2026-03-26 22:58:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 43bfe296-351d-5e28-8a25-5f5aae11d602 with identifier: 1985673
2026-03-26 22:58:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 43bfe296-351d-5e28-8a25-5f5aae11d602 with identifier: 1985673
2026-03-26 22:58:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 43bfe296-351d-5e28-8a25-5f5aae11d602 with identifier: 1985673 to the API
2026-03-26 22:58:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:58:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:58:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ce/aa292cb90d15412bad92aff958187080/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '43bfe296-351d-5e28-8a25-5f5aae11d602',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3 Sportback',
 'odometer': 53332,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43bfe296-351d-5e28-8a25-5f5aae11d602/43bfe296-351d-5e28-8a25-5f5aae11d602_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 658734,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/aa292cb90d15412bad92aff958187080/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43bfe296-351d-5e28-8a25-5f5aae11d602/43bfe296-351d-5e28-8a25-5f5aae11d602_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 676140,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/aa292cb90d15412bad92aff958187080/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43bfe296-351d-5e28-8a25-5f5aae11d602/43bfe296-351d-5e28-8a25-5f5aae11d602_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 713716,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/aa292cb90d15412bad92aff958187080/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43bfe296-351d-5e28-8a25-5f5aae11d602/43bfe296-351d-5e28-8a25-5f5aae11d602_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 687974,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/aa292cb90d15412bad92aff958187080/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43bfe296-351d-5e28-8a25-5f5aae11d602/43bfe296-351d-5e28-8a25-5f5aae11d602_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 674057,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/aa292cb90d15412bad92aff958187080/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43bfe296-351d-5e28-8a25-5f5aae11d602/43bfe296-351d-5e28-8a25-5f5aae11d602_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 687725,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/aa292cb90d15412bad92aff958187080/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43bfe296-351d-5e28-8a25-5f5aae11d602/43bfe296-351d-5e28-8a25-5f5aae11d602_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 592521,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/aa292cb90d15412bad92aff958187080/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43bfe296-351d-5e28-8a25-5f5aae11d602/43bfe296-351d-5e28-8a25-5f5aae11d602_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 731367,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/aa292cb90d15412bad92aff958187080/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43bfe296-351d-5e28-8a25-5f5aae11d602/43bfe296-351d-5e28-8a25-5f5aae11d602_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 712720,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/aa292cb90d15412bad92aff958187080/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43bfe296-351d-5e28-8a25-5f5aae11d602/43bfe296-351d-5e28-8a25-5f5aae11d602_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 706162,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/aa292cb90d15412bad92aff958187080/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 Sportback 1.4 45 TFSI E S TRONIC',
 'transmission': 'automatic',
 'trim': '1.4 45 TFSI E S TRONIC',
 'vin': None,
 'year': 2022}
2026-03-26 22:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985673%27 HTTP/1.1" 200 None
2026-03-26 22:58:04 [ayvens.be] INFO: Saving data for 1985673: {'created_time': 1774565884.565044, 'last_price_update_time': 1774565884.565054, 'auction_closing_time': 1774958400.0}
2026-03-26 22:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985673') HTTP/1.1" 204 0
2026-03-26 22:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252Fa4e8a6002a164ea99aed05581cf04e47%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/a4e8a6002a164ea99aed05581cf04e47/images/large/3.jpg not downloaded yet
2026-03-26 22:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252Fa4e8a6002a164ea99aed05581cf04e47%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/a4e8a6002a164ea99aed05581cf04e47/images/large/4.jpg not downloaded yet
2026-03-26 22:58:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77bc250>
2026-03-26 22:58:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d83f80e-b981-55eb-ba32-3dbbda630b16/7d83f80e-b981-55eb-ba32-3dbbda630b16_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2du%252F13ad8fcad1ea4f368641647522520f6e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2du/13ad8fcad1ea4f368641647522520f6e/images/large/5.jpg saved to cache
2026-03-26 22:58:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7d83f80e-b981-55eb-ba32-3dbbda630b16
2026-03-26 22:58:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/dbc9765a1bc64025aaebdff11d3d15ab/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2du/13ad8fcad1ea4f368641647522520f6e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2du/13ad8fcad1ea4f368641647522520f6e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252Fa4e8a6002a164ea99aed05581cf04e47%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/a4e8a6002a164ea99aed05581cf04e47/images/large/5.jpg not downloaded yet
2026-03-26 22:58:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2du/13ad8fcad1ea4f368641647522520f6e/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2du/13ad8fcad1ea4f368641647522520f6e/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252Fa4e8a6002a164ea99aed05581cf04e47%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/a4e8a6002a164ea99aed05581cf04e47/images/large/6.jpg not downloaded yet
2026-03-26 22:58:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2du/13ad8fcad1ea4f368641647522520f6e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/dbc9765a1bc64025aaebdff11d3d15ab/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252Fa4e8a6002a164ea99aed05581cf04e47%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/a4e8a6002a164ea99aed05581cf04e47/images/large/7.jpg not downloaded yet
2026-03-26 22:58:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/dbc9765a1bc64025aaebdff11d3d15ab/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252Fa4e8a6002a164ea99aed05581cf04e47%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/a4e8a6002a164ea99aed05581cf04e47/images/large/8.jpg not downloaded yet
2026-03-26 22:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252Fa4e8a6002a164ea99aed05581cf04e47%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/a4e8a6002a164ea99aed05581cf04e47/images/large/9.jpg not downloaded yet
2026-03-26 22:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252Fa4e8a6002a164ea99aed05581cf04e47%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/a4e8a6002a164ea99aed05581cf04e47/images/large/10.jpg not downloaded yet
2026-03-26 22:58:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c7f650>
2026-03-26 22:58:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3f96dd9-a309-5d3d-b9f0-8186628076bd/b3f96dd9-a309-5d3d-b9f0-8186628076bd_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fdbc9765a1bc64025aaebdff11d3d15ab%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/dbc9765a1bc64025aaebdff11d3d15ab/images/large/1.jpg saved to cache
2026-03-26 22:58:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b3f96dd9-a309-5d3d-b9f0-8186628076bd
2026-03-26 22:58:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b78ab810>
2026-03-26 22:58:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d83f80e-b981-55eb-ba32-3dbbda630b16/7d83f80e-b981-55eb-ba32-3dbbda630b16_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2du%252F13ad8fcad1ea4f368641647522520f6e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2du/13ad8fcad1ea4f368641647522520f6e/images/large/7.jpg saved to cache
2026-03-26 22:58:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7d83f80e-b981-55eb-ba32-3dbbda630b16
2026-03-26 22:58:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7407cd0>
2026-03-26 22:58:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d83f80e-b981-55eb-ba32-3dbbda630b16/7d83f80e-b981-55eb-ba32-3dbbda630b16_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:58:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2du%252F13ad8fcad1ea4f368641647522520f6e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2du/13ad8fcad1ea4f368641647522520f6e/images/large/6.jpg saved to cache
2026-03-26 22:58:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7d83f80e-b981-55eb-ba32-3dbbda630b16
2026-03-26 22:58:05 [ayvens.be] INFO: Found listing with ID: 1985677
2026-03-26 22:58:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985677%27 HTTP/1.1" 200 None
2026-03-26 22:58:05 [ayvens.be] INFO: Scrape type for 1985677: 1
2026-03-26 22:58:05 [ayvens.be] INFO: Extracting data for car ID: 1985677
2026-03-26 22:58:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1df76a12-ab1c-5bdf-9805-12191f762d3c with identifier: 1985677
2026-03-26 22:58:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1df76a12-ab1c-5bdf-9805-12191f762d3c with scrape type 1
2026-03-26 22:58:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1df76a12-ab1c-5bdf-9805-12191f762d3c
2026-03-26 22:58:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Fd7515d5ffa33424fa0b072717607391e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/d7515d5ffa33424fa0b072717607391e/images/large/1.jpg not downloaded yet
2026-03-26 22:58:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76e0550>
2026-03-26 22:58:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d83f80e-b981-55eb-ba32-3dbbda630b16/7d83f80e-b981-55eb-ba32-3dbbda630b16_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:58:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2du%252F13ad8fcad1ea4f368641647522520f6e%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2du/13ad8fcad1ea4f368641647522520f6e/images/large/10.jpg saved to cache
2026-03-26 22:58:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7d83f80e-b981-55eb-ba32-3dbbda630b16
2026-03-26 22:58:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7726f50>
2026-03-26 22:58:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d83f80e-b981-55eb-ba32-3dbbda630b16/7d83f80e-b981-55eb-ba32-3dbbda630b16_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:58:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2du%252F13ad8fcad1ea4f368641647522520f6e%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2du/13ad8fcad1ea4f368641647522520f6e/images/large/9.jpg saved to cache
2026-03-26 22:58:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7d83f80e-b981-55eb-ba32-3dbbda630b16
2026-03-26 22:58:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Fd7515d5ffa33424fa0b072717607391e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/d7515d5ffa33424fa0b072717607391e/images/large/2.jpg not downloaded yet
2026-03-26 22:58:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Fd7515d5ffa33424fa0b072717607391e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/d7515d5ffa33424fa0b072717607391e/images/large/3.jpg not downloaded yet
2026-03-26 22:58:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76e12d0>
2026-03-26 22:58:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d83f80e-b981-55eb-ba32-3dbbda630b16/7d83f80e-b981-55eb-ba32-3dbbda630b16_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:58:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2du%252F13ad8fcad1ea4f368641647522520f6e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2du/13ad8fcad1ea4f368641647522520f6e/images/large/8.jpg saved to cache
2026-03-26 22:58:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7d83f80e-b981-55eb-ba32-3dbbda630b16
2026-03-26 22:58:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7d83f80e-b981-55eb-ba32-3dbbda630b16, skipping ID generation
2026-03-26 22:58:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d83f80e-b981-55eb-ba32-3dbbda630b16 with scrape type 1
2026-03-26 22:58:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7d83f80e-b981-55eb-ba32-3dbbda630b16 sending to next pipeline
2026-03-26 22:58:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 7d83f80e-b981-55eb-ba32-3dbbda630b16, identifier: 1985674
2026-03-26 22:58:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e343d0>
2026-03-26 22:58:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3f96dd9-a309-5d3d-b9f0-8186628076bd/b3f96dd9-a309-5d3d-b9f0-8186628076bd_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:58:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fdbc9765a1bc64025aaebdff11d3d15ab%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/dbc9765a1bc64025aaebdff11d3d15ab/images/large/3.jpg saved to cache
2026-03-26 22:58:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b3f96dd9-a309-5d3d-b9f0-8186628076bd
2026-03-26 22:58:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7429110>
2026-03-26 22:58:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3f96dd9-a309-5d3d-b9f0-8186628076bd/b3f96dd9-a309-5d3d-b9f0-8186628076bd_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:58:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fdbc9765a1bc64025aaebdff11d3d15ab%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/dbc9765a1bc64025aaebdff11d3d15ab/images/large/2.jpg saved to cache
2026-03-26 22:58:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b3f96dd9-a309-5d3d-b9f0-8186628076bd
2026-03-26 22:58:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/dbc9765a1bc64025aaebdff11d3d15ab/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 7d83f80e-b981-55eb-ba32-3dbbda630b16 with identifier: 1985674
2026-03-26 22:58:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 7d83f80e-b981-55eb-ba32-3dbbda630b16 with identifier: 1985674
2026-03-26 22:58:05 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 7d83f80e-b981-55eb-ba32-3dbbda630b16 with identifier: 1985674 to the API
2026-03-26 22:58:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:58:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:58:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2du/13ad8fcad1ea4f368641647522520f6e/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '7d83f80e-b981-55eb-ba32-3dbbda630b16',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLA SHOOTING BRAKE',
 'odometer': 61618,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d83f80e-b981-55eb-ba32-3dbbda630b16/7d83f80e-b981-55eb-ba32-3dbbda630b16_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 685994,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2du/13ad8fcad1ea4f368641647522520f6e/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d83f80e-b981-55eb-ba32-3dbbda630b16/7d83f80e-b981-55eb-ba32-3dbbda630b16_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 669737,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2du/13ad8fcad1ea4f368641647522520f6e/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d83f80e-b981-55eb-ba32-3dbbda630b16/7d83f80e-b981-55eb-ba32-3dbbda630b16_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 707584,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2du/13ad8fcad1ea4f368641647522520f6e/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d83f80e-b981-55eb-ba32-3dbbda630b16/7d83f80e-b981-55eb-ba32-3dbbda630b16_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 716156,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2du/13ad8fcad1ea4f368641647522520f6e/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d83f80e-b981-55eb-ba32-3dbbda630b16/7d83f80e-b981-55eb-ba32-3dbbda630b16_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 691285,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2du/13ad8fcad1ea4f368641647522520f6e/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d83f80e-b981-55eb-ba32-3dbbda630b16/7d83f80e-b981-55eb-ba32-3dbbda630b16_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 707115,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2du/13ad8fcad1ea4f368641647522520f6e/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d83f80e-b981-55eb-ba32-3dbbda630b16/7d83f80e-b981-55eb-ba32-3dbbda630b16_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 689496,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2du/13ad8fcad1ea4f368641647522520f6e/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d83f80e-b981-55eb-ba32-3dbbda630b16/7d83f80e-b981-55eb-ba32-3dbbda630b16_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 859135,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2du/13ad8fcad1ea4f368641647522520f6e/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d83f80e-b981-55eb-ba32-3dbbda630b16/7d83f80e-b981-55eb-ba32-3dbbda630b16_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 792310,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2du/13ad8fcad1ea4f368641647522520f6e/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d83f80e-b981-55eb-ba32-3dbbda630b16/7d83f80e-b981-55eb-ba32-3dbbda630b16_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 776646,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2du/13ad8fcad1ea4f368641647522520f6e/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLA SHOOTING BRAKE 1.3 CLA 250 E BUSINESS SOLUTION '
          'DCT',
 'transmission': 'automatic',
 'trim': '1.3 CLA 250 E BUSINESS SOLUTION DCT',
 'vin': None,
 'year': 2023}
2026-03-26 22:58:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985674%27 HTTP/1.1" 200 None
2026-03-26 22:58:05 [ayvens.be] INFO: Saving data for 1985674: {'created_time': 1774565885.995422, 'last_price_update_time': 1774565885.995434, 'auction_closing_time': 1774958400.0}
2026-03-26 22:58:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985674') HTTP/1.1" 204 0
2026-03-26 22:58:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Fd7515d5ffa33424fa0b072717607391e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/d7515d5ffa33424fa0b072717607391e/images/large/4.jpg not downloaded yet
2026-03-26 22:58:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/a4e8a6002a164ea99aed05581cf04e47/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Fd7515d5ffa33424fa0b072717607391e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/d7515d5ffa33424fa0b072717607391e/images/large/5.jpg not downloaded yet
2026-03-26 22:58:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/dbc9765a1bc64025aaebdff11d3d15ab/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/a4e8a6002a164ea99aed05581cf04e47/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7a61090>
2026-03-26 22:58:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3f96dd9-a309-5d3d-b9f0-8186628076bd/b3f96dd9-a309-5d3d-b9f0-8186628076bd_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:58:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fdbc9765a1bc64025aaebdff11d3d15ab%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/dbc9765a1bc64025aaebdff11d3d15ab/images/large/6.jpg saved to cache
2026-03-26 22:58:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b3f96dd9-a309-5d3d-b9f0-8186628076bd
2026-03-26 22:58:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/dbc9765a1bc64025aaebdff11d3d15ab/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/dbc9765a1bc64025aaebdff11d3d15ab/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Fd7515d5ffa33424fa0b072717607391e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/d7515d5ffa33424fa0b072717607391e/images/large/6.jpg not downloaded yet
2026-03-26 22:58:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/dbc9765a1bc64025aaebdff11d3d15ab/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/dbc9765a1bc64025aaebdff11d3d15ab/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Fd7515d5ffa33424fa0b072717607391e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/d7515d5ffa33424fa0b072717607391e/images/large/7.jpg not downloaded yet
2026-03-26 22:58:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7946a90>
2026-03-26 22:58:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a020241f-9671-558c-b1cb-37c2c25a38ed/a020241f-9671-558c-b1cb-37c2c25a38ed_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:58:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252Fa4e8a6002a164ea99aed05581cf04e47%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/a4e8a6002a164ea99aed05581cf04e47/images/large/1.jpg saved to cache
2026-03-26 22:58:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a020241f-9671-558c-b1cb-37c2c25a38ed
2026-03-26 22:58:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c76d10>
2026-03-26 22:58:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3f96dd9-a309-5d3d-b9f0-8186628076bd/b3f96dd9-a309-5d3d-b9f0-8186628076bd_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:58:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fdbc9765a1bc64025aaebdff11d3d15ab%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/dbc9765a1bc64025aaebdff11d3d15ab/images/large/9.jpg saved to cache
2026-03-26 22:58:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b3f96dd9-a309-5d3d-b9f0-8186628076bd
2026-03-26 22:58:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Fd7515d5ffa33424fa0b072717607391e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/d7515d5ffa33424fa0b072717607391e/images/large/8.jpg not downloaded yet
2026-03-26 22:58:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b777ab50>
2026-03-26 22:58:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a020241f-9671-558c-b1cb-37c2c25a38ed/a020241f-9671-558c-b1cb-37c2c25a38ed_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:58:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252Fa4e8a6002a164ea99aed05581cf04e47%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/a4e8a6002a164ea99aed05581cf04e47/images/large/2.jpg saved to cache
2026-03-26 22:58:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a020241f-9671-558c-b1cb-37c2c25a38ed
2026-03-26 22:58:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Fd7515d5ffa33424fa0b072717607391e%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/d7515d5ffa33424fa0b072717607391e/images/large/9.jpg not downloaded yet
2026-03-26 22:58:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b75a5e10>
2026-03-26 22:58:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3f96dd9-a309-5d3d-b9f0-8186628076bd/b3f96dd9-a309-5d3d-b9f0-8186628076bd_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:58:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fdbc9765a1bc64025aaebdff11d3d15ab%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/dbc9765a1bc64025aaebdff11d3d15ab/images/large/8.jpg saved to cache
2026-03-26 22:58:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b3f96dd9-a309-5d3d-b9f0-8186628076bd
2026-03-26 22:58:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c7c290>
2026-03-26 22:58:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3f96dd9-a309-5d3d-b9f0-8186628076bd/b3f96dd9-a309-5d3d-b9f0-8186628076bd_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:58:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fdbc9765a1bc64025aaebdff11d3d15ab%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/dbc9765a1bc64025aaebdff11d3d15ab/images/large/5.jpg saved to cache
2026-03-26 22:58:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b3f96dd9-a309-5d3d-b9f0-8186628076bd
2026-03-26 22:58:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7dd08d0>
2026-03-26 22:58:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3f96dd9-a309-5d3d-b9f0-8186628076bd/b3f96dd9-a309-5d3d-b9f0-8186628076bd_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:58:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fdbc9765a1bc64025aaebdff11d3d15ab%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/dbc9765a1bc64025aaebdff11d3d15ab/images/large/4.jpg saved to cache
2026-03-26 22:58:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b3f96dd9-a309-5d3d-b9f0-8186628076bd
2026-03-26 22:58:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7404bd0>
2026-03-26 22:58:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3f96dd9-a309-5d3d-b9f0-8186628076bd/b3f96dd9-a309-5d3d-b9f0-8186628076bd_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:58:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fdbc9765a1bc64025aaebdff11d3d15ab%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/dbc9765a1bc64025aaebdff11d3d15ab/images/large/7.jpg saved to cache
2026-03-26 22:58:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b3f96dd9-a309-5d3d-b9f0-8186628076bd
2026-03-26 22:58:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/d7515d5ffa33424fa0b072717607391e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:07 [scrapy.extensions.logstats] INFO: Crawled 8 pages (at -1 pages/min), scraped 455 items (at 37 items/min)
2026-03-26 22:58:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 182MiB
2026-03-26 22:58:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Fd7515d5ffa33424fa0b072717607391e%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/d7515d5ffa33424fa0b072717607391e/images/large/10.jpg not downloaded yet
2026-03-26 22:58:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/dbc9765a1bc64025aaebdff11d3d15ab/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/a4e8a6002a164ea99aed05581cf04e47/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:07 [ayvens.be] INFO: Found listing with ID: 1985678
2026-03-26 22:58:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985678%27 HTTP/1.1" 200 None
2026-03-26 22:58:07 [ayvens.be] INFO: Scrape type for 1985678: 1
2026-03-26 22:58:07 [ayvens.be] INFO: Extracting data for car ID: 1985678
2026-03-26 22:58:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f95b6f5-ec00-5c09-9f02-b54ca7a1e021 with identifier: 1985678
2026-03-26 22:58:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f95b6f5-ec00-5c09-9f02-b54ca7a1e021 with scrape type 1
2026-03-26 22:58:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6f95b6f5-ec00-5c09-9f02-b54ca7a1e021
2026-03-26 22:58:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F24ddf958ec73434c8de2f5c2d4044901%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/24ddf958ec73434c8de2f5c2d4044901/images/large/1.jpg not downloaded yet
2026-03-26 22:58:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/a4e8a6002a164ea99aed05581cf04e47/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/a4e8a6002a164ea99aed05581cf04e47/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F24ddf958ec73434c8de2f5c2d4044901%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/24ddf958ec73434c8de2f5c2d4044901/images/large/2.jpg not downloaded yet
2026-03-26 22:58:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/a4e8a6002a164ea99aed05581cf04e47/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F24ddf958ec73434c8de2f5c2d4044901%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/24ddf958ec73434c8de2f5c2d4044901/images/large/3.jpg not downloaded yet
2026-03-26 22:58:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/a4e8a6002a164ea99aed05581cf04e47/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/d7515d5ffa33424fa0b072717607391e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F24ddf958ec73434c8de2f5c2d4044901%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/24ddf958ec73434c8de2f5c2d4044901/images/large/4.jpg not downloaded yet
2026-03-26 22:58:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7a63810>
2026-03-26 22:58:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1df76a12-ab1c-5bdf-9805-12191f762d3c/1df76a12-ab1c-5bdf-9805-12191f762d3c_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:58:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Fd7515d5ffa33424fa0b072717607391e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/d7515d5ffa33424fa0b072717607391e/images/large/1.jpg saved to cache
2026-03-26 22:58:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1df76a12-ab1c-5bdf-9805-12191f762d3c
2026-03-26 22:58:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/a4e8a6002a164ea99aed05581cf04e47/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F24ddf958ec73434c8de2f5c2d4044901%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/24ddf958ec73434c8de2f5c2d4044901/images/large/5.jpg not downloaded yet
2026-03-26 22:58:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b78a9790>
2026-03-26 22:58:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3f96dd9-a309-5d3d-b9f0-8186628076bd/b3f96dd9-a309-5d3d-b9f0-8186628076bd_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:58:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fdbc9765a1bc64025aaebdff11d3d15ab%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/dbc9765a1bc64025aaebdff11d3d15ab/images/large/10.jpg saved to cache
2026-03-26 22:58:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b3f96dd9-a309-5d3d-b9f0-8186628076bd
2026-03-26 22:58:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b3f96dd9-a309-5d3d-b9f0-8186628076bd, skipping ID generation
2026-03-26 22:58:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3f96dd9-a309-5d3d-b9f0-8186628076bd with scrape type 1
2026-03-26 22:58:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b3f96dd9-a309-5d3d-b9f0-8186628076bd sending to next pipeline
2026-03-26 22:58:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b3f96dd9-a309-5d3d-b9f0-8186628076bd, identifier: 1985675
2026-03-26 22:58:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7410510>
2026-03-26 22:58:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a020241f-9671-558c-b1cb-37c2c25a38ed/a020241f-9671-558c-b1cb-37c2c25a38ed_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:58:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252Fa4e8a6002a164ea99aed05581cf04e47%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/a4e8a6002a164ea99aed05581cf04e47/images/large/4.jpg saved to cache
2026-03-26 22:58:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a020241f-9671-558c-b1cb-37c2c25a38ed
2026-03-26 22:58:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/d7515d5ffa33424fa0b072717607391e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/d7515d5ffa33424fa0b072717607391e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F24ddf958ec73434c8de2f5c2d4044901%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/24ddf958ec73434c8de2f5c2d4044901/images/large/6.jpg not downloaded yet
2026-03-26 22:58:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b3f96dd9-a309-5d3d-b9f0-8186628076bd with identifier: 1985675
2026-03-26 22:58:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b3f96dd9-a309-5d3d-b9f0-8186628076bd with identifier: 1985675
2026-03-26 22:58:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b3f96dd9-a309-5d3d-b9f0-8186628076bd with identifier: 1985675 to the API
2026-03-26 22:58:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:58:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:58:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2dt/dbc9765a1bc64025aaebdff11d3d15ab/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'b3f96dd9-a309-5d3d-b9f0-8186628076bd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF VIII',
 'odometer': 50581,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3f96dd9-a309-5d3d-b9f0-8186628076bd/b3f96dd9-a309-5d3d-b9f0-8186628076bd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 634542,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/dbc9765a1bc64025aaebdff11d3d15ab/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3f96dd9-a309-5d3d-b9f0-8186628076bd/b3f96dd9-a309-5d3d-b9f0-8186628076bd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 629629,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/dbc9765a1bc64025aaebdff11d3d15ab/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3f96dd9-a309-5d3d-b9f0-8186628076bd/b3f96dd9-a309-5d3d-b9f0-8186628076bd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 646892,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/dbc9765a1bc64025aaebdff11d3d15ab/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3f96dd9-a309-5d3d-b9f0-8186628076bd/b3f96dd9-a309-5d3d-b9f0-8186628076bd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 684465,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/dbc9765a1bc64025aaebdff11d3d15ab/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3f96dd9-a309-5d3d-b9f0-8186628076bd/b3f96dd9-a309-5d3d-b9f0-8186628076bd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 616164,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/dbc9765a1bc64025aaebdff11d3d15ab/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3f96dd9-a309-5d3d-b9f0-8186628076bd/b3f96dd9-a309-5d3d-b9f0-8186628076bd_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 664315,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/dbc9765a1bc64025aaebdff11d3d15ab/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3f96dd9-a309-5d3d-b9f0-8186628076bd/b3f96dd9-a309-5d3d-b9f0-8186628076bd_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 659061,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/dbc9765a1bc64025aaebdff11d3d15ab/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3f96dd9-a309-5d3d-b9f0-8186628076bd/b3f96dd9-a309-5d3d-b9f0-8186628076bd_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 719811,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/dbc9765a1bc64025aaebdff11d3d15ab/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3f96dd9-a309-5d3d-b9f0-8186628076bd/b3f96dd9-a309-5d3d-b9f0-8186628076bd_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 590291,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/dbc9765a1bc64025aaebdff11d3d15ab/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3f96dd9-a309-5d3d-b9f0-8186628076bd/b3f96dd9-a309-5d3d-b9f0-8186628076bd_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 340826,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/dbc9765a1bc64025aaebdff11d3d15ab/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF VIII 1.4 EHYBRID STYLE BUSINESS DSG',
 'transmission': 'automatic',
 'trim': '1.4 EHYBRID STYLE BUSINESS DSG',
 'vin': None,
 'year': 2023}
2026-03-26 22:58:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985675%27 HTTP/1.1" 200 None
2026-03-26 22:58:07 [ayvens.be] INFO: Saving data for 1985675: {'created_time': 1774565887.838944, 'last_price_update_time': 1774565887.838953, 'auction_closing_time': 1774958400.0}
2026-03-26 22:58:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985675') HTTP/1.1" 204 0
2026-03-26 22:58:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F24ddf958ec73434c8de2f5c2d4044901%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/24ddf958ec73434c8de2f5c2d4044901/images/large/7.jpg not downloaded yet
2026-03-26 22:58:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7500310>
2026-03-26 22:58:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a020241f-9671-558c-b1cb-37c2c25a38ed/a020241f-9671-558c-b1cb-37c2c25a38ed_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:58:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252Fa4e8a6002a164ea99aed05581cf04e47%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/a4e8a6002a164ea99aed05581cf04e47/images/large/3.jpg saved to cache
2026-03-26 22:58:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a020241f-9671-558c-b1cb-37c2c25a38ed
2026-03-26 22:58:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6dda790>
2026-03-26 22:58:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a020241f-9671-558c-b1cb-37c2c25a38ed/a020241f-9671-558c-b1cb-37c2c25a38ed_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252Fa4e8a6002a164ea99aed05581cf04e47%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/a4e8a6002a164ea99aed05581cf04e47/images/large/5.jpg saved to cache
2026-03-26 22:58:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a020241f-9671-558c-b1cb-37c2c25a38ed
2026-03-26 22:58:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77c9d90>
2026-03-26 22:58:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a020241f-9671-558c-b1cb-37c2c25a38ed/a020241f-9671-558c-b1cb-37c2c25a38ed_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252Fa4e8a6002a164ea99aed05581cf04e47%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/a4e8a6002a164ea99aed05581cf04e47/images/large/10.jpg saved to cache
2026-03-26 22:58:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a020241f-9671-558c-b1cb-37c2c25a38ed
2026-03-26 22:58:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6dd8c50>
2026-03-26 22:58:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a020241f-9671-558c-b1cb-37c2c25a38ed/a020241f-9671-558c-b1cb-37c2c25a38ed_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252Fa4e8a6002a164ea99aed05581cf04e47%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/a4e8a6002a164ea99aed05581cf04e47/images/large/9.jpg saved to cache
2026-03-26 22:58:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a020241f-9671-558c-b1cb-37c2c25a38ed
2026-03-26 22:58:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b740bd50>
2026-03-26 22:58:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1df76a12-ab1c-5bdf-9805-12191f762d3c/1df76a12-ab1c-5bdf-9805-12191f762d3c_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Fd7515d5ffa33424fa0b072717607391e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/d7515d5ffa33424fa0b072717607391e/images/large/4.jpg saved to cache
2026-03-26 22:58:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1df76a12-ab1c-5bdf-9805-12191f762d3c
2026-03-26 22:58:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b75a7950>
2026-03-26 22:58:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a020241f-9671-558c-b1cb-37c2c25a38ed/a020241f-9671-558c-b1cb-37c2c25a38ed_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252Fa4e8a6002a164ea99aed05581cf04e47%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/a4e8a6002a164ea99aed05581cf04e47/images/large/8.jpg saved to cache
2026-03-26 22:58:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a020241f-9671-558c-b1cb-37c2c25a38ed
2026-03-26 22:58:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/d7515d5ffa33424fa0b072717607391e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/d7515d5ffa33424fa0b072717607391e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F24ddf958ec73434c8de2f5c2d4044901%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/24ddf958ec73434c8de2f5c2d4044901/images/large/8.jpg not downloaded yet
2026-03-26 22:58:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74274d0>
2026-03-26 22:58:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1df76a12-ab1c-5bdf-9805-12191f762d3c/1df76a12-ab1c-5bdf-9805-12191f762d3c_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Fd7515d5ffa33424fa0b072717607391e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/d7515d5ffa33424fa0b072717607391e/images/large/2.jpg saved to cache
2026-03-26 22:58:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1df76a12-ab1c-5bdf-9805-12191f762d3c
2026-03-26 22:58:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7488350>
2026-03-26 22:58:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1df76a12-ab1c-5bdf-9805-12191f762d3c/1df76a12-ab1c-5bdf-9805-12191f762d3c_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Fd7515d5ffa33424fa0b072717607391e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/d7515d5ffa33424fa0b072717607391e/images/large/3.jpg saved to cache
2026-03-26 22:58:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1df76a12-ab1c-5bdf-9805-12191f762d3c
2026-03-26 22:58:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/d7515d5ffa33424fa0b072717607391e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F24ddf958ec73434c8de2f5c2d4044901%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/24ddf958ec73434c8de2f5c2d4044901/images/large/9.jpg not downloaded yet
2026-03-26 22:58:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/d7515d5ffa33424fa0b072717607391e/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b781a990>
2026-03-26 22:58:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1df76a12-ab1c-5bdf-9805-12191f762d3c/1df76a12-ab1c-5bdf-9805-12191f762d3c_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Fd7515d5ffa33424fa0b072717607391e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/d7515d5ffa33424fa0b072717607391e/images/large/6.jpg saved to cache
2026-03-26 22:58:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1df76a12-ab1c-5bdf-9805-12191f762d3c
2026-03-26 22:58:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79d5d90>
2026-03-26 22:58:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1df76a12-ab1c-5bdf-9805-12191f762d3c/1df76a12-ab1c-5bdf-9805-12191f762d3c_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Fd7515d5ffa33424fa0b072717607391e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/d7515d5ffa33424fa0b072717607391e/images/large/7.jpg saved to cache
2026-03-26 22:58:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1df76a12-ab1c-5bdf-9805-12191f762d3c
2026-03-26 22:58:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/a4e8a6002a164ea99aed05581cf04e47/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/d7515d5ffa33424fa0b072717607391e/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F24ddf958ec73434c8de2f5c2d4044901%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/24ddf958ec73434c8de2f5c2d4044901/images/large/10.jpg not downloaded yet
2026-03-26 22:58:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/a4e8a6002a164ea99aed05581cf04e47/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/d7515d5ffa33424fa0b072717607391e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:08 [ayvens.be] INFO: Found listing with ID: 1985679
2026-03-26 22:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985679%27 HTTP/1.1" 200 None
2026-03-26 22:58:08 [ayvens.be] INFO: Scrape type for 1985679: 1
2026-03-26 22:58:08 [ayvens.be] INFO: Extracting data for car ID: 1985679
2026-03-26 22:58:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 85d66156-2e3e-548c-8bbb-85097e13616c with identifier: 1985679
2026-03-26 22:58:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85d66156-2e3e-548c-8bbb-85097e13616c with scrape type 1
2026-03-26 22:58:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 85d66156-2e3e-548c-8bbb-85097e13616c
2026-03-26 22:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fe4fbb75581d74462a8eacbdbbefacce1%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/e4fbb75581d74462a8eacbdbbefacce1/images/large/1.jpg not downloaded yet
2026-03-26 22:58:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b782d750>
2026-03-26 22:58:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1df76a12-ab1c-5bdf-9805-12191f762d3c/1df76a12-ab1c-5bdf-9805-12191f762d3c_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Fd7515d5ffa33424fa0b072717607391e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/d7515d5ffa33424fa0b072717607391e/images/large/5.jpg saved to cache
2026-03-26 22:58:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1df76a12-ab1c-5bdf-9805-12191f762d3c
2026-03-26 22:58:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76a7ad0>
2026-03-26 22:58:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1df76a12-ab1c-5bdf-9805-12191f762d3c/1df76a12-ab1c-5bdf-9805-12191f762d3c_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Fd7515d5ffa33424fa0b072717607391e%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/d7515d5ffa33424fa0b072717607391e/images/large/9.jpg saved to cache
2026-03-26 22:58:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1df76a12-ab1c-5bdf-9805-12191f762d3c
2026-03-26 22:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fe4fbb75581d74462a8eacbdbbefacce1%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/e4fbb75581d74462a8eacbdbbefacce1/images/large/2.jpg not downloaded yet
2026-03-26 22:58:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fe4fbb75581d74462a8eacbdbbefacce1%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/e4fbb75581d74462a8eacbdbbefacce1/images/large/3.jpg not downloaded yet
2026-03-26 22:58:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7ded0d0>
2026-03-26 22:58:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a020241f-9671-558c-b1cb-37c2c25a38ed/a020241f-9671-558c-b1cb-37c2c25a38ed_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:58:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252Fa4e8a6002a164ea99aed05581cf04e47%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/a4e8a6002a164ea99aed05581cf04e47/images/large/7.jpg saved to cache
2026-03-26 22:58:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a020241f-9671-558c-b1cb-37c2c25a38ed
2026-03-26 22:58:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b884d0>
2026-03-26 22:58:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1df76a12-ab1c-5bdf-9805-12191f762d3c/1df76a12-ab1c-5bdf-9805-12191f762d3c_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:58:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Fd7515d5ffa33424fa0b072717607391e%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/d7515d5ffa33424fa0b072717607391e/images/large/10.jpg saved to cache
2026-03-26 22:58:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1df76a12-ab1c-5bdf-9805-12191f762d3c
2026-03-26 22:58:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7981ad0>
2026-03-26 22:58:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a020241f-9671-558c-b1cb-37c2c25a38ed/a020241f-9671-558c-b1cb-37c2c25a38ed_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:58:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252Fa4e8a6002a164ea99aed05581cf04e47%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/a4e8a6002a164ea99aed05581cf04e47/images/large/6.jpg saved to cache
2026-03-26 22:58:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a020241f-9671-558c-b1cb-37c2c25a38ed
2026-03-26 22:58:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a020241f-9671-558c-b1cb-37c2c25a38ed, skipping ID generation
2026-03-26 22:58:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a020241f-9671-558c-b1cb-37c2c25a38ed with scrape type 1
2026-03-26 22:58:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a020241f-9671-558c-b1cb-37c2c25a38ed sending to next pipeline
2026-03-26 22:58:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a020241f-9671-558c-b1cb-37c2c25a38ed, identifier: 1985676
2026-03-26 22:58:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cbdf90>
2026-03-26 22:58:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1df76a12-ab1c-5bdf-9805-12191f762d3c/1df76a12-ab1c-5bdf-9805-12191f762d3c_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:58:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Fd7515d5ffa33424fa0b072717607391e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/d7515d5ffa33424fa0b072717607391e/images/large/8.jpg saved to cache
2026-03-26 22:58:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1df76a12-ab1c-5bdf-9805-12191f762d3c
2026-03-26 22:58:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1df76a12-ab1c-5bdf-9805-12191f762d3c, skipping ID generation
2026-03-26 22:58:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1df76a12-ab1c-5bdf-9805-12191f762d3c with scrape type 1
2026-03-26 22:58:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1df76a12-ab1c-5bdf-9805-12191f762d3c sending to next pipeline
2026-03-26 22:58:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 1df76a12-ab1c-5bdf-9805-12191f762d3c, identifier: 1985677
2026-03-26 22:58:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fe4fbb75581d74462a8eacbdbbefacce1%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/e4fbb75581d74462a8eacbdbbefacce1/images/large/4.jpg not downloaded yet
2026-03-26 22:58:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a020241f-9671-558c-b1cb-37c2c25a38ed with identifier: 1985676
2026-03-26 22:58:09 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 22:58:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 22:58:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a020241f-9671-558c-b1cb-37c2c25a38ed with identifier: 1985676
2026-03-26 22:58:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a020241f-9671-558c-b1cb-37c2c25a38ed with identifier: 1985676 to the API
2026-03-26 22:58:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:58:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:58:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yr/a4e8a6002a164ea99aed05581cf04e47/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'STD',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'electric',
 'id': 'a020241f-9671-558c-b1cb-37c2c25a38ed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'MIRAI',
 'odometer': 31331,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a020241f-9671-558c-b1cb-37c2c25a38ed/a020241f-9671-558c-b1cb-37c2c25a38ed_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 546802,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/a4e8a6002a164ea99aed05581cf04e47/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a020241f-9671-558c-b1cb-37c2c25a38ed/a020241f-9671-558c-b1cb-37c2c25a38ed_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 557111,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/a4e8a6002a164ea99aed05581cf04e47/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a020241f-9671-558c-b1cb-37c2c25a38ed/a020241f-9671-558c-b1cb-37c2c25a38ed_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 558605,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/a4e8a6002a164ea99aed05581cf04e47/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a020241f-9671-558c-b1cb-37c2c25a38ed/a020241f-9671-558c-b1cb-37c2c25a38ed_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 593014,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/a4e8a6002a164ea99aed05581cf04e47/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a020241f-9671-558c-b1cb-37c2c25a38ed/a020241f-9671-558c-b1cb-37c2c25a38ed_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 565771,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/a4e8a6002a164ea99aed05581cf04e47/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a020241f-9671-558c-b1cb-37c2c25a38ed/a020241f-9671-558c-b1cb-37c2c25a38ed_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 611341,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/a4e8a6002a164ea99aed05581cf04e47/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a020241f-9671-558c-b1cb-37c2c25a38ed/a020241f-9671-558c-b1cb-37c2c25a38ed_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 707937,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/a4e8a6002a164ea99aed05581cf04e47/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a020241f-9671-558c-b1cb-37c2c25a38ed/a020241f-9671-558c-b1cb-37c2c25a38ed_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 594042,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/a4e8a6002a164ea99aed05581cf04e47/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a020241f-9671-558c-b1cb-37c2c25a38ed/a020241f-9671-558c-b1cb-37c2c25a38ed_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 637263,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/a4e8a6002a164ea99aed05581cf04e47/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a020241f-9671-558c-b1cb-37c2c25a38ed/a020241f-9671-558c-b1cb-37c2c25a38ed_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 670881,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/a4e8a6002a164ea99aed05581cf04e47/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-19',
 'seats_number': 4,
 'seller_name': None,
 'title': 'TOYOTA MIRAI Mirai Fuel Cell',
 'transmission': 'automatic',
 'trim': 'Mirai Fuel Cell',
 'vin': None,
 'year': 2020}
2026-03-26 22:58:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985676%27 HTTP/1.1" 200 None
2026-03-26 22:58:09 [ayvens.be] INFO: Saving data for 1985676: {'created_time': 1774565889.967087, 'last_price_update_time': 1774565889.967097, 'auction_closing_time': 1774958400.0}
2026-03-26 22:58:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985676') HTTP/1.1" 204 0
2026-03-26 22:58:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 1df76a12-ab1c-5bdf-9805-12191f762d3c with identifier: 1985677
2026-03-26 22:58:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 1df76a12-ab1c-5bdf-9805-12191f762d3c with identifier: 1985677
2026-03-26 22:58:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 1df76a12-ab1c-5bdf-9805-12191f762d3c with identifier: 1985677 to the API
2026-03-26 22:58:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:58:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:58:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1ys/d7515d5ffa33424fa0b072717607391e/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'STD',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'electric',
 'id': '1df76a12-ab1c-5bdf-9805-12191f762d3c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'MIRAI',
 'odometer': 1895,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1df76a12-ab1c-5bdf-9805-12191f762d3c/1df76a12-ab1c-5bdf-9805-12191f762d3c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 287839,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/d7515d5ffa33424fa0b072717607391e/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1df76a12-ab1c-5bdf-9805-12191f762d3c/1df76a12-ab1c-5bdf-9805-12191f762d3c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 281278,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/d7515d5ffa33424fa0b072717607391e/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1df76a12-ab1c-5bdf-9805-12191f762d3c/1df76a12-ab1c-5bdf-9805-12191f762d3c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 293948,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/d7515d5ffa33424fa0b072717607391e/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1df76a12-ab1c-5bdf-9805-12191f762d3c/1df76a12-ab1c-5bdf-9805-12191f762d3c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 294075,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/d7515d5ffa33424fa0b072717607391e/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1df76a12-ab1c-5bdf-9805-12191f762d3c/1df76a12-ab1c-5bdf-9805-12191f762d3c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 280150,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/d7515d5ffa33424fa0b072717607391e/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1df76a12-ab1c-5bdf-9805-12191f762d3c/1df76a12-ab1c-5bdf-9805-12191f762d3c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 273119,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/d7515d5ffa33424fa0b072717607391e/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1df76a12-ab1c-5bdf-9805-12191f762d3c/1df76a12-ab1c-5bdf-9805-12191f762d3c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 207367,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/d7515d5ffa33424fa0b072717607391e/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1df76a12-ab1c-5bdf-9805-12191f762d3c/1df76a12-ab1c-5bdf-9805-12191f762d3c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 404510,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/d7515d5ffa33424fa0b072717607391e/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1df76a12-ab1c-5bdf-9805-12191f762d3c/1df76a12-ab1c-5bdf-9805-12191f762d3c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 380487,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/d7515d5ffa33424fa0b072717607391e/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1df76a12-ab1c-5bdf-9805-12191f762d3c/1df76a12-ab1c-5bdf-9805-12191f762d3c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 313031,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/d7515d5ffa33424fa0b072717607391e/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-26',
 'seats_number': 4,
 'seller_name': None,
 'title': 'TOYOTA MIRAI Mirai Fuel Cell',
 'transmission': 'automatic',
 'trim': 'Mirai Fuel Cell',
 'vin': None,
 'year': 2020}
2026-03-26 22:58:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985677%27 HTTP/1.1" 200 None
2026-03-26 22:58:10 [ayvens.be] INFO: Saving data for 1985677: {'created_time': 1774565890.296896, 'last_price_update_time': 1774565890.296905, 'auction_closing_time': 1774958400.0}
2026-03-26 22:58:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985677') HTTP/1.1" 204 0
2026-03-26 22:58:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fe4fbb75581d74462a8eacbdbbefacce1%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/e4fbb75581d74462a8eacbdbbefacce1/images/large/5.jpg not downloaded yet
2026-03-26 22:58:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/24ddf958ec73434c8de2f5c2d4044901/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/24ddf958ec73434c8de2f5c2d4044901/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fe4fbb75581d74462a8eacbdbbefacce1%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/e4fbb75581d74462a8eacbdbbefacce1/images/large/6.jpg not downloaded yet
2026-03-26 22:58:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/24ddf958ec73434c8de2f5c2d4044901/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fe4fbb75581d74462a8eacbdbbefacce1%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/e4fbb75581d74462a8eacbdbbefacce1/images/large/7.jpg not downloaded yet
2026-03-26 22:58:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/24ddf958ec73434c8de2f5c2d4044901/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/24ddf958ec73434c8de2f5c2d4044901/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/24ddf958ec73434c8de2f5c2d4044901/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fe4fbb75581d74462a8eacbdbbefacce1%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/e4fbb75581d74462a8eacbdbbefacce1/images/large/8.jpg not downloaded yet
2026-03-26 22:58:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/24ddf958ec73434c8de2f5c2d4044901/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/24ddf958ec73434c8de2f5c2d4044901/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fe4fbb75581d74462a8eacbdbbefacce1%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/e4fbb75581d74462a8eacbdbbefacce1/images/large/9.jpg not downloaded yet
2026-03-26 22:58:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fe4fbb75581d74462a8eacbdbbefacce1%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/e4fbb75581d74462a8eacbdbbefacce1/images/large/10.jpg not downloaded yet
2026-03-26 22:58:10 [ayvens.be] INFO: Found listing with ID: 1985680
2026-03-26 22:58:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985680%27 HTTP/1.1" 200 None
2026-03-26 22:58:10 [ayvens.be] INFO: Scrape type for 1985680: 1
2026-03-26 22:58:10 [ayvens.be] INFO: Extracting data for car ID: 1985680
2026-03-26 22:58:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 38e5fee7-112c-57a0-a045-c2601d471e9d with identifier: 1985680
2026-03-26 22:58:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38e5fee7-112c-57a0-a045-c2601d471e9d with scrape type 1
2026-03-26 22:58:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 38e5fee7-112c-57a0-a045-c2601d471e9d
2026-03-26 22:58:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F73334bd9718d49e29424fd9421eecb9b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/73334bd9718d49e29424fd9421eecb9b/images/large/1.jpg not downloaded yet
2026-03-26 22:58:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd3abf50>
2026-03-26 22:58:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f95b6f5-ec00-5c09-9f02-b54ca7a1e021/6f95b6f5-ec00-5c09-9f02-b54ca7a1e021_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:58:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F24ddf958ec73434c8de2f5c2d4044901%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/24ddf958ec73434c8de2f5c2d4044901/images/large/1.jpg saved to cache
2026-03-26 22:58:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6f95b6f5-ec00-5c09-9f02-b54ca7a1e021
2026-03-26 22:58:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7dedd90>
2026-03-26 22:58:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f95b6f5-ec00-5c09-9f02-b54ca7a1e021/6f95b6f5-ec00-5c09-9f02-b54ca7a1e021_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:58:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F24ddf958ec73434c8de2f5c2d4044901%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/24ddf958ec73434c8de2f5c2d4044901/images/large/2.jpg saved to cache
2026-03-26 22:58:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6f95b6f5-ec00-5c09-9f02-b54ca7a1e021
2026-03-26 22:58:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F73334bd9718d49e29424fd9421eecb9b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/73334bd9718d49e29424fd9421eecb9b/images/large/2.jpg not downloaded yet
2026-03-26 22:58:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F73334bd9718d49e29424fd9421eecb9b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/73334bd9718d49e29424fd9421eecb9b/images/large/3.jpg not downloaded yet
2026-03-26 22:58:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6decf50>
2026-03-26 22:58:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f95b6f5-ec00-5c09-9f02-b54ca7a1e021/6f95b6f5-ec00-5c09-9f02-b54ca7a1e021_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:58:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F24ddf958ec73434c8de2f5c2d4044901%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/24ddf958ec73434c8de2f5c2d4044901/images/large/3.jpg saved to cache
2026-03-26 22:58:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6f95b6f5-ec00-5c09-9f02-b54ca7a1e021
2026-03-26 22:58:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7ca8990>
2026-03-26 22:58:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f95b6f5-ec00-5c09-9f02-b54ca7a1e021/6f95b6f5-ec00-5c09-9f02-b54ca7a1e021_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:58:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F24ddf958ec73434c8de2f5c2d4044901%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/24ddf958ec73434c8de2f5c2d4044901/images/large/5.jpg saved to cache
2026-03-26 22:58:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6f95b6f5-ec00-5c09-9f02-b54ca7a1e021
2026-03-26 22:58:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cb3dd0>
2026-03-26 22:58:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f95b6f5-ec00-5c09-9f02-b54ca7a1e021/6f95b6f5-ec00-5c09-9f02-b54ca7a1e021_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F24ddf958ec73434c8de2f5c2d4044901%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/24ddf958ec73434c8de2f5c2d4044901/images/large/4.jpg saved to cache
2026-03-26 22:58:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6f95b6f5-ec00-5c09-9f02-b54ca7a1e021
2026-03-26 22:58:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7ca99d0>
2026-03-26 22:58:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f95b6f5-ec00-5c09-9f02-b54ca7a1e021/6f95b6f5-ec00-5c09-9f02-b54ca7a1e021_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F24ddf958ec73434c8de2f5c2d4044901%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/24ddf958ec73434c8de2f5c2d4044901/images/large/6.jpg saved to cache
2026-03-26 22:58:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6f95b6f5-ec00-5c09-9f02-b54ca7a1e021
2026-03-26 22:58:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6df3d90>
2026-03-26 22:58:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f95b6f5-ec00-5c09-9f02-b54ca7a1e021/6f95b6f5-ec00-5c09-9f02-b54ca7a1e021_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F24ddf958ec73434c8de2f5c2d4044901%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/24ddf958ec73434c8de2f5c2d4044901/images/large/8.jpg saved to cache
2026-03-26 22:58:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6f95b6f5-ec00-5c09-9f02-b54ca7a1e021
2026-03-26 22:58:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e15bd0>
2026-03-26 22:58:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f95b6f5-ec00-5c09-9f02-b54ca7a1e021/6f95b6f5-ec00-5c09-9f02-b54ca7a1e021_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F24ddf958ec73434c8de2f5c2d4044901%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/24ddf958ec73434c8de2f5c2d4044901/images/large/7.jpg saved to cache
2026-03-26 22:58:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6f95b6f5-ec00-5c09-9f02-b54ca7a1e021
2026-03-26 22:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F73334bd9718d49e29424fd9421eecb9b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/73334bd9718d49e29424fd9421eecb9b/images/large/4.jpg not downloaded yet
2026-03-26 22:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F73334bd9718d49e29424fd9421eecb9b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/73334bd9718d49e29424fd9421eecb9b/images/large/5.jpg not downloaded yet
2026-03-26 22:58:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/24ddf958ec73434c8de2f5c2d4044901/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/e4fbb75581d74462a8eacbdbbefacce1/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/e4fbb75581d74462a8eacbdbbefacce1/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/e4fbb75581d74462a8eacbdbbefacce1/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/e4fbb75581d74462a8eacbdbbefacce1/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F73334bd9718d49e29424fd9421eecb9b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/73334bd9718d49e29424fd9421eecb9b/images/large/6.jpg not downloaded yet
2026-03-26 22:58:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/24ddf958ec73434c8de2f5c2d4044901/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/e4fbb75581d74462a8eacbdbbefacce1/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/e4fbb75581d74462a8eacbdbbefacce1/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F73334bd9718d49e29424fd9421eecb9b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/73334bd9718d49e29424fd9421eecb9b/images/large/7.jpg not downloaded yet
2026-03-26 22:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F73334bd9718d49e29424fd9421eecb9b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/73334bd9718d49e29424fd9421eecb9b/images/large/8.jpg not downloaded yet
2026-03-26 22:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F73334bd9718d49e29424fd9421eecb9b%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/73334bd9718d49e29424fd9421eecb9b/images/large/9.jpg not downloaded yet
2026-03-26 22:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F73334bd9718d49e29424fd9421eecb9b%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/73334bd9718d49e29424fd9421eecb9b/images/large/10.jpg not downloaded yet
2026-03-26 22:58:11 [ayvens.be] INFO: Found listing with ID: 1985681
2026-03-26 22:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985681%27 HTTP/1.1" 200 None
2026-03-26 22:58:11 [ayvens.be] INFO: Scrape type for 1985681: 1
2026-03-26 22:58:11 [ayvens.be] INFO: Extracting data for car ID: 1985681
2026-03-26 22:58:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c6de310f-3ed4-54eb-93fd-40cf284d08ea with identifier: 1985681
2026-03-26 22:58:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6de310f-3ed4-54eb-93fd-40cf284d08ea with scrape type 1
2026-03-26 22:58:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c6de310f-3ed4-54eb-93fd-40cf284d08ea
2026-03-26 22:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fe646a0e982594f07afdd823a871663bf%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/e646a0e982594f07afdd823a871663bf/images/large/1.jpg not downloaded yet
2026-03-26 22:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fe646a0e982594f07afdd823a871663bf%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/e646a0e982594f07afdd823a871663bf/images/large/2.jpg not downloaded yet
2026-03-26 22:58:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7269150>
2026-03-26 22:58:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f95b6f5-ec00-5c09-9f02-b54ca7a1e021/6f95b6f5-ec00-5c09-9f02-b54ca7a1e021_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F24ddf958ec73434c8de2f5c2d4044901%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/24ddf958ec73434c8de2f5c2d4044901/images/large/10.jpg saved to cache
2026-03-26 22:58:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6f95b6f5-ec00-5c09-9f02-b54ca7a1e021
2026-03-26 22:58:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b741ce90>
2026-03-26 22:58:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85d66156-2e3e-548c-8bbb-85097e13616c/85d66156-2e3e-548c-8bbb-85097e13616c_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fe4fbb75581d74462a8eacbdbbefacce1%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/e4fbb75581d74462a8eacbdbbefacce1/images/large/4.jpg saved to cache
2026-03-26 22:58:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 85d66156-2e3e-548c-8bbb-85097e13616c
2026-03-26 22:58:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74e7790>
2026-03-26 22:58:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85d66156-2e3e-548c-8bbb-85097e13616c/85d66156-2e3e-548c-8bbb-85097e13616c_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fe4fbb75581d74462a8eacbdbbefacce1%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/e4fbb75581d74462a8eacbdbbefacce1/images/large/2.jpg saved to cache
2026-03-26 22:58:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 85d66156-2e3e-548c-8bbb-85097e13616c
2026-03-26 22:58:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b741e550>
2026-03-26 22:58:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85d66156-2e3e-548c-8bbb-85097e13616c/85d66156-2e3e-548c-8bbb-85097e13616c_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fe4fbb75581d74462a8eacbdbbefacce1%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/e4fbb75581d74462a8eacbdbbefacce1/images/large/3.jpg saved to cache
2026-03-26 22:58:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 85d66156-2e3e-548c-8bbb-85097e13616c
2026-03-26 22:58:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b746ec90>
2026-03-26 22:58:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85d66156-2e3e-548c-8bbb-85097e13616c/85d66156-2e3e-548c-8bbb-85097e13616c_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fe4fbb75581d74462a8eacbdbbefacce1%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/e4fbb75581d74462a8eacbdbbefacce1/images/large/5.jpg saved to cache
2026-03-26 22:58:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 85d66156-2e3e-548c-8bbb-85097e13616c
2026-03-26 22:58:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7400410>
2026-03-26 22:58:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f95b6f5-ec00-5c09-9f02-b54ca7a1e021/6f95b6f5-ec00-5c09-9f02-b54ca7a1e021_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F24ddf958ec73434c8de2f5c2d4044901%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/24ddf958ec73434c8de2f5c2d4044901/images/large/9.jpg saved to cache
2026-03-26 22:58:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6f95b6f5-ec00-5c09-9f02-b54ca7a1e021
2026-03-26 22:58:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6f95b6f5-ec00-5c09-9f02-b54ca7a1e021, skipping ID generation
2026-03-26 22:58:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f95b6f5-ec00-5c09-9f02-b54ca7a1e021 with scrape type 1
2026-03-26 22:58:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6f95b6f5-ec00-5c09-9f02-b54ca7a1e021 sending to next pipeline
2026-03-26 22:58:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 6f95b6f5-ec00-5c09-9f02-b54ca7a1e021, identifier: 1985678
2026-03-26 22:58:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b792dbd0>
2026-03-26 22:58:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85d66156-2e3e-548c-8bbb-85097e13616c/85d66156-2e3e-548c-8bbb-85097e13616c_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:58:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fe4fbb75581d74462a8eacbdbbefacce1%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/e4fbb75581d74462a8eacbdbbefacce1/images/large/1.jpg saved to cache
2026-03-26 22:58:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 85d66156-2e3e-548c-8bbb-85097e13616c
2026-03-26 22:58:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7caa010>
2026-03-26 22:58:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85d66156-2e3e-548c-8bbb-85097e13616c/85d66156-2e3e-548c-8bbb-85097e13616c_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:58:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fe4fbb75581d74462a8eacbdbbefacce1%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/e4fbb75581d74462a8eacbdbbefacce1/images/large/6.jpg saved to cache
2026-03-26 22:58:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 85d66156-2e3e-548c-8bbb-85097e13616c
2026-03-26 22:58:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fe646a0e982594f07afdd823a871663bf%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/e646a0e982594f07afdd823a871663bf/images/large/3.jpg not downloaded yet
2026-03-26 22:58:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 6f95b6f5-ec00-5c09-9f02-b54ca7a1e021 with identifier: 1985678
2026-03-26 22:58:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 6f95b6f5-ec00-5c09-9f02-b54ca7a1e021 with identifier: 1985678
2026-03-26 22:58:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 6f95b6f5-ec00-5c09-9f02-b54ca7a1e021 with identifier: 1985678 to the API
2026-03-26 22:58:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:58:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:58:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yr/24ddf958ec73434c8de2f5c2d4044901/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '6f95b6f5-ec00-5c09-9f02-b54ca7a1e021',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 92915,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f95b6f5-ec00-5c09-9f02-b54ca7a1e021/6f95b6f5-ec00-5c09-9f02-b54ca7a1e021_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 775607,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/24ddf958ec73434c8de2f5c2d4044901/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f95b6f5-ec00-5c09-9f02-b54ca7a1e021/6f95b6f5-ec00-5c09-9f02-b54ca7a1e021_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 733027,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/24ddf958ec73434c8de2f5c2d4044901/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f95b6f5-ec00-5c09-9f02-b54ca7a1e021/6f95b6f5-ec00-5c09-9f02-b54ca7a1e021_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 755407,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/24ddf958ec73434c8de2f5c2d4044901/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f95b6f5-ec00-5c09-9f02-b54ca7a1e021/6f95b6f5-ec00-5c09-9f02-b54ca7a1e021_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 768747,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/24ddf958ec73434c8de2f5c2d4044901/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f95b6f5-ec00-5c09-9f02-b54ca7a1e021/6f95b6f5-ec00-5c09-9f02-b54ca7a1e021_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 750910,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/24ddf958ec73434c8de2f5c2d4044901/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f95b6f5-ec00-5c09-9f02-b54ca7a1e021/6f95b6f5-ec00-5c09-9f02-b54ca7a1e021_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 805115,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/24ddf958ec73434c8de2f5c2d4044901/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f95b6f5-ec00-5c09-9f02-b54ca7a1e021/6f95b6f5-ec00-5c09-9f02-b54ca7a1e021_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 613039,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/24ddf958ec73434c8de2f5c2d4044901/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f95b6f5-ec00-5c09-9f02-b54ca7a1e021/6f95b6f5-ec00-5c09-9f02-b54ca7a1e021_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 702545,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/24ddf958ec73434c8de2f5c2d4044901/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f95b6f5-ec00-5c09-9f02-b54ca7a1e021/6f95b6f5-ec00-5c09-9f02-b54ca7a1e021_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 690132,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/24ddf958ec73434c8de2f5c2d4044901/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f95b6f5-ec00-5c09-9f02-b54ca7a1e021/6f95b6f5-ec00-5c09-9f02-b54ca7a1e021_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 771909,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/24ddf958ec73434c8de2f5c2d4044901/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 1.5 XDRIVE25E (162KW)',
 'transmission': 'automatic',
 'trim': '1.5 XDRIVE25E (162KW)',
 'vin': None,
 'year': 2020}
2026-03-26 22:58:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985678%27 HTTP/1.1" 200 None
2026-03-26 22:58:12 [ayvens.be] INFO: Saving data for 1985678: {'created_time': 1774565892.698756, 'last_price_update_time': 1774565892.698765, 'auction_closing_time': 1774958400.0}
2026-03-26 22:58:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985678') HTTP/1.1" 204 0
2026-03-26 22:58:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fe646a0e982594f07afdd823a871663bf%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/e646a0e982594f07afdd823a871663bf/images/large/4.jpg not downloaded yet
2026-03-26 22:58:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/e4fbb75581d74462a8eacbdbbefacce1/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/73334bd9718d49e29424fd9421eecb9b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fe646a0e982594f07afdd823a871663bf%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/e646a0e982594f07afdd823a871663bf/images/large/5.jpg not downloaded yet
2026-03-26 22:58:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/e4fbb75581d74462a8eacbdbbefacce1/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/73334bd9718d49e29424fd9421eecb9b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fe646a0e982594f07afdd823a871663bf%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/e646a0e982594f07afdd823a871663bf/images/large/6.jpg not downloaded yet
2026-03-26 22:58:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/e4fbb75581d74462a8eacbdbbefacce1/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fe646a0e982594f07afdd823a871663bf%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/e646a0e982594f07afdd823a871663bf/images/large/7.jpg not downloaded yet
2026-03-26 22:58:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/73334bd9718d49e29424fd9421eecb9b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/73334bd9718d49e29424fd9421eecb9b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/e4fbb75581d74462a8eacbdbbefacce1/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fe646a0e982594f07afdd823a871663bf%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/e646a0e982594f07afdd823a871663bf/images/large/8.jpg not downloaded yet
2026-03-26 22:58:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fe646a0e982594f07afdd823a871663bf%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/e646a0e982594f07afdd823a871663bf/images/large/9.jpg not downloaded yet
2026-03-26 22:58:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fe646a0e982594f07afdd823a871663bf%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/e646a0e982594f07afdd823a871663bf/images/large/10.jpg not downloaded yet
2026-03-26 22:58:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b75715d0>
2026-03-26 22:58:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85d66156-2e3e-548c-8bbb-85097e13616c/85d66156-2e3e-548c-8bbb-85097e13616c_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:58:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fe4fbb75581d74462a8eacbdbbefacce1%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/e4fbb75581d74462a8eacbdbbefacce1/images/large/9.jpg saved to cache
2026-03-26 22:58:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 85d66156-2e3e-548c-8bbb-85097e13616c
2026-03-26 22:58:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7592ed0>
2026-03-26 22:58:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38e5fee7-112c-57a0-a045-c2601d471e9d/38e5fee7-112c-57a0-a045-c2601d471e9d_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:58:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F73334bd9718d49e29424fd9421eecb9b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/73334bd9718d49e29424fd9421eecb9b/images/large/2.jpg saved to cache
2026-03-26 22:58:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 38e5fee7-112c-57a0-a045-c2601d471e9d
2026-03-26 22:58:13 [ayvens.be] INFO: Found listing with ID: 1985682
2026-03-26 22:58:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985682%27 HTTP/1.1" 200 None
2026-03-26 22:58:13 [ayvens.be] INFO: Scrape type for 1985682: 1
2026-03-26 22:58:13 [ayvens.be] INFO: Extracting data for car ID: 1985682
2026-03-26 22:58:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0ec8777e-7d1c-5539-adbe-9c85041f9c4d with identifier: 1985682
2026-03-26 22:58:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ec8777e-7d1c-5539-adbe-9c85041f9c4d with scrape type 1
2026-03-26 22:58:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0ec8777e-7d1c-5539-adbe-9c85041f9c4d
2026-03-26 22:58:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F276299b5ed154d2cab857291372d7aee%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/276299b5ed154d2cab857291372d7aee/images/large/1.jpg not downloaded yet
2026-03-26 22:58:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F276299b5ed154d2cab857291372d7aee%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/276299b5ed154d2cab857291372d7aee/images/large/2.jpg not downloaded yet
2026-03-26 22:58:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74dff10>
2026-03-26 22:58:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85d66156-2e3e-548c-8bbb-85097e13616c/85d66156-2e3e-548c-8bbb-85097e13616c_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:58:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fe4fbb75581d74462a8eacbdbbefacce1%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/e4fbb75581d74462a8eacbdbbefacce1/images/large/7.jpg saved to cache
2026-03-26 22:58:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 85d66156-2e3e-548c-8bbb-85097e13616c
2026-03-26 22:58:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd136a10>
2026-03-26 22:58:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38e5fee7-112c-57a0-a045-c2601d471e9d/38e5fee7-112c-57a0-a045-c2601d471e9d_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:58:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F73334bd9718d49e29424fd9421eecb9b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/73334bd9718d49e29424fd9421eecb9b/images/large/1.jpg saved to cache
2026-03-26 22:58:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 38e5fee7-112c-57a0-a045-c2601d471e9d
2026-03-26 22:58:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b741f750>
2026-03-26 22:58:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85d66156-2e3e-548c-8bbb-85097e13616c/85d66156-2e3e-548c-8bbb-85097e13616c_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:58:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fe4fbb75581d74462a8eacbdbbefacce1%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/e4fbb75581d74462a8eacbdbbefacce1/images/large/8.jpg saved to cache
2026-03-26 22:58:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 85d66156-2e3e-548c-8bbb-85097e13616c
2026-03-26 22:58:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c7e590>
2026-03-26 22:58:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38e5fee7-112c-57a0-a045-c2601d471e9d/38e5fee7-112c-57a0-a045-c2601d471e9d_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:58:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F73334bd9718d49e29424fd9421eecb9b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/73334bd9718d49e29424fd9421eecb9b/images/large/3.jpg saved to cache
2026-03-26 22:58:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 38e5fee7-112c-57a0-a045-c2601d471e9d
2026-03-26 22:58:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79dee50>
2026-03-26 22:58:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38e5fee7-112c-57a0-a045-c2601d471e9d/38e5fee7-112c-57a0-a045-c2601d471e9d_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:58:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F73334bd9718d49e29424fd9421eecb9b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/73334bd9718d49e29424fd9421eecb9b/images/large/4.jpg saved to cache
2026-03-26 22:58:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 38e5fee7-112c-57a0-a045-c2601d471e9d
2026-03-26 22:58:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74a6750>
2026-03-26 22:58:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85d66156-2e3e-548c-8bbb-85097e13616c/85d66156-2e3e-548c-8bbb-85097e13616c_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:58:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fe4fbb75581d74462a8eacbdbbefacce1%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/e4fbb75581d74462a8eacbdbbefacce1/images/large/10.jpg saved to cache
2026-03-26 22:58:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 85d66156-2e3e-548c-8bbb-85097e13616c
2026-03-26 22:58:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 85d66156-2e3e-548c-8bbb-85097e13616c, skipping ID generation
2026-03-26 22:58:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85d66156-2e3e-548c-8bbb-85097e13616c with scrape type 1
2026-03-26 22:58:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 85d66156-2e3e-548c-8bbb-85097e13616c sending to next pipeline
2026-03-26 22:58:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 85d66156-2e3e-548c-8bbb-85097e13616c, identifier: 1985679
2026-03-26 22:58:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/73334bd9718d49e29424fd9421eecb9b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 85d66156-2e3e-548c-8bbb-85097e13616c with identifier: 1985679
2026-03-26 22:58:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 85d66156-2e3e-548c-8bbb-85097e13616c with identifier: 1985679
2026-03-26 22:58:13 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 85d66156-2e3e-548c-8bbb-85097e13616c with identifier: 1985679 to the API
2026-03-26 22:58:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:58:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:58:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bd/e4fbb75581d74462a8eacbdbbefacce1/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '85d66156-2e3e-548c-8bbb-85097e13616c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'T-CROSS',
 'odometer': 93888,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85d66156-2e3e-548c-8bbb-85097e13616c/85d66156-2e3e-548c-8bbb-85097e13616c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 640095,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/e4fbb75581d74462a8eacbdbbefacce1/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85d66156-2e3e-548c-8bbb-85097e13616c/85d66156-2e3e-548c-8bbb-85097e13616c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 601060,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/e4fbb75581d74462a8eacbdbbefacce1/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85d66156-2e3e-548c-8bbb-85097e13616c/85d66156-2e3e-548c-8bbb-85097e13616c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 587633,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/e4fbb75581d74462a8eacbdbbefacce1/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85d66156-2e3e-548c-8bbb-85097e13616c/85d66156-2e3e-548c-8bbb-85097e13616c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 587709,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/e4fbb75581d74462a8eacbdbbefacce1/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85d66156-2e3e-548c-8bbb-85097e13616c/85d66156-2e3e-548c-8bbb-85097e13616c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 577304,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/e4fbb75581d74462a8eacbdbbefacce1/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85d66156-2e3e-548c-8bbb-85097e13616c/85d66156-2e3e-548c-8bbb-85097e13616c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 590652,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/e4fbb75581d74462a8eacbdbbefacce1/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85d66156-2e3e-548c-8bbb-85097e13616c/85d66156-2e3e-548c-8bbb-85097e13616c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 656298,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/e4fbb75581d74462a8eacbdbbefacce1/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85d66156-2e3e-548c-8bbb-85097e13616c/85d66156-2e3e-548c-8bbb-85097e13616c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 648489,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/e4fbb75581d74462a8eacbdbbefacce1/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85d66156-2e3e-548c-8bbb-85097e13616c/85d66156-2e3e-548c-8bbb-85097e13616c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 614307,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/e4fbb75581d74462a8eacbdbbefacce1/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85d66156-2e3e-548c-8bbb-85097e13616c/85d66156-2e3e-548c-8bbb-85097e13616c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 625770,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/e4fbb75581d74462a8eacbdbbefacce1/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN T-CROSS 1.0 TSI 81KW ACTIVE',
 'transmission': 'manual',
 'trim': '1.0 TSI 81KW ACTIVE',
 'vin': None,
 'year': 2021}
2026-03-26 22:58:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985679%27 HTTP/1.1" 200 None
2026-03-26 22:58:14 [ayvens.be] INFO: Saving data for 1985679: {'created_time': 1774565894.168878, 'last_price_update_time': 1774565894.168888, 'auction_closing_time': 1774958400.0}
2026-03-26 22:58:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985679') HTTP/1.1" 204 0
2026-03-26 22:58:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F276299b5ed154d2cab857291372d7aee%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/276299b5ed154d2cab857291372d7aee/images/large/3.jpg not downloaded yet
2026-03-26 22:58:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F276299b5ed154d2cab857291372d7aee%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/276299b5ed154d2cab857291372d7aee/images/large/4.jpg not downloaded yet
2026-03-26 22:58:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/e646a0e982594f07afdd823a871663bf/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74ad290>
2026-03-26 22:58:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38e5fee7-112c-57a0-a045-c2601d471e9d/38e5fee7-112c-57a0-a045-c2601d471e9d_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:58:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F73334bd9718d49e29424fd9421eecb9b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/73334bd9718d49e29424fd9421eecb9b/images/large/5.jpg saved to cache
2026-03-26 22:58:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 38e5fee7-112c-57a0-a045-c2601d471e9d
2026-03-26 22:58:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/e646a0e982594f07afdd823a871663bf/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/73334bd9718d49e29424fd9421eecb9b/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F276299b5ed154d2cab857291372d7aee%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/276299b5ed154d2cab857291372d7aee/images/large/5.jpg not downloaded yet
2026-03-26 22:58:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/73334bd9718d49e29424fd9421eecb9b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/e646a0e982594f07afdd823a871663bf/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/73334bd9718d49e29424fd9421eecb9b/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F276299b5ed154d2cab857291372d7aee%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/276299b5ed154d2cab857291372d7aee/images/large/6.jpg not downloaded yet
2026-03-26 22:58:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/73334bd9718d49e29424fd9421eecb9b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F276299b5ed154d2cab857291372d7aee%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/276299b5ed154d2cab857291372d7aee/images/large/7.jpg not downloaded yet
2026-03-26 22:58:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F276299b5ed154d2cab857291372d7aee%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/276299b5ed154d2cab857291372d7aee/images/large/8.jpg not downloaded yet
2026-03-26 22:58:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b768af10>
2026-03-26 22:58:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6de310f-3ed4-54eb-93fd-40cf284d08ea/c6de310f-3ed4-54eb-93fd-40cf284d08ea_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:58:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fe646a0e982594f07afdd823a871663bf%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/e646a0e982594f07afdd823a871663bf/images/large/1.jpg saved to cache
2026-03-26 22:58:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c6de310f-3ed4-54eb-93fd-40cf284d08ea
2026-03-26 22:58:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F276299b5ed154d2cab857291372d7aee%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/276299b5ed154d2cab857291372d7aee/images/large/9.jpg not downloaded yet
2026-03-26 22:58:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/e646a0e982594f07afdd823a871663bf/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F276299b5ed154d2cab857291372d7aee%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/276299b5ed154d2cab857291372d7aee/images/large/10.jpg not downloaded yet
2026-03-26 22:58:14 [ayvens.be] INFO: Found listing with ID: 1985683
2026-03-26 22:58:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985683%27 HTTP/1.1" 200 None
2026-03-26 22:58:14 [ayvens.be] INFO: Scrape type for 1985683: 1
2026-03-26 22:58:14 [ayvens.be] INFO: Extracting data for car ID: 1985683
2026-03-26 22:58:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c52951fe-413c-577b-b815-1e7f4950c75e with identifier: 1985683
2026-03-26 22:58:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c52951fe-413c-577b-b815-1e7f4950c75e with scrape type 1
2026-03-26 22:58:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c52951fe-413c-577b-b815-1e7f4950c75e
2026-03-26 22:58:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F198d790e5d4241d09d58b58375f21fd9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/198d790e5d4241d09d58b58375f21fd9/images/large/1.jpg not downloaded yet
2026-03-26 22:58:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7745250>
2026-03-26 22:58:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6de310f-3ed4-54eb-93fd-40cf284d08ea/c6de310f-3ed4-54eb-93fd-40cf284d08ea_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:58:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fe646a0e982594f07afdd823a871663bf%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/e646a0e982594f07afdd823a871663bf/images/large/3.jpg saved to cache
2026-03-26 22:58:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c6de310f-3ed4-54eb-93fd-40cf284d08ea
2026-03-26 22:58:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7dd3610>
2026-03-26 22:58:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38e5fee7-112c-57a0-a045-c2601d471e9d/38e5fee7-112c-57a0-a045-c2601d471e9d_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:58:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F73334bd9718d49e29424fd9421eecb9b%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/73334bd9718d49e29424fd9421eecb9b/images/large/10.jpg saved to cache
2026-03-26 22:58:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 38e5fee7-112c-57a0-a045-c2601d471e9d
2026-03-26 22:58:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74102d0>
2026-03-26 22:58:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38e5fee7-112c-57a0-a045-c2601d471e9d/38e5fee7-112c-57a0-a045-c2601d471e9d_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:58:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F73334bd9718d49e29424fd9421eecb9b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/73334bd9718d49e29424fd9421eecb9b/images/large/8.jpg saved to cache
2026-03-26 22:58:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 38e5fee7-112c-57a0-a045-c2601d471e9d
2026-03-26 22:58:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e45950>
2026-03-26 22:58:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6de310f-3ed4-54eb-93fd-40cf284d08ea/c6de310f-3ed4-54eb-93fd-40cf284d08ea_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:58:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fe646a0e982594f07afdd823a871663bf%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/e646a0e982594f07afdd823a871663bf/images/large/2.jpg saved to cache
2026-03-26 22:58:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c6de310f-3ed4-54eb-93fd-40cf284d08ea
2026-03-26 22:58:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7413610>
2026-03-26 22:58:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38e5fee7-112c-57a0-a045-c2601d471e9d/38e5fee7-112c-57a0-a045-c2601d471e9d_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:58:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F73334bd9718d49e29424fd9421eecb9b%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/73334bd9718d49e29424fd9421eecb9b/images/large/9.jpg saved to cache
2026-03-26 22:58:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 38e5fee7-112c-57a0-a045-c2601d471e9d
2026-03-26 22:58:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7ce9c50>
2026-03-26 22:58:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38e5fee7-112c-57a0-a045-c2601d471e9d/38e5fee7-112c-57a0-a045-c2601d471e9d_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:58:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F73334bd9718d49e29424fd9421eecb9b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/73334bd9718d49e29424fd9421eecb9b/images/large/7.jpg saved to cache
2026-03-26 22:58:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 38e5fee7-112c-57a0-a045-c2601d471e9d
2026-03-26 22:58:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F198d790e5d4241d09d58b58375f21fd9%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/198d790e5d4241d09d58b58375f21fd9/images/large/2.jpg not downloaded yet
2026-03-26 22:58:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/e646a0e982594f07afdd823a871663bf/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/e646a0e982594f07afdd823a871663bf/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F198d790e5d4241d09d58b58375f21fd9%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/198d790e5d4241d09d58b58375f21fd9/images/large/3.jpg not downloaded yet
2026-03-26 22:58:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/73334bd9718d49e29424fd9421eecb9b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7410390>
2026-03-26 22:58:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6de310f-3ed4-54eb-93fd-40cf284d08ea/c6de310f-3ed4-54eb-93fd-40cf284d08ea_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:58:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fe646a0e982594f07afdd823a871663bf%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/e646a0e982594f07afdd823a871663bf/images/large/4.jpg saved to cache
2026-03-26 22:58:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c6de310f-3ed4-54eb-93fd-40cf284d08ea
2026-03-26 22:58:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F198d790e5d4241d09d58b58375f21fd9%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/198d790e5d4241d09d58b58375f21fd9/images/large/4.jpg not downloaded yet
2026-03-26 22:58:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F198d790e5d4241d09d58b58375f21fd9%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/198d790e5d4241d09d58b58375f21fd9/images/large/5.jpg not downloaded yet
2026-03-26 22:58:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/e646a0e982594f07afdd823a871663bf/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F198d790e5d4241d09d58b58375f21fd9%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/198d790e5d4241d09d58b58375f21fd9/images/large/6.jpg not downloaded yet
2026-03-26 22:58:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7417510>
2026-03-26 22:58:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6de310f-3ed4-54eb-93fd-40cf284d08ea/c6de310f-3ed4-54eb-93fd-40cf284d08ea_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:58:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fe646a0e982594f07afdd823a871663bf%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/e646a0e982594f07afdd823a871663bf/images/large/10.jpg saved to cache
2026-03-26 22:58:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c6de310f-3ed4-54eb-93fd-40cf284d08ea
2026-03-26 22:58:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7496290>
2026-03-26 22:58:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6de310f-3ed4-54eb-93fd-40cf284d08ea/c6de310f-3ed4-54eb-93fd-40cf284d08ea_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:58:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fe646a0e982594f07afdd823a871663bf%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/e646a0e982594f07afdd823a871663bf/images/large/5.jpg saved to cache
2026-03-26 22:58:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c6de310f-3ed4-54eb-93fd-40cf284d08ea
2026-03-26 22:58:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/e646a0e982594f07afdd823a871663bf/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/e646a0e982594f07afdd823a871663bf/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/276299b5ed154d2cab857291372d7aee/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/276299b5ed154d2cab857291372d7aee/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F198d790e5d4241d09d58b58375f21fd9%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/198d790e5d4241d09d58b58375f21fd9/images/large/7.jpg not downloaded yet
2026-03-26 22:58:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7500fd0>
2026-03-26 22:58:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38e5fee7-112c-57a0-a045-c2601d471e9d/38e5fee7-112c-57a0-a045-c2601d471e9d_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:58:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F73334bd9718d49e29424fd9421eecb9b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/73334bd9718d49e29424fd9421eecb9b/images/large/6.jpg saved to cache
2026-03-26 22:58:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 38e5fee7-112c-57a0-a045-c2601d471e9d
2026-03-26 22:58:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 38e5fee7-112c-57a0-a045-c2601d471e9d, skipping ID generation
2026-03-26 22:58:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38e5fee7-112c-57a0-a045-c2601d471e9d with scrape type 1
2026-03-26 22:58:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 38e5fee7-112c-57a0-a045-c2601d471e9d sending to next pipeline
2026-03-26 22:58:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 38e5fee7-112c-57a0-a045-c2601d471e9d, identifier: 1985680
2026-03-26 22:58:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 38e5fee7-112c-57a0-a045-c2601d471e9d with identifier: 1985680
2026-03-26 22:58:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 38e5fee7-112c-57a0-a045-c2601d471e9d with identifier: 1985680
2026-03-26 22:58:15 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 38e5fee7-112c-57a0-a045-c2601d471e9d with identifier: 1985680 to the API
2026-03-26 22:58:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:58:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:58:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1ys/73334bd9718d49e29424fd9421eecb9b/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'STD',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'electric',
 'id': '38e5fee7-112c-57a0-a045-c2601d471e9d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'MIRAI',
 'odometer': 16613,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38e5fee7-112c-57a0-a045-c2601d471e9d/38e5fee7-112c-57a0-a045-c2601d471e9d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 559153,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/73334bd9718d49e29424fd9421eecb9b/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38e5fee7-112c-57a0-a045-c2601d471e9d/38e5fee7-112c-57a0-a045-c2601d471e9d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 565788,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/73334bd9718d49e29424fd9421eecb9b/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38e5fee7-112c-57a0-a045-c2601d471e9d/38e5fee7-112c-57a0-a045-c2601d471e9d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 564370,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/73334bd9718d49e29424fd9421eecb9b/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38e5fee7-112c-57a0-a045-c2601d471e9d/38e5fee7-112c-57a0-a045-c2601d471e9d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 578713,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/73334bd9718d49e29424fd9421eecb9b/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38e5fee7-112c-57a0-a045-c2601d471e9d/38e5fee7-112c-57a0-a045-c2601d471e9d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 523269,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/73334bd9718d49e29424fd9421eecb9b/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38e5fee7-112c-57a0-a045-c2601d471e9d/38e5fee7-112c-57a0-a045-c2601d471e9d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 608818,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/73334bd9718d49e29424fd9421eecb9b/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38e5fee7-112c-57a0-a045-c2601d471e9d/38e5fee7-112c-57a0-a045-c2601d471e9d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 665494,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/73334bd9718d49e29424fd9421eecb9b/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38e5fee7-112c-57a0-a045-c2601d471e9d/38e5fee7-112c-57a0-a045-c2601d471e9d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 523263,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/73334bd9718d49e29424fd9421eecb9b/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38e5fee7-112c-57a0-a045-c2601d471e9d/38e5fee7-112c-57a0-a045-c2601d471e9d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 596037,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/73334bd9718d49e29424fd9421eecb9b/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38e5fee7-112c-57a0-a045-c2601d471e9d/38e5fee7-112c-57a0-a045-c2601d471e9d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 545099,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/73334bd9718d49e29424fd9421eecb9b/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-26',
 'seats_number': 4,
 'seller_name': None,
 'title': 'TOYOTA MIRAI Mirai Fuel Cell',
 'transmission': 'automatic',
 'trim': 'Mirai Fuel Cell',
 'vin': None,
 'year': 2020}
2026-03-26 22:58:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985680%27 HTTP/1.1" 200 None
2026-03-26 22:58:15 [ayvens.be] INFO: Saving data for 1985680: {'created_time': 1774565895.870135, 'last_price_update_time': 1774565895.870145, 'auction_closing_time': 1774958400.0}
2026-03-26 22:58:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985680') HTTP/1.1" 204 0
2026-03-26 22:58:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F198d790e5d4241d09d58b58375f21fd9%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/198d790e5d4241d09d58b58375f21fd9/images/large/8.jpg not downloaded yet
2026-03-26 22:58:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7413750>
2026-03-26 22:58:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6de310f-3ed4-54eb-93fd-40cf284d08ea/c6de310f-3ed4-54eb-93fd-40cf284d08ea_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:58:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fe646a0e982594f07afdd823a871663bf%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/e646a0e982594f07afdd823a871663bf/images/large/6.jpg saved to cache
2026-03-26 22:58:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c6de310f-3ed4-54eb-93fd-40cf284d08ea
2026-03-26 22:58:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b78c1590>
2026-03-26 22:58:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6de310f-3ed4-54eb-93fd-40cf284d08ea/c6de310f-3ed4-54eb-93fd-40cf284d08ea_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:58:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fe646a0e982594f07afdd823a871663bf%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/e646a0e982594f07afdd823a871663bf/images/large/9.jpg saved to cache
2026-03-26 22:58:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c6de310f-3ed4-54eb-93fd-40cf284d08ea
2026-03-26 22:58:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7688ad0>
2026-03-26 22:58:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6de310f-3ed4-54eb-93fd-40cf284d08ea/c6de310f-3ed4-54eb-93fd-40cf284d08ea_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:58:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fe646a0e982594f07afdd823a871663bf%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/e646a0e982594f07afdd823a871663bf/images/large/8.jpg saved to cache
2026-03-26 22:58:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c6de310f-3ed4-54eb-93fd-40cf284d08ea
2026-03-26 22:58:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74f9310>
2026-03-26 22:58:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ec8777e-7d1c-5539-adbe-9c85041f9c4d/0ec8777e-7d1c-5539-adbe-9c85041f9c4d_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:58:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F276299b5ed154d2cab857291372d7aee%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/276299b5ed154d2cab857291372d7aee/images/large/1.jpg saved to cache
2026-03-26 22:58:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0ec8777e-7d1c-5539-adbe-9c85041f9c4d
2026-03-26 22:58:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b781a6d0>
2026-03-26 22:58:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ec8777e-7d1c-5539-adbe-9c85041f9c4d/0ec8777e-7d1c-5539-adbe-9c85041f9c4d_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:58:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F276299b5ed154d2cab857291372d7aee%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/276299b5ed154d2cab857291372d7aee/images/large/2.jpg saved to cache
2026-03-26 22:58:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0ec8777e-7d1c-5539-adbe-9c85041f9c4d
2026-03-26 22:58:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/276299b5ed154d2cab857291372d7aee/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F198d790e5d4241d09d58b58375f21fd9%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/198d790e5d4241d09d58b58375f21fd9/images/large/9.jpg not downloaded yet
2026-03-26 22:58:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F198d790e5d4241d09d58b58375f21fd9%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/198d790e5d4241d09d58b58375f21fd9/images/large/10.jpg not downloaded yet
2026-03-26 22:58:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/e646a0e982594f07afdd823a871663bf/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:16 [ayvens.be] INFO: Found listing with ID: 1985684
2026-03-26 22:58:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985684%27 HTTP/1.1" 200 None
2026-03-26 22:58:16 [ayvens.be] INFO: Scrape type for 1985684: 1
2026-03-26 22:58:16 [ayvens.be] INFO: Extracting data for car ID: 1985684
2026-03-26 22:58:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a86a63cd-4b75-5d5a-88ab-2edf899ef6f9 with identifier: 1985684
2026-03-26 22:58:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a86a63cd-4b75-5d5a-88ab-2edf899ef6f9 with scrape type 1
2026-03-26 22:58:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a86a63cd-4b75-5d5a-88ab-2edf899ef6f9
2026-03-26 22:58:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2df%252F7a662d5d3196439fad73e94997d1a760%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2df/7a662d5d3196439fad73e94997d1a760/images/large/1.jpg not downloaded yet
2026-03-26 22:58:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/276299b5ed154d2cab857291372d7aee/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2df%252F7a662d5d3196439fad73e94997d1a760%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2df/7a662d5d3196439fad73e94997d1a760/images/large/2.jpg not downloaded yet
2026-03-26 22:58:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6da5190>
2026-03-26 22:58:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ec8777e-7d1c-5539-adbe-9c85041f9c4d/0ec8777e-7d1c-5539-adbe-9c85041f9c4d_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:58:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F276299b5ed154d2cab857291372d7aee%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/276299b5ed154d2cab857291372d7aee/images/large/3.jpg saved to cache
2026-03-26 22:58:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0ec8777e-7d1c-5539-adbe-9c85041f9c4d
2026-03-26 22:58:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/276299b5ed154d2cab857291372d7aee/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/276299b5ed154d2cab857291372d7aee/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2df%252F7a662d5d3196439fad73e94997d1a760%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2df/7a662d5d3196439fad73e94997d1a760/images/large/3.jpg not downloaded yet
2026-03-26 22:58:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/276299b5ed154d2cab857291372d7aee/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/276299b5ed154d2cab857291372d7aee/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2df%252F7a662d5d3196439fad73e94997d1a760%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2df/7a662d5d3196439fad73e94997d1a760/images/large/4.jpg not downloaded yet
2026-03-26 22:58:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/276299b5ed154d2cab857291372d7aee/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2df%252F7a662d5d3196439fad73e94997d1a760%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2df/7a662d5d3196439fad73e94997d1a760/images/large/5.jpg not downloaded yet
2026-03-26 22:58:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7442290>
2026-03-26 22:58:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6de310f-3ed4-54eb-93fd-40cf284d08ea/c6de310f-3ed4-54eb-93fd-40cf284d08ea_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:58:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fe646a0e982594f07afdd823a871663bf%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/e646a0e982594f07afdd823a871663bf/images/large/7.jpg saved to cache
2026-03-26 22:58:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c6de310f-3ed4-54eb-93fd-40cf284d08ea
2026-03-26 22:58:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c6de310f-3ed4-54eb-93fd-40cf284d08ea, skipping ID generation
2026-03-26 22:58:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6de310f-3ed4-54eb-93fd-40cf284d08ea with scrape type 1
2026-03-26 22:58:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c6de310f-3ed4-54eb-93fd-40cf284d08ea sending to next pipeline
2026-03-26 22:58:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c6de310f-3ed4-54eb-93fd-40cf284d08ea, identifier: 1985681
2026-03-26 22:58:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd3b9010>
2026-03-26 22:58:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ec8777e-7d1c-5539-adbe-9c85041f9c4d/0ec8777e-7d1c-5539-adbe-9c85041f9c4d_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:58:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F276299b5ed154d2cab857291372d7aee%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/276299b5ed154d2cab857291372d7aee/images/large/4.jpg saved to cache
2026-03-26 22:58:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0ec8777e-7d1c-5539-adbe-9c85041f9c4d
2026-03-26 22:58:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c6de310f-3ed4-54eb-93fd-40cf284d08ea with identifier: 1985681
2026-03-26 22:58:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c6de310f-3ed4-54eb-93fd-40cf284d08ea with identifier: 1985681
2026-03-26 22:58:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c6de310f-3ed4-54eb-93fd-40cf284d08ea with identifier: 1985681 to the API
2026-03-26 22:58:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:58:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:58:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bx/e646a0e982594f07afdd823a871663bf/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'c6de310f-3ed4-54eb-93fd-40cf284d08ea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'Octavia',
 'odometer': 113184,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6de310f-3ed4-54eb-93fd-40cf284d08ea/c6de310f-3ed4-54eb-93fd-40cf284d08ea_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 629517,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/e646a0e982594f07afdd823a871663bf/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6de310f-3ed4-54eb-93fd-40cf284d08ea/c6de310f-3ed4-54eb-93fd-40cf284d08ea_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 628636,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/e646a0e982594f07afdd823a871663bf/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6de310f-3ed4-54eb-93fd-40cf284d08ea/c6de310f-3ed4-54eb-93fd-40cf284d08ea_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 561974,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/e646a0e982594f07afdd823a871663bf/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6de310f-3ed4-54eb-93fd-40cf284d08ea/c6de310f-3ed4-54eb-93fd-40cf284d08ea_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 598906,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/e646a0e982594f07afdd823a871663bf/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6de310f-3ed4-54eb-93fd-40cf284d08ea/c6de310f-3ed4-54eb-93fd-40cf284d08ea_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 557008,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/e646a0e982594f07afdd823a871663bf/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6de310f-3ed4-54eb-93fd-40cf284d08ea/c6de310f-3ed4-54eb-93fd-40cf284d08ea_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 575226,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/e646a0e982594f07afdd823a871663bf/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6de310f-3ed4-54eb-93fd-40cf284d08ea/c6de310f-3ed4-54eb-93fd-40cf284d08ea_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 587975,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/e646a0e982594f07afdd823a871663bf/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6de310f-3ed4-54eb-93fd-40cf284d08ea/c6de310f-3ed4-54eb-93fd-40cf284d08ea_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 591021,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/e646a0e982594f07afdd823a871663bf/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6de310f-3ed4-54eb-93fd-40cf284d08ea/c6de310f-3ed4-54eb-93fd-40cf284d08ea_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 599414,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/e646a0e982594f07afdd823a871663bf/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6de310f-3ed4-54eb-93fd-40cf284d08ea/c6de310f-3ed4-54eb-93fd-40cf284d08ea_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 472319,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/e646a0e982594f07afdd823a871663bf/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA Octavia 2.0 CRTDI 85KW DSG7 CLEVER+',
 'transmission': 'automatic',
 'trim': '2.0 CRTDI 85KW DSG7 CLEVER+',
 'vin': None,
 'year': 2022}
2026-03-26 22:58:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985681%27 HTTP/1.1" 200 None
2026-03-26 22:58:17 [ayvens.be] INFO: Saving data for 1985681: {'created_time': 1774565897.191276, 'last_price_update_time': 1774565897.191287, 'auction_closing_time': 1774958400.0}
2026-03-26 22:58:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985681') HTTP/1.1" 204 0
2026-03-26 22:58:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2df%252F7a662d5d3196439fad73e94997d1a760%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2df/7a662d5d3196439fad73e94997d1a760/images/large/6.jpg not downloaded yet
2026-03-26 22:58:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2df%252F7a662d5d3196439fad73e94997d1a760%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2df/7a662d5d3196439fad73e94997d1a760/images/large/7.jpg not downloaded yet
2026-03-26 22:58:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/198d790e5d4241d09d58b58375f21fd9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7661610>
2026-03-26 22:58:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ec8777e-7d1c-5539-adbe-9c85041f9c4d/0ec8777e-7d1c-5539-adbe-9c85041f9c4d_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:58:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F276299b5ed154d2cab857291372d7aee%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/276299b5ed154d2cab857291372d7aee/images/large/5.jpg saved to cache
2026-03-26 22:58:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0ec8777e-7d1c-5539-adbe-9c85041f9c4d
2026-03-26 22:58:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e2bc10>
2026-03-26 22:58:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ec8777e-7d1c-5539-adbe-9c85041f9c4d/0ec8777e-7d1c-5539-adbe-9c85041f9c4d_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:58:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F276299b5ed154d2cab857291372d7aee%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/276299b5ed154d2cab857291372d7aee/images/large/7.jpg saved to cache
2026-03-26 22:58:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0ec8777e-7d1c-5539-adbe-9c85041f9c4d
2026-03-26 22:58:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7ce9290>
2026-03-26 22:58:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ec8777e-7d1c-5539-adbe-9c85041f9c4d/0ec8777e-7d1c-5539-adbe-9c85041f9c4d_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:58:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F276299b5ed154d2cab857291372d7aee%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/276299b5ed154d2cab857291372d7aee/images/large/9.jpg saved to cache
2026-03-26 22:58:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0ec8777e-7d1c-5539-adbe-9c85041f9c4d
2026-03-26 22:58:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd12d050>
2026-03-26 22:58:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ec8777e-7d1c-5539-adbe-9c85041f9c4d/0ec8777e-7d1c-5539-adbe-9c85041f9c4d_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:58:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F276299b5ed154d2cab857291372d7aee%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/276299b5ed154d2cab857291372d7aee/images/large/6.jpg saved to cache
2026-03-26 22:58:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0ec8777e-7d1c-5539-adbe-9c85041f9c4d
2026-03-26 22:58:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7ceb490>
2026-03-26 22:58:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ec8777e-7d1c-5539-adbe-9c85041f9c4d/0ec8777e-7d1c-5539-adbe-9c85041f9c4d_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:58:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F276299b5ed154d2cab857291372d7aee%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/276299b5ed154d2cab857291372d7aee/images/large/8.jpg saved to cache
2026-03-26 22:58:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0ec8777e-7d1c-5539-adbe-9c85041f9c4d
2026-03-26 22:58:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2df%252F7a662d5d3196439fad73e94997d1a760%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2df/7a662d5d3196439fad73e94997d1a760/images/large/8.jpg not downloaded yet
2026-03-26 22:58:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/276299b5ed154d2cab857291372d7aee/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2df%252F7a662d5d3196439fad73e94997d1a760%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2df/7a662d5d3196439fad73e94997d1a760/images/large/9.jpg not downloaded yet
2026-03-26 22:58:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76ef510>
2026-03-26 22:58:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c52951fe-413c-577b-b815-1e7f4950c75e/c52951fe-413c-577b-b815-1e7f4950c75e_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:58:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F198d790e5d4241d09d58b58375f21fd9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/198d790e5d4241d09d58b58375f21fd9/images/large/1.jpg saved to cache
2026-03-26 22:58:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c52951fe-413c-577b-b815-1e7f4950c75e
2026-03-26 22:58:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/198d790e5d4241d09d58b58375f21fd9/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2df%252F7a662d5d3196439fad73e94997d1a760%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2df/7a662d5d3196439fad73e94997d1a760/images/large/10.jpg not downloaded yet
2026-03-26 22:58:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/198d790e5d4241d09d58b58375f21fd9/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/198d790e5d4241d09d58b58375f21fd9/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/198d790e5d4241d09d58b58375f21fd9/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:17 [ayvens.be] INFO: Found listing with ID: 1985685
2026-03-26 22:58:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985685%27 HTTP/1.1" 200 None
2026-03-26 22:58:18 [ayvens.be] INFO: Scrape type for 1985685: 1
2026-03-26 22:58:18 [ayvens.be] INFO: Extracting data for car ID: 1985685
2026-03-26 22:58:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e7696874-805f-5be8-b5ff-4078f283f07b with identifier: 1985685
2026-03-26 22:58:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7696874-805f-5be8-b5ff-4078f283f07b with scrape type 1
2026-03-26 22:58:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e7696874-805f-5be8-b5ff-4078f283f07b
2026-03-26 22:58:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ff25e87172e624d2db2098457d86824c5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/f25e87172e624d2db2098457d86824c5/images/large/1.jpg not downloaded yet
2026-03-26 22:58:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/198d790e5d4241d09d58b58375f21fd9/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/198d790e5d4241d09d58b58375f21fd9/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cb37d0>
2026-03-26 22:58:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ec8777e-7d1c-5539-adbe-9c85041f9c4d/0ec8777e-7d1c-5539-adbe-9c85041f9c4d_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:58:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F276299b5ed154d2cab857291372d7aee%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/276299b5ed154d2cab857291372d7aee/images/large/10.jpg saved to cache
2026-03-26 22:58:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0ec8777e-7d1c-5539-adbe-9c85041f9c4d
2026-03-26 22:58:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0ec8777e-7d1c-5539-adbe-9c85041f9c4d, skipping ID generation
2026-03-26 22:58:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ec8777e-7d1c-5539-adbe-9c85041f9c4d with scrape type 1
2026-03-26 22:58:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0ec8777e-7d1c-5539-adbe-9c85041f9c4d sending to next pipeline
2026-03-26 22:58:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 0ec8777e-7d1c-5539-adbe-9c85041f9c4d, identifier: 1985682
2026-03-26 22:58:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ff25e87172e624d2db2098457d86824c5%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/f25e87172e624d2db2098457d86824c5/images/large/2.jpg not downloaded yet
2026-03-26 22:58:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 0ec8777e-7d1c-5539-adbe-9c85041f9c4d with identifier: 1985682
2026-03-26 22:58:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 0ec8777e-7d1c-5539-adbe-9c85041f9c4d with identifier: 1985682
2026-03-26 22:58:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 0ec8777e-7d1c-5539-adbe-9c85041f9c4d with identifier: 1985682 to the API
2026-03-26 22:58:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:58:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:58:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2br/276299b5ed154d2cab857291372d7aee/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '0ec8777e-7d1c-5539-adbe-9c85041f9c4d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X2',
 'odometer': 111755,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 20,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ec8777e-7d1c-5539-adbe-9c85041f9c4d/0ec8777e-7d1c-5539-adbe-9c85041f9c4d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 678342,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/276299b5ed154d2cab857291372d7aee/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ec8777e-7d1c-5539-adbe-9c85041f9c4d/0ec8777e-7d1c-5539-adbe-9c85041f9c4d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 691778,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/276299b5ed154d2cab857291372d7aee/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ec8777e-7d1c-5539-adbe-9c85041f9c4d/0ec8777e-7d1c-5539-adbe-9c85041f9c4d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 644040,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/276299b5ed154d2cab857291372d7aee/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ec8777e-7d1c-5539-adbe-9c85041f9c4d/0ec8777e-7d1c-5539-adbe-9c85041f9c4d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 692676,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/276299b5ed154d2cab857291372d7aee/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ec8777e-7d1c-5539-adbe-9c85041f9c4d/0ec8777e-7d1c-5539-adbe-9c85041f9c4d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 668987,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/276299b5ed154d2cab857291372d7aee/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ec8777e-7d1c-5539-adbe-9c85041f9c4d/0ec8777e-7d1c-5539-adbe-9c85041f9c4d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 720862,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/276299b5ed154d2cab857291372d7aee/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ec8777e-7d1c-5539-adbe-9c85041f9c4d/0ec8777e-7d1c-5539-adbe-9c85041f9c4d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 595752,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/276299b5ed154d2cab857291372d7aee/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ec8777e-7d1c-5539-adbe-9c85041f9c4d/0ec8777e-7d1c-5539-adbe-9c85041f9c4d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 865445,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/276299b5ed154d2cab857291372d7aee/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ec8777e-7d1c-5539-adbe-9c85041f9c4d/0ec8777e-7d1c-5539-adbe-9c85041f9c4d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 781166,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/276299b5ed154d2cab857291372d7aee/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ec8777e-7d1c-5539-adbe-9c85041f9c4d/0ec8777e-7d1c-5539-adbe-9c85041f9c4d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 763061,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/276299b5ed154d2cab857291372d7aee/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X2 2.0 XDRIVE18D 4WD AUTO 100KW',
 'transmission': 'automatic',
 'trim': '2.0 XDRIVE18D 4WD AUTO 100KW',
 'vin': None,
 'year': 2022}
2026-03-26 22:58:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985682%27 HTTP/1.1" 200 None
2026-03-26 22:58:18 [ayvens.be] INFO: Saving data for 1985682: {'created_time': 1774565898.529405, 'last_price_update_time': 1774565898.529414, 'auction_closing_time': 1774958400.0}
2026-03-26 22:58:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985682') HTTP/1.1" 204 0
2026-03-26 22:58:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ff25e87172e624d2db2098457d86824c5%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/f25e87172e624d2db2098457d86824c5/images/large/3.jpg not downloaded yet
2026-03-26 22:58:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74b7e10>
2026-03-26 22:58:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c52951fe-413c-577b-b815-1e7f4950c75e/c52951fe-413c-577b-b815-1e7f4950c75e_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:58:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F198d790e5d4241d09d58b58375f21fd9%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/198d790e5d4241d09d58b58375f21fd9/images/large/2.jpg saved to cache
2026-03-26 22:58:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c52951fe-413c-577b-b815-1e7f4950c75e
2026-03-26 22:58:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7417f50>
2026-03-26 22:58:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c52951fe-413c-577b-b815-1e7f4950c75e/c52951fe-413c-577b-b815-1e7f4950c75e_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:58:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F198d790e5d4241d09d58b58375f21fd9%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/198d790e5d4241d09d58b58375f21fd9/images/large/3.jpg saved to cache
2026-03-26 22:58:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c52951fe-413c-577b-b815-1e7f4950c75e
2026-03-26 22:58:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74b7390>
2026-03-26 22:58:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c52951fe-413c-577b-b815-1e7f4950c75e/c52951fe-413c-577b-b815-1e7f4950c75e_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:58:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F198d790e5d4241d09d58b58375f21fd9%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/198d790e5d4241d09d58b58375f21fd9/images/large/5.jpg saved to cache
2026-03-26 22:58:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c52951fe-413c-577b-b815-1e7f4950c75e
2026-03-26 22:58:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76a4c10>
2026-03-26 22:58:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c52951fe-413c-577b-b815-1e7f4950c75e/c52951fe-413c-577b-b815-1e7f4950c75e_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:58:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F198d790e5d4241d09d58b58375f21fd9%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/198d790e5d4241d09d58b58375f21fd9/images/large/7.jpg saved to cache
2026-03-26 22:58:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c52951fe-413c-577b-b815-1e7f4950c75e
2026-03-26 22:58:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74973d0>
2026-03-26 22:58:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c52951fe-413c-577b-b815-1e7f4950c75e/c52951fe-413c-577b-b815-1e7f4950c75e_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F198d790e5d4241d09d58b58375f21fd9%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/198d790e5d4241d09d58b58375f21fd9/images/large/4.jpg saved to cache
2026-03-26 22:58:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c52951fe-413c-577b-b815-1e7f4950c75e
2026-03-26 22:58:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7502ad0>
2026-03-26 22:58:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c52951fe-413c-577b-b815-1e7f4950c75e/c52951fe-413c-577b-b815-1e7f4950c75e_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F198d790e5d4241d09d58b58375f21fd9%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/198d790e5d4241d09d58b58375f21fd9/images/large/6.jpg saved to cache
2026-03-26 22:58:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c52951fe-413c-577b-b815-1e7f4950c75e
2026-03-26 22:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ff25e87172e624d2db2098457d86824c5%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/f25e87172e624d2db2098457d86824c5/images/large/4.jpg not downloaded yet
2026-03-26 22:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ff25e87172e624d2db2098457d86824c5%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/f25e87172e624d2db2098457d86824c5/images/large/5.jpg not downloaded yet
2026-03-26 22:58:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/198d790e5d4241d09d58b58375f21fd9/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ff25e87172e624d2db2098457d86824c5%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/f25e87172e624d2db2098457d86824c5/images/large/6.jpg not downloaded yet
2026-03-26 22:58:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/198d790e5d4241d09d58b58375f21fd9/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2df/7a662d5d3196439fad73e94997d1a760/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ff25e87172e624d2db2098457d86824c5%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/f25e87172e624d2db2098457d86824c5/images/large/7.jpg not downloaded yet
2026-03-26 22:58:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/198d790e5d4241d09d58b58375f21fd9/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2df/7a662d5d3196439fad73e94997d1a760/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2df/7a662d5d3196439fad73e94997d1a760/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2df/7a662d5d3196439fad73e94997d1a760/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ff25e87172e624d2db2098457d86824c5%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/f25e87172e624d2db2098457d86824c5/images/large/8.jpg not downloaded yet
2026-03-26 22:58:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2df/7a662d5d3196439fad73e94997d1a760/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ff25e87172e624d2db2098457d86824c5%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/f25e87172e624d2db2098457d86824c5/images/large/9.jpg not downloaded yet
2026-03-26 22:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ff25e87172e624d2db2098457d86824c5%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/f25e87172e624d2db2098457d86824c5/images/large/10.jpg not downloaded yet
2026-03-26 22:58:19 [ayvens.be] INFO: Found listing with ID: 1985686
2026-03-26 22:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985686%27 HTTP/1.1" 200 None
2026-03-26 22:58:19 [ayvens.be] INFO: Scrape type for 1985686: 1
2026-03-26 22:58:19 [ayvens.be] INFO: Extracting data for car ID: 1985686
2026-03-26 22:58:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cee14472-5229-5fa6-8340-3ab9f5e814c8 with identifier: 1985686
2026-03-26 22:58:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cee14472-5229-5fa6-8340-3ab9f5e814c8 with scrape type 1
2026-03-26 22:58:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cee14472-5229-5fa6-8340-3ab9f5e814c8
2026-03-26 22:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F3fd3478027884bcdbc5457bf8a21380c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/3fd3478027884bcdbc5457bf8a21380c/images/large/1.jpg not downloaded yet
2026-03-26 22:58:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7a81210>
2026-03-26 22:58:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c52951fe-413c-577b-b815-1e7f4950c75e/c52951fe-413c-577b-b815-1e7f4950c75e_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F198d790e5d4241d09d58b58375f21fd9%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/198d790e5d4241d09d58b58375f21fd9/images/large/8.jpg saved to cache
2026-03-26 22:58:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c52951fe-413c-577b-b815-1e7f4950c75e
2026-03-26 22:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F3fd3478027884bcdbc5457bf8a21380c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/3fd3478027884bcdbc5457bf8a21380c/images/large/2.jpg not downloaded yet
2026-03-26 22:58:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b776a0d0>
2026-03-26 22:58:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c52951fe-413c-577b-b815-1e7f4950c75e/c52951fe-413c-577b-b815-1e7f4950c75e_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F198d790e5d4241d09d58b58375f21fd9%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/198d790e5d4241d09d58b58375f21fd9/images/large/9.jpg saved to cache
2026-03-26 22:58:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c52951fe-413c-577b-b815-1e7f4950c75e
2026-03-26 22:58:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7414a50>
2026-03-26 22:58:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a86a63cd-4b75-5d5a-88ab-2edf899ef6f9/a86a63cd-4b75-5d5a-88ab-2edf899ef6f9_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2df%252F7a662d5d3196439fad73e94997d1a760%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2df/7a662d5d3196439fad73e94997d1a760/images/large/5.jpg saved to cache
2026-03-26 22:58:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a86a63cd-4b75-5d5a-88ab-2edf899ef6f9
2026-03-26 22:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F3fd3478027884bcdbc5457bf8a21380c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/3fd3478027884bcdbc5457bf8a21380c/images/large/3.jpg not downloaded yet
2026-03-26 22:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F3fd3478027884bcdbc5457bf8a21380c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/3fd3478027884bcdbc5457bf8a21380c/images/large/4.jpg not downloaded yet
2026-03-26 22:58:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7dd00d0>
2026-03-26 22:58:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c52951fe-413c-577b-b815-1e7f4950c75e/c52951fe-413c-577b-b815-1e7f4950c75e_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F198d790e5d4241d09d58b58375f21fd9%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/198d790e5d4241d09d58b58375f21fd9/images/large/10.jpg saved to cache
2026-03-26 22:58:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c52951fe-413c-577b-b815-1e7f4950c75e
2026-03-26 22:58:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c52951fe-413c-577b-b815-1e7f4950c75e, skipping ID generation
2026-03-26 22:58:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c52951fe-413c-577b-b815-1e7f4950c75e with scrape type 1
2026-03-26 22:58:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c52951fe-413c-577b-b815-1e7f4950c75e sending to next pipeline
2026-03-26 22:58:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c52951fe-413c-577b-b815-1e7f4950c75e, identifier: 1985683
2026-03-26 22:58:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79a7ed0>
2026-03-26 22:58:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a86a63cd-4b75-5d5a-88ab-2edf899ef6f9/a86a63cd-4b75-5d5a-88ab-2edf899ef6f9_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:58:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2df%252F7a662d5d3196439fad73e94997d1a760%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2df/7a662d5d3196439fad73e94997d1a760/images/large/1.jpg saved to cache
2026-03-26 22:58:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a86a63cd-4b75-5d5a-88ab-2edf899ef6f9
2026-03-26 22:58:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6dc2d90>
2026-03-26 22:58:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a86a63cd-4b75-5d5a-88ab-2edf899ef6f9/a86a63cd-4b75-5d5a-88ab-2edf899ef6f9_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:58:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2df%252F7a662d5d3196439fad73e94997d1a760%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2df/7a662d5d3196439fad73e94997d1a760/images/large/3.jpg saved to cache
2026-03-26 22:58:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a86a63cd-4b75-5d5a-88ab-2edf899ef6f9
2026-03-26 22:58:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80cad3e190>
2026-03-26 22:58:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a86a63cd-4b75-5d5a-88ab-2edf899ef6f9/a86a63cd-4b75-5d5a-88ab-2edf899ef6f9_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:58:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2df%252F7a662d5d3196439fad73e94997d1a760%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2df/7a662d5d3196439fad73e94997d1a760/images/large/2.jpg saved to cache
2026-03-26 22:58:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a86a63cd-4b75-5d5a-88ab-2edf899ef6f9
2026-03-26 22:58:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e364d0>
2026-03-26 22:58:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a86a63cd-4b75-5d5a-88ab-2edf899ef6f9/a86a63cd-4b75-5d5a-88ab-2edf899ef6f9_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:58:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2df%252F7a662d5d3196439fad73e94997d1a760%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2df/7a662d5d3196439fad73e94997d1a760/images/large/4.jpg saved to cache
2026-03-26 22:58:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a86a63cd-4b75-5d5a-88ab-2edf899ef6f9
2026-03-26 22:58:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2df/7a662d5d3196439fad73e94997d1a760/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c52951fe-413c-577b-b815-1e7f4950c75e with identifier: 1985683
2026-03-26 22:58:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c52951fe-413c-577b-b815-1e7f4950c75e with identifier: 1985683
2026-03-26 22:58:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c52951fe-413c-577b-b815-1e7f4950c75e with identifier: 1985683 to the API
2026-03-26 22:58:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:58:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:58:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bp/198d790e5d4241d09d58b58375f21fd9/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'c52951fe-413c-577b-b815-1e7f4950c75e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3',
 'odometer': 113189,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c52951fe-413c-577b-b815-1e7f4950c75e/c52951fe-413c-577b-b815-1e7f4950c75e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 725006,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/198d790e5d4241d09d58b58375f21fd9/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c52951fe-413c-577b-b815-1e7f4950c75e/c52951fe-413c-577b-b815-1e7f4950c75e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 732991,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/198d790e5d4241d09d58b58375f21fd9/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c52951fe-413c-577b-b815-1e7f4950c75e/c52951fe-413c-577b-b815-1e7f4950c75e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 697672,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/198d790e5d4241d09d58b58375f21fd9/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c52951fe-413c-577b-b815-1e7f4950c75e/c52951fe-413c-577b-b815-1e7f4950c75e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 728773,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/198d790e5d4241d09d58b58375f21fd9/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c52951fe-413c-577b-b815-1e7f4950c75e/c52951fe-413c-577b-b815-1e7f4950c75e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 693862,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/198d790e5d4241d09d58b58375f21fd9/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c52951fe-413c-577b-b815-1e7f4950c75e/c52951fe-413c-577b-b815-1e7f4950c75e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 760088,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/198d790e5d4241d09d58b58375f21fd9/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c52951fe-413c-577b-b815-1e7f4950c75e/c52951fe-413c-577b-b815-1e7f4950c75e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 617535,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/198d790e5d4241d09d58b58375f21fd9/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c52951fe-413c-577b-b815-1e7f4950c75e/c52951fe-413c-577b-b815-1e7f4950c75e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 720629,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/198d790e5d4241d09d58b58375f21fd9/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c52951fe-413c-577b-b815-1e7f4950c75e/c52951fe-413c-577b-b815-1e7f4950c75e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 641556,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/198d790e5d4241d09d58b58375f21fd9/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c52951fe-413c-577b-b815-1e7f4950c75e/c52951fe-413c-577b-b815-1e7f4950c75e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 731023,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/198d790e5d4241d09d58b58375f21fd9/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 1.4 45 TFSI E S TRONIC',
 'transmission': 'automatic',
 'trim': '1.4 45 TFSI E S TRONIC',
 'vin': None,
 'year': 2022}
2026-03-26 22:58:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985683%27 HTTP/1.1" 200 None
2026-03-26 22:58:20 [ayvens.be] INFO: Saving data for 1985683: {'created_time': 1774565900.677815, 'last_price_update_time': 1774565900.677824, 'auction_closing_time': 1774958400.0}
2026-03-26 22:58:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985683') HTTP/1.1" 204 0
2026-03-26 22:58:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F3fd3478027884bcdbc5457bf8a21380c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/3fd3478027884bcdbc5457bf8a21380c/images/large/5.jpg not downloaded yet
2026-03-26 22:58:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2df/7a662d5d3196439fad73e94997d1a760/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2df/7a662d5d3196439fad73e94997d1a760/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F3fd3478027884bcdbc5457bf8a21380c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/3fd3478027884bcdbc5457bf8a21380c/images/large/6.jpg not downloaded yet
2026-03-26 22:58:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/f25e87172e624d2db2098457d86824c5/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2df/7a662d5d3196439fad73e94997d1a760/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7428710>
2026-03-26 22:58:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a86a63cd-4b75-5d5a-88ab-2edf899ef6f9/a86a63cd-4b75-5d5a-88ab-2edf899ef6f9_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:58:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2df%252F7a662d5d3196439fad73e94997d1a760%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2df/7a662d5d3196439fad73e94997d1a760/images/large/7.jpg saved to cache
2026-03-26 22:58:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a86a63cd-4b75-5d5a-88ab-2edf899ef6f9
2026-03-26 22:58:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2df/7a662d5d3196439fad73e94997d1a760/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F3fd3478027884bcdbc5457bf8a21380c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/3fd3478027884bcdbc5457bf8a21380c/images/large/7.jpg not downloaded yet
2026-03-26 22:58:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/f25e87172e624d2db2098457d86824c5/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/f25e87172e624d2db2098457d86824c5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F3fd3478027884bcdbc5457bf8a21380c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/3fd3478027884bcdbc5457bf8a21380c/images/large/8.jpg not downloaded yet
2026-03-26 22:58:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7dd2450>
2026-03-26 22:58:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a86a63cd-4b75-5d5a-88ab-2edf899ef6f9/a86a63cd-4b75-5d5a-88ab-2edf899ef6f9_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:58:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2df%252F7a662d5d3196439fad73e94997d1a760%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2df/7a662d5d3196439fad73e94997d1a760/images/large/9.jpg saved to cache
2026-03-26 22:58:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a86a63cd-4b75-5d5a-88ab-2edf899ef6f9
2026-03-26 22:58:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74360d0>
2026-03-26 22:58:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a86a63cd-4b75-5d5a-88ab-2edf899ef6f9/a86a63cd-4b75-5d5a-88ab-2edf899ef6f9_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:58:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2df%252F7a662d5d3196439fad73e94997d1a760%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2df/7a662d5d3196439fad73e94997d1a760/images/large/10.jpg saved to cache
2026-03-26 22:58:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a86a63cd-4b75-5d5a-88ab-2edf899ef6f9
2026-03-26 22:58:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77ca8d0>
2026-03-26 22:58:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7696874-805f-5be8-b5ff-4078f283f07b/e7696874-805f-5be8-b5ff-4078f283f07b_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:58:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ff25e87172e624d2db2098457d86824c5%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/f25e87172e624d2db2098457d86824c5/images/large/3.jpg saved to cache
2026-03-26 22:58:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e7696874-805f-5be8-b5ff-4078f283f07b
2026-03-26 22:58:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b75a5dd0>
2026-03-26 22:58:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a86a63cd-4b75-5d5a-88ab-2edf899ef6f9/a86a63cd-4b75-5d5a-88ab-2edf899ef6f9_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:58:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2df%252F7a662d5d3196439fad73e94997d1a760%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2df/7a662d5d3196439fad73e94997d1a760/images/large/6.jpg saved to cache
2026-03-26 22:58:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a86a63cd-4b75-5d5a-88ab-2edf899ef6f9
2026-03-26 22:58:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F3fd3478027884bcdbc5457bf8a21380c%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/3fd3478027884bcdbc5457bf8a21380c/images/large/9.jpg not downloaded yet
2026-03-26 22:58:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F3fd3478027884bcdbc5457bf8a21380c%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/3fd3478027884bcdbc5457bf8a21380c/images/large/10.jpg not downloaded yet
2026-03-26 22:58:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e34b50>
2026-03-26 22:58:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a86a63cd-4b75-5d5a-88ab-2edf899ef6f9/a86a63cd-4b75-5d5a-88ab-2edf899ef6f9_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:58:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2df%252F7a662d5d3196439fad73e94997d1a760%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2df/7a662d5d3196439fad73e94997d1a760/images/large/8.jpg saved to cache
2026-03-26 22:58:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a86a63cd-4b75-5d5a-88ab-2edf899ef6f9
2026-03-26 22:58:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a86a63cd-4b75-5d5a-88ab-2edf899ef6f9, skipping ID generation
2026-03-26 22:58:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a86a63cd-4b75-5d5a-88ab-2edf899ef6f9 with scrape type 1
2026-03-26 22:58:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a86a63cd-4b75-5d5a-88ab-2edf899ef6f9 sending to next pipeline
2026-03-26 22:58:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a86a63cd-4b75-5d5a-88ab-2edf899ef6f9, identifier: 1985684
2026-03-26 22:58:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b75a5490>
2026-03-26 22:58:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7696874-805f-5be8-b5ff-4078f283f07b/e7696874-805f-5be8-b5ff-4078f283f07b_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:58:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ff25e87172e624d2db2098457d86824c5%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/f25e87172e624d2db2098457d86824c5/images/large/2.jpg saved to cache
2026-03-26 22:58:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e7696874-805f-5be8-b5ff-4078f283f07b
2026-03-26 22:58:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b72fdcd0>
2026-03-26 22:58:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7696874-805f-5be8-b5ff-4078f283f07b/e7696874-805f-5be8-b5ff-4078f283f07b_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:58:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ff25e87172e624d2db2098457d86824c5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/f25e87172e624d2db2098457d86824c5/images/large/1.jpg saved to cache
2026-03-26 22:58:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e7696874-805f-5be8-b5ff-4078f283f07b
2026-03-26 22:58:21 [ayvens.be] INFO: Found listing with ID: 1985687
2026-03-26 22:58:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985687%27 HTTP/1.1" 200 None
2026-03-26 22:58:21 [ayvens.be] INFO: Scrape type for 1985687: 1
2026-03-26 22:58:21 [ayvens.be] INFO: Extracting data for car ID: 1985687
2026-03-26 22:58:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d with identifier: 1985687
2026-03-26 22:58:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d with scrape type 1
2026-03-26 22:58:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d
2026-03-26 22:58:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F62b411a368bb418cb4f9f7ab2c6c7638%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/62b411a368bb418cb4f9f7ab2c6c7638/images/large/1.jpg not downloaded yet
2026-03-26 22:58:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a86a63cd-4b75-5d5a-88ab-2edf899ef6f9 with identifier: 1985684
2026-03-26 22:58:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a86a63cd-4b75-5d5a-88ab-2edf899ef6f9 with identifier: 1985684
2026-03-26 22:58:21 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a86a63cd-4b75-5d5a-88ab-2edf899ef6f9 with identifier: 1985684 to the API
2026-03-26 22:58:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:58:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:58:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2df/7a662d5d3196439fad73e94997d1a760/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'electric',
 'id': 'a86a63cd-4b75-5d5a-88ab-2edf899ef6f9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'EV6',
 'odometer': 76315,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a86a63cd-4b75-5d5a-88ab-2edf899ef6f9/a86a63cd-4b75-5d5a-88ab-2edf899ef6f9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 641603,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2df/7a662d5d3196439fad73e94997d1a760/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a86a63cd-4b75-5d5a-88ab-2edf899ef6f9/a86a63cd-4b75-5d5a-88ab-2edf899ef6f9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 653023,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2df/7a662d5d3196439fad73e94997d1a760/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a86a63cd-4b75-5d5a-88ab-2edf899ef6f9/a86a63cd-4b75-5d5a-88ab-2edf899ef6f9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 610607,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2df/7a662d5d3196439fad73e94997d1a760/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a86a63cd-4b75-5d5a-88ab-2edf899ef6f9/a86a63cd-4b75-5d5a-88ab-2edf899ef6f9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 729301,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2df/7a662d5d3196439fad73e94997d1a760/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a86a63cd-4b75-5d5a-88ab-2edf899ef6f9/a86a63cd-4b75-5d5a-88ab-2edf899ef6f9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 582326,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2df/7a662d5d3196439fad73e94997d1a760/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a86a63cd-4b75-5d5a-88ab-2edf899ef6f9/a86a63cd-4b75-5d5a-88ab-2edf899ef6f9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 581135,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2df/7a662d5d3196439fad73e94997d1a760/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a86a63cd-4b75-5d5a-88ab-2edf899ef6f9/a86a63cd-4b75-5d5a-88ab-2edf899ef6f9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 610522,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2df/7a662d5d3196439fad73e94997d1a760/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a86a63cd-4b75-5d5a-88ab-2edf899ef6f9/a86a63cd-4b75-5d5a-88ab-2edf899ef6f9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 717966,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2df/7a662d5d3196439fad73e94997d1a760/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a86a63cd-4b75-5d5a-88ab-2edf899ef6f9/a86a63cd-4b75-5d5a-88ab-2edf899ef6f9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 523031,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2df/7a662d5d3196439fad73e94997d1a760/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a86a63cd-4b75-5d5a-88ab-2edf899ef6f9/a86a63cd-4b75-5d5a-88ab-2edf899ef6f9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 486047,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2df/7a662d5d3196439fad73e94997d1a760/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA EV6 BEV 77KWH EARTH AUTO RWD',
 'transmission': 'automatic',
 'trim': 'BEV 77KWH EARTH AUTO RWD',
 'vin': None,
 'year': 2023}
2026-03-26 22:58:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985684%27 HTTP/1.1" 200 None
2026-03-26 22:58:21 [ayvens.be] INFO: Saving data for 1985684: {'created_time': 1774565901.981794, 'last_price_update_time': 1774565901.981804, 'auction_closing_time': 1774958400.0}
2026-03-26 22:58:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985684') HTTP/1.1" 204 0
2026-03-26 22:58:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F62b411a368bb418cb4f9f7ab2c6c7638%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/62b411a368bb418cb4f9f7ab2c6c7638/images/large/2.jpg not downloaded yet
2026-03-26 22:58:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/f25e87172e624d2db2098457d86824c5/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/f25e87172e624d2db2098457d86824c5/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F62b411a368bb418cb4f9f7ab2c6c7638%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/62b411a368bb418cb4f9f7ab2c6c7638/images/large/3.jpg not downloaded yet
2026-03-26 22:58:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/f25e87172e624d2db2098457d86824c5/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/3fd3478027884bcdbc5457bf8a21380c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/3fd3478027884bcdbc5457bf8a21380c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F62b411a368bb418cb4f9f7ab2c6c7638%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/62b411a368bb418cb4f9f7ab2c6c7638/images/large/4.jpg not downloaded yet
2026-03-26 22:58:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/f25e87172e624d2db2098457d86824c5/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F62b411a368bb418cb4f9f7ab2c6c7638%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/62b411a368bb418cb4f9f7ab2c6c7638/images/large/5.jpg not downloaded yet
2026-03-26 22:58:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/f25e87172e624d2db2098457d86824c5/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F62b411a368bb418cb4f9f7ab2c6c7638%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/62b411a368bb418cb4f9f7ab2c6c7638/images/large/6.jpg not downloaded yet
2026-03-26 22:58:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/f25e87172e624d2db2098457d86824c5/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F62b411a368bb418cb4f9f7ab2c6c7638%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/62b411a368bb418cb4f9f7ab2c6c7638/images/large/7.jpg not downloaded yet
2026-03-26 22:58:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F62b411a368bb418cb4f9f7ab2c6c7638%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/62b411a368bb418cb4f9f7ab2c6c7638/images/large/8.jpg not downloaded yet
2026-03-26 22:58:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F62b411a368bb418cb4f9f7ab2c6c7638%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/62b411a368bb418cb4f9f7ab2c6c7638/images/large/9.jpg not downloaded yet
2026-03-26 22:58:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77bd4d0>
2026-03-26 22:58:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7696874-805f-5be8-b5ff-4078f283f07b/e7696874-805f-5be8-b5ff-4078f283f07b_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:58:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ff25e87172e624d2db2098457d86824c5%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/f25e87172e624d2db2098457d86824c5/images/large/5.jpg saved to cache
2026-03-26 22:58:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e7696874-805f-5be8-b5ff-4078f283f07b
2026-03-26 22:58:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7438710>
2026-03-26 22:58:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7696874-805f-5be8-b5ff-4078f283f07b/e7696874-805f-5be8-b5ff-4078f283f07b_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:58:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ff25e87172e624d2db2098457d86824c5%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/f25e87172e624d2db2098457d86824c5/images/large/6.jpg saved to cache
2026-03-26 22:58:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e7696874-805f-5be8-b5ff-4078f283f07b
2026-03-26 22:58:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F62b411a368bb418cb4f9f7ab2c6c7638%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/62b411a368bb418cb4f9f7ab2c6c7638/images/large/10.jpg not downloaded yet
2026-03-26 22:58:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd0d3310>
2026-03-26 22:58:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7696874-805f-5be8-b5ff-4078f283f07b/e7696874-805f-5be8-b5ff-4078f283f07b_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:58:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ff25e87172e624d2db2098457d86824c5%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/f25e87172e624d2db2098457d86824c5/images/large/10.jpg saved to cache
2026-03-26 22:58:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e7696874-805f-5be8-b5ff-4078f283f07b
2026-03-26 22:58:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74ac8d0>
2026-03-26 22:58:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cee14472-5229-5fa6-8340-3ab9f5e814c8/cee14472-5229-5fa6-8340-3ab9f5e814c8_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:58:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F3fd3478027884bcdbc5457bf8a21380c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/3fd3478027884bcdbc5457bf8a21380c/images/large/1.jpg saved to cache
2026-03-26 22:58:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cee14472-5229-5fa6-8340-3ab9f5e814c8
2026-03-26 22:58:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7ce83d0>
2026-03-26 22:58:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cee14472-5229-5fa6-8340-3ab9f5e814c8/cee14472-5229-5fa6-8340-3ab9f5e814c8_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:58:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F3fd3478027884bcdbc5457bf8a21380c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/3fd3478027884bcdbc5457bf8a21380c/images/large/2.jpg saved to cache
2026-03-26 22:58:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cee14472-5229-5fa6-8340-3ab9f5e814c8
2026-03-26 22:58:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/3fd3478027884bcdbc5457bf8a21380c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:22 [ayvens.be] INFO: Found listing with ID: 1985688
2026-03-26 22:58:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985688%27 HTTP/1.1" 200 None
2026-03-26 22:58:22 [ayvens.be] INFO: Scrape type for 1985688: 1
2026-03-26 22:58:22 [ayvens.be] INFO: Extracting data for car ID: 1985688
2026-03-26 22:58:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f721e15-332b-51f4-b704-261dcb3d5496 with identifier: 1985688
2026-03-26 22:58:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f721e15-332b-51f4-b704-261dcb3d5496 with scrape type 1
2026-03-26 22:58:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3f721e15-332b-51f4-b704-261dcb3d5496
2026-03-26 22:58:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F6777771e11884601bd2cc9687b5d98d4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/6777771e11884601bd2cc9687b5d98d4/images/large/1.jpg not downloaded yet
2026-03-26 22:58:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F6777771e11884601bd2cc9687b5d98d4%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/6777771e11884601bd2cc9687b5d98d4/images/large/2.jpg not downloaded yet
2026-03-26 22:58:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74ad910>
2026-03-26 22:58:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7696874-805f-5be8-b5ff-4078f283f07b/e7696874-805f-5be8-b5ff-4078f283f07b_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:58:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ff25e87172e624d2db2098457d86824c5%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/f25e87172e624d2db2098457d86824c5/images/large/4.jpg saved to cache
2026-03-26 22:58:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e7696874-805f-5be8-b5ff-4078f283f07b
2026-03-26 22:58:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76cf750>
2026-03-26 22:58:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7696874-805f-5be8-b5ff-4078f283f07b/e7696874-805f-5be8-b5ff-4078f283f07b_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:58:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ff25e87172e624d2db2098457d86824c5%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/f25e87172e624d2db2098457d86824c5/images/large/9.jpg saved to cache
2026-03-26 22:58:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e7696874-805f-5be8-b5ff-4078f283f07b
2026-03-26 22:58:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7452d10>
2026-03-26 22:58:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7696874-805f-5be8-b5ff-4078f283f07b/e7696874-805f-5be8-b5ff-4078f283f07b_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:58:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ff25e87172e624d2db2098457d86824c5%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/f25e87172e624d2db2098457d86824c5/images/large/8.jpg saved to cache
2026-03-26 22:58:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e7696874-805f-5be8-b5ff-4078f283f07b
2026-03-26 22:58:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/3fd3478027884bcdbc5457bf8a21380c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/3fd3478027884bcdbc5457bf8a21380c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F6777771e11884601bd2cc9687b5d98d4%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/6777771e11884601bd2cc9687b5d98d4/images/large/3.jpg not downloaded yet
2026-03-26 22:58:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/3fd3478027884bcdbc5457bf8a21380c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F6777771e11884601bd2cc9687b5d98d4%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/6777771e11884601bd2cc9687b5d98d4/images/large/4.jpg not downloaded yet
2026-03-26 22:58:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74503d0>
2026-03-26 22:58:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cee14472-5229-5fa6-8340-3ab9f5e814c8/cee14472-5229-5fa6-8340-3ab9f5e814c8_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:58:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F3fd3478027884bcdbc5457bf8a21380c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/3fd3478027884bcdbc5457bf8a21380c/images/large/3.jpg saved to cache
2026-03-26 22:58:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cee14472-5229-5fa6-8340-3ab9f5e814c8
2026-03-26 22:58:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/3fd3478027884bcdbc5457bf8a21380c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/f25e87172e624d2db2098457d86824c5/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/3fd3478027884bcdbc5457bf8a21380c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/3fd3478027884bcdbc5457bf8a21380c/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ah/62b411a368bb418cb4f9f7ab2c6c7638/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F6777771e11884601bd2cc9687b5d98d4%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/6777771e11884601bd2cc9687b5d98d4/images/large/5.jpg not downloaded yet
2026-03-26 22:58:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F6777771e11884601bd2cc9687b5d98d4%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/6777771e11884601bd2cc9687b5d98d4/images/large/6.jpg not downloaded yet
2026-03-26 22:58:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ah/62b411a368bb418cb4f9f7ab2c6c7638/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F6777771e11884601bd2cc9687b5d98d4%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/6777771e11884601bd2cc9687b5d98d4/images/large/7.jpg not downloaded yet
2026-03-26 22:58:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76ccb90>
2026-03-26 22:58:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cee14472-5229-5fa6-8340-3ab9f5e814c8/cee14472-5229-5fa6-8340-3ab9f5e814c8_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:58:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F3fd3478027884bcdbc5457bf8a21380c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/3fd3478027884bcdbc5457bf8a21380c/images/large/4.jpg saved to cache
2026-03-26 22:58:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cee14472-5229-5fa6-8340-3ab9f5e814c8
2026-03-26 22:58:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7def7d0>
2026-03-26 22:58:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cee14472-5229-5fa6-8340-3ab9f5e814c8/cee14472-5229-5fa6-8340-3ab9f5e814c8_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:58:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F3fd3478027884bcdbc5457bf8a21380c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/3fd3478027884bcdbc5457bf8a21380c/images/large/6.jpg saved to cache
2026-03-26 22:58:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cee14472-5229-5fa6-8340-3ab9f5e814c8
2026-03-26 22:58:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7727750>
2026-03-26 22:58:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cee14472-5229-5fa6-8340-3ab9f5e814c8/cee14472-5229-5fa6-8340-3ab9f5e814c8_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:58:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F3fd3478027884bcdbc5457bf8a21380c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/3fd3478027884bcdbc5457bf8a21380c/images/large/5.jpg saved to cache
2026-03-26 22:58:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cee14472-5229-5fa6-8340-3ab9f5e814c8
2026-03-26 22:58:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ah/62b411a368bb418cb4f9f7ab2c6c7638/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F6777771e11884601bd2cc9687b5d98d4%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/6777771e11884601bd2cc9687b5d98d4/images/large/8.jpg not downloaded yet
2026-03-26 22:58:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F6777771e11884601bd2cc9687b5d98d4%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/6777771e11884601bd2cc9687b5d98d4/images/large/9.jpg not downloaded yet
2026-03-26 22:58:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ah/62b411a368bb418cb4f9f7ab2c6c7638/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ah/62b411a368bb418cb4f9f7ab2c6c7638/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6d82650>
2026-03-26 22:58:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cee14472-5229-5fa6-8340-3ab9f5e814c8/cee14472-5229-5fa6-8340-3ab9f5e814c8_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:58:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F3fd3478027884bcdbc5457bf8a21380c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/3fd3478027884bcdbc5457bf8a21380c/images/large/8.jpg saved to cache
2026-03-26 22:58:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cee14472-5229-5fa6-8340-3ab9f5e814c8
2026-03-26 22:58:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6da5950>
2026-03-26 22:58:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7696874-805f-5be8-b5ff-4078f283f07b/e7696874-805f-5be8-b5ff-4078f283f07b_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:58:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ff25e87172e624d2db2098457d86824c5%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/f25e87172e624d2db2098457d86824c5/images/large/7.jpg saved to cache
2026-03-26 22:58:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e7696874-805f-5be8-b5ff-4078f283f07b
2026-03-26 22:58:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e7696874-805f-5be8-b5ff-4078f283f07b, skipping ID generation
2026-03-26 22:58:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7696874-805f-5be8-b5ff-4078f283f07b with scrape type 1
2026-03-26 22:58:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e7696874-805f-5be8-b5ff-4078f283f07b sending to next pipeline
2026-03-26 22:58:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e7696874-805f-5be8-b5ff-4078f283f07b, identifier: 1985685
2026-03-26 22:58:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b75a4d90>
2026-03-26 22:58:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cee14472-5229-5fa6-8340-3ab9f5e814c8/cee14472-5229-5fa6-8340-3ab9f5e814c8_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:58:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F3fd3478027884bcdbc5457bf8a21380c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/3fd3478027884bcdbc5457bf8a21380c/images/large/7.jpg saved to cache
2026-03-26 22:58:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cee14472-5229-5fa6-8340-3ab9f5e814c8
2026-03-26 22:58:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7278410>
2026-03-26 22:58:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cee14472-5229-5fa6-8340-3ab9f5e814c8/cee14472-5229-5fa6-8340-3ab9f5e814c8_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:58:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F3fd3478027884bcdbc5457bf8a21380c%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/3fd3478027884bcdbc5457bf8a21380c/images/large/9.jpg saved to cache
2026-03-26 22:58:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cee14472-5229-5fa6-8340-3ab9f5e814c8
2026-03-26 22:58:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76cf450>
2026-03-26 22:58:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d/24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:58:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F62b411a368bb418cb4f9f7ab2c6c7638%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/62b411a368bb418cb4f9f7ab2c6c7638/images/large/2.jpg saved to cache
2026-03-26 22:58:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d
2026-03-26 22:58:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7660350>
2026-03-26 22:58:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d/24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:58:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F62b411a368bb418cb4f9f7ab2c6c7638%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/62b411a368bb418cb4f9f7ab2c6c7638/images/large/3.jpg saved to cache
2026-03-26 22:58:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d
2026-03-26 22:58:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/3fd3478027884bcdbc5457bf8a21380c/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ah/62b411a368bb418cb4f9f7ab2c6c7638/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ah/62b411a368bb418cb4f9f7ab2c6c7638/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F6777771e11884601bd2cc9687b5d98d4%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/6777771e11884601bd2cc9687b5d98d4/images/large/10.jpg not downloaded yet
2026-03-26 22:58:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e7696874-805f-5be8-b5ff-4078f283f07b with identifier: 1985685
2026-03-26 22:58:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e7696874-805f-5be8-b5ff-4078f283f07b with identifier: 1985685
2026-03-26 22:58:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e7696874-805f-5be8-b5ff-4078f283f07b with identifier: 1985685 to the API
2026-03-26 22:58:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:58:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:58:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bd/f25e87172e624d2db2098457d86824c5/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'electric',
 'id': 'e7696874-805f-5be8-b5ff-4078f283f07b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'E-TRON',
 'odometer': 119616,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 25,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7696874-805f-5be8-b5ff-4078f283f07b/e7696874-805f-5be8-b5ff-4078f283f07b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 679281,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/f25e87172e624d2db2098457d86824c5/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7696874-805f-5be8-b5ff-4078f283f07b/e7696874-805f-5be8-b5ff-4078f283f07b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 743294,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/f25e87172e624d2db2098457d86824c5/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7696874-805f-5be8-b5ff-4078f283f07b/e7696874-805f-5be8-b5ff-4078f283f07b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 684796,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/f25e87172e624d2db2098457d86824c5/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7696874-805f-5be8-b5ff-4078f283f07b/e7696874-805f-5be8-b5ff-4078f283f07b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 732015,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/f25e87172e624d2db2098457d86824c5/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7696874-805f-5be8-b5ff-4078f283f07b/e7696874-805f-5be8-b5ff-4078f283f07b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 682323,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/f25e87172e624d2db2098457d86824c5/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7696874-805f-5be8-b5ff-4078f283f07b/e7696874-805f-5be8-b5ff-4078f283f07b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 689827,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/f25e87172e624d2db2098457d86824c5/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7696874-805f-5be8-b5ff-4078f283f07b/e7696874-805f-5be8-b5ff-4078f283f07b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 637427,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/f25e87172e624d2db2098457d86824c5/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7696874-805f-5be8-b5ff-4078f283f07b/e7696874-805f-5be8-b5ff-4078f283f07b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 728055,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/f25e87172e624d2db2098457d86824c5/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7696874-805f-5be8-b5ff-4078f283f07b/e7696874-805f-5be8-b5ff-4078f283f07b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 643189,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/f25e87172e624d2db2098457d86824c5/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7696874-805f-5be8-b5ff-4078f283f07b/e7696874-805f-5be8-b5ff-4078f283f07b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 637874,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/f25e87172e624d2db2098457d86824c5/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI E-TRON 95 kWh 55 Quattro Advanced',
 'transmission': 'automatic',
 'trim': '95 kWh 55 Quattro Advanced',
 'vin': None,
 'year': 2021}
2026-03-26 22:58:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985685%27 HTTP/1.1" 200 None
2026-03-26 22:58:24 [ayvens.be] INFO: Saving data for 1985685: {'created_time': 1774565904.500748, 'last_price_update_time': 1774565904.500756, 'auction_closing_time': 1774958400.0}
2026-03-26 22:58:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985685') HTTP/1.1" 204 0
2026-03-26 22:58:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ah/62b411a368bb418cb4f9f7ab2c6c7638/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:24 [ayvens.be] INFO: Found listing with ID: 1985689
2026-03-26 22:58:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985689%27 HTTP/1.1" 200 None
2026-03-26 22:58:24 [ayvens.be] INFO: Scrape type for 1985689: 1
2026-03-26 22:58:24 [ayvens.be] INFO: Extracting data for car ID: 1985689
2026-03-26 22:58:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 553a68b8-cbe1-5949-add3-97bebbbbfdee with identifier: 1985689
2026-03-26 22:58:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 553a68b8-cbe1-5949-add3-97bebbbbfdee with scrape type 1
2026-03-26 22:58:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 553a68b8-cbe1-5949-add3-97bebbbbfdee
2026-03-26 22:58:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F6e1ddf3292884f51ba576737e391865c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/6e1ddf3292884f51ba576737e391865c/images/large/1.jpg not downloaded yet
2026-03-26 22:58:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F6e1ddf3292884f51ba576737e391865c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/6e1ddf3292884f51ba576737e391865c/images/large/2.jpg not downloaded yet
2026-03-26 22:58:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7819450>
2026-03-26 22:58:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d/24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:58:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F62b411a368bb418cb4f9f7ab2c6c7638%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/62b411a368bb418cb4f9f7ab2c6c7638/images/large/1.jpg saved to cache
2026-03-26 22:58:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d
2026-03-26 22:58:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76cdf90>
2026-03-26 22:58:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d/24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:58:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F62b411a368bb418cb4f9f7ab2c6c7638%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/62b411a368bb418cb4f9f7ab2c6c7638/images/large/4.jpg saved to cache
2026-03-26 22:58:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d
2026-03-26 22:58:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7269c90>
2026-03-26 22:58:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d/24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:58:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F62b411a368bb418cb4f9f7ab2c6c7638%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/62b411a368bb418cb4f9f7ab2c6c7638/images/large/9.jpg saved to cache
2026-03-26 22:58:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d
2026-03-26 22:58:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e29b50>
2026-03-26 22:58:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cee14472-5229-5fa6-8340-3ab9f5e814c8/cee14472-5229-5fa6-8340-3ab9f5e814c8_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:58:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F3fd3478027884bcdbc5457bf8a21380c%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/3fd3478027884bcdbc5457bf8a21380c/images/large/10.jpg saved to cache
2026-03-26 22:58:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cee14472-5229-5fa6-8340-3ab9f5e814c8
2026-03-26 22:58:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cee14472-5229-5fa6-8340-3ab9f5e814c8, skipping ID generation
2026-03-26 22:58:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cee14472-5229-5fa6-8340-3ab9f5e814c8 with scrape type 1
2026-03-26 22:58:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cee14472-5229-5fa6-8340-3ab9f5e814c8 sending to next pipeline
2026-03-26 22:58:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: cee14472-5229-5fa6-8340-3ab9f5e814c8, identifier: 1985686
2026-03-26 22:58:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79dcf90>
2026-03-26 22:58:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d/24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F62b411a368bb418cb4f9f7ab2c6c7638%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/62b411a368bb418cb4f9f7ab2c6c7638/images/large/5.jpg saved to cache
2026-03-26 22:58:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d
2026-03-26 22:58:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd267a50>
2026-03-26 22:58:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d/24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F62b411a368bb418cb4f9f7ab2c6c7638%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/62b411a368bb418cb4f9f7ab2c6c7638/images/large/10.jpg saved to cache
2026-03-26 22:58:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d
2026-03-26 22:58:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: cee14472-5229-5fa6-8340-3ab9f5e814c8 with identifier: 1985686
2026-03-26 22:58:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: cee14472-5229-5fa6-8340-3ab9f5e814c8 with identifier: 1985686
2026-03-26 22:58:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: cee14472-5229-5fa6-8340-3ab9f5e814c8 with identifier: 1985686 to the API
2026-03-26 22:58:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:58:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:58:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bl/3fd3478027884bcdbc5457bf8a21380c/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'cee14472-5229-5fa6-8340-3ab9f5e814c8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 150966,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cee14472-5229-5fa6-8340-3ab9f5e814c8/cee14472-5229-5fa6-8340-3ab9f5e814c8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 642226,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/3fd3478027884bcdbc5457bf8a21380c/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cee14472-5229-5fa6-8340-3ab9f5e814c8/cee14472-5229-5fa6-8340-3ab9f5e814c8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 671540,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/3fd3478027884bcdbc5457bf8a21380c/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cee14472-5229-5fa6-8340-3ab9f5e814c8/cee14472-5229-5fa6-8340-3ab9f5e814c8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 586471,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/3fd3478027884bcdbc5457bf8a21380c/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cee14472-5229-5fa6-8340-3ab9f5e814c8/cee14472-5229-5fa6-8340-3ab9f5e814c8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 687953,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/3fd3478027884bcdbc5457bf8a21380c/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cee14472-5229-5fa6-8340-3ab9f5e814c8/cee14472-5229-5fa6-8340-3ab9f5e814c8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 603194,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/3fd3478027884bcdbc5457bf8a21380c/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cee14472-5229-5fa6-8340-3ab9f5e814c8/cee14472-5229-5fa6-8340-3ab9f5e814c8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 614235,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/3fd3478027884bcdbc5457bf8a21380c/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cee14472-5229-5fa6-8340-3ab9f5e814c8/cee14472-5229-5fa6-8340-3ab9f5e814c8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 592300,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/3fd3478027884bcdbc5457bf8a21380c/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cee14472-5229-5fa6-8340-3ab9f5e814c8/cee14472-5229-5fa6-8340-3ab9f5e814c8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 632780,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/3fd3478027884bcdbc5457bf8a21380c/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cee14472-5229-5fa6-8340-3ab9f5e814c8/cee14472-5229-5fa6-8340-3ab9f5e814c8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 627545,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/3fd3478027884bcdbc5457bf8a21380c/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cee14472-5229-5fa6-8340-3ab9f5e814c8/cee14472-5229-5fa6-8340-3ab9f5e814c8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 638179,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/3fd3478027884bcdbc5457bf8a21380c/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 1.5 XDRIVE25E (162KW)',
 'transmission': 'automatic',
 'trim': '1.5 XDRIVE25E (162KW)',
 'vin': None,
 'year': 2022}
2026-03-26 22:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985686%27 HTTP/1.1" 200 None
2026-03-26 22:58:25 [ayvens.be] INFO: Saving data for 1985686: {'created_time': 1774565905.561716, 'last_price_update_time': 1774565905.561726, 'auction_closing_time': 1774958400.0}
2026-03-26 22:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985686') HTTP/1.1" 204 0
2026-03-26 22:58:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ah/62b411a368bb418cb4f9f7ab2c6c7638/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F6e1ddf3292884f51ba576737e391865c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/6e1ddf3292884f51ba576737e391865c/images/large/3.jpg not downloaded yet
2026-03-26 22:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F6e1ddf3292884f51ba576737e391865c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/6e1ddf3292884f51ba576737e391865c/images/large/4.jpg not downloaded yet
2026-03-26 22:58:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7cea7d0>
2026-03-26 22:58:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d/24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F62b411a368bb418cb4f9f7ab2c6c7638%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/62b411a368bb418cb4f9f7ab2c6c7638/images/large/8.jpg saved to cache
2026-03-26 22:58:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d
2026-03-26 22:58:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/6777771e11884601bd2cc9687b5d98d4/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/6777771e11884601bd2cc9687b5d98d4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ah/62b411a368bb418cb4f9f7ab2c6c7638/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F6e1ddf3292884f51ba576737e391865c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/6e1ddf3292884f51ba576737e391865c/images/large/5.jpg not downloaded yet
2026-03-26 22:58:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/6777771e11884601bd2cc9687b5d98d4/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F6e1ddf3292884f51ba576737e391865c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/6e1ddf3292884f51ba576737e391865c/images/large/6.jpg not downloaded yet
2026-03-26 22:58:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c6a4d0>
2026-03-26 22:58:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d/24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F62b411a368bb418cb4f9f7ab2c6c7638%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/62b411a368bb418cb4f9f7ab2c6c7638/images/large/7.jpg saved to cache
2026-03-26 22:58:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d
2026-03-26 22:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F6e1ddf3292884f51ba576737e391865c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/6e1ddf3292884f51ba576737e391865c/images/large/7.jpg not downloaded yet
2026-03-26 22:58:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/6777771e11884601bd2cc9687b5d98d4/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/6777771e11884601bd2cc9687b5d98d4/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F6e1ddf3292884f51ba576737e391865c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/6e1ddf3292884f51ba576737e391865c/images/large/8.jpg not downloaded yet
2026-03-26 22:58:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/6777771e11884601bd2cc9687b5d98d4/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6e2bed0>
2026-03-26 22:58:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f721e15-332b-51f4-b704-261dcb3d5496/3f721e15-332b-51f4-b704-261dcb3d5496_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F6777771e11884601bd2cc9687b5d98d4%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/6777771e11884601bd2cc9687b5d98d4/images/large/2.jpg saved to cache
2026-03-26 22:58:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3f721e15-332b-51f4-b704-261dcb3d5496
2026-03-26 22:58:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b78a8410>
2026-03-26 22:58:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f721e15-332b-51f4-b704-261dcb3d5496/3f721e15-332b-51f4-b704-261dcb3d5496_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:58:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F6777771e11884601bd2cc9687b5d98d4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/6777771e11884601bd2cc9687b5d98d4/images/large/1.jpg saved to cache
2026-03-26 22:58:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3f721e15-332b-51f4-b704-261dcb3d5496
2026-03-26 22:58:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76cf850>
2026-03-26 22:58:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d/24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:58:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F62b411a368bb418cb4f9f7ab2c6c7638%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/62b411a368bb418cb4f9f7ab2c6c7638/images/large/6.jpg saved to cache
2026-03-26 22:58:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d
2026-03-26 22:58:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d, skipping ID generation
2026-03-26 22:58:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d with scrape type 1
2026-03-26 22:58:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d sending to next pipeline
2026-03-26 22:58:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d, identifier: 1985687
2026-03-26 22:58:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7415850>
2026-03-26 22:58:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f721e15-332b-51f4-b704-261dcb3d5496/3f721e15-332b-51f4-b704-261dcb3d5496_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:58:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F6777771e11884601bd2cc9687b5d98d4%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/6777771e11884601bd2cc9687b5d98d4/images/large/5.jpg saved to cache
2026-03-26 22:58:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3f721e15-332b-51f4-b704-261dcb3d5496
2026-03-26 22:58:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F6e1ddf3292884f51ba576737e391865c%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/6e1ddf3292884f51ba576737e391865c/images/large/9.jpg not downloaded yet
2026-03-26 22:58:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d with identifier: 1985687
2026-03-26 22:58:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d with identifier: 1985687
2026-03-26 22:58:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d with identifier: 1985687 to the API
2026-03-26 22:58:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:58:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:58:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ah/62b411a368bb418cb4f9f7ab2c6c7638/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '5 SERIES TOURING',
 'odometer': 120814,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d/24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 264412,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ah/62b411a368bb418cb4f9f7ab2c6c7638/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d/24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 262892,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ah/62b411a368bb418cb4f9f7ab2c6c7638/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d/24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 240724,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ah/62b411a368bb418cb4f9f7ab2c6c7638/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d/24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 229744,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ah/62b411a368bb418cb4f9f7ab2c6c7638/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d/24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 316610,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ah/62b411a368bb418cb4f9f7ab2c6c7638/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d/24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 301497,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ah/62b411a368bb418cb4f9f7ab2c6c7638/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d/24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 263314,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ah/62b411a368bb418cb4f9f7ab2c6c7638/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d/24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 389451,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ah/62b411a368bb418cb4f9f7ab2c6c7638/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d/24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 217896,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ah/62b411a368bb418cb4f9f7ab2c6c7638/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d/24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 314960,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ah/62b411a368bb418cb4f9f7ab2c6c7638/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 5 SERIES TOURING 2.0 518D 110KW TOURING AUTO',
 'transmission': 'automatic',
 'trim': '2.0 518D 110KW TOURING AUTO',
 'vin': None,
 'year': 2021}
2026-03-26 22:58:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985687%27 HTTP/1.1" 200 None
2026-03-26 22:58:26 [ayvens.be] INFO: Saving data for 1985687: {'created_time': 1774565906.605945, 'last_price_update_time': 1774565906.605955, 'auction_closing_time': 1774958400.0}
2026-03-26 22:58:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985687') HTTP/1.1" 204 0
2026-03-26 22:58:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/6777771e11884601bd2cc9687b5d98d4/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F6e1ddf3292884f51ba576737e391865c%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/6e1ddf3292884f51ba576737e391865c/images/large/10.jpg not downloaded yet
2026-03-26 22:58:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/6777771e11884601bd2cc9687b5d98d4/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/6777771e11884601bd2cc9687b5d98d4/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:26 [ayvens.be] INFO: Found listing with ID: 1985690
2026-03-26 22:58:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985690%27 HTTP/1.1" 200 None
2026-03-26 22:58:26 [ayvens.be] INFO: Scrape type for 1985690: 1
2026-03-26 22:58:26 [ayvens.be] INFO: Extracting data for car ID: 1985690
2026-03-26 22:58:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f23d59d4-bf04-53b9-9d1d-7ba64f201fe0 with identifier: 1985690
2026-03-26 22:58:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f23d59d4-bf04-53b9-9d1d-7ba64f201fe0 with scrape type 1
2026-03-26 22:58:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f23d59d4-bf04-53b9-9d1d-7ba64f201fe0
2026-03-26 22:58:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F7769f03748bb46f59925e77ea7a7fd3a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/7769f03748bb46f59925e77ea7a7fd3a/images/large/1.jpg not downloaded yet
2026-03-26 22:58:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7ceb750>
2026-03-26 22:58:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f721e15-332b-51f4-b704-261dcb3d5496/3f721e15-332b-51f4-b704-261dcb3d5496_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:58:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F6777771e11884601bd2cc9687b5d98d4%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/6777771e11884601bd2cc9687b5d98d4/images/large/4.jpg saved to cache
2026-03-26 22:58:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3f721e15-332b-51f4-b704-261dcb3d5496
2026-03-26 22:58:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7570690>
2026-03-26 22:58:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f721e15-332b-51f4-b704-261dcb3d5496/3f721e15-332b-51f4-b704-261dcb3d5496_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:58:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F6777771e11884601bd2cc9687b5d98d4%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/6777771e11884601bd2cc9687b5d98d4/images/large/3.jpg saved to cache
2026-03-26 22:58:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3f721e15-332b-51f4-b704-261dcb3d5496
2026-03-26 22:58:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7defdd0>
2026-03-26 22:58:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f721e15-332b-51f4-b704-261dcb3d5496/3f721e15-332b-51f4-b704-261dcb3d5496_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:58:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F6777771e11884601bd2cc9687b5d98d4%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/6777771e11884601bd2cc9687b5d98d4/images/large/7.jpg saved to cache
2026-03-26 22:58:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3f721e15-332b-51f4-b704-261dcb3d5496
2026-03-26 22:58:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/6777771e11884601bd2cc9687b5d98d4/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F7769f03748bb46f59925e77ea7a7fd3a%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/7769f03748bb46f59925e77ea7a7fd3a/images/large/2.jpg not downloaded yet
2026-03-26 22:58:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F7769f03748bb46f59925e77ea7a7fd3a%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/7769f03748bb46f59925e77ea7a7fd3a/images/large/3.jpg not downloaded yet
2026-03-26 22:58:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7448250>
2026-03-26 22:58:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f721e15-332b-51f4-b704-261dcb3d5496/3f721e15-332b-51f4-b704-261dcb3d5496_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:58:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F6777771e11884601bd2cc9687b5d98d4%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/6777771e11884601bd2cc9687b5d98d4/images/large/10.jpg saved to cache
2026-03-26 22:58:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3f721e15-332b-51f4-b704-261dcb3d5496
2026-03-26 22:58:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7cea510>
2026-03-26 22:58:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f721e15-332b-51f4-b704-261dcb3d5496/3f721e15-332b-51f4-b704-261dcb3d5496_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:58:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F6777771e11884601bd2cc9687b5d98d4%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/6777771e11884601bd2cc9687b5d98d4/images/large/9.jpg saved to cache
2026-03-26 22:58:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3f721e15-332b-51f4-b704-261dcb3d5496
2026-03-26 22:58:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c81f10>
2026-03-26 22:58:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f721e15-332b-51f4-b704-261dcb3d5496/3f721e15-332b-51f4-b704-261dcb3d5496_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:58:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F6777771e11884601bd2cc9687b5d98d4%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/6777771e11884601bd2cc9687b5d98d4/images/large/6.jpg saved to cache
2026-03-26 22:58:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3f721e15-332b-51f4-b704-261dcb3d5496
2026-03-26 22:58:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/6e1ddf3292884f51ba576737e391865c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F7769f03748bb46f59925e77ea7a7fd3a%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/7769f03748bb46f59925e77ea7a7fd3a/images/large/4.jpg not downloaded yet
2026-03-26 22:58:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/6e1ddf3292884f51ba576737e391865c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/6e1ddf3292884f51ba576737e391865c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F7769f03748bb46f59925e77ea7a7fd3a%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/7769f03748bb46f59925e77ea7a7fd3a/images/large/5.jpg not downloaded yet
2026-03-26 22:58:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F7769f03748bb46f59925e77ea7a7fd3a%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/7769f03748bb46f59925e77ea7a7fd3a/images/large/6.jpg not downloaded yet
2026-03-26 22:58:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cbd250>
2026-03-26 22:58:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f721e15-332b-51f4-b704-261dcb3d5496/3f721e15-332b-51f4-b704-261dcb3d5496_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:58:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F6777771e11884601bd2cc9687b5d98d4%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/6777771e11884601bd2cc9687b5d98d4/images/large/8.jpg saved to cache
2026-03-26 22:58:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3f721e15-332b-51f4-b704-261dcb3d5496
2026-03-26 22:58:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3f721e15-332b-51f4-b704-261dcb3d5496, skipping ID generation
2026-03-26 22:58:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f721e15-332b-51f4-b704-261dcb3d5496 with scrape type 1
2026-03-26 22:58:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3f721e15-332b-51f4-b704-261dcb3d5496 sending to next pipeline
2026-03-26 22:58:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 3f721e15-332b-51f4-b704-261dcb3d5496, identifier: 1985688
2026-03-26 22:58:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 3f721e15-332b-51f4-b704-261dcb3d5496 with identifier: 1985688
2026-03-26 22:58:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 3f721e15-332b-51f4-b704-261dcb3d5496 with identifier: 1985688
2026-03-26 22:58:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 3f721e15-332b-51f4-b704-261dcb3d5496 with identifier: 1985688 to the API
2026-03-26 22:58:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:58:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:58:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2dt/6777771e11884601bd2cc9687b5d98d4/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '3f721e15-332b-51f4-b704-261dcb3d5496',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF VIII',
 'odometer': 56982,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f721e15-332b-51f4-b704-261dcb3d5496/3f721e15-332b-51f4-b704-261dcb3d5496_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 617553,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/6777771e11884601bd2cc9687b5d98d4/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f721e15-332b-51f4-b704-261dcb3d5496/3f721e15-332b-51f4-b704-261dcb3d5496_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 624090,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/6777771e11884601bd2cc9687b5d98d4/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f721e15-332b-51f4-b704-261dcb3d5496/3f721e15-332b-51f4-b704-261dcb3d5496_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 684504,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/6777771e11884601bd2cc9687b5d98d4/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f721e15-332b-51f4-b704-261dcb3d5496/3f721e15-332b-51f4-b704-261dcb3d5496_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 709196,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/6777771e11884601bd2cc9687b5d98d4/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f721e15-332b-51f4-b704-261dcb3d5496/3f721e15-332b-51f4-b704-261dcb3d5496_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 658169,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/6777771e11884601bd2cc9687b5d98d4/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f721e15-332b-51f4-b704-261dcb3d5496/3f721e15-332b-51f4-b704-261dcb3d5496_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 564323,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/6777771e11884601bd2cc9687b5d98d4/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f721e15-332b-51f4-b704-261dcb3d5496/3f721e15-332b-51f4-b704-261dcb3d5496_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 722761,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/6777771e11884601bd2cc9687b5d98d4/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f721e15-332b-51f4-b704-261dcb3d5496/3f721e15-332b-51f4-b704-261dcb3d5496_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 688843,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/6777771e11884601bd2cc9687b5d98d4/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f721e15-332b-51f4-b704-261dcb3d5496/3f721e15-332b-51f4-b704-261dcb3d5496_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 575326,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/6777771e11884601bd2cc9687b5d98d4/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f721e15-332b-51f4-b704-261dcb3d5496/3f721e15-332b-51f4-b704-261dcb3d5496_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 419822,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/6777771e11884601bd2cc9687b5d98d4/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF VIII 1.4 EHYBRID STYLE BUSINESS DSG',
 'transmission': 'automatic',
 'trim': '1.4 EHYBRID STYLE BUSINESS DSG',
 'vin': None,
 'year': 2023}
2026-03-26 22:58:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985688%27 HTTP/1.1" 200 None
2026-03-26 22:58:27 [ayvens.be] INFO: Saving data for 1985688: {'created_time': 1774565907.768266, 'last_price_update_time': 1774565907.768276, 'auction_closing_time': 1774958400.0}
2026-03-26 22:58:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985688') HTTP/1.1" 204 0
2026-03-26 22:58:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/6e1ddf3292884f51ba576737e391865c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F7769f03748bb46f59925e77ea7a7fd3a%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/7769f03748bb46f59925e77ea7a7fd3a/images/large/7.jpg not downloaded yet
2026-03-26 22:58:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/6e1ddf3292884f51ba576737e391865c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F7769f03748bb46f59925e77ea7a7fd3a%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/7769f03748bb46f59925e77ea7a7fd3a/images/large/8.jpg not downloaded yet
2026-03-26 22:58:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5cbd590>
2026-03-26 22:58:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_553a68b8-cbe1-5949-add3-97bebbbbfdee/553a68b8-cbe1-5949-add3-97bebbbbfdee_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:58:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F6e1ddf3292884f51ba576737e391865c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/6e1ddf3292884f51ba576737e391865c/images/large/1.jpg saved to cache
2026-03-26 22:58:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 553a68b8-cbe1-5949-add3-97bebbbbfdee
2026-03-26 22:58:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79cd290>
2026-03-26 22:58:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_553a68b8-cbe1-5949-add3-97bebbbbfdee/553a68b8-cbe1-5949-add3-97bebbbbfdee_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:58:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F6e1ddf3292884f51ba576737e391865c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/6e1ddf3292884f51ba576737e391865c/images/large/4.jpg saved to cache
2026-03-26 22:58:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 553a68b8-cbe1-5949-add3-97bebbbbfdee
2026-03-26 22:58:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c5fe50>
2026-03-26 22:58:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_553a68b8-cbe1-5949-add3-97bebbbbfdee/553a68b8-cbe1-5949-add3-97bebbbbfdee_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F6e1ddf3292884f51ba576737e391865c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/6e1ddf3292884f51ba576737e391865c/images/large/3.jpg saved to cache
2026-03-26 22:58:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 553a68b8-cbe1-5949-add3-97bebbbbfdee
2026-03-26 22:58:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/6e1ddf3292884f51ba576737e391865c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F7769f03748bb46f59925e77ea7a7fd3a%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/7769f03748bb46f59925e77ea7a7fd3a/images/large/9.jpg not downloaded yet
2026-03-26 22:58:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/6e1ddf3292884f51ba576737e391865c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77cad10>
2026-03-26 22:58:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_553a68b8-cbe1-5949-add3-97bebbbbfdee/553a68b8-cbe1-5949-add3-97bebbbbfdee_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F6e1ddf3292884f51ba576737e391865c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/6e1ddf3292884f51ba576737e391865c/images/large/5.jpg saved to cache
2026-03-26 22:58:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 553a68b8-cbe1-5949-add3-97bebbbbfdee
2026-03-26 22:58:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79f3d10>
2026-03-26 22:58:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_553a68b8-cbe1-5949-add3-97bebbbbfdee/553a68b8-cbe1-5949-add3-97bebbbbfdee_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F6e1ddf3292884f51ba576737e391865c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/6e1ddf3292884f51ba576737e391865c/images/large/2.jpg saved to cache
2026-03-26 22:58:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 553a68b8-cbe1-5949-add3-97bebbbbfdee
2026-03-26 22:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F7769f03748bb46f59925e77ea7a7fd3a%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/7769f03748bb46f59925e77ea7a7fd3a/images/large/10.jpg not downloaded yet
2026-03-26 22:58:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/6e1ddf3292884f51ba576737e391865c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:28 [ayvens.be] INFO: Found listing with ID: 1985691
2026-03-26 22:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985691%27 HTTP/1.1" 200 None
2026-03-26 22:58:28 [ayvens.be] INFO: Scrape type for 1985691: 1
2026-03-26 22:58:28 [ayvens.be] INFO: Extracting data for car ID: 1985691
2026-03-26 22:58:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 63e367b0-917d-51cc-9c21-36a4976b89c1 with identifier: 1985691
2026-03-26 22:58:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63e367b0-917d-51cc-9c21-36a4976b89c1 with scrape type 1
2026-03-26 22:58:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 63e367b0-917d-51cc-9c21-36a4976b89c1
2026-03-26 22:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fbd6015f82c01430188203aa1036a5e21%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/bd6015f82c01430188203aa1036a5e21/images/large/1.jpg not downloaded yet
2026-03-26 22:58:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b5c6b090>
2026-03-26 22:58:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_553a68b8-cbe1-5949-add3-97bebbbbfdee/553a68b8-cbe1-5949-add3-97bebbbbfdee_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F6e1ddf3292884f51ba576737e391865c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/6e1ddf3292884f51ba576737e391865c/images/large/7.jpg saved to cache
2026-03-26 22:58:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 553a68b8-cbe1-5949-add3-97bebbbbfdee
2026-03-26 22:58:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6dc1150>
2026-03-26 22:58:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_553a68b8-cbe1-5949-add3-97bebbbbfdee/553a68b8-cbe1-5949-add3-97bebbbbfdee_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F6e1ddf3292884f51ba576737e391865c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/6e1ddf3292884f51ba576737e391865c/images/large/6.jpg saved to cache
2026-03-26 22:58:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 553a68b8-cbe1-5949-add3-97bebbbbfdee
2026-03-26 22:58:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/7769f03748bb46f59925e77ea7a7fd3a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fbd6015f82c01430188203aa1036a5e21%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/bd6015f82c01430188203aa1036a5e21/images/large/2.jpg not downloaded yet
2026-03-26 22:58:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/6e1ddf3292884f51ba576737e391865c/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/6e1ddf3292884f51ba576737e391865c/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fbd6015f82c01430188203aa1036a5e21%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/bd6015f82c01430188203aa1036a5e21/images/large/3.jpg not downloaded yet
2026-03-26 22:58:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7745e90>
2026-03-26 22:58:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_553a68b8-cbe1-5949-add3-97bebbbbfdee/553a68b8-cbe1-5949-add3-97bebbbbfdee_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F6e1ddf3292884f51ba576737e391865c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/6e1ddf3292884f51ba576737e391865c/images/large/8.jpg saved to cache
2026-03-26 22:58:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 553a68b8-cbe1-5949-add3-97bebbbbfdee
2026-03-26 22:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fbd6015f82c01430188203aa1036a5e21%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/bd6015f82c01430188203aa1036a5e21/images/large/4.jpg not downloaded yet
2026-03-26 22:58:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/7769f03748bb46f59925e77ea7a7fd3a/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fbd6015f82c01430188203aa1036a5e21%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/bd6015f82c01430188203aa1036a5e21/images/large/5.jpg not downloaded yet
2026-03-26 22:58:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/7769f03748bb46f59925e77ea7a7fd3a/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fbd6015f82c01430188203aa1036a5e21%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/bd6015f82c01430188203aa1036a5e21/images/large/6.jpg not downloaded yet
2026-03-26 22:58:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7876c90>
2026-03-26 22:58:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f23d59d4-bf04-53b9-9d1d-7ba64f201fe0/f23d59d4-bf04-53b9-9d1d-7ba64f201fe0_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F7769f03748bb46f59925e77ea7a7fd3a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/7769f03748bb46f59925e77ea7a7fd3a/images/large/1.jpg saved to cache
2026-03-26 22:58:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f23d59d4-bf04-53b9-9d1d-7ba64f201fe0
2026-03-26 22:58:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7476110>
2026-03-26 22:58:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_553a68b8-cbe1-5949-add3-97bebbbbfdee/553a68b8-cbe1-5949-add3-97bebbbbfdee_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F6e1ddf3292884f51ba576737e391865c%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/6e1ddf3292884f51ba576737e391865c/images/large/9.jpg saved to cache
2026-03-26 22:58:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 553a68b8-cbe1-5949-add3-97bebbbbfdee
2026-03-26 22:58:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77bef10>
2026-03-26 22:58:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_553a68b8-cbe1-5949-add3-97bebbbbfdee/553a68b8-cbe1-5949-add3-97bebbbbfdee_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F6e1ddf3292884f51ba576737e391865c%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/6e1ddf3292884f51ba576737e391865c/images/large/10.jpg saved to cache
2026-03-26 22:58:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 553a68b8-cbe1-5949-add3-97bebbbbfdee
2026-03-26 22:58:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 553a68b8-cbe1-5949-add3-97bebbbbfdee, skipping ID generation
2026-03-26 22:58:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 553a68b8-cbe1-5949-add3-97bebbbbfdee with scrape type 1
2026-03-26 22:58:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 553a68b8-cbe1-5949-add3-97bebbbbfdee sending to next pipeline
2026-03-26 22:58:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 553a68b8-cbe1-5949-add3-97bebbbbfdee, identifier: 1985689
2026-03-26 22:58:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 553a68b8-cbe1-5949-add3-97bebbbbfdee with identifier: 1985689
2026-03-26 22:58:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 553a68b8-cbe1-5949-add3-97bebbbbfdee with identifier: 1985689
2026-03-26 22:58:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 553a68b8-cbe1-5949-add3-97bebbbbfdee with identifier: 1985689 to the API
2026-03-26 22:58:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:58:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:58:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yw/6e1ddf3292884f51ba576737e391865c/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '553a68b8-cbe1-5949-add3-97bebbbbfdee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLC',
 'odometer': 59283,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_553a68b8-cbe1-5949-add3-97bebbbbfdee/553a68b8-cbe1-5949-add3-97bebbbbfdee_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 662237,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/6e1ddf3292884f51ba576737e391865c/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_553a68b8-cbe1-5949-add3-97bebbbbfdee/553a68b8-cbe1-5949-add3-97bebbbbfdee_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 648417,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/6e1ddf3292884f51ba576737e391865c/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_553a68b8-cbe1-5949-add3-97bebbbbfdee/553a68b8-cbe1-5949-add3-97bebbbbfdee_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 658707,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/6e1ddf3292884f51ba576737e391865c/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_553a68b8-cbe1-5949-add3-97bebbbbfdee/553a68b8-cbe1-5949-add3-97bebbbbfdee_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 695515,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/6e1ddf3292884f51ba576737e391865c/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_553a68b8-cbe1-5949-add3-97bebbbbfdee/553a68b8-cbe1-5949-add3-97bebbbbfdee_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 675757,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/6e1ddf3292884f51ba576737e391865c/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_553a68b8-cbe1-5949-add3-97bebbbbfdee/553a68b8-cbe1-5949-add3-97bebbbbfdee_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 733014,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/6e1ddf3292884f51ba576737e391865c/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_553a68b8-cbe1-5949-add3-97bebbbbfdee/553a68b8-cbe1-5949-add3-97bebbbbfdee_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 592031,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/6e1ddf3292884f51ba576737e391865c/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_553a68b8-cbe1-5949-add3-97bebbbbfdee/553a68b8-cbe1-5949-add3-97bebbbbfdee_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 874816,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/6e1ddf3292884f51ba576737e391865c/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_553a68b8-cbe1-5949-add3-97bebbbbfdee/553a68b8-cbe1-5949-add3-97bebbbbfdee_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 834881,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/6e1ddf3292884f51ba576737e391865c/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_553a68b8-cbe1-5949-add3-97bebbbbfdee/553a68b8-cbe1-5949-add3-97bebbbbfdee_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 816382,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/6e1ddf3292884f51ba576737e391865c/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLC 2.0 GLC 300 DE 4MATIC 4WD AUTO',
 'transmission': 'automatic',
 'trim': '2.0 GLC 300 DE 4MATIC 4WD AUTO',
 'vin': None,
 'year': 2021}
2026-03-26 22:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985689%27 HTTP/1.1" 200 None
2026-03-26 22:58:29 [ayvens.be] INFO: Saving data for 1985689: {'created_time': 1774565909.572962, 'last_price_update_time': 1774565909.572971, 'auction_closing_time': 1774958400.0}
2026-03-26 22:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985689') HTTP/1.1" 204 0
2026-03-26 22:58:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/7769f03748bb46f59925e77ea7a7fd3a/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fbd6015f82c01430188203aa1036a5e21%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/bd6015f82c01430188203aa1036a5e21/images/large/7.jpg not downloaded yet
2026-03-26 22:58:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/7769f03748bb46f59925e77ea7a7fd3a/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fbd6015f82c01430188203aa1036a5e21%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/bd6015f82c01430188203aa1036a5e21/images/large/8.jpg not downloaded yet
2026-03-26 22:58:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b6d72fd0>
2026-03-26 22:58:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f23d59d4-bf04-53b9-9d1d-7ba64f201fe0/f23d59d4-bf04-53b9-9d1d-7ba64f201fe0_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F7769f03748bb46f59925e77ea7a7fd3a%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/7769f03748bb46f59925e77ea7a7fd3a/images/large/2.jpg saved to cache
2026-03-26 22:58:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f23d59d4-bf04-53b9-9d1d-7ba64f201fe0
2026-03-26 22:58:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79446d0>
2026-03-26 22:58:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f23d59d4-bf04-53b9-9d1d-7ba64f201fe0/f23d59d4-bf04-53b9-9d1d-7ba64f201fe0_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F7769f03748bb46f59925e77ea7a7fd3a%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/7769f03748bb46f59925e77ea7a7fd3a/images/large/3.jpg saved to cache
2026-03-26 22:58:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f23d59d4-bf04-53b9-9d1d-7ba64f201fe0
2026-03-26 22:58:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/bd6015f82c01430188203aa1036a5e21/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fbd6015f82c01430188203aa1036a5e21%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/bd6015f82c01430188203aa1036a5e21/images/large/9.jpg not downloaded yet
2026-03-26 22:58:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/7769f03748bb46f59925e77ea7a7fd3a/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fbd6015f82c01430188203aa1036a5e21%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 22:58:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/bd6015f82c01430188203aa1036a5e21/images/large/10.jpg not downloaded yet
2026-03-26 22:58:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7877fd0>
2026-03-26 22:58:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f23d59d4-bf04-53b9-9d1d-7ba64f201fe0/f23d59d4-bf04-53b9-9d1d-7ba64f201fe0_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F7769f03748bb46f59925e77ea7a7fd3a%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/7769f03748bb46f59925e77ea7a7fd3a/images/large/5.jpg saved to cache
2026-03-26 22:58:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f23d59d4-bf04-53b9-9d1d-7ba64f201fe0
2026-03-26 22:58:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7818ed0>
2026-03-26 22:58:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f23d59d4-bf04-53b9-9d1d-7ba64f201fe0/f23d59d4-bf04-53b9-9d1d-7ba64f201fe0_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:58:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F7769f03748bb46f59925e77ea7a7fd3a%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/7769f03748bb46f59925e77ea7a7fd3a/images/large/4.jpg saved to cache
2026-03-26 22:58:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f23d59d4-bf04-53b9-9d1d-7ba64f201fe0
2026-03-26 22:58:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/bd6015f82c01430188203aa1036a5e21/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:30 [ayvens.be] INFO: Found listing with ID: 1982329
2026-03-26 22:58:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982329%27 HTTP/1.1" 200 None
2026-03-26 22:58:30 [ayvens.be] INFO: Scrape type for 1982329: 2
2026-03-26 22:58:30 [ayvens.be] INFO: Extracting data for car ID: 1982329
2026-03-26 22:58:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 88032add-a537-5e53-ada9-4a19d9dc69ef with identifier: 1982329
2026-03-26 22:58:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88032add-a537-5e53-ada9-4a19d9dc69ef with scrape type 2
2026-03-26 22:58:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 88032add-a537-5e53-ada9-4a19d9dc69ef with scrape type 2
2026-03-26 22:58:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 88032add-a537-5e53-ada9-4a19d9dc69ef, identifier: 1982329
2026-03-26 22:58:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/7769f03748bb46f59925e77ea7a7fd3a/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 88032add-a537-5e53-ada9-4a19d9dc69ef with identifier: 1982329
2026-03-26 22:58:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 88032add-a537-5e53-ada9-4a19d9dc69ef with identifier: 1982329
2026-03-26 22:58:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 88032add-a537-5e53-ada9-4a19d9dc69ef with identifier: 1982329 to the API
2026-03-26 22:58:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:58:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:58:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '88032add-a537-5e53-ada9-4a19d9dc69ef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X3',
 'odometer': 33237,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X3 2.0 SDRIVE18D (100KW) AUTO',
 'transmission': 'automatic',
 'trim': '2.0 SDRIVE18D (100KW) AUTO',
 'vin': None,
 'year': 2022}
2026-03-26 22:58:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982329%27 HTTP/1.1" 200 None
2026-03-26 22:58:30 [ayvens.be] INFO: Saving data for 1982329: {'auction_closing_time': 1774942200.0, 'created_time': 1774478788.26907, 'last_price_update_time': 1774565910.444699}
2026-03-26 22:58:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982329') HTTP/1.1" 204 0
2026-03-26 22:58:30 [ayvens.be] INFO: Found listing with ID: 1982330
2026-03-26 22:58:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982330%27 HTTP/1.1" 200 None
2026-03-26 22:58:30 [ayvens.be] INFO: Scrape type for 1982330: 2
2026-03-26 22:58:30 [ayvens.be] INFO: Extracting data for car ID: 1982330
2026-03-26 22:58:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3d264e6-64ee-5681-a2e2-b5c058193019 with identifier: 1982330
2026-03-26 22:58:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3d264e6-64ee-5681-a2e2-b5c058193019 with scrape type 2
2026-03-26 22:58:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d3d264e6-64ee-5681-a2e2-b5c058193019 with scrape type 2
2026-03-26 22:58:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d3d264e6-64ee-5681-a2e2-b5c058193019, identifier: 1982330
2026-03-26 22:58:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/bd6015f82c01430188203aa1036a5e21/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d3d264e6-64ee-5681-a2e2-b5c058193019 with identifier: 1982330
2026-03-26 22:58:30 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 22:58:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 22:58:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d3d264e6-64ee-5681-a2e2-b5c058193019 with identifier: 1982330
2026-03-26 22:58:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d3d264e6-64ee-5681-a2e2-b5c058193019 with identifier: 1982330 to the API
2026-03-26 22:58:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:58:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:58:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'color': 'BLANC NACRE',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'd3d264e6-64ee-5681-a2e2-b5c058193019',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008 DIESEL - 2016',
 'odometer': 187463,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-06',
 'seats_number': None,
 'seller_name': None,
 'title': 'PEUGEOT 3008 DIESEL - 2016 2.0 BlueHDi GT (EU6.2)',
 'transmission': 'automatic',
 'trim': '2.0 BlueHDi GT (EU6.2)',
 'vin': None,
 'year': 2019}
2026-03-26 22:58:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982330%27 HTTP/1.1" 200 None
2026-03-26 22:58:30 [ayvens.be] INFO: Saving data for 1982330: {'auction_closing_time': 1774942200.0, 'created_time': 1774478789.41912, 'last_price_update_time': 1774565910.864298}
2026-03-26 22:58:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982330') HTTP/1.1" 204 0
2026-03-26 22:58:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7a81990>
2026-03-26 22:58:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63e367b0-917d-51cc-9c21-36a4976b89c1/63e367b0-917d-51cc-9c21-36a4976b89c1_image_0.jpg HTTP/1.1" 201 0
2026-03-26 22:58:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fbd6015f82c01430188203aa1036a5e21%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/bd6015f82c01430188203aa1036a5e21/images/large/1.jpg saved to cache
2026-03-26 22:58:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 63e367b0-917d-51cc-9c21-36a4976b89c1
2026-03-26 22:58:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79d7450>
2026-03-26 22:58:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f23d59d4-bf04-53b9-9d1d-7ba64f201fe0/f23d59d4-bf04-53b9-9d1d-7ba64f201fe0_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:58:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F7769f03748bb46f59925e77ea7a7fd3a%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/7769f03748bb46f59925e77ea7a7fd3a/images/large/6.jpg saved to cache
2026-03-26 22:58:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f23d59d4-bf04-53b9-9d1d-7ba64f201fe0
2026-03-26 22:58:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b74dda50>
2026-03-26 22:58:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63e367b0-917d-51cc-9c21-36a4976b89c1/63e367b0-917d-51cc-9c21-36a4976b89c1_image_1.jpg HTTP/1.1" 201 0
2026-03-26 22:58:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fbd6015f82c01430188203aa1036a5e21%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/bd6015f82c01430188203aa1036a5e21/images/large/2.jpg saved to cache
2026-03-26 22:58:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 63e367b0-917d-51cc-9c21-36a4976b89c1
2026-03-26 22:58:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/7769f03748bb46f59925e77ea7a7fd3a/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:31 [ayvens.be] INFO: Found listing with ID: 1982331
2026-03-26 22:58:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982331%27 HTTP/1.1" 200 None
2026-03-26 22:58:31 [ayvens.be] INFO: Scrape type for 1982331: 2
2026-03-26 22:58:31 [ayvens.be] INFO: Extracting data for car ID: 1982331
2026-03-26 22:58:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a60bbba9-24f5-5fe1-b8e3-c1d495eae495 with identifier: 1982331
2026-03-26 22:58:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a60bbba9-24f5-5fe1-b8e3-c1d495eae495 with scrape type 2
2026-03-26 22:58:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a60bbba9-24f5-5fe1-b8e3-c1d495eae495 with scrape type 2
2026-03-26 22:58:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a60bbba9-24f5-5fe1-b8e3-c1d495eae495, identifier: 1982331
2026-03-26 22:58:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/7769f03748bb46f59925e77ea7a7fd3a/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/7769f03748bb46f59925e77ea7a7fd3a/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a60bbba9-24f5-5fe1-b8e3-c1d495eae495 with identifier: 1982331
2026-03-26 22:58:31 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 22:58:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 22:58:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a60bbba9-24f5-5fe1-b8e3-c1d495eae495 with identifier: 1982331
2026-03-26 22:58:31 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a60bbba9-24f5-5fe1-b8e3-c1d495eae495 with identifier: 1982331 to the API
2026-03-26 22:58:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:58:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:58:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'color': 'METALLIC',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'a60bbba9-24f5-5fe1-b8e3-c1d495eae495',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'B-CLASS',
 'odometer': 155312,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ B-CLASS 2.0 B 180 D BUSINESS SOLUTION DCT',
 'transmission': 'automatic',
 'trim': '2.0 B 180 D BUSINESS SOLUTION DCT',
 'vin': None,
 'year': 2021}
2026-03-26 22:58:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982331%27 HTTP/1.1" 200 None
2026-03-26 22:58:31 [ayvens.be] INFO: Saving data for 1982331: {'auction_closing_time': 1774942200.0, 'created_time': 1774478792.09054, 'last_price_update_time': 1774565911.723672}
2026-03-26 22:58:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982331') HTTP/1.1" 204 0
2026-03-26 22:58:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7946050>
2026-03-26 22:58:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f23d59d4-bf04-53b9-9d1d-7ba64f201fe0/f23d59d4-bf04-53b9-9d1d-7ba64f201fe0_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:58:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F7769f03748bb46f59925e77ea7a7fd3a%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/7769f03748bb46f59925e77ea7a7fd3a/images/large/7.jpg saved to cache
2026-03-26 22:58:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f23d59d4-bf04-53b9-9d1d-7ba64f201fe0
2026-03-26 22:58:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/bd6015f82c01430188203aa1036a5e21/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:31 [ayvens.be] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 600
2026-03-26 22:58:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/bd6015f82c01430188203aa1036a5e21/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80bd235f10>
2026-03-26 22:58:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63e367b0-917d-51cc-9c21-36a4976b89c1/63e367b0-917d-51cc-9c21-36a4976b89c1_image_3.jpg HTTP/1.1" 201 0
2026-03-26 22:58:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fbd6015f82c01430188203aa1036a5e21%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/bd6015f82c01430188203aa1036a5e21/images/large/4.jpg saved to cache
2026-03-26 22:58:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 63e367b0-917d-51cc-9c21-36a4976b89c1
2026-03-26 22:58:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b76ceb90>
2026-03-26 22:58:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f23d59d4-bf04-53b9-9d1d-7ba64f201fe0/f23d59d4-bf04-53b9-9d1d-7ba64f201fe0_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:58:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F7769f03748bb46f59925e77ea7a7fd3a%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/7769f03748bb46f59925e77ea7a7fd3a/images/large/10.jpg saved to cache
2026-03-26 22:58:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f23d59d4-bf04-53b9-9d1d-7ba64f201fe0
2026-03-26 22:58:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-26 22:58:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77449d0>
2026-03-26 22:58:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f23d59d4-bf04-53b9-9d1d-7ba64f201fe0/f23d59d4-bf04-53b9-9d1d-7ba64f201fe0_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:58:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F7769f03748bb46f59925e77ea7a7fd3a%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/7769f03748bb46f59925e77ea7a7fd3a/images/large/9.jpg saved to cache
2026-03-26 22:58:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f23d59d4-bf04-53b9-9d1d-7ba64f201fe0
2026-03-26 22:58:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b79a43d0>
2026-03-26 22:58:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f23d59d4-bf04-53b9-9d1d-7ba64f201fe0/f23d59d4-bf04-53b9-9d1d-7ba64f201fe0_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:58:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F7769f03748bb46f59925e77ea7a7fd3a%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/7769f03748bb46f59925e77ea7a7fd3a/images/large/8.jpg saved to cache
2026-03-26 22:58:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f23d59d4-bf04-53b9-9d1d-7ba64f201fe0
2026-03-26 22:58:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f23d59d4-bf04-53b9-9d1d-7ba64f201fe0, skipping ID generation
2026-03-26 22:58:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f23d59d4-bf04-53b9-9d1d-7ba64f201fe0 with scrape type 1
2026-03-26 22:58:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f23d59d4-bf04-53b9-9d1d-7ba64f201fe0 sending to next pipeline
2026-03-26 22:58:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f23d59d4-bf04-53b9-9d1d-7ba64f201fe0, identifier: 1985690
2026-03-26 22:58:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/bd6015f82c01430188203aa1036a5e21/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f23d59d4-bf04-53b9-9d1d-7ba64f201fe0 with identifier: 1985690
2026-03-26 22:58:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f23d59d4-bf04-53b9-9d1d-7ba64f201fe0 with identifier: 1985690
2026-03-26 22:58:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f23d59d4-bf04-53b9-9d1d-7ba64f201fe0 with identifier: 1985690 to the API
2026-03-26 22:58:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:58:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:58:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bn/7769f03748bb46f59925e77ea7a7fd3a/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'f23d59d4-bf04-53b9-9d1d-7ba64f201fe0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'Octavia',
 'odometer': 86813,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f23d59d4-bf04-53b9-9d1d-7ba64f201fe0/f23d59d4-bf04-53b9-9d1d-7ba64f201fe0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 713882,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/7769f03748bb46f59925e77ea7a7fd3a/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f23d59d4-bf04-53b9-9d1d-7ba64f201fe0/f23d59d4-bf04-53b9-9d1d-7ba64f201fe0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 728064,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/7769f03748bb46f59925e77ea7a7fd3a/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f23d59d4-bf04-53b9-9d1d-7ba64f201fe0/f23d59d4-bf04-53b9-9d1d-7ba64f201fe0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 710120,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/7769f03748bb46f59925e77ea7a7fd3a/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f23d59d4-bf04-53b9-9d1d-7ba64f201fe0/f23d59d4-bf04-53b9-9d1d-7ba64f201fe0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 775641,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/7769f03748bb46f59925e77ea7a7fd3a/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f23d59d4-bf04-53b9-9d1d-7ba64f201fe0/f23d59d4-bf04-53b9-9d1d-7ba64f201fe0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 718321,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/7769f03748bb46f59925e77ea7a7fd3a/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f23d59d4-bf04-53b9-9d1d-7ba64f201fe0/f23d59d4-bf04-53b9-9d1d-7ba64f201fe0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 794008,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/7769f03748bb46f59925e77ea7a7fd3a/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f23d59d4-bf04-53b9-9d1d-7ba64f201fe0/f23d59d4-bf04-53b9-9d1d-7ba64f201fe0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 625223,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/7769f03748bb46f59925e77ea7a7fd3a/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f23d59d4-bf04-53b9-9d1d-7ba64f201fe0/f23d59d4-bf04-53b9-9d1d-7ba64f201fe0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 890446,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/7769f03748bb46f59925e77ea7a7fd3a/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f23d59d4-bf04-53b9-9d1d-7ba64f201fe0/f23d59d4-bf04-53b9-9d1d-7ba64f201fe0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 909646,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/7769f03748bb46f59925e77ea7a7fd3a/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f23d59d4-bf04-53b9-9d1d-7ba64f201fe0/f23d59d4-bf04-53b9-9d1d-7ba64f201fe0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 808285,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/7769f03748bb46f59925e77ea7a7fd3a/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA Octavia 1.4 TSI PHEV 150KW DSG CLEVER+',
 'transmission': 'automatic',
 'trim': '1.4 TSI PHEV 150KW DSG CLEVER+',
 'vin': None,
 'year': 2022}
2026-03-26 22:58:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985690%27 HTTP/1.1" 200 None
2026-03-26 22:58:32 [ayvens.be] INFO: Saving data for 1985690: {'created_time': 1774565912.658525, 'last_price_update_time': 1774565912.658537, 'auction_closing_time': 1774958400.0}
2026-03-26 22:58:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985690') HTTP/1.1" 204 0
2026-03-26 22:58:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7437bd0>
2026-03-26 22:58:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63e367b0-917d-51cc-9c21-36a4976b89c1/63e367b0-917d-51cc-9c21-36a4976b89c1_image_4.jpg HTTP/1.1" 201 0
2026-03-26 22:58:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fbd6015f82c01430188203aa1036a5e21%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/bd6015f82c01430188203aa1036a5e21/images/large/5.jpg saved to cache
2026-03-26 22:58:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 63e367b0-917d-51cc-9c21-36a4976b89c1
2026-03-26 22:58:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77e8690>
2026-03-26 22:58:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63e367b0-917d-51cc-9c21-36a4976b89c1/63e367b0-917d-51cc-9c21-36a4976b89c1_image_5.jpg HTTP/1.1" 201 0
2026-03-26 22:58:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fbd6015f82c01430188203aa1036a5e21%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/bd6015f82c01430188203aa1036a5e21/images/large/6.jpg saved to cache
2026-03-26 22:58:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 63e367b0-917d-51cc-9c21-36a4976b89c1
2026-03-26 22:58:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/bd6015f82c01430188203aa1036a5e21/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/bd6015f82c01430188203aa1036a5e21/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/bd6015f82c01430188203aa1036a5e21/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b72bae50>
2026-03-26 22:58:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63e367b0-917d-51cc-9c21-36a4976b89c1/63e367b0-917d-51cc-9c21-36a4976b89c1_image_6.jpg HTTP/1.1" 201 0
2026-03-26 22:58:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fbd6015f82c01430188203aa1036a5e21%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/bd6015f82c01430188203aa1036a5e21/images/large/7.jpg saved to cache
2026-03-26 22:58:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 63e367b0-917d-51cc-9c21-36a4976b89c1
2026-03-26 22:58:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/bd6015f82c01430188203aa1036a5e21/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 22:58:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b748b610>
2026-03-26 22:58:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63e367b0-917d-51cc-9c21-36a4976b89c1/63e367b0-917d-51cc-9c21-36a4976b89c1_image_7.jpg HTTP/1.1" 201 0
2026-03-26 22:58:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fbd6015f82c01430188203aa1036a5e21%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/bd6015f82c01430188203aa1036a5e21/images/large/8.jpg saved to cache
2026-03-26 22:58:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 63e367b0-917d-51cc-9c21-36a4976b89c1
2026-03-26 22:58:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b77690d0>
2026-03-26 22:58:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63e367b0-917d-51cc-9c21-36a4976b89c1/63e367b0-917d-51cc-9c21-36a4976b89c1_image_2.jpg HTTP/1.1" 201 0
2026-03-26 22:58:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fbd6015f82c01430188203aa1036a5e21%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/bd6015f82c01430188203aa1036a5e21/images/large/3.jpg saved to cache
2026-03-26 22:58:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 63e367b0-917d-51cc-9c21-36a4976b89c1
2026-03-26 22:58:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7b89550>
2026-03-26 22:58:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63e367b0-917d-51cc-9c21-36a4976b89c1/63e367b0-917d-51cc-9c21-36a4976b89c1_image_9.jpg HTTP/1.1" 201 0
2026-03-26 22:58:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fbd6015f82c01430188203aa1036a5e21%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/bd6015f82c01430188203aa1036a5e21/images/large/10.jpg saved to cache
2026-03-26 22:58:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 63e367b0-917d-51cc-9c21-36a4976b89c1
2026-03-26 22:58:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 22:58:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f80b7aa0510>
2026-03-26 22:58:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 22:58:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 22:58:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 22:58:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63e367b0-917d-51cc-9c21-36a4976b89c1/63e367b0-917d-51cc-9c21-36a4976b89c1_image_8.jpg HTTP/1.1" 201 0
2026-03-26 22:58:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fbd6015f82c01430188203aa1036a5e21%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 22:58:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/bd6015f82c01430188203aa1036a5e21/images/large/9.jpg saved to cache
2026-03-26 22:58:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 63e367b0-917d-51cc-9c21-36a4976b89c1
2026-03-26 22:58:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 63e367b0-917d-51cc-9c21-36a4976b89c1, skipping ID generation
2026-03-26 22:58:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63e367b0-917d-51cc-9c21-36a4976b89c1 with scrape type 1
2026-03-26 22:58:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 63e367b0-917d-51cc-9c21-36a4976b89c1 sending to next pipeline
2026-03-26 22:58:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 63e367b0-917d-51cc-9c21-36a4976b89c1, identifier: 1985691
2026-03-26 22:58:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 63e367b0-917d-51cc-9c21-36a4976b89c1 with identifier: 1985691
2026-03-26 22:58:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 63e367b0-917d-51cc-9c21-36a4976b89c1 with identifier: 1985691
2026-03-26 22:58:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 63e367b0-917d-51cc-9c21-36a4976b89c1 with identifier: 1985691 to the API
2026-03-26 22:58:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:58:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:58:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ad/bd6015f82c01430188203aa1036a5e21/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-31T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '63e367b0-917d-51cc-9c21-36a4976b89c1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41071',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'T-ROC',
 'odometer': 91752,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63e367b0-917d-51cc-9c21-36a4976b89c1/63e367b0-917d-51cc-9c21-36a4976b89c1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 239865,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/bd6015f82c01430188203aa1036a5e21/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63e367b0-917d-51cc-9c21-36a4976b89c1/63e367b0-917d-51cc-9c21-36a4976b89c1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 253279,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/bd6015f82c01430188203aa1036a5e21/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63e367b0-917d-51cc-9c21-36a4976b89c1/63e367b0-917d-51cc-9c21-36a4976b89c1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 256284,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/bd6015f82c01430188203aa1036a5e21/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63e367b0-917d-51cc-9c21-36a4976b89c1/63e367b0-917d-51cc-9c21-36a4976b89c1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 240832,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/bd6015f82c01430188203aa1036a5e21/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63e367b0-917d-51cc-9c21-36a4976b89c1/63e367b0-917d-51cc-9c21-36a4976b89c1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 301691,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/bd6015f82c01430188203aa1036a5e21/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63e367b0-917d-51cc-9c21-36a4976b89c1/63e367b0-917d-51cc-9c21-36a4976b89c1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 265926,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/bd6015f82c01430188203aa1036a5e21/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63e367b0-917d-51cc-9c21-36a4976b89c1/63e367b0-917d-51cc-9c21-36a4976b89c1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 281493,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/bd6015f82c01430188203aa1036a5e21/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63e367b0-917d-51cc-9c21-36a4976b89c1/63e367b0-917d-51cc-9c21-36a4976b89c1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 338456,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/bd6015f82c01430188203aa1036a5e21/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63e367b0-917d-51cc-9c21-36a4976b89c1/63e367b0-917d-51cc-9c21-36a4976b89c1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 362062,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/bd6015f82c01430188203aa1036a5e21/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63e367b0-917d-51cc-9c21-36a4976b89c1/63e367b0-917d-51cc-9c21-36a4976b89c1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 286146,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/bd6015f82c01430188203aa1036a5e21/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN T-ROC 1.0 TSI STYLE',
 'transmission': 'manual',
 'trim': '1.0 TSI STYLE',
 'vin': None,
 'year': 2021}
2026-03-26 22:58:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271985691%27 HTTP/1.1" 200 None
2026-03-26 22:58:33 [ayvens.be] INFO: Saving data for 1985691: {'created_time': 1774565913.659102, 'last_price_update_time': 1774565913.659113, 'auction_closing_time': 1774958400.0}
2026-03-26 22:58:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1985691') HTTP/1.1" 204 0
2026-03-26 22:58:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-03-26 22:58:34 [ayvens.be] INFO: Found listing with ID: 1982332
2026-03-26 22:58:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982332%27 HTTP/1.1" 200 None
2026-03-26 22:58:34 [ayvens.be] INFO: Scrape type for 1982332: 2
2026-03-26 22:58:34 [ayvens.be] INFO: Extracting data for car ID: 1982332
2026-03-26 22:58:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5ab8f8c-f600-567b-bdfe-38251527bb98 with identifier: 1982332
2026-03-26 22:58:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5ab8f8c-f600-567b-bdfe-38251527bb98 with scrape type 2
2026-03-26 22:58:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f5ab8f8c-f600-567b-bdfe-38251527bb98 with scrape type 2
2026-03-26 22:58:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f5ab8f8c-f600-567b-bdfe-38251527bb98, identifier: 1982332
2026-03-26 22:58:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f5ab8f8c-f600-567b-bdfe-38251527bb98 with identifier: 1982332
2026-03-26 22:58:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f5ab8f8c-f600-567b-bdfe-38251527bb98 with identifier: 1982332
2026-03-26 22:58:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f5ab8f8c-f600-567b-bdfe-38251527bb98 with identifier: 1982332 to the API
2026-03-26 22:58:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:58:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:58:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.8L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'f5ab8f8c-f600-567b-bdfe-38251527bb98',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'LAND CRUISER LWB DIESEL - 2013',
 'odometer': 193258,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA LAND CRUISER LWB DIESEL - 2013 2.8 D-4D Active Van Aut',
 'transmission': 'automatic',
 'trim': '2.8 D-4D Active Van Aut',
 'vin': None,
 'year': 2017}
2026-03-26 22:58:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982332%27 HTTP/1.1" 200 None
2026-03-26 22:58:35 [ayvens.be] INFO: Saving data for 1982332: {'auction_closing_time': 1774942200.0, 'created_time': 1774478793.162967, 'last_price_update_time': 1774565915.096557}
2026-03-26 22:58:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982332') HTTP/1.1" 204 0
2026-03-26 22:58:35 [ayvens.be] INFO: Found listing with ID: 1982333
2026-03-26 22:58:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982333%27 HTTP/1.1" 200 None
2026-03-26 22:58:35 [ayvens.be] INFO: Scrape type for 1982333: 2
2026-03-26 22:58:35 [ayvens.be] INFO: Extracting data for car ID: 1982333
2026-03-26 22:58:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f27e9242-9738-549f-a594-37d64626cefe with identifier: 1982333
2026-03-26 22:58:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f27e9242-9738-549f-a594-37d64626cefe with scrape type 2
2026-03-26 22:58:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f27e9242-9738-549f-a594-37d64626cefe with scrape type 2
2026-03-26 22:58:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f27e9242-9738-549f-a594-37d64626cefe, identifier: 1982333
2026-03-26 22:58:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f27e9242-9738-549f-a594-37d64626cefe with identifier: 1982333
2026-03-26 22:58:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f27e9242-9738-549f-a594-37d64626cefe with identifier: 1982333
2026-03-26 22:58:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f27e9242-9738-549f-a594-37d64626cefe with identifier: 1982333 to the API
2026-03-26 22:58:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:58:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:58:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'f27e9242-9738-549f-a594-37d64626cefe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': 'EXPERT FOURGON MWB DSL - 2016',
 'odometer': 175816,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-11',
 'seats_number': 3,
 'seller_name': None,
 'title': 'PEUGEOT EXPERT FOURGON MWB DSL - 2016 1.6 BlueHDi L2 Standard '
          'Premium STOCK',
 'transmission': 'manual',
 'trim': '1.6 BlueHDi L2 Standard Premium STOCK',
 'vin': None,
 'year': 2018}
2026-03-26 22:58:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982333%27 HTTP/1.1" 200 None
2026-03-26 22:58:35 [ayvens.be] INFO: Saving data for 1982333: {'auction_closing_time': 1774942200.0, 'created_time': 1774478816.927094, 'last_price_update_time': 1774565915.56224}
2026-03-26 22:58:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982333') HTTP/1.1" 204 0
2026-03-26 22:58:35 [ayvens.be] INFO: Found listing with ID: 1982334
2026-03-26 22:58:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982334%27 HTTP/1.1" 200 None
2026-03-26 22:58:35 [ayvens.be] INFO: Scrape type for 1982334: 2
2026-03-26 22:58:35 [ayvens.be] INFO: Extracting data for car ID: 1982334
2026-03-26 22:58:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e44bb305-671e-5a96-aed0-8f3645b2ee04 with identifier: 1982334
2026-03-26 22:58:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e44bb305-671e-5a96-aed0-8f3645b2ee04 with scrape type 2
2026-03-26 22:58:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e44bb305-671e-5a96-aed0-8f3645b2ee04 with scrape type 2
2026-03-26 22:58:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e44bb305-671e-5a96-aed0-8f3645b2ee04, identifier: 1982334
2026-03-26 22:58:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e44bb305-671e-5a96-aed0-8f3645b2ee04 with identifier: 1982334
2026-03-26 22:58:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e44bb305-671e-5a96-aed0-8f3645b2ee04 with identifier: 1982334
2026-03-26 22:58:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e44bb305-671e-5a96-aed0-8f3645b2ee04 with identifier: 1982334 to the API
2026-03-26 22:58:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:58:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:58:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'e44bb305-671e-5a96-aed0-8f3645b2ee04',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A4 DIESEL - 2019',
 'odometer': 173396,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A4 DIESEL - 2019 35 TDi (EU6d-TEMP) STOCK',
 'transmission': 'manual',
 'trim': '35 TDi (EU6d-TEMP) STOCK',
 'vin': None,
 'year': 2019}
2026-03-26 22:58:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982334%27 HTTP/1.1" 200 None
2026-03-26 22:58:36 [ayvens.be] INFO: Saving data for 1982334: {'auction_closing_time': 1774942200.0, 'created_time': 1774478815.97775, 'last_price_update_time': 1774565916.001744}
2026-03-26 22:58:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982334') HTTP/1.1" 204 0
2026-03-26 22:58:36 [ayvens.be] INFO: Found listing with ID: 1982335
2026-03-26 22:58:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982335%27 HTTP/1.1" 200 None
2026-03-26 22:58:36 [ayvens.be] INFO: Scrape type for 1982335: 2
2026-03-26 22:58:36 [ayvens.be] INFO: Extracting data for car ID: 1982335
2026-03-26 22:58:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 245d263a-8a9d-5652-900c-eb6ef49b5c65 with identifier: 1982335
2026-03-26 22:58:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 245d263a-8a9d-5652-900c-eb6ef49b5c65 with scrape type 2
2026-03-26 22:58:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 245d263a-8a9d-5652-900c-eb6ef49b5c65 with scrape type 2
2026-03-26 22:58:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 245d263a-8a9d-5652-900c-eb6ef49b5c65, identifier: 1982335
2026-03-26 22:58:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 245d263a-8a9d-5652-900c-eb6ef49b5c65 with identifier: 1982335
2026-03-26 22:58:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 245d263a-8a9d-5652-900c-eb6ef49b5c65 with identifier: 1982335
2026-03-26 22:58:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 245d263a-8a9d-5652-900c-eb6ef49b5c65 with identifier: 1982335 to the API
2026-03-26 22:58:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:58:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:58:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '245d263a-8a9d-5652-900c-eb6ef49b5c65',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '208 DIESEL - 2019',
 'odometer': 160268,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 208 DIESEL - 2019 1.5 BlueHDi Active',
 'transmission': 'manual',
 'trim': '1.5 BlueHDi Active',
 'vin': None,
 'year': 2020}
2026-03-26 22:58:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982335%27 HTTP/1.1" 200 None
2026-03-26 22:58:36 [ayvens.be] INFO: Saving data for 1982335: {'auction_closing_time': 1774942200.0, 'created_time': 1774478798.085271, 'last_price_update_time': 1774565916.415162}
2026-03-26 22:58:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982335') HTTP/1.1" 204 0
2026-03-26 22:58:36 [ayvens.be] INFO: Found listing with ID: 1982336
2026-03-26 22:58:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982336%27 HTTP/1.1" 200 None
2026-03-26 22:58:36 [ayvens.be] INFO: Scrape type for 1982336: 2
2026-03-26 22:58:36 [ayvens.be] INFO: Extracting data for car ID: 1982336
2026-03-26 22:58:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff12b6a1-744a-5afb-8455-8dbc4dd88f69 with identifier: 1982336
2026-03-26 22:58:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff12b6a1-744a-5afb-8455-8dbc4dd88f69 with scrape type 2
2026-03-26 22:58:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ff12b6a1-744a-5afb-8455-8dbc4dd88f69 with scrape type 2
2026-03-26 22:58:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: ff12b6a1-744a-5afb-8455-8dbc4dd88f69, identifier: 1982336
2026-03-26 22:58:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: ff12b6a1-744a-5afb-8455-8dbc4dd88f69 with identifier: 1982336
2026-03-26 22:58:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: ff12b6a1-744a-5afb-8455-8dbc4dd88f69 with identifier: 1982336
2026-03-26 22:58:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: ff12b6a1-744a-5afb-8455-8dbc4dd88f69 with identifier: 1982336 to the API
2026-03-26 22:58:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:58:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:58:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'ff12b6a1-744a-5afb-8455-8dbc4dd88f69',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 218065,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 1.2 PURETECH 96KW S&S ALLURE',
 'transmission': 'manual',
 'trim': '1.2 PURETECH 96KW S&S ALLURE',
 'vin': None,
 'year': 2022}
2026-03-26 22:58:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982336%27 HTTP/1.1" 200 None
2026-03-26 22:58:36 [ayvens.be] INFO: Saving data for 1982336: {'auction_closing_time': 1774942200.0, 'created_time': 1774478814.266784, 'last_price_update_time': 1774565916.82618}
2026-03-26 22:58:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982336') HTTP/1.1" 204 0
2026-03-26 22:58:36 [ayvens.be] INFO: Found listing with ID: 1982337
2026-03-26 22:58:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982337%27 HTTP/1.1" 200 None
2026-03-26 22:58:36 [ayvens.be] INFO: Scrape type for 1982337: 2
2026-03-26 22:58:36 [ayvens.be] INFO: Extracting data for car ID: 1982337
2026-03-26 22:58:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b1e5cde9-97c2-5535-b035-cdb008ccc8cf with identifier: 1982337
2026-03-26 22:58:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1e5cde9-97c2-5535-b035-cdb008ccc8cf with scrape type 2
2026-03-26 22:58:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b1e5cde9-97c2-5535-b035-cdb008ccc8cf with scrape type 2
2026-03-26 22:58:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b1e5cde9-97c2-5535-b035-cdb008ccc8cf, identifier: 1982337
2026-03-26 22:58:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b1e5cde9-97c2-5535-b035-cdb008ccc8cf with identifier: 1982337
2026-03-26 22:58:37 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 22:58:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 22:58:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b1e5cde9-97c2-5535-b035-cdb008ccc8cf with identifier: 1982337
2026-03-26 22:58:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b1e5cde9-97c2-5535-b035-cdb008ccc8cf with identifier: 1982337 to the API
2026-03-26 22:58:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:58:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:58:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'color': 'NOIR OBSIDIENNE METALLISE',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'b1e5cde9-97c2-5535-b035-cdb008ccc8cf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLC',
 'odometer': 138110,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLC 2.0 GLC 200 D BUS SOL AUTO',
 'transmission': 'automatic',
 'trim': '2.0 GLC 200 D BUS SOL AUTO',
 'vin': None,
 'year': 2021}
2026-03-26 22:58:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982337%27 HTTP/1.1" 200 None
2026-03-26 22:58:37 [ayvens.be] INFO: Saving data for 1982337: {'auction_closing_time': 1774942200.0, 'created_time': 1774478800.549661, 'last_price_update_time': 1774565917.293097}
2026-03-26 22:58:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982337') HTTP/1.1" 204 0
2026-03-26 22:58:37 [ayvens.be] INFO: Found listing with ID: 1982338
2026-03-26 22:58:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982338%27 HTTP/1.1" 200 None
2026-03-26 22:58:37 [ayvens.be] INFO: Scrape type for 1982338: 2
2026-03-26 22:58:37 [ayvens.be] INFO: Extracting data for car ID: 1982338
2026-03-26 22:58:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c17b7144-1840-536d-9e87-64ba56072f21 with identifier: 1982338
2026-03-26 22:58:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c17b7144-1840-536d-9e87-64ba56072f21 with scrape type 2
2026-03-26 22:58:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c17b7144-1840-536d-9e87-64ba56072f21 with scrape type 2
2026-03-26 22:58:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c17b7144-1840-536d-9e87-64ba56072f21, identifier: 1982338
2026-03-26 22:58:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c17b7144-1840-536d-9e87-64ba56072f21 with identifier: 1982338
2026-03-26 22:58:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c17b7144-1840-536d-9e87-64ba56072f21 with identifier: 1982338
2026-03-26 22:58:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c17b7144-1840-536d-9e87-64ba56072f21 with identifier: 1982338 to the API
2026-03-26 22:58:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:58:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:58:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'color': 'NACRE WIT PARELKLEUR',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'c17b7144-1840-536d-9e87-64ba56072f21',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '5008',
 'odometer': 134405,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-14',
 'seats_number': 7,
 'seller_name': None,
 'title': 'PEUGEOT 5008 1.2 PURETECH 130 AUTO CROSSWAY',
 'transmission': 'automatic',
 'trim': '1.2 PURETECH 130 AUTO CROSSWAY',
 'vin': None,
 'year': 2020}
2026-03-26 22:58:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982338%27 HTTP/1.1" 200 None
2026-03-26 22:58:37 [ayvens.be] INFO: Saving data for 1982338: {'auction_closing_time': 1774942200.0, 'created_time': 1774478811.68787, 'last_price_update_time': 1774565917.684527}
2026-03-26 22:58:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982338') HTTP/1.1" 204 0
2026-03-26 22:58:37 [ayvens.be] INFO: Found listing with ID: 1982339
2026-03-26 22:58:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982339%27 HTTP/1.1" 200 None
2026-03-26 22:58:37 [ayvens.be] INFO: Scrape type for 1982339: 2
2026-03-26 22:58:37 [ayvens.be] INFO: Extracting data for car ID: 1982339
2026-03-26 22:58:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03d96b29-1dca-51e2-a634-54c278f07d69 with identifier: 1982339
2026-03-26 22:58:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03d96b29-1dca-51e2-a634-54c278f07d69 with scrape type 2
2026-03-26 22:58:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 03d96b29-1dca-51e2-a634-54c278f07d69 with scrape type 2
2026-03-26 22:58:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 03d96b29-1dca-51e2-a634-54c278f07d69, identifier: 1982339
2026-03-26 22:58:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 03d96b29-1dca-51e2-a634-54c278f07d69 with identifier: 1982339
2026-03-26 22:58:37 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 22:58:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 22:58:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 03d96b29-1dca-51e2-a634-54c278f07d69 with identifier: 1982339
2026-03-26 22:58:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 03d96b29-1dca-51e2-a634-54c278f07d69 with identifier: 1982339 to the API
2026-03-26 22:58:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:58:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:58:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 98,
 'color': 'MAGNETIC',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '03d96b29-1dca-51e2-a634-54c278f07d69',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'FOCUS CLIPPER DIESEL - 2018',
 'odometer': 147787,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD FOCUS CLIPPER DIESEL - 2018 1.5 EcoBlue Trend Edition Bus. '
          '(EU6.2) STOCK',
 'transmission': 'manual',
 'trim': '1.5 EcoBlue Trend Edition Bus. (EU6.2) STOCK',
 'vin': None,
 'year': 2020}
2026-03-26 22:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982339%27 HTTP/1.1" 200 None
2026-03-26 22:58:38 [ayvens.be] INFO: Saving data for 1982339: {'auction_closing_time': 1774942200.0, 'created_time': 1774478812.065567, 'last_price_update_time': 1774565918.086701}
2026-03-26 22:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982339') HTTP/1.1" 204 0
2026-03-26 22:58:38 [ayvens.be] INFO: Found listing with ID: 1982340
2026-03-26 22:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982340%27 HTTP/1.1" 200 None
2026-03-26 22:58:38 [ayvens.be] INFO: Scrape type for 1982340: 2
2026-03-26 22:58:38 [ayvens.be] INFO: Extracting data for car ID: 1982340
2026-03-26 22:58:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 50d8f030-3e13-5662-8c7d-a6278d5b4211 with identifier: 1982340
2026-03-26 22:58:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 50d8f030-3e13-5662-8c7d-a6278d5b4211 with scrape type 2
2026-03-26 22:58:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 50d8f030-3e13-5662-8c7d-a6278d5b4211 with scrape type 2
2026-03-26 22:58:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 50d8f030-3e13-5662-8c7d-a6278d5b4211, identifier: 1982340
2026-03-26 22:58:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 50d8f030-3e13-5662-8c7d-a6278d5b4211 with identifier: 1982340
2026-03-26 22:58:38 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 22:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 22:58:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 50d8f030-3e13-5662-8c7d-a6278d5b4211 with identifier: 1982340
2026-03-26 22:58:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 50d8f030-3e13-5662-8c7d-a6278d5b4211 with identifier: 1982340 to the API
2026-03-26 22:58:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:58:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:58:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'color': 'CRYSTAL WHITE',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '50d8f030-3e13-5662-8c7d-a6278d5b4211',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 134118,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-10',
 'seats_number': 2,
 'seller_name': None,
 'title': 'VOLVO XC40 2.0 D3 GEARTRONIC R-DESIGN TRANSFO VAN',
 'transmission': 'automatic',
 'trim': '2.0 D3 GEARTRONIC R-DESIGN TRANSFO VAN',
 'vin': None,
 'year': 2021}
2026-03-26 22:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982340%27 HTTP/1.1" 200 None
2026-03-26 22:58:38 [ayvens.be] INFO: Saving data for 1982340: {'auction_closing_time': 1774942200.0, 'created_time': 1774478804.888618, 'last_price_update_time': 1774565918.477805}
2026-03-26 22:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982340') HTTP/1.1" 204 0
2026-03-26 22:58:38 [ayvens.be] INFO: Found listing with ID: 1982341
2026-03-26 22:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982341%27 HTTP/1.1" 200 None
2026-03-26 22:58:38 [ayvens.be] INFO: Scrape type for 1982341: 2
2026-03-26 22:58:38 [ayvens.be] INFO: Extracting data for car ID: 1982341
2026-03-26 22:58:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 913f2d2d-b7d2-5f52-9d16-ac234d31b81a with identifier: 1982341
2026-03-26 22:58:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 913f2d2d-b7d2-5f52-9d16-ac234d31b81a with scrape type 2
2026-03-26 22:58:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 913f2d2d-b7d2-5f52-9d16-ac234d31b81a with scrape type 2
2026-03-26 22:58:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 913f2d2d-b7d2-5f52-9d16-ac234d31b81a, identifier: 1982341
2026-03-26 22:58:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 913f2d2d-b7d2-5f52-9d16-ac234d31b81a with identifier: 1982341
2026-03-26 22:58:38 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 22:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 22:58:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 913f2d2d-b7d2-5f52-9d16-ac234d31b81a with identifier: 1982341
2026-03-26 22:58:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 913f2d2d-b7d2-5f52-9d16-ac234d31b81a with identifier: 1982341 to the API
2026-03-26 22:58:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:58:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:58:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'color': 'CANDY WHITE',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '913f2d2d-b7d2-5f52-9d16-ac234d31b81a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'CADDY MAXI DIESEL - 2015',
 'odometer': 152698,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-03',
 'seats_number': 2,
 'seller_name': None,
 'title': 'VOLKSWAGEN CADDY MAXI DIESEL - 2015 2.0 TDi SCR Conceptline (EU6.2) '
          'Transfo Van',
 'transmission': 'manual',
 'trim': '2.0 TDi SCR Conceptline (EU6.2) Transfo Van',
 'vin': None,
 'year': 2020}
2026-03-26 22:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982341%27 HTTP/1.1" 200 None
2026-03-26 22:58:38 [ayvens.be] INFO: Saving data for 1982341: {'auction_closing_time': 1774942200.0, 'created_time': 1774478810.138818, 'last_price_update_time': 1774565918.918157}
2026-03-26 22:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982341') HTTP/1.1" 204 0
2026-03-26 22:58:38 [ayvens.be] INFO: Found listing with ID: 1982342
2026-03-26 22:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982342%27 HTTP/1.1" 200 None
2026-03-26 22:58:38 [ayvens.be] INFO: Scrape type for 1982342: 2
2026-03-26 22:58:38 [ayvens.be] INFO: Extracting data for car ID: 1982342
2026-03-26 22:58:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c73498a3-7301-5ec3-a68d-6842f08000dd with identifier: 1982342
2026-03-26 22:58:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c73498a3-7301-5ec3-a68d-6842f08000dd with scrape type 2
2026-03-26 22:58:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c73498a3-7301-5ec3-a68d-6842f08000dd with scrape type 2
2026-03-26 22:58:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c73498a3-7301-5ec3-a68d-6842f08000dd, identifier: 1982342
2026-03-26 22:58:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c73498a3-7301-5ec3-a68d-6842f08000dd with identifier: 1982342
2026-03-26 22:58:39 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 22:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 22:58:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c73498a3-7301-5ec3-a68d-6842f08000dd with identifier: 1982342
2026-03-26 22:58:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c73498a3-7301-5ec3-a68d-6842f08000dd with identifier: 1982342 to the API
2026-03-26 22:58:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:58:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:58:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'color': 'METAALKLEUR',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'c73498a3-7301-5ec3-a68d-6842f08000dd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC60 DIESEL - 2017',
 'odometer': 140551,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC60 DIESEL - 2017 2.0 D3 Inscription AdBlue',
 'transmission': 'manual',
 'trim': '2.0 D3 Inscription AdBlue',
 'vin': None,
 'year': 2020}
2026-03-26 22:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982342%27 HTTP/1.1" 200 None
2026-03-26 22:58:39 [ayvens.be] INFO: Saving data for 1982342: {'auction_closing_time': 1774942200.0, 'created_time': 1774478809.778097, 'last_price_update_time': 1774565919.312591}
2026-03-26 22:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982342') HTTP/1.1" 204 0
2026-03-26 22:58:39 [ayvens.be] INFO: Found listing with ID: 1982343
2026-03-26 22:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982343%27 HTTP/1.1" 200 None
2026-03-26 22:58:39 [ayvens.be] INFO: Scrape type for 1982343: 2
2026-03-26 22:58:39 [ayvens.be] INFO: Extracting data for car ID: 1982343
2026-03-26 22:58:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fefe2540-1ee0-52bc-9a99-baead36263f7 with identifier: 1982343
2026-03-26 22:58:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fefe2540-1ee0-52bc-9a99-baead36263f7 with scrape type 2
2026-03-26 22:58:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fefe2540-1ee0-52bc-9a99-baead36263f7 with scrape type 2
2026-03-26 22:58:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: fefe2540-1ee0-52bc-9a99-baead36263f7, identifier: 1982343
2026-03-26 22:58:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: fefe2540-1ee0-52bc-9a99-baead36263f7 with identifier: 1982343
2026-03-26 22:58:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: fefe2540-1ee0-52bc-9a99-baead36263f7 with identifier: 1982343
2026-03-26 22:58:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: fefe2540-1ee0-52bc-9a99-baead36263f7 with identifier: 1982343 to the API
2026-03-26 22:58:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:58:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:58:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'fefe2540-1ee0-52bc-9a99-baead36263f7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '3 TOURING DIESEL - 2019',
 'odometer': 155118,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3 TOURING DIESEL - 2019 320 dXA MHD AdBlue',
 'transmission': 'automatic',
 'trim': '320 dXA MHD AdBlue',
 'vin': None,
 'year': 2021}
2026-03-26 22:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982343%27 HTTP/1.1" 200 None
2026-03-26 22:58:39 [ayvens.be] INFO: Saving data for 1982343: {'auction_closing_time': 1774942200.0, 'created_time': 1774478809.390058, 'last_price_update_time': 1774565919.738115}
2026-03-26 22:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982343') HTTP/1.1" 204 0
2026-03-26 22:58:39 [ayvens.be] INFO: Found listing with ID: 1982344
2026-03-26 22:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982344%27 HTTP/1.1" 200 None
2026-03-26 22:58:39 [ayvens.be] INFO: Scrape type for 1982344: 2
2026-03-26 22:58:39 [ayvens.be] INFO: Extracting data for car ID: 1982344
2026-03-26 22:58:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b0bf027-1869-5cba-9be5-bc6c487317b9 with identifier: 1982344
2026-03-26 22:58:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b0bf027-1869-5cba-9be5-bc6c487317b9 with scrape type 2
2026-03-26 22:58:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3b0bf027-1869-5cba-9be5-bc6c487317b9 with scrape type 2
2026-03-26 22:58:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 3b0bf027-1869-5cba-9be5-bc6c487317b9, identifier: 1982344
2026-03-26 22:58:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 3b0bf027-1869-5cba-9be5-bc6c487317b9 with identifier: 1982344
2026-03-26 22:58:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 3b0bf027-1869-5cba-9be5-bc6c487317b9 with identifier: 1982344
2026-03-26 22:58:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 3b0bf027-1869-5cba-9be5-bc6c487317b9 with identifier: 1982344 to the API
2026-03-26 22:58:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:58:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:58:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '3b0bf027-1869-5cba-9be5-bc6c487317b9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TOURAN',
 'odometer': 142790,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN TOURAN 2.0 TDI 110KW HIGHLINE DSG',
 'transmission': 'automatic',
 'trim': '2.0 TDI 110KW HIGHLINE DSG',
 'vin': None,
 'year': 2021}
2026-03-26 22:58:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982344%27 HTTP/1.1" 200 None
2026-03-26 22:58:40 [ayvens.be] INFO: Saving data for 1982344: {'auction_closing_time': 1774942200.0, 'created_time': 1774478810.497817, 'last_price_update_time': 1774565920.132193}
2026-03-26 22:58:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982344') HTTP/1.1" 204 0
2026-03-26 22:58:40 [ayvens.be] INFO: Found listing with ID: 1982345
2026-03-26 22:58:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982345%27 HTTP/1.1" 200 None
2026-03-26 22:58:40 [ayvens.be] INFO: Scrape type for 1982345: 2
2026-03-26 22:58:40 [ayvens.be] INFO: Extracting data for car ID: 1982345
2026-03-26 22:58:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6acaa694-d3c3-5f58-b05a-1ff123a94e0f with identifier: 1982345
2026-03-26 22:58:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6acaa694-d3c3-5f58-b05a-1ff123a94e0f with scrape type 2
2026-03-26 22:58:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6acaa694-d3c3-5f58-b05a-1ff123a94e0f with scrape type 2
2026-03-26 22:58:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 6acaa694-d3c3-5f58-b05a-1ff123a94e0f, identifier: 1982345
2026-03-26 22:58:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 6acaa694-d3c3-5f58-b05a-1ff123a94e0f with identifier: 1982345
2026-03-26 22:58:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 6acaa694-d3c3-5f58-b05a-1ff123a94e0f with identifier: 1982345
2026-03-26 22:58:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 6acaa694-d3c3-5f58-b05a-1ff123a94e0f with identifier: 1982345 to the API
2026-03-26 22:58:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:58:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:58:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '6acaa694-d3c3-5f58-b05a-1ff123a94e0f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'KAROQ',
 'odometer': 199961,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA KAROQ 1.5 TSI ACT Ambition (EU6.2)',
 'transmission': 'manual',
 'trim': '1.5 TSI ACT Ambition (EU6.2)',
 'vin': None,
 'year': 2019}
2026-03-26 22:58:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982345%27 HTTP/1.1" 200 None
2026-03-26 22:58:40 [ayvens.be] INFO: Saving data for 1982345: {'auction_closing_time': 1774942200.0, 'created_time': 1774478813.913185, 'last_price_update_time': 1774565920.50525}
2026-03-26 22:58:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982345') HTTP/1.1" 204 0
2026-03-26 22:58:40 [ayvens.be] INFO: Found listing with ID: 1982346
2026-03-26 22:58:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982346%27 HTTP/1.1" 200 None
2026-03-26 22:58:40 [ayvens.be] INFO: Scrape type for 1982346: 2
2026-03-26 22:58:40 [ayvens.be] INFO: Extracting data for car ID: 1982346
2026-03-26 22:58:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6169cd80-e650-504d-b377-0bb023cf43c7 with identifier: 1982346
2026-03-26 22:58:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6169cd80-e650-504d-b377-0bb023cf43c7 with scrape type 2
2026-03-26 22:58:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6169cd80-e650-504d-b377-0bb023cf43c7 with scrape type 2
2026-03-26 22:58:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 6169cd80-e650-504d-b377-0bb023cf43c7, identifier: 1982346
2026-03-26 22:58:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 6169cd80-e650-504d-b377-0bb023cf43c7 with identifier: 1982346
2026-03-26 22:58:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 6169cd80-e650-504d-b377-0bb023cf43c7 with identifier: 1982346
2026-03-26 22:58:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 6169cd80-e650-504d-b377-0bb023cf43c7 with identifier: 1982346 to the API
2026-03-26 22:58:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:58:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:58:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '6169cd80-e650-504d-b377-0bb023cf43c7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A5 SPORTBACK',
 'odometer': 161249,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-09',
 'seats_number': 4,
 'seller_name': None,
 'title': 'AUDI A5 SPORTBACK 2.0 35 TDI S TRONIC BUS. ED.',
 'transmission': 'automatic',
 'trim': '2.0 35 TDI S TRONIC BUS. ED.',
 'vin': None,
 'year': 2020}
2026-03-26 22:58:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982346%27 HTTP/1.1" 200 None
2026-03-26 22:58:40 [ayvens.be] INFO: Saving data for 1982346: {'auction_closing_time': 1774942200.0, 'created_time': 1774478817.638513, 'last_price_update_time': 1774565920.914732}
2026-03-26 22:58:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982346') HTTP/1.1" 204 0
2026-03-26 22:58:40 [ayvens.be] INFO: Found listing with ID: 1982347
2026-03-26 22:58:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982347%27 HTTP/1.1" 200 None
2026-03-26 22:58:40 [ayvens.be] INFO: Scrape type for 1982347: 2
2026-03-26 22:58:40 [ayvens.be] INFO: Extracting data for car ID: 1982347
2026-03-26 22:58:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 64300d52-37b6-58ad-926a-f5f378e1bb2b with identifier: 1982347
2026-03-26 22:58:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64300d52-37b6-58ad-926a-f5f378e1bb2b with scrape type 2
2026-03-26 22:58:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 64300d52-37b6-58ad-926a-f5f378e1bb2b with scrape type 2
2026-03-26 22:58:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 64300d52-37b6-58ad-926a-f5f378e1bb2b, identifier: 1982347
2026-03-26 22:58:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 64300d52-37b6-58ad-926a-f5f378e1bb2b with identifier: 1982347
2026-03-26 22:58:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 64300d52-37b6-58ad-926a-f5f378e1bb2b with identifier: 1982347
2026-03-26 22:58:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 64300d52-37b6-58ad-926a-f5f378e1bb2b with identifier: 1982347 to the API
2026-03-26 22:58:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:58:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:58:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '64300d52-37b6-58ad-926a-f5f378e1bb2b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLASS GLA DIESEL (H247)',
 'odometer': 207172,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLASS GLA DIESEL (H247) GLA 180 d Business Solution',
 'transmission': 'automatic',
 'trim': 'GLA 180 d Business Solution',
 'vin': None,
 'year': 2020}
2026-03-26 22:58:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982347%27 HTTP/1.1" 200 None
2026-03-26 22:58:41 [ayvens.be] INFO: Saving data for 1982347: {'auction_closing_time': 1774942200.0, 'created_time': 1774478829.577431, 'last_price_update_time': 1774565921.276475}
2026-03-26 22:58:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982347') HTTP/1.1" 204 0
2026-03-26 22:58:41 [ayvens.be] INFO: Found listing with ID: 1982348
2026-03-26 22:58:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982348%27 HTTP/1.1" 200 None
2026-03-26 22:58:41 [ayvens.be] INFO: Scrape type for 1982348: 2
2026-03-26 22:58:41 [ayvens.be] INFO: Extracting data for car ID: 1982348
2026-03-26 22:58:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ccc18215-eeba-51d7-9900-4cec45a42db8 with identifier: 1982348
2026-03-26 22:58:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ccc18215-eeba-51d7-9900-4cec45a42db8 with scrape type 2
2026-03-26 22:58:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ccc18215-eeba-51d7-9900-4cec45a42db8 with scrape type 2
2026-03-26 22:58:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: ccc18215-eeba-51d7-9900-4cec45a42db8, identifier: 1982348
2026-03-26 22:58:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: ccc18215-eeba-51d7-9900-4cec45a42db8 with identifier: 1982348
2026-03-26 22:58:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: ccc18215-eeba-51d7-9900-4cec45a42db8 with identifier: 1982348
2026-03-26 22:58:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: ccc18215-eeba-51d7-9900-4cec45a42db8 with identifier: 1982348 to the API
2026-03-26 22:58:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:58:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:58:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'ccc18215-eeba-51d7-9900-4cec45a42db8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q2',
 'odometer': 167539,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q2 2.0 30 TDI S TRONIC ADVANCED BUSINESS ED',
 'transmission': 'automatic',
 'trim': '2.0 30 TDI S TRONIC ADVANCED BUSINESS ED',
 'vin': None,
 'year': 2021}
2026-03-26 22:58:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982348%27 HTTP/1.1" 200 None
2026-03-26 22:58:41 [ayvens.be] INFO: Saving data for 1982348: {'auction_closing_time': 1774942200.0, 'created_time': 1774478820.748151, 'last_price_update_time': 1774565921.723778}
2026-03-26 22:58:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982348') HTTP/1.1" 204 0
2026-03-26 22:58:41 [ayvens.be] INFO: Found listing with ID: 1982349
2026-03-26 22:58:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982349%27 HTTP/1.1" 200 None
2026-03-26 22:58:41 [ayvens.be] INFO: Scrape type for 1982349: 2
2026-03-26 22:58:41 [ayvens.be] INFO: Extracting data for car ID: 1982349
2026-03-26 22:58:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6cb974a7-8bc0-5c94-8ee6-4a477d1d77af with identifier: 1982349
2026-03-26 22:58:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6cb974a7-8bc0-5c94-8ee6-4a477d1d77af with scrape type 2
2026-03-26 22:58:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6cb974a7-8bc0-5c94-8ee6-4a477d1d77af with scrape type 2
2026-03-26 22:58:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 6cb974a7-8bc0-5c94-8ee6-4a477d1d77af, identifier: 1982349
2026-03-26 22:58:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 6cb974a7-8bc0-5c94-8ee6-4a477d1d77af with identifier: 1982349
2026-03-26 22:58:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 6cb974a7-8bc0-5c94-8ee6-4a477d1d77af with identifier: 1982349
2026-03-26 22:58:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 6cb974a7-8bc0-5c94-8ee6-4a477d1d77af with identifier: 1982349 to the API
2026-03-26 22:58:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:58:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:58:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '6cb974a7-8bc0-5c94-8ee6-4a477d1d77af',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'Vivaro',
 'odometer': 167206,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-26',
 'seats_number': 3,
 'seller_name': None,
 'title': 'OPEL Vivaro 2.0 TURBO 106KW INNOVATION L3H1 AUTO',
 'transmission': 'automatic',
 'trim': '2.0 TURBO 106KW INNOVATION L3H1 AUTO',
 'vin': None,
 'year': 2022}
2026-03-26 22:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982349%27 HTTP/1.1" 200 None
2026-03-26 22:58:42 [ayvens.be] INFO: Saving data for 1982349: {'auction_closing_time': 1774942200.0, 'created_time': 1774478822.241517, 'last_price_update_time': 1774565922.093132}
2026-03-26 22:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982349') HTTP/1.1" 204 0
2026-03-26 22:58:42 [ayvens.be] INFO: Found listing with ID: 1982350
2026-03-26 22:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982350%27 HTTP/1.1" 200 None
2026-03-26 22:58:42 [ayvens.be] INFO: Scrape type for 1982350: 2
2026-03-26 22:58:42 [ayvens.be] INFO: Extracting data for car ID: 1982350
2026-03-26 22:58:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e35ee64d-0ec6-584a-a656-f24bce655830 with identifier: 1982350
2026-03-26 22:58:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e35ee64d-0ec6-584a-a656-f24bce655830 with scrape type 2
2026-03-26 22:58:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e35ee64d-0ec6-584a-a656-f24bce655830 with scrape type 2
2026-03-26 22:58:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e35ee64d-0ec6-584a-a656-f24bce655830, identifier: 1982350
2026-03-26 22:58:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e35ee64d-0ec6-584a-a656-f24bce655830 with identifier: 1982350
2026-03-26 22:58:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e35ee64d-0ec6-584a-a656-f24bce655830 with identifier: 1982350
2026-03-26 22:58:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e35ee64d-0ec6-584a-a656-f24bce655830 with identifier: 1982350 to the API
2026-03-26 22:58:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:58:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:58:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'e35ee64d-0ec6-584a-a656-f24bce655830',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'KAROQ',
 'odometer': 197795,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA KAROQ 2.0 CRTDI 85KW DSG7 CLEVER+',
 'transmission': 'automatic',
 'trim': '2.0 CRTDI 85KW DSG7 CLEVER+',
 'vin': None,
 'year': 2021}
2026-03-26 22:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982350%27 HTTP/1.1" 200 None
2026-03-26 22:58:42 [ayvens.be] INFO: Saving data for 1982350: {'auction_closing_time': 1774942200.0, 'created_time': 1774478826.626647, 'last_price_update_time': 1774565922.460128}
2026-03-26 22:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982350') HTTP/1.1" 204 0
2026-03-26 22:58:42 [ayvens.be] INFO: Found listing with ID: 1982351
2026-03-26 22:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982351%27 HTTP/1.1" 200 None
2026-03-26 22:58:42 [ayvens.be] INFO: Scrape type for 1982351: 2
2026-03-26 22:58:42 [ayvens.be] INFO: Extracting data for car ID: 1982351
2026-03-26 22:58:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a39e4b4-9ce8-5cb4-9929-e88c92c19cfd with identifier: 1982351
2026-03-26 22:58:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a39e4b4-9ce8-5cb4-9929-e88c92c19cfd with scrape type 2
2026-03-26 22:58:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1a39e4b4-9ce8-5cb4-9929-e88c92c19cfd with scrape type 2
2026-03-26 22:58:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 1a39e4b4-9ce8-5cb4-9929-e88c92c19cfd, identifier: 1982351
2026-03-26 22:58:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 1a39e4b4-9ce8-5cb4-9929-e88c92c19cfd with identifier: 1982351
2026-03-26 22:58:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 1a39e4b4-9ce8-5cb4-9929-e88c92c19cfd with identifier: 1982351
2026-03-26 22:58:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 1a39e4b4-9ce8-5cb4-9929-e88c92c19cfd with identifier: 1982351 to the API
2026-03-26 22:58:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:58:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:58:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '1a39e4b4-9ce8-5cb4-9929-e88c92c19cfd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X3',
 'odometer': 183975,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X3 2.0 SDRIVE18D (100KW) AUTO',
 'transmission': 'automatic',
 'trim': '2.0 SDRIVE18D (100KW) AUTO',
 'vin': None,
 'year': 2021}
2026-03-26 22:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982351%27 HTTP/1.1" 200 None
2026-03-26 22:58:42 [ayvens.be] INFO: Saving data for 1982351: {'auction_closing_time': 1774942200.0, 'created_time': 1774478825.69092, 'last_price_update_time': 1774565922.825332}
2026-03-26 22:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982351') HTTP/1.1" 204 0
2026-03-26 22:58:42 [ayvens.be] INFO: Found listing with ID: 1982352
2026-03-26 22:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982352%27 HTTP/1.1" 200 None
2026-03-26 22:58:42 [ayvens.be] INFO: Scrape type for 1982352: 2
2026-03-26 22:58:42 [ayvens.be] INFO: Extracting data for car ID: 1982352
2026-03-26 22:58:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a245134c-4e87-5115-a573-4691a07681a0 with identifier: 1982352
2026-03-26 22:58:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a245134c-4e87-5115-a573-4691a07681a0 with scrape type 2
2026-03-26 22:58:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a245134c-4e87-5115-a573-4691a07681a0 with scrape type 2
2026-03-26 22:58:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a245134c-4e87-5115-a573-4691a07681a0, identifier: 1982352
2026-03-26 22:58:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a245134c-4e87-5115-a573-4691a07681a0 with identifier: 1982352
2026-03-26 22:58:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a245134c-4e87-5115-a573-4691a07681a0 with identifier: 1982352
2026-03-26 22:58:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a245134c-4e87-5115-a573-4691a07681a0 with identifier: 1982352 to the API
2026-03-26 22:58:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:58:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:58:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'a245134c-4e87-5115-a573-4691a07681a0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A5 SPORTBACK DIESEL - 2020',
 'odometer': 204053,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-04',
 'seats_number': 4,
 'seller_name': None,
 'title': 'AUDI A5 SPORTBACK DIESEL - 2020 30 TDi Business Edition S tronic',
 'transmission': 'automatic',
 'trim': '30 TDi Business Edition S tronic',
 'vin': None,
 'year': 2020}
2026-03-26 22:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982352%27 HTTP/1.1" 200 None
2026-03-26 22:58:43 [ayvens.be] INFO: Saving data for 1982352: {'auction_closing_time': 1774942200.0, 'created_time': 1774478827.960688, 'last_price_update_time': 1774565923.189094}
2026-03-26 22:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982352') HTTP/1.1" 204 0
2026-03-26 22:58:43 [ayvens.be] INFO: Found listing with ID: 1982353
2026-03-26 22:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982353%27 HTTP/1.1" 200 None
2026-03-26 22:58:43 [ayvens.be] INFO: Scrape type for 1982353: 2
2026-03-26 22:58:43 [ayvens.be] INFO: Extracting data for car ID: 1982353
2026-03-26 22:58:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da9a13e0-8bd8-5101-8235-801ece0e6766 with identifier: 1982353
2026-03-26 22:58:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da9a13e0-8bd8-5101-8235-801ece0e6766 with scrape type 2
2026-03-26 22:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item da9a13e0-8bd8-5101-8235-801ece0e6766 with scrape type 2
2026-03-26 22:58:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: da9a13e0-8bd8-5101-8235-801ece0e6766, identifier: 1982353
2026-03-26 22:58:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: da9a13e0-8bd8-5101-8235-801ece0e6766 with identifier: 1982353
2026-03-26 22:58:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: da9a13e0-8bd8-5101-8235-801ece0e6766 with identifier: 1982353
2026-03-26 22:58:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: da9a13e0-8bd8-5101-8235-801ece0e6766 with identifier: 1982353 to the API
2026-03-26 22:58:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:58:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:58:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'da9a13e0-8bd8-5101-8235-801ece0e6766',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 75775,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 1.5 SDRIVE18IA (100KW)',
 'transmission': 'automatic',
 'trim': '1.5 SDRIVE18IA (100KW)',
 'vin': None,
 'year': 2022}
2026-03-26 22:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982353%27 HTTP/1.1" 200 None
2026-03-26 22:58:43 [ayvens.be] INFO: Saving data for 1982353: {'auction_closing_time': 1774942200.0, 'created_time': 1774478828.685969, 'last_price_update_time': 1774565923.609914}
2026-03-26 22:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982353') HTTP/1.1" 204 0
2026-03-26 22:58:43 [ayvens.be] INFO: Found listing with ID: 1982354
2026-03-26 22:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982354%27 HTTP/1.1" 200 None
2026-03-26 22:58:43 [ayvens.be] INFO: Scrape type for 1982354: 2
2026-03-26 22:58:43 [ayvens.be] INFO: Extracting data for car ID: 1982354
2026-03-26 22:58:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0314240d-b381-5798-98ae-4d0788a8f32a with identifier: 1982354
2026-03-26 22:58:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0314240d-b381-5798-98ae-4d0788a8f32a with scrape type 2
2026-03-26 22:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0314240d-b381-5798-98ae-4d0788a8f32a with scrape type 2
2026-03-26 22:58:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 0314240d-b381-5798-98ae-4d0788a8f32a, identifier: 1982354
2026-03-26 22:58:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 0314240d-b381-5798-98ae-4d0788a8f32a with identifier: 1982354
2026-03-26 22:58:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 0314240d-b381-5798-98ae-4d0788a8f32a with identifier: 1982354
2026-03-26 22:58:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 0314240d-b381-5798-98ae-4d0788a8f32a with identifier: 1982354 to the API
2026-03-26 22:58:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:58:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:58:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '0314240d-b381-5798-98ae-4d0788a8f32a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '308 SW',
 'odometer': 55941,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 308 SW 1.2 PURETECH 96KW S-S AUTO GT PACK',
 'transmission': 'automatic',
 'trim': '1.2 PURETECH 96KW S-S AUTO GT PACK',
 'vin': None,
 'year': 2023}
2026-03-26 22:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982354%27 HTTP/1.1" 200 None
2026-03-26 22:58:43 [ayvens.be] INFO: Saving data for 1982354: {'auction_closing_time': 1774942200.0, 'created_time': 1774478832.573938, 'last_price_update_time': 1774565923.973116}
2026-03-26 22:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982354') HTTP/1.1" 204 0
2026-03-26 22:58:43 [ayvens.be] INFO: Found listing with ID: 1982355
2026-03-26 22:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982355%27 HTTP/1.1" 200 None
2026-03-26 22:58:44 [ayvens.be] INFO: Scrape type for 1982355: 2
2026-03-26 22:58:44 [ayvens.be] INFO: Extracting data for car ID: 1982355
2026-03-26 22:58:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62ad896d-e91c-5202-9835-1dfea3e44517 with identifier: 1982355
2026-03-26 22:58:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62ad896d-e91c-5202-9835-1dfea3e44517 with scrape type 2
2026-03-26 22:58:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 62ad896d-e91c-5202-9835-1dfea3e44517 with scrape type 2
2026-03-26 22:58:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 62ad896d-e91c-5202-9835-1dfea3e44517, identifier: 1982355
2026-03-26 22:58:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 62ad896d-e91c-5202-9835-1dfea3e44517 with identifier: 1982355
2026-03-26 22:58:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 62ad896d-e91c-5202-9835-1dfea3e44517 with identifier: 1982355
2026-03-26 22:58:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 62ad896d-e91c-5202-9835-1dfea3e44517 with identifier: 1982355 to the API
2026-03-26 22:58:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:58:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:58:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '62ad896d-e91c-5202-9835-1dfea3e44517',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'CITROAu2039N',
 'model': 'C5 X',
 'odometer': 60986,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-04-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROAu2039N C5 X 1.2 PURETECH 130 S&S EAT8 FEEL AT',
 'transmission': 'automatic',
 'trim': '1.2 PURETECH 130 S&S EAT8 FEEL AT',
 'vin': None,
 'year': 2023}
2026-03-26 22:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982355%27 HTTP/1.1" 200 None
2026-03-26 22:58:44 [ayvens.be] INFO: Saving data for 1982355: {'auction_closing_time': 1774942200.0, 'created_time': 1774478836.0746, 'last_price_update_time': 1774565924.34243}
2026-03-26 22:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982355') HTTP/1.1" 204 0
2026-03-26 22:58:44 [ayvens.be] INFO: Found listing with ID: 1982356
2026-03-26 22:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982356%27 HTTP/1.1" 200 None
2026-03-26 22:58:44 [ayvens.be] INFO: Scrape type for 1982356: 2
2026-03-26 22:58:44 [ayvens.be] INFO: Extracting data for car ID: 1982356
2026-03-26 22:58:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c6743647-357c-5f2f-89ac-6b555c76e721 with identifier: 1982356
2026-03-26 22:58:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6743647-357c-5f2f-89ac-6b555c76e721 with scrape type 2
2026-03-26 22:58:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c6743647-357c-5f2f-89ac-6b555c76e721 with scrape type 2
2026-03-26 22:58:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c6743647-357c-5f2f-89ac-6b555c76e721, identifier: 1982356
2026-03-26 22:58:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c6743647-357c-5f2f-89ac-6b555c76e721 with identifier: 1982356
2026-03-26 22:58:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c6743647-357c-5f2f-89ac-6b555c76e721 with identifier: 1982356
2026-03-26 22:58:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c6743647-357c-5f2f-89ac-6b555c76e721 with identifier: 1982356 to the API
2026-03-26 22:58:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:58:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:58:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'c6743647-357c-5f2f-89ac-6b555c76e721',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '1 SERIES HATCH',
 'odometer': 77659,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1 SERIES HATCH 1.5 116D (85KW)',
 'transmission': 'manual',
 'trim': '1.5 116D (85KW)',
 'vin': None,
 'year': 2022}
2026-03-26 22:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982356%27 HTTP/1.1" 200 None
2026-03-26 22:58:44 [ayvens.be] INFO: Saving data for 1982356: {'auction_closing_time': 1774942200.0, 'created_time': 1774478865.627455, 'last_price_update_time': 1774565924.720614}
2026-03-26 22:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982356') HTTP/1.1" 204 0
2026-03-26 22:58:44 [ayvens.be] INFO: Found listing with ID: 1982357
2026-03-26 22:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982357%27 HTTP/1.1" 200 None
2026-03-26 22:58:44 [ayvens.be] INFO: Scrape type for 1982357: 2
2026-03-26 22:58:44 [ayvens.be] INFO: Extracting data for car ID: 1982357
2026-03-26 22:58:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d9b6005f-c543-5e51-80c8-6fa0585684e9 with identifier: 1982357
2026-03-26 22:58:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9b6005f-c543-5e51-80c8-6fa0585684e9 with scrape type 2
2026-03-26 22:58:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d9b6005f-c543-5e51-80c8-6fa0585684e9 with scrape type 2
2026-03-26 22:58:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d9b6005f-c543-5e51-80c8-6fa0585684e9, identifier: 1982357
2026-03-26 22:58:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d9b6005f-c543-5e51-80c8-6fa0585684e9 with identifier: 1982357
2026-03-26 22:58:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d9b6005f-c543-5e51-80c8-6fa0585684e9 with identifier: 1982357
2026-03-26 22:58:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d9b6005f-c543-5e51-80c8-6fa0585684e9 with identifier: 1982357 to the API
2026-03-26 22:58:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:58:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:58:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'd9b6005f-c543-5e51-80c8-6fa0585684e9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A3 SPORTBACK DIESEL - 2020',
 'odometer': 73865,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A3 SPORTBACK DIESEL - 2020 30 TDi',
 'transmission': 'manual',
 'trim': '30 TDi',
 'vin': None,
 'year': 2021}
2026-03-26 22:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982357%27 HTTP/1.1" 200 None
2026-03-26 22:58:45 [ayvens.be] INFO: Saving data for 1982357: {'auction_closing_time': 1774942200.0, 'created_time': 1774478866.33197, 'last_price_update_time': 1774565925.141872}
2026-03-26 22:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982357') HTTP/1.1" 204 0
2026-03-26 22:58:45 [ayvens.be] INFO: Found listing with ID: 1982358
2026-03-26 22:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982358%27 HTTP/1.1" 200 None
2026-03-26 22:58:45 [ayvens.be] INFO: Scrape type for 1982358: 2
2026-03-26 22:58:45 [ayvens.be] INFO: Extracting data for car ID: 1982358
2026-03-26 22:58:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 332e6710-3a5f-5d99-b557-eba9e7dcf17e with identifier: 1982358
2026-03-26 22:58:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 332e6710-3a5f-5d99-b557-eba9e7dcf17e with scrape type 2
2026-03-26 22:58:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 332e6710-3a5f-5d99-b557-eba9e7dcf17e with scrape type 2
2026-03-26 22:58:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 332e6710-3a5f-5d99-b557-eba9e7dcf17e, identifier: 1982358
2026-03-26 22:58:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 332e6710-3a5f-5d99-b557-eba9e7dcf17e with identifier: 1982358
2026-03-26 22:58:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 332e6710-3a5f-5d99-b557-eba9e7dcf17e with identifier: 1982358
2026-03-26 22:58:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 332e6710-3a5f-5d99-b557-eba9e7dcf17e with identifier: 1982358 to the API
2026-03-26 22:58:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:58:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:58:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.4L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '332e6710-3a5f-5d99-b557-eba9e7dcf17e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'PASSAT',
 'odometer': 57955,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN PASSAT 1.4 TSI GTE BUSINESS DSG',
 'transmission': 'automatic',
 'trim': '1.4 TSI GTE BUSINESS DSG',
 'vin': None,
 'year': 2021}
2026-03-26 22:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982358%27 HTTP/1.1" 200 None
2026-03-26 22:58:45 [ayvens.be] INFO: Saving data for 1982358: {'auction_closing_time': 1774942200.0, 'created_time': 1774478865.963672, 'last_price_update_time': 1774565925.519525}
2026-03-26 22:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982358') HTTP/1.1" 204 0
2026-03-26 22:58:45 [ayvens.be] INFO: Found listing with ID: 1982359
2026-03-26 22:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982359%27 HTTP/1.1" 200 None
2026-03-26 22:58:45 [ayvens.be] INFO: Scrape type for 1982359: 2
2026-03-26 22:58:45 [ayvens.be] INFO: Extracting data for car ID: 1982359
2026-03-26 22:58:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e96b9b1a-8274-5af2-9c5c-b5cb8890b308 with identifier: 1982359
2026-03-26 22:58:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e96b9b1a-8274-5af2-9c5c-b5cb8890b308 with scrape type 2
2026-03-26 22:58:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e96b9b1a-8274-5af2-9c5c-b5cb8890b308 with scrape type 2
2026-03-26 22:58:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e96b9b1a-8274-5af2-9c5c-b5cb8890b308, identifier: 1982359
2026-03-26 22:58:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e96b9b1a-8274-5af2-9c5c-b5cb8890b308 with identifier: 1982359
2026-03-26 22:58:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e96b9b1a-8274-5af2-9c5c-b5cb8890b308 with identifier: 1982359
2026-03-26 22:58:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e96b9b1a-8274-5af2-9c5c-b5cb8890b308 with identifier: 1982359 to the API
2026-03-26 22:58:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:58:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:58:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'e96b9b1a-8274-5af2-9c5c-b5cb8890b308',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '5008',
 'odometer': 48727,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-23',
 'seats_number': 7,
 'seller_name': None,
 'title': 'PEUGEOT 5008 1.2 PURETECH 130 AUTO GT PACK',
 'transmission': 'automatic',
 'trim': '1.2 PURETECH 130 AUTO GT PACK',
 'vin': None,
 'year': 2021}
2026-03-26 22:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982359%27 HTTP/1.1" 200 None
2026-03-26 22:58:45 [ayvens.be] INFO: Saving data for 1982359: {'auction_closing_time': 1774942200.0, 'created_time': 1774478840.591405, 'last_price_update_time': 1774565925.987155}
2026-03-26 22:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982359') HTTP/1.1" 204 0
2026-03-26 22:58:46 [ayvens.be] INFO: Found listing with ID: 1982360
2026-03-26 22:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982360%27 HTTP/1.1" 200 None
2026-03-26 22:58:46 [ayvens.be] INFO: Scrape type for 1982360: 2
2026-03-26 22:58:46 [ayvens.be] INFO: Extracting data for car ID: 1982360
2026-03-26 22:58:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5617fe04-6629-5d82-9a7e-a97abf42e2ad with identifier: 1982360
2026-03-26 22:58:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5617fe04-6629-5d82-9a7e-a97abf42e2ad with scrape type 2
2026-03-26 22:58:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5617fe04-6629-5d82-9a7e-a97abf42e2ad with scrape type 2
2026-03-26 22:58:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 5617fe04-6629-5d82-9a7e-a97abf42e2ad, identifier: 1982360
2026-03-26 22:58:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 5617fe04-6629-5d82-9a7e-a97abf42e2ad with identifier: 1982360
2026-03-26 22:58:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 5617fe04-6629-5d82-9a7e-a97abf42e2ad with identifier: 1982360
2026-03-26 22:58:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 5617fe04-6629-5d82-9a7e-a97abf42e2ad with identifier: 1982360 to the API
2026-03-26 22:58:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:58:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:58:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '5617fe04-6629-5d82-9a7e-a97abf42e2ad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X2',
 'odometer': 41905,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X2 1.5 SDRIVE18I 100KW DCT',
 'transmission': 'automatic',
 'trim': '1.5 SDRIVE18I 100KW DCT',
 'vin': None,
 'year': 2022}
2026-03-26 22:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982360%27 HTTP/1.1" 200 None
2026-03-26 22:58:46 [ayvens.be] INFO: Saving data for 1982360: {'auction_closing_time': 1774942200.0, 'created_time': 1774478842.565642, 'last_price_update_time': 1774565926.351656}
2026-03-26 22:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982360') HTTP/1.1" 204 0
2026-03-26 22:58:46 [ayvens.be] INFO: Found listing with ID: 1982361
2026-03-26 22:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982361%27 HTTP/1.1" 200 None
2026-03-26 22:58:46 [ayvens.be] INFO: Scrape type for 1982361: 2
2026-03-26 22:58:46 [ayvens.be] INFO: Extracting data for car ID: 1982361
2026-03-26 22:58:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62ce4bcb-b26f-52f9-8101-2847d7dcc6a0 with identifier: 1982361
2026-03-26 22:58:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62ce4bcb-b26f-52f9-8101-2847d7dcc6a0 with scrape type 2
2026-03-26 22:58:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 62ce4bcb-b26f-52f9-8101-2847d7dcc6a0 with scrape type 2
2026-03-26 22:58:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 62ce4bcb-b26f-52f9-8101-2847d7dcc6a0, identifier: 1982361
2026-03-26 22:58:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 62ce4bcb-b26f-52f9-8101-2847d7dcc6a0 with identifier: 1982361
2026-03-26 22:58:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 62ce4bcb-b26f-52f9-8101-2847d7dcc6a0 with identifier: 1982361
2026-03-26 22:58:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 62ce4bcb-b26f-52f9-8101-2847d7dcc6a0 with identifier: 1982361 to the API
2026-03-26 22:58:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:58:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:58:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '62ce4bcb-b26f-52f9-8101-2847d7dcc6a0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '308',
 'odometer': 182827,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 308 1.6 PHEV 180 S-S AUTO ALLURE PACK',
 'transmission': 'automatic',
 'trim': '1.6 PHEV 180 S-S AUTO ALLURE PACK',
 'vin': None,
 'year': 2022}
2026-03-26 22:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982361%27 HTTP/1.1" 200 None
2026-03-26 22:58:46 [ayvens.be] INFO: Saving data for 1982361: {'auction_closing_time': 1774942200.0, 'created_time': 1774478843.848242, 'last_price_update_time': 1774565926.755097}
2026-03-26 22:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982361') HTTP/1.1" 204 0
2026-03-26 22:58:46 [ayvens.be] INFO: Found listing with ID: 1982362
2026-03-26 22:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982362%27 HTTP/1.1" 200 None
2026-03-26 22:58:46 [ayvens.be] INFO: Scrape type for 1982362: 2
2026-03-26 22:58:46 [ayvens.be] INFO: Extracting data for car ID: 1982362
2026-03-26 22:58:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ca879a9-f76e-522e-8f3d-0187d2220f2a with identifier: 1982362
2026-03-26 22:58:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ca879a9-f76e-522e-8f3d-0187d2220f2a with scrape type 2
2026-03-26 22:58:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3ca879a9-f76e-522e-8f3d-0187d2220f2a with scrape type 2
2026-03-26 22:58:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 3ca879a9-f76e-522e-8f3d-0187d2220f2a, identifier: 1982362
2026-03-26 22:58:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 3ca879a9-f76e-522e-8f3d-0187d2220f2a with identifier: 1982362
2026-03-26 22:58:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 3ca879a9-f76e-522e-8f3d-0187d2220f2a with identifier: 1982362
2026-03-26 22:58:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 3ca879a9-f76e-522e-8f3d-0187d2220f2a with identifier: 1982362 to the API
2026-03-26 22:58:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:58:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:58:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '3ca879a9-f76e-522e-8f3d-0187d2220f2a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '2 SERIES GRAN COUPE',
 'odometer': 190523,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 2 SERIES GRAN COUPE 1.5 216DA GRAN COUPE',
 'transmission': 'automatic',
 'trim': '1.5 216DA GRAN COUPE',
 'vin': None,
 'year': 2022}
2026-03-26 22:58:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982362%27 HTTP/1.1" 200 None
2026-03-26 22:58:47 [ayvens.be] INFO: Saving data for 1982362: {'auction_closing_time': 1774942200.0, 'created_time': 1774478846.236708, 'last_price_update_time': 1774565927.132247}
2026-03-26 22:58:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982362') HTTP/1.1" 204 0
2026-03-26 22:58:47 [ayvens.be] INFO: Found listing with ID: 1982363
2026-03-26 22:58:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982363%27 HTTP/1.1" 200 None
2026-03-26 22:58:47 [ayvens.be] INFO: Scrape type for 1982363: 2
2026-03-26 22:58:47 [ayvens.be] INFO: Extracting data for car ID: 1982363
2026-03-26 22:58:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2caed4b9-cbe4-5dab-9099-7dd1f501f2c0 with identifier: 1982363
2026-03-26 22:58:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2caed4b9-cbe4-5dab-9099-7dd1f501f2c0 with scrape type 2
2026-03-26 22:58:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2caed4b9-cbe4-5dab-9099-7dd1f501f2c0 with scrape type 2
2026-03-26 22:58:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 2caed4b9-cbe4-5dab-9099-7dd1f501f2c0, identifier: 1982363
2026-03-26 22:58:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 2caed4b9-cbe4-5dab-9099-7dd1f501f2c0 with identifier: 1982363
2026-03-26 22:58:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 2caed4b9-cbe4-5dab-9099-7dd1f501f2c0 with identifier: 1982363
2026-03-26 22:58:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 2caed4b9-cbe4-5dab-9099-7dd1f501f2c0 with identifier: 1982363 to the API
2026-03-26 22:58:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:58:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:58:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.9L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '2caed4b9-cbe4-5dab-9099-7dd1f501f2c0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'VITO',
 'odometer': 223946,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-14',
 'seats_number': 3,
 'seller_name': None,
 'title': 'MERCEDES-BENZ VITO 2.0 100KW 114 CDI L2',
 'transmission': 'manual',
 'trim': '2.0 100KW 114 CDI L2',
 'vin': None,
 'year': 2022}
2026-03-26 22:58:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982363%27 HTTP/1.1" 200 None
2026-03-26 22:58:47 [ayvens.be] INFO: Saving data for 1982363: {'auction_closing_time': 1774942200.0, 'created_time': 1774478847.560597, 'last_price_update_time': 1774565927.518341}
2026-03-26 22:58:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982363') HTTP/1.1" 204 0
2026-03-26 22:58:47 [ayvens.be] INFO: Found listing with ID: 1982364
2026-03-26 22:58:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982364%27 HTTP/1.1" 200 None
2026-03-26 22:58:47 [ayvens.be] INFO: Scrape type for 1982364: 2
2026-03-26 22:58:47 [ayvens.be] INFO: Extracting data for car ID: 1982364
2026-03-26 22:58:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5acb7406-40bb-51e1-995c-1de2c3f8a8c5 with identifier: 1982364
2026-03-26 22:58:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5acb7406-40bb-51e1-995c-1de2c3f8a8c5 with scrape type 2
2026-03-26 22:58:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5acb7406-40bb-51e1-995c-1de2c3f8a8c5 with scrape type 2
2026-03-26 22:58:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 5acb7406-40bb-51e1-995c-1de2c3f8a8c5, identifier: 1982364
2026-03-26 22:58:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 5acb7406-40bb-51e1-995c-1de2c3f8a8c5 with identifier: 1982364
2026-03-26 22:58:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 5acb7406-40bb-51e1-995c-1de2c3f8a8c5 with identifier: 1982364
2026-03-26 22:58:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 5acb7406-40bb-51e1-995c-1de2c3f8a8c5 with identifier: 1982364 to the API
2026-03-26 22:58:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:58:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:58:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '5acb7406-40bb-51e1-995c-1de2c3f8a8c5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'CADDY',
 'odometer': 209411,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-08',
 'seats_number': 2,
 'seller_name': None,
 'title': 'VOLKSWAGEN CADDY 2.0TDI 55KW BMT CARGO',
 'transmission': 'manual',
 'trim': '2.0TDI 55KW BMT CARGO',
 'vin': None,
 'year': 2022}
2026-03-26 22:58:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982364%27 HTTP/1.1" 200 None
2026-03-26 22:58:47 [ayvens.be] INFO: Saving data for 1982364: {'auction_closing_time': 1774942200.0, 'created_time': 1774478850.585558, 'last_price_update_time': 1774565927.885223}
2026-03-26 22:58:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982364') HTTP/1.1" 204 0
2026-03-26 22:58:47 [ayvens.be] INFO: Found listing with ID: 1982365
2026-03-26 22:58:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982365%27 HTTP/1.1" 200 None
2026-03-26 22:58:47 [ayvens.be] INFO: Scrape type for 1982365: 2
2026-03-26 22:58:47 [ayvens.be] INFO: Extracting data for car ID: 1982365
2026-03-26 22:58:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d3a7b6a-cc06-5926-be1f-7f29745f83ee with identifier: 1982365
2026-03-26 22:58:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d3a7b6a-cc06-5926-be1f-7f29745f83ee with scrape type 2
2026-03-26 22:58:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1d3a7b6a-cc06-5926-be1f-7f29745f83ee with scrape type 2
2026-03-26 22:58:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 1d3a7b6a-cc06-5926-be1f-7f29745f83ee, identifier: 1982365
2026-03-26 22:58:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 1d3a7b6a-cc06-5926-be1f-7f29745f83ee with identifier: 1982365
2026-03-26 22:58:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 1d3a7b6a-cc06-5926-be1f-7f29745f83ee with identifier: 1982365
2026-03-26 22:58:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 1d3a7b6a-cc06-5926-be1f-7f29745f83ee with identifier: 1982365 to the API
2026-03-26 22:58:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:58:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:58:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '1d3a7b6a-cc06-5926-be1f-7f29745f83ee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'FABIA COMBI - 2018',
 'odometer': 197844,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA FABIA COMBI - 2018 1.0 TSI Ambition',
 'transmission': 'manual',
 'trim': '1.0 TSI Ambition',
 'vin': None,
 'year': 2019}
2026-03-26 22:58:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982365%27 HTTP/1.1" 200 None
2026-03-26 22:58:48 [ayvens.be] INFO: Saving data for 1982365: {'auction_closing_time': 1774942200.0, 'created_time': 1774478865.272644, 'last_price_update_time': 1774565928.261855}
2026-03-26 22:58:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982365') HTTP/1.1" 204 0
2026-03-26 22:58:48 [ayvens.be] INFO: Found listing with ID: 1982366
2026-03-26 22:58:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982366%27 HTTP/1.1" 200 None
2026-03-26 22:58:48 [ayvens.be] INFO: Scrape type for 1982366: 2
2026-03-26 22:58:48 [ayvens.be] INFO: Extracting data for car ID: 1982366
2026-03-26 22:58:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26f9dfe2-d663-518c-8fd2-7f71ec532d28 with identifier: 1982366
2026-03-26 22:58:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26f9dfe2-d663-518c-8fd2-7f71ec532d28 with scrape type 2
2026-03-26 22:58:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 26f9dfe2-d663-518c-8fd2-7f71ec532d28 with scrape type 2
2026-03-26 22:58:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 26f9dfe2-d663-518c-8fd2-7f71ec532d28, identifier: 1982366
2026-03-26 22:58:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 26f9dfe2-d663-518c-8fd2-7f71ec532d28 with identifier: 1982366
2026-03-26 22:58:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 26f9dfe2-d663-518c-8fd2-7f71ec532d28 with identifier: 1982366
2026-03-26 22:58:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 26f9dfe2-d663-518c-8fd2-7f71ec532d28 with identifier: 1982366 to the API
2026-03-26 22:58:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:58:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:58:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '26f9dfe2-d663-518c-8fd2-7f71ec532d28',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'V60',
 'odometer': 163253,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO V60 2.0 T6 RECHARGE GEARTR INSCRIPTION EXPR',
 'transmission': 'automatic',
 'trim': '2.0 T6 RECHARGE GEARTR INSCRIPTION EXPR',
 'vin': None,
 'year': 2021}
2026-03-26 22:58:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982366%27 HTTP/1.1" 200 None
2026-03-26 22:58:48 [ayvens.be] INFO: Saving data for 1982366: {'auction_closing_time': 1774942200.0, 'created_time': 1774478864.900403, 'last_price_update_time': 1774565928.632616}
2026-03-26 22:58:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982366') HTTP/1.1" 204 0
2026-03-26 22:58:48 [ayvens.be] INFO: Found listing with ID: 1982367
2026-03-26 22:58:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982367%27 HTTP/1.1" 200 None
2026-03-26 22:58:48 [ayvens.be] INFO: Scrape type for 1982367: 2
2026-03-26 22:58:48 [ayvens.be] INFO: Extracting data for car ID: 1982367
2026-03-26 22:58:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5f410232-5e8f-5468-b97f-fcbec566c596 with identifier: 1982367
2026-03-26 22:58:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f410232-5e8f-5468-b97f-fcbec566c596 with scrape type 2
2026-03-26 22:58:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5f410232-5e8f-5468-b97f-fcbec566c596 with scrape type 2
2026-03-26 22:58:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 5f410232-5e8f-5468-b97f-fcbec566c596, identifier: 1982367
2026-03-26 22:58:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 5f410232-5e8f-5468-b97f-fcbec566c596 with identifier: 1982367
2026-03-26 22:58:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 5f410232-5e8f-5468-b97f-fcbec566c596 with identifier: 1982367
2026-03-26 22:58:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 5f410232-5e8f-5468-b97f-fcbec566c596 with identifier: 1982367 to the API
2026-03-26 22:58:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:58:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:58:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '5f410232-5e8f-5468-b97f-fcbec566c596',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'RANGER',
 'odometer': 242195,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD RANGER 2.0 BIT 156KW 4WD D-CAB WILDTRAK AUTO',
 'transmission': 'automatic',
 'trim': '2.0 BIT 156KW 4WD D-CAB WILDTRAK AUTO',
 'vin': None,
 'year': 2021}
2026-03-26 22:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982367%27 HTTP/1.1" 200 None
2026-03-26 22:58:49 [ayvens.be] INFO: Saving data for 1982367: {'auction_closing_time': 1774942200.0, 'created_time': 1774478853.964136, 'last_price_update_time': 1774565929.013039}
2026-03-26 22:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982367') HTTP/1.1" 204 0
2026-03-26 22:58:49 [ayvens.be] INFO: Found listing with ID: 1982368
2026-03-26 22:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982368%27 HTTP/1.1" 200 None
2026-03-26 22:58:49 [ayvens.be] INFO: Scrape type for 1982368: 2
2026-03-26 22:58:49 [ayvens.be] INFO: Extracting data for car ID: 1982368
2026-03-26 22:58:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0efb8a44-b42c-5a49-beba-3efd9e9a2cdd with identifier: 1982368
2026-03-26 22:58:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0efb8a44-b42c-5a49-beba-3efd9e9a2cdd with scrape type 2
2026-03-26 22:58:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0efb8a44-b42c-5a49-beba-3efd9e9a2cdd with scrape type 2
2026-03-26 22:58:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 0efb8a44-b42c-5a49-beba-3efd9e9a2cdd, identifier: 1982368
2026-03-26 22:58:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 0efb8a44-b42c-5a49-beba-3efd9e9a2cdd with identifier: 1982368
2026-03-26 22:58:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 0efb8a44-b42c-5a49-beba-3efd9e9a2cdd with identifier: 1982368
2026-03-26 22:58:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 0efb8a44-b42c-5a49-beba-3efd9e9a2cdd with identifier: 1982368 to the API
2026-03-26 22:58:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:58:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:58:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '0efb8a44-b42c-5a49-beba-3efd9e9a2cdd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TIGUAN DIESEL - 2016',
 'odometer': 156193,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN TIGUAN DIESEL - 2016 2.0 TDi SCR Comfortline (EU6.2)',
 'transmission': 'manual',
 'trim': '2.0 TDi SCR Comfortline (EU6.2)',
 'vin': None,
 'year': 2020}
2026-03-26 22:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982368%27 HTTP/1.1" 200 None
2026-03-26 22:58:49 [ayvens.be] INFO: Saving data for 1982368: {'auction_closing_time': 1774942200.0, 'created_time': 1774478858.931639, 'last_price_update_time': 1774565929.410186}
2026-03-26 22:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982368') HTTP/1.1" 204 0
2026-03-26 22:58:49 [ayvens.be] INFO: Found listing with ID: 1982369
2026-03-26 22:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982369%27 HTTP/1.1" 200 None
2026-03-26 22:58:49 [ayvens.be] INFO: Scrape type for 1982369: 2
2026-03-26 22:58:49 [ayvens.be] INFO: Extracting data for car ID: 1982369
2026-03-26 22:58:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 654038e2-6432-5b5b-9e3f-65c9d3e967dc with identifier: 1982369
2026-03-26 22:58:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 654038e2-6432-5b5b-9e3f-65c9d3e967dc with scrape type 2
2026-03-26 22:58:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 654038e2-6432-5b5b-9e3f-65c9d3e967dc with scrape type 2
2026-03-26 22:58:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 654038e2-6432-5b5b-9e3f-65c9d3e967dc, identifier: 1982369
2026-03-26 22:58:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 654038e2-6432-5b5b-9e3f-65c9d3e967dc with identifier: 1982369
2026-03-26 22:58:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 654038e2-6432-5b5b-9e3f-65c9d3e967dc with identifier: 1982369
2026-03-26 22:58:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 654038e2-6432-5b5b-9e3f-65c9d3e967dc with identifier: 1982369 to the API
2026-03-26 22:58:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:58:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:58:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '654038e2-6432-5b5b-9e3f-65c9d3e967dc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A-CLASS',
 'odometer': 91533,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ A-CLASS 1.3 A 180 BUSINESS SOLUTION ESSENTIAL',
 'transmission': 'manual',
 'trim': '1.3 A 180 BUSINESS SOLUTION ESSENTIAL',
 'vin': None,
 'year': 2022}
2026-03-26 22:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982369%27 HTTP/1.1" 200 None
2026-03-26 22:58:49 [ayvens.be] INFO: Saving data for 1982369: {'auction_closing_time': 1774942200.0, 'created_time': 1774478857.462004, 'last_price_update_time': 1774565929.785649}
2026-03-26 22:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982369') HTTP/1.1" 204 0
2026-03-26 22:58:49 [ayvens.be] INFO: Found listing with ID: 1982370
2026-03-26 22:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982370%27 HTTP/1.1" 200 None
2026-03-26 22:58:49 [ayvens.be] INFO: Scrape type for 1982370: 2
2026-03-26 22:58:49 [ayvens.be] INFO: Extracting data for car ID: 1982370
2026-03-26 22:58:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c34ad44-3e1b-50dd-a354-6c883c1ddeb9 with identifier: 1982370
2026-03-26 22:58:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c34ad44-3e1b-50dd-a354-6c883c1ddeb9 with scrape type 2
2026-03-26 22:58:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3c34ad44-3e1b-50dd-a354-6c883c1ddeb9 with scrape type 2
2026-03-26 22:58:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 3c34ad44-3e1b-50dd-a354-6c883c1ddeb9, identifier: 1982370
2026-03-26 22:58:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 3c34ad44-3e1b-50dd-a354-6c883c1ddeb9 with identifier: 1982370
2026-03-26 22:58:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 3c34ad44-3e1b-50dd-a354-6c883c1ddeb9 with identifier: 1982370
2026-03-26 22:58:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 3c34ad44-3e1b-50dd-a354-6c883c1ddeb9 with identifier: 1982370 to the API
2026-03-26 22:58:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:58:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:58:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '3c34ad44-3e1b-50dd-a354-6c883c1ddeb9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'CLIO',
 'odometer': 85585,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT CLIO 1.0 TCE 90 EVOLUTION',
 'transmission': 'manual',
 'trim': '1.0 TCE 90 EVOLUTION',
 'vin': None,
 'year': 2022}
2026-03-26 22:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982370%27 HTTP/1.1" 200 None
2026-03-26 22:58:50 [ayvens.be] INFO: Saving data for 1982370: {'auction_closing_time': 1774942200.0, 'created_time': 1774478857.936936, 'last_price_update_time': 1774565930.249474}
2026-03-26 22:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982370') HTTP/1.1" 204 0
2026-03-26 22:58:50 [ayvens.be] INFO: Found listing with ID: 1982371
2026-03-26 22:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982371%27 HTTP/1.1" 200 None
2026-03-26 22:58:50 [ayvens.be] INFO: Scrape type for 1982371: 2
2026-03-26 22:58:50 [ayvens.be] INFO: Extracting data for car ID: 1982371
2026-03-26 22:58:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8f9e6d5-ecfe-5080-ad1b-4defdd1509b5 with identifier: 1982371
2026-03-26 22:58:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8f9e6d5-ecfe-5080-ad1b-4defdd1509b5 with scrape type 2
2026-03-26 22:58:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e8f9e6d5-ecfe-5080-ad1b-4defdd1509b5 with scrape type 2
2026-03-26 22:58:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e8f9e6d5-ecfe-5080-ad1b-4defdd1509b5, identifier: 1982371
2026-03-26 22:58:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e8f9e6d5-ecfe-5080-ad1b-4defdd1509b5 with identifier: 1982371
2026-03-26 22:58:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e8f9e6d5-ecfe-5080-ad1b-4defdd1509b5 with identifier: 1982371
2026-03-26 22:58:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e8f9e6d5-ecfe-5080-ad1b-4defdd1509b5 with identifier: 1982371 to the API
2026-03-26 22:58:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:58:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:58:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'e8f9e6d5-ecfe-5080-ad1b-4defdd1509b5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 102124,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 1.5 SDRIVE16D',
 'transmission': 'manual',
 'trim': '1.5 SDRIVE16D',
 'vin': None,
 'year': 2021}
2026-03-26 22:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982371%27 HTTP/1.1" 200 None
2026-03-26 22:58:50 [ayvens.be] INFO: Saving data for 1982371: {'auction_closing_time': 1774942200.0, 'created_time': 1774478860.734076, 'last_price_update_time': 1774565930.614017}
2026-03-26 22:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982371') HTTP/1.1" 204 0
2026-03-26 22:58:50 [ayvens.be] INFO: Found listing with ID: 1982372
2026-03-26 22:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982372%27 HTTP/1.1" 200 None
2026-03-26 22:58:50 [ayvens.be] INFO: Scrape type for 1982372: 2
2026-03-26 22:58:50 [ayvens.be] INFO: Extracting data for car ID: 1982372
2026-03-26 22:58:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b9e223a-a958-5530-a528-f172915a1616 with identifier: 1982372
2026-03-26 22:58:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b9e223a-a958-5530-a528-f172915a1616 with scrape type 2
2026-03-26 22:58:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8b9e223a-a958-5530-a528-f172915a1616 with scrape type 2
2026-03-26 22:58:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 8b9e223a-a958-5530-a528-f172915a1616, identifier: 1982372
2026-03-26 22:58:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 8b9e223a-a958-5530-a528-f172915a1616 with identifier: 1982372
2026-03-26 22:58:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 8b9e223a-a958-5530-a528-f172915a1616 with identifier: 1982372
2026-03-26 22:58:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 8b9e223a-a958-5530-a528-f172915a1616 with identifier: 1982372 to the API
2026-03-26 22:58:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:58:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:58:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '8b9e223a-a958-5530-a528-f172915a1616',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 69715,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T4 RECHARGE GEARTR. INSCRIPTION',
 'transmission': 'automatic',
 'trim': '1.5 T4 RECHARGE GEARTR. INSCRIPTION',
 'vin': None,
 'year': 2021}
2026-03-26 22:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982372%27 HTTP/1.1" 200 None
2026-03-26 22:58:50 [ayvens.be] INFO: Saving data for 1982372: {'auction_closing_time': 1774942200.0, 'created_time': 1774478861.949055, 'last_price_update_time': 1774565930.995588}
2026-03-26 22:58:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982372') HTTP/1.1" 204 0
2026-03-26 22:58:51 [ayvens.be] INFO: Found listing with ID: 1982373
2026-03-26 22:58:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982373%27 HTTP/1.1" 200 None
2026-03-26 22:58:51 [ayvens.be] INFO: Scrape type for 1982373: 2
2026-03-26 22:58:51 [ayvens.be] INFO: Extracting data for car ID: 1982373
2026-03-26 22:58:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 785dd859-af55-5763-9b46-06d6f50a3d70 with identifier: 1982373
2026-03-26 22:58:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 785dd859-af55-5763-9b46-06d6f50a3d70 with scrape type 2
2026-03-26 22:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 785dd859-af55-5763-9b46-06d6f50a3d70 with scrape type 2
2026-03-26 22:58:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 785dd859-af55-5763-9b46-06d6f50a3d70, identifier: 1982373
2026-03-26 22:58:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 785dd859-af55-5763-9b46-06d6f50a3d70 with identifier: 1982373
2026-03-26 22:58:51 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 22:58:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 22:58:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 785dd859-af55-5763-9b46-06d6f50a3d70 with identifier: 1982373
2026-03-26 22:58:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 785dd859-af55-5763-9b46-06d6f50a3d70 with identifier: 1982373 to the API
2026-03-26 22:58:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:58:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:58:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 101,
 'color': 'NOIR PERLA NERA',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '785dd859-af55-5763-9b46-06d6f50a3d70',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '5008 DIESEL - 2020',
 'odometer': 55014,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-29',
 'seats_number': 7,
 'seller_name': None,
 'title': 'PEUGEOT 5008 DIESEL - 2020 1.5 BlueHDi Allure',
 'transmission': 'automatic',
 'trim': '1.5 BlueHDi Allure',
 'vin': None,
 'year': 2020}
2026-03-26 22:58:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982373%27 HTTP/1.1" 200 None
2026-03-26 22:58:51 [ayvens.be] INFO: Saving data for 1982373: {'auction_closing_time': 1774942200.0, 'created_time': 1774478863.104647, 'last_price_update_time': 1774565931.38584}
2026-03-26 22:58:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982373') HTTP/1.1" 204 0
2026-03-26 22:58:51 [ayvens.be] INFO: Found listing with ID: 1982374
2026-03-26 22:58:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982374%27 HTTP/1.1" 200 None
2026-03-26 22:58:51 [ayvens.be] INFO: Scrape type for 1982374: 2
2026-03-26 22:58:51 [ayvens.be] INFO: Extracting data for car ID: 1982374
2026-03-26 22:58:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d057e446-aaa5-5849-b692-2eea29002f92 with identifier: 1982374
2026-03-26 22:58:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d057e446-aaa5-5849-b692-2eea29002f92 with scrape type 2
2026-03-26 22:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d057e446-aaa5-5849-b692-2eea29002f92 with scrape type 2
2026-03-26 22:58:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d057e446-aaa5-5849-b692-2eea29002f92, identifier: 1982374
2026-03-26 22:58:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d057e446-aaa5-5849-b692-2eea29002f92 with identifier: 1982374
2026-03-26 22:58:51 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 22:58:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 22:58:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d057e446-aaa5-5849-b692-2eea29002f92 with identifier: 1982374
2026-03-26 22:58:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d057e446-aaa5-5849-b692-2eea29002f92 with identifier: 1982374 to the API
2026-03-26 22:58:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:58:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:58:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 148,
 'color': 'WIT',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'd057e446-aaa5-5849-b692-2eea29002f92',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'CITROAu2039N',
 'model': 'Berlingo',
 'odometer': 75593,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROAu2039N Berlingo 1.6 VTi Feel',
 'transmission': 'manual',
 'trim': '1.6 VTi Feel',
 'vin': None,
 'year': 2017}
2026-03-26 22:58:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982374%27 HTTP/1.1" 200 None
2026-03-26 22:58:51 [ayvens.be] INFO: Saving data for 1982374: {'auction_closing_time': 1774942200.0, 'created_time': 1774478874.453032, 'last_price_update_time': 1774565931.770249}
2026-03-26 22:58:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982374') HTTP/1.1" 204 0
2026-03-26 22:58:51 [ayvens.be] INFO: Found listing with ID: 1982375
2026-03-26 22:58:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982375%27 HTTP/1.1" 200 None
2026-03-26 22:58:51 [ayvens.be] INFO: Scrape type for 1982375: 2
2026-03-26 22:58:51 [ayvens.be] INFO: Extracting data for car ID: 1982375
2026-03-26 22:58:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1321fa06-3436-5cce-9b4b-d08e45d7298a with identifier: 1982375
2026-03-26 22:58:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1321fa06-3436-5cce-9b4b-d08e45d7298a with scrape type 2
2026-03-26 22:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1321fa06-3436-5cce-9b4b-d08e45d7298a with scrape type 2
2026-03-26 22:58:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 1321fa06-3436-5cce-9b4b-d08e45d7298a, identifier: 1982375
2026-03-26 22:58:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 1321fa06-3436-5cce-9b4b-d08e45d7298a with identifier: 1982375
2026-03-26 22:58:51 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 22:58:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 22:58:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 1321fa06-3436-5cce-9b4b-d08e45d7298a with identifier: 1982375
2026-03-26 22:58:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 1321fa06-3436-5cce-9b4b-d08e45d7298a with identifier: 1982375 to the API
2026-03-26 22:58:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:58:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:58:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 41,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '1321fa06-3436-5cce-9b4b-d08e45d7298a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 84866,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T5 TE PHEV Inscription DCT STOCK',
 'transmission': 'automatic',
 'trim': '1.5 T5 TE PHEV Inscription DCT STOCK',
 'vin': None,
 'year': 2020}
2026-03-26 22:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982375%27 HTTP/1.1" 200 None
2026-03-26 22:58:52 [ayvens.be] INFO: Saving data for 1982375: {'auction_closing_time': 1774942200.0, 'created_time': 1774478874.814417, 'last_price_update_time': 1774565932.155205}
2026-03-26 22:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982375') HTTP/1.1" 204 0
2026-03-26 22:58:52 [ayvens.be] INFO: Found listing with ID: 1982376
2026-03-26 22:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982376%27 HTTP/1.1" 200 None
2026-03-26 22:58:52 [ayvens.be] INFO: Scrape type for 1982376: 2
2026-03-26 22:58:52 [ayvens.be] INFO: Extracting data for car ID: 1982376
2026-03-26 22:58:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 040d8843-27a3-5075-957d-30ca3378b5a1 with identifier: 1982376
2026-03-26 22:58:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 040d8843-27a3-5075-957d-30ca3378b5a1 with scrape type 2
2026-03-26 22:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 040d8843-27a3-5075-957d-30ca3378b5a1 with scrape type 2
2026-03-26 22:58:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 040d8843-27a3-5075-957d-30ca3378b5a1, identifier: 1982376
2026-03-26 22:58:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 040d8843-27a3-5075-957d-30ca3378b5a1 with identifier: 1982376
2026-03-26 22:58:52 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 22:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 22:58:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 040d8843-27a3-5075-957d-30ca3378b5a1 with identifier: 1982376
2026-03-26 22:58:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 040d8843-27a3-5075-957d-30ca3378b5a1 with identifier: 1982376 to the API
2026-03-26 22:58:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:58:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:58:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'color': 'ONYX BLACK METALLIC',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '040d8843-27a3-5075-957d-30ca3378b5a1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 84265,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 2.0 D3 GEARTRONIC R-DESIGN',
 'transmission': 'automatic',
 'trim': '2.0 D3 GEARTRONIC R-DESIGN',
 'vin': None,
 'year': 2021}
2026-03-26 22:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982376%27 HTTP/1.1" 200 None
2026-03-26 22:58:52 [ayvens.be] INFO: Saving data for 1982376: {'auction_closing_time': 1774942200.0, 'created_time': 1774478876.56052, 'last_price_update_time': 1774565932.527038}
2026-03-26 22:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982376') HTTP/1.1" 204 0
2026-03-26 22:58:52 [ayvens.be] INFO: Found listing with ID: 1982377
2026-03-26 22:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982377%27 HTTP/1.1" 200 None
2026-03-26 22:58:52 [ayvens.be] INFO: Scrape type for 1982377: 2
2026-03-26 22:58:52 [ayvens.be] INFO: Extracting data for car ID: 1982377
2026-03-26 22:58:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e22ac190-a7f9-5fcf-8ba0-d3a47ae8acc8 with identifier: 1982377
2026-03-26 22:58:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e22ac190-a7f9-5fcf-8ba0-d3a47ae8acc8 with scrape type 2
2026-03-26 22:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e22ac190-a7f9-5fcf-8ba0-d3a47ae8acc8 with scrape type 2
2026-03-26 22:58:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e22ac190-a7f9-5fcf-8ba0-d3a47ae8acc8, identifier: 1982377
2026-03-26 22:58:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e22ac190-a7f9-5fcf-8ba0-d3a47ae8acc8 with identifier: 1982377
2026-03-26 22:58:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e22ac190-a7f9-5fcf-8ba0-d3a47ae8acc8 with identifier: 1982377
2026-03-26 22:58:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e22ac190-a7f9-5fcf-8ba0-d3a47ae8acc8 with identifier: 1982377 to the API
2026-03-26 22:58:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:58:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:58:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'electric',
 'id': 'e22ac190-a7f9-5fcf-8ba0-d3a47ae8acc8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'TESLA',
 'model': 'MODEL Y',
 'odometer': 162296,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TESLA MODEL Y BEV 75KWH LONG RANGE AUTO 4WD',
 'transmission': 'automatic',
 'trim': 'BEV 75KWH LONG RANGE AUTO 4WD',
 'vin': None,
 'year': 2022}
2026-03-26 22:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982377%27 HTTP/1.1" 200 None
2026-03-26 22:58:52 [ayvens.be] INFO: Saving data for 1982377: {'auction_closing_time': 1774942200.0, 'created_time': 1774478879.74978, 'last_price_update_time': 1774565932.938098}
2026-03-26 22:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982377') HTTP/1.1" 204 0
2026-03-26 22:58:52 [ayvens.be] INFO: Found listing with ID: 1982378
2026-03-26 22:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982378%27 HTTP/1.1" 200 None
2026-03-26 22:58:52 [ayvens.be] INFO: Scrape type for 1982378: 2
2026-03-26 22:58:52 [ayvens.be] INFO: Extracting data for car ID: 1982378
2026-03-26 22:58:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73485618-5170-5b7a-b324-cf77a23aeb42 with identifier: 1982378
2026-03-26 22:58:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73485618-5170-5b7a-b324-cf77a23aeb42 with scrape type 2
2026-03-26 22:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 73485618-5170-5b7a-b324-cf77a23aeb42 with scrape type 2
2026-03-26 22:58:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 73485618-5170-5b7a-b324-cf77a23aeb42, identifier: 1982378
2026-03-26 22:58:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 73485618-5170-5b7a-b324-cf77a23aeb42 with identifier: 1982378
2026-03-26 22:58:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 73485618-5170-5b7a-b324-cf77a23aeb42 with identifier: 1982378
2026-03-26 22:58:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 73485618-5170-5b7a-b324-cf77a23aeb42 with identifier: 1982378 to the API
2026-03-26 22:58:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:58:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:58:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '73485618-5170-5b7a-b324-cf77a23aeb42',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '5 SERIES BERLINE',
 'odometer': 180867,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 5 SERIES BERLINE 2.0 530E 185KW AUTO',
 'transmission': 'automatic',
 'trim': '2.0 530E 185KW AUTO',
 'vin': None,
 'year': 2021}
2026-03-26 22:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982378%27 HTTP/1.1" 200 None
2026-03-26 22:58:53 [ayvens.be] INFO: Saving data for 1982378: {'auction_closing_time': 1774942200.0, 'created_time': 1774478882.360886, 'last_price_update_time': 1774565933.322337}
2026-03-26 22:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982378') HTTP/1.1" 204 0
2026-03-26 22:58:53 [ayvens.be] INFO: Found listing with ID: 1982379
2026-03-26 22:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982379%27 HTTP/1.1" 200 None
2026-03-26 22:58:53 [ayvens.be] INFO: Scrape type for 1982379: 2
2026-03-26 22:58:53 [ayvens.be] INFO: Extracting data for car ID: 1982379
2026-03-26 22:58:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a19ac83-5fc0-5b35-aa5b-cefe01aa0810 with identifier: 1982379
2026-03-26 22:58:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a19ac83-5fc0-5b35-aa5b-cefe01aa0810 with scrape type 2
2026-03-26 22:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5a19ac83-5fc0-5b35-aa5b-cefe01aa0810 with scrape type 2
2026-03-26 22:58:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 5a19ac83-5fc0-5b35-aa5b-cefe01aa0810, identifier: 1982379
2026-03-26 22:58:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 5a19ac83-5fc0-5b35-aa5b-cefe01aa0810 with identifier: 1982379
2026-03-26 22:58:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 5a19ac83-5fc0-5b35-aa5b-cefe01aa0810 with identifier: 1982379
2026-03-26 22:58:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 5a19ac83-5fc0-5b35-aa5b-cefe01aa0810 with identifier: 1982379 to the API
2026-03-26 22:58:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:58:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:58:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'electric',
 'id': '5a19ac83-5fc0-5b35-aa5b-cefe01aa0810',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'TESLA',
 'model': 'MODEL 3',
 'odometer': 157744,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TESLA MODEL 3 BEV 75KWH LONG RANGE DUAL MOTOR 4WD AUTO',
 'transmission': 'automatic',
 'trim': 'BEV 75KWH LONG RANGE DUAL MOTOR 4WD AUTO',
 'vin': None,
 'year': 2022}
2026-03-26 22:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982379%27 HTTP/1.1" 200 None
2026-03-26 22:58:53 [ayvens.be] INFO: Saving data for 1982379: {'auction_closing_time': 1774942200.0, 'created_time': 1774478883.737769, 'last_price_update_time': 1774565933.683664}
2026-03-26 22:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982379') HTTP/1.1" 204 0
2026-03-26 22:58:53 [ayvens.be] INFO: Found listing with ID: 1982380
2026-03-26 22:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982380%27 HTTP/1.1" 200 None
2026-03-26 22:58:53 [ayvens.be] INFO: Scrape type for 1982380: 2
2026-03-26 22:58:53 [ayvens.be] INFO: Extracting data for car ID: 1982380
2026-03-26 22:58:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be621ee0-f86b-5a1b-9698-2fb276af75a5 with identifier: 1982380
2026-03-26 22:58:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be621ee0-f86b-5a1b-9698-2fb276af75a5 with scrape type 2
2026-03-26 22:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item be621ee0-f86b-5a1b-9698-2fb276af75a5 with scrape type 2
2026-03-26 22:58:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: be621ee0-f86b-5a1b-9698-2fb276af75a5, identifier: 1982380
2026-03-26 22:58:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: be621ee0-f86b-5a1b-9698-2fb276af75a5 with identifier: 1982380
2026-03-26 22:58:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: be621ee0-f86b-5a1b-9698-2fb276af75a5 with identifier: 1982380
2026-03-26 22:58:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: be621ee0-f86b-5a1b-9698-2fb276af75a5 with identifier: 1982380 to the API
2026-03-26 22:58:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:58:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:58:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'be621ee0-f86b-5a1b-9698-2fb276af75a5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'Vivaro',
 'odometer': 164503,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-04',
 'seats_number': 2,
 'seller_name': None,
 'title': 'OPEL Vivaro 2.0 TURBO 90KW EDITION L3H1 3.1T AUTO',
 'transmission': 'automatic',
 'trim': '2.0 TURBO 90KW EDITION L3H1 3.1T AUTO',
 'vin': None,
 'year': 2021}
2026-03-26 22:58:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982380%27 HTTP/1.1" 200 None
2026-03-26 22:58:54 [ayvens.be] INFO: Saving data for 1982380: {'auction_closing_time': 1774942200.0, 'created_time': 1774478892.848618, 'last_price_update_time': 1774565934.044941}
2026-03-26 22:58:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982380') HTTP/1.1" 204 0
2026-03-26 22:58:54 [ayvens.be] INFO: Found listing with ID: 1982382
2026-03-26 22:58:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982382%27 HTTP/1.1" 200 None
2026-03-26 22:58:54 [ayvens.be] INFO: Scrape type for 1982382: 2
2026-03-26 22:58:54 [ayvens.be] INFO: Extracting data for car ID: 1982382
2026-03-26 22:58:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8cb1147c-3a18-55bb-b58c-df65ea141be6 with identifier: 1982382
2026-03-26 22:58:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8cb1147c-3a18-55bb-b58c-df65ea141be6 with scrape type 2
2026-03-26 22:58:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8cb1147c-3a18-55bb-b58c-df65ea141be6 with scrape type 2
2026-03-26 22:58:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 8cb1147c-3a18-55bb-b58c-df65ea141be6, identifier: 1982382
2026-03-26 22:58:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 8cb1147c-3a18-55bb-b58c-df65ea141be6 with identifier: 1982382
2026-03-26 22:58:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 8cb1147c-3a18-55bb-b58c-df65ea141be6 with identifier: 1982382
2026-03-26 22:58:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 8cb1147c-3a18-55bb-b58c-df65ea141be6 with identifier: 1982382 to the API
2026-03-26 22:58:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:58:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:58:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '8cb1147c-3a18-55bb-b58c-df65ea141be6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '3 SERIES BERLINE',
 'odometer': 143466,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3 SERIES BERLINE 2.0 316DA (90KW) BERLINE',
 'transmission': 'automatic',
 'trim': '2.0 316DA (90KW) BERLINE',
 'vin': None,
 'year': 2022}
2026-03-26 22:58:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982382%27 HTTP/1.1" 200 None
2026-03-26 22:58:54 [ayvens.be] INFO: Saving data for 1982382: {'auction_closing_time': 1774942200.0, 'created_time': 1774478888.464472, 'last_price_update_time': 1774565934.512392}
2026-03-26 22:58:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982382') HTTP/1.1" 204 0
2026-03-26 22:58:54 [ayvens.be] INFO: Found listing with ID: 1982383
2026-03-26 22:58:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982383%27 HTTP/1.1" 200 None
2026-03-26 22:58:54 [ayvens.be] INFO: Scrape type for 1982383: 2
2026-03-26 22:58:54 [ayvens.be] INFO: Extracting data for car ID: 1982383
2026-03-26 22:58:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99079dac-8be6-5408-973e-703de7a75c32 with identifier: 1982383
2026-03-26 22:58:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99079dac-8be6-5408-973e-703de7a75c32 with scrape type 2
2026-03-26 22:58:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 99079dac-8be6-5408-973e-703de7a75c32 with scrape type 2
2026-03-26 22:58:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 99079dac-8be6-5408-973e-703de7a75c32, identifier: 1982383
2026-03-26 22:58:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 99079dac-8be6-5408-973e-703de7a75c32 with identifier: 1982383
2026-03-26 22:58:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 99079dac-8be6-5408-973e-703de7a75c32 with identifier: 1982383
2026-03-26 22:58:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 99079dac-8be6-5408-973e-703de7a75c32 with identifier: 1982383 to the API
2026-03-26 22:58:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:58:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:58:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '99079dac-8be6-5408-973e-703de7a75c32',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X3',
 'odometer': 137644,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X3 2.0 XDRIVE20D (120KW) AUTO 4WD',
 'transmission': 'automatic',
 'trim': '2.0 XDRIVE20D (120KW) AUTO 4WD',
 'vin': None,
 'year': 2020}
2026-03-26 22:58:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982383%27 HTTP/1.1" 200 None
2026-03-26 22:58:54 [ayvens.be] INFO: Saving data for 1982383: {'auction_closing_time': 1774942200.0, 'created_time': 1774478892.50703, 'last_price_update_time': 1774565934.886599}
2026-03-26 22:58:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982383') HTTP/1.1" 204 0
2026-03-26 22:58:54 [ayvens.be] INFO: Found listing with ID: 1982384
2026-03-26 22:58:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982384%27 HTTP/1.1" 200 None
2026-03-26 22:58:54 [ayvens.be] INFO: Scrape type for 1982384: 2
2026-03-26 22:58:54 [ayvens.be] INFO: Extracting data for car ID: 1982384
2026-03-26 22:58:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2648bf2-7702-5d3b-9ea0-2ef3b30177ae with identifier: 1982384
2026-03-26 22:58:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2648bf2-7702-5d3b-9ea0-2ef3b30177ae with scrape type 2
2026-03-26 22:58:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d2648bf2-7702-5d3b-9ea0-2ef3b30177ae with scrape type 2
2026-03-26 22:58:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d2648bf2-7702-5d3b-9ea0-2ef3b30177ae, identifier: 1982384
2026-03-26 22:58:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d2648bf2-7702-5d3b-9ea0-2ef3b30177ae with identifier: 1982384
2026-03-26 22:58:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d2648bf2-7702-5d3b-9ea0-2ef3b30177ae with identifier: 1982384
2026-03-26 22:58:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d2648bf2-7702-5d3b-9ea0-2ef3b30177ae with identifier: 1982384 to the API
2026-03-26 22:58:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:58:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:58:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'd2648bf2-7702-5d3b-9ea0-2ef3b30177ae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 138844,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 1.5 SDRIVE18I (100KW)',
 'transmission': 'manual',
 'trim': '1.5 SDRIVE18I (100KW)',
 'vin': None,
 'year': 2022}
2026-03-26 22:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982384%27 HTTP/1.1" 200 None
2026-03-26 22:58:55 [ayvens.be] INFO: Saving data for 1982384: {'auction_closing_time': 1774942200.0, 'created_time': 1774478890.422806, 'last_price_update_time': 1774565935.252815}
2026-03-26 22:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982384') HTTP/1.1" 204 0
2026-03-26 22:58:55 [ayvens.be] INFO: Found listing with ID: 1982385
2026-03-26 22:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982385%27 HTTP/1.1" 200 None
2026-03-26 22:58:55 [ayvens.be] INFO: Scrape type for 1982385: 2
2026-03-26 22:58:55 [ayvens.be] INFO: Extracting data for car ID: 1982385
2026-03-26 22:58:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a6b1966c-b078-5117-a3fc-cee0c2070ee8 with identifier: 1982385
2026-03-26 22:58:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6b1966c-b078-5117-a3fc-cee0c2070ee8 with scrape type 2
2026-03-26 22:58:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a6b1966c-b078-5117-a3fc-cee0c2070ee8 with scrape type 2
2026-03-26 22:58:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a6b1966c-b078-5117-a3fc-cee0c2070ee8, identifier: 1982385
2026-03-26 22:58:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a6b1966c-b078-5117-a3fc-cee0c2070ee8 with identifier: 1982385
2026-03-26 22:58:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a6b1966c-b078-5117-a3fc-cee0c2070ee8 with identifier: 1982385
2026-03-26 22:58:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a6b1966c-b078-5117-a3fc-cee0c2070ee8 with identifier: 1982385 to the API
2026-03-26 22:58:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:58:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:58:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'a6b1966c-b078-5117-a3fc-cee0c2070ee8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'CORSA',
 'odometer': 35992,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL CORSA 1.2 TURBO 74KW S-S ELEGANCE',
 'transmission': 'manual',
 'trim': '1.2 TURBO 74KW S-S ELEGANCE',
 'vin': None,
 'year': 2023}
2026-03-26 22:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982385%27 HTTP/1.1" 200 None
2026-03-26 22:58:55 [ayvens.be] INFO: Saving data for 1982385: {'auction_closing_time': 1774942200.0, 'created_time': 1774478891.17965, 'last_price_update_time': 1774565935.771927}
2026-03-26 22:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982385') HTTP/1.1" 204 0
2026-03-26 22:58:55 [ayvens.be] INFO: Found listing with ID: 1982386
2026-03-26 22:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982386%27 HTTP/1.1" 200 None
2026-03-26 22:58:55 [ayvens.be] INFO: Scrape type for 1982386: 2
2026-03-26 22:58:55 [ayvens.be] INFO: Extracting data for car ID: 1982386
2026-03-26 22:58:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bbd22d27-98be-52d3-b256-0d95b317e4be with identifier: 1982386
2026-03-26 22:58:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bbd22d27-98be-52d3-b256-0d95b317e4be with scrape type 2
2026-03-26 22:58:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bbd22d27-98be-52d3-b256-0d95b317e4be with scrape type 2
2026-03-26 22:58:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: bbd22d27-98be-52d3-b256-0d95b317e4be, identifier: 1982386
2026-03-26 22:58:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: bbd22d27-98be-52d3-b256-0d95b317e4be with identifier: 1982386
2026-03-26 22:58:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: bbd22d27-98be-52d3-b256-0d95b317e4be with identifier: 1982386
2026-03-26 22:58:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: bbd22d27-98be-52d3-b256-0d95b317e4be with identifier: 1982386 to the API
2026-03-26 22:58:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:58:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:58:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'bbd22d27-98be-52d3-b256-0d95b317e4be',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 81619,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 1.5 SDRIVE16D',
 'transmission': 'manual',
 'trim': '1.5 SDRIVE16D',
 'vin': None,
 'year': 2022}
2026-03-26 22:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982386%27 HTTP/1.1" 200 None
2026-03-26 22:58:56 [ayvens.be] INFO: Saving data for 1982386: {'auction_closing_time': 1774942200.0, 'created_time': 1774478895.36424, 'last_price_update_time': 1774565936.153201}
2026-03-26 22:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982386') HTTP/1.1" 204 0
2026-03-26 22:58:56 [ayvens.be] INFO: Found listing with ID: 1982387
2026-03-26 22:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982387%27 HTTP/1.1" 200 None
2026-03-26 22:58:56 [ayvens.be] INFO: Scrape type for 1982387: 2
2026-03-26 22:58:56 [ayvens.be] INFO: Extracting data for car ID: 1982387
2026-03-26 22:58:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 178d2ce4-1420-5197-883e-8acc5a2fadcf with identifier: 1982387
2026-03-26 22:58:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 178d2ce4-1420-5197-883e-8acc5a2fadcf with scrape type 2
2026-03-26 22:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 178d2ce4-1420-5197-883e-8acc5a2fadcf with scrape type 2
2026-03-26 22:58:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 178d2ce4-1420-5197-883e-8acc5a2fadcf, identifier: 1982387
2026-03-26 22:58:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 178d2ce4-1420-5197-883e-8acc5a2fadcf with identifier: 1982387
2026-03-26 22:58:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 178d2ce4-1420-5197-883e-8acc5a2fadcf with identifier: 1982387
2026-03-26 22:58:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 178d2ce4-1420-5197-883e-8acc5a2fadcf with identifier: 1982387 to the API
2026-03-26 22:58:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:58:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:58:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '178d2ce4-1420-5197-883e-8acc5a2fadcf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'ARKANA',
 'odometer': 67305,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT ARKANA 1.6 E-TECH 145 EVOLUTION',
 'transmission': 'automatic',
 'trim': '1.6 E-TECH 145 EVOLUTION',
 'vin': None,
 'year': 2023}
2026-03-26 22:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982387%27 HTTP/1.1" 200 None
2026-03-26 22:58:56 [ayvens.be] INFO: Saving data for 1982387: {'auction_closing_time': 1774942200.0, 'created_time': 1774478920.122697, 'last_price_update_time': 1774565936.521081}
2026-03-26 22:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982387') HTTP/1.1" 204 0
2026-03-26 22:58:56 [ayvens.be] INFO: Found listing with ID: 1982388
2026-03-26 22:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982388%27 HTTP/1.1" 200 None
2026-03-26 22:58:56 [ayvens.be] INFO: Scrape type for 1982388: 2
2026-03-26 22:58:56 [ayvens.be] INFO: Extracting data for car ID: 1982388
2026-03-26 22:58:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c4b137ce-0d50-5531-b5f8-17b4e65f0c5a with identifier: 1982388
2026-03-26 22:58:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4b137ce-0d50-5531-b5f8-17b4e65f0c5a with scrape type 2
2026-03-26 22:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c4b137ce-0d50-5531-b5f8-17b4e65f0c5a with scrape type 2
2026-03-26 22:58:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c4b137ce-0d50-5531-b5f8-17b4e65f0c5a, identifier: 1982388
2026-03-26 22:58:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c4b137ce-0d50-5531-b5f8-17b4e65f0c5a with identifier: 1982388
2026-03-26 22:58:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c4b137ce-0d50-5531-b5f8-17b4e65f0c5a with identifier: 1982388
2026-03-26 22:58:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c4b137ce-0d50-5531-b5f8-17b4e65f0c5a with identifier: 1982388 to the API
2026-03-26 22:58:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:58:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:58:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.9L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'c4b137ce-0d50-5531-b5f8-17b4e65f0c5a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLA',
 'odometer': 147755,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLA 2.0 CLA 200 D DCT BUSINESS SOLUTION',
 'transmission': 'automatic',
 'trim': '2.0 CLA 200 D DCT BUSINESS SOLUTION',
 'vin': None,
 'year': 2021}
2026-03-26 22:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982388%27 HTTP/1.1" 200 None
2026-03-26 22:58:56 [ayvens.be] INFO: Saving data for 1982388: {'auction_closing_time': 1774942200.0, 'created_time': 1774478898.148764, 'last_price_update_time': 1774565936.93798}
2026-03-26 22:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982388') HTTP/1.1" 204 0
2026-03-26 22:58:56 [ayvens.be] INFO: Found listing with ID: 1982389
2026-03-26 22:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982389%27 HTTP/1.1" 200 None
2026-03-26 22:58:56 [ayvens.be] INFO: Scrape type for 1982389: 2
2026-03-26 22:58:56 [ayvens.be] INFO: Extracting data for car ID: 1982389
2026-03-26 22:58:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1cd6e8e0-33bb-5180-b480-aaafa6ba2fa2 with identifier: 1982389
2026-03-26 22:58:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1cd6e8e0-33bb-5180-b480-aaafa6ba2fa2 with scrape type 2
2026-03-26 22:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1cd6e8e0-33bb-5180-b480-aaafa6ba2fa2 with scrape type 2
2026-03-26 22:58:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 1cd6e8e0-33bb-5180-b480-aaafa6ba2fa2, identifier: 1982389
2026-03-26 22:58:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 1cd6e8e0-33bb-5180-b480-aaafa6ba2fa2 with identifier: 1982389
2026-03-26 22:58:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 1cd6e8e0-33bb-5180-b480-aaafa6ba2fa2 with identifier: 1982389
2026-03-26 22:58:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 1cd6e8e0-33bb-5180-b480-aaafa6ba2fa2 with identifier: 1982389 to the API
2026-03-26 22:58:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:58:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:58:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '1cd6e8e0-33bb-5180-b480-aaafa6ba2fa2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLA - Klasse',
 'odometer': 128409,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLA - Klasse 2.0 CLA 200 D BUSINESS SOLUTION LIM DCT',
 'transmission': 'automatic',
 'trim': '2.0 CLA 200 D BUSINESS SOLUTION LIM DCT',
 'vin': None,
 'year': 2021}
2026-03-26 22:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982389%27 HTTP/1.1" 200 None
2026-03-26 22:58:57 [ayvens.be] INFO: Saving data for 1982389: {'auction_closing_time': 1774942200.0, 'created_time': 1774478914.576671, 'last_price_update_time': 1774565937.317766}
2026-03-26 22:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982389') HTTP/1.1" 204 0
2026-03-26 22:58:57 [ayvens.be] INFO: Found listing with ID: 1982390
2026-03-26 22:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982390%27 HTTP/1.1" 200 None
2026-03-26 22:58:57 [ayvens.be] INFO: Scrape type for 1982390: 2
2026-03-26 22:58:57 [ayvens.be] INFO: Extracting data for car ID: 1982390
2026-03-26 22:58:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b34e3e61-ae3d-5000-b57d-5ddcb608b172 with identifier: 1982390
2026-03-26 22:58:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b34e3e61-ae3d-5000-b57d-5ddcb608b172 with scrape type 2
2026-03-26 22:58:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b34e3e61-ae3d-5000-b57d-5ddcb608b172 with scrape type 2
2026-03-26 22:58:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b34e3e61-ae3d-5000-b57d-5ddcb608b172, identifier: 1982390
2026-03-26 22:58:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b34e3e61-ae3d-5000-b57d-5ddcb608b172 with identifier: 1982390
2026-03-26 22:58:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b34e3e61-ae3d-5000-b57d-5ddcb608b172 with identifier: 1982390
2026-03-26 22:58:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b34e3e61-ae3d-5000-b57d-5ddcb608b172 with identifier: 1982390 to the API
2026-03-26 22:58:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:58:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:58:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'electric',
 'id': 'b34e3e61-ae3d-5000-b57d-5ddcb608b172',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'TESLA',
 'model': 'MODEL Y',
 'odometer': 121404,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TESLA MODEL Y BEV 75KWH LONG RANGE AUTO 4WD',
 'transmission': 'automatic',
 'trim': 'BEV 75KWH LONG RANGE AUTO 4WD',
 'vin': None,
 'year': 2022}
2026-03-26 22:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982390%27 HTTP/1.1" 200 None
2026-03-26 22:58:57 [ayvens.be] INFO: Saving data for 1982390: {'auction_closing_time': 1774942200.0, 'created_time': 1774478911.904237, 'last_price_update_time': 1774565937.740543}
2026-03-26 22:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982390') HTTP/1.1" 204 0
2026-03-26 22:58:57 [ayvens.be] INFO: Found listing with ID: 1982391
2026-03-26 22:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982391%27 HTTP/1.1" 200 None
2026-03-26 22:58:57 [ayvens.be] INFO: Scrape type for 1982391: 2
2026-03-26 22:58:57 [ayvens.be] INFO: Extracting data for car ID: 1982391
2026-03-26 22:58:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 80d0d71e-61e4-53aa-8104-89fd0eb13100 with identifier: 1982391
2026-03-26 22:58:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80d0d71e-61e4-53aa-8104-89fd0eb13100 with scrape type 2
2026-03-26 22:58:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 80d0d71e-61e4-53aa-8104-89fd0eb13100 with scrape type 2
2026-03-26 22:58:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 80d0d71e-61e4-53aa-8104-89fd0eb13100, identifier: 1982391
2026-03-26 22:58:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 80d0d71e-61e4-53aa-8104-89fd0eb13100 with identifier: 1982391
2026-03-26 22:58:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 80d0d71e-61e4-53aa-8104-89fd0eb13100 with identifier: 1982391
2026-03-26 22:58:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 80d0d71e-61e4-53aa-8104-89fd0eb13100 with identifier: 1982391 to the API
2026-03-26 22:58:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:58:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:58:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '80d0d71e-61e4-53aa-8104-89fd0eb13100',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'Touran',
 'odometer': 128349,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN Touran 1.0 TSI Highline OPF (EU6.2) STOCK',
 'transmission': 'manual',
 'trim': '1.0 TSI Highline OPF (EU6.2) STOCK',
 'vin': None,
 'year': 2019}
2026-03-26 22:58:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982391%27 HTTP/1.1" 200 None
2026-03-26 22:58:58 [ayvens.be] INFO: Saving data for 1982391: {'auction_closing_time': 1774942200.0, 'created_time': 1774478901.364453, 'last_price_update_time': 1774565938.130158}
2026-03-26 22:58:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982391') HTTP/1.1" 204 0
2026-03-26 22:58:58 [ayvens.be] INFO: Found listing with ID: 1982392
2026-03-26 22:58:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982392%27 HTTP/1.1" 200 None
2026-03-26 22:58:58 [ayvens.be] INFO: Scrape type for 1982392: 2
2026-03-26 22:58:58 [ayvens.be] INFO: Extracting data for car ID: 1982392
2026-03-26 22:58:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4efed24f-a385-57ca-9506-c473184ac7b2 with identifier: 1982392
2026-03-26 22:58:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4efed24f-a385-57ca-9506-c473184ac7b2 with scrape type 2
2026-03-26 22:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4efed24f-a385-57ca-9506-c473184ac7b2 with scrape type 2
2026-03-26 22:58:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 4efed24f-a385-57ca-9506-c473184ac7b2, identifier: 1982392
2026-03-26 22:58:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 4efed24f-a385-57ca-9506-c473184ac7b2 with identifier: 1982392
2026-03-26 22:58:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 4efed24f-a385-57ca-9506-c473184ac7b2 with identifier: 1982392
2026-03-26 22:58:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 4efed24f-a385-57ca-9506-c473184ac7b2 with identifier: 1982392 to the API
2026-03-26 22:58:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:58:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:58:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '4efed24f-a385-57ca-9506-c473184ac7b2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TIGUAN - 2016',
 'odometer': 122796,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN TIGUAN - 2016 1.5 TSI ACT IQ.Drive OPF DSG',
 'transmission': 'automatic',
 'trim': '1.5 TSI ACT IQ.Drive OPF DSG',
 'vin': None,
 'year': 2020}
2026-03-26 22:58:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982392%27 HTTP/1.1" 200 None
2026-03-26 22:58:58 [ayvens.be] INFO: Saving data for 1982392: {'auction_closing_time': 1774942200.0, 'created_time': 1774478902.760937, 'last_price_update_time': 1774565938.495317}
2026-03-26 22:58:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982392') HTTP/1.1" 204 0
2026-03-26 22:58:58 [ayvens.be] INFO: Found listing with ID: 1982393
2026-03-26 22:58:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982393%27 HTTP/1.1" 200 None
2026-03-26 22:58:58 [ayvens.be] INFO: Scrape type for 1982393: 2
2026-03-26 22:58:58 [ayvens.be] INFO: Extracting data for car ID: 1982393
2026-03-26 22:58:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c13cdafa-b2ee-57a4-88ef-f2d298604d46 with identifier: 1982393
2026-03-26 22:58:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c13cdafa-b2ee-57a4-88ef-f2d298604d46 with scrape type 2
2026-03-26 22:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c13cdafa-b2ee-57a4-88ef-f2d298604d46 with scrape type 2
2026-03-26 22:58:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c13cdafa-b2ee-57a4-88ef-f2d298604d46, identifier: 1982393
2026-03-26 22:58:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c13cdafa-b2ee-57a4-88ef-f2d298604d46 with identifier: 1982393
2026-03-26 22:58:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c13cdafa-b2ee-57a4-88ef-f2d298604d46 with identifier: 1982393
2026-03-26 22:58:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c13cdafa-b2ee-57a4-88ef-f2d298604d46 with identifier: 1982393 to the API
2026-03-26 22:58:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:58:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:58:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'c13cdafa-b2ee-57a4-88ef-f2d298604d46',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'FABIA COMBI - 2018',
 'odometer': 131540,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA FABIA COMBI - 2018 1.0 TSI Ambition',
 'transmission': 'manual',
 'trim': '1.0 TSI Ambition',
 'vin': None,
 'year': 2019}
2026-03-26 22:58:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982393%27 HTTP/1.1" 200 None
2026-03-26 22:58:58 [ayvens.be] INFO: Saving data for 1982393: {'auction_closing_time': 1774942200.0, 'created_time': 1774478904.281637, 'last_price_update_time': 1774565938.955065}
2026-03-26 22:58:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982393') HTTP/1.1" 204 0
2026-03-26 22:58:58 [ayvens.be] INFO: Found listing with ID: 1982394
2026-03-26 22:58:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982394%27 HTTP/1.1" 200 None
2026-03-26 22:58:58 [ayvens.be] INFO: Scrape type for 1982394: 2
2026-03-26 22:58:58 [ayvens.be] INFO: Extracting data for car ID: 1982394
2026-03-26 22:58:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 328c7018-685a-5c56-aef3-34cef35012df with identifier: 1982394
2026-03-26 22:58:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 328c7018-685a-5c56-aef3-34cef35012df with scrape type 2
2026-03-26 22:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 328c7018-685a-5c56-aef3-34cef35012df with scrape type 2
2026-03-26 22:58:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 328c7018-685a-5c56-aef3-34cef35012df, identifier: 1982394
2026-03-26 22:58:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 328c7018-685a-5c56-aef3-34cef35012df with identifier: 1982394
2026-03-26 22:58:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 328c7018-685a-5c56-aef3-34cef35012df with identifier: 1982394
2026-03-26 22:58:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 328c7018-685a-5c56-aef3-34cef35012df with identifier: 1982394 to the API
2026-03-26 22:58:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:58:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:58:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '328c7018-685a-5c56-aef3-34cef35012df',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 123308,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 1.5 SDRIVE16D',
 'transmission': 'manual',
 'trim': '1.5 SDRIVE16D',
 'vin': None,
 'year': 2022}
2026-03-26 22:58:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982394%27 HTTP/1.1" 200 None
2026-03-26 22:58:59 [ayvens.be] INFO: Saving data for 1982394: {'auction_closing_time': 1774942200.0, 'created_time': 1774478907.105256, 'last_price_update_time': 1774565939.337855}
2026-03-26 22:58:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982394') HTTP/1.1" 204 0
2026-03-26 22:58:59 [ayvens.be] INFO: Found listing with ID: 1982395
2026-03-26 22:58:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982395%27 HTTP/1.1" 200 None
2026-03-26 22:58:59 [ayvens.be] INFO: Scrape type for 1982395: 2
2026-03-26 22:58:59 [ayvens.be] INFO: Extracting data for car ID: 1982395
2026-03-26 22:58:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 27dd3695-4e0b-5809-85a4-687e95d181bb with identifier: 1982395
2026-03-26 22:58:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27dd3695-4e0b-5809-85a4-687e95d181bb with scrape type 2
2026-03-26 22:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 27dd3695-4e0b-5809-85a4-687e95d181bb with scrape type 2
2026-03-26 22:58:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 27dd3695-4e0b-5809-85a4-687e95d181bb, identifier: 1982395
2026-03-26 22:58:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 27dd3695-4e0b-5809-85a4-687e95d181bb with identifier: 1982395
2026-03-26 22:58:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 27dd3695-4e0b-5809-85a4-687e95d181bb with identifier: 1982395
2026-03-26 22:58:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 27dd3695-4e0b-5809-85a4-687e95d181bb with identifier: 1982395 to the API
2026-03-26 22:58:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:58:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:58:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '27dd3695-4e0b-5809-85a4-687e95d181bb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '3 SERIES BERLINE',
 'odometer': 147027,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3 SERIES BERLINE 2.0 330E (135KW) BERLINE',
 'transmission': 'automatic',
 'trim': '2.0 330E (135KW) BERLINE',
 'vin': None,
 'year': 2021}
2026-03-26 22:58:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982395%27 HTTP/1.1" 200 None
2026-03-26 22:58:59 [ayvens.be] INFO: Saving data for 1982395: {'auction_closing_time': 1774942200.0, 'created_time': 1774478908.503659, 'last_price_update_time': 1774565939.709083}
2026-03-26 22:58:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982395') HTTP/1.1" 204 0
2026-03-26 22:58:59 [ayvens.be] INFO: Found listing with ID: 1982396
2026-03-26 22:58:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:58:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982396%27 HTTP/1.1" 200 None
2026-03-26 22:58:59 [ayvens.be] INFO: Scrape type for 1982396: 2
2026-03-26 22:58:59 [ayvens.be] INFO: Extracting data for car ID: 1982396
2026-03-26 22:58:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b04e2942-b8f6-5cff-9240-2024048ae747 with identifier: 1982396
2026-03-26 22:58:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b04e2942-b8f6-5cff-9240-2024048ae747 with scrape type 2
2026-03-26 22:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b04e2942-b8f6-5cff-9240-2024048ae747 with scrape type 2
2026-03-26 22:58:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b04e2942-b8f6-5cff-9240-2024048ae747, identifier: 1982396
2026-03-26 22:58:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b04e2942-b8f6-5cff-9240-2024048ae747 with identifier: 1982396
2026-03-26 22:58:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b04e2942-b8f6-5cff-9240-2024048ae747 with identifier: 1982396
2026-03-26 22:58:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b04e2942-b8f6-5cff-9240-2024048ae747 with identifier: 1982396 to the API
2026-03-26 22:58:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:58:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'b04e2942-b8f6-5cff-9240-2024048ae747',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 56538,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 1.5 XDRIVE25E PHEV 162KW)',
 'transmission': 'automatic',
 'trim': '1.5 XDRIVE25E PHEV 162KW)',
 'vin': None,
 'year': 2022}
2026-03-26 22:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982396%27 HTTP/1.1" 200 None
2026-03-26 22:59:00 [ayvens.be] INFO: Saving data for 1982396: {'auction_closing_time': 1774942200.0, 'created_time': 1774478911.338866, 'last_price_update_time': 1774565940.097317}
2026-03-26 22:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982396') HTTP/1.1" 204 0
2026-03-26 22:59:00 [ayvens.be] INFO: Found listing with ID: 1982397
2026-03-26 22:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982397%27 HTTP/1.1" 200 None
2026-03-26 22:59:00 [ayvens.be] INFO: Scrape type for 1982397: 2
2026-03-26 22:59:00 [ayvens.be] INFO: Extracting data for car ID: 1982397
2026-03-26 22:59:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45f31c3c-3d1f-5c7e-a872-731aafd2b284 with identifier: 1982397
2026-03-26 22:59:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45f31c3c-3d1f-5c7e-a872-731aafd2b284 with scrape type 2
2026-03-26 22:59:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 45f31c3c-3d1f-5c7e-a872-731aafd2b284 with scrape type 2
2026-03-26 22:59:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 45f31c3c-3d1f-5c7e-a872-731aafd2b284, identifier: 1982397
2026-03-26 22:59:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 45f31c3c-3d1f-5c7e-a872-731aafd2b284 with identifier: 1982397
2026-03-26 22:59:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 45f31c3c-3d1f-5c7e-a872-731aafd2b284 with identifier: 1982397
2026-03-26 22:59:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 45f31c3c-3d1f-5c7e-a872-731aafd2b284 with identifier: 1982397 to the API
2026-03-26 22:59:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 22,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '45f31c3c-3d1f-5c7e-a872-731aafd2b284',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A-CLASS',
 'odometer': 39475,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ A-CLASS 1.3 A 250 E DCT BUSINESS SOLUTION',
 'transmission': 'automatic',
 'trim': '1.3 A 250 E DCT BUSINESS SOLUTION',
 'vin': None,
 'year': 2022}
2026-03-26 22:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982397%27 HTTP/1.1" 200 None
2026-03-26 22:59:00 [ayvens.be] INFO: Saving data for 1982397: {'auction_closing_time': 1774942200.0, 'created_time': 1774478910.222854, 'last_price_update_time': 1774565940.47616}
2026-03-26 22:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982397') HTTP/1.1" 204 0
2026-03-26 22:59:00 [ayvens.be] INFO: Found listing with ID: 1982398
2026-03-26 22:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982398%27 HTTP/1.1" 200 None
2026-03-26 22:59:00 [ayvens.be] INFO: Scrape type for 1982398: 2
2026-03-26 22:59:00 [ayvens.be] INFO: Extracting data for car ID: 1982398
2026-03-26 22:59:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 53c333d1-b709-5396-9cd4-5959711c6956 with identifier: 1982398
2026-03-26 22:59:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53c333d1-b709-5396-9cd4-5959711c6956 with scrape type 2
2026-03-26 22:59:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 53c333d1-b709-5396-9cd4-5959711c6956 with scrape type 2
2026-03-26 22:59:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 53c333d1-b709-5396-9cd4-5959711c6956, identifier: 1982398
2026-03-26 22:59:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 53c333d1-b709-5396-9cd4-5959711c6956 with identifier: 1982398
2026-03-26 22:59:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 53c333d1-b709-5396-9cd4-5959711c6956 with identifier: 1982398
2026-03-26 22:59:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 53c333d1-b709-5396-9cd4-5959711c6956 with identifier: 1982398 to the API
2026-03-26 22:59:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '53c333d1-b709-5396-9cd4-5959711c6956',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A3 SPORTBACK - 2020',
 'odometer': 57899,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A3 SPORTBACK - 2020 35 TFSI Advanced',
 'transmission': 'manual',
 'trim': '35 TFSI Advanced',
 'vin': None,
 'year': 2022}
2026-03-26 22:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982398%27 HTTP/1.1" 200 None
2026-03-26 22:59:00 [ayvens.be] INFO: Saving data for 1982398: {'auction_closing_time': 1774942200.0, 'created_time': 1774478913.283197, 'last_price_update_time': 1774565940.875001}
2026-03-26 22:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982398') HTTP/1.1" 204 0
2026-03-26 22:59:00 [ayvens.be] INFO: Found listing with ID: 1982399
2026-03-26 22:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982399%27 HTTP/1.1" 200 None
2026-03-26 22:59:00 [ayvens.be] INFO: Scrape type for 1982399: 2
2026-03-26 22:59:00 [ayvens.be] INFO: Extracting data for car ID: 1982399
2026-03-26 22:59:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2132b37f-1729-5a11-9802-554987bbc326 with identifier: 1982399
2026-03-26 22:59:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2132b37f-1729-5a11-9802-554987bbc326 with scrape type 2
2026-03-26 22:59:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2132b37f-1729-5a11-9802-554987bbc326 with scrape type 2
2026-03-26 22:59:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 2132b37f-1729-5a11-9802-554987bbc326, identifier: 1982399
2026-03-26 22:59:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 2132b37f-1729-5a11-9802-554987bbc326 with identifier: 1982399
2026-03-26 22:59:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 2132b37f-1729-5a11-9802-554987bbc326 with identifier: 1982399
2026-03-26 22:59:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 2132b37f-1729-5a11-9802-554987bbc326 with identifier: 1982399 to the API
2026-03-26 22:59:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '2132b37f-1729-5a11-9802-554987bbc326',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'LEON ST',
 'odometer': 82590,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT LEON ST 1.0 ETSI 110 MOVE! DSG',
 'transmission': 'automatic',
 'trim': '1.0 ETSI 110 MOVE! DSG',
 'vin': None,
 'year': 2022}
2026-03-26 22:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982399%27 HTTP/1.1" 200 None
2026-03-26 22:59:01 [ayvens.be] INFO: Saving data for 1982399: {'auction_closing_time': 1774942200.0, 'created_time': 1774478915.951199, 'last_price_update_time': 1774565941.234675}
2026-03-26 22:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982399') HTTP/1.1" 204 0
2026-03-26 22:59:01 [ayvens.be] INFO: Found listing with ID: 1982400
2026-03-26 22:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982400%27 HTTP/1.1" 200 None
2026-03-26 22:59:01 [ayvens.be] INFO: Scrape type for 1982400: 2
2026-03-26 22:59:01 [ayvens.be] INFO: Extracting data for car ID: 1982400
2026-03-26 22:59:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 599545e4-b508-5eeb-80b3-1961aaf1d328 with identifier: 1982400
2026-03-26 22:59:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 599545e4-b508-5eeb-80b3-1961aaf1d328 with scrape type 2
2026-03-26 22:59:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 599545e4-b508-5eeb-80b3-1961aaf1d328 with scrape type 2
2026-03-26 22:59:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 599545e4-b508-5eeb-80b3-1961aaf1d328, identifier: 1982400
2026-03-26 22:59:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 599545e4-b508-5eeb-80b3-1961aaf1d328 with identifier: 1982400
2026-03-26 22:59:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 599545e4-b508-5eeb-80b3-1961aaf1d328 with identifier: 1982400
2026-03-26 22:59:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 599545e4-b508-5eeb-80b3-1961aaf1d328 with identifier: 1982400 to the API
2026-03-26 22:59:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '599545e4-b508-5eeb-80b3-1961aaf1d328',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 48354,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 2008 1.2 PURETECH 74KW S-S ACTIVE PACK',
 'transmission': 'manual',
 'trim': '1.2 PURETECH 74KW S-S ACTIVE PACK',
 'vin': None,
 'year': 2022}
2026-03-26 22:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982400%27 HTTP/1.1" 200 None
2026-03-26 22:59:01 [ayvens.be] INFO: Saving data for 1982400: {'auction_closing_time': 1774942200.0, 'created_time': 1774478919.167415, 'last_price_update_time': 1774565941.612397}
2026-03-26 22:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982400') HTTP/1.1" 204 0
2026-03-26 22:59:01 [ayvens.be] INFO: Found listing with ID: 1982401
2026-03-26 22:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982401%27 HTTP/1.1" 200 None
2026-03-26 22:59:01 [ayvens.be] INFO: Scrape type for 1982401: 2
2026-03-26 22:59:01 [ayvens.be] INFO: Extracting data for car ID: 1982401
2026-03-26 22:59:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 16cc5be1-f268-5e3b-abb9-442e4406b2da with identifier: 1982401
2026-03-26 22:59:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 16cc5be1-f268-5e3b-abb9-442e4406b2da with scrape type 2
2026-03-26 22:59:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 16cc5be1-f268-5e3b-abb9-442e4406b2da with scrape type 2
2026-03-26 22:59:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 16cc5be1-f268-5e3b-abb9-442e4406b2da, identifier: 1982401
2026-03-26 22:59:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 16cc5be1-f268-5e3b-abb9-442e4406b2da with identifier: 1982401
2026-03-26 22:59:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 16cc5be1-f268-5e3b-abb9-442e4406b2da with identifier: 1982401
2026-03-26 22:59:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 16cc5be1-f268-5e3b-abb9-442e4406b2da with identifier: 1982401 to the API
2026-03-26 22:59:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '16cc5be1-f268-5e3b-abb9-442e4406b2da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '308',
 'odometer': 47504,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 308 1.2 PURETECH 96KW S-S ACTIVE PACK',
 'transmission': 'manual',
 'trim': '1.2 PURETECH 96KW S-S ACTIVE PACK',
 'vin': None,
 'year': 2023}
2026-03-26 22:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982401%27 HTTP/1.1" 200 None
2026-03-26 22:59:01 [ayvens.be] INFO: Saving data for 1982401: {'auction_closing_time': 1774942200.0, 'created_time': 1774478918.505059, 'last_price_update_time': 1774565941.997372}
2026-03-26 22:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982401') HTTP/1.1" 204 0
2026-03-26 22:59:02 [ayvens.be] INFO: Found listing with ID: 1982402
2026-03-26 22:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982402%27 HTTP/1.1" 200 None
2026-03-26 22:59:02 [ayvens.be] INFO: Scrape type for 1982402: 2
2026-03-26 22:59:02 [ayvens.be] INFO: Extracting data for car ID: 1982402
2026-03-26 22:59:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d4aadd3-e23a-56f6-8c5a-98ebd740c6d1 with identifier: 1982402
2026-03-26 22:59:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d4aadd3-e23a-56f6-8c5a-98ebd740c6d1 with scrape type 2
2026-03-26 22:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9d4aadd3-e23a-56f6-8c5a-98ebd740c6d1 with scrape type 2
2026-03-26 22:59:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 9d4aadd3-e23a-56f6-8c5a-98ebd740c6d1, identifier: 1982402
2026-03-26 22:59:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 9d4aadd3-e23a-56f6-8c5a-98ebd740c6d1 with identifier: 1982402
2026-03-26 22:59:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 9d4aadd3-e23a-56f6-8c5a-98ebd740c6d1 with identifier: 1982402
2026-03-26 22:59:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 9d4aadd3-e23a-56f6-8c5a-98ebd740c6d1 with identifier: 1982402 to the API
2026-03-26 22:59:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 107,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '9d4aadd3-e23a-56f6-8c5a-98ebd740c6d1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1 DIESEL - 2019',
 'odometer': 77696,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 DIESEL - 2019 1.5 d sDrive16 AdBlue',
 'transmission': 'manual',
 'trim': '1.5 d sDrive16 AdBlue',
 'vin': None,
 'year': 2020}
2026-03-26 22:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982402%27 HTTP/1.1" 200 None
2026-03-26 22:59:02 [ayvens.be] INFO: Saving data for 1982402: {'auction_closing_time': 1774942200.0, 'created_time': 1774478921.244205, 'last_price_update_time': 1774565942.375675}
2026-03-26 22:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982402') HTTP/1.1" 204 0
2026-03-26 22:59:02 [ayvens.be] INFO: Found listing with ID: 1982403
2026-03-26 22:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982403%27 HTTP/1.1" 200 None
2026-03-26 22:59:02 [ayvens.be] INFO: Scrape type for 1982403: 2
2026-03-26 22:59:02 [ayvens.be] INFO: Extracting data for car ID: 1982403
2026-03-26 22:59:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 84095232-8b51-51e3-a551-1ababe15656e with identifier: 1982403
2026-03-26 22:59:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84095232-8b51-51e3-a551-1ababe15656e with scrape type 2
2026-03-26 22:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 84095232-8b51-51e3-a551-1ababe15656e with scrape type 2
2026-03-26 22:59:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 84095232-8b51-51e3-a551-1ababe15656e, identifier: 1982403
2026-03-26 22:59:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 84095232-8b51-51e3-a551-1ababe15656e with identifier: 1982403
2026-03-26 22:59:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 84095232-8b51-51e3-a551-1ababe15656e with identifier: 1982403
2026-03-26 22:59:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 84095232-8b51-51e3-a551-1ababe15656e with identifier: 1982403 to the API
2026-03-26 22:59:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '84095232-8b51-51e3-a551-1ababe15656e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'C-CLASS BREAK',
 'odometer': 65360,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ C-CLASS BREAK 2.0 C 300 E PHEV AUTO LUXURY LINE',
 'transmission': 'automatic',
 'trim': '2.0 C 300 E PHEV AUTO LUXURY LINE',
 'vin': None,
 'year': 2023}
2026-03-26 22:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982403%27 HTTP/1.1" 200 None
2026-03-26 22:59:02 [ayvens.be] INFO: Saving data for 1982403: {'auction_closing_time': 1774942200.0, 'created_time': 1774478923.202445, 'last_price_update_time': 1774565942.81665}
2026-03-26 22:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982403') HTTP/1.1" 204 0
2026-03-26 22:59:02 [ayvens.be] INFO: Found listing with ID: 1982404
2026-03-26 22:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982404%27 HTTP/1.1" 200 None
2026-03-26 22:59:02 [ayvens.be] INFO: Scrape type for 1982404: 2
2026-03-26 22:59:02 [ayvens.be] INFO: Extracting data for car ID: 1982404
2026-03-26 22:59:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 27fe8baa-77e9-5ffa-9c7d-b8fc3dc4048a with identifier: 1982404
2026-03-26 22:59:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27fe8baa-77e9-5ffa-9c7d-b8fc3dc4048a with scrape type 2
2026-03-26 22:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 27fe8baa-77e9-5ffa-9c7d-b8fc3dc4048a with scrape type 2
2026-03-26 22:59:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 27fe8baa-77e9-5ffa-9c7d-b8fc3dc4048a, identifier: 1982404
2026-03-26 22:59:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 27fe8baa-77e9-5ffa-9c7d-b8fc3dc4048a with identifier: 1982404
2026-03-26 22:59:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 27fe8baa-77e9-5ffa-9c7d-b8fc3dc4048a with identifier: 1982404
2026-03-26 22:59:03 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 27fe8baa-77e9-5ffa-9c7d-b8fc3dc4048a with identifier: 1982404 to the API
2026-03-26 22:59:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '27fe8baa-77e9-5ffa-9c7d-b8fc3dc4048a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'JAGUAR',
 'model': 'E-PACE',
 'odometer': 121708,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'JAGUAR E-PACE 2.0 D150 R-DYNAMIC AUTO 4WD',
 'transmission': 'automatic',
 'trim': '2.0 D150 R-DYNAMIC AUTO 4WD',
 'vin': None,
 'year': 2020}
2026-03-26 22:59:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982404%27 HTTP/1.1" 200 None
2026-03-26 22:59:03 [ayvens.be] INFO: Saving data for 1982404: {'auction_closing_time': 1774942200.0, 'created_time': 1774478925.03607, 'last_price_update_time': 1774565943.303201}
2026-03-26 22:59:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982404') HTTP/1.1" 204 0
2026-03-26 22:59:03 [ayvens.be] INFO: Found listing with ID: 1982405
2026-03-26 22:59:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982405%27 HTTP/1.1" 200 None
2026-03-26 22:59:03 [ayvens.be] INFO: Scrape type for 1982405: 2
2026-03-26 22:59:03 [ayvens.be] INFO: Extracting data for car ID: 1982405
2026-03-26 22:59:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 70e69321-2ce2-5a6a-9c60-833ed997f9d6 with identifier: 1982405
2026-03-26 22:59:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70e69321-2ce2-5a6a-9c60-833ed997f9d6 with scrape type 2
2026-03-26 22:59:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 70e69321-2ce2-5a6a-9c60-833ed997f9d6 with scrape type 2
2026-03-26 22:59:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 70e69321-2ce2-5a6a-9c60-833ed997f9d6, identifier: 1982405
2026-03-26 22:59:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 70e69321-2ce2-5a6a-9c60-833ed997f9d6 with identifier: 1982405
2026-03-26 22:59:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 70e69321-2ce2-5a6a-9c60-833ed997f9d6 with identifier: 1982405
2026-03-26 22:59:03 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 70e69321-2ce2-5a6a-9c60-833ed997f9d6 with identifier: 1982405 to the API
2026-03-26 22:59:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'electric',
 'id': '70e69321-2ce2-5a6a-9c60-833ed997f9d6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'IX3',
 'odometer': 138884,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW IX3 80KWH AUTO',
 'transmission': 'automatic',
 'trim': '80KWH AUTO',
 'vin': None,
 'year': 2021}
2026-03-26 22:59:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982405%27 HTTP/1.1" 200 None
2026-03-26 22:59:03 [ayvens.be] INFO: Saving data for 1982405: {'auction_closing_time': 1774942200.0, 'created_time': 1774478927.726232, 'last_price_update_time': 1774565943.691317}
2026-03-26 22:59:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982405') HTTP/1.1" 204 0
2026-03-26 22:59:03 [ayvens.be] INFO: Found listing with ID: 1982406
2026-03-26 22:59:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982406%27 HTTP/1.1" 200 None
2026-03-26 22:59:03 [ayvens.be] INFO: Scrape type for 1982406: 2
2026-03-26 22:59:03 [ayvens.be] INFO: Extracting data for car ID: 1982406
2026-03-26 22:59:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e910e974-6374-5dda-9733-e36da3fef1f7 with identifier: 1982406
2026-03-26 22:59:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e910e974-6374-5dda-9733-e36da3fef1f7 with scrape type 2
2026-03-26 22:59:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e910e974-6374-5dda-9733-e36da3fef1f7 with scrape type 2
2026-03-26 22:59:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e910e974-6374-5dda-9733-e36da3fef1f7, identifier: 1982406
2026-03-26 22:59:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e910e974-6374-5dda-9733-e36da3fef1f7 with identifier: 1982406
2026-03-26 22:59:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e910e974-6374-5dda-9733-e36da3fef1f7 with identifier: 1982406
2026-03-26 22:59:03 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e910e974-6374-5dda-9733-e36da3fef1f7 with identifier: 1982406 to the API
2026-03-26 22:59:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'e910e974-6374-5dda-9733-e36da3fef1f7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 140783,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 1.5 SDRIVE18I (100KW)',
 'transmission': 'manual',
 'trim': '1.5 SDRIVE18I (100KW)',
 'vin': None,
 'year': 2021}
2026-03-26 22:59:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982406%27 HTTP/1.1" 200 None
2026-03-26 22:59:04 [ayvens.be] INFO: Saving data for 1982406: {'auction_closing_time': 1774942200.0, 'created_time': 1774478930.448604, 'last_price_update_time': 1774565944.06159}
2026-03-26 22:59:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982406') HTTP/1.1" 204 0
2026-03-26 22:59:04 [ayvens.be] INFO: Found listing with ID: 1982407
2026-03-26 22:59:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982407%27 HTTP/1.1" 200 None
2026-03-26 22:59:04 [ayvens.be] INFO: Scrape type for 1982407: 2
2026-03-26 22:59:04 [ayvens.be] INFO: Extracting data for car ID: 1982407
2026-03-26 22:59:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c619667-3703-5ceb-a897-1306aca506b1 with identifier: 1982407
2026-03-26 22:59:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c619667-3703-5ceb-a897-1306aca506b1 with scrape type 2
2026-03-26 22:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5c619667-3703-5ceb-a897-1306aca506b1 with scrape type 2
2026-03-26 22:59:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 5c619667-3703-5ceb-a897-1306aca506b1, identifier: 1982407
2026-03-26 22:59:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 5c619667-3703-5ceb-a897-1306aca506b1 with identifier: 1982407
2026-03-26 22:59:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 5c619667-3703-5ceb-a897-1306aca506b1 with identifier: 1982407
2026-03-26 22:59:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 5c619667-3703-5ceb-a897-1306aca506b1 with identifier: 1982407 to the API
2026-03-26 22:59:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '5c619667-3703-5ceb-a897-1306aca506b1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'V60',
 'odometer': 129057,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO V60 2.0 D3 MOMENTUM CORE',
 'transmission': 'manual',
 'trim': '2.0 D3 MOMENTUM CORE',
 'vin': None,
 'year': 2021}
2026-03-26 22:59:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982407%27 HTTP/1.1" 200 None
2026-03-26 22:59:04 [ayvens.be] INFO: Saving data for 1982407: {'auction_closing_time': 1774942200.0, 'created_time': 1774478932.938344, 'last_price_update_time': 1774565944.431644}
2026-03-26 22:59:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982407') HTTP/1.1" 204 0
2026-03-26 22:59:04 [ayvens.be] INFO: Found listing with ID: 1982408
2026-03-26 22:59:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982408%27 HTTP/1.1" 200 None
2026-03-26 22:59:04 [ayvens.be] INFO: Scrape type for 1982408: 2
2026-03-26 22:59:04 [ayvens.be] INFO: Extracting data for car ID: 1982408
2026-03-26 22:59:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d1052ef-ada9-538b-848f-e28c0c901c0e with identifier: 1982408
2026-03-26 22:59:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d1052ef-ada9-538b-848f-e28c0c901c0e with scrape type 2
2026-03-26 22:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2d1052ef-ada9-538b-848f-e28c0c901c0e with scrape type 2
2026-03-26 22:59:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 2d1052ef-ada9-538b-848f-e28c0c901c0e, identifier: 1982408
2026-03-26 22:59:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 2d1052ef-ada9-538b-848f-e28c0c901c0e with identifier: 1982408
2026-03-26 22:59:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 2d1052ef-ada9-538b-848f-e28c0c901c0e with identifier: 1982408
2026-03-26 22:59:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 2d1052ef-ada9-538b-848f-e28c0c901c0e with identifier: 1982408 to the API
2026-03-26 22:59:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'electric',
 'id': '2d1052ef-ada9-538b-848f-e28c0c901c0e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'TESLA',
 'model': 'MODEL Y',
 'odometer': 140135,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-04-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TESLA MODEL Y BEV AUTO RWD',
 'transmission': 'automatic',
 'trim': 'BEV AUTO RWD',
 'vin': None,
 'year': 2023}
2026-03-26 22:59:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982408%27 HTTP/1.1" 200 None
2026-03-26 22:59:04 [ayvens.be] INFO: Saving data for 1982408: {'auction_closing_time': 1774942200.0, 'created_time': 1774478942.469826, 'last_price_update_time': 1774565944.802181}
2026-03-26 22:59:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982408') HTTP/1.1" 204 0
2026-03-26 22:59:04 [ayvens.be] INFO: Found listing with ID: 1982409
2026-03-26 22:59:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982409%27 HTTP/1.1" 200 None
2026-03-26 22:59:04 [ayvens.be] INFO: Scrape type for 1982409: 2
2026-03-26 22:59:04 [ayvens.be] INFO: Extracting data for car ID: 1982409
2026-03-26 22:59:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 328bbf9e-7c19-5f79-ad3e-88f11e2a78b0 with identifier: 1982409
2026-03-26 22:59:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 328bbf9e-7c19-5f79-ad3e-88f11e2a78b0 with scrape type 2
2026-03-26 22:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 328bbf9e-7c19-5f79-ad3e-88f11e2a78b0 with scrape type 2
2026-03-26 22:59:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 328bbf9e-7c19-5f79-ad3e-88f11e2a78b0, identifier: 1982409
2026-03-26 22:59:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 328bbf9e-7c19-5f79-ad3e-88f11e2a78b0 with identifier: 1982409
2026-03-26 22:59:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 328bbf9e-7c19-5f79-ad3e-88f11e2a78b0 with identifier: 1982409
2026-03-26 22:59:05 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 328bbf9e-7c19-5f79-ad3e-88f11e2a78b0 with identifier: 1982409 to the API
2026-03-26 22:59:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '328bbf9e-7c19-5f79-ad3e-88f11e2a78b0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'S60 - 2019',
 'odometer': 130116,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO S60 - 2019 2.0 T8 AWD PHEV Inscription',
 'transmission': 'automatic',
 'trim': '2.0 T8 AWD PHEV Inscription',
 'vin': None,
 'year': 2020}
2026-03-26 22:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982409%27 HTTP/1.1" 200 None
2026-03-26 22:59:05 [ayvens.be] INFO: Saving data for 1982409: {'auction_closing_time': 1774942200.0, 'created_time': 1774478941.858141, 'last_price_update_time': 1774565945.207647}
2026-03-26 22:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982409') HTTP/1.1" 204 0
2026-03-26 22:59:05 [ayvens.be] INFO: Found listing with ID: 1982410
2026-03-26 22:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982410%27 HTTP/1.1" 200 None
2026-03-26 22:59:05 [ayvens.be] INFO: Scrape type for 1982410: 2
2026-03-26 22:59:05 [ayvens.be] INFO: Extracting data for car ID: 1982410
2026-03-26 22:59:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 780346eb-a86a-53fd-99c7-cbd67cdb7646 with identifier: 1982410
2026-03-26 22:59:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 780346eb-a86a-53fd-99c7-cbd67cdb7646 with scrape type 2
2026-03-26 22:59:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 780346eb-a86a-53fd-99c7-cbd67cdb7646 with scrape type 2
2026-03-26 22:59:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 780346eb-a86a-53fd-99c7-cbd67cdb7646, identifier: 1982410
2026-03-26 22:59:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 780346eb-a86a-53fd-99c7-cbd67cdb7646 with identifier: 1982410
2026-03-26 22:59:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 780346eb-a86a-53fd-99c7-cbd67cdb7646 with identifier: 1982410
2026-03-26 22:59:05 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 780346eb-a86a-53fd-99c7-cbd67cdb7646 with identifier: 1982410 to the API
2026-03-26 22:59:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '780346eb-a86a-53fd-99c7-cbd67cdb7646',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3',
 'odometer': 127744,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 2.0 35 TDI S TRONIC BUSINESS EDITION',
 'transmission': 'automatic',
 'trim': '2.0 35 TDI S TRONIC BUSINESS EDITION',
 'vin': None,
 'year': 2021}
2026-03-26 22:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982410%27 HTTP/1.1" 200 None
2026-03-26 22:59:05 [ayvens.be] INFO: Saving data for 1982410: {'auction_closing_time': 1774942200.0, 'created_time': 1774478940.548088, 'last_price_update_time': 1774565945.683817}
2026-03-26 22:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982410') HTTP/1.1" 204 0
2026-03-26 22:59:05 [ayvens.be] INFO: Found listing with ID: 1982411
2026-03-26 22:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982411%27 HTTP/1.1" 200 None
2026-03-26 22:59:05 [ayvens.be] INFO: Scrape type for 1982411: 2
2026-03-26 22:59:05 [ayvens.be] INFO: Extracting data for car ID: 1982411
2026-03-26 22:59:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa9b692c-89e8-5265-a8a8-58748501fb04 with identifier: 1982411
2026-03-26 22:59:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa9b692c-89e8-5265-a8a8-58748501fb04 with scrape type 2
2026-03-26 22:59:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fa9b692c-89e8-5265-a8a8-58748501fb04 with scrape type 2
2026-03-26 22:59:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: fa9b692c-89e8-5265-a8a8-58748501fb04, identifier: 1982411
2026-03-26 22:59:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: fa9b692c-89e8-5265-a8a8-58748501fb04 with identifier: 1982411
2026-03-26 22:59:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: fa9b692c-89e8-5265-a8a8-58748501fb04 with identifier: 1982411
2026-03-26 22:59:05 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: fa9b692c-89e8-5265-a8a8-58748501fb04 with identifier: 1982411 to the API
2026-03-26 22:59:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'fa9b692c-89e8-5265-a8a8-58748501fb04',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q5 DIESEL - 2017',
 'odometer': 124159,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q5 DIESEL - 2017 30 TDi Business Edition S tronic',
 'transmission': 'automatic',
 'trim': '30 TDi Business Edition S tronic',
 'vin': None,
 'year': 2021}
2026-03-26 22:59:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982411%27 HTTP/1.1" 200 None
2026-03-26 22:59:06 [ayvens.be] INFO: Saving data for 1982411: {'auction_closing_time': 1774942200.0, 'created_time': 1774478937.027585, 'last_price_update_time': 1774565946.073393}
2026-03-26 22:59:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982411') HTTP/1.1" 204 0
2026-03-26 22:59:06 [ayvens.be] INFO: Found listing with ID: 1982412
2026-03-26 22:59:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982412%27 HTTP/1.1" 200 None
2026-03-26 22:59:06 [ayvens.be] INFO: Scrape type for 1982412: 2
2026-03-26 22:59:06 [ayvens.be] INFO: Extracting data for car ID: 1982412
2026-03-26 22:59:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eca083a9-7be3-5cf8-b5bc-2102e83d9845 with identifier: 1982412
2026-03-26 22:59:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eca083a9-7be3-5cf8-b5bc-2102e83d9845 with scrape type 2
2026-03-26 22:59:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eca083a9-7be3-5cf8-b5bc-2102e83d9845 with scrape type 2
2026-03-26 22:59:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: eca083a9-7be3-5cf8-b5bc-2102e83d9845, identifier: 1982412
2026-03-26 22:59:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: eca083a9-7be3-5cf8-b5bc-2102e83d9845 with identifier: 1982412
2026-03-26 22:59:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: eca083a9-7be3-5cf8-b5bc-2102e83d9845 with identifier: 1982412
2026-03-26 22:59:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: eca083a9-7be3-5cf8-b5bc-2102e83d9845 with identifier: 1982412 to the API
2026-03-26 22:59:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'eca083a9-7be3-5cf8-b5bc-2102e83d9845',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'Trafic',
 'odometer': 64508,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-02',
 'seats_number': 3,
 'seller_name': None,
 'title': 'RENAULT Trafic 1.6 dCi 29 L1H1 Grand Confort STOCK',
 'transmission': 'manual',
 'trim': '1.6 dCi 29 L1H1 Grand Confort STOCK',
 'vin': None,
 'year': 2019}
2026-03-26 22:59:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982412%27 HTTP/1.1" 200 None
2026-03-26 22:59:06 [ayvens.be] INFO: Saving data for 1982412: {'auction_closing_time': 1774942200.0, 'created_time': 1774478939.530747, 'last_price_update_time': 1774565946.458506}
2026-03-26 22:59:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982412') HTTP/1.1" 204 0
2026-03-26 22:59:06 [ayvens.be] INFO: Found listing with ID: 1982413
2026-03-26 22:59:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982413%27 HTTP/1.1" 200 None
2026-03-26 22:59:06 [ayvens.be] INFO: Scrape type for 1982413: 2
2026-03-26 22:59:06 [ayvens.be] INFO: Extracting data for car ID: 1982413
2026-03-26 22:59:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2cba5fde-1672-50fe-b5a0-858d155d4385 with identifier: 1982413
2026-03-26 22:59:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2cba5fde-1672-50fe-b5a0-858d155d4385 with scrape type 2
2026-03-26 22:59:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2cba5fde-1672-50fe-b5a0-858d155d4385 with scrape type 2
2026-03-26 22:59:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 2cba5fde-1672-50fe-b5a0-858d155d4385, identifier: 1982413
2026-03-26 22:59:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 2cba5fde-1672-50fe-b5a0-858d155d4385 with identifier: 1982413
2026-03-26 22:59:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 2cba5fde-1672-50fe-b5a0-858d155d4385 with identifier: 1982413
2026-03-26 22:59:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 2cba5fde-1672-50fe-b5a0-858d155d4385 with identifier: 1982413 to the API
2026-03-26 22:59:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '2cba5fde-1672-50fe-b5a0-858d155d4385',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'CITROAu2039N',
 'model': 'C3 AIRCROSS',
 'odometer': 43054,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROAu2039N C3 AIRCROSS 1.2 PURETECH 110 S&S SHINE',
 'transmission': 'manual',
 'trim': '1.2 PURETECH 110 S&S SHINE',
 'vin': None,
 'year': 2022}
2026-03-26 22:59:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982413%27 HTTP/1.1" 200 None
2026-03-26 22:59:06 [ayvens.be] INFO: Saving data for 1982413: {'auction_closing_time': 1774942200.0, 'created_time': 1774478938.804357, 'last_price_update_time': 1774565946.828863}
2026-03-26 22:59:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982413') HTTP/1.1" 204 0
2026-03-26 22:59:06 [ayvens.be] INFO: Found listing with ID: 1982414
2026-03-26 22:59:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982414%27 HTTP/1.1" 200 None
2026-03-26 22:59:06 [ayvens.be] INFO: Scrape type for 1982414: 2
2026-03-26 22:59:06 [ayvens.be] INFO: Extracting data for car ID: 1982414
2026-03-26 22:59:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a3a18270-df83-5ed1-9fcc-5a876d1d24c1 with identifier: 1982414
2026-03-26 22:59:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3a18270-df83-5ed1-9fcc-5a876d1d24c1 with scrape type 2
2026-03-26 22:59:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a3a18270-df83-5ed1-9fcc-5a876d1d24c1 with scrape type 2
2026-03-26 22:59:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a3a18270-df83-5ed1-9fcc-5a876d1d24c1, identifier: 1982414
2026-03-26 22:59:06 [scrapy.extensions.logstats] INFO: Crawled 8 pages (at 0 pages/min), scraped 556 items (at 101 items/min)
2026-03-26 22:59:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 182MiB
2026-03-26 22:59:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a3a18270-df83-5ed1-9fcc-5a876d1d24c1 with identifier: 1982414
2026-03-26 22:59:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a3a18270-df83-5ed1-9fcc-5a876d1d24c1 with identifier: 1982414
2026-03-26 22:59:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a3a18270-df83-5ed1-9fcc-5a876d1d24c1 with identifier: 1982414 to the API
2026-03-26 22:59:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'electric',
 'id': 'a3a18270-df83-5ed1-9fcc-5a876d1d24c1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'TESLA',
 'model': 'MODEL S',
 'odometer': 49783,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-07-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TESLA MODEL S BEV ALL-WHEEL DRIVE AUTO',
 'transmission': 'automatic',
 'trim': 'BEV ALL-WHEEL DRIVE AUTO',
 'vin': None,
 'year': 2024}
2026-03-26 22:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982414%27 HTTP/1.1" 200 None
2026-03-26 22:59:07 [ayvens.be] INFO: Saving data for 1982414: {'auction_closing_time': 1774942200.0, 'created_time': 1774478941.505813, 'last_price_update_time': 1774565947.191489}
2026-03-26 22:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982414') HTTP/1.1" 204 0
2026-03-26 22:59:07 [ayvens.be] INFO: Found listing with ID: 1982415
2026-03-26 22:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982415%27 HTTP/1.1" 200 None
2026-03-26 22:59:07 [ayvens.be] INFO: Scrape type for 1982415: 2
2026-03-26 22:59:07 [ayvens.be] INFO: Extracting data for car ID: 1982415
2026-03-26 22:59:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7b1f6a0-d8dc-5edf-a409-1d12080bf074 with identifier: 1982415
2026-03-26 22:59:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7b1f6a0-d8dc-5edf-a409-1d12080bf074 with scrape type 2
2026-03-26 22:59:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b7b1f6a0-d8dc-5edf-a409-1d12080bf074 with scrape type 2
2026-03-26 22:59:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b7b1f6a0-d8dc-5edf-a409-1d12080bf074, identifier: 1982415
2026-03-26 22:59:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b7b1f6a0-d8dc-5edf-a409-1d12080bf074 with identifier: 1982415
2026-03-26 22:59:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b7b1f6a0-d8dc-5edf-a409-1d12080bf074 with identifier: 1982415
2026-03-26 22:59:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b7b1f6a0-d8dc-5edf-a409-1d12080bf074 with identifier: 1982415 to the API
2026-03-26 22:59:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'b7b1f6a0-d8dc-5edf-a409-1d12080bf074',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '1 SERIES HATCH',
 'odometer': 47670,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1 SERIES HATCH 1.5 118I (100KW)',
 'transmission': 'manual',
 'trim': '1.5 118I (100KW)',
 'vin': None,
 'year': 2021}
2026-03-26 22:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982415%27 HTTP/1.1" 200 None
2026-03-26 22:59:07 [ayvens.be] INFO: Saving data for 1982415: {'auction_closing_time': 1774942200.0, 'created_time': 1774478945.199929, 'last_price_update_time': 1774565947.656626}
2026-03-26 22:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982415') HTTP/1.1" 204 0
2026-03-26 22:59:07 [ayvens.be] INFO: Found listing with ID: 1982416
2026-03-26 22:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982416%27 HTTP/1.1" 200 None
2026-03-26 22:59:07 [ayvens.be] INFO: Scrape type for 1982416: 2
2026-03-26 22:59:07 [ayvens.be] INFO: Extracting data for car ID: 1982416
2026-03-26 22:59:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aff5731d-2d02-541f-82f9-3cbff49e8496 with identifier: 1982416
2026-03-26 22:59:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aff5731d-2d02-541f-82f9-3cbff49e8496 with scrape type 2
2026-03-26 22:59:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aff5731d-2d02-541f-82f9-3cbff49e8496 with scrape type 2
2026-03-26 22:59:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: aff5731d-2d02-541f-82f9-3cbff49e8496, identifier: 1982416
2026-03-26 22:59:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: aff5731d-2d02-541f-82f9-3cbff49e8496 with identifier: 1982416
2026-03-26 22:59:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: aff5731d-2d02-541f-82f9-3cbff49e8496 with identifier: 1982416
2026-03-26 22:59:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: aff5731d-2d02-541f-82f9-3cbff49e8496 with identifier: 1982416 to the API
2026-03-26 22:59:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'aff5731d-2d02-541f-82f9-3cbff49e8496',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '1 SERIES HATCH',
 'odometer': 62724,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1 SERIES HATCH 1.5 118I (100KW)',
 'transmission': 'manual',
 'trim': '1.5 118I (100KW)',
 'vin': None,
 'year': 2021}
2026-03-26 22:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982416%27 HTTP/1.1" 200 None
2026-03-26 22:59:08 [ayvens.be] INFO: Saving data for 1982416: {'auction_closing_time': 1774942200.0, 'created_time': 1774478946.803706, 'last_price_update_time': 1774565948.043303}
2026-03-26 22:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982416') HTTP/1.1" 204 0
2026-03-26 22:59:08 [ayvens.be] INFO: Found listing with ID: 1982417
2026-03-26 22:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982417%27 HTTP/1.1" 200 None
2026-03-26 22:59:08 [ayvens.be] INFO: Scrape type for 1982417: 2
2026-03-26 22:59:08 [ayvens.be] INFO: Extracting data for car ID: 1982417
2026-03-26 22:59:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4139ed62-7b28-5253-bc5c-ace461473fc1 with identifier: 1982417
2026-03-26 22:59:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4139ed62-7b28-5253-bc5c-ace461473fc1 with scrape type 2
2026-03-26 22:59:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4139ed62-7b28-5253-bc5c-ace461473fc1 with scrape type 2
2026-03-26 22:59:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 4139ed62-7b28-5253-bc5c-ace461473fc1, identifier: 1982417
2026-03-26 22:59:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 4139ed62-7b28-5253-bc5c-ace461473fc1 with identifier: 1982417
2026-03-26 22:59:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 4139ed62-7b28-5253-bc5c-ace461473fc1 with identifier: 1982417
2026-03-26 22:59:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 4139ed62-7b28-5253-bc5c-ace461473fc1 with identifier: 1982417 to the API
2026-03-26 22:59:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '4139ed62-7b28-5253-bc5c-ace461473fc1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'Clio',
 'odometer': 62348,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT Clio 1.0 TCE 100 CORPORATE EDITION',
 'transmission': 'manual',
 'trim': '1.0 TCE 100 CORPORATE EDITION',
 'vin': None,
 'year': 2020}
2026-03-26 22:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982417%27 HTTP/1.1" 200 None
2026-03-26 22:59:08 [ayvens.be] INFO: Saving data for 1982417: {'auction_closing_time': 1774942200.0, 'created_time': 1774478950.27522, 'last_price_update_time': 1774565948.431542}
2026-03-26 22:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982417') HTTP/1.1" 204 0
2026-03-26 22:59:08 [ayvens.be] INFO: Found listing with ID: 1982418
2026-03-26 22:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982418%27 HTTP/1.1" 200 None
2026-03-26 22:59:08 [ayvens.be] INFO: Scrape type for 1982418: 2
2026-03-26 22:59:08 [ayvens.be] INFO: Extracting data for car ID: 1982418
2026-03-26 22:59:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 28b481e7-4718-5df7-90aa-83f2fdf704b5 with identifier: 1982418
2026-03-26 22:59:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28b481e7-4718-5df7-90aa-83f2fdf704b5 with scrape type 2
2026-03-26 22:59:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 28b481e7-4718-5df7-90aa-83f2fdf704b5 with scrape type 2
2026-03-26 22:59:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 28b481e7-4718-5df7-90aa-83f2fdf704b5, identifier: 1982418
2026-03-26 22:59:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 28b481e7-4718-5df7-90aa-83f2fdf704b5 with identifier: 1982418
2026-03-26 22:59:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 28b481e7-4718-5df7-90aa-83f2fdf704b5 with identifier: 1982418
2026-03-26 22:59:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 28b481e7-4718-5df7-90aa-83f2fdf704b5 with identifier: 1982418 to the API
2026-03-26 22:59:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '28b481e7-4718-5df7-90aa-83f2fdf704b5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3 Sportback',
 'odometer': 35405,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 Sportback 1.4 45 TFSI E S TRONIC S LINE',
 'transmission': 'automatic',
 'trim': '1.4 45 TFSI E S TRONIC S LINE',
 'vin': None,
 'year': 2022}
2026-03-26 22:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982418%27 HTTP/1.1" 200 None
2026-03-26 22:59:08 [ayvens.be] INFO: Saving data for 1982418: {'auction_closing_time': 1774942200.0, 'created_time': 1774478949.914022, 'last_price_update_time': 1774565948.842918}
2026-03-26 22:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982418') HTTP/1.1" 204 0
2026-03-26 22:59:08 [ayvens.be] INFO: Found listing with ID: 1982419
2026-03-26 22:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982419%27 HTTP/1.1" 200 None
2026-03-26 22:59:08 [ayvens.be] INFO: Scrape type for 1982419: 2
2026-03-26 22:59:08 [ayvens.be] INFO: Extracting data for car ID: 1982419
2026-03-26 22:59:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 667dd1e2-a658-5df0-b59d-4f13d7fb61a6 with identifier: 1982419
2026-03-26 22:59:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 667dd1e2-a658-5df0-b59d-4f13d7fb61a6 with scrape type 2
2026-03-26 22:59:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 667dd1e2-a658-5df0-b59d-4f13d7fb61a6 with scrape type 2
2026-03-26 22:59:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 667dd1e2-a658-5df0-b59d-4f13d7fb61a6, identifier: 1982419
2026-03-26 22:59:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 667dd1e2-a658-5df0-b59d-4f13d7fb61a6 with identifier: 1982419
2026-03-26 22:59:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 667dd1e2-a658-5df0-b59d-4f13d7fb61a6 with identifier: 1982419
2026-03-26 22:59:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 667dd1e2-a658-5df0-b59d-4f13d7fb61a6 with identifier: 1982419 to the API
2026-03-26 22:59:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '667dd1e2-a658-5df0-b59d-4f13d7fb61a6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Focus',
 'odometer': 74873,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD Focus 1.0I ECOBOOST 74KW CONNECTED',
 'transmission': 'manual',
 'trim': '1.0I ECOBOOST 74KW CONNECTED',
 'vin': None,
 'year': 2021}
2026-03-26 22:59:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982419%27 HTTP/1.1" 200 None
2026-03-26 22:59:09 [ayvens.be] INFO: Saving data for 1982419: {'auction_closing_time': 1774942200.0, 'created_time': 1774478955.18062, 'last_price_update_time': 1774565949.290688}
2026-03-26 22:59:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982419') HTTP/1.1" 204 0
2026-03-26 22:59:09 [ayvens.be] INFO: Found listing with ID: 1982420
2026-03-26 22:59:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982420%27 HTTP/1.1" 200 None
2026-03-26 22:59:09 [ayvens.be] INFO: Scrape type for 1982420: 2
2026-03-26 22:59:09 [ayvens.be] INFO: Extracting data for car ID: 1982420
2026-03-26 22:59:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd93bbc2-8fc6-58aa-bd77-ab39fbf7acff with identifier: 1982420
2026-03-26 22:59:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd93bbc2-8fc6-58aa-bd77-ab39fbf7acff with scrape type 2
2026-03-26 22:59:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fd93bbc2-8fc6-58aa-bd77-ab39fbf7acff with scrape type 2
2026-03-26 22:59:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: fd93bbc2-8fc6-58aa-bd77-ab39fbf7acff, identifier: 1982420
2026-03-26 22:59:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: fd93bbc2-8fc6-58aa-bd77-ab39fbf7acff with identifier: 1982420
2026-03-26 22:59:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: fd93bbc2-8fc6-58aa-bd77-ab39fbf7acff with identifier: 1982420
2026-03-26 22:59:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: fd93bbc2-8fc6-58aa-bd77-ab39fbf7acff with identifier: 1982420 to the API
2026-03-26 22:59:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'fd93bbc2-8fc6-58aa-bd77-ab39fbf7acff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'KAROQ',
 'odometer': 121821,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA KAROQ 2.0 CRTDI 85KW DSG7 CLEVER',
 'transmission': 'automatic',
 'trim': '2.0 CRTDI 85KW DSG7 CLEVER',
 'vin': None,
 'year': 2021}
2026-03-26 22:59:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982420%27 HTTP/1.1" 200 None
2026-03-26 22:59:09 [ayvens.be] INFO: Saving data for 1982420: {'auction_closing_time': 1774942200.0, 'created_time': 1774478953.595732, 'last_price_update_time': 1774565949.655728}
2026-03-26 22:59:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982420') HTTP/1.1" 204 0
2026-03-26 22:59:09 [ayvens.be] INFO: Found listing with ID: 1982421
2026-03-26 22:59:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982421%27 HTTP/1.1" 200 None
2026-03-26 22:59:09 [ayvens.be] INFO: Scrape type for 1982421: 2
2026-03-26 22:59:09 [ayvens.be] INFO: Extracting data for car ID: 1982421
2026-03-26 22:59:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82a0a085-2c82-5c07-9ec5-ee5f85858273 with identifier: 1982421
2026-03-26 22:59:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82a0a085-2c82-5c07-9ec5-ee5f85858273 with scrape type 2
2026-03-26 22:59:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 82a0a085-2c82-5c07-9ec5-ee5f85858273 with scrape type 2
2026-03-26 22:59:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 82a0a085-2c82-5c07-9ec5-ee5f85858273, identifier: 1982421
2026-03-26 22:59:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 82a0a085-2c82-5c07-9ec5-ee5f85858273 with identifier: 1982421
2026-03-26 22:59:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 82a0a085-2c82-5c07-9ec5-ee5f85858273 with identifier: 1982421
2026-03-26 22:59:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 82a0a085-2c82-5c07-9ec5-ee5f85858273 with identifier: 1982421 to the API
2026-03-26 22:59:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '82a0a085-2c82-5c07-9ec5-ee5f85858273',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '508',
 'odometer': 152919,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 508 1.2 PURETECH 130 S&S AUTO GT',
 'transmission': 'automatic',
 'trim': '1.2 PURETECH 130 S&S AUTO GT',
 'vin': None,
 'year': 2022}
2026-03-26 22:59:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982421%27 HTTP/1.1" 200 None
2026-03-26 22:59:10 [ayvens.be] INFO: Saving data for 1982421: {'auction_closing_time': 1774942200.0, 'created_time': 1774478956.306955, 'last_price_update_time': 1774565950.037099}
2026-03-26 22:59:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982421') HTTP/1.1" 204 0
2026-03-26 22:59:10 [ayvens.be] INFO: Found listing with ID: 1982422
2026-03-26 22:59:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982422%27 HTTP/1.1" 200 None
2026-03-26 22:59:10 [ayvens.be] INFO: Scrape type for 1982422: 2
2026-03-26 22:59:10 [ayvens.be] INFO: Extracting data for car ID: 1982422
2026-03-26 22:59:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de54aad0-1892-529e-8816-f49bbdf46b03 with identifier: 1982422
2026-03-26 22:59:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de54aad0-1892-529e-8816-f49bbdf46b03 with scrape type 2
2026-03-26 22:59:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item de54aad0-1892-529e-8816-f49bbdf46b03 with scrape type 2
2026-03-26 22:59:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: de54aad0-1892-529e-8816-f49bbdf46b03, identifier: 1982422
2026-03-26 22:59:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: de54aad0-1892-529e-8816-f49bbdf46b03 with identifier: 1982422
2026-03-26 22:59:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: de54aad0-1892-529e-8816-f49bbdf46b03 with identifier: 1982422
2026-03-26 22:59:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: de54aad0-1892-529e-8816-f49bbdf46b03 with identifier: 1982422 to the API
2026-03-26 22:59:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'de54aad0-1892-529e-8816-f49bbdf46b03',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A3 SPORTBACK',
 'odometer': 143478,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A3 SPORTBACK 2.0 35 TDI 110KW S TRONIC BUSINESS EDIT.',
 'transmission': 'automatic',
 'trim': '2.0 35 TDI 110KW S TRONIC BUSINESS EDIT.',
 'vin': None,
 'year': 2021}
2026-03-26 22:59:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982422%27 HTTP/1.1" 200 None
2026-03-26 22:59:10 [ayvens.be] INFO: Saving data for 1982422: {'auction_closing_time': 1774942200.0, 'created_time': 1774478958.688205, 'last_price_update_time': 1774565950.553031}
2026-03-26 22:59:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982422') HTTP/1.1" 204 0
2026-03-26 22:59:10 [ayvens.be] INFO: Found listing with ID: 1982423
2026-03-26 22:59:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982423%27 HTTP/1.1" 200 None
2026-03-26 22:59:10 [ayvens.be] INFO: Scrape type for 1982423: 2
2026-03-26 22:59:10 [ayvens.be] INFO: Extracting data for car ID: 1982423
2026-03-26 22:59:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8cacb26c-0ca3-50ba-bd38-cb41d7fd3322 with identifier: 1982423
2026-03-26 22:59:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8cacb26c-0ca3-50ba-bd38-cb41d7fd3322 with scrape type 2
2026-03-26 22:59:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8cacb26c-0ca3-50ba-bd38-cb41d7fd3322 with scrape type 2
2026-03-26 22:59:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 8cacb26c-0ca3-50ba-bd38-cb41d7fd3322, identifier: 1982423
2026-03-26 22:59:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 8cacb26c-0ca3-50ba-bd38-cb41d7fd3322 with identifier: 1982423
2026-03-26 22:59:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 8cacb26c-0ca3-50ba-bd38-cb41d7fd3322 with identifier: 1982423
2026-03-26 22:59:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 8cacb26c-0ca3-50ba-bd38-cb41d7fd3322 with identifier: 1982423 to the API
2026-03-26 22:59:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '8cacb26c-0ca3-50ba-bd38-cb41d7fd3322',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 43099,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T2 CORE',
 'transmission': 'manual',
 'trim': '1.5 T2 CORE',
 'vin': None,
 'year': 2023}
2026-03-26 22:59:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982423%27 HTTP/1.1" 200 None
2026-03-26 22:59:10 [ayvens.be] INFO: Saving data for 1982423: {'auction_closing_time': 1774942200.0, 'created_time': 1774478961.196477, 'last_price_update_time': 1774565950.969268}
2026-03-26 22:59:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982423') HTTP/1.1" 204 0
2026-03-26 22:59:10 [ayvens.be] INFO: Found listing with ID: 1982424
2026-03-26 22:59:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982424%27 HTTP/1.1" 200 None
2026-03-26 22:59:11 [ayvens.be] INFO: Scrape type for 1982424: 2
2026-03-26 22:59:11 [ayvens.be] INFO: Extracting data for car ID: 1982424
2026-03-26 22:59:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b442c974-7063-5b36-a79c-8716b8f0080e with identifier: 1982424
2026-03-26 22:59:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b442c974-7063-5b36-a79c-8716b8f0080e with scrape type 2
2026-03-26 22:59:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b442c974-7063-5b36-a79c-8716b8f0080e with scrape type 2
2026-03-26 22:59:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b442c974-7063-5b36-a79c-8716b8f0080e, identifier: 1982424
2026-03-26 22:59:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b442c974-7063-5b36-a79c-8716b8f0080e with identifier: 1982424
2026-03-26 22:59:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b442c974-7063-5b36-a79c-8716b8f0080e with identifier: 1982424
2026-03-26 22:59:11 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b442c974-7063-5b36-a79c-8716b8f0080e with identifier: 1982424 to the API
2026-03-26 22:59:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'b442c974-7063-5b36-a79c-8716b8f0080e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': 'PARTNER',
 'odometer': 67110,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-08',
 'seats_number': 2,
 'seller_name': None,
 'title': 'PEUGEOT PARTNER 1.5 BHDI L2 HEAVY 75KW PREMIUM',
 'transmission': 'manual',
 'trim': '1.5 BHDI L2 HEAVY 75KW PREMIUM',
 'vin': None,
 'year': 2020}
2026-03-26 22:59:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982424%27 HTTP/1.1" 200 None
2026-03-26 22:59:11 [ayvens.be] INFO: Saving data for 1982424: {'auction_closing_time': 1774942200.0, 'created_time': 1774478962.993294, 'last_price_update_time': 1774565951.334793}
2026-03-26 22:59:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982424') HTTP/1.1" 204 0
2026-03-26 22:59:11 [ayvens.be] INFO: Found listing with ID: 1982425
2026-03-26 22:59:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982425%27 HTTP/1.1" 200 None
2026-03-26 22:59:11 [ayvens.be] INFO: Scrape type for 1982425: 2
2026-03-26 22:59:11 [ayvens.be] INFO: Extracting data for car ID: 1982425
2026-03-26 22:59:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 734ddfbc-827b-54de-a383-eec090b57f08 with identifier: 1982425
2026-03-26 22:59:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 734ddfbc-827b-54de-a383-eec090b57f08 with scrape type 2
2026-03-26 22:59:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 734ddfbc-827b-54de-a383-eec090b57f08 with scrape type 2
2026-03-26 22:59:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 734ddfbc-827b-54de-a383-eec090b57f08, identifier: 1982425
2026-03-26 22:59:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 734ddfbc-827b-54de-a383-eec090b57f08 with identifier: 1982425
2026-03-26 22:59:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 734ddfbc-827b-54de-a383-eec090b57f08 with identifier: 1982425
2026-03-26 22:59:11 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 734ddfbc-827b-54de-a383-eec090b57f08 with identifier: 1982425 to the API
2026-03-26 22:59:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '734ddfbc-827b-54de-a383-eec090b57f08',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC60 - 2017',
 'odometer': 140718,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC60 - 2017 2.0 T6 AWD PHEV Inscription Geartronic',
 'transmission': 'automatic',
 'trim': '2.0 T6 AWD PHEV Inscription Geartronic',
 'vin': None,
 'year': 2021}
2026-03-26 22:59:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982425%27 HTTP/1.1" 200 None
2026-03-26 22:59:11 [ayvens.be] INFO: Saving data for 1982425: {'auction_closing_time': 1774942200.0, 'created_time': 1774478965.156011, 'last_price_update_time': 1774565951.710114}
2026-03-26 22:59:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982425') HTTP/1.1" 204 0
2026-03-26 22:59:11 [ayvens.be] INFO: Found listing with ID: 1982426
2026-03-26 22:59:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982426%27 HTTP/1.1" 200 None
2026-03-26 22:59:12 [ayvens.be] INFO: Scrape type for 1982426: 2
2026-03-26 22:59:12 [ayvens.be] INFO: Extracting data for car ID: 1982426
2026-03-26 22:59:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a18994d-ec49-587d-b063-6d3fb6bdd9ad with identifier: 1982426
2026-03-26 22:59:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a18994d-ec49-587d-b063-6d3fb6bdd9ad with scrape type 2
2026-03-26 22:59:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3a18994d-ec49-587d-b063-6d3fb6bdd9ad with scrape type 2
2026-03-26 22:59:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 3a18994d-ec49-587d-b063-6d3fb6bdd9ad, identifier: 1982426
2026-03-26 22:59:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 3a18994d-ec49-587d-b063-6d3fb6bdd9ad with identifier: 1982426
2026-03-26 22:59:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 3a18994d-ec49-587d-b063-6d3fb6bdd9ad with identifier: 1982426
2026-03-26 22:59:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 3a18994d-ec49-587d-b063-6d3fb6bdd9ad with identifier: 1982426 to the API
2026-03-26 22:59:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '3a18994d-ec49-587d-b063-6d3fb6bdd9ad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': 'EXPERT FOURGON MWB DSL - 2016',
 'odometer': 78998,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-20',
 'seats_number': 3,
 'seller_name': None,
 'title': 'PEUGEOT EXPERT FOURGON MWB DSL - 2016 2.0 BlueHDi L2 Standard '
          'Premium S&S',
 'transmission': 'manual',
 'trim': '2.0 BlueHDi L2 Standard Premium S&S',
 'vin': None,
 'year': 2020}
2026-03-26 22:59:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982426%27 HTTP/1.1" 200 None
2026-03-26 22:59:12 [ayvens.be] INFO: Saving data for 1982426: {'auction_closing_time': 1774942200.0, 'created_time': 1774479010.518353, 'last_price_update_time': 1774565952.409384}
2026-03-26 22:59:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982426') HTTP/1.1" 204 0
2026-03-26 22:59:12 [ayvens.be] INFO: Found listing with ID: 1982427
2026-03-26 22:59:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982427%27 HTTP/1.1" 200 None
2026-03-26 22:59:12 [ayvens.be] INFO: Scrape type for 1982427: 2
2026-03-26 22:59:12 [ayvens.be] INFO: Extracting data for car ID: 1982427
2026-03-26 22:59:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 006794fd-0d45-53d2-ad92-893dde83a26f with identifier: 1982427
2026-03-26 22:59:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 006794fd-0d45-53d2-ad92-893dde83a26f with scrape type 2
2026-03-26 22:59:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 006794fd-0d45-53d2-ad92-893dde83a26f with scrape type 2
2026-03-26 22:59:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 006794fd-0d45-53d2-ad92-893dde83a26f, identifier: 1982427
2026-03-26 22:59:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 006794fd-0d45-53d2-ad92-893dde83a26f with identifier: 1982427
2026-03-26 22:59:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 006794fd-0d45-53d2-ad92-893dde83a26f with identifier: 1982427
2026-03-26 22:59:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 006794fd-0d45-53d2-ad92-893dde83a26f with identifier: 1982427 to the API
2026-03-26 22:59:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '006794fd-0d45-53d2-ad92-893dde83a26f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '3 SERIES BERLINE',
 'odometer': 147007,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3 SERIES BERLINE 2.0 318DA (110KW) BERLINE',
 'transmission': 'automatic',
 'trim': '2.0 318DA (110KW) BERLINE',
 'vin': None,
 'year': 2021}
2026-03-26 22:59:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982427%27 HTTP/1.1" 200 None
2026-03-26 22:59:12 [ayvens.be] INFO: Saving data for 1982427: {'auction_closing_time': 1774942200.0, 'created_time': 1774479009.980068, 'last_price_update_time': 1774565952.76908}
2026-03-26 22:59:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982427') HTTP/1.1" 204 0
2026-03-26 22:59:12 [ayvens.be] INFO: Found listing with ID: 1982428
2026-03-26 22:59:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982428%27 HTTP/1.1" 200 None
2026-03-26 22:59:12 [ayvens.be] INFO: Scrape type for 1982428: 2
2026-03-26 22:59:12 [ayvens.be] INFO: Extracting data for car ID: 1982428
2026-03-26 22:59:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e7edd12e-9682-5d8d-ab36-625f82b84ab4 with identifier: 1982428
2026-03-26 22:59:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7edd12e-9682-5d8d-ab36-625f82b84ab4 with scrape type 2
2026-03-26 22:59:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e7edd12e-9682-5d8d-ab36-625f82b84ab4 with scrape type 2
2026-03-26 22:59:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e7edd12e-9682-5d8d-ab36-625f82b84ab4, identifier: 1982428
2026-03-26 22:59:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e7edd12e-9682-5d8d-ab36-625f82b84ab4 with identifier: 1982428
2026-03-26 22:59:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e7edd12e-9682-5d8d-ab36-625f82b84ab4 with identifier: 1982428
2026-03-26 22:59:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e7edd12e-9682-5d8d-ab36-625f82b84ab4 with identifier: 1982428 to the API
2026-03-26 22:59:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'e7edd12e-9682-5d8d-ab36-625f82b84ab4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 78365,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T4 PHEV INSCRIPTION EXPR. DCT',
 'transmission': 'automatic',
 'trim': '1.5 T4 PHEV INSCRIPTION EXPR. DCT',
 'vin': None,
 'year': 2021}
2026-03-26 22:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982428%27 HTTP/1.1" 200 None
2026-03-26 22:59:13 [ayvens.be] INFO: Saving data for 1982428: {'auction_closing_time': 1774942200.0, 'created_time': 1774479008.963794, 'last_price_update_time': 1774565953.152927}
2026-03-26 22:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982428') HTTP/1.1" 204 0
2026-03-26 22:59:13 [ayvens.be] INFO: Found listing with ID: 1982429
2026-03-26 22:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982429%27 HTTP/1.1" 200 None
2026-03-26 22:59:13 [ayvens.be] INFO: Scrape type for 1982429: 2
2026-03-26 22:59:13 [ayvens.be] INFO: Extracting data for car ID: 1982429
2026-03-26 22:59:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99176e82-1d7f-5fea-8932-0645b25ec15f with identifier: 1982429
2026-03-26 22:59:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99176e82-1d7f-5fea-8932-0645b25ec15f with scrape type 2
2026-03-26 22:59:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 99176e82-1d7f-5fea-8932-0645b25ec15f with scrape type 2
2026-03-26 22:59:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 99176e82-1d7f-5fea-8932-0645b25ec15f, identifier: 1982429
2026-03-26 22:59:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 99176e82-1d7f-5fea-8932-0645b25ec15f with identifier: 1982429
2026-03-26 22:59:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 99176e82-1d7f-5fea-8932-0645b25ec15f with identifier: 1982429
2026-03-26 22:59:13 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 99176e82-1d7f-5fea-8932-0645b25ec15f with identifier: 1982429 to the API
2026-03-26 22:59:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '99176e82-1d7f-5fea-8932-0645b25ec15f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'ARONA',
 'odometer': 39164,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT ARONA 1.0 TSI 81KW MOVE',
 'transmission': 'manual',
 'trim': '1.0 TSI 81KW MOVE',
 'vin': None,
 'year': 2023}
2026-03-26 22:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982429%27 HTTP/1.1" 200 None
2026-03-26 22:59:13 [ayvens.be] INFO: Saving data for 1982429: {'auction_closing_time': 1774942200.0, 'created_time': 1774478980.424613, 'last_price_update_time': 1774565953.585035}
2026-03-26 22:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982429') HTTP/1.1" 204 0
2026-03-26 22:59:13 [ayvens.be] INFO: Found listing with ID: 1982430
2026-03-26 22:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982430%27 HTTP/1.1" 200 None
2026-03-26 22:59:13 [ayvens.be] INFO: Scrape type for 1982430: 2
2026-03-26 22:59:13 [ayvens.be] INFO: Extracting data for car ID: 1982430
2026-03-26 22:59:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b320123d-41b6-543f-bb50-94cead8a936e with identifier: 1982430
2026-03-26 22:59:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b320123d-41b6-543f-bb50-94cead8a936e with scrape type 2
2026-03-26 22:59:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b320123d-41b6-543f-bb50-94cead8a936e with scrape type 2
2026-03-26 22:59:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b320123d-41b6-543f-bb50-94cead8a936e, identifier: 1982430
2026-03-26 22:59:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b320123d-41b6-543f-bb50-94cead8a936e with identifier: 1982430
2026-03-26 22:59:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b320123d-41b6-543f-bb50-94cead8a936e with identifier: 1982430
2026-03-26 22:59:13 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b320123d-41b6-543f-bb50-94cead8a936e with identifier: 1982430 to the API
2026-03-26 22:59:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'electric',
 'id': 'b320123d-41b6-543f-bb50-94cead8a936e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'ENYAQ',
 'odometer': 52903,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-08-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA ENYAQ 62KWH IV 60',
 'transmission': 'automatic',
 'trim': '62KWH IV 60',
 'vin': None,
 'year': 2023}
2026-03-26 22:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982430%27 HTTP/1.1" 200 None
2026-03-26 22:59:13 [ayvens.be] INFO: Saving data for 1982430: {'auction_closing_time': 1774942200.0, 'created_time': 1774478975.697299, 'last_price_update_time': 1774565953.940534}
2026-03-26 22:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982430') HTTP/1.1" 204 0
2026-03-26 22:59:13 [ayvens.be] INFO: Found listing with ID: 1982431
2026-03-26 22:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982431%27 HTTP/1.1" 200 None
2026-03-26 22:59:13 [ayvens.be] INFO: Scrape type for 1982431: 2
2026-03-26 22:59:13 [ayvens.be] INFO: Extracting data for car ID: 1982431
2026-03-26 22:59:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1d9a820-3a3f-5874-9609-9db0550840c1 with identifier: 1982431
2026-03-26 22:59:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1d9a820-3a3f-5874-9609-9db0550840c1 with scrape type 2
2026-03-26 22:59:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d1d9a820-3a3f-5874-9609-9db0550840c1 with scrape type 2
2026-03-26 22:59:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d1d9a820-3a3f-5874-9609-9db0550840c1, identifier: 1982431
2026-03-26 22:59:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d1d9a820-3a3f-5874-9609-9db0550840c1 with identifier: 1982431
2026-03-26 22:59:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d1d9a820-3a3f-5874-9609-9db0550840c1 with identifier: 1982431
2026-03-26 22:59:14 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d1d9a820-3a3f-5874-9609-9db0550840c1 with identifier: 1982431 to the API
2026-03-26 22:59:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'd1d9a820-3a3f-5874-9609-9db0550840c1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'ARKANA',
 'odometer': 30433,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT ARKANA 1.3 TCE MHEV 140 R.S. LINE EDC',
 'transmission': 'automatic',
 'trim': '1.3 TCE MHEV 140 R.S. LINE EDC',
 'vin': None,
 'year': 2022}
2026-03-26 22:59:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982431%27 HTTP/1.1" 200 None
2026-03-26 22:59:14 [ayvens.be] INFO: Saving data for 1982431: {'auction_closing_time': 1774942200.0, 'created_time': 1774478973.814668, 'last_price_update_time': 1774565954.31163}
2026-03-26 22:59:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982431') HTTP/1.1" 204 0
2026-03-26 22:59:14 [ayvens.be] INFO: Found listing with ID: 1982432
2026-03-26 22:59:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982432%27 HTTP/1.1" 200 None
2026-03-26 22:59:14 [ayvens.be] INFO: Scrape type for 1982432: 2
2026-03-26 22:59:14 [ayvens.be] INFO: Extracting data for car ID: 1982432
2026-03-26 22:59:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae9b7317-3666-5793-8bd7-fc93e9fb3c3c with identifier: 1982432
2026-03-26 22:59:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae9b7317-3666-5793-8bd7-fc93e9fb3c3c with scrape type 2
2026-03-26 22:59:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ae9b7317-3666-5793-8bd7-fc93e9fb3c3c with scrape type 2
2026-03-26 22:59:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: ae9b7317-3666-5793-8bd7-fc93e9fb3c3c, identifier: 1982432
2026-03-26 22:59:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: ae9b7317-3666-5793-8bd7-fc93e9fb3c3c with identifier: 1982432
2026-03-26 22:59:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: ae9b7317-3666-5793-8bd7-fc93e9fb3c3c with identifier: 1982432
2026-03-26 22:59:14 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: ae9b7317-3666-5793-8bd7-fc93e9fb3c3c with identifier: 1982432 to the API
2026-03-26 22:59:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'ae9b7317-3666-5793-8bd7-fc93e9fb3c3c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'ARONA',
 'odometer': 60189,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT ARONA 1.0 TSI Move! DSG (EU6.2)',
 'transmission': 'automatic',
 'trim': '1.0 TSI Move! DSG (EU6.2)',
 'vin': None,
 'year': 2020}
2026-03-26 22:59:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982432%27 HTTP/1.1" 200 None
2026-03-26 22:59:14 [ayvens.be] INFO: Saving data for 1982432: {'auction_closing_time': 1774942200.0, 'created_time': 1774478972.748628, 'last_price_update_time': 1774565954.676223}
2026-03-26 22:59:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982432') HTTP/1.1" 204 0
2026-03-26 22:59:14 [ayvens.be] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 700
2026-03-26 22:59:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-26 22:59:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-03-26 22:59:16 [ayvens.be] INFO: Found listing with ID: 1982433
2026-03-26 22:59:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982433%27 HTTP/1.1" 200 None
2026-03-26 22:59:16 [ayvens.be] INFO: Scrape type for 1982433: 2
2026-03-26 22:59:16 [ayvens.be] INFO: Extracting data for car ID: 1982433
2026-03-26 22:59:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c3a3245-cd3c-575e-bc30-7574e9b71011 with identifier: 1982433
2026-03-26 22:59:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c3a3245-cd3c-575e-bc30-7574e9b71011 with scrape type 2
2026-03-26 22:59:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7c3a3245-cd3c-575e-bc30-7574e9b71011 with scrape type 2
2026-03-26 22:59:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 7c3a3245-cd3c-575e-bc30-7574e9b71011, identifier: 1982433
2026-03-26 22:59:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 7c3a3245-cd3c-575e-bc30-7574e9b71011 with identifier: 1982433
2026-03-26 22:59:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 7c3a3245-cd3c-575e-bc30-7574e9b71011 with identifier: 1982433
2026-03-26 22:59:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 7c3a3245-cd3c-575e-bc30-7574e9b71011 with identifier: 1982433 to the API
2026-03-26 22:59:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '7c3a3245-cd3c-575e-bc30-7574e9b71011',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '1 SERIES HATCH',
 'odometer': 57430,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1 SERIES HATCH 1.5 118I (100KW)',
 'transmission': 'manual',
 'trim': '1.5 118I (100KW)',
 'vin': None,
 'year': 2021}
2026-03-26 22:59:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982433%27 HTTP/1.1" 200 None
2026-03-26 22:59:17 [ayvens.be] INFO: Saving data for 1982433: {'auction_closing_time': 1774942200.0, 'created_time': 1774478974.417576, 'last_price_update_time': 1774565957.183768}
2026-03-26 22:59:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982433') HTTP/1.1" 204 0
2026-03-26 22:59:17 [ayvens.be] INFO: Found listing with ID: 1982434
2026-03-26 22:59:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982434%27 HTTP/1.1" 200 None
2026-03-26 22:59:17 [ayvens.be] INFO: Scrape type for 1982434: 2
2026-03-26 22:59:17 [ayvens.be] INFO: Extracting data for car ID: 1982434
2026-03-26 22:59:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e70b48f7-8da6-5910-aa96-0829617f29de with identifier: 1982434
2026-03-26 22:59:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e70b48f7-8da6-5910-aa96-0829617f29de with scrape type 2
2026-03-26 22:59:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e70b48f7-8da6-5910-aa96-0829617f29de with scrape type 2
2026-03-26 22:59:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e70b48f7-8da6-5910-aa96-0829617f29de, identifier: 1982434
2026-03-26 22:59:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e70b48f7-8da6-5910-aa96-0829617f29de with identifier: 1982434
2026-03-26 22:59:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e70b48f7-8da6-5910-aa96-0829617f29de with identifier: 1982434
2026-03-26 22:59:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e70b48f7-8da6-5910-aa96-0829617f29de with identifier: 1982434 to the API
2026-03-26 22:59:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'e70b48f7-8da6-5910-aa96-0829617f29de',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'OCTAVIA COMBI',
 'odometer': 64633,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA OCTAVIA COMBI 2.0 CRTDI 85KW DSG7 CLEVER',
 'transmission': 'automatic',
 'trim': '2.0 CRTDI 85KW DSG7 CLEVER',
 'vin': None,
 'year': 2022}
2026-03-26 22:59:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982434%27 HTTP/1.1" 200 None
2026-03-26 22:59:17 [ayvens.be] INFO: Saving data for 1982434: {'auction_closing_time': 1774942200.0, 'created_time': 1774478976.859149, 'last_price_update_time': 1774565957.587553}
2026-03-26 22:59:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982434') HTTP/1.1" 204 0
2026-03-26 22:59:17 [ayvens.be] INFO: Found listing with ID: 1982435
2026-03-26 22:59:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982435%27 HTTP/1.1" 200 None
2026-03-26 22:59:17 [ayvens.be] INFO: Scrape type for 1982435: 2
2026-03-26 22:59:17 [ayvens.be] INFO: Extracting data for car ID: 1982435
2026-03-26 22:59:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f89c3738-2d1b-5d36-ab42-4308943fc454 with identifier: 1982435
2026-03-26 22:59:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f89c3738-2d1b-5d36-ab42-4308943fc454 with scrape type 2
2026-03-26 22:59:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f89c3738-2d1b-5d36-ab42-4308943fc454 with scrape type 2
2026-03-26 22:59:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f89c3738-2d1b-5d36-ab42-4308943fc454, identifier: 1982435
2026-03-26 22:59:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f89c3738-2d1b-5d36-ab42-4308943fc454 with identifier: 1982435
2026-03-26 22:59:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f89c3738-2d1b-5d36-ab42-4308943fc454 with identifier: 1982435
2026-03-26 22:59:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f89c3738-2d1b-5d36-ab42-4308943fc454 with identifier: 1982435 to the API
2026-03-26 22:59:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'f89c3738-2d1b-5d36-ab42-4308943fc454',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'Clio',
 'odometer': 48115,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT Clio 1.0 TCE 100 CORPORATE EDITION',
 'transmission': 'manual',
 'trim': '1.0 TCE 100 CORPORATE EDITION',
 'vin': None,
 'year': 2020}
2026-03-26 22:59:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982435%27 HTTP/1.1" 200 None
2026-03-26 22:59:17 [ayvens.be] INFO: Saving data for 1982435: {'auction_closing_time': 1774942200.0, 'created_time': 1774478979.221198, 'last_price_update_time': 1774565957.953117}
2026-03-26 22:59:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982435') HTTP/1.1" 204 0
2026-03-26 22:59:17 [ayvens.be] INFO: Found listing with ID: 1982436
2026-03-26 22:59:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982436%27 HTTP/1.1" 200 None
2026-03-26 22:59:17 [ayvens.be] INFO: Scrape type for 1982436: 2
2026-03-26 22:59:17 [ayvens.be] INFO: Extracting data for car ID: 1982436
2026-03-26 22:59:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 76f4aa23-fa08-539a-9861-8e6329050ac7 with identifier: 1982436
2026-03-26 22:59:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76f4aa23-fa08-539a-9861-8e6329050ac7 with scrape type 2
2026-03-26 22:59:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 76f4aa23-fa08-539a-9861-8e6329050ac7 with scrape type 2
2026-03-26 22:59:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 76f4aa23-fa08-539a-9861-8e6329050ac7, identifier: 1982436
2026-03-26 22:59:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 76f4aa23-fa08-539a-9861-8e6329050ac7 with identifier: 1982436
2026-03-26 22:59:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 76f4aa23-fa08-539a-9861-8e6329050ac7 with identifier: 1982436
2026-03-26 22:59:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 76f4aa23-fa08-539a-9861-8e6329050ac7 with identifier: 1982436 to the API
2026-03-26 22:59:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '76f4aa23-fa08-539a-9861-8e6329050ac7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A4 AVANT DIESEL - 2020',
 'odometer': 148208,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A4 AVANT DIESEL - 2020 30 TDi',
 'transmission': 'manual',
 'trim': '30 TDi',
 'vin': None,
 'year': 2020}
2026-03-26 22:59:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982436%27 HTTP/1.1" 200 None
2026-03-26 22:59:18 [ayvens.be] INFO: Saving data for 1982436: {'auction_closing_time': 1774942200.0, 'created_time': 1774479006.516343, 'last_price_update_time': 1774565958.331321}
2026-03-26 22:59:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982436') HTTP/1.1" 204 0
2026-03-26 22:59:18 [ayvens.be] INFO: Found listing with ID: 1982437
2026-03-26 22:59:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982437%27 HTTP/1.1" 200 None
2026-03-26 22:59:18 [ayvens.be] INFO: Scrape type for 1982437: 2
2026-03-26 22:59:18 [ayvens.be] INFO: Extracting data for car ID: 1982437
2026-03-26 22:59:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f89d208-018d-551e-9200-7252e06ab89e with identifier: 1982437
2026-03-26 22:59:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f89d208-018d-551e-9200-7252e06ab89e with scrape type 2
2026-03-26 22:59:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9f89d208-018d-551e-9200-7252e06ab89e with scrape type 2
2026-03-26 22:59:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 9f89d208-018d-551e-9200-7252e06ab89e, identifier: 1982437
2026-03-26 22:59:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 9f89d208-018d-551e-9200-7252e06ab89e with identifier: 1982437
2026-03-26 22:59:18 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 22:59:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 22:59:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 9f89d208-018d-551e-9200-7252e06ab89e with identifier: 1982437
2026-03-26 22:59:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 9f89d208-018d-551e-9200-7252e06ab89e with identifier: 1982437 to the API
2026-03-26 22:59:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 164,
 'color': 'BLANC GLACIER',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '9f89d208-018d-551e-9200-7252e06ab89e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'TRAFIC 29 FOURGON MWB DSL - 20',
 'odometer': 93512,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-02-05',
 'seats_number': 6,
 'seller_name': None,
 'title': 'RENAULT TRAFIC 29 FOURGON MWB DSL - 20 1.6 dCi 29 L2H1 Energy '
          'Tw.Turbo Gd Conf.   STOCK',
 'transmission': 'manual',
 'trim': '1.6 dCi 29 L2H1 Energy Tw.Turbo Gd Conf.   STOCK',
 'vin': None,
 'year': 2016}
2026-03-26 22:59:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982437%27 HTTP/1.1" 200 None
2026-03-26 22:59:18 [ayvens.be] INFO: Saving data for 1982437: {'auction_closing_time': 1774942200.0, 'created_time': 1774478983.242525, 'last_price_update_time': 1774565958.789056}
2026-03-26 22:59:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982437') HTTP/1.1" 204 0
2026-03-26 22:59:18 [ayvens.be] INFO: Found listing with ID: 1982438
2026-03-26 22:59:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982438%27 HTTP/1.1" 200 None
2026-03-26 22:59:18 [ayvens.be] INFO: Scrape type for 1982438: 2
2026-03-26 22:59:18 [ayvens.be] INFO: Extracting data for car ID: 1982438
2026-03-26 22:59:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf56811e-d6bb-5ebc-b1f9-858a9a9a3d1e with identifier: 1982438
2026-03-26 22:59:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf56811e-d6bb-5ebc-b1f9-858a9a9a3d1e with scrape type 2
2026-03-26 22:59:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bf56811e-d6bb-5ebc-b1f9-858a9a9a3d1e with scrape type 2
2026-03-26 22:59:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: bf56811e-d6bb-5ebc-b1f9-858a9a9a3d1e, identifier: 1982438
2026-03-26 22:59:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: bf56811e-d6bb-5ebc-b1f9-858a9a9a3d1e with identifier: 1982438
2026-03-26 22:59:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: bf56811e-d6bb-5ebc-b1f9-858a9a9a3d1e with identifier: 1982438
2026-03-26 22:59:19 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: bf56811e-d6bb-5ebc-b1f9-858a9a9a3d1e with identifier: 1982438 to the API
2026-03-26 22:59:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'bf56811e-d6bb-5ebc-b1f9-858a9a9a3d1e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 101949,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T4 PHEV R-DESIGN DCT',
 'transmission': 'automatic',
 'trim': '1.5 T4 PHEV R-DESIGN DCT',
 'vin': None,
 'year': 2022}
2026-03-26 22:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982438%27 HTTP/1.1" 200 None
2026-03-26 22:59:19 [ayvens.be] INFO: Saving data for 1982438: {'auction_closing_time': 1774942200.0, 'created_time': 1774479005.502128, 'last_price_update_time': 1774565959.172674}
2026-03-26 22:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982438') HTTP/1.1" 204 0
2026-03-26 22:59:19 [ayvens.be] INFO: Found listing with ID: 1982439
2026-03-26 22:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982439%27 HTTP/1.1" 200 None
2026-03-26 22:59:19 [ayvens.be] INFO: Scrape type for 1982439: 2
2026-03-26 22:59:19 [ayvens.be] INFO: Extracting data for car ID: 1982439
2026-03-26 22:59:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 11297d7e-0041-5c3f-8223-1d581758c2af with identifier: 1982439
2026-03-26 22:59:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11297d7e-0041-5c3f-8223-1d581758c2af with scrape type 2
2026-03-26 22:59:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 11297d7e-0041-5c3f-8223-1d581758c2af with scrape type 2
2026-03-26 22:59:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 11297d7e-0041-5c3f-8223-1d581758c2af, identifier: 1982439
2026-03-26 22:59:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 11297d7e-0041-5c3f-8223-1d581758c2af with identifier: 1982439
2026-03-26 22:59:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 11297d7e-0041-5c3f-8223-1d581758c2af with identifier: 1982439
2026-03-26 22:59:19 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 11297d7e-0041-5c3f-8223-1d581758c2af with identifier: 1982439 to the API
2026-03-26 22:59:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.8L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '11297d7e-0041-5c3f-8223-1d581758c2af',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'COROLLA TOURING SPORTS',
 'odometer': 117699,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA COROLLA TOURING SPORTS 1.8 HEV DYNAMIC E-CVT',
 'transmission': 'automatic',
 'trim': '1.8 HEV DYNAMIC E-CVT',
 'vin': None,
 'year': 2022}
2026-03-26 22:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982439%27 HTTP/1.1" 200 None
2026-03-26 22:59:19 [ayvens.be] INFO: Saving data for 1982439: {'auction_closing_time': 1774942200.0, 'created_time': 1774478994.212064, 'last_price_update_time': 1774565959.540279}
2026-03-26 22:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982439') HTTP/1.1" 204 0
2026-03-26 22:59:19 [ayvens.be] INFO: Found listing with ID: 1982440
2026-03-26 22:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982440%27 HTTP/1.1" 200 None
2026-03-26 22:59:19 [ayvens.be] INFO: Scrape type for 1982440: 2
2026-03-26 22:59:19 [ayvens.be] INFO: Extracting data for car ID: 1982440
2026-03-26 22:59:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13dae2d0-e29a-59df-8608-9073adf888ee with identifier: 1982440
2026-03-26 22:59:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13dae2d0-e29a-59df-8608-9073adf888ee with scrape type 2
2026-03-26 22:59:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 13dae2d0-e29a-59df-8608-9073adf888ee with scrape type 2
2026-03-26 22:59:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 13dae2d0-e29a-59df-8608-9073adf888ee, identifier: 1982440
2026-03-26 22:59:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 13dae2d0-e29a-59df-8608-9073adf888ee with identifier: 1982440
2026-03-26 22:59:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 13dae2d0-e29a-59df-8608-9073adf888ee with identifier: 1982440
2026-03-26 22:59:19 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 13dae2d0-e29a-59df-8608-9073adf888ee with identifier: 1982440 to the API
2026-03-26 22:59:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '13dae2d0-e29a-59df-8608-9073adf888ee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'KODIAQ',
 'odometer': 110738,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-25',
 'seats_number': 7,
 'seller_name': None,
 'title': 'SKODA KODIAQ 1.5 TSI ACT Sportline II',
 'transmission': 'manual',
 'trim': '1.5 TSI ACT Sportline II',
 'vin': None,
 'year': 2020}
2026-03-26 22:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982440%27 HTTP/1.1" 200 None
2026-03-26 22:59:19 [ayvens.be] INFO: Saving data for 1982440: {'auction_closing_time': 1774942200.0, 'created_time': 1774478992.274762, 'last_price_update_time': 1774565959.919192}
2026-03-26 22:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982440') HTTP/1.1" 204 0
2026-03-26 22:59:19 [ayvens.be] INFO: Found listing with ID: 1982441
2026-03-26 22:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982441%27 HTTP/1.1" 200 None
2026-03-26 22:59:19 [ayvens.be] INFO: Scrape type for 1982441: 2
2026-03-26 22:59:19 [ayvens.be] INFO: Extracting data for car ID: 1982441
2026-03-26 22:59:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 744b5375-f1be-5813-9a5a-21ba7d244bb9 with identifier: 1982441
2026-03-26 22:59:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 744b5375-f1be-5813-9a5a-21ba7d244bb9 with scrape type 2
2026-03-26 22:59:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 744b5375-f1be-5813-9a5a-21ba7d244bb9 with scrape type 2
2026-03-26 22:59:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 744b5375-f1be-5813-9a5a-21ba7d244bb9, identifier: 1982441
2026-03-26 22:59:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 744b5375-f1be-5813-9a5a-21ba7d244bb9 with identifier: 1982441
2026-03-26 22:59:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 744b5375-f1be-5813-9a5a-21ba7d244bb9 with identifier: 1982441
2026-03-26 22:59:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 744b5375-f1be-5813-9a5a-21ba7d244bb9 with identifier: 1982441 to the API
2026-03-26 22:59:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '744b5375-f1be-5813-9a5a-21ba7d244bb9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TRANSPORTER 1400 FOU SWB DSL -',
 'odometer': 113085,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-01',
 'seats_number': 3,
 'seller_name': None,
 'title': 'VOLKSWAGEN TRANSPORTER 1400 FOU SWB DSL - 2.0 TDi SCR BMT STOCK',
 'transmission': 'manual',
 'trim': '2.0 TDi SCR BMT STOCK',
 'vin': None,
 'year': 2019}
2026-03-26 22:59:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982441%27 HTTP/1.1" 200 None
2026-03-26 22:59:20 [ayvens.be] INFO: Saving data for 1982441: {'auction_closing_time': 1774942200.0, 'created_time': 1774478988.129205, 'last_price_update_time': 1774565960.297683}
2026-03-26 22:59:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982441') HTTP/1.1" 204 0
2026-03-26 22:59:20 [ayvens.be] INFO: Found listing with ID: 1982442
2026-03-26 22:59:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982442%27 HTTP/1.1" 200 None
2026-03-26 22:59:20 [ayvens.be] INFO: Scrape type for 1982442: 2
2026-03-26 22:59:20 [ayvens.be] INFO: Extracting data for car ID: 1982442
2026-03-26 22:59:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9f907ef-5d82-5033-af2e-bd0a3e4569b5 with identifier: 1982442
2026-03-26 22:59:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9f907ef-5d82-5033-af2e-bd0a3e4569b5 with scrape type 2
2026-03-26 22:59:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f9f907ef-5d82-5033-af2e-bd0a3e4569b5 with scrape type 2
2026-03-26 22:59:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f9f907ef-5d82-5033-af2e-bd0a3e4569b5, identifier: 1982442
2026-03-26 22:59:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f9f907ef-5d82-5033-af2e-bd0a3e4569b5 with identifier: 1982442
2026-03-26 22:59:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f9f907ef-5d82-5033-af2e-bd0a3e4569b5 with identifier: 1982442
2026-03-26 22:59:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f9f907ef-5d82-5033-af2e-bd0a3e4569b5 with identifier: 1982442 to the API
2026-03-26 22:59:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'f9f907ef-5d82-5033-af2e-bd0a3e4569b5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'V90 CROSS COUNTRY',
 'odometer': 113361,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO V90 CROSS COUNTRY 2.0 B4 D 4WD GEARTR. CROSS COUNTRY PRO',
 'transmission': 'automatic',
 'trim': '2.0 B4 D 4WD GEARTR. CROSS COUNTRY PRO',
 'vin': None,
 'year': 2021}
2026-03-26 22:59:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982442%27 HTTP/1.1" 200 None
2026-03-26 22:59:20 [ayvens.be] INFO: Saving data for 1982442: {'auction_closing_time': 1774942200.0, 'created_time': 1774478989.504201, 'last_price_update_time': 1774565960.660906}
2026-03-26 22:59:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982442') HTTP/1.1" 204 0
2026-03-26 22:59:20 [ayvens.be] INFO: Found listing with ID: 1982443
2026-03-26 22:59:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982443%27 HTTP/1.1" 200 None
2026-03-26 22:59:20 [ayvens.be] INFO: Scrape type for 1982443: 2
2026-03-26 22:59:20 [ayvens.be] INFO: Extracting data for car ID: 1982443
2026-03-26 22:59:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cacad840-061c-5dfe-87e8-f7489674923f with identifier: 1982443
2026-03-26 22:59:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cacad840-061c-5dfe-87e8-f7489674923f with scrape type 2
2026-03-26 22:59:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cacad840-061c-5dfe-87e8-f7489674923f with scrape type 2
2026-03-26 22:59:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: cacad840-061c-5dfe-87e8-f7489674923f, identifier: 1982443
2026-03-26 22:59:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: cacad840-061c-5dfe-87e8-f7489674923f with identifier: 1982443
2026-03-26 22:59:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: cacad840-061c-5dfe-87e8-f7489674923f with identifier: 1982443
2026-03-26 22:59:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: cacad840-061c-5dfe-87e8-f7489674923f with identifier: 1982443 to the API
2026-03-26 22:59:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'cacad840-061c-5dfe-87e8-f7489674923f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 100765,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 1.5 SDRIVE18I (100KW)',
 'transmission': 'manual',
 'trim': '1.5 SDRIVE18I (100KW)',
 'vin': None,
 'year': 2022}
2026-03-26 22:59:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982443%27 HTTP/1.1" 200 None
2026-03-26 22:59:21 [ayvens.be] INFO: Saving data for 1982443: {'auction_closing_time': 1774942200.0, 'created_time': 1774478990.919816, 'last_price_update_time': 1774565961.036862}
2026-03-26 22:59:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982443') HTTP/1.1" 204 0
2026-03-26 22:59:21 [ayvens.be] INFO: Found listing with ID: 1982444
2026-03-26 22:59:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982444%27 HTTP/1.1" 200 None
2026-03-26 22:59:21 [ayvens.be] INFO: Scrape type for 1982444: 2
2026-03-26 22:59:21 [ayvens.be] INFO: Extracting data for car ID: 1982444
2026-03-26 22:59:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8131033-29d9-5848-adc6-3c6d85d7287d with identifier: 1982444
2026-03-26 22:59:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8131033-29d9-5848-adc6-3c6d85d7287d with scrape type 2
2026-03-26 22:59:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f8131033-29d9-5848-adc6-3c6d85d7287d with scrape type 2
2026-03-26 22:59:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f8131033-29d9-5848-adc6-3c6d85d7287d, identifier: 1982444
2026-03-26 22:59:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f8131033-29d9-5848-adc6-3c6d85d7287d with identifier: 1982444
2026-03-26 22:59:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f8131033-29d9-5848-adc6-3c6d85d7287d with identifier: 1982444
2026-03-26 22:59:21 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f8131033-29d9-5848-adc6-3c6d85d7287d with identifier: 1982444 to the API
2026-03-26 22:59:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'f8131033-29d9-5848-adc6-3c6d85d7287d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 86531,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T4 PHEV INSCRIPTION DCT',
 'transmission': 'automatic',
 'trim': '1.5 T4 PHEV INSCRIPTION DCT',
 'vin': None,
 'year': 2022}
2026-03-26 22:59:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982444%27 HTTP/1.1" 200 None
2026-03-26 22:59:21 [ayvens.be] INFO: Saving data for 1982444: {'auction_closing_time': 1774942200.0, 'created_time': 1774478993.858937, 'last_price_update_time': 1774565961.40787}
2026-03-26 22:59:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982444') HTTP/1.1" 204 0
2026-03-26 22:59:21 [ayvens.be] INFO: Found listing with ID: 1982445
2026-03-26 22:59:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982445%27 HTTP/1.1" 200 None
2026-03-26 22:59:21 [ayvens.be] INFO: Scrape type for 1982445: 2
2026-03-26 22:59:21 [ayvens.be] INFO: Extracting data for car ID: 1982445
2026-03-26 22:59:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e269c9ed-ab32-5654-928d-86dbafcc8c10 with identifier: 1982445
2026-03-26 22:59:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e269c9ed-ab32-5654-928d-86dbafcc8c10 with scrape type 2
2026-03-26 22:59:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e269c9ed-ab32-5654-928d-86dbafcc8c10 with scrape type 2
2026-03-26 22:59:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e269c9ed-ab32-5654-928d-86dbafcc8c10, identifier: 1982445
2026-03-26 22:59:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e269c9ed-ab32-5654-928d-86dbafcc8c10 with identifier: 1982445
2026-03-26 22:59:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e269c9ed-ab32-5654-928d-86dbafcc8c10 with identifier: 1982445
2026-03-26 22:59:21 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e269c9ed-ab32-5654-928d-86dbafcc8c10 with identifier: 1982445 to the API
2026-03-26 22:59:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'e269c9ed-ab32-5654-928d-86dbafcc8c10',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLB',
 'odometer': 120789,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLB 2.0 GLB 180 D BUSINESS SOLUTION',
 'transmission': 'automatic',
 'trim': '2.0 GLB 180 D BUSINESS SOLUTION',
 'vin': None,
 'year': 2021}
2026-03-26 22:59:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982445%27 HTTP/1.1" 200 None
2026-03-26 22:59:21 [ayvens.be] INFO: Saving data for 1982445: {'auction_closing_time': 1774942200.0, 'created_time': 1774479006.851433, 'last_price_update_time': 1774565961.786136}
2026-03-26 22:59:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982445') HTTP/1.1" 204 0
2026-03-26 22:59:21 [ayvens.be] INFO: Found listing with ID: 1982446
2026-03-26 22:59:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982446%27 HTTP/1.1" 200 None
2026-03-26 22:59:21 [ayvens.be] INFO: Scrape type for 1982446: 2
2026-03-26 22:59:21 [ayvens.be] INFO: Extracting data for car ID: 1982446
2026-03-26 22:59:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd475d9c-aaf5-52f3-8d5e-d9ffb116b3e6 with identifier: 1982446
2026-03-26 22:59:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd475d9c-aaf5-52f3-8d5e-d9ffb116b3e6 with scrape type 2
2026-03-26 22:59:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dd475d9c-aaf5-52f3-8d5e-d9ffb116b3e6 with scrape type 2
2026-03-26 22:59:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: dd475d9c-aaf5-52f3-8d5e-d9ffb116b3e6, identifier: 1982446
2026-03-26 22:59:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: dd475d9c-aaf5-52f3-8d5e-d9ffb116b3e6 with identifier: 1982446
2026-03-26 22:59:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: dd475d9c-aaf5-52f3-8d5e-d9ffb116b3e6 with identifier: 1982446
2026-03-26 22:59:21 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: dd475d9c-aaf5-52f3-8d5e-d9ffb116b3e6 with identifier: 1982446 to the API
2026-03-26 22:59:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'dd475d9c-aaf5-52f3-8d5e-d9ffb116b3e6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q5',
 'odometer': 117065,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q5 2.0 40 TDI S TRONIC QUATTRO B. ED. ADV',
 'transmission': 'automatic',
 'trim': '2.0 40 TDI S TRONIC QUATTRO B. ED. ADV',
 'vin': None,
 'year': 2021}
2026-03-26 22:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982446%27 HTTP/1.1" 200 None
2026-03-26 22:59:22 [ayvens.be] INFO: Saving data for 1982446: {'auction_closing_time': 1774942200.0, 'created_time': 1774479004.60505, 'last_price_update_time': 1774565962.16746}
2026-03-26 22:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982446') HTTP/1.1" 204 0
2026-03-26 22:59:22 [ayvens.be] INFO: Found listing with ID: 1982447
2026-03-26 22:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982447%27 HTTP/1.1" 200 None
2026-03-26 22:59:22 [ayvens.be] INFO: Scrape type for 1982447: 2
2026-03-26 22:59:22 [ayvens.be] INFO: Extracting data for car ID: 1982447
2026-03-26 22:59:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a5178048-2c9e-57b9-b033-270f599fcfcb with identifier: 1982447
2026-03-26 22:59:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a5178048-2c9e-57b9-b033-270f599fcfcb with scrape type 2
2026-03-26 22:59:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a5178048-2c9e-57b9-b033-270f599fcfcb with scrape type 2
2026-03-26 22:59:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a5178048-2c9e-57b9-b033-270f599fcfcb, identifier: 1982447
2026-03-26 22:59:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a5178048-2c9e-57b9-b033-270f599fcfcb with identifier: 1982447
2026-03-26 22:59:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a5178048-2c9e-57b9-b033-270f599fcfcb with identifier: 1982447
2026-03-26 22:59:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a5178048-2c9e-57b9-b033-270f599fcfcb with identifier: 1982447 to the API
2026-03-26 22:59:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'a5178048-2c9e-57b9-b033-270f599fcfcb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLC',
 'odometer': 106638,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLC 2.0 GLC 300 DE 4MATIC 4WD BUS SOL AUTO',
 'transmission': 'automatic',
 'trim': '2.0 GLC 300 DE 4MATIC 4WD BUS SOL AUTO',
 'vin': None,
 'year': 2021}
2026-03-26 22:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982447%27 HTTP/1.1" 200 None
2026-03-26 22:59:22 [ayvens.be] INFO: Saving data for 1982447: {'auction_closing_time': 1774942200.0, 'created_time': 1774478999.740072, 'last_price_update_time': 1774565962.541472}
2026-03-26 22:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982447') HTTP/1.1" 204 0
2026-03-26 22:59:22 [ayvens.be] INFO: Found listing with ID: 1982448
2026-03-26 22:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982448%27 HTTP/1.1" 200 None
2026-03-26 22:59:22 [ayvens.be] INFO: Scrape type for 1982448: 2
2026-03-26 22:59:22 [ayvens.be] INFO: Extracting data for car ID: 1982448
2026-03-26 22:59:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46150241-ab67-52a9-bf8f-5fecb2aa1682 with identifier: 1982448
2026-03-26 22:59:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46150241-ab67-52a9-bf8f-5fecb2aa1682 with scrape type 2
2026-03-26 22:59:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 46150241-ab67-52a9-bf8f-5fecb2aa1682 with scrape type 2
2026-03-26 22:59:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 46150241-ab67-52a9-bf8f-5fecb2aa1682, identifier: 1982448
2026-03-26 22:59:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 46150241-ab67-52a9-bf8f-5fecb2aa1682 with identifier: 1982448
2026-03-26 22:59:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 46150241-ab67-52a9-bf8f-5fecb2aa1682 with identifier: 1982448
2026-03-26 22:59:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 46150241-ab67-52a9-bf8f-5fecb2aa1682 with identifier: 1982448 to the API
2026-03-26 22:59:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '46150241-ab67-52a9-bf8f-5fecb2aa1682',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '308 SW',
 'odometer': 98226,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 308 SW 1.5 BLUEHDI 96KW S-S AUTO ALLURE PACK',
 'transmission': 'automatic',
 'trim': '1.5 BLUEHDI 96KW S-S AUTO ALLURE PACK',
 'vin': None,
 'year': 2021}
2026-03-26 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982448%27 HTTP/1.1" 200 None
2026-03-26 22:59:23 [ayvens.be] INFO: Saving data for 1982448: {'auction_closing_time': 1774942200.0, 'created_time': 1774478998.739673, 'last_price_update_time': 1774565963.010771}
2026-03-26 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982448') HTTP/1.1" 204 0
2026-03-26 22:59:23 [ayvens.be] INFO: Found listing with ID: 1982449
2026-03-26 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982449%27 HTTP/1.1" 200 None
2026-03-26 22:59:23 [ayvens.be] INFO: Scrape type for 1982449: 2
2026-03-26 22:59:23 [ayvens.be] INFO: Extracting data for car ID: 1982449
2026-03-26 22:59:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 124521f8-a17b-51a0-b34b-df47fd238977 with identifier: 1982449
2026-03-26 22:59:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 124521f8-a17b-51a0-b34b-df47fd238977 with scrape type 2
2026-03-26 22:59:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 124521f8-a17b-51a0-b34b-df47fd238977 with scrape type 2
2026-03-26 22:59:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 124521f8-a17b-51a0-b34b-df47fd238977, identifier: 1982449
2026-03-26 22:59:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 124521f8-a17b-51a0-b34b-df47fd238977 with identifier: 1982449
2026-03-26 22:59:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 124521f8-a17b-51a0-b34b-df47fd238977 with identifier: 1982449
2026-03-26 22:59:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 124521f8-a17b-51a0-b34b-df47fd238977 with identifier: 1982449 to the API
2026-03-26 22:59:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '124521f8-a17b-51a0-b34b-df47fd238977',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X3',
 'odometer': 88535,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X3 2.0 SDRIVE18D (100KW) AUTO',
 'transmission': 'automatic',
 'trim': '2.0 SDRIVE18D (100KW) AUTO',
 'vin': None,
 'year': 2022}
2026-03-26 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982449%27 HTTP/1.1" 200 None
2026-03-26 22:59:23 [ayvens.be] INFO: Saving data for 1982449: {'auction_closing_time': 1774942200.0, 'created_time': 1774479001.256982, 'last_price_update_time': 1774565963.399193}
2026-03-26 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982449') HTTP/1.1" 204 0
2026-03-26 22:59:23 [ayvens.be] INFO: Found listing with ID: 1982450
2026-03-26 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982450%27 HTTP/1.1" 200 None
2026-03-26 22:59:23 [ayvens.be] INFO: Scrape type for 1982450: 2
2026-03-26 22:59:23 [ayvens.be] INFO: Extracting data for car ID: 1982450
2026-03-26 22:59:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d457ea5-817c-5892-85d4-161dbe8956cc with identifier: 1982450
2026-03-26 22:59:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d457ea5-817c-5892-85d4-161dbe8956cc with scrape type 2
2026-03-26 22:59:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3d457ea5-817c-5892-85d4-161dbe8956cc with scrape type 2
2026-03-26 22:59:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 3d457ea5-817c-5892-85d4-161dbe8956cc, identifier: 1982450
2026-03-26 22:59:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 3d457ea5-817c-5892-85d4-161dbe8956cc with identifier: 1982450
2026-03-26 22:59:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 3d457ea5-817c-5892-85d4-161dbe8956cc with identifier: 1982450
2026-03-26 22:59:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 3d457ea5-817c-5892-85d4-161dbe8956cc with identifier: 1982450 to the API
2026-03-26 22:59:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '3d457ea5-817c-5892-85d4-161dbe8956cc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 87507,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 2008 1.2 PURETECH 96KW S-S AUTO GT',
 'transmission': 'automatic',
 'trim': '1.2 PURETECH 96KW S-S AUTO GT',
 'vin': None,
 'year': 2022}
2026-03-26 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982450%27 HTTP/1.1" 200 None
2026-03-26 22:59:23 [ayvens.be] INFO: Saving data for 1982450: {'auction_closing_time': 1774942200.0, 'created_time': 1774479002.980497, 'last_price_update_time': 1774565963.766591}
2026-03-26 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982450') HTTP/1.1" 204 0
2026-03-26 22:59:23 [ayvens.be] INFO: Found listing with ID: 1982451
2026-03-26 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982451%27 HTTP/1.1" 200 None
2026-03-26 22:59:23 [ayvens.be] INFO: Scrape type for 1982451: 2
2026-03-26 22:59:23 [ayvens.be] INFO: Extracting data for car ID: 1982451
2026-03-26 22:59:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 334d5026-7bd1-5ecd-b307-f4eeeee4f100 with identifier: 1982451
2026-03-26 22:59:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 334d5026-7bd1-5ecd-b307-f4eeeee4f100 with scrape type 2
2026-03-26 22:59:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 334d5026-7bd1-5ecd-b307-f4eeeee4f100 with scrape type 2
2026-03-26 22:59:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 334d5026-7bd1-5ecd-b307-f4eeeee4f100, identifier: 1982451
2026-03-26 22:59:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 334d5026-7bd1-5ecd-b307-f4eeeee4f100 with identifier: 1982451
2026-03-26 22:59:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 334d5026-7bd1-5ecd-b307-f4eeeee4f100 with identifier: 1982451
2026-03-26 22:59:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 334d5026-7bd1-5ecd-b307-f4eeeee4f100 with identifier: 1982451 to the API
2026-03-26 22:59:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '334d5026-7bd1-5ecd-b307-f4eeeee4f100',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'CLIO',
 'odometer': 90608,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT CLIO 1.0 TCE 90 EVOLUTION',
 'transmission': 'manual',
 'trim': '1.0 TCE 90 EVOLUTION',
 'vin': None,
 'year': 2022}
2026-03-26 22:59:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982451%27 HTTP/1.1" 200 None
2026-03-26 22:59:24 [ayvens.be] INFO: Saving data for 1982451: {'auction_closing_time': 1774942200.0, 'created_time': 1774479003.959583, 'last_price_update_time': 1774565964.13239}
2026-03-26 22:59:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982451') HTTP/1.1" 204 0
2026-03-26 22:59:24 [ayvens.be] INFO: Found listing with ID: 1982452
2026-03-26 22:59:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982452%27 HTTP/1.1" 200 None
2026-03-26 22:59:24 [ayvens.be] INFO: Scrape type for 1982452: 2
2026-03-26 22:59:24 [ayvens.be] INFO: Extracting data for car ID: 1982452
2026-03-26 22:59:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8379ce6a-5c44-5957-9b56-b8dfd0fc742b with identifier: 1982452
2026-03-26 22:59:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8379ce6a-5c44-5957-9b56-b8dfd0fc742b with scrape type 2
2026-03-26 22:59:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8379ce6a-5c44-5957-9b56-b8dfd0fc742b with scrape type 2
2026-03-26 22:59:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 8379ce6a-5c44-5957-9b56-b8dfd0fc742b, identifier: 1982452
2026-03-26 22:59:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 8379ce6a-5c44-5957-9b56-b8dfd0fc742b with identifier: 1982452
2026-03-26 22:59:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 8379ce6a-5c44-5957-9b56-b8dfd0fc742b with identifier: 1982452
2026-03-26 22:59:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 8379ce6a-5c44-5957-9b56-b8dfd0fc742b with identifier: 1982452 to the API
2026-03-26 22:59:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '8379ce6a-5c44-5957-9b56-b8dfd0fc742b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'LAND ROVER',
 'model': 'DISCOVERY SPORT',
 'odometer': 111609,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'LAND ROVER DISCOVERY SPORT 1.5 P300E PHEV S 4WD AUTO',
 'transmission': 'automatic',
 'trim': '1.5 P300E PHEV S 4WD AUTO',
 'vin': None,
 'year': 2021}
2026-03-26 22:59:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982452%27 HTTP/1.1" 200 None
2026-03-26 22:59:24 [ayvens.be] INFO: Saving data for 1982452: {'auction_closing_time': 1774942200.0, 'created_time': 1774479007.655769, 'last_price_update_time': 1774565964.557424}
2026-03-26 22:59:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982452') HTTP/1.1" 204 0
2026-03-26 22:59:24 [ayvens.be] INFO: Found listing with ID: 1982453
2026-03-26 22:59:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982453%27 HTTP/1.1" 200 None
2026-03-26 22:59:24 [ayvens.be] INFO: Scrape type for 1982453: 2
2026-03-26 22:59:24 [ayvens.be] INFO: Extracting data for car ID: 1982453
2026-03-26 22:59:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e9370e14-c0eb-5ddf-8842-2b34b9c2017a with identifier: 1982453
2026-03-26 22:59:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9370e14-c0eb-5ddf-8842-2b34b9c2017a with scrape type 2
2026-03-26 22:59:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e9370e14-c0eb-5ddf-8842-2b34b9c2017a with scrape type 2
2026-03-26 22:59:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e9370e14-c0eb-5ddf-8842-2b34b9c2017a, identifier: 1982453
2026-03-26 22:59:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e9370e14-c0eb-5ddf-8842-2b34b9c2017a with identifier: 1982453
2026-03-26 22:59:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e9370e14-c0eb-5ddf-8842-2b34b9c2017a with identifier: 1982453
2026-03-26 22:59:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e9370e14-c0eb-5ddf-8842-2b34b9c2017a with identifier: 1982453 to the API
2026-03-26 22:59:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'e9370e14-c0eb-5ddf-8842-2b34b9c2017a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'FOCUS CLIPPER',
 'odometer': 85509,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD FOCUS CLIPPER 1.5 ECOBLUE 88KW ST-LINE',
 'transmission': 'manual',
 'trim': '1.5 ECOBLUE 88KW ST-LINE',
 'vin': None,
 'year': 2021}
2026-03-26 22:59:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982453%27 HTTP/1.1" 200 None
2026-03-26 22:59:24 [ayvens.be] INFO: Saving data for 1982453: {'auction_closing_time': 1774942200.0, 'created_time': 1774479011.087251, 'last_price_update_time': 1774565964.941162}
2026-03-26 22:59:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982453') HTTP/1.1" 204 0
2026-03-26 22:59:24 [ayvens.be] INFO: Found listing with ID: 1982454
2026-03-26 22:59:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982454%27 HTTP/1.1" 200 None
2026-03-26 22:59:24 [ayvens.be] INFO: Scrape type for 1982454: 2
2026-03-26 22:59:24 [ayvens.be] INFO: Extracting data for car ID: 1982454
2026-03-26 22:59:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 217ee1da-dc21-5227-8fe5-b861fcdd2aa0 with identifier: 1982454
2026-03-26 22:59:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 217ee1da-dc21-5227-8fe5-b861fcdd2aa0 with scrape type 2
2026-03-26 22:59:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 217ee1da-dc21-5227-8fe5-b861fcdd2aa0 with scrape type 2
2026-03-26 22:59:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 217ee1da-dc21-5227-8fe5-b861fcdd2aa0, identifier: 1982454
2026-03-26 22:59:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 217ee1da-dc21-5227-8fe5-b861fcdd2aa0 with identifier: 1982454
2026-03-26 22:59:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 217ee1da-dc21-5227-8fe5-b861fcdd2aa0 with identifier: 1982454
2026-03-26 22:59:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 217ee1da-dc21-5227-8fe5-b861fcdd2aa0 with identifier: 1982454 to the API
2026-03-26 22:59:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '217ee1da-dc21-5227-8fe5-b861fcdd2aa0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '3 SERIES TOURING',
 'odometer': 88839,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3 SERIES TOURING 2.0 316DA (90KW) TOURING',
 'transmission': 'automatic',
 'trim': '2.0 316DA (90KW) TOURING',
 'vin': None,
 'year': 2021}
2026-03-26 22:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982454%27 HTTP/1.1" 200 None
2026-03-26 22:59:25 [ayvens.be] INFO: Saving data for 1982454: {'auction_closing_time': 1774942200.0, 'created_time': 1774479012.9934, 'last_price_update_time': 1774565965.309476}
2026-03-26 22:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982454') HTTP/1.1" 204 0
2026-03-26 22:59:25 [ayvens.be] INFO: Found listing with ID: 1982455
2026-03-26 22:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982455%27 HTTP/1.1" 200 None
2026-03-26 22:59:25 [ayvens.be] INFO: Scrape type for 1982455: 2
2026-03-26 22:59:25 [ayvens.be] INFO: Extracting data for car ID: 1982455
2026-03-26 22:59:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e5937440-5f5a-5726-91e1-234d4722949e with identifier: 1982455
2026-03-26 22:59:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5937440-5f5a-5726-91e1-234d4722949e with scrape type 2
2026-03-26 22:59:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e5937440-5f5a-5726-91e1-234d4722949e with scrape type 2
2026-03-26 22:59:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e5937440-5f5a-5726-91e1-234d4722949e, identifier: 1982455
2026-03-26 22:59:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e5937440-5f5a-5726-91e1-234d4722949e with identifier: 1982455
2026-03-26 22:59:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e5937440-5f5a-5726-91e1-234d4722949e with identifier: 1982455
2026-03-26 22:59:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e5937440-5f5a-5726-91e1-234d4722949e with identifier: 1982455 to the API
2026-03-26 22:59:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.5L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'e5937440-5f5a-5726-91e1-234d4722949e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'LEXUS',
 'model': 'ES',
 'odometer': 110761,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'LEXUS ES 2.5 300H HEV EXPLORE LINE',
 'transmission': 'automatic',
 'trim': '2.5 300H HEV EXPLORE LINE',
 'vin': None,
 'year': 2021}
2026-03-26 22:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982455%27 HTTP/1.1" 200 None
2026-03-26 22:59:25 [ayvens.be] INFO: Saving data for 1982455: {'auction_closing_time': 1774942200.0, 'created_time': 1774479014.514879, 'last_price_update_time': 1774565965.697843}
2026-03-26 22:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982455') HTTP/1.1" 204 0
2026-03-26 22:59:25 [ayvens.be] INFO: Found listing with ID: 1982456
2026-03-26 22:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982456%27 HTTP/1.1" 200 None
2026-03-26 22:59:25 [ayvens.be] INFO: Scrape type for 1982456: 2
2026-03-26 22:59:25 [ayvens.be] INFO: Extracting data for car ID: 1982456
2026-03-26 22:59:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 680145e4-e929-5ac8-a9fc-3c7d2628abbb with identifier: 1982456
2026-03-26 22:59:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 680145e4-e929-5ac8-a9fc-3c7d2628abbb with scrape type 2
2026-03-26 22:59:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 680145e4-e929-5ac8-a9fc-3c7d2628abbb with scrape type 2
2026-03-26 22:59:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 680145e4-e929-5ac8-a9fc-3c7d2628abbb, identifier: 1982456
2026-03-26 22:59:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 680145e4-e929-5ac8-a9fc-3c7d2628abbb with identifier: 1982456
2026-03-26 22:59:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 680145e4-e929-5ac8-a9fc-3c7d2628abbb with identifier: 1982456
2026-03-26 22:59:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 680145e4-e929-5ac8-a9fc-3c7d2628abbb with identifier: 1982456 to the API
2026-03-26 22:59:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.3L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '680145e4-e929-5ac8-a9fc-3c7d2628abbb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLA',
 'odometer': 93864,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLA 1.3 CLA 250 E BUSINESS SOLUTION DCT',
 'transmission': 'automatic',
 'trim': '1.3 CLA 250 E BUSINESS SOLUTION DCT',
 'vin': None,
 'year': 2022}
2026-03-26 22:59:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982456%27 HTTP/1.1" 200 None
2026-03-26 22:59:26 [ayvens.be] INFO: Saving data for 1982456: {'auction_closing_time': 1774942200.0, 'created_time': 1774479017.841809, 'last_price_update_time': 1774565966.06724}
2026-03-26 22:59:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982456') HTTP/1.1" 204 0
2026-03-26 22:59:26 [ayvens.be] INFO: Found listing with ID: 1982457
2026-03-26 22:59:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982457%27 HTTP/1.1" 200 None
2026-03-26 22:59:26 [ayvens.be] INFO: Scrape type for 1982457: 2
2026-03-26 22:59:26 [ayvens.be] INFO: Extracting data for car ID: 1982457
2026-03-26 22:59:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e98e6b75-f185-59ed-bb03-81af154fd551 with identifier: 1982457
2026-03-26 22:59:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e98e6b75-f185-59ed-bb03-81af154fd551 with scrape type 2
2026-03-26 22:59:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e98e6b75-f185-59ed-bb03-81af154fd551 with scrape type 2
2026-03-26 22:59:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e98e6b75-f185-59ed-bb03-81af154fd551, identifier: 1982457
2026-03-26 22:59:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e98e6b75-f185-59ed-bb03-81af154fd551 with identifier: 1982457
2026-03-26 22:59:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e98e6b75-f185-59ed-bb03-81af154fd551 with identifier: 1982457
2026-03-26 22:59:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e98e6b75-f185-59ed-bb03-81af154fd551 with identifier: 1982457 to the API
2026-03-26 22:59:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'e98e6b75-f185-59ed-bb03-81af154fd551',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'RAV4',
 'odometer': 117920,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA RAV4 2.5 HYBRID DYNAMIC BUSINESS E-CVT',
 'transmission': 'automatic',
 'trim': '2.5 HYBRID DYNAMIC BUSINESS E-CVT',
 'vin': None,
 'year': 2020}
2026-03-26 22:59:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982457%27 HTTP/1.1" 200 None
2026-03-26 22:59:26 [ayvens.be] INFO: Saving data for 1982457: {'auction_closing_time': 1774942200.0, 'created_time': 1774479019.188729, 'last_price_update_time': 1774565966.426951}
2026-03-26 22:59:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982457') HTTP/1.1" 204 0
2026-03-26 22:59:26 [ayvens.be] INFO: Found listing with ID: 1982458
2026-03-26 22:59:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982458%27 HTTP/1.1" 200 None
2026-03-26 22:59:26 [ayvens.be] INFO: Scrape type for 1982458: 2
2026-03-26 22:59:26 [ayvens.be] INFO: Extracting data for car ID: 1982458
2026-03-26 22:59:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2fc4b69-4ee2-5ab1-b8c3-0ffdb618c2f1 with identifier: 1982458
2026-03-26 22:59:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2fc4b69-4ee2-5ab1-b8c3-0ffdb618c2f1 with scrape type 2
2026-03-26 22:59:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f2fc4b69-4ee2-5ab1-b8c3-0ffdb618c2f1 with scrape type 2
2026-03-26 22:59:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f2fc4b69-4ee2-5ab1-b8c3-0ffdb618c2f1, identifier: 1982458
2026-03-26 22:59:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f2fc4b69-4ee2-5ab1-b8c3-0ffdb618c2f1 with identifier: 1982458
2026-03-26 22:59:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f2fc4b69-4ee2-5ab1-b8c3-0ffdb618c2f1 with identifier: 1982458
2026-03-26 22:59:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f2fc4b69-4ee2-5ab1-b8c3-0ffdb618c2f1 with identifier: 1982458 to the API
2026-03-26 22:59:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'f2fc4b69-4ee2-5ab1-b8c3-0ffdb618c2f1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '3 SERIES TOURING',
 'odometer': 85391,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3 SERIES TOURING 2.0 318D (100KW) TOURING',
 'transmission': 'automatic',
 'trim': '2.0 318D (100KW) TOURING',
 'vin': None,
 'year': 2023}
2026-03-26 22:59:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982458%27 HTTP/1.1" 200 None
2026-03-26 22:59:26 [ayvens.be] INFO: Saving data for 1982458: {'auction_closing_time': 1774942200.0, 'created_time': 1774479020.435229, 'last_price_update_time': 1774565966.79015}
2026-03-26 22:59:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982458') HTTP/1.1" 204 0
2026-03-26 22:59:26 [ayvens.be] INFO: Found listing with ID: 1982459
2026-03-26 22:59:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982459%27 HTTP/1.1" 200 None
2026-03-26 22:59:26 [ayvens.be] INFO: Scrape type for 1982459: 2
2026-03-26 22:59:26 [ayvens.be] INFO: Extracting data for car ID: 1982459
2026-03-26 22:59:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 10a5e25e-516f-5f87-bbbb-30b29f313e8f with identifier: 1982459
2026-03-26 22:59:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10a5e25e-516f-5f87-bbbb-30b29f313e8f with scrape type 2
2026-03-26 22:59:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 10a5e25e-516f-5f87-bbbb-30b29f313e8f with scrape type 2
2026-03-26 22:59:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 10a5e25e-516f-5f87-bbbb-30b29f313e8f, identifier: 1982459
2026-03-26 22:59:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 10a5e25e-516f-5f87-bbbb-30b29f313e8f with identifier: 1982459
2026-03-26 22:59:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 10a5e25e-516f-5f87-bbbb-30b29f313e8f with identifier: 1982459
2026-03-26 22:59:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 10a5e25e-516f-5f87-bbbb-30b29f313e8f with identifier: 1982459 to the API
2026-03-26 22:59:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '10a5e25e-516f-5f87-bbbb-30b29f313e8f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'T-ROC',
 'odometer': 119346,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN T-ROC 1.0 TSI STYLE',
 'transmission': 'manual',
 'trim': '1.0 TSI STYLE',
 'vin': None,
 'year': 2020}
2026-03-26 22:59:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982459%27 HTTP/1.1" 200 None
2026-03-26 22:59:27 [ayvens.be] INFO: Saving data for 1982459: {'auction_closing_time': 1774942200.0, 'created_time': 1774479027.959642, 'last_price_update_time': 1774565967.29225}
2026-03-26 22:59:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982459') HTTP/1.1" 204 0
2026-03-26 22:59:27 [ayvens.be] INFO: Found listing with ID: 1982460
2026-03-26 22:59:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982460%27 HTTP/1.1" 200 None
2026-03-26 22:59:27 [ayvens.be] INFO: Scrape type for 1982460: 2
2026-03-26 22:59:27 [ayvens.be] INFO: Extracting data for car ID: 1982460
2026-03-26 22:59:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 31ba1b1c-b18f-5649-8f03-bc82dc358998 with identifier: 1982460
2026-03-26 22:59:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31ba1b1c-b18f-5649-8f03-bc82dc358998 with scrape type 2
2026-03-26 22:59:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 31ba1b1c-b18f-5649-8f03-bc82dc358998 with scrape type 2
2026-03-26 22:59:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 31ba1b1c-b18f-5649-8f03-bc82dc358998, identifier: 1982460
2026-03-26 22:59:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 31ba1b1c-b18f-5649-8f03-bc82dc358998 with identifier: 1982460
2026-03-26 22:59:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 31ba1b1c-b18f-5649-8f03-bc82dc358998 with identifier: 1982460
2026-03-26 22:59:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 31ba1b1c-b18f-5649-8f03-bc82dc358998 with identifier: 1982460 to the API
2026-03-26 22:59:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '31ba1b1c-b18f-5649-8f03-bc82dc358998',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3',
 'odometer': 110356,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 2.0 35 TDI S TRONIC BUS. ED. ATTRACTION',
 'transmission': 'automatic',
 'trim': '2.0 35 TDI S TRONIC BUS. ED. ATTRACTION',
 'vin': None,
 'year': 2023}
2026-03-26 22:59:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982460%27 HTTP/1.1" 200 None
2026-03-26 22:59:27 [ayvens.be] INFO: Saving data for 1982460: {'auction_closing_time': 1774942200.0, 'created_time': 1774479023.903214, 'last_price_update_time': 1774565967.662386}
2026-03-26 22:59:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982460') HTTP/1.1" 204 0
2026-03-26 22:59:27 [ayvens.be] INFO: Found listing with ID: 1982461
2026-03-26 22:59:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982461%27 HTTP/1.1" 200 None
2026-03-26 22:59:27 [ayvens.be] INFO: Scrape type for 1982461: 2
2026-03-26 22:59:27 [ayvens.be] INFO: Extracting data for car ID: 1982461
2026-03-26 22:59:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 727ae113-be3c-5cd8-819d-c53d0943f35d with identifier: 1982461
2026-03-26 22:59:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 727ae113-be3c-5cd8-819d-c53d0943f35d with scrape type 2
2026-03-26 22:59:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 727ae113-be3c-5cd8-819d-c53d0943f35d with scrape type 2
2026-03-26 22:59:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 727ae113-be3c-5cd8-819d-c53d0943f35d, identifier: 1982461
2026-03-26 22:59:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 727ae113-be3c-5cd8-819d-c53d0943f35d with identifier: 1982461
2026-03-26 22:59:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 727ae113-be3c-5cd8-819d-c53d0943f35d with identifier: 1982461
2026-03-26 22:59:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 727ae113-be3c-5cd8-819d-c53d0943f35d with identifier: 1982461 to the API
2026-03-26 22:59:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '727ae113-be3c-5cd8-819d-c53d0943f35d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'HYUNDAI',
 'model': 'SANTA FE',
 'odometer': 100708,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'HYUNDAI SANTA FE 1.6 T-GDI PHEV 4WD SHINE AUTO',
 'transmission': 'automatic',
 'trim': '1.6 T-GDI PHEV 4WD SHINE AUTO',
 'vin': None,
 'year': 2022}
2026-03-26 22:59:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982461%27 HTTP/1.1" 200 None
2026-03-26 22:59:28 [ayvens.be] INFO: Saving data for 1982461: {'auction_closing_time': 1774942200.0, 'created_time': 1774479026.600928, 'last_price_update_time': 1774565968.058098}
2026-03-26 22:59:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982461') HTTP/1.1" 204 0
2026-03-26 22:59:28 [ayvens.be] INFO: Found listing with ID: 1982462
2026-03-26 22:59:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982462%27 HTTP/1.1" 200 None
2026-03-26 22:59:28 [ayvens.be] INFO: Scrape type for 1982462: 2
2026-03-26 22:59:28 [ayvens.be] INFO: Extracting data for car ID: 1982462
2026-03-26 22:59:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d58fe7a9-29b5-53a0-8f5f-57935b9876bf with identifier: 1982462
2026-03-26 22:59:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d58fe7a9-29b5-53a0-8f5f-57935b9876bf with scrape type 2
2026-03-26 22:59:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d58fe7a9-29b5-53a0-8f5f-57935b9876bf with scrape type 2
2026-03-26 22:59:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d58fe7a9-29b5-53a0-8f5f-57935b9876bf, identifier: 1982462
2026-03-26 22:59:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d58fe7a9-29b5-53a0-8f5f-57935b9876bf with identifier: 1982462
2026-03-26 22:59:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d58fe7a9-29b5-53a0-8f5f-57935b9876bf with identifier: 1982462
2026-03-26 22:59:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d58fe7a9-29b5-53a0-8f5f-57935b9876bf with identifier: 1982462 to the API
2026-03-26 22:59:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'd58fe7a9-29b5-53a0-8f5f-57935b9876bf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT CUSTOM',
 'odometer': 88626,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-28',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FORD TRANSIT CUSTOM 2.0TD 130PS TREND FWD 300 LWB',
 'transmission': 'manual',
 'trim': '2.0TD 130PS TREND FWD 300 LWB',
 'vin': None,
 'year': 2022}
2026-03-26 22:59:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982462%27 HTTP/1.1" 200 None
2026-03-26 22:59:28 [ayvens.be] INFO: Saving data for 1982462: {'auction_closing_time': 1774942200.0, 'created_time': 1774479025.090594, 'last_price_update_time': 1774565968.412539}
2026-03-26 22:59:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982462') HTTP/1.1" 204 0
2026-03-26 22:59:28 [ayvens.be] INFO: Found listing with ID: 1982463
2026-03-26 22:59:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982463%27 HTTP/1.1" 200 None
2026-03-26 22:59:28 [ayvens.be] INFO: Scrape type for 1982463: 2
2026-03-26 22:59:28 [ayvens.be] INFO: Extracting data for car ID: 1982463
2026-03-26 22:59:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2e3a40c-f91b-586f-9246-b79dc3c5b78b with identifier: 1982463
2026-03-26 22:59:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2e3a40c-f91b-586f-9246-b79dc3c5b78b with scrape type 2
2026-03-26 22:59:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e2e3a40c-f91b-586f-9246-b79dc3c5b78b with scrape type 2
2026-03-26 22:59:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e2e3a40c-f91b-586f-9246-b79dc3c5b78b, identifier: 1982463
2026-03-26 22:59:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e2e3a40c-f91b-586f-9246-b79dc3c5b78b with identifier: 1982463
2026-03-26 22:59:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e2e3a40c-f91b-586f-9246-b79dc3c5b78b with identifier: 1982463
2026-03-26 22:59:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e2e3a40c-f91b-586f-9246-b79dc3c5b78b with identifier: 1982463 to the API
2026-03-26 22:59:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'e2e3a40c-f91b-586f-9246-b79dc3c5b78b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '308 SW',
 'odometer': 87111,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 308 SW 1.2 PURETECH 96KW S-S AUTO GT PACK',
 'transmission': 'automatic',
 'trim': '1.2 PURETECH 96KW S-S AUTO GT PACK',
 'vin': None,
 'year': 2023}
2026-03-26 22:59:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982463%27 HTTP/1.1" 200 None
2026-03-26 22:59:28 [ayvens.be] INFO: Saving data for 1982463: {'auction_closing_time': 1774942200.0, 'created_time': 1774479027.61123, 'last_price_update_time': 1774565968.76564}
2026-03-26 22:59:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982463') HTTP/1.1" 204 0
2026-03-26 22:59:28 [ayvens.be] INFO: Found listing with ID: 1982464
2026-03-26 22:59:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982464%27 HTTP/1.1" 200 None
2026-03-26 22:59:28 [ayvens.be] INFO: Scrape type for 1982464: 2
2026-03-26 22:59:28 [ayvens.be] INFO: Extracting data for car ID: 1982464
2026-03-26 22:59:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 69d499af-3843-575a-be0e-d5894765409c with identifier: 1982464
2026-03-26 22:59:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69d499af-3843-575a-be0e-d5894765409c with scrape type 2
2026-03-26 22:59:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 69d499af-3843-575a-be0e-d5894765409c with scrape type 2
2026-03-26 22:59:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 69d499af-3843-575a-be0e-d5894765409c, identifier: 1982464
2026-03-26 22:59:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 69d499af-3843-575a-be0e-d5894765409c with identifier: 1982464
2026-03-26 22:59:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 69d499af-3843-575a-be0e-d5894765409c with identifier: 1982464
2026-03-26 22:59:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 69d499af-3843-575a-be0e-d5894765409c with identifier: 1982464 to the API
2026-03-26 22:59:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '69d499af-3843-575a-be0e-d5894765409c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'C-HR',
 'odometer': 85456,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA C-HR 2.0 VVT-I HEV C-LUB MONO-TONE AUTO',
 'transmission': 'automatic',
 'trim': '2.0 VVT-I HEV C-LUB MONO-TONE AUTO',
 'vin': None,
 'year': 2022}
2026-03-26 22:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982464%27 HTTP/1.1" 200 None
2026-03-26 22:59:29 [ayvens.be] INFO: Saving data for 1982464: {'auction_closing_time': 1774942200.0, 'created_time': 1774479030.612408, 'last_price_update_time': 1774565969.157431}
2026-03-26 22:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982464') HTTP/1.1" 204 0
2026-03-26 22:59:29 [ayvens.be] INFO: Found listing with ID: 1982465
2026-03-26 22:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982465%27 HTTP/1.1" 200 None
2026-03-26 22:59:29 [ayvens.be] INFO: Scrape type for 1982465: 2
2026-03-26 22:59:29 [ayvens.be] INFO: Extracting data for car ID: 1982465
2026-03-26 22:59:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f050986b-f470-5a9e-af76-068d8f4cf6e6 with identifier: 1982465
2026-03-26 22:59:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f050986b-f470-5a9e-af76-068d8f4cf6e6 with scrape type 2
2026-03-26 22:59:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f050986b-f470-5a9e-af76-068d8f4cf6e6 with scrape type 2
2026-03-26 22:59:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f050986b-f470-5a9e-af76-068d8f4cf6e6, identifier: 1982465
2026-03-26 22:59:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f050986b-f470-5a9e-af76-068d8f4cf6e6 with identifier: 1982465
2026-03-26 22:59:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f050986b-f470-5a9e-af76-068d8f4cf6e6 with identifier: 1982465
2026-03-26 22:59:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f050986b-f470-5a9e-af76-068d8f4cf6e6 with identifier: 1982465 to the API
2026-03-26 22:59:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'f050986b-f470-5a9e-af76-068d8f4cf6e6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A4 AVANT',
 'odometer': 102933,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A4 AVANT 2.0 30 TDI 100KW S TR BUSINESS ED',
 'transmission': 'automatic',
 'trim': '2.0 30 TDI 100KW S TR BUSINESS ED',
 'vin': None,
 'year': 2020}
2026-03-26 22:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982465%27 HTTP/1.1" 200 None
2026-03-26 22:59:29 [ayvens.be] INFO: Saving data for 1982465: {'auction_closing_time': 1774942200.0, 'created_time': 1774479031.724177, 'last_price_update_time': 1774565969.528155}
2026-03-26 22:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982465') HTTP/1.1" 204 0
2026-03-26 22:59:29 [ayvens.be] INFO: Found listing with ID: 1982466
2026-03-26 22:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982466%27 HTTP/1.1" 200 None
2026-03-26 22:59:29 [ayvens.be] INFO: Scrape type for 1982466: 2
2026-03-26 22:59:29 [ayvens.be] INFO: Extracting data for car ID: 1982466
2026-03-26 22:59:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3464b5bd-93fc-5dc3-b4fe-0e113f01eeeb with identifier: 1982466
2026-03-26 22:59:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3464b5bd-93fc-5dc3-b4fe-0e113f01eeeb with scrape type 2
2026-03-26 22:59:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3464b5bd-93fc-5dc3-b4fe-0e113f01eeeb with scrape type 2
2026-03-26 22:59:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 3464b5bd-93fc-5dc3-b4fe-0e113f01eeeb, identifier: 1982466
2026-03-26 22:59:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 3464b5bd-93fc-5dc3-b4fe-0e113f01eeeb with identifier: 1982466
2026-03-26 22:59:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 3464b5bd-93fc-5dc3-b4fe-0e113f01eeeb with identifier: 1982466
2026-03-26 22:59:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 3464b5bd-93fc-5dc3-b4fe-0e113f01eeeb with identifier: 1982466 to the API
2026-03-26 22:59:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '3464b5bd-93fc-5dc3-b4fe-0e113f01eeeb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 89351,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 1.5 XDRIVE25E PHEV 162KW)',
 'transmission': 'automatic',
 'trim': '1.5 XDRIVE25E PHEV 162KW)',
 'vin': None,
 'year': 2022}
2026-03-26 22:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982466%27 HTTP/1.1" 200 None
2026-03-26 22:59:29 [ayvens.be] INFO: Saving data for 1982466: {'auction_closing_time': 1774942200.0, 'created_time': 1774479034.142029, 'last_price_update_time': 1774565969.901316}
2026-03-26 22:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982466') HTTP/1.1" 204 0
2026-03-26 22:59:29 [ayvens.be] INFO: Found listing with ID: 1982467
2026-03-26 22:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982467%27 HTTP/1.1" 200 None
2026-03-26 22:59:29 [ayvens.be] INFO: Scrape type for 1982467: 2
2026-03-26 22:59:29 [ayvens.be] INFO: Extracting data for car ID: 1982467
2026-03-26 22:59:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4159fc8d-9f3b-5a91-8c5a-7df3821f96ae with identifier: 1982467
2026-03-26 22:59:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4159fc8d-9f3b-5a91-8c5a-7df3821f96ae with scrape type 2
2026-03-26 22:59:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4159fc8d-9f3b-5a91-8c5a-7df3821f96ae with scrape type 2
2026-03-26 22:59:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 4159fc8d-9f3b-5a91-8c5a-7df3821f96ae, identifier: 1982467
2026-03-26 22:59:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 4159fc8d-9f3b-5a91-8c5a-7df3821f96ae with identifier: 1982467
2026-03-26 22:59:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 4159fc8d-9f3b-5a91-8c5a-7df3821f96ae with identifier: 1982467
2026-03-26 22:59:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 4159fc8d-9f3b-5a91-8c5a-7df3821f96ae with identifier: 1982467 to the API
2026-03-26 22:59:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '4159fc8d-9f3b-5a91-8c5a-7df3821f96ae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '5008 DIESEL - 2017',
 'odometer': 102775,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-12',
 'seats_number': 7,
 'seller_name': None,
 'title': 'PEUGEOT 5008 DIESEL - 2017 1.5 BlueHDi Access (EU6.2) STOCK',
 'transmission': 'manual',
 'trim': '1.5 BlueHDi Access (EU6.2) STOCK',
 'vin': None,
 'year': 2020}
2026-03-26 22:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982467%27 HTTP/1.1" 200 None
2026-03-26 22:59:30 [ayvens.be] INFO: Saving data for 1982467: {'auction_closing_time': 1774942200.0, 'created_time': 1774479035.652814, 'last_price_update_time': 1774565970.292757}
2026-03-26 22:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982467') HTTP/1.1" 204 0
2026-03-26 22:59:30 [ayvens.be] INFO: Found listing with ID: 1982468
2026-03-26 22:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982468%27 HTTP/1.1" 200 None
2026-03-26 22:59:30 [ayvens.be] INFO: Scrape type for 1982468: 2
2026-03-26 22:59:30 [ayvens.be] INFO: Extracting data for car ID: 1982468
2026-03-26 22:59:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b3a8e03-6d71-5262-919f-fa0570eaa289 with identifier: 1982468
2026-03-26 22:59:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b3a8e03-6d71-5262-919f-fa0570eaa289 with scrape type 2
2026-03-26 22:59:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5b3a8e03-6d71-5262-919f-fa0570eaa289 with scrape type 2
2026-03-26 22:59:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 5b3a8e03-6d71-5262-919f-fa0570eaa289, identifier: 1982468
2026-03-26 22:59:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 5b3a8e03-6d71-5262-919f-fa0570eaa289 with identifier: 1982468
2026-03-26 22:59:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 5b3a8e03-6d71-5262-919f-fa0570eaa289 with identifier: 1982468
2026-03-26 22:59:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 5b3a8e03-6d71-5262-919f-fa0570eaa289 with identifier: 1982468 to the API
2026-03-26 22:59:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '5b3a8e03-6d71-5262-919f-fa0570eaa289',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 82918,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 1.5 SDRIVE16D',
 'transmission': 'manual',
 'trim': '1.5 SDRIVE16D',
 'vin': None,
 'year': 2020}
2026-03-26 22:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982468%27 HTTP/1.1" 200 None
2026-03-26 22:59:30 [ayvens.be] INFO: Saving data for 1982468: {'auction_closing_time': 1774942200.0, 'created_time': 1774479038.503995, 'last_price_update_time': 1774565970.661664}
2026-03-26 22:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982468') HTTP/1.1" 204 0
2026-03-26 22:59:30 [ayvens.be] INFO: Found listing with ID: 1982469
2026-03-26 22:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982469%27 HTTP/1.1" 200 None
2026-03-26 22:59:30 [ayvens.be] INFO: Scrape type for 1982469: 2
2026-03-26 22:59:30 [ayvens.be] INFO: Extracting data for car ID: 1982469
2026-03-26 22:59:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf27518d-000f-541f-8175-556aea3c18e6 with identifier: 1982469
2026-03-26 22:59:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf27518d-000f-541f-8175-556aea3c18e6 with scrape type 2
2026-03-26 22:59:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cf27518d-000f-541f-8175-556aea3c18e6 with scrape type 2
2026-03-26 22:59:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: cf27518d-000f-541f-8175-556aea3c18e6, identifier: 1982469
2026-03-26 22:59:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: cf27518d-000f-541f-8175-556aea3c18e6 with identifier: 1982469
2026-03-26 22:59:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: cf27518d-000f-541f-8175-556aea3c18e6 with identifier: 1982469
2026-03-26 22:59:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: cf27518d-000f-541f-8175-556aea3c18e6 with identifier: 1982469 to the API
2026-03-26 22:59:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'cf27518d-000f-541f-8175-556aea3c18e6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'LEON - 2020',
 'odometer': 50464,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT LEON - 2020 1.0 EcoTSI Move!',
 'transmission': 'manual',
 'trim': '1.0 EcoTSI Move!',
 'vin': None,
 'year': 2021}
2026-03-26 22:59:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982469%27 HTTP/1.1" 200 None
2026-03-26 22:59:31 [ayvens.be] INFO: Saving data for 1982469: {'auction_closing_time': 1774942200.0, 'created_time': 1774479045.365469, 'last_price_update_time': 1774565971.345304}
2026-03-26 22:59:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982469') HTTP/1.1" 204 0
2026-03-26 22:59:31 [ayvens.be] INFO: Found listing with ID: 1982470
2026-03-26 22:59:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982470%27 HTTP/1.1" 200 None
2026-03-26 22:59:31 [ayvens.be] INFO: Scrape type for 1982470: 2
2026-03-26 22:59:31 [ayvens.be] INFO: Extracting data for car ID: 1982470
2026-03-26 22:59:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d9d57ab0-6978-5be0-be88-6219e02c2e1b with identifier: 1982470
2026-03-26 22:59:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9d57ab0-6978-5be0-be88-6219e02c2e1b with scrape type 2
2026-03-26 22:59:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d9d57ab0-6978-5be0-be88-6219e02c2e1b with scrape type 2
2026-03-26 22:59:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d9d57ab0-6978-5be0-be88-6219e02c2e1b, identifier: 1982470
2026-03-26 22:59:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d9d57ab0-6978-5be0-be88-6219e02c2e1b with identifier: 1982470
2026-03-26 22:59:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d9d57ab0-6978-5be0-be88-6219e02c2e1b with identifier: 1982470
2026-03-26 22:59:31 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d9d57ab0-6978-5be0-be88-6219e02c2e1b with identifier: 1982470 to the API
2026-03-26 22:59:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '0.9L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'd9d57ab0-6978-5be0-be88-6219e02c2e1b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'Clio',
 'odometer': 41062,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT Clio 0.9 TCe Zen (EU6c) STOCK',
 'transmission': 'manual',
 'trim': '0.9 TCe Zen (EU6c) STOCK',
 'vin': None,
 'year': 2020}
2026-03-26 22:59:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982470%27 HTTP/1.1" 200 None
2026-03-26 22:59:31 [ayvens.be] INFO: Saving data for 1982470: {'auction_closing_time': 1774942200.0, 'created_time': 1774479045.002639, 'last_price_update_time': 1774565971.997345}
2026-03-26 22:59:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982470') HTTP/1.1" 204 0
2026-03-26 22:59:32 [ayvens.be] INFO: Found listing with ID: 1982471
2026-03-26 22:59:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982471%27 HTTP/1.1" 200 None
2026-03-26 22:59:32 [ayvens.be] INFO: Scrape type for 1982471: 2
2026-03-26 22:59:32 [ayvens.be] INFO: Extracting data for car ID: 1982471
2026-03-26 22:59:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1756c4f5-4977-5b7a-b6d9-1eb44bd4c4ad with identifier: 1982471
2026-03-26 22:59:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1756c4f5-4977-5b7a-b6d9-1eb44bd4c4ad with scrape type 2
2026-03-26 22:59:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1756c4f5-4977-5b7a-b6d9-1eb44bd4c4ad with scrape type 2
2026-03-26 22:59:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 1756c4f5-4977-5b7a-b6d9-1eb44bd4c4ad, identifier: 1982471
2026-03-26 22:59:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 1756c4f5-4977-5b7a-b6d9-1eb44bd4c4ad with identifier: 1982471
2026-03-26 22:59:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 1756c4f5-4977-5b7a-b6d9-1eb44bd4c4ad with identifier: 1982471
2026-03-26 22:59:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 1756c4f5-4977-5b7a-b6d9-1eb44bd4c4ad with identifier: 1982471 to the API
2026-03-26 22:59:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'electric',
 'id': '1756c4f5-4977-5b7a-b6d9-1eb44bd4c4ad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 36446,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-25',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 22 KWH MAXI Z.E. B-BUY 2-SEATS',
 'transmission': 'automatic',
 'trim': '22 KWH MAXI Z.E. B-BUY 2-SEATS',
 'vin': None,
 'year': 2021}
2026-03-26 22:59:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982471%27 HTTP/1.1" 200 None
2026-03-26 22:59:32 [ayvens.be] INFO: Saving data for 1982471: {'auction_closing_time': 1774942200.0, 'created_time': 1774479041.703581, 'last_price_update_time': 1774565972.373947}
2026-03-26 22:59:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982471') HTTP/1.1" 204 0
2026-03-26 22:59:32 [ayvens.be] INFO: Found listing with ID: 1982472
2026-03-26 22:59:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982472%27 HTTP/1.1" 200 None
2026-03-26 22:59:32 [ayvens.be] INFO: Scrape type for 1982472: 2
2026-03-26 22:59:32 [ayvens.be] INFO: Extracting data for car ID: 1982472
2026-03-26 22:59:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4acd9598-579a-5dde-90fd-00aca329922f with identifier: 1982472
2026-03-26 22:59:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4acd9598-579a-5dde-90fd-00aca329922f with scrape type 2
2026-03-26 22:59:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4acd9598-579a-5dde-90fd-00aca329922f with scrape type 2
2026-03-26 22:59:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 4acd9598-579a-5dde-90fd-00aca329922f, identifier: 1982472
2026-03-26 22:59:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 4acd9598-579a-5dde-90fd-00aca329922f with identifier: 1982472
2026-03-26 22:59:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 4acd9598-579a-5dde-90fd-00aca329922f with identifier: 1982472
2026-03-26 22:59:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 4acd9598-579a-5dde-90fd-00aca329922f with identifier: 1982472 to the API
2026-03-26 22:59:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '4acd9598-579a-5dde-90fd-00aca329922f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'DACIA',
 'model': 'SANDERO',
 'odometer': 34186,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DACIA SANDERO 1.0 SCE 65 ESSENTIAL',
 'transmission': 'manual',
 'trim': '1.0 SCE 65 ESSENTIAL',
 'vin': None,
 'year': 2022}
2026-03-26 22:59:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982472%27 HTTP/1.1" 200 None
2026-03-26 22:59:32 [ayvens.be] INFO: Saving data for 1982472: {'auction_closing_time': 1774942200.0, 'created_time': 1774479042.575343, 'last_price_update_time': 1774565972.75095}
2026-03-26 22:59:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982472') HTTP/1.1" 204 0
2026-03-26 22:59:32 [ayvens.be] INFO: Found listing with ID: 1982473
2026-03-26 22:59:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982473%27 HTTP/1.1" 200 None
2026-03-26 22:59:32 [ayvens.be] INFO: Scrape type for 1982473: 2
2026-03-26 22:59:32 [ayvens.be] INFO: Extracting data for car ID: 1982473
2026-03-26 22:59:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 70848cdf-9bb6-577a-af2e-41dfa506b339 with identifier: 1982473
2026-03-26 22:59:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70848cdf-9bb6-577a-af2e-41dfa506b339 with scrape type 2
2026-03-26 22:59:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 70848cdf-9bb6-577a-af2e-41dfa506b339 with scrape type 2
2026-03-26 22:59:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 70848cdf-9bb6-577a-af2e-41dfa506b339, identifier: 1982473
2026-03-26 22:59:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 70848cdf-9bb6-577a-af2e-41dfa506b339 with identifier: 1982473
2026-03-26 22:59:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 70848cdf-9bb6-577a-af2e-41dfa506b339 with identifier: 1982473
2026-03-26 22:59:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 70848cdf-9bb6-577a-af2e-41dfa506b339 with identifier: 1982473 to the API
2026-03-26 22:59:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '70848cdf-9bb6-577a-af2e-41dfa506b339',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': "CEE'D SPORTSWAGON",
 'odometer': 84182,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-01',
 'seats_number': 5,
 'seller_name': None,
 'title': "KIA CEE'D SPORTSWAGON 1.0 T-GDI PULSE",
 'transmission': 'manual',
 'trim': '1.0 T-GDI PULSE',
 'vin': None,
 'year': 2022}
2026-03-26 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982473%27 HTTP/1.1" 200 None
2026-03-26 22:59:33 [ayvens.be] INFO: Saving data for 1982473: {'auction_closing_time': 1774942200.0, 'created_time': 1774479044.628852, 'last_price_update_time': 1774565973.127557}
2026-03-26 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982473') HTTP/1.1" 204 0
2026-03-26 22:59:33 [ayvens.be] INFO: Found listing with ID: 1982474
2026-03-26 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982474%27 HTTP/1.1" 200 None
2026-03-26 22:59:33 [ayvens.be] INFO: Scrape type for 1982474: 2
2026-03-26 22:59:33 [ayvens.be] INFO: Extracting data for car ID: 1982474
2026-03-26 22:59:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aa6a5cdb-54ac-5c28-bf6e-156c60d4f1ef with identifier: 1982474
2026-03-26 22:59:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa6a5cdb-54ac-5c28-bf6e-156c60d4f1ef with scrape type 2
2026-03-26 22:59:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aa6a5cdb-54ac-5c28-bf6e-156c60d4f1ef with scrape type 2
2026-03-26 22:59:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: aa6a5cdb-54ac-5c28-bf6e-156c60d4f1ef, identifier: 1982474
2026-03-26 22:59:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: aa6a5cdb-54ac-5c28-bf6e-156c60d4f1ef with identifier: 1982474
2026-03-26 22:59:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: aa6a5cdb-54ac-5c28-bf6e-156c60d4f1ef with identifier: 1982474
2026-03-26 22:59:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: aa6a5cdb-54ac-5c28-bf6e-156c60d4f1ef with identifier: 1982474 to the API
2026-03-26 22:59:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'aa6a5cdb-54ac-5c28-bf6e-156c60d4f1ef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': "CEE'D SPORTSWAGON",
 'odometer': 74440,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-27',
 'seats_number': 5,
 'seller_name': None,
 'title': "KIA CEE'D SPORTSWAGON 1.0 T-GDI PULSE",
 'transmission': 'manual',
 'trim': '1.0 T-GDI PULSE',
 'vin': None,
 'year': 2022}
2026-03-26 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982474%27 HTTP/1.1" 200 None
2026-03-26 22:59:33 [ayvens.be] INFO: Saving data for 1982474: {'auction_closing_time': 1774942200.0, 'created_time': 1774479079.160865, 'last_price_update_time': 1774565973.493212}
2026-03-26 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982474') HTTP/1.1" 204 0
2026-03-26 22:59:33 [ayvens.be] INFO: Found listing with ID: 1982475
2026-03-26 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982475%27 HTTP/1.1" 200 None
2026-03-26 22:59:33 [ayvens.be] INFO: Scrape type for 1982475: 2
2026-03-26 22:59:33 [ayvens.be] INFO: Extracting data for car ID: 1982475
2026-03-26 22:59:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 822a5572-f966-5eba-ab98-a37b168414f4 with identifier: 1982475
2026-03-26 22:59:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 822a5572-f966-5eba-ab98-a37b168414f4 with scrape type 2
2026-03-26 22:59:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 822a5572-f966-5eba-ab98-a37b168414f4 with scrape type 2
2026-03-26 22:59:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 822a5572-f966-5eba-ab98-a37b168414f4, identifier: 1982475
2026-03-26 22:59:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 822a5572-f966-5eba-ab98-a37b168414f4 with identifier: 1982475
2026-03-26 22:59:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 822a5572-f966-5eba-ab98-a37b168414f4 with identifier: 1982475
2026-03-26 22:59:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 822a5572-f966-5eba-ab98-a37b168414f4 with identifier: 1982475 to the API
2026-03-26 22:59:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '822a5572-f966-5eba-ab98-a37b168414f4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'CLIO',
 'odometer': 22943,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT CLIO 1.0 TCE 90 EQUILIBRE',
 'transmission': 'manual',
 'trim': '1.0 TCE 90 EQUILIBRE',
 'vin': None,
 'year': 2023}
2026-03-26 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982475%27 HTTP/1.1" 200 None
2026-03-26 22:59:33 [ayvens.be] INFO: Saving data for 1982475: {'auction_closing_time': 1774942200.0, 'created_time': 1774479054.434738, 'last_price_update_time': 1774565973.8552}
2026-03-26 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982475') HTTP/1.1" 204 0
2026-03-26 22:59:33 [ayvens.be] INFO: Found listing with ID: 1982476
2026-03-26 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982476%27 HTTP/1.1" 200 None
2026-03-26 22:59:33 [ayvens.be] INFO: Scrape type for 1982476: 2
2026-03-26 22:59:33 [ayvens.be] INFO: Extracting data for car ID: 1982476
2026-03-26 22:59:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f69bc805-9b22-5ecf-9ec8-b1dfc34c9e0b with identifier: 1982476
2026-03-26 22:59:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f69bc805-9b22-5ecf-9ec8-b1dfc34c9e0b with scrape type 2
2026-03-26 22:59:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f69bc805-9b22-5ecf-9ec8-b1dfc34c9e0b with scrape type 2
2026-03-26 22:59:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f69bc805-9b22-5ecf-9ec8-b1dfc34c9e0b, identifier: 1982476
2026-03-26 22:59:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f69bc805-9b22-5ecf-9ec8-b1dfc34c9e0b with identifier: 1982476
2026-03-26 22:59:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f69bc805-9b22-5ecf-9ec8-b1dfc34c9e0b with identifier: 1982476
2026-03-26 22:59:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f69bc805-9b22-5ecf-9ec8-b1dfc34c9e0b with identifier: 1982476 to the API
2026-03-26 22:59:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'f69bc805-9b22-5ecf-9ec8-b1dfc34c9e0b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 79604,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 1.5 XDRIVE25E (162KW)',
 'transmission': 'automatic',
 'trim': '1.5 XDRIVE25E (162KW)',
 'vin': None,
 'year': 2021}
2026-03-26 22:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982476%27 HTTP/1.1" 200 None
2026-03-26 22:59:34 [ayvens.be] INFO: Saving data for 1982476: {'auction_closing_time': 1774942200.0, 'created_time': 1774479077.467721, 'last_price_update_time': 1774565974.217501}
2026-03-26 22:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982476') HTTP/1.1" 204 0
2026-03-26 22:59:34 [ayvens.be] INFO: Found listing with ID: 1982477
2026-03-26 22:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982477%27 HTTP/1.1" 200 None
2026-03-26 22:59:34 [ayvens.be] INFO: Scrape type for 1982477: 2
2026-03-26 22:59:34 [ayvens.be] INFO: Extracting data for car ID: 1982477
2026-03-26 22:59:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a2da3de6-8252-5e2c-9288-b1863a165294 with identifier: 1982477
2026-03-26 22:59:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2da3de6-8252-5e2c-9288-b1863a165294 with scrape type 2
2026-03-26 22:59:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a2da3de6-8252-5e2c-9288-b1863a165294 with scrape type 2
2026-03-26 22:59:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a2da3de6-8252-5e2c-9288-b1863a165294, identifier: 1982477
2026-03-26 22:59:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a2da3de6-8252-5e2c-9288-b1863a165294 with identifier: 1982477
2026-03-26 22:59:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a2da3de6-8252-5e2c-9288-b1863a165294 with identifier: 1982477
2026-03-26 22:59:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a2da3de6-8252-5e2c-9288-b1863a165294 with identifier: 1982477 to the API
2026-03-26 22:59:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'electric',
 'id': 'a2da3de6-8252-5e2c-9288-b1863a165294',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'TESLA',
 'model': 'MODEL 3',
 'odometer': 83675,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TESLA MODEL 3 75 kWh Long-Range Dual Motor',
 'transmission': 'automatic',
 'trim': '75 kWh Long-Range Dual Motor',
 'vin': None,
 'year': 2020}
2026-03-26 22:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982477%27 HTTP/1.1" 200 None
2026-03-26 22:59:34 [ayvens.be] INFO: Saving data for 1982477: {'auction_closing_time': 1774942200.0, 'created_time': 1774479075.870906, 'last_price_update_time': 1774565974.592514}
2026-03-26 22:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982477') HTTP/1.1" 204 0
2026-03-26 22:59:34 [ayvens.be] INFO: Found listing with ID: 1982478
2026-03-26 22:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982478%27 HTTP/1.1" 200 None
2026-03-26 22:59:34 [ayvens.be] INFO: Scrape type for 1982478: 2
2026-03-26 22:59:34 [ayvens.be] INFO: Extracting data for car ID: 1982478
2026-03-26 22:59:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db920fb1-a153-5f8c-bed7-0266b14ec159 with identifier: 1982478
2026-03-26 22:59:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db920fb1-a153-5f8c-bed7-0266b14ec159 with scrape type 2
2026-03-26 22:59:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item db920fb1-a153-5f8c-bed7-0266b14ec159 with scrape type 2
2026-03-26 22:59:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: db920fb1-a153-5f8c-bed7-0266b14ec159, identifier: 1982478
2026-03-26 22:59:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: db920fb1-a153-5f8c-bed7-0266b14ec159 with identifier: 1982478
2026-03-26 22:59:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: db920fb1-a153-5f8c-bed7-0266b14ec159 with identifier: 1982478
2026-03-26 22:59:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: db920fb1-a153-5f8c-bed7-0266b14ec159 with identifier: 1982478 to the API
2026-03-26 22:59:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'db920fb1-a153-5f8c-bed7-0266b14ec159',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'ECOSPORT',
 'odometer': 75506,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD ECOSPORT 1.0I ECOBOOST 92KW TITANIUM',
 'transmission': 'manual',
 'trim': '1.0I ECOBOOST 92KW TITANIUM',
 'vin': None,
 'year': 2021}
2026-03-26 22:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982478%27 HTTP/1.1" 200 None
2026-03-26 22:59:34 [ayvens.be] INFO: Saving data for 1982478: {'auction_closing_time': 1774942200.0, 'created_time': 1774479074.296794, 'last_price_update_time': 1774565974.970886}
2026-03-26 22:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982478') HTTP/1.1" 204 0
2026-03-26 22:59:34 [ayvens.be] INFO: Found listing with ID: 1982479
2026-03-26 22:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982479%27 HTTP/1.1" 200 None
2026-03-26 22:59:35 [ayvens.be] INFO: Scrape type for 1982479: 2
2026-03-26 22:59:35 [ayvens.be] INFO: Extracting data for car ID: 1982479
2026-03-26 22:59:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0cd54f7-8af7-5842-aa72-e3dae08adbc1 with identifier: 1982479
2026-03-26 22:59:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0cd54f7-8af7-5842-aa72-e3dae08adbc1 with scrape type 2
2026-03-26 22:59:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a0cd54f7-8af7-5842-aa72-e3dae08adbc1 with scrape type 2
2026-03-26 22:59:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a0cd54f7-8af7-5842-aa72-e3dae08adbc1, identifier: 1982479
2026-03-26 22:59:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a0cd54f7-8af7-5842-aa72-e3dae08adbc1 with identifier: 1982479
2026-03-26 22:59:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a0cd54f7-8af7-5842-aa72-e3dae08adbc1 with identifier: 1982479
2026-03-26 22:59:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a0cd54f7-8af7-5842-aa72-e3dae08adbc1 with identifier: 1982479 to the API
2026-03-26 22:59:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'electric',
 'id': 'a0cd54f7-8af7-5842-aa72-e3dae08adbc1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'TESLA',
 'model': 'MODEL 3',
 'odometer': 50582,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TESLA MODEL 3 BEV 50KWH STANDARD RWD PLUS AUTO',
 'transmission': 'automatic',
 'trim': 'BEV 50KWH STANDARD RWD PLUS AUTO',
 'vin': None,
 'year': 2022}
2026-03-26 22:59:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982479%27 HTTP/1.1" 200 None
2026-03-26 22:59:35 [ayvens.be] INFO: Saving data for 1982479: {'auction_closing_time': 1774942200.0, 'created_time': 1774479075.181869, 'last_price_update_time': 1774565975.337838}
2026-03-26 22:59:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982479') HTTP/1.1" 204 0
2026-03-26 22:59:35 [ayvens.be] INFO: Found listing with ID: 1982480
2026-03-26 22:59:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982480%27 HTTP/1.1" 200 None
2026-03-26 22:59:35 [ayvens.be] INFO: Scrape type for 1982480: 2
2026-03-26 22:59:35 [ayvens.be] INFO: Extracting data for car ID: 1982480
2026-03-26 22:59:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 28f3ba22-fc31-567a-bd91-ccdafe78aa28 with identifier: 1982480
2026-03-26 22:59:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28f3ba22-fc31-567a-bd91-ccdafe78aa28 with scrape type 2
2026-03-26 22:59:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 28f3ba22-fc31-567a-bd91-ccdafe78aa28 with scrape type 2
2026-03-26 22:59:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 28f3ba22-fc31-567a-bd91-ccdafe78aa28, identifier: 1982480
2026-03-26 22:59:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 28f3ba22-fc31-567a-bd91-ccdafe78aa28 with identifier: 1982480
2026-03-26 22:59:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 28f3ba22-fc31-567a-bd91-ccdafe78aa28 with identifier: 1982480
2026-03-26 22:59:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 28f3ba22-fc31-567a-bd91-ccdafe78aa28 with identifier: 1982480 to the API
2026-03-26 22:59:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '28f3ba22-fc31-567a-bd91-ccdafe78aa28',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'ARONA',
 'odometer': 55872,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT ARONA 1.0 TSI 85KW MOVE DCT',
 'transmission': 'automatic',
 'trim': '1.0 TSI 85KW MOVE DCT',
 'vin': None,
 'year': 2020}
2026-03-26 22:59:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982480%27 HTTP/1.1" 200 None
2026-03-26 22:59:35 [ayvens.be] INFO: Saving data for 1982480: {'auction_closing_time': 1774942200.0, 'created_time': 1774479067.58787, 'last_price_update_time': 1774565975.726667}
2026-03-26 22:59:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982480') HTTP/1.1" 204 0
2026-03-26 22:59:35 [ayvens.be] INFO: Found listing with ID: 1982481
2026-03-26 22:59:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982481%27 HTTP/1.1" 200 None
2026-03-26 22:59:35 [ayvens.be] INFO: Scrape type for 1982481: 2
2026-03-26 22:59:35 [ayvens.be] INFO: Extracting data for car ID: 1982481
2026-03-26 22:59:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a8bf2da9-d57b-5482-9535-88f20e321d95 with identifier: 1982481
2026-03-26 22:59:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8bf2da9-d57b-5482-9535-88f20e321d95 with scrape type 2
2026-03-26 22:59:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a8bf2da9-d57b-5482-9535-88f20e321d95 with scrape type 2
2026-03-26 22:59:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a8bf2da9-d57b-5482-9535-88f20e321d95, identifier: 1982481
2026-03-26 22:59:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a8bf2da9-d57b-5482-9535-88f20e321d95 with identifier: 1982481
2026-03-26 22:59:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a8bf2da9-d57b-5482-9535-88f20e321d95 with identifier: 1982481
2026-03-26 22:59:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a8bf2da9-d57b-5482-9535-88f20e321d95 with identifier: 1982481 to the API
2026-03-26 22:59:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'a8bf2da9-d57b-5482-9535-88f20e321d95',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLC COUPE',
 'odometer': 22368,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLC COUPE 2.0 GLC 300 DE PHEV 4MATIC BUS SOL AUTO',
 'transmission': 'automatic',
 'trim': '2.0 GLC 300 DE PHEV 4MATIC BUS SOL AUTO',
 'vin': None,
 'year': 2022}
2026-03-26 22:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982481%27 HTTP/1.1" 200 None
2026-03-26 22:59:36 [ayvens.be] INFO: Saving data for 1982481: {'auction_closing_time': 1774942200.0, 'created_time': 1774479061.684657, 'last_price_update_time': 1774565976.194029}
2026-03-26 22:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982481') HTTP/1.1" 204 0
2026-03-26 22:59:36 [ayvens.be] INFO: Found listing with ID: 1982482
2026-03-26 22:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982482%27 HTTP/1.1" 200 None
2026-03-26 22:59:36 [ayvens.be] INFO: Scrape type for 1982482: 2
2026-03-26 22:59:36 [ayvens.be] INFO: Extracting data for car ID: 1982482
2026-03-26 22:59:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ac11435-3641-5dd8-8bbb-437cd16362c1 with identifier: 1982482
2026-03-26 22:59:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ac11435-3641-5dd8-8bbb-437cd16362c1 with scrape type 2
2026-03-26 22:59:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9ac11435-3641-5dd8-8bbb-437cd16362c1 with scrape type 2
2026-03-26 22:59:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 9ac11435-3641-5dd8-8bbb-437cd16362c1, identifier: 1982482
2026-03-26 22:59:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 9ac11435-3641-5dd8-8bbb-437cd16362c1 with identifier: 1982482
2026-03-26 22:59:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 9ac11435-3641-5dd8-8bbb-437cd16362c1 with identifier: 1982482
2026-03-26 22:59:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 9ac11435-3641-5dd8-8bbb-437cd16362c1 with identifier: 1982482 to the API
2026-03-26 22:59:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '9ac11435-3641-5dd8-8bbb-437cd16362c1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '1 SERIES HATCH',
 'odometer': 62148,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1 SERIES HATCH 1.5 116DA (85KW)',
 'transmission': 'automatic',
 'trim': '1.5 116DA (85KW)',
 'vin': None,
 'year': 2023}
2026-03-26 22:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982482%27 HTTP/1.1" 200 None
2026-03-26 22:59:36 [ayvens.be] INFO: Saving data for 1982482: {'auction_closing_time': 1774942200.0, 'created_time': 1774479063.164172, 'last_price_update_time': 1774565976.567785}
2026-03-26 22:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982482') HTTP/1.1" 204 0
2026-03-26 22:59:36 [ayvens.be] INFO: Found listing with ID: 1982483
2026-03-26 22:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982483%27 HTTP/1.1" 200 None
2026-03-26 22:59:36 [ayvens.be] INFO: Scrape type for 1982483: 2
2026-03-26 22:59:36 [ayvens.be] INFO: Extracting data for car ID: 1982483
2026-03-26 22:59:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b6dbdacc-f85e-50cd-a562-5120a4c43a46 with identifier: 1982483
2026-03-26 22:59:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6dbdacc-f85e-50cd-a562-5120a4c43a46 with scrape type 2
2026-03-26 22:59:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b6dbdacc-f85e-50cd-a562-5120a4c43a46 with scrape type 2
2026-03-26 22:59:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b6dbdacc-f85e-50cd-a562-5120a4c43a46, identifier: 1982483
2026-03-26 22:59:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b6dbdacc-f85e-50cd-a562-5120a4c43a46 with identifier: 1982483
2026-03-26 22:59:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b6dbdacc-f85e-50cd-a562-5120a4c43a46 with identifier: 1982483
2026-03-26 22:59:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b6dbdacc-f85e-50cd-a562-5120a4c43a46 with identifier: 1982483 to the API
2026-03-26 22:59:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'b6dbdacc-f85e-50cd-a562-5120a4c43a46',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A-CLASS',
 'odometer': 39848,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ A-CLASS 1.3 A 160',
 'transmission': 'manual',
 'trim': '1.3 A 160',
 'vin': None,
 'year': 2022}
2026-03-26 22:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982483%27 HTTP/1.1" 200 None
2026-03-26 22:59:36 [ayvens.be] INFO: Saving data for 1982483: {'auction_closing_time': 1774942200.0, 'created_time': 1774479064.573467, 'last_price_update_time': 1774565976.943704}
2026-03-26 22:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982483') HTTP/1.1" 204 0
2026-03-26 22:59:36 [ayvens.be] INFO: Found listing with ID: 1982484
2026-03-26 22:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982484%27 HTTP/1.1" 200 None
2026-03-26 22:59:36 [ayvens.be] INFO: Scrape type for 1982484: 2
2026-03-26 22:59:36 [ayvens.be] INFO: Extracting data for car ID: 1982484
2026-03-26 22:59:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa8011ce-f24b-5963-afee-68f9cd31adf2 with identifier: 1982484
2026-03-26 22:59:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa8011ce-f24b-5963-afee-68f9cd31adf2 with scrape type 2
2026-03-26 22:59:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fa8011ce-f24b-5963-afee-68f9cd31adf2 with scrape type 2
2026-03-26 22:59:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: fa8011ce-f24b-5963-afee-68f9cd31adf2, identifier: 1982484
2026-03-26 22:59:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: fa8011ce-f24b-5963-afee-68f9cd31adf2 with identifier: 1982484
2026-03-26 22:59:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: fa8011ce-f24b-5963-afee-68f9cd31adf2 with identifier: 1982484
2026-03-26 22:59:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: fa8011ce-f24b-5963-afee-68f9cd31adf2 with identifier: 1982484 to the API
2026-03-26 22:59:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'fa8011ce-f24b-5963-afee-68f9cd31adf2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'AYGO X',
 'odometer': 41091,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-05',
 'seats_number': 4,
 'seller_name': None,
 'title': 'TOYOTA AYGO X 1.0 VVT-I ENVY CVT',
 'transmission': 'automatic',
 'trim': '1.0 VVT-I ENVY CVT',
 'vin': None,
 'year': 2022}
2026-03-26 22:59:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982484%27 HTTP/1.1" 200 None
2026-03-26 22:59:37 [ayvens.be] INFO: Saving data for 1982484: {'auction_closing_time': 1774942200.0, 'created_time': 1774479066.301031, 'last_price_update_time': 1774565977.524162}
2026-03-26 22:59:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982484') HTTP/1.1" 204 0
2026-03-26 22:59:37 [ayvens.be] INFO: Found listing with ID: 1982485
2026-03-26 22:59:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982485%27 HTTP/1.1" 200 None
2026-03-26 22:59:37 [ayvens.be] INFO: Scrape type for 1982485: 2
2026-03-26 22:59:37 [ayvens.be] INFO: Extracting data for car ID: 1982485
2026-03-26 22:59:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cbfa6165-acd1-580f-ae41-fda323df94f1 with identifier: 1982485
2026-03-26 22:59:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cbfa6165-acd1-580f-ae41-fda323df94f1 with scrape type 2
2026-03-26 22:59:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cbfa6165-acd1-580f-ae41-fda323df94f1 with scrape type 2
2026-03-26 22:59:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: cbfa6165-acd1-580f-ae41-fda323df94f1, identifier: 1982485
2026-03-26 22:59:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: cbfa6165-acd1-580f-ae41-fda323df94f1 with identifier: 1982485
2026-03-26 22:59:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: cbfa6165-acd1-580f-ae41-fda323df94f1 with identifier: 1982485
2026-03-26 22:59:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: cbfa6165-acd1-580f-ae41-fda323df94f1 with identifier: 1982485 to the API
2026-03-26 22:59:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'cbfa6165-acd1-580f-ae41-fda323df94f1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'MOKKA',
 'odometer': 74273,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL MOKKA 1.2 TURBO 96KW ELEGANCE',
 'transmission': 'manual',
 'trim': '1.2 TURBO 96KW ELEGANCE',
 'vin': None,
 'year': 2022}
2026-03-26 22:59:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982485%27 HTTP/1.1" 200 None
2026-03-26 22:59:37 [ayvens.be] INFO: Saving data for 1982485: {'auction_closing_time': 1774942200.0, 'created_time': 1774479069.275006, 'last_price_update_time': 1774565977.893985}
2026-03-26 22:59:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982485') HTTP/1.1" 204 0
2026-03-26 22:59:37 [ayvens.be] INFO: Found listing with ID: 1982486
2026-03-26 22:59:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982486%27 HTTP/1.1" 200 None
2026-03-26 22:59:37 [ayvens.be] INFO: Scrape type for 1982486: 2
2026-03-26 22:59:37 [ayvens.be] INFO: Extracting data for car ID: 1982486
2026-03-26 22:59:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d617911-5e07-59ab-b6ff-ec22f5b28cb4 with identifier: 1982486
2026-03-26 22:59:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d617911-5e07-59ab-b6ff-ec22f5b28cb4 with scrape type 2
2026-03-26 22:59:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5d617911-5e07-59ab-b6ff-ec22f5b28cb4 with scrape type 2
2026-03-26 22:59:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 5d617911-5e07-59ab-b6ff-ec22f5b28cb4, identifier: 1982486
2026-03-26 22:59:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 5d617911-5e07-59ab-b6ff-ec22f5b28cb4 with identifier: 1982486
2026-03-26 22:59:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 5d617911-5e07-59ab-b6ff-ec22f5b28cb4 with identifier: 1982486
2026-03-26 22:59:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 5d617911-5e07-59ab-b6ff-ec22f5b28cb4 with identifier: 1982486 to the API
2026-03-26 22:59:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '5d617911-5e07-59ab-b6ff-ec22f5b28cb4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '508',
 'odometer': 74857,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 508 1.6 PHEV 225 E-AUTO ALLURE',
 'transmission': 'automatic',
 'trim': '1.6 PHEV 225 E-AUTO ALLURE',
 'vin': None,
 'year': 2021}
2026-03-26 22:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982486%27 HTTP/1.1" 200 None
2026-03-26 22:59:38 [ayvens.be] INFO: Saving data for 1982486: {'auction_closing_time': 1774942200.0, 'created_time': 1774479069.966618, 'last_price_update_time': 1774565978.270722}
2026-03-26 22:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982486') HTTP/1.1" 204 0
2026-03-26 22:59:38 [ayvens.be] INFO: Found listing with ID: 1982487
2026-03-26 22:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982487%27 HTTP/1.1" 200 None
2026-03-26 22:59:38 [ayvens.be] INFO: Scrape type for 1982487: 2
2026-03-26 22:59:38 [ayvens.be] INFO: Extracting data for car ID: 1982487
2026-03-26 22:59:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d62e9ba0-5996-579d-91b8-041173683520 with identifier: 1982487
2026-03-26 22:59:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d62e9ba0-5996-579d-91b8-041173683520 with scrape type 2
2026-03-26 22:59:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d62e9ba0-5996-579d-91b8-041173683520 with scrape type 2
2026-03-26 22:59:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d62e9ba0-5996-579d-91b8-041173683520, identifier: 1982487
2026-03-26 22:59:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d62e9ba0-5996-579d-91b8-041173683520 with identifier: 1982487
2026-03-26 22:59:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d62e9ba0-5996-579d-91b8-041173683520 with identifier: 1982487
2026-03-26 22:59:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d62e9ba0-5996-579d-91b8-041173683520 with identifier: 1982487 to the API
2026-03-26 22:59:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'd62e9ba0-5996-579d-91b8-041173683520',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLA - Klasse',
 'odometer': 78007,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLA - Klasse 1.3 CLA 250 E BUSINESS SOLUTION DCT',
 'transmission': 'automatic',
 'trim': '1.3 CLA 250 E BUSINESS SOLUTION DCT',
 'vin': None,
 'year': 2022}
2026-03-26 22:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982487%27 HTTP/1.1" 200 None
2026-03-26 22:59:38 [ayvens.be] INFO: Saving data for 1982487: {'auction_closing_time': 1774942200.0, 'created_time': 1774479071.778296, 'last_price_update_time': 1774565978.63881}
2026-03-26 22:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982487') HTTP/1.1" 204 0
2026-03-26 22:59:38 [ayvens.be] INFO: Found listing with ID: 1982488
2026-03-26 22:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982488%27 HTTP/1.1" 200 None
2026-03-26 22:59:38 [ayvens.be] INFO: Scrape type for 1982488: 2
2026-03-26 22:59:38 [ayvens.be] INFO: Extracting data for car ID: 1982488
2026-03-26 22:59:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5fea91da-b641-54fd-a480-3402c5b0b66c with identifier: 1982488
2026-03-26 22:59:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5fea91da-b641-54fd-a480-3402c5b0b66c with scrape type 2
2026-03-26 22:59:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5fea91da-b641-54fd-a480-3402c5b0b66c with scrape type 2
2026-03-26 22:59:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 5fea91da-b641-54fd-a480-3402c5b0b66c, identifier: 1982488
2026-03-26 22:59:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 5fea91da-b641-54fd-a480-3402c5b0b66c with identifier: 1982488
2026-03-26 22:59:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 5fea91da-b641-54fd-a480-3402c5b0b66c with identifier: 1982488
2026-03-26 22:59:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 5fea91da-b641-54fd-a480-3402c5b0b66c with identifier: 1982488 to the API
2026-03-26 22:59:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '5fea91da-b641-54fd-a480-3402c5b0b66c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'PASSAT VARIANT',
 'odometer': 62614,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN PASSAT VARIANT 1.4 TSI MSQ VARIANT GTE BUSINESS',
 'transmission': 'automatic',
 'trim': '1.4 TSI MSQ VARIANT GTE BUSINESS',
 'vin': None,
 'year': 2021}
2026-03-26 22:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982488%27 HTTP/1.1" 200 None
2026-03-26 22:59:39 [ayvens.be] INFO: Saving data for 1982488: {'auction_closing_time': 1774942200.0, 'created_time': 1774479073.249275, 'last_price_update_time': 1774565979.022002}
2026-03-26 22:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982488') HTTP/1.1" 204 0
2026-03-26 22:59:39 [ayvens.be] INFO: Found listing with ID: 1982489
2026-03-26 22:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982489%27 HTTP/1.1" 200 None
2026-03-26 22:59:39 [ayvens.be] INFO: Scrape type for 1982489: 2
2026-03-26 22:59:39 [ayvens.be] INFO: Extracting data for car ID: 1982489
2026-03-26 22:59:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 851522a4-7560-5ec5-8de2-a7e8f4c139ab with identifier: 1982489
2026-03-26 22:59:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 851522a4-7560-5ec5-8de2-a7e8f4c139ab with scrape type 2
2026-03-26 22:59:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 851522a4-7560-5ec5-8de2-a7e8f4c139ab with scrape type 2
2026-03-26 22:59:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 851522a4-7560-5ec5-8de2-a7e8f4c139ab, identifier: 1982489
2026-03-26 22:59:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 851522a4-7560-5ec5-8de2-a7e8f4c139ab with identifier: 1982489
2026-03-26 22:59:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 851522a4-7560-5ec5-8de2-a7e8f4c139ab with identifier: 1982489
2026-03-26 22:59:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 851522a4-7560-5ec5-8de2-a7e8f4c139ab with identifier: 1982489 to the API
2026-03-26 22:59:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '851522a4-7560-5ec5-8de2-a7e8f4c139ab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'ASTRA',
 'odometer': 43526,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-01-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL ASTRA 1.2 TURBO 96KW S-S GS DRIVING SCHOOL',
 'transmission': 'manual',
 'trim': '1.2 TURBO 96KW S-S GS DRIVING SCHOOL',
 'vin': None,
 'year': 2024}
2026-03-26 22:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982489%27 HTTP/1.1" 200 None
2026-03-26 22:59:39 [ayvens.be] INFO: Saving data for 1982489: {'auction_closing_time': 1774942200.0, 'created_time': 1774479074.661387, 'last_price_update_time': 1774565979.38364}
2026-03-26 22:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982489') HTTP/1.1" 204 0
2026-03-26 22:59:39 [ayvens.be] INFO: Found listing with ID: 1982490
2026-03-26 22:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982490%27 HTTP/1.1" 200 None
2026-03-26 22:59:39 [ayvens.be] INFO: Scrape type for 1982490: 2
2026-03-26 22:59:39 [ayvens.be] INFO: Extracting data for car ID: 1982490
2026-03-26 22:59:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bcf27002-f671-51e6-901d-6803e65eed45 with identifier: 1982490
2026-03-26 22:59:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bcf27002-f671-51e6-901d-6803e65eed45 with scrape type 2
2026-03-26 22:59:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bcf27002-f671-51e6-901d-6803e65eed45 with scrape type 2
2026-03-26 22:59:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: bcf27002-f671-51e6-901d-6803e65eed45, identifier: 1982490
2026-03-26 22:59:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: bcf27002-f671-51e6-901d-6803e65eed45 with identifier: 1982490
2026-03-26 22:59:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: bcf27002-f671-51e6-901d-6803e65eed45 with identifier: 1982490
2026-03-26 22:59:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: bcf27002-f671-51e6-901d-6803e65eed45 with identifier: 1982490 to the API
2026-03-26 22:59:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'bcf27002-f671-51e6-901d-6803e65eed45',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'CORSA',
 'odometer': 44028,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL CORSA 1.2 TURBO 74KW S-S ELEGANCE',
 'transmission': 'manual',
 'trim': '1.2 TURBO 74KW S-S ELEGANCE',
 'vin': None,
 'year': 2022}
2026-03-26 22:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982490%27 HTTP/1.1" 200 None
2026-03-26 22:59:39 [ayvens.be] INFO: Saving data for 1982490: {'auction_closing_time': 1774942200.0, 'created_time': 1774479086.913853, 'last_price_update_time': 1774565979.766274}
2026-03-26 22:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982490') HTTP/1.1" 204 0
2026-03-26 22:59:39 [ayvens.be] INFO: Found listing with ID: 1982491
2026-03-26 22:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982491%27 HTTP/1.1" 200 None
2026-03-26 22:59:39 [ayvens.be] INFO: Scrape type for 1982491: 2
2026-03-26 22:59:39 [ayvens.be] INFO: Extracting data for car ID: 1982491
2026-03-26 22:59:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e07c39a8-9736-55b4-97cd-35de75f7655a with identifier: 1982491
2026-03-26 22:59:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e07c39a8-9736-55b4-97cd-35de75f7655a with scrape type 2
2026-03-26 22:59:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e07c39a8-9736-55b4-97cd-35de75f7655a with scrape type 2
2026-03-26 22:59:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e07c39a8-9736-55b4-97cd-35de75f7655a, identifier: 1982491
2026-03-26 22:59:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e07c39a8-9736-55b4-97cd-35de75f7655a with identifier: 1982491
2026-03-26 22:59:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e07c39a8-9736-55b4-97cd-35de75f7655a with identifier: 1982491
2026-03-26 22:59:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e07c39a8-9736-55b4-97cd-35de75f7655a with identifier: 1982491 to the API
2026-03-26 22:59:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'e07c39a8-9736-55b4-97cd-35de75f7655a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'ARONA',
 'odometer': 72458,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT ARONA 1.0 TSI 70KW MOVE',
 'transmission': 'manual',
 'trim': '1.0 TSI 70KW MOVE',
 'vin': None,
 'year': 2023}
2026-03-26 22:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982491%27 HTTP/1.1" 200 None
2026-03-26 22:59:40 [ayvens.be] INFO: Saving data for 1982491: {'auction_closing_time': 1774942200.0, 'created_time': 1774479085.777469, 'last_price_update_time': 1774565980.15265}
2026-03-26 22:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982491') HTTP/1.1" 204 0
2026-03-26 22:59:40 [ayvens.be] INFO: Found listing with ID: 1981135
2026-03-26 22:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981135%27 HTTP/1.1" 200 None
2026-03-26 22:59:40 [ayvens.be] INFO: Scrape type for 1981135: 2
2026-03-26 22:59:40 [ayvens.be] INFO: Extracting data for car ID: 1981135
2026-03-26 22:59:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79f9428e-091f-5f46-bb9e-7c3db70a593d with identifier: 1981135
2026-03-26 22:59:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79f9428e-091f-5f46-bb9e-7c3db70a593d with scrape type 2
2026-03-26 22:59:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 79f9428e-091f-5f46-bb9e-7c3db70a593d with scrape type 2
2026-03-26 22:59:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 79f9428e-091f-5f46-bb9e-7c3db70a593d, identifier: 1981135
2026-03-26 22:59:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 79f9428e-091f-5f46-bb9e-7c3db70a593d with identifier: 1981135
2026-03-26 22:59:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 79f9428e-091f-5f46-bb9e-7c3db70a593d with identifier: 1981135
2026-03-26 22:59:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 79f9428e-091f-5f46-bb9e-7c3db70a593d with identifier: 1981135 to the API
2026-03-26 22:59:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '79f9428e-091f-5f46-bb9e-7c3db70a593d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'C3',
 'odometer': 39734,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-04-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROËN C3 1.2 PURETECH 83 YOU ! MAN S-S',
 'transmission': 'manual',
 'trim': '1.2 PURETECH 83 YOU ! MAN S-S',
 'vin': None,
 'year': 2023}
2026-03-26 22:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981135%27 HTTP/1.1" 200 None
2026-03-26 22:59:40 [ayvens.be] INFO: Saving data for 1981135: {'auction_closing_time': 1774855800.0, 'created_time': 1774392326.917128, 'last_price_update_time': 1774565980.640852}
2026-03-26 22:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981135') HTTP/1.1" 204 0
2026-03-26 22:59:40 [ayvens.be] INFO: Found listing with ID: 1981136
2026-03-26 22:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981136%27 HTTP/1.1" 200 None
2026-03-26 22:59:40 [ayvens.be] INFO: Scrape type for 1981136: 2
2026-03-26 22:59:40 [ayvens.be] INFO: Extracting data for car ID: 1981136
2026-03-26 22:59:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46ec57dc-bca1-51b9-9171-f999955cb521 with identifier: 1981136
2026-03-26 22:59:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46ec57dc-bca1-51b9-9171-f999955cb521 with scrape type 2
2026-03-26 22:59:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 46ec57dc-bca1-51b9-9171-f999955cb521 with scrape type 2
2026-03-26 22:59:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 46ec57dc-bca1-51b9-9171-f999955cb521, identifier: 1981136
2026-03-26 22:59:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 46ec57dc-bca1-51b9-9171-f999955cb521 with identifier: 1981136
2026-03-26 22:59:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 46ec57dc-bca1-51b9-9171-f999955cb521 with identifier: 1981136
2026-03-26 22:59:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 46ec57dc-bca1-51b9-9171-f999955cb521 with identifier: 1981136 to the API
2026-03-26 22:59:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '46ec57dc-bca1-51b9-9171-f999955cb521',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A-CLASS',
 'odometer': 138625,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ A-CLASS 1.3 A 250 E DCT BUSINESS SOLUTION',
 'transmission': 'automatic',
 'trim': '1.3 A 250 E DCT BUSINESS SOLUTION',
 'vin': None,
 'year': 2020}
2026-03-26 22:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981136%27 HTTP/1.1" 200 None
2026-03-26 22:59:41 [ayvens.be] INFO: Saving data for 1981136: {'auction_closing_time': 1774855800.0, 'created_time': 1774392341.835887, 'last_price_update_time': 1774565981.025386}
2026-03-26 22:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981136') HTTP/1.1" 204 0
2026-03-26 22:59:41 [ayvens.be] INFO: Found listing with ID: 1981137
2026-03-26 22:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981137%27 HTTP/1.1" 200 None
2026-03-26 22:59:41 [ayvens.be] INFO: Scrape type for 1981137: 2
2026-03-26 22:59:41 [ayvens.be] INFO: Extracting data for car ID: 1981137
2026-03-26 22:59:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a691153-75fd-5fd6-8d9c-90017e3894b2 with identifier: 1981137
2026-03-26 22:59:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a691153-75fd-5fd6-8d9c-90017e3894b2 with scrape type 2
2026-03-26 22:59:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2a691153-75fd-5fd6-8d9c-90017e3894b2 with scrape type 2
2026-03-26 22:59:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 2a691153-75fd-5fd6-8d9c-90017e3894b2, identifier: 1981137
2026-03-26 22:59:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 2a691153-75fd-5fd6-8d9c-90017e3894b2 with identifier: 1981137
2026-03-26 22:59:41 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 22:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 22:59:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 2a691153-75fd-5fd6-8d9c-90017e3894b2 with identifier: 1981137
2026-03-26 22:59:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 2a691153-75fd-5fd6-8d9c-90017e3894b2 with identifier: 1981137 to the API
2026-03-26 22:59:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 43,
 'color': 'SAPHIRSCHWARZ METALLIC',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '2a691153-75fd-5fd6-8d9c-90017e3894b2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 113121,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 1.5 XDRIVE25E (162KW)',
 'transmission': 'automatic',
 'trim': '1.5 XDRIVE25E (162KW)',
 'vin': None,
 'year': 2021}
2026-03-26 22:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981137%27 HTTP/1.1" 200 None
2026-03-26 22:59:41 [ayvens.be] INFO: Saving data for 1981137: {'auction_closing_time': 1774855800.0, 'created_time': 1774392329.486292, 'last_price_update_time': 1774565981.406997}
2026-03-26 22:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981137') HTTP/1.1" 204 0
2026-03-26 22:59:41 [ayvens.be] INFO: Found listing with ID: 1981138
2026-03-26 22:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981138%27 HTTP/1.1" 200 None
2026-03-26 22:59:41 [ayvens.be] INFO: Scrape type for 1981138: 2
2026-03-26 22:59:41 [ayvens.be] INFO: Extracting data for car ID: 1981138
2026-03-26 22:59:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 55dff7df-9b11-5d60-91fa-a74a269584dd with identifier: 1981138
2026-03-26 22:59:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55dff7df-9b11-5d60-91fa-a74a269584dd with scrape type 2
2026-03-26 22:59:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 55dff7df-9b11-5d60-91fa-a74a269584dd with scrape type 2
2026-03-26 22:59:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 55dff7df-9b11-5d60-91fa-a74a269584dd, identifier: 1981138
2026-03-26 22:59:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 55dff7df-9b11-5d60-91fa-a74a269584dd with identifier: 1981138
2026-03-26 22:59:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 55dff7df-9b11-5d60-91fa-a74a269584dd with identifier: 1981138
2026-03-26 22:59:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 55dff7df-9b11-5d60-91fa-a74a269584dd with identifier: 1981138 to the API
2026-03-26 22:59:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '55dff7df-9b11-5d60-91fa-a74a269584dd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q5',
 'odometer': 133256,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q5 2.0 TDI 35 120KW S TRON. B. ED. SP',
 'transmission': 'automatic',
 'trim': '2.0 TDI 35 120KW S TRON. B. ED. SP',
 'vin': None,
 'year': 2020}
2026-03-26 22:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981138%27 HTTP/1.1" 200 None
2026-03-26 22:59:41 [ayvens.be] INFO: Saving data for 1981138: {'auction_closing_time': 1774855800.0, 'created_time': 1774392335.772605, 'last_price_update_time': 1774565981.798653}
2026-03-26 22:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981138') HTTP/1.1" 204 0
2026-03-26 22:59:41 [ayvens.be] INFO: Found listing with ID: 1981139
2026-03-26 22:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981139%27 HTTP/1.1" 200 None
2026-03-26 22:59:41 [ayvens.be] INFO: Scrape type for 1981139: 2
2026-03-26 22:59:41 [ayvens.be] INFO: Extracting data for car ID: 1981139
2026-03-26 22:59:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e40e898-1a73-5900-a6ac-3adfd092d841 with identifier: 1981139
2026-03-26 22:59:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e40e898-1a73-5900-a6ac-3adfd092d841 with scrape type 2
2026-03-26 22:59:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3e40e898-1a73-5900-a6ac-3adfd092d841 with scrape type 2
2026-03-26 22:59:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 3e40e898-1a73-5900-a6ac-3adfd092d841, identifier: 1981139
2026-03-26 22:59:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 3e40e898-1a73-5900-a6ac-3adfd092d841 with identifier: 1981139
2026-03-26 22:59:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 3e40e898-1a73-5900-a6ac-3adfd092d841 with identifier: 1981139
2026-03-26 22:59:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 3e40e898-1a73-5900-a6ac-3adfd092d841 with identifier: 1981139 to the API
2026-03-26 22:59:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'electric',
 'id': '3e40e898-1a73-5900-a6ac-3adfd092d841',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'TESLA',
 'model': 'MODEL 3',
 'odometer': 44757,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TESLA MODEL 3 BEV 50KWH STANDARD RWD PLUS AUTO',
 'transmission': 'automatic',
 'trim': 'BEV 50KWH STANDARD RWD PLUS AUTO',
 'vin': None,
 'year': 2022}
2026-03-26 22:59:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981139%27 HTTP/1.1" 200 None
2026-03-26 22:59:42 [ayvens.be] INFO: Saving data for 1981139: {'auction_closing_time': 1774855800.0, 'created_time': 1774392332.388943, 'last_price_update_time': 1774565982.197967}
2026-03-26 22:59:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981139') HTTP/1.1" 204 0
2026-03-26 22:59:42 [ayvens.be] INFO: Found listing with ID: 1981140
2026-03-26 22:59:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981140%27 HTTP/1.1" 200 None
2026-03-26 22:59:42 [ayvens.be] INFO: Scrape type for 1981140: 2
2026-03-26 22:59:42 [ayvens.be] INFO: Extracting data for car ID: 1981140
2026-03-26 22:59:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6e7ceea0-d793-598a-b897-0075675d2746 with identifier: 1981140
2026-03-26 22:59:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e7ceea0-d793-598a-b897-0075675d2746 with scrape type 2
2026-03-26 22:59:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6e7ceea0-d793-598a-b897-0075675d2746 with scrape type 2
2026-03-26 22:59:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 6e7ceea0-d793-598a-b897-0075675d2746, identifier: 1981140
2026-03-26 22:59:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 6e7ceea0-d793-598a-b897-0075675d2746 with identifier: 1981140
2026-03-26 22:59:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 6e7ceea0-d793-598a-b897-0075675d2746 with identifier: 1981140
2026-03-26 22:59:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 6e7ceea0-d793-598a-b897-0075675d2746 with identifier: 1981140 to the API
2026-03-26 22:59:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '6e7ceea0-d793-598a-b897-0075675d2746',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'E-CLASS BREAK',
 'odometer': 123901,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ E-CLASS BREAK 2.0 E 300 E AUTO',
 'transmission': 'automatic',
 'trim': '2.0 E 300 E AUTO',
 'vin': None,
 'year': 2021}
2026-03-26 22:59:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981140%27 HTTP/1.1" 200 None
2026-03-26 22:59:42 [ayvens.be] INFO: Saving data for 1981140: {'auction_closing_time': 1774855800.0, 'created_time': 1774392334.949015, 'last_price_update_time': 1774565982.583442}
2026-03-26 22:59:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981140') HTTP/1.1" 204 0
2026-03-26 22:59:42 [ayvens.be] INFO: Found listing with ID: 1981141
2026-03-26 22:59:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981141%27 HTTP/1.1" 200 None
2026-03-26 22:59:42 [ayvens.be] INFO: Scrape type for 1981141: 2
2026-03-26 22:59:42 [ayvens.be] INFO: Extracting data for car ID: 1981141
2026-03-26 22:59:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e756c7e5-3ba1-5508-b45b-031fde5bc5dd with identifier: 1981141
2026-03-26 22:59:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e756c7e5-3ba1-5508-b45b-031fde5bc5dd with scrape type 2
2026-03-26 22:59:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e756c7e5-3ba1-5508-b45b-031fde5bc5dd with scrape type 2
2026-03-26 22:59:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e756c7e5-3ba1-5508-b45b-031fde5bc5dd, identifier: 1981141
2026-03-26 22:59:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e756c7e5-3ba1-5508-b45b-031fde5bc5dd with identifier: 1981141
2026-03-26 22:59:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e756c7e5-3ba1-5508-b45b-031fde5bc5dd with identifier: 1981141
2026-03-26 22:59:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e756c7e5-3ba1-5508-b45b-031fde5bc5dd with identifier: 1981141 to the API
2026-03-26 22:59:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.3L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'e756c7e5-3ba1-5508-b45b-031fde5bc5dd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'MASTER',
 'odometer': 40457,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-11-27',
 'seats_number': 3,
 'seller_name': None,
 'title': 'RENAULT MASTER 2.3 DCI 150 EN. BLUE GR CONFORT L2H2 35',
 'transmission': 'manual',
 'trim': '2.3 DCI 150 EN. BLUE GR CONFORT L2H2 35',
 'vin': None,
 'year': 2023}
2026-03-26 22:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981141%27 HTTP/1.1" 200 None
2026-03-26 22:59:43 [ayvens.be] INFO: Saving data for 1981141: {'auction_closing_time': 1774855800.0, 'created_time': 1774392337.685238, 'last_price_update_time': 1774565983.125335}
2026-03-26 22:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981141') HTTP/1.1" 204 0
2026-03-26 22:59:43 [ayvens.be] INFO: Found listing with ID: 1981142
2026-03-26 22:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981142%27 HTTP/1.1" 200 None
2026-03-26 22:59:43 [ayvens.be] INFO: Scrape type for 1981142: 2
2026-03-26 22:59:43 [ayvens.be] INFO: Extracting data for car ID: 1981142
2026-03-26 22:59:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 932ba259-a9f5-5bad-9ff0-16f2a67d1110 with identifier: 1981142
2026-03-26 22:59:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 932ba259-a9f5-5bad-9ff0-16f2a67d1110 with scrape type 2
2026-03-26 22:59:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 932ba259-a9f5-5bad-9ff0-16f2a67d1110 with scrape type 2
2026-03-26 22:59:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 932ba259-a9f5-5bad-9ff0-16f2a67d1110, identifier: 1981142
2026-03-26 22:59:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 932ba259-a9f5-5bad-9ff0-16f2a67d1110 with identifier: 1981142
2026-03-26 22:59:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 932ba259-a9f5-5bad-9ff0-16f2a67d1110 with identifier: 1981142
2026-03-26 22:59:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 932ba259-a9f5-5bad-9ff0-16f2a67d1110 with identifier: 1981142 to the API
2026-03-26 22:59:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '932ba259-a9f5-5bad-9ff0-16f2a67d1110',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 61616,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 1.6 HYBRID 225 E-AUTO8 GT',
 'transmission': 'automatic',
 'trim': '1.6 HYBRID 225 E-AUTO8 GT',
 'vin': None,
 'year': 2021}
2026-03-26 22:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981142%27 HTTP/1.1" 200 None
2026-03-26 22:59:43 [ayvens.be] INFO: Saving data for 1981142: {'auction_closing_time': 1774855800.0, 'created_time': 1774392340.125317, 'last_price_update_time': 1774565983.498649}
2026-03-26 22:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981142') HTTP/1.1" 204 0
2026-03-26 22:59:43 [ayvens.be] INFO: Found listing with ID: 1981143
2026-03-26 22:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981143%27 HTTP/1.1" 200 None
2026-03-26 22:59:43 [ayvens.be] INFO: Scrape type for 1981143: 2
2026-03-26 22:59:43 [ayvens.be] INFO: Extracting data for car ID: 1981143
2026-03-26 22:59:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e7f49ce1-9cb3-5e49-8374-cacc8536af7c with identifier: 1981143
2026-03-26 22:59:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7f49ce1-9cb3-5e49-8374-cacc8536af7c with scrape type 2
2026-03-26 22:59:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e7f49ce1-9cb3-5e49-8374-cacc8536af7c with scrape type 2
2026-03-26 22:59:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e7f49ce1-9cb3-5e49-8374-cacc8536af7c, identifier: 1981143
2026-03-26 22:59:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e7f49ce1-9cb3-5e49-8374-cacc8536af7c with identifier: 1981143
2026-03-26 22:59:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e7f49ce1-9cb3-5e49-8374-cacc8536af7c with identifier: 1981143
2026-03-26 22:59:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e7f49ce1-9cb3-5e49-8374-cacc8536af7c with identifier: 1981143 to the API
2026-03-26 22:59:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'electric',
 'id': 'e7f49ce1-9cb3-5e49-8374-cacc8536af7c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'IX3',
 'odometer': 116865,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW IX3 80KWH AUTO',
 'transmission': 'automatic',
 'trim': '80KWH AUTO',
 'vin': None,
 'year': 2021}
2026-03-26 22:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981143%27 HTTP/1.1" 200 None
2026-03-26 22:59:43 [ayvens.be] INFO: Saving data for 1981143: {'auction_closing_time': 1774855800.0, 'created_time': 1774392341.057917, 'last_price_update_time': 1774565983.88029}
2026-03-26 22:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981143') HTTP/1.1" 204 0
2026-03-26 22:59:43 [ayvens.be] INFO: Found listing with ID: 1981144
2026-03-26 22:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981144%27 HTTP/1.1" 200 None
2026-03-26 22:59:43 [ayvens.be] INFO: Scrape type for 1981144: 2
2026-03-26 22:59:43 [ayvens.be] INFO: Extracting data for car ID: 1981144
2026-03-26 22:59:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e99ef99f-7fc5-5a59-9b9d-3745dc92bd65 with identifier: 1981144
2026-03-26 22:59:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e99ef99f-7fc5-5a59-9b9d-3745dc92bd65 with scrape type 2
2026-03-26 22:59:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e99ef99f-7fc5-5a59-9b9d-3745dc92bd65 with scrape type 2
2026-03-26 22:59:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e99ef99f-7fc5-5a59-9b9d-3745dc92bd65, identifier: 1981144
2026-03-26 22:59:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e99ef99f-7fc5-5a59-9b9d-3745dc92bd65 with identifier: 1981144
2026-03-26 22:59:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e99ef99f-7fc5-5a59-9b9d-3745dc92bd65 with identifier: 1981144
2026-03-26 22:59:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e99ef99f-7fc5-5a59-9b9d-3745dc92bd65 with identifier: 1981144 to the API
2026-03-26 22:59:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'electric',
 'id': 'e99ef99f-7fc5-5a59-9b9d-3745dc92bd65',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'POLESTAR',
 'model': 'POLESTAR 2',
 'odometer': 126429,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'POLESTAR POLESTAR 2 78 kWh Dual Motor Launch',
 'transmission': 'automatic',
 'trim': '78 kWh Dual Motor Launch',
 'vin': None,
 'year': 2021}
2026-03-26 22:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981144%27 HTTP/1.1" 200 None
2026-03-26 22:59:44 [ayvens.be] INFO: Saving data for 1981144: {'auction_closing_time': 1774855800.0, 'created_time': 1774392342.981161, 'last_price_update_time': 1774565984.252082}
2026-03-26 22:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981144') HTTP/1.1" 204 0
2026-03-26 22:59:44 [ayvens.be] INFO: Found listing with ID: 1981145
2026-03-26 22:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981145%27 HTTP/1.1" 200 None
2026-03-26 22:59:44 [ayvens.be] INFO: Scrape type for 1981145: 2
2026-03-26 22:59:44 [ayvens.be] INFO: Extracting data for car ID: 1981145
2026-03-26 22:59:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 75831d27-db1a-57be-b9a4-6b8922f3a7f8 with identifier: 1981145
2026-03-26 22:59:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75831d27-db1a-57be-b9a4-6b8922f3a7f8 with scrape type 2
2026-03-26 22:59:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 75831d27-db1a-57be-b9a4-6b8922f3a7f8 with scrape type 2
2026-03-26 22:59:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 75831d27-db1a-57be-b9a4-6b8922f3a7f8, identifier: 1981145
2026-03-26 22:59:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 75831d27-db1a-57be-b9a4-6b8922f3a7f8 with identifier: 1981145
2026-03-26 22:59:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 75831d27-db1a-57be-b9a4-6b8922f3a7f8 with identifier: 1981145
2026-03-26 22:59:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 75831d27-db1a-57be-b9a4-6b8922f3a7f8 with identifier: 1981145 to the API
2026-03-26 22:59:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '75831d27-db1a-57be-b9a4-6b8922f3a7f8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'SUPERB COMBI',
 'odometer': 75263,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA SUPERB COMBI 1.4 TSI PHEV 160KW DSG6 AMBITION',
 'transmission': 'automatic',
 'trim': '1.4 TSI PHEV 160KW DSG6 AMBITION',
 'vin': None,
 'year': 2021}
2026-03-26 22:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981145%27 HTTP/1.1" 200 None
2026-03-26 22:59:44 [ayvens.be] INFO: Saving data for 1981145: {'auction_closing_time': 1774855800.0, 'created_time': 1774392344.203996, 'last_price_update_time': 1774565984.628546}
2026-03-26 22:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981145') HTTP/1.1" 204 0
2026-03-26 22:59:44 [ayvens.be] INFO: Found listing with ID: 1981146
2026-03-26 22:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981146%27 HTTP/1.1" 200 None
2026-03-26 22:59:44 [ayvens.be] INFO: Scrape type for 1981146: 2
2026-03-26 22:59:44 [ayvens.be] INFO: Extracting data for car ID: 1981146
2026-03-26 22:59:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c80c1a2f-015a-5969-ab5d-64b9e6a66da7 with identifier: 1981146
2026-03-26 22:59:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c80c1a2f-015a-5969-ab5d-64b9e6a66da7 with scrape type 2
2026-03-26 22:59:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c80c1a2f-015a-5969-ab5d-64b9e6a66da7 with scrape type 2
2026-03-26 22:59:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c80c1a2f-015a-5969-ab5d-64b9e6a66da7, identifier: 1981146
2026-03-26 22:59:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c80c1a2f-015a-5969-ab5d-64b9e6a66da7 with identifier: 1981146
2026-03-26 22:59:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c80c1a2f-015a-5969-ab5d-64b9e6a66da7 with identifier: 1981146
2026-03-26 22:59:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c80c1a2f-015a-5969-ab5d-64b9e6a66da7 with identifier: 1981146 to the API
2026-03-26 22:59:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'c80c1a2f-015a-5969-ab5d-64b9e6a66da7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 126846,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T4 RECHARGE GEARTR. INSCRIPTION EXPR',
 'transmission': 'automatic',
 'trim': '1.5 T4 RECHARGE GEARTR. INSCRIPTION EXPR',
 'vin': None,
 'year': 2021}
2026-03-26 22:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981146%27 HTTP/1.1" 200 None
2026-03-26 22:59:45 [ayvens.be] INFO: Saving data for 1981146: {'auction_closing_time': 1774855800.0, 'created_time': 1774392346.312486, 'last_price_update_time': 1774565985.104125}
2026-03-26 22:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981146') HTTP/1.1" 204 0
2026-03-26 22:59:45 [ayvens.be] INFO: Found listing with ID: 1981147
2026-03-26 22:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981147%27 HTTP/1.1" 200 None
2026-03-26 22:59:45 [ayvens.be] INFO: Scrape type for 1981147: 2
2026-03-26 22:59:45 [ayvens.be] INFO: Extracting data for car ID: 1981147
2026-03-26 22:59:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d383ddfc-c6f8-58f9-8819-387d76fdbede with identifier: 1981147
2026-03-26 22:59:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d383ddfc-c6f8-58f9-8819-387d76fdbede with scrape type 2
2026-03-26 22:59:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d383ddfc-c6f8-58f9-8819-387d76fdbede with scrape type 2
2026-03-26 22:59:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d383ddfc-c6f8-58f9-8819-387d76fdbede, identifier: 1981147
2026-03-26 22:59:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d383ddfc-c6f8-58f9-8819-387d76fdbede with identifier: 1981147
2026-03-26 22:59:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d383ddfc-c6f8-58f9-8819-387d76fdbede with identifier: 1981147
2026-03-26 22:59:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d383ddfc-c6f8-58f9-8819-387d76fdbede with identifier: 1981147 to the API
2026-03-26 22:59:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'd383ddfc-c6f8-58f9-8819-387d76fdbede',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '308 SW',
 'odometer': 87676,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 308 SW 1.2 PURETECH 96KW S-S GT PACK',
 'transmission': 'manual',
 'trim': '1.2 PURETECH 96KW S-S GT PACK',
 'vin': None,
 'year': 2021}
2026-03-26 22:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981147%27 HTTP/1.1" 200 None
2026-03-26 22:59:45 [ayvens.be] INFO: Saving data for 1981147: {'auction_closing_time': 1774855800.0, 'created_time': 1774392348.212917, 'last_price_update_time': 1774565985.468085}
2026-03-26 22:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981147') HTTP/1.1" 204 0
2026-03-26 22:59:45 [ayvens.be] INFO: Found listing with ID: 1981148
2026-03-26 22:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981148%27 HTTP/1.1" 200 None
2026-03-26 22:59:45 [ayvens.be] INFO: Scrape type for 1981148: 2
2026-03-26 22:59:45 [ayvens.be] INFO: Extracting data for car ID: 1981148
2026-03-26 22:59:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 95c75bc2-fcb0-517e-8e3c-23cf7736db37 with identifier: 1981148
2026-03-26 22:59:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95c75bc2-fcb0-517e-8e3c-23cf7736db37 with scrape type 2
2026-03-26 22:59:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 95c75bc2-fcb0-517e-8e3c-23cf7736db37 with scrape type 2
2026-03-26 22:59:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 95c75bc2-fcb0-517e-8e3c-23cf7736db37, identifier: 1981148
2026-03-26 22:59:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 95c75bc2-fcb0-517e-8e3c-23cf7736db37 with identifier: 1981148
2026-03-26 22:59:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 95c75bc2-fcb0-517e-8e3c-23cf7736db37 with identifier: 1981148
2026-03-26 22:59:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 95c75bc2-fcb0-517e-8e3c-23cf7736db37 with identifier: 1981148 to the API
2026-03-26 22:59:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 43,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '95c75bc2-fcb0-517e-8e3c-23cf7736db37',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 190552,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T5 TE PHEV R-Design DCT STOCK',
 'transmission': 'automatic',
 'trim': '1.5 T5 TE PHEV R-Design DCT STOCK',
 'vin': None,
 'year': 2020}
2026-03-26 22:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981148%27 HTTP/1.1" 200 None
2026-03-26 22:59:45 [ayvens.be] INFO: Saving data for 1981148: {'auction_closing_time': 1774855800.0, 'created_time': 1774392349.406868, 'last_price_update_time': 1774565985.84425}
2026-03-26 22:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981148') HTTP/1.1" 204 0
2026-03-26 22:59:45 [ayvens.be] INFO: Found listing with ID: 1981149
2026-03-26 22:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981149%27 HTTP/1.1" 200 None
2026-03-26 22:59:45 [ayvens.be] INFO: Scrape type for 1981149: 2
2026-03-26 22:59:45 [ayvens.be] INFO: Extracting data for car ID: 1981149
2026-03-26 22:59:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 95495680-c237-5901-b6dc-368b4f2bde71 with identifier: 1981149
2026-03-26 22:59:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95495680-c237-5901-b6dc-368b4f2bde71 with scrape type 2
2026-03-26 22:59:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 95495680-c237-5901-b6dc-368b4f2bde71 with scrape type 2
2026-03-26 22:59:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 95495680-c237-5901-b6dc-368b4f2bde71, identifier: 1981149
2026-03-26 22:59:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 95495680-c237-5901-b6dc-368b4f2bde71 with identifier: 1981149
2026-03-26 22:59:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 95495680-c237-5901-b6dc-368b4f2bde71 with identifier: 1981149
2026-03-26 22:59:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 95495680-c237-5901-b6dc-368b4f2bde71 with identifier: 1981149 to the API
2026-03-26 22:59:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '95495680-c237-5901-b6dc-368b4f2bde71',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLASS GLB DIESEL (X247)',
 'odometer': 164034,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-29',
 'seats_number': 7,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLASS GLB DIESEL (X247) GLB 200 d Business Solution',
 'transmission': 'automatic',
 'trim': 'GLB 200 d Business Solution',
 'vin': None,
 'year': 2020}
2026-03-26 22:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981149%27 HTTP/1.1" 200 None
2026-03-26 22:59:46 [ayvens.be] INFO: Saving data for 1981149: {'auction_closing_time': 1774855800.0, 'created_time': 1774392351.239466, 'last_price_update_time': 1774565986.213633}
2026-03-26 22:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981149') HTTP/1.1" 204 0
2026-03-26 22:59:46 [ayvens.be] INFO: Found listing with ID: 1981150
2026-03-26 22:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981150%27 HTTP/1.1" 200 None
2026-03-26 22:59:46 [ayvens.be] INFO: Scrape type for 1981150: 2
2026-03-26 22:59:46 [ayvens.be] INFO: Extracting data for car ID: 1981150
2026-03-26 22:59:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 67d18c03-5a70-52d6-8f3a-d501780a05bb with identifier: 1981150
2026-03-26 22:59:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67d18c03-5a70-52d6-8f3a-d501780a05bb with scrape type 2
2026-03-26 22:59:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 67d18c03-5a70-52d6-8f3a-d501780a05bb with scrape type 2
2026-03-26 22:59:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 67d18c03-5a70-52d6-8f3a-d501780a05bb, identifier: 1981150
2026-03-26 22:59:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 67d18c03-5a70-52d6-8f3a-d501780a05bb with identifier: 1981150
2026-03-26 22:59:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 67d18c03-5a70-52d6-8f3a-d501780a05bb with identifier: 1981150
2026-03-26 22:59:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 67d18c03-5a70-52d6-8f3a-d501780a05bb with identifier: 1981150 to the API
2026-03-26 22:59:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 179,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '67d18c03-5a70-52d6-8f3a-d501780a05bb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT 2T 350M FOU MWB HR DSL',
 'odometer': 33608,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-04',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FORD TRANSIT 2T 350M FOU MWB HR DSL 2.0 TDCi L2H2 Trend',
 'transmission': 'manual',
 'trim': '2.0 TDCi L2H2 Trend',
 'vin': None,
 'year': 2018}
2026-03-26 22:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981150%27 HTTP/1.1" 200 None
2026-03-26 22:59:46 [ayvens.be] INFO: Saving data for 1981150: {'auction_closing_time': 1774855800.0, 'created_time': 1774392352.904018, 'last_price_update_time': 1774565986.67288}
2026-03-26 22:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981150') HTTP/1.1" 204 0
2026-03-26 22:59:46 [ayvens.be] INFO: Found listing with ID: 1981151
2026-03-26 22:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981151%27 HTTP/1.1" 200 None
2026-03-26 22:59:46 [ayvens.be] INFO: Scrape type for 1981151: 2
2026-03-26 22:59:46 [ayvens.be] INFO: Extracting data for car ID: 1981151
2026-03-26 22:59:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2c73026-a151-5067-8118-8a4478549aa2 with identifier: 1981151
2026-03-26 22:59:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2c73026-a151-5067-8118-8a4478549aa2 with scrape type 2
2026-03-26 22:59:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b2c73026-a151-5067-8118-8a4478549aa2 with scrape type 2
2026-03-26 22:59:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b2c73026-a151-5067-8118-8a4478549aa2, identifier: 1981151
2026-03-26 22:59:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b2c73026-a151-5067-8118-8a4478549aa2 with identifier: 1981151
2026-03-26 22:59:46 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 22:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 22:59:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b2c73026-a151-5067-8118-8a4478549aa2 with identifier: 1981151
2026-03-26 22:59:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b2c73026-a151-5067-8118-8a4478549aa2 with identifier: 1981151 to the API
2026-03-26 22:59:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 33,
 'color': 'SKYSCRAPER GRAU',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'b2c73026-a151-5067-8118-8a4478549aa2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '5 SERIES BERLINE',
 'odometer': 57590,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 5 SERIES BERLINE 2.0 530E 215KW AUTO',
 'transmission': 'automatic',
 'trim': '2.0 530E 215KW AUTO',
 'vin': None,
 'year': 2023}
2026-03-26 22:59:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981151%27 HTTP/1.1" 200 None
2026-03-26 22:59:47 [ayvens.be] INFO: Saving data for 1981151: {'auction_closing_time': 1774855800.0, 'created_time': 1774392354.444965, 'last_price_update_time': 1774565987.097137}
2026-03-26 22:59:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981151') HTTP/1.1" 204 0
2026-03-26 22:59:47 [ayvens.be] INFO: Found listing with ID: 1981152
2026-03-26 22:59:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981152%27 HTTP/1.1" 200 None
2026-03-26 22:59:47 [ayvens.be] INFO: Scrape type for 1981152: 2
2026-03-26 22:59:47 [ayvens.be] INFO: Extracting data for car ID: 1981152
2026-03-26 22:59:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd809381-d151-5296-b62b-a4d865d26fdf with identifier: 1981152
2026-03-26 22:59:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd809381-d151-5296-b62b-a4d865d26fdf with scrape type 2
2026-03-26 22:59:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cd809381-d151-5296-b62b-a4d865d26fdf with scrape type 2
2026-03-26 22:59:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: cd809381-d151-5296-b62b-a4d865d26fdf, identifier: 1981152
2026-03-26 22:59:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: cd809381-d151-5296-b62b-a4d865d26fdf with identifier: 1981152
2026-03-26 22:59:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: cd809381-d151-5296-b62b-a4d865d26fdf with identifier: 1981152
2026-03-26 22:59:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: cd809381-d151-5296-b62b-a4d865d26fdf with identifier: 1981152 to the API
2026-03-26 22:59:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'cd809381-d151-5296-b62b-a4d865d26fdf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'QASHQAI',
 'odometer': 91724,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN QASHQAI 1.3 MHEV 116KW ACENTA XTRONIC',
 'transmission': 'automatic',
 'trim': '1.3 MHEV 116KW ACENTA XTRONIC',
 'vin': None,
 'year': 2023}
2026-03-26 22:59:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981152%27 HTTP/1.1" 200 None
2026-03-26 22:59:47 [ayvens.be] INFO: Saving data for 1981152: {'auction_closing_time': 1774855800.0, 'created_time': 1774392356.262048, 'last_price_update_time': 1774565987.496551}
2026-03-26 22:59:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981152') HTTP/1.1" 204 0
2026-03-26 22:59:47 [ayvens.be] INFO: Found listing with ID: 1981153
2026-03-26 22:59:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981153%27 HTTP/1.1" 200 None
2026-03-26 22:59:47 [ayvens.be] INFO: Scrape type for 1981153: 2
2026-03-26 22:59:47 [ayvens.be] INFO: Extracting data for car ID: 1981153
2026-03-26 22:59:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a2eb5f30-0659-59ec-97ca-b4d7614e8aba with identifier: 1981153
2026-03-26 22:59:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2eb5f30-0659-59ec-97ca-b4d7614e8aba with scrape type 2
2026-03-26 22:59:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a2eb5f30-0659-59ec-97ca-b4d7614e8aba with scrape type 2
2026-03-26 22:59:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a2eb5f30-0659-59ec-97ca-b4d7614e8aba, identifier: 1981153
2026-03-26 22:59:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a2eb5f30-0659-59ec-97ca-b4d7614e8aba with identifier: 1981153
2026-03-26 22:59:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a2eb5f30-0659-59ec-97ca-b4d7614e8aba with identifier: 1981153
2026-03-26 22:59:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a2eb5f30-0659-59ec-97ca-b4d7614e8aba with identifier: 1981153 to the API
2026-03-26 22:59:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'electric',
 'id': 'a2eb5f30-0659-59ec-97ca-b4d7614e8aba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'POLESTAR',
 'model': '2',
 'odometer': 48318,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'POLESTAR 2 BEV 64KWH SINGLE MOTOR STANDARD RANGE',
 'transmission': 'automatic',
 'trim': 'BEV 64KWH SINGLE MOTOR STANDARD RANGE',
 'vin': None,
 'year': 2022}
2026-03-26 22:59:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981153%27 HTTP/1.1" 200 None
2026-03-26 22:59:47 [ayvens.be] INFO: Saving data for 1981153: {'auction_closing_time': 1774855800.0, 'created_time': 1774392357.339076, 'last_price_update_time': 1774565987.860376}
2026-03-26 22:59:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981153') HTTP/1.1" 204 0
2026-03-26 22:59:47 [ayvens.be] INFO: Found listing with ID: 1981154
2026-03-26 22:59:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981154%27 HTTP/1.1" 200 None
2026-03-26 22:59:47 [ayvens.be] INFO: Scrape type for 1981154: 2
2026-03-26 22:59:47 [ayvens.be] INFO: Extracting data for car ID: 1981154
2026-03-26 22:59:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30fa89c7-74f2-5738-9f5a-2c2b02344a0d with identifier: 1981154
2026-03-26 22:59:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30fa89c7-74f2-5738-9f5a-2c2b02344a0d with scrape type 2
2026-03-26 22:59:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 30fa89c7-74f2-5738-9f5a-2c2b02344a0d with scrape type 2
2026-03-26 22:59:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 30fa89c7-74f2-5738-9f5a-2c2b02344a0d, identifier: 1981154
2026-03-26 22:59:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 30fa89c7-74f2-5738-9f5a-2c2b02344a0d with identifier: 1981154
2026-03-26 22:59:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 30fa89c7-74f2-5738-9f5a-2c2b02344a0d with identifier: 1981154
2026-03-26 22:59:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 30fa89c7-74f2-5738-9f5a-2c2b02344a0d with identifier: 1981154 to the API
2026-03-26 22:59:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '30fa89c7-74f2-5738-9f5a-2c2b02344a0d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'CITROAu2039N',
 'model': 'C5 AIRCROSS',
 'odometer': 101522,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROAu2039N C5 AIRCROSS 1.6 PureTech PHEV Shine S&S',
 'transmission': 'automatic',
 'trim': '1.6 PureTech PHEV Shine S&S',
 'vin': None,
 'year': 2020}
2026-03-26 22:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981154%27 HTTP/1.1" 200 None
2026-03-26 22:59:48 [ayvens.be] INFO: Saving data for 1981154: {'auction_closing_time': 1774855800.0, 'created_time': 1774392358.96782, 'last_price_update_time': 1774565988.2537}
2026-03-26 22:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981154') HTTP/1.1" 204 0
2026-03-26 22:59:48 [ayvens.be] INFO: Found listing with ID: 1981155
2026-03-26 22:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981155%27 HTTP/1.1" 200 None
2026-03-26 22:59:48 [ayvens.be] INFO: Scrape type for 1981155: 2
2026-03-26 22:59:48 [ayvens.be] INFO: Extracting data for car ID: 1981155
2026-03-26 22:59:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40d9d405-e816-59b5-8743-cae75190dd16 with identifier: 1981155
2026-03-26 22:59:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40d9d405-e816-59b5-8743-cae75190dd16 with scrape type 2
2026-03-26 22:59:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 40d9d405-e816-59b5-8743-cae75190dd16 with scrape type 2
2026-03-26 22:59:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 40d9d405-e816-59b5-8743-cae75190dd16, identifier: 1981155
2026-03-26 22:59:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 40d9d405-e816-59b5-8743-cae75190dd16 with identifier: 1981155
2026-03-26 22:59:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 40d9d405-e816-59b5-8743-cae75190dd16 with identifier: 1981155
2026-03-26 22:59:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 40d9d405-e816-59b5-8743-cae75190dd16 with identifier: 1981155 to the API
2026-03-26 22:59:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '40d9d405-e816-59b5-8743-cae75190dd16',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '1 SERIES HATCH',
 'odometer': 93963,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1 SERIES HATCH 1.5 116D (85KW)',
 'transmission': 'manual',
 'trim': '1.5 116D (85KW)',
 'vin': None,
 'year': 2022}
2026-03-26 22:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981155%27 HTTP/1.1" 200 None
2026-03-26 22:59:48 [ayvens.be] INFO: Saving data for 1981155: {'auction_closing_time': 1774855800.0, 'created_time': 1774392361.295842, 'last_price_update_time': 1774565988.653299}
2026-03-26 22:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981155') HTTP/1.1" 204 0
2026-03-26 22:59:48 [ayvens.be] INFO: Found listing with ID: 1981156
2026-03-26 22:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981156%27 HTTP/1.1" 200 None
2026-03-26 22:59:48 [ayvens.be] INFO: Scrape type for 1981156: 2
2026-03-26 22:59:48 [ayvens.be] INFO: Extracting data for car ID: 1981156
2026-03-26 22:59:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79a9001d-4382-56d9-8dea-163a7a9c475a with identifier: 1981156
2026-03-26 22:59:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79a9001d-4382-56d9-8dea-163a7a9c475a with scrape type 2
2026-03-26 22:59:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 79a9001d-4382-56d9-8dea-163a7a9c475a with scrape type 2
2026-03-26 22:59:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 79a9001d-4382-56d9-8dea-163a7a9c475a, identifier: 1981156
2026-03-26 22:59:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 79a9001d-4382-56d9-8dea-163a7a9c475a with identifier: 1981156
2026-03-26 22:59:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 79a9001d-4382-56d9-8dea-163a7a9c475a with identifier: 1981156
2026-03-26 22:59:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 79a9001d-4382-56d9-8dea-163a7a9c475a with identifier: 1981156 to the API
2026-03-26 22:59:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '79a9001d-4382-56d9-8dea-163a7a9c475a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A3',
 'odometer': 86513,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A3 1.4 40 TFSI E S TRON. ADVANCED SPORTBACK',
 'transmission': 'automatic',
 'trim': '1.4 40 TFSI E S TRON. ADVANCED SPORTBACK',
 'vin': None,
 'year': 2022}
2026-03-26 22:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981156%27 HTTP/1.1" 200 None
2026-03-26 22:59:49 [ayvens.be] INFO: Saving data for 1981156: {'auction_closing_time': 1774855800.0, 'created_time': 1774392363.220389, 'last_price_update_time': 1774565989.053309}
2026-03-26 22:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981156') HTTP/1.1" 204 0
2026-03-26 22:59:49 [ayvens.be] INFO: Found listing with ID: 1981157
2026-03-26 22:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981157%27 HTTP/1.1" 200 None
2026-03-26 22:59:49 [ayvens.be] INFO: Scrape type for 1981157: 2
2026-03-26 22:59:49 [ayvens.be] INFO: Extracting data for car ID: 1981157
2026-03-26 22:59:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7de6e15d-a6a6-5347-8ee9-97962eae7102 with identifier: 1981157
2026-03-26 22:59:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7de6e15d-a6a6-5347-8ee9-97962eae7102 with scrape type 2
2026-03-26 22:59:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7de6e15d-a6a6-5347-8ee9-97962eae7102 with scrape type 2
2026-03-26 22:59:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 7de6e15d-a6a6-5347-8ee9-97962eae7102, identifier: 1981157
2026-03-26 22:59:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 7de6e15d-a6a6-5347-8ee9-97962eae7102 with identifier: 1981157
2026-03-26 22:59:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 7de6e15d-a6a6-5347-8ee9-97962eae7102 with identifier: 1981157
2026-03-26 22:59:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 7de6e15d-a6a6-5347-8ee9-97962eae7102 with identifier: 1981157 to the API
2026-03-26 22:59:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '7de6e15d-a6a6-5347-8ee9-97962eae7102',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '1 SERIES HATCH',
 'odometer': 92277,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1 SERIES HATCH 1.5 116DA (85KW)',
 'transmission': 'automatic',
 'trim': '1.5 116DA (85KW)',
 'vin': None,
 'year': 2022}
2026-03-26 22:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981157%27 HTTP/1.1" 200 None
2026-03-26 22:59:49 [ayvens.be] INFO: Saving data for 1981157: {'auction_closing_time': 1774855800.0, 'created_time': 1774392365.077413, 'last_price_update_time': 1774565989.550786}
2026-03-26 22:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981157') HTTP/1.1" 204 0
2026-03-26 22:59:49 [ayvens.be] INFO: Found listing with ID: 1981158
2026-03-26 22:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981158%27 HTTP/1.1" 200 None
2026-03-26 22:59:49 [ayvens.be] INFO: Scrape type for 1981158: 2
2026-03-26 22:59:49 [ayvens.be] INFO: Extracting data for car ID: 1981158
2026-03-26 22:59:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c56cdfc2-f6a0-5415-8a30-9cc226ccf3e3 with identifier: 1981158
2026-03-26 22:59:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c56cdfc2-f6a0-5415-8a30-9cc226ccf3e3 with scrape type 2
2026-03-26 22:59:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c56cdfc2-f6a0-5415-8a30-9cc226ccf3e3 with scrape type 2
2026-03-26 22:59:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c56cdfc2-f6a0-5415-8a30-9cc226ccf3e3, identifier: 1981158
2026-03-26 22:59:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c56cdfc2-f6a0-5415-8a30-9cc226ccf3e3 with identifier: 1981158
2026-03-26 22:59:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c56cdfc2-f6a0-5415-8a30-9cc226ccf3e3 with identifier: 1981158
2026-03-26 22:59:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c56cdfc2-f6a0-5415-8a30-9cc226ccf3e3 with identifier: 1981158 to the API
2026-03-26 22:59:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'c56cdfc2-f6a0-5415-8a30-9cc226ccf3e3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '3 SERIES TOURING',
 'odometer': 171872,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3 SERIES TOURING 2.0 330E (215KW) TOURING',
 'transmission': 'automatic',
 'trim': '2.0 330E (215KW) TOURING',
 'vin': None,
 'year': 2022}
2026-03-26 22:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981158%27 HTTP/1.1" 200 None
2026-03-26 22:59:49 [ayvens.be] INFO: Saving data for 1981158: {'auction_closing_time': 1774855800.0, 'created_time': 1774392366.228704, 'last_price_update_time': 1774565989.936449}
2026-03-26 22:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981158') HTTP/1.1" 204 0
2026-03-26 22:59:49 [ayvens.be] INFO: Found listing with ID: 1981159
2026-03-26 22:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981159%27 HTTP/1.1" 200 None
2026-03-26 22:59:49 [ayvens.be] INFO: Scrape type for 1981159: 2
2026-03-26 22:59:49 [ayvens.be] INFO: Extracting data for car ID: 1981159
2026-03-26 22:59:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bfc8ad3b-0a22-5704-af7f-eb08498cc608 with identifier: 1981159
2026-03-26 22:59:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bfc8ad3b-0a22-5704-af7f-eb08498cc608 with scrape type 2
2026-03-26 22:59:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bfc8ad3b-0a22-5704-af7f-eb08498cc608 with scrape type 2
2026-03-26 22:59:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: bfc8ad3b-0a22-5704-af7f-eb08498cc608, identifier: 1981159
2026-03-26 22:59:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: bfc8ad3b-0a22-5704-af7f-eb08498cc608 with identifier: 1981159
2026-03-26 22:59:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: bfc8ad3b-0a22-5704-af7f-eb08498cc608 with identifier: 1981159
2026-03-26 22:59:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: bfc8ad3b-0a22-5704-af7f-eb08498cc608 with identifier: 1981159 to the API
2026-03-26 22:59:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'bfc8ad3b-0a22-5704-af7f-eb08498cc608',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '1 SERIES HATCH',
 'odometer': 50569,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1 SERIES HATCH 1.5 116DA (85KW)',
 'transmission': 'automatic',
 'trim': '1.5 116DA (85KW)',
 'vin': None,
 'year': 2022}
2026-03-26 22:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981159%27 HTTP/1.1" 200 None
2026-03-26 22:59:50 [ayvens.be] INFO: Saving data for 1981159: {'auction_closing_time': 1774855800.0, 'created_time': 1774392369.032312, 'last_price_update_time': 1774565990.323866}
2026-03-26 22:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981159') HTTP/1.1" 204 0
2026-03-26 22:59:50 [ayvens.be] INFO: Found listing with ID: 1981160
2026-03-26 22:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981160%27 HTTP/1.1" 200 None
2026-03-26 22:59:50 [ayvens.be] INFO: Scrape type for 1981160: 2
2026-03-26 22:59:50 [ayvens.be] INFO: Extracting data for car ID: 1981160
2026-03-26 22:59:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8921c252-c828-5ada-af84-a5834b0a35cf with identifier: 1981160
2026-03-26 22:59:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8921c252-c828-5ada-af84-a5834b0a35cf with scrape type 2
2026-03-26 22:59:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8921c252-c828-5ada-af84-a5834b0a35cf with scrape type 2
2026-03-26 22:59:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 8921c252-c828-5ada-af84-a5834b0a35cf, identifier: 1981160
2026-03-26 22:59:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 8921c252-c828-5ada-af84-a5834b0a35cf with identifier: 1981160
2026-03-26 22:59:50 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 22:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 22:59:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 8921c252-c828-5ada-af84-a5834b0a35cf with identifier: 1981160
2026-03-26 22:59:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 8921c252-c828-5ada-af84-a5834b0a35cf with identifier: 1981160 to the API
2026-03-26 22:59:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '8921c252-c828-5ada-af84-a5834b0a35cf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'LEON DIESEL - 2017',
 'odometer': 84412,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT LEON DIESEL - 2017 2.0 CR TDi Move! Ultimate DSG',
 'transmission': 'automatic',
 'trim': '2.0 CR TDi Move! Ultimate DSG',
 'vin': None,
 'year': 2020}
2026-03-26 22:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981160%27 HTTP/1.1" 200 None
2026-03-26 22:59:50 [ayvens.be] INFO: Saving data for 1981160: {'auction_closing_time': 1774855800.0, 'created_time': 1774392370.035216, 'last_price_update_time': 1774565990.70016}
2026-03-26 22:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981160') HTTP/1.1" 204 0
2026-03-26 22:59:50 [ayvens.be] INFO: Found listing with ID: 1981161
2026-03-26 22:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981161%27 HTTP/1.1" 200 None
2026-03-26 22:59:50 [ayvens.be] INFO: Scrape type for 1981161: 2
2026-03-26 22:59:50 [ayvens.be] INFO: Extracting data for car ID: 1981161
2026-03-26 22:59:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2fc17eb-8cc4-5060-a30b-08e075170d4d with identifier: 1981161
2026-03-26 22:59:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2fc17eb-8cc4-5060-a30b-08e075170d4d with scrape type 2
2026-03-26 22:59:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d2fc17eb-8cc4-5060-a30b-08e075170d4d with scrape type 2
2026-03-26 22:59:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d2fc17eb-8cc4-5060-a30b-08e075170d4d, identifier: 1981161
2026-03-26 22:59:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d2fc17eb-8cc4-5060-a30b-08e075170d4d with identifier: 1981161
2026-03-26 22:59:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d2fc17eb-8cc4-5060-a30b-08e075170d4d with identifier: 1981161
2026-03-26 22:59:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d2fc17eb-8cc4-5060-a30b-08e075170d4d with identifier: 1981161 to the API
2026-03-26 22:59:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 39,
 'color': 'SAPHIRSCHWARZ METALLIC',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'd2fc17eb-8cc4-5060-a30b-08e075170d4d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X2',
 'odometer': 60204,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X2 1.5 XDRIVE25E (162KW)',
 'transmission': 'automatic',
 'trim': '1.5 XDRIVE25E (162KW)',
 'vin': None,
 'year': 2021}
2026-03-26 22:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981161%27 HTTP/1.1" 200 None
2026-03-26 22:59:51 [ayvens.be] INFO: Saving data for 1981161: {'auction_closing_time': 1774855800.0, 'created_time': 1774392371.303155, 'last_price_update_time': 1774565991.064788}
2026-03-26 22:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981161') HTTP/1.1" 204 0
2026-03-26 22:59:51 [ayvens.be] INFO: Found listing with ID: 1981162
2026-03-26 22:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981162%27 HTTP/1.1" 200 None
2026-03-26 22:59:51 [ayvens.be] INFO: Scrape type for 1981162: 2
2026-03-26 22:59:51 [ayvens.be] INFO: Extracting data for car ID: 1981162
2026-03-26 22:59:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3768bda1-7314-5a71-83e5-60dfb18d6a21 with identifier: 1981162
2026-03-26 22:59:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3768bda1-7314-5a71-83e5-60dfb18d6a21 with scrape type 2
2026-03-26 22:59:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3768bda1-7314-5a71-83e5-60dfb18d6a21 with scrape type 2
2026-03-26 22:59:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 3768bda1-7314-5a71-83e5-60dfb18d6a21, identifier: 1981162
2026-03-26 22:59:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 3768bda1-7314-5a71-83e5-60dfb18d6a21 with identifier: 1981162
2026-03-26 22:59:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 3768bda1-7314-5a71-83e5-60dfb18d6a21 with identifier: 1981162
2026-03-26 22:59:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 3768bda1-7314-5a71-83e5-60dfb18d6a21 with identifier: 1981162 to the API
2026-03-26 22:59:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '3768bda1-7314-5a71-83e5-60dfb18d6a21',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'OCTAVIA COMBI - 2020',
 'odometer': 125754,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA OCTAVIA COMBI - 2020 1.5 TSI Style',
 'transmission': 'manual',
 'trim': '1.5 TSI Style',
 'vin': None,
 'year': 2020}
2026-03-26 22:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981162%27 HTTP/1.1" 200 None
2026-03-26 22:59:51 [ayvens.be] INFO: Saving data for 1981162: {'auction_closing_time': 1774855800.0, 'created_time': 1774392373.982268, 'last_price_update_time': 1774565991.441559}
2026-03-26 22:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981162') HTTP/1.1" 204 0
2026-03-26 22:59:51 [ayvens.be] INFO: Found listing with ID: 1981163
2026-03-26 22:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981163%27 HTTP/1.1" 200 None
2026-03-26 22:59:51 [ayvens.be] INFO: Scrape type for 1981163: 2
2026-03-26 22:59:51 [ayvens.be] INFO: Extracting data for car ID: 1981163
2026-03-26 22:59:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 633de39c-557a-5914-acd1-c2a22f2cf2b7 with identifier: 1981163
2026-03-26 22:59:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 633de39c-557a-5914-acd1-c2a22f2cf2b7 with scrape type 2
2026-03-26 22:59:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 633de39c-557a-5914-acd1-c2a22f2cf2b7 with scrape type 2
2026-03-26 22:59:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 633de39c-557a-5914-acd1-c2a22f2cf2b7, identifier: 1981163
2026-03-26 22:59:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 633de39c-557a-5914-acd1-c2a22f2cf2b7 with identifier: 1981163
2026-03-26 22:59:51 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 22:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 22:59:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 633de39c-557a-5914-acd1-c2a22f2cf2b7 with identifier: 1981163
2026-03-26 22:59:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 633de39c-557a-5914-acd1-c2a22f2cf2b7 with identifier: 1981163 to the API
2026-03-26 22:59:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'color': 'MYTHOSZWART METAALKLEUR',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '633de39c-557a-5914-acd1-c2a22f2cf2b7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3 SPORTBACK',
 'odometer': 63981,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 SPORTBACK 2.0 35 TDI S TRONIC QUATTRO',
 'transmission': 'automatic',
 'trim': '2.0 35 TDI S TRONIC QUATTRO',
 'vin': None,
 'year': 2021}
2026-03-26 22:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981163%27 HTTP/1.1" 200 None
2026-03-26 22:59:51 [ayvens.be] INFO: Saving data for 1981163: {'auction_closing_time': 1774855800.0, 'created_time': 1774392375.101855, 'last_price_update_time': 1774565991.819289}
2026-03-26 22:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981163') HTTP/1.1" 204 0
2026-03-26 22:59:51 [ayvens.be] INFO: Found listing with ID: 1981164
2026-03-26 22:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981164%27 HTTP/1.1" 200 None
2026-03-26 22:59:51 [ayvens.be] INFO: Scrape type for 1981164: 2
2026-03-26 22:59:51 [ayvens.be] INFO: Extracting data for car ID: 1981164
2026-03-26 22:59:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ea36366-becb-52d6-adf2-de44265f70ba with identifier: 1981164
2026-03-26 22:59:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ea36366-becb-52d6-adf2-de44265f70ba with scrape type 2
2026-03-26 22:59:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2ea36366-becb-52d6-adf2-de44265f70ba with scrape type 2
2026-03-26 22:59:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 2ea36366-becb-52d6-adf2-de44265f70ba, identifier: 1981164
2026-03-26 22:59:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 2ea36366-becb-52d6-adf2-de44265f70ba with identifier: 1981164
2026-03-26 22:59:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 2ea36366-becb-52d6-adf2-de44265f70ba with identifier: 1981164
2026-03-26 22:59:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 2ea36366-becb-52d6-adf2-de44265f70ba with identifier: 1981164 to the API
2026-03-26 22:59:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '2ea36366-becb-52d6-adf2-de44265f70ba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 42910,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 2008 1.2 PURETECH 96KW S-S GT',
 'transmission': 'manual',
 'trim': '1.2 PURETECH 96KW S-S GT',
 'vin': None,
 'year': 2022}
2026-03-26 22:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981164%27 HTTP/1.1" 200 None
2026-03-26 22:59:52 [ayvens.be] INFO: Saving data for 1981164: {'auction_closing_time': 1774855800.0, 'created_time': 1774392376.659302, 'last_price_update_time': 1774565992.211207}
2026-03-26 22:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981164') HTTP/1.1" 204 0
2026-03-26 22:59:52 [ayvens.be] INFO: Found listing with ID: 1981165
2026-03-26 22:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981165%27 HTTP/1.1" 200 None
2026-03-26 22:59:52 [ayvens.be] INFO: Scrape type for 1981165: 2
2026-03-26 22:59:52 [ayvens.be] INFO: Extracting data for car ID: 1981165
2026-03-26 22:59:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 86cae8a2-90d4-5ee6-8835-6f25660ee9f0 with identifier: 1981165
2026-03-26 22:59:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 86cae8a2-90d4-5ee6-8835-6f25660ee9f0 with scrape type 2
2026-03-26 22:59:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 86cae8a2-90d4-5ee6-8835-6f25660ee9f0 with scrape type 2
2026-03-26 22:59:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 86cae8a2-90d4-5ee6-8835-6f25660ee9f0, identifier: 1981165
2026-03-26 22:59:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 86cae8a2-90d4-5ee6-8835-6f25660ee9f0 with identifier: 1981165
2026-03-26 22:59:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 86cae8a2-90d4-5ee6-8835-6f25660ee9f0 with identifier: 1981165
2026-03-26 22:59:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 86cae8a2-90d4-5ee6-8835-6f25660ee9f0 with identifier: 1981165 to the API
2026-03-26 22:59:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'electric',
 'id': '86cae8a2-90d4-5ee6-8835-6f25660ee9f0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'IX',
 'odometer': 62278,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW IX BEV 77KWH XDRIVE40',
 'transmission': 'automatic',
 'trim': 'BEV 77KWH XDRIVE40',
 'vin': None,
 'year': 2023}
2026-03-26 22:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981165%27 HTTP/1.1" 200 None
2026-03-26 22:59:52 [ayvens.be] INFO: Saving data for 1981165: {'auction_closing_time': 1774855800.0, 'created_time': 1774392378.632645, 'last_price_update_time': 1774565992.622291}
2026-03-26 22:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981165') HTTP/1.1" 204 0
2026-03-26 22:59:52 [ayvens.be] INFO: Found listing with ID: 1981166
2026-03-26 22:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981166%27 HTTP/1.1" 200 None
2026-03-26 22:59:52 [ayvens.be] INFO: Scrape type for 1981166: 2
2026-03-26 22:59:52 [ayvens.be] INFO: Extracting data for car ID: 1981166
2026-03-26 22:59:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82784532-457f-558d-bc1b-25ccb11a7de7 with identifier: 1981166
2026-03-26 22:59:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82784532-457f-558d-bc1b-25ccb11a7de7 with scrape type 2
2026-03-26 22:59:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 82784532-457f-558d-bc1b-25ccb11a7de7 with scrape type 2
2026-03-26 22:59:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 82784532-457f-558d-bc1b-25ccb11a7de7, identifier: 1981166
2026-03-26 22:59:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 82784532-457f-558d-bc1b-25ccb11a7de7 with identifier: 1981166
2026-03-26 22:59:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 82784532-457f-558d-bc1b-25ccb11a7de7 with identifier: 1981166
2026-03-26 22:59:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 82784532-457f-558d-bc1b-25ccb11a7de7 with identifier: 1981166 to the API
2026-03-26 22:59:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'electric',
 'id': '82784532-457f-558d-bc1b-25ccb11a7de7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'C40',
 'odometer': 74098,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO C40 BEV 78KWH RECHARGE TWIN ULTIMATE',
 'transmission': 'automatic',
 'trim': 'BEV 78KWH RECHARGE TWIN ULTIMATE',
 'vin': None,
 'year': 2022}
2026-03-26 22:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981166%27 HTTP/1.1" 200 None
2026-03-26 22:59:53 [ayvens.be] INFO: Saving data for 1981166: {'auction_closing_time': 1774855800.0, 'created_time': 1774392381.077474, 'last_price_update_time': 1774565993.008773}
2026-03-26 22:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981166') HTTP/1.1" 204 0
2026-03-26 22:59:53 [ayvens.be] INFO: Found listing with ID: 1981167
2026-03-26 22:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981167%27 HTTP/1.1" 200 None
2026-03-26 22:59:53 [ayvens.be] INFO: Scrape type for 1981167: 2
2026-03-26 22:59:53 [ayvens.be] INFO: Extracting data for car ID: 1981167
2026-03-26 22:59:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26fb0bb8-171f-523e-a686-3a59b11a0599 with identifier: 1981167
2026-03-26 22:59:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26fb0bb8-171f-523e-a686-3a59b11a0599 with scrape type 2
2026-03-26 22:59:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 26fb0bb8-171f-523e-a686-3a59b11a0599 with scrape type 2
2026-03-26 22:59:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 26fb0bb8-171f-523e-a686-3a59b11a0599, identifier: 1981167
2026-03-26 22:59:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 26fb0bb8-171f-523e-a686-3a59b11a0599 with identifier: 1981167
2026-03-26 22:59:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 26fb0bb8-171f-523e-a686-3a59b11a0599 with identifier: 1981167
2026-03-26 22:59:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 26fb0bb8-171f-523e-a686-3a59b11a0599 with identifier: 1981167 to the API
2026-03-26 22:59:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'color': 'SAPHIRSCHWARZ METALLIC',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '26fb0bb8-171f-523e-a686-3a59b11a0599',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '1 SERIES HATCH',
 'odometer': 73894,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1 SERIES HATCH 1.5 116DA (85KW) Model Advantage Business',
 'transmission': 'automatic',
 'trim': '1.5 116DA (85KW) Model Advantage Business',
 'vin': None,
 'year': 2021}
2026-03-26 22:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981167%27 HTTP/1.1" 200 None
2026-03-26 22:59:53 [ayvens.be] INFO: Saving data for 1981167: {'auction_closing_time': 1774855800.0, 'created_time': 1774392382.620115, 'last_price_update_time': 1774565993.389459}
2026-03-26 22:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981167') HTTP/1.1" 204 0
2026-03-26 22:59:53 [ayvens.be] INFO: Found listing with ID: 1981168
2026-03-26 22:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981168%27 HTTP/1.1" 200 None
2026-03-26 22:59:53 [ayvens.be] INFO: Scrape type for 1981168: 2
2026-03-26 22:59:53 [ayvens.be] INFO: Extracting data for car ID: 1981168
2026-03-26 22:59:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e06512cd-663b-5bfc-81eb-1250f1e387e6 with identifier: 1981168
2026-03-26 22:59:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e06512cd-663b-5bfc-81eb-1250f1e387e6 with scrape type 2
2026-03-26 22:59:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e06512cd-663b-5bfc-81eb-1250f1e387e6 with scrape type 2
2026-03-26 22:59:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e06512cd-663b-5bfc-81eb-1250f1e387e6, identifier: 1981168
2026-03-26 22:59:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e06512cd-663b-5bfc-81eb-1250f1e387e6 with identifier: 1981168
2026-03-26 22:59:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e06512cd-663b-5bfc-81eb-1250f1e387e6 with identifier: 1981168
2026-03-26 22:59:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e06512cd-663b-5bfc-81eb-1250f1e387e6 with identifier: 1981168 to the API
2026-03-26 22:59:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'e06512cd-663b-5bfc-81eb-1250f1e387e6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'GRANDLAND X',
 'odometer': 59559,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL GRANDLAND X 1.5 TURBO ECOTEC D 96KW S-S ULTIMATE',
 'transmission': 'manual',
 'trim': '1.5 TURBO ECOTEC D 96KW S-S ULTIMATE',
 'vin': None,
 'year': 2021}
2026-03-26 22:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981168%27 HTTP/1.1" 200 None
2026-03-26 22:59:53 [ayvens.be] INFO: Saving data for 1981168: {'auction_closing_time': 1774855800.0, 'created_time': 1774392384.256174, 'last_price_update_time': 1774565993.852726}
2026-03-26 22:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981168') HTTP/1.1" 204 0
2026-03-26 22:59:53 [ayvens.be] INFO: Found listing with ID: 1981169
2026-03-26 22:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981169%27 HTTP/1.1" 200 None
2026-03-26 22:59:53 [ayvens.be] INFO: Scrape type for 1981169: 2
2026-03-26 22:59:53 [ayvens.be] INFO: Extracting data for car ID: 1981169
2026-03-26 22:59:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bada9f12-e66f-5e16-8270-62c2bb7ec9f5 with identifier: 1981169
2026-03-26 22:59:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bada9f12-e66f-5e16-8270-62c2bb7ec9f5 with scrape type 2
2026-03-26 22:59:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bada9f12-e66f-5e16-8270-62c2bb7ec9f5 with scrape type 2
2026-03-26 22:59:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: bada9f12-e66f-5e16-8270-62c2bb7ec9f5, identifier: 1981169
2026-03-26 22:59:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: bada9f12-e66f-5e16-8270-62c2bb7ec9f5 with identifier: 1981169
2026-03-26 22:59:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: bada9f12-e66f-5e16-8270-62c2bb7ec9f5 with identifier: 1981169
2026-03-26 22:59:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: bada9f12-e66f-5e16-8270-62c2bb7ec9f5 with identifier: 1981169 to the API
2026-03-26 22:59:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'bada9f12-e66f-5e16-8270-62c2bb7ec9f5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3',
 'odometer': 73579,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 1.5 35 TFSI S TRONIC BUS. ED. ATTRACTION',
 'transmission': 'automatic',
 'trim': '1.5 35 TFSI S TRONIC BUS. ED. ATTRACTION',
 'vin': None,
 'year': 2022}
2026-03-26 22:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981169%27 HTTP/1.1" 200 None
2026-03-26 22:59:54 [ayvens.be] INFO: Saving data for 1981169: {'auction_closing_time': 1774855800.0, 'created_time': 1774392385.973873, 'last_price_update_time': 1774565994.2375}
2026-03-26 22:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981169') HTTP/1.1" 204 0
2026-03-26 22:59:54 [ayvens.be] INFO: Found listing with ID: 1981170
2026-03-26 22:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981170%27 HTTP/1.1" 200 None
2026-03-26 22:59:54 [ayvens.be] INFO: Scrape type for 1981170: 2
2026-03-26 22:59:54 [ayvens.be] INFO: Extracting data for car ID: 1981170
2026-03-26 22:59:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf74b177-c79e-5671-9cc0-4f2599309342 with identifier: 1981170
2026-03-26 22:59:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf74b177-c79e-5671-9cc0-4f2599309342 with scrape type 2
2026-03-26 22:59:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bf74b177-c79e-5671-9cc0-4f2599309342 with scrape type 2
2026-03-26 22:59:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: bf74b177-c79e-5671-9cc0-4f2599309342, identifier: 1981170
2026-03-26 22:59:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: bf74b177-c79e-5671-9cc0-4f2599309342 with identifier: 1981170
2026-03-26 22:59:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: bf74b177-c79e-5671-9cc0-4f2599309342 with identifier: 1981170
2026-03-26 22:59:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: bf74b177-c79e-5671-9cc0-4f2599309342 with identifier: 1981170 to the API
2026-03-26 22:59:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'bf74b177-c79e-5671-9cc0-4f2599309342',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q2',
 'odometer': 58340,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q2 35 TFSI (EU6d-TEMP)',
 'transmission': 'manual',
 'trim': '35 TFSI (EU6d-TEMP)',
 'vin': None,
 'year': 2020}
2026-03-26 22:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981170%27 HTTP/1.1" 200 None
2026-03-26 22:59:54 [ayvens.be] INFO: Saving data for 1981170: {'auction_closing_time': 1774855800.0, 'created_time': 1774392387.442555, 'last_price_update_time': 1774565994.613013}
2026-03-26 22:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981170') HTTP/1.1" 204 0
2026-03-26 22:59:54 [ayvens.be] INFO: Found listing with ID: 1981171
2026-03-26 22:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981171%27 HTTP/1.1" 200 None
2026-03-26 22:59:54 [ayvens.be] INFO: Scrape type for 1981171: 2
2026-03-26 22:59:54 [ayvens.be] INFO: Extracting data for car ID: 1981171
2026-03-26 22:59:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02b95496-d32c-5b55-a5e2-4b6f41ff1ee7 with identifier: 1981171
2026-03-26 22:59:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02b95496-d32c-5b55-a5e2-4b6f41ff1ee7 with scrape type 2
2026-03-26 22:59:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 02b95496-d32c-5b55-a5e2-4b6f41ff1ee7 with scrape type 2
2026-03-26 22:59:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 02b95496-d32c-5b55-a5e2-4b6f41ff1ee7, identifier: 1981171
2026-03-26 22:59:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 02b95496-d32c-5b55-a5e2-4b6f41ff1ee7 with identifier: 1981171
2026-03-26 22:59:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 02b95496-d32c-5b55-a5e2-4b6f41ff1ee7 with identifier: 1981171
2026-03-26 22:59:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 02b95496-d32c-5b55-a5e2-4b6f41ff1ee7 with identifier: 1981171 to the API
2026-03-26 22:59:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '02b95496-d32c-5b55-a5e2-4b6f41ff1ee7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'LEXUS',
 'model': 'NX 300h - 2017',
 'odometer': 153802,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'LEXUS NX 300h - 2017 2.5i AWD Privilege Line E-CVT (EU6.2)',
 'transmission': 'automatic',
 'trim': '2.5i AWD Privilege Line E-CVT (EU6.2)',
 'vin': None,
 'year': 2020}
2026-03-26 22:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981171%27 HTTP/1.1" 200 None
2026-03-26 22:59:54 [ayvens.be] INFO: Saving data for 1981171: {'auction_closing_time': 1774855800.0, 'created_time': 1774392390.736211, 'last_price_update_time': 1774565994.990638}
2026-03-26 22:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981171') HTTP/1.1" 204 0
2026-03-26 22:59:55 [ayvens.be] INFO: Found listing with ID: 1981172
2026-03-26 22:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981172%27 HTTP/1.1" 200 None
2026-03-26 22:59:55 [ayvens.be] INFO: Scrape type for 1981172: 2
2026-03-26 22:59:55 [ayvens.be] INFO: Extracting data for car ID: 1981172
2026-03-26 22:59:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af82c574-4a37-5f1d-9ffb-8ed56ee5a5e0 with identifier: 1981172
2026-03-26 22:59:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af82c574-4a37-5f1d-9ffb-8ed56ee5a5e0 with scrape type 2
2026-03-26 22:59:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af82c574-4a37-5f1d-9ffb-8ed56ee5a5e0 with scrape type 2
2026-03-26 22:59:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: af82c574-4a37-5f1d-9ffb-8ed56ee5a5e0, identifier: 1981172
2026-03-26 22:59:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: af82c574-4a37-5f1d-9ffb-8ed56ee5a5e0 with identifier: 1981172
2026-03-26 22:59:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: af82c574-4a37-5f1d-9ffb-8ed56ee5a5e0 with identifier: 1981172
2026-03-26 22:59:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: af82c574-4a37-5f1d-9ffb-8ed56ee5a5e0 with identifier: 1981172 to the API
2026-03-26 22:59:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'af82c574-4a37-5f1d-9ffb-8ed56ee5a5e0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 75657,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 2008 1.5 BLUEHDI 81KW S-S GT',
 'transmission': 'manual',
 'trim': '1.5 BLUEHDI 81KW S-S GT',
 'vin': None,
 'year': 2021}
2026-03-26 22:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981172%27 HTTP/1.1" 200 None
2026-03-26 22:59:55 [ayvens.be] INFO: Saving data for 1981172: {'auction_closing_time': 1774855800.0, 'created_time': 1774392392.063078, 'last_price_update_time': 1774565995.361001}
2026-03-26 22:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981172') HTTP/1.1" 204 0
2026-03-26 22:59:55 [ayvens.be] INFO: Found listing with ID: 1981173
2026-03-26 22:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981173%27 HTTP/1.1" 200 None
2026-03-26 22:59:55 [ayvens.be] INFO: Scrape type for 1981173: 2
2026-03-26 22:59:55 [ayvens.be] INFO: Extracting data for car ID: 1981173
2026-03-26 22:59:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c25d1e4-4df3-555c-9e6e-3804b484e812 with identifier: 1981173
2026-03-26 22:59:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c25d1e4-4df3-555c-9e6e-3804b484e812 with scrape type 2
2026-03-26 22:59:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8c25d1e4-4df3-555c-9e6e-3804b484e812 with scrape type 2
2026-03-26 22:59:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 8c25d1e4-4df3-555c-9e6e-3804b484e812, identifier: 1981173
2026-03-26 22:59:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 8c25d1e4-4df3-555c-9e6e-3804b484e812 with identifier: 1981173
2026-03-26 22:59:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 8c25d1e4-4df3-555c-9e6e-3804b484e812 with identifier: 1981173
2026-03-26 22:59:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 8c25d1e4-4df3-555c-9e6e-3804b484e812 with identifier: 1981173 to the API
2026-03-26 22:59:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '8c25d1e4-4df3-555c-9e6e-3804b484e812',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'ESPACE',
 'odometer': 72455,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT ESPACE 2.0 BLUE DCI 190 EDC INITIALE PARIS',
 'transmission': 'automatic',
 'trim': '2.0 BLUE DCI 190 EDC INITIALE PARIS',
 'vin': None,
 'year': 2021}
2026-03-26 22:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981173%27 HTTP/1.1" 200 None
2026-03-26 22:59:55 [ayvens.be] INFO: Saving data for 1981173: {'auction_closing_time': 1774855800.0, 'created_time': 1774392394.456033, 'last_price_update_time': 1774565995.804695}
2026-03-26 22:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981173') HTTP/1.1" 204 0
2026-03-26 22:59:55 [ayvens.be] INFO: Found listing with ID: 1981174
2026-03-26 22:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981174%27 HTTP/1.1" 200 None
2026-03-26 22:59:55 [ayvens.be] INFO: Scrape type for 1981174: 2
2026-03-26 22:59:55 [ayvens.be] INFO: Extracting data for car ID: 1981174
2026-03-26 22:59:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0ac70e37-7aff-5307-9289-11c93460ae8a with identifier: 1981174
2026-03-26 22:59:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ac70e37-7aff-5307-9289-11c93460ae8a with scrape type 2
2026-03-26 22:59:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0ac70e37-7aff-5307-9289-11c93460ae8a with scrape type 2
2026-03-26 22:59:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 0ac70e37-7aff-5307-9289-11c93460ae8a, identifier: 1981174
2026-03-26 22:59:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 0ac70e37-7aff-5307-9289-11c93460ae8a with identifier: 1981174
2026-03-26 22:59:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 0ac70e37-7aff-5307-9289-11c93460ae8a with identifier: 1981174
2026-03-26 22:59:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 0ac70e37-7aff-5307-9289-11c93460ae8a with identifier: 1981174 to the API
2026-03-26 22:59:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '0ac70e37-7aff-5307-9289-11c93460ae8a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A4',
 'odometer': 64706,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A4 2.0 35 TFSI 110KW S TRONIC',
 'transmission': 'automatic',
 'trim': '2.0 35 TFSI 110KW S TRONIC',
 'vin': None,
 'year': 2020}
2026-03-26 22:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981174%27 HTTP/1.1" 200 None
2026-03-26 22:59:56 [ayvens.be] INFO: Saving data for 1981174: {'auction_closing_time': 1774855800.0, 'created_time': 1774392396.048972, 'last_price_update_time': 1774565996.178789}
2026-03-26 22:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981174') HTTP/1.1" 204 0
2026-03-26 22:59:56 [ayvens.be] INFO: Found listing with ID: 1981175
2026-03-26 22:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981175%27 HTTP/1.1" 200 None
2026-03-26 22:59:56 [ayvens.be] INFO: Scrape type for 1981175: 2
2026-03-26 22:59:56 [ayvens.be] INFO: Extracting data for car ID: 1981175
2026-03-26 22:59:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 331bba43-88fa-5fd6-bc58-c262b85e16e4 with identifier: 1981175
2026-03-26 22:59:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 331bba43-88fa-5fd6-bc58-c262b85e16e4 with scrape type 2
2026-03-26 22:59:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 331bba43-88fa-5fd6-bc58-c262b85e16e4 with scrape type 2
2026-03-26 22:59:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 331bba43-88fa-5fd6-bc58-c262b85e16e4, identifier: 1981175
2026-03-26 22:59:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 331bba43-88fa-5fd6-bc58-c262b85e16e4 with identifier: 1981175
2026-03-26 22:59:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 331bba43-88fa-5fd6-bc58-c262b85e16e4 with identifier: 1981175
2026-03-26 22:59:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 331bba43-88fa-5fd6-bc58-c262b85e16e4 with identifier: 1981175 to the API
2026-03-26 22:59:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'electric',
 'id': '331bba43-88fa-5fd6-bc58-c262b85e16e4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'E-TRON SPORTBACK',
 'odometer': 175527,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI E-TRON SPORTBACK BEV 95KWH 55 QUATTRO S-LINE',
 'transmission': 'automatic',
 'trim': 'BEV 95KWH 55 QUATTRO S-LINE',
 'vin': None,
 'year': 2022}
2026-03-26 22:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981175%27 HTTP/1.1" 200 None
2026-03-26 22:59:56 [ayvens.be] INFO: Saving data for 1981175: {'auction_closing_time': 1774855800.0, 'created_time': 1774392398.035845, 'last_price_update_time': 1774565996.53867}
2026-03-26 22:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981175') HTTP/1.1" 204 0
2026-03-26 22:59:56 [ayvens.be] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 800
2026-03-26 22:59:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-26 22:59:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-03-26 22:59:58 [ayvens.be] INFO: Found listing with ID: 1981176
2026-03-26 22:59:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981176%27 HTTP/1.1" 200 None
2026-03-26 22:59:58 [ayvens.be] INFO: Scrape type for 1981176: 2
2026-03-26 22:59:58 [ayvens.be] INFO: Extracting data for car ID: 1981176
2026-03-26 22:59:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17214413-005d-58d6-88eb-3901260b89d0 with identifier: 1981176
2026-03-26 22:59:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17214413-005d-58d6-88eb-3901260b89d0 with scrape type 2
2026-03-26 22:59:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 17214413-005d-58d6-88eb-3901260b89d0 with scrape type 2
2026-03-26 22:59:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 17214413-005d-58d6-88eb-3901260b89d0, identifier: 1981176
2026-03-26 22:59:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 17214413-005d-58d6-88eb-3901260b89d0 with identifier: 1981176
2026-03-26 22:59:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 17214413-005d-58d6-88eb-3901260b89d0 with identifier: 1981176
2026-03-26 22:59:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 17214413-005d-58d6-88eb-3901260b89d0 with identifier: 1981176 to the API
2026-03-26 22:59:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '17214413-005d-58d6-88eb-3901260b89d0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'DS AUTOMOBILES',
 'model': 'DS7 CROSSBACK DIESEL',
 'odometer': 68115,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DS AUTOMOBILES DS7 CROSSBACK DIESEL 1.5 BlueHDi Performance Line '
          '(EU6.2)',
 'transmission': 'automatic',
 'trim': '1.5 BlueHDi Performance Line (EU6.2)',
 'vin': None,
 'year': 2020}
2026-03-26 22:59:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981176%27 HTTP/1.1" 200 None
2026-03-26 22:59:59 [ayvens.be] INFO: Saving data for 1981176: {'auction_closing_time': 1774855800.0, 'created_time': 1774392401.041871, 'last_price_update_time': 1774565999.28844}
2026-03-26 22:59:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981176') HTTP/1.1" 204 0
2026-03-26 22:59:59 [ayvens.be] INFO: Found listing with ID: 1981177
2026-03-26 22:59:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981177%27 HTTP/1.1" 200 None
2026-03-26 22:59:59 [ayvens.be] INFO: Scrape type for 1981177: 2
2026-03-26 22:59:59 [ayvens.be] INFO: Extracting data for car ID: 1981177
2026-03-26 22:59:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a2b3553c-9c84-5edb-8824-6696ed4b72ca with identifier: 1981177
2026-03-26 22:59:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2b3553c-9c84-5edb-8824-6696ed4b72ca with scrape type 2
2026-03-26 22:59:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a2b3553c-9c84-5edb-8824-6696ed4b72ca with scrape type 2
2026-03-26 22:59:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a2b3553c-9c84-5edb-8824-6696ed4b72ca, identifier: 1981177
2026-03-26 22:59:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a2b3553c-9c84-5edb-8824-6696ed4b72ca with identifier: 1981177
2026-03-26 22:59:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a2b3553c-9c84-5edb-8824-6696ed4b72ca with identifier: 1981177
2026-03-26 22:59:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a2b3553c-9c84-5edb-8824-6696ed4b72ca with identifier: 1981177 to the API
2026-03-26 22:59:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 22:59:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'a2b3553c-9c84-5edb-8824-6696ed4b72ca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'PUMA',
 'odometer': 97573,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD PUMA 1.5 TDCI 88KW TITANIUM X',
 'transmission': 'manual',
 'trim': '1.5 TDCI 88KW TITANIUM X',
 'vin': None,
 'year': 2022}
2026-03-26 22:59:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981177%27 HTTP/1.1" 200 None
2026-03-26 22:59:59 [ayvens.be] INFO: Saving data for 1981177: {'auction_closing_time': 1774855800.0, 'created_time': 1774392402.530933, 'last_price_update_time': 1774565999.726865}
2026-03-26 22:59:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981177') HTTP/1.1" 204 0
2026-03-26 22:59:59 [ayvens.be] INFO: Found listing with ID: 1981178
2026-03-26 22:59:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 22:59:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981178%27 HTTP/1.1" 200 None
2026-03-26 22:59:59 [ayvens.be] INFO: Scrape type for 1981178: 2
2026-03-26 22:59:59 [ayvens.be] INFO: Extracting data for car ID: 1981178
2026-03-26 22:59:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a4409a9-9ad5-5493-9e2c-50833909d336 with identifier: 1981178
2026-03-26 22:59:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a4409a9-9ad5-5493-9e2c-50833909d336 with scrape type 2
2026-03-26 22:59:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7a4409a9-9ad5-5493-9e2c-50833909d336 with scrape type 2
2026-03-26 22:59:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 7a4409a9-9ad5-5493-9e2c-50833909d336, identifier: 1981178
2026-03-26 22:59:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 7a4409a9-9ad5-5493-9e2c-50833909d336 with identifier: 1981178
2026-03-26 22:59:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 7a4409a9-9ad5-5493-9e2c-50833909d336 with identifier: 1981178
2026-03-26 22:59:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 7a4409a9-9ad5-5493-9e2c-50833909d336 with identifier: 1981178 to the API
2026-03-26 22:59:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 22:59:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:00:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 161,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '7a4409a9-9ad5-5493-9e2c-50833909d336',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TRANSPORTER 1400 FOU SWB DSL -',
 'odometer': 91397,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-13',
 'seats_number': 3,
 'seller_name': None,
 'title': 'VOLKSWAGEN TRANSPORTER 1400 FOU SWB DSL - 2.0 TDi SCR BMT STOCK',
 'transmission': 'manual',
 'trim': '2.0 TDi SCR BMT STOCK',
 'vin': None,
 'year': 2019}
2026-03-26 23:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981178%27 HTTP/1.1" 200 None
2026-03-26 23:00:00 [ayvens.be] INFO: Saving data for 1981178: {'auction_closing_time': 1774855800.0, 'created_time': 1774392404.029869, 'last_price_update_time': 1774566000.127063}
2026-03-26 23:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981178') HTTP/1.1" 204 0
2026-03-26 23:00:00 [ayvens.be] INFO: Found listing with ID: 1981179
2026-03-26 23:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981179%27 HTTP/1.1" 200 None
2026-03-26 23:00:00 [ayvens.be] INFO: Scrape type for 1981179: 2
2026-03-26 23:00:00 [ayvens.be] INFO: Extracting data for car ID: 1981179
2026-03-26 23:00:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c56e558d-f409-5e26-a03f-a3ce35464bb6 with identifier: 1981179
2026-03-26 23:00:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c56e558d-f409-5e26-a03f-a3ce35464bb6 with scrape type 2
2026-03-26 23:00:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c56e558d-f409-5e26-a03f-a3ce35464bb6 with scrape type 2
2026-03-26 23:00:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c56e558d-f409-5e26-a03f-a3ce35464bb6, identifier: 1981179
2026-03-26 23:00:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c56e558d-f409-5e26-a03f-a3ce35464bb6 with identifier: 1981179
2026-03-26 23:00:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c56e558d-f409-5e26-a03f-a3ce35464bb6 with identifier: 1981179
2026-03-26 23:00:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c56e558d-f409-5e26-a03f-a3ce35464bb6 with identifier: 1981179 to the API
2026-03-26 23:00:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:00:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:00:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'c56e558d-f409-5e26-a03f-a3ce35464bb6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 80002,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T4 RECHARGE GEARTRONIC R-DESIGN',
 'transmission': 'automatic',
 'trim': '1.5 T4 RECHARGE GEARTRONIC R-DESIGN',
 'vin': None,
 'year': 2021}
2026-03-26 23:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981179%27 HTTP/1.1" 200 None
2026-03-26 23:00:00 [ayvens.be] INFO: Saving data for 1981179: {'auction_closing_time': 1774855800.0, 'created_time': 1774392405.447877, 'last_price_update_time': 1774566000.599835}
2026-03-26 23:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981179') HTTP/1.1" 204 0
2026-03-26 23:00:00 [ayvens.be] INFO: Found listing with ID: 1981180
2026-03-26 23:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981180%27 HTTP/1.1" 200 None
2026-03-26 23:00:00 [ayvens.be] INFO: Scrape type for 1981180: 2
2026-03-26 23:00:00 [ayvens.be] INFO: Extracting data for car ID: 1981180
2026-03-26 23:00:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 63b06c4f-b3e4-52db-b6d0-71fd8b18aee3 with identifier: 1981180
2026-03-26 23:00:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63b06c4f-b3e4-52db-b6d0-71fd8b18aee3 with scrape type 2
2026-03-26 23:00:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 63b06c4f-b3e4-52db-b6d0-71fd8b18aee3 with scrape type 2
2026-03-26 23:00:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 63b06c4f-b3e4-52db-b6d0-71fd8b18aee3, identifier: 1981180
2026-03-26 23:00:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 63b06c4f-b3e4-52db-b6d0-71fd8b18aee3 with identifier: 1981180
2026-03-26 23:00:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 63b06c4f-b3e4-52db-b6d0-71fd8b18aee3 with identifier: 1981180
2026-03-26 23:00:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 63b06c4f-b3e4-52db-b6d0-71fd8b18aee3 with identifier: 1981180 to the API
2026-03-26 23:00:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:00:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:00:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '63b06c4f-b3e4-52db-b6d0-71fd8b18aee3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'SUPERB DIESEL - 2019',
 'odometer': 162489,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA SUPERB DIESEL - 2019 1.6 CR TDi Style DSG',
 'transmission': 'automatic',
 'trim': '1.6 CR TDi Style DSG',
 'vin': None,
 'year': 2019}
2026-03-26 23:00:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981180%27 HTTP/1.1" 200 None
2026-03-26 23:00:02 [ayvens.be] INFO: Saving data for 1981180: {'auction_closing_time': 1774855800.0, 'created_time': 1774392406.994496, 'last_price_update_time': 1774566002.390261}
2026-03-26 23:00:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981180') HTTP/1.1" 204 0
2026-03-26 23:00:02 [ayvens.be] INFO: Found listing with ID: 1981181
2026-03-26 23:00:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981181%27 HTTP/1.1" 200 None
2026-03-26 23:00:02 [ayvens.be] INFO: Scrape type for 1981181: 2
2026-03-26 23:00:02 [ayvens.be] INFO: Extracting data for car ID: 1981181
2026-03-26 23:00:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc105ddb-de53-57db-9a21-f647522a6943 with identifier: 1981181
2026-03-26 23:00:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc105ddb-de53-57db-9a21-f647522a6943 with scrape type 2
2026-03-26 23:00:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bc105ddb-de53-57db-9a21-f647522a6943 with scrape type 2
2026-03-26 23:00:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: bc105ddb-de53-57db-9a21-f647522a6943, identifier: 1981181
2026-03-26 23:00:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: bc105ddb-de53-57db-9a21-f647522a6943 with identifier: 1981181
2026-03-26 23:00:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: bc105ddb-de53-57db-9a21-f647522a6943 with identifier: 1981181
2026-03-26 23:00:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: bc105ddb-de53-57db-9a21-f647522a6943 with identifier: 1981181 to the API
2026-03-26 23:00:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:00:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:00:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'bc105ddb-de53-57db-9a21-f647522a6943',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'B-CLASS',
 'odometer': 28223,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ B-CLASS 1.3 B 180 ESSENTIAL LINE DCT',
 'transmission': 'automatic',
 'trim': '1.3 B 180 ESSENTIAL LINE DCT',
 'vin': None,
 'year': 2022}
2026-03-26 23:00:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981181%27 HTTP/1.1" 200 None
2026-03-26 23:00:02 [ayvens.be] INFO: Saving data for 1981181: {'auction_closing_time': 1774855800.0, 'created_time': 1774392408.617494, 'last_price_update_time': 1774566002.840097}
2026-03-26 23:00:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981181') HTTP/1.1" 204 0
2026-03-26 23:00:02 [ayvens.be] INFO: Found listing with ID: 1981182
2026-03-26 23:00:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981182%27 HTTP/1.1" 200 None
2026-03-26 23:00:02 [ayvens.be] INFO: Scrape type for 1981182: 2
2026-03-26 23:00:02 [ayvens.be] INFO: Extracting data for car ID: 1981182
2026-03-26 23:00:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7aceaaa9-c92a-515d-ba6b-e81b502da630 with identifier: 1981182
2026-03-26 23:00:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7aceaaa9-c92a-515d-ba6b-e81b502da630 with scrape type 2
2026-03-26 23:00:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7aceaaa9-c92a-515d-ba6b-e81b502da630 with scrape type 2
2026-03-26 23:00:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 7aceaaa9-c92a-515d-ba6b-e81b502da630, identifier: 1981182
2026-03-26 23:00:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 7aceaaa9-c92a-515d-ba6b-e81b502da630 with identifier: 1981182
2026-03-26 23:00:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 7aceaaa9-c92a-515d-ba6b-e81b502da630 with identifier: 1981182
2026-03-26 23:00:03 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 7aceaaa9-c92a-515d-ba6b-e81b502da630 with identifier: 1981182 to the API
2026-03-26 23:00:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:00:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:00:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '7aceaaa9-c92a-515d-ba6b-e81b502da630',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A4 AVANT',
 'odometer': 124706,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A4 AVANT 2.0 35 TDI 120KW S TR ADV BUSINESS ED',
 'transmission': 'automatic',
 'trim': '2.0 35 TDI 120KW S TR ADV BUSINESS ED',
 'vin': None,
 'year': 2021}
2026-03-26 23:00:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981182%27 HTTP/1.1" 200 None
2026-03-26 23:00:04 [ayvens.be] INFO: Saving data for 1981182: {'auction_closing_time': 1774855800.0, 'created_time': 1774392410.621697, 'last_price_update_time': 1774566004.923248}
2026-03-26 23:00:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981182') HTTP/1.1" 204 0
2026-03-26 23:00:04 [ayvens.be] INFO: Found listing with ID: 1981183
2026-03-26 23:00:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981183%27 HTTP/1.1" 200 None
2026-03-26 23:00:04 [ayvens.be] INFO: Scrape type for 1981183: 2
2026-03-26 23:00:04 [ayvens.be] INFO: Extracting data for car ID: 1981183
2026-03-26 23:00:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 59b6a74b-2362-54af-9350-d76aac1792fd with identifier: 1981183
2026-03-26 23:00:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 59b6a74b-2362-54af-9350-d76aac1792fd with scrape type 2
2026-03-26 23:00:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 59b6a74b-2362-54af-9350-d76aac1792fd with scrape type 2
2026-03-26 23:00:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 59b6a74b-2362-54af-9350-d76aac1792fd, identifier: 1981183
2026-03-26 23:00:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 59b6a74b-2362-54af-9350-d76aac1792fd with identifier: 1981183
2026-03-26 23:00:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 59b6a74b-2362-54af-9350-d76aac1792fd with identifier: 1981183
2026-03-26 23:00:05 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 59b6a74b-2362-54af-9350-d76aac1792fd with identifier: 1981183 to the API
2026-03-26 23:00:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:00:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:00:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.0L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '59b6a74b-2362-54af-9350-d76aac1792fd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'FIAT',
 'model': '500 - 2015',
 'odometer': 76076,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-14',
 'seats_number': 4,
 'seller_name': None,
 'title': 'FIAT 500 - 2015 1.0i MHEV Lounge',
 'transmission': 'manual',
 'trim': '1.0i MHEV Lounge',
 'vin': None,
 'year': 2020}
2026-03-26 23:00:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981183%27 HTTP/1.1" 200 None
2026-03-26 23:00:06 [ayvens.be] INFO: Saving data for 1981183: {'auction_closing_time': 1774855800.0, 'created_time': 1774392411.942653, 'last_price_update_time': 1774566006.516534}
2026-03-26 23:00:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981183') HTTP/1.1" 204 0
2026-03-26 23:00:06 [ayvens.be] INFO: Found listing with ID: 1981184
2026-03-26 23:00:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981184%27 HTTP/1.1" 200 None
2026-03-26 23:00:06 [ayvens.be] INFO: Scrape type for 1981184: 2
2026-03-26 23:00:06 [ayvens.be] INFO: Extracting data for car ID: 1981184
2026-03-26 23:00:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 67cbb5a5-1e4b-5774-a9c0-45ad41c3f46e with identifier: 1981184
2026-03-26 23:00:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67cbb5a5-1e4b-5774-a9c0-45ad41c3f46e with scrape type 2
2026-03-26 23:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 67cbb5a5-1e4b-5774-a9c0-45ad41c3f46e with scrape type 2
2026-03-26 23:00:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 67cbb5a5-1e4b-5774-a9c0-45ad41c3f46e, identifier: 1981184
2026-03-26 23:00:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 67cbb5a5-1e4b-5774-a9c0-45ad41c3f46e with identifier: 1981184
2026-03-26 23:00:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 67cbb5a5-1e4b-5774-a9c0-45ad41c3f46e with identifier: 1981184
2026-03-26 23:00:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 67cbb5a5-1e4b-5774-a9c0-45ad41c3f46e with identifier: 1981184 to the API
2026-03-26 23:00:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:00:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:00:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 92,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '67cbb5a5-1e4b-5774-a9c0-45ad41c3f46e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '308 DIESEL - 2017',
 'odometer': 87500,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-05-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 308 DIESEL - 2017 1.5 BlueHDi Active (EU6.2)',
 'transmission': 'automatic',
 'trim': '1.5 BlueHDi Active (EU6.2)',
 'vin': None,
 'year': 2020}
2026-03-26 23:00:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981184%27 HTTP/1.1" 200 None
2026-03-26 23:00:06 [ayvens.be] INFO: Saving data for 1981184: {'auction_closing_time': 1774855800.0, 'created_time': 1774392414.479355, 'last_price_update_time': 1774566006.997205}
2026-03-26 23:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981184') HTTP/1.1" 204 0
2026-03-26 23:00:07 [ayvens.be] INFO: Found listing with ID: 1981185
2026-03-26 23:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981185%27 HTTP/1.1" 200 None
2026-03-26 23:00:07 [ayvens.be] INFO: Scrape type for 1981185: 2
2026-03-26 23:00:07 [ayvens.be] INFO: Extracting data for car ID: 1981185
2026-03-26 23:00:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 882573fb-1930-56f8-ac29-e5d6c092958b with identifier: 1981185
2026-03-26 23:00:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 882573fb-1930-56f8-ac29-e5d6c092958b with scrape type 2
2026-03-26 23:00:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 882573fb-1930-56f8-ac29-e5d6c092958b with scrape type 2
2026-03-26 23:00:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 882573fb-1930-56f8-ac29-e5d6c092958b, identifier: 1981185
2026-03-26 23:00:07 [scrapy.extensions.logstats] INFO: Crawled 10 pages (at 2 pages/min), scraped 684 items (at 128 items/min)
2026-03-26 23:00:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 182MiB
2026-03-26 23:00:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 882573fb-1930-56f8-ac29-e5d6c092958b with identifier: 1981185
2026-03-26 23:00:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 882573fb-1930-56f8-ac29-e5d6c092958b with identifier: 1981185
2026-03-26 23:00:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 882573fb-1930-56f8-ac29-e5d6c092958b with identifier: 1981185 to the API
2026-03-26 23:00:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:00:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:00:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '882573fb-1930-56f8-ac29-e5d6c092958b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '2 SERIES ACTIVE TOURER',
 'odometer': 79199,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 2 SERIES ACTIVE TOURER 1.5 216I ACTIVE TOURER',
 'transmission': 'manual',
 'trim': '1.5 216I ACTIVE TOURER',
 'vin': None,
 'year': 2021}
2026-03-26 23:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981185%27 HTTP/1.1" 200 None
2026-03-26 23:00:07 [ayvens.be] INFO: Saving data for 1981185: {'auction_closing_time': 1774855800.0, 'created_time': 1774392415.44941, 'last_price_update_time': 1774566007.404331}
2026-03-26 23:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981185') HTTP/1.1" 204 0
2026-03-26 23:00:07 [ayvens.be] INFO: Found listing with ID: 1981186
2026-03-26 23:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981186%27 HTTP/1.1" 200 None
2026-03-26 23:00:07 [ayvens.be] INFO: Scrape type for 1981186: 2
2026-03-26 23:00:07 [ayvens.be] INFO: Extracting data for car ID: 1981186
2026-03-26 23:00:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c8cfc13c-7357-50e4-9a81-496fc7f2697f with identifier: 1981186
2026-03-26 23:00:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8cfc13c-7357-50e4-9a81-496fc7f2697f with scrape type 2
2026-03-26 23:00:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c8cfc13c-7357-50e4-9a81-496fc7f2697f with scrape type 2
2026-03-26 23:00:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c8cfc13c-7357-50e4-9a81-496fc7f2697f, identifier: 1981186
2026-03-26 23:00:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c8cfc13c-7357-50e4-9a81-496fc7f2697f with identifier: 1981186
2026-03-26 23:00:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c8cfc13c-7357-50e4-9a81-496fc7f2697f with identifier: 1981186
2026-03-26 23:00:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c8cfc13c-7357-50e4-9a81-496fc7f2697f with identifier: 1981186 to the API
2026-03-26 23:00:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:00:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:00:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'c8cfc13c-7357-50e4-9a81-496fc7f2697f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A6',
 'odometer': 78402,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A6 2.0 TDI 35 S TRONIC BUSINESS ED SPORT',
 'transmission': 'automatic',
 'trim': '2.0 TDI 35 S TRONIC BUSINESS ED SPORT',
 'vin': None,
 'year': 2021}
2026-03-26 23:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981186%27 HTTP/1.1" 200 None
2026-03-26 23:00:07 [ayvens.be] INFO: Saving data for 1981186: {'auction_closing_time': 1774855800.0, 'created_time': 1774392416.496681, 'last_price_update_time': 1774566007.802884}
2026-03-26 23:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981186') HTTP/1.1" 204 0
2026-03-26 23:00:07 [ayvens.be] INFO: Found listing with ID: 1981187
2026-03-26 23:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981187%27 HTTP/1.1" 200 None
2026-03-26 23:00:07 [ayvens.be] INFO: Scrape type for 1981187: 2
2026-03-26 23:00:07 [ayvens.be] INFO: Extracting data for car ID: 1981187
2026-03-26 23:00:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a72a7c77-b267-5998-b7cd-188d4962645c with identifier: 1981187
2026-03-26 23:00:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a72a7c77-b267-5998-b7cd-188d4962645c with scrape type 2
2026-03-26 23:00:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a72a7c77-b267-5998-b7cd-188d4962645c with scrape type 2
2026-03-26 23:00:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a72a7c77-b267-5998-b7cd-188d4962645c, identifier: 1981187
2026-03-26 23:00:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a72a7c77-b267-5998-b7cd-188d4962645c with identifier: 1981187
2026-03-26 23:00:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a72a7c77-b267-5998-b7cd-188d4962645c with identifier: 1981187
2026-03-26 23:00:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a72a7c77-b267-5998-b7cd-188d4962645c with identifier: 1981187 to the API
2026-03-26 23:00:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:00:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:00:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'electric',
 'id': 'a72a7c77-b267-5998-b7cd-188d4962645c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'TESLA',
 'model': 'MODEL 3',
 'odometer': 109261,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TESLA MODEL 3 75 KWH LONG RANGE DUAL MOTOR 4WD AUTO',
 'transmission': 'automatic',
 'trim': '75 KWH LONG RANGE DUAL MOTOR 4WD AUTO',
 'vin': None,
 'year': 2021}
2026-03-26 23:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981187%27 HTTP/1.1" 200 None
2026-03-26 23:00:09 [ayvens.be] INFO: Saving data for 1981187: {'auction_closing_time': 1774855800.0, 'created_time': 1774392418.711801, 'last_price_update_time': 1774566009.890659}
2026-03-26 23:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981187') HTTP/1.1" 204 0
2026-03-26 23:00:09 [ayvens.be] INFO: Found listing with ID: 1981188
2026-03-26 23:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981188%27 HTTP/1.1" 200 None
2026-03-26 23:00:09 [ayvens.be] INFO: Scrape type for 1981188: 2
2026-03-26 23:00:09 [ayvens.be] INFO: Extracting data for car ID: 1981188
2026-03-26 23:00:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a002bfd-a915-531e-b05e-d40568f19197 with identifier: 1981188
2026-03-26 23:00:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a002bfd-a915-531e-b05e-d40568f19197 with scrape type 2
2026-03-26 23:00:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9a002bfd-a915-531e-b05e-d40568f19197 with scrape type 2
2026-03-26 23:00:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 9a002bfd-a915-531e-b05e-d40568f19197, identifier: 1981188
2026-03-26 23:00:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 9a002bfd-a915-531e-b05e-d40568f19197 with identifier: 1981188
2026-03-26 23:00:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 9a002bfd-a915-531e-b05e-d40568f19197 with identifier: 1981188
2026-03-26 23:00:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 9a002bfd-a915-531e-b05e-d40568f19197 with identifier: 1981188 to the API
2026-03-26 23:00:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:00:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:00:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '9a002bfd-a915-531e-b05e-d40568f19197',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'FABIA',
 'odometer': 23776,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-09-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA FABIA 1.0 TSI 85KW DSG CORPORATE',
 'transmission': 'automatic',
 'trim': '1.0 TSI 85KW DSG CORPORATE',
 'vin': None,
 'year': 2024}
2026-03-26 23:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981188%27 HTTP/1.1" 200 None
2026-03-26 23:00:11 [ayvens.be] INFO: Saving data for 1981188: {'auction_closing_time': 1774855800.0, 'created_time': 1774392421.164786, 'last_price_update_time': 1774566011.725958}
2026-03-26 23:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981188') HTTP/1.1" 204 0
2026-03-26 23:00:11 [ayvens.be] INFO: Found listing with ID: 1981189
2026-03-26 23:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981189%27 HTTP/1.1" 200 None
2026-03-26 23:00:11 [ayvens.be] INFO: Scrape type for 1981189: 2
2026-03-26 23:00:11 [ayvens.be] INFO: Extracting data for car ID: 1981189
2026-03-26 23:00:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 16158bbe-f025-5494-907d-ec6a1d3f8c66 with identifier: 1981189
2026-03-26 23:00:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 16158bbe-f025-5494-907d-ec6a1d3f8c66 with scrape type 2
2026-03-26 23:00:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 16158bbe-f025-5494-907d-ec6a1d3f8c66 with scrape type 2
2026-03-26 23:00:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 16158bbe-f025-5494-907d-ec6a1d3f8c66, identifier: 1981189
2026-03-26 23:00:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 16158bbe-f025-5494-907d-ec6a1d3f8c66 with identifier: 1981189
2026-03-26 23:00:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 16158bbe-f025-5494-907d-ec6a1d3f8c66 with identifier: 1981189
2026-03-26 23:00:11 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 16158bbe-f025-5494-907d-ec6a1d3f8c66 with identifier: 1981189 to the API
2026-03-26 23:00:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:00:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:00:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'electric',
 'id': '16158bbe-f025-5494-907d-ec6a1d3f8c66',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'EQA',
 'odometer': 72213,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ EQA BEV 67KWH EQA 250 AUTO',
 'transmission': 'automatic',
 'trim': 'BEV 67KWH EQA 250 AUTO',
 'vin': None,
 'year': 2021}
2026-03-26 23:00:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981189%27 HTTP/1.1" 200 None
2026-03-26 23:00:12 [ayvens.be] INFO: Saving data for 1981189: {'auction_closing_time': 1774855800.0, 'created_time': 1774392422.361461, 'last_price_update_time': 1774566012.187506}
2026-03-26 23:00:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981189') HTTP/1.1" 204 0
2026-03-26 23:00:12 [ayvens.be] INFO: Found listing with ID: 1981190
2026-03-26 23:00:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981190%27 HTTP/1.1" 200 None
2026-03-26 23:00:12 [ayvens.be] INFO: Scrape type for 1981190: 2
2026-03-26 23:00:12 [ayvens.be] INFO: Extracting data for car ID: 1981190
2026-03-26 23:00:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d90bae9-76bb-55ed-8860-c28c42a7ee2d with identifier: 1981190
2026-03-26 23:00:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d90bae9-76bb-55ed-8860-c28c42a7ee2d with scrape type 2
2026-03-26 23:00:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7d90bae9-76bb-55ed-8860-c28c42a7ee2d with scrape type 2
2026-03-26 23:00:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 7d90bae9-76bb-55ed-8860-c28c42a7ee2d, identifier: 1981190
2026-03-26 23:00:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 7d90bae9-76bb-55ed-8860-c28c42a7ee2d with identifier: 1981190
2026-03-26 23:00:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 7d90bae9-76bb-55ed-8860-c28c42a7ee2d with identifier: 1981190
2026-03-26 23:00:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 7d90bae9-76bb-55ed-8860-c28c42a7ee2d with identifier: 1981190 to the API
2026-03-26 23:00:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:00:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:00:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '7d90bae9-76bb-55ed-8860-c28c42a7ee2d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'PUMA',
 'odometer': 57971,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD PUMA 1.0 ECOBOOST MHEV 92KW TITANIUM X',
 'transmission': 'manual',
 'trim': '1.0 ECOBOOST MHEV 92KW TITANIUM X',
 'vin': None,
 'year': 2022}
2026-03-26 23:00:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981190%27 HTTP/1.1" 200 None
2026-03-26 23:00:12 [ayvens.be] INFO: Saving data for 1981190: {'auction_closing_time': 1774855800.0, 'created_time': 1774392423.886259, 'last_price_update_time': 1774566012.952373}
2026-03-26 23:00:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981190') HTTP/1.1" 204 0
2026-03-26 23:00:12 [ayvens.be] INFO: Found listing with ID: 1981191
2026-03-26 23:00:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981191%27 HTTP/1.1" 200 None
2026-03-26 23:00:13 [ayvens.be] INFO: Scrape type for 1981191: 2
2026-03-26 23:00:13 [ayvens.be] INFO: Extracting data for car ID: 1981191
2026-03-26 23:00:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe091a10-bfdc-5d3f-8236-47195332ac34 with identifier: 1981191
2026-03-26 23:00:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe091a10-bfdc-5d3f-8236-47195332ac34 with scrape type 2
2026-03-26 23:00:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fe091a10-bfdc-5d3f-8236-47195332ac34 with scrape type 2
2026-03-26 23:00:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: fe091a10-bfdc-5d3f-8236-47195332ac34, identifier: 1981191
2026-03-26 23:00:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: fe091a10-bfdc-5d3f-8236-47195332ac34 with identifier: 1981191
2026-03-26 23:00:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: fe091a10-bfdc-5d3f-8236-47195332ac34 with identifier: 1981191
2026-03-26 23:00:13 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: fe091a10-bfdc-5d3f-8236-47195332ac34 with identifier: 1981191 to the API
2026-03-26 23:00:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:00:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:00:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'fe091a10-bfdc-5d3f-8236-47195332ac34',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': "CEE'D SPORTSWAGON",
 'odometer': 32910,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-07-04',
 'seats_number': 5,
 'seller_name': None,
 'title': "KIA CEE'D SPORTSWAGON 1.0 T-GDI MHEV PULSE DCT",
 'transmission': 'automatic',
 'trim': '1.0 T-GDI MHEV PULSE DCT',
 'vin': None,
 'year': 2024}
2026-03-26 23:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981191%27 HTTP/1.1" 200 None
2026-03-26 23:00:14 [ayvens.be] INFO: Saving data for 1981191: {'auction_closing_time': 1774855800.0, 'created_time': 1774392425.882338, 'last_price_update_time': 1774566014.108374}
2026-03-26 23:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981191') HTTP/1.1" 204 0
2026-03-26 23:00:14 [ayvens.be] INFO: Found listing with ID: 1981192
2026-03-26 23:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981192%27 HTTP/1.1" 200 None
2026-03-26 23:00:14 [ayvens.be] INFO: Scrape type for 1981192: 2
2026-03-26 23:00:14 [ayvens.be] INFO: Extracting data for car ID: 1981192
2026-03-26 23:00:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00dbba5e-e47b-5613-9827-74f622da8956 with identifier: 1981192
2026-03-26 23:00:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00dbba5e-e47b-5613-9827-74f622da8956 with scrape type 2
2026-03-26 23:00:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 00dbba5e-e47b-5613-9827-74f622da8956 with scrape type 2
2026-03-26 23:00:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 00dbba5e-e47b-5613-9827-74f622da8956, identifier: 1981192
2026-03-26 23:00:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 00dbba5e-e47b-5613-9827-74f622da8956 with identifier: 1981192
2026-03-26 23:00:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 00dbba5e-e47b-5613-9827-74f622da8956 with identifier: 1981192
2026-03-26 23:00:14 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 00dbba5e-e47b-5613-9827-74f622da8956 with identifier: 1981192 to the API
2026-03-26 23:00:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:00:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:00:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 152,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.4L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '00dbba5e-e47b-5613-9827-74f622da8956',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'ABARTH',
 'model': '500',
 'odometer': 54253,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-08',
 'seats_number': 4,
 'seller_name': None,
 'title': 'ABARTH 500 1.4 T-JET 595',
 'transmission': 'manual',
 'trim': '1.4 T-JET 595',
 'vin': None,
 'year': 2022}
2026-03-26 23:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981192%27 HTTP/1.1" 200 None
2026-03-26 23:00:14 [ayvens.be] INFO: Saving data for 1981192: {'auction_closing_time': 1774855800.0, 'created_time': 1774392428.370271, 'last_price_update_time': 1774566014.508026}
2026-03-26 23:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981192') HTTP/1.1" 204 0
2026-03-26 23:00:14 [ayvens.be] INFO: Found listing with ID: 1981193
2026-03-26 23:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981193%27 HTTP/1.1" 200 None
2026-03-26 23:00:14 [ayvens.be] INFO: Scrape type for 1981193: 2
2026-03-26 23:00:14 [ayvens.be] INFO: Extracting data for car ID: 1981193
2026-03-26 23:00:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 57c50d68-de83-5965-b7b6-58c456a320f5 with identifier: 1981193
2026-03-26 23:00:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57c50d68-de83-5965-b7b6-58c456a320f5 with scrape type 2
2026-03-26 23:00:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 57c50d68-de83-5965-b7b6-58c456a320f5 with scrape type 2
2026-03-26 23:00:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 57c50d68-de83-5965-b7b6-58c456a320f5, identifier: 1981193
2026-03-26 23:00:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 57c50d68-de83-5965-b7b6-58c456a320f5 with identifier: 1981193
2026-03-26 23:00:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 57c50d68-de83-5965-b7b6-58c456a320f5 with identifier: 1981193
2026-03-26 23:00:14 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 57c50d68-de83-5965-b7b6-58c456a320f5 with identifier: 1981193 to the API
2026-03-26 23:00:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:00:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:00:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '57c50d68-de83-5965-b7b6-58c456a320f5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': 'RIFTER',
 'odometer': 114618,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT RIFTER 1.5 BLUEHDI 75KW S-S ACTIVE',
 'transmission': 'manual',
 'trim': '1.5 BLUEHDI 75KW S-S ACTIVE',
 'vin': None,
 'year': 2022}
2026-03-26 23:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981193%27 HTTP/1.1" 200 None
2026-03-26 23:00:14 [ayvens.be] INFO: Saving data for 1981193: {'auction_closing_time': 1774855800.0, 'created_time': 1774392430.847746, 'last_price_update_time': 1774566014.916089}
2026-03-26 23:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981193') HTTP/1.1" 204 0
2026-03-26 23:00:14 [ayvens.be] INFO: Found listing with ID: 1981194
2026-03-26 23:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981194%27 HTTP/1.1" 200 None
2026-03-26 23:00:14 [ayvens.be] INFO: Scrape type for 1981194: 2
2026-03-26 23:00:14 [ayvens.be] INFO: Extracting data for car ID: 1981194
2026-03-26 23:00:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 48c868ee-daee-58ba-aa22-9ccc0cb5cf9f with identifier: 1981194
2026-03-26 23:00:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 48c868ee-daee-58ba-aa22-9ccc0cb5cf9f with scrape type 2
2026-03-26 23:00:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 48c868ee-daee-58ba-aa22-9ccc0cb5cf9f with scrape type 2
2026-03-26 23:00:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 48c868ee-daee-58ba-aa22-9ccc0cb5cf9f, identifier: 1981194
2026-03-26 23:00:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 48c868ee-daee-58ba-aa22-9ccc0cb5cf9f with identifier: 1981194
2026-03-26 23:00:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 48c868ee-daee-58ba-aa22-9ccc0cb5cf9f with identifier: 1981194
2026-03-26 23:00:15 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 48c868ee-daee-58ba-aa22-9ccc0cb5cf9f with identifier: 1981194 to the API
2026-03-26 23:00:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:00:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:00:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.6L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '48c868ee-daee-58ba-aa22-9ccc0cb5cf9f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'E-CLASS BERLINE',
 'odometer': 86429,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ E-CLASS BERLINE 1.6 E 200 D BUSINESS SOLUTION AUTO',
 'transmission': 'automatic',
 'trim': '1.6 E 200 D BUSINESS SOLUTION AUTO',
 'vin': None,
 'year': 2021}
2026-03-26 23:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981194%27 HTTP/1.1" 200 None
2026-03-26 23:00:15 [ayvens.be] INFO: Saving data for 1981194: {'auction_closing_time': 1774855800.0, 'created_time': 1774392433.170293, 'last_price_update_time': 1774566015.378533}
2026-03-26 23:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981194') HTTP/1.1" 204 0
2026-03-26 23:00:15 [ayvens.be] INFO: Found listing with ID: 1981195
2026-03-26 23:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981195%27 HTTP/1.1" 200 None
2026-03-26 23:00:15 [ayvens.be] INFO: Scrape type for 1981195: 2
2026-03-26 23:00:15 [ayvens.be] INFO: Extracting data for car ID: 1981195
2026-03-26 23:00:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4bea68af-8c20-5867-a11f-bdf142cff75a with identifier: 1981195
2026-03-26 23:00:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4bea68af-8c20-5867-a11f-bdf142cff75a with scrape type 2
2026-03-26 23:00:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4bea68af-8c20-5867-a11f-bdf142cff75a with scrape type 2
2026-03-26 23:00:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 4bea68af-8c20-5867-a11f-bdf142cff75a, identifier: 1981195
2026-03-26 23:00:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 4bea68af-8c20-5867-a11f-bdf142cff75a with identifier: 1981195
2026-03-26 23:00:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 4bea68af-8c20-5867-a11f-bdf142cff75a with identifier: 1981195
2026-03-26 23:00:15 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 4bea68af-8c20-5867-a11f-bdf142cff75a with identifier: 1981195 to the API
2026-03-26 23:00:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:00:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:00:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '4bea68af-8c20-5867-a11f-bdf142cff75a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'CITROAu2039N',
 'model': 'C5 AIRCROSS',
 'odometer': 80642,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROAu2039N C5 AIRCROSS 1.5 BLUEHDI 130 SHINE AUTO',
 'transmission': 'automatic',
 'trim': '1.5 BLUEHDI 130 SHINE AUTO',
 'vin': None,
 'year': 2021}
2026-03-26 23:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981195%27 HTTP/1.1" 200 None
2026-03-26 23:00:16 [ayvens.be] INFO: Saving data for 1981195: {'auction_closing_time': 1774855800.0, 'created_time': 1774392435.435781, 'last_price_update_time': 1774566016.624649}
2026-03-26 23:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981195') HTTP/1.1" 204 0
2026-03-26 23:00:16 [ayvens.be] INFO: Found listing with ID: 1981196
2026-03-26 23:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981196%27 HTTP/1.1" 200 None
2026-03-26 23:00:16 [ayvens.be] INFO: Scrape type for 1981196: 2
2026-03-26 23:00:16 [ayvens.be] INFO: Extracting data for car ID: 1981196
2026-03-26 23:00:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a506822-a73a-5c8a-add2-85e191767713 with identifier: 1981196
2026-03-26 23:00:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a506822-a73a-5c8a-add2-85e191767713 with scrape type 2
2026-03-26 23:00:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1a506822-a73a-5c8a-add2-85e191767713 with scrape type 2
2026-03-26 23:00:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 1a506822-a73a-5c8a-add2-85e191767713, identifier: 1981196
2026-03-26 23:00:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 1a506822-a73a-5c8a-add2-85e191767713 with identifier: 1981196
2026-03-26 23:00:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 1a506822-a73a-5c8a-add2-85e191767713 with identifier: 1981196
2026-03-26 23:00:16 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 1a506822-a73a-5c8a-add2-85e191767713 with identifier: 1981196 to the API
2026-03-26 23:00:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:00:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:00:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '1a506822-a73a-5c8a-add2-85e191767713',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLB',
 'odometer': 68376,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLB 1.3 GLB 180 BUSINESS SOLUTION ESSENTIAL',
 'transmission': 'automatic',
 'trim': '1.3 GLB 180 BUSINESS SOLUTION ESSENTIAL',
 'vin': None,
 'year': 2021}
2026-03-26 23:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981196%27 HTTP/1.1" 200 None
2026-03-26 23:00:17 [ayvens.be] INFO: Saving data for 1981196: {'auction_closing_time': 1774855800.0, 'created_time': 1774392437.036631, 'last_price_update_time': 1774566017.013512}
2026-03-26 23:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981196') HTTP/1.1" 204 0
2026-03-26 23:00:17 [ayvens.be] INFO: Found listing with ID: 1981197
2026-03-26 23:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981197%27 HTTP/1.1" 200 None
2026-03-26 23:00:17 [ayvens.be] INFO: Scrape type for 1981197: 2
2026-03-26 23:00:17 [ayvens.be] INFO: Extracting data for car ID: 1981197
2026-03-26 23:00:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34bbce84-f627-506c-82ba-5e794d52266e with identifier: 1981197
2026-03-26 23:00:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34bbce84-f627-506c-82ba-5e794d52266e with scrape type 2
2026-03-26 23:00:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 34bbce84-f627-506c-82ba-5e794d52266e with scrape type 2
2026-03-26 23:00:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 34bbce84-f627-506c-82ba-5e794d52266e, identifier: 1981197
2026-03-26 23:00:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 34bbce84-f627-506c-82ba-5e794d52266e with identifier: 1981197
2026-03-26 23:00:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 34bbce84-f627-506c-82ba-5e794d52266e with identifier: 1981197
2026-03-26 23:00:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 34bbce84-f627-506c-82ba-5e794d52266e with identifier: 1981197 to the API
2026-03-26 23:00:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:00:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:00:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '34bbce84-f627-506c-82ba-5e794d52266e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '3 TOURING - 2019',
 'odometer': 99279,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3 TOURING - 2019 318iA OPF',
 'transmission': 'automatic',
 'trim': '318iA OPF',
 'vin': None,
 'year': 2021}
2026-03-26 23:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981197%27 HTTP/1.1" 200 None
2026-03-26 23:00:17 [ayvens.be] INFO: Saving data for 1981197: {'auction_closing_time': 1774855800.0, 'created_time': 1774392440.643883, 'last_price_update_time': 1774566017.424556}
2026-03-26 23:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981197') HTTP/1.1" 204 0
2026-03-26 23:00:17 [ayvens.be] INFO: Found listing with ID: 1981198
2026-03-26 23:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981198%27 HTTP/1.1" 200 None
2026-03-26 23:00:17 [ayvens.be] INFO: Scrape type for 1981198: 2
2026-03-26 23:00:17 [ayvens.be] INFO: Extracting data for car ID: 1981198
2026-03-26 23:00:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 05b12c27-b446-504a-96f4-31499a06ea19 with identifier: 1981198
2026-03-26 23:00:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05b12c27-b446-504a-96f4-31499a06ea19 with scrape type 2
2026-03-26 23:00:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 05b12c27-b446-504a-96f4-31499a06ea19 with scrape type 2
2026-03-26 23:00:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 05b12c27-b446-504a-96f4-31499a06ea19, identifier: 1981198
2026-03-26 23:00:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 05b12c27-b446-504a-96f4-31499a06ea19 with identifier: 1981198
2026-03-26 23:00:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 05b12c27-b446-504a-96f4-31499a06ea19 with identifier: 1981198
2026-03-26 23:00:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 05b12c27-b446-504a-96f4-31499a06ea19 with identifier: 1981198 to the API
2026-03-26 23:00:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:00:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:00:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '05b12c27-b446-504a-96f4-31499a06ea19',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '1 SERIES HATCH',
 'odometer': 83734,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1 SERIES HATCH 1.5 116IA (80KW)',
 'transmission': 'automatic',
 'trim': '1.5 116IA (80KW)',
 'vin': None,
 'year': 2021}
2026-03-26 23:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981198%27 HTTP/1.1" 200 None
2026-03-26 23:00:17 [ayvens.be] INFO: Saving data for 1981198: {'auction_closing_time': 1774855800.0, 'created_time': 1774392441.927994, 'last_price_update_time': 1774566017.954779}
2026-03-26 23:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981198') HTTP/1.1" 204 0
2026-03-26 23:00:17 [ayvens.be] INFO: Found listing with ID: 1981199
2026-03-26 23:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981199%27 HTTP/1.1" 200 None
2026-03-26 23:00:17 [ayvens.be] INFO: Scrape type for 1981199: 2
2026-03-26 23:00:17 [ayvens.be] INFO: Extracting data for car ID: 1981199
2026-03-26 23:00:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1774da05-df84-53e8-b1ea-548cacdfce92 with identifier: 1981199
2026-03-26 23:00:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1774da05-df84-53e8-b1ea-548cacdfce92 with scrape type 2
2026-03-26 23:00:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1774da05-df84-53e8-b1ea-548cacdfce92 with scrape type 2
2026-03-26 23:00:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 1774da05-df84-53e8-b1ea-548cacdfce92, identifier: 1981199
2026-03-26 23:00:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 1774da05-df84-53e8-b1ea-548cacdfce92 with identifier: 1981199
2026-03-26 23:00:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 1774da05-df84-53e8-b1ea-548cacdfce92 with identifier: 1981199
2026-03-26 23:00:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 1774da05-df84-53e8-b1ea-548cacdfce92 with identifier: 1981199 to the API
2026-03-26 23:00:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:00:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:00:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '1774da05-df84-53e8-b1ea-548cacdfce92',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '3 SERIES TOURING',
 'odometer': 85608,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3 SERIES TOURING 2.0 330E (215KW) TOURING',
 'transmission': 'automatic',
 'trim': '2.0 330E (215KW) TOURING',
 'vin': None,
 'year': 2022}
2026-03-26 23:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981199%27 HTTP/1.1" 200 None
2026-03-26 23:00:19 [ayvens.be] INFO: Saving data for 1981199: {'auction_closing_time': 1774855800.0, 'created_time': 1774392443.333041, 'last_price_update_time': 1774566019.03367}
2026-03-26 23:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981199') HTTP/1.1" 204 0
2026-03-26 23:00:19 [ayvens.be] INFO: Found listing with ID: 1981200
2026-03-26 23:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981200%27 HTTP/1.1" 200 None
2026-03-26 23:00:19 [ayvens.be] INFO: Scrape type for 1981200: 2
2026-03-26 23:00:19 [ayvens.be] INFO: Extracting data for car ID: 1981200
2026-03-26 23:00:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff0844ab-9dc1-5c70-9ffb-b8abaa1d6b14 with identifier: 1981200
2026-03-26 23:00:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff0844ab-9dc1-5c70-9ffb-b8abaa1d6b14 with scrape type 2
2026-03-26 23:00:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ff0844ab-9dc1-5c70-9ffb-b8abaa1d6b14 with scrape type 2
2026-03-26 23:00:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: ff0844ab-9dc1-5c70-9ffb-b8abaa1d6b14, identifier: 1981200
2026-03-26 23:00:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: ff0844ab-9dc1-5c70-9ffb-b8abaa1d6b14 with identifier: 1981200
2026-03-26 23:00:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: ff0844ab-9dc1-5c70-9ffb-b8abaa1d6b14 with identifier: 1981200
2026-03-26 23:00:19 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: ff0844ab-9dc1-5c70-9ffb-b8abaa1d6b14 with identifier: 1981200 to the API
2026-03-26 23:00:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:00:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:00:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'ff0844ab-9dc1-5c70-9ffb-b8abaa1d6b14',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1 - 2019',
 'odometer': 93886,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 - 2019 1.5iA xDrive25e PHEV OPF',
 'transmission': 'automatic',
 'trim': '1.5iA xDrive25e PHEV OPF',
 'vin': None,
 'year': 2021}
2026-03-26 23:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981200%27 HTTP/1.1" 200 None
2026-03-26 23:00:19 [ayvens.be] INFO: Saving data for 1981200: {'auction_closing_time': 1774855800.0, 'created_time': 1774392445.185101, 'last_price_update_time': 1774566019.433382}
2026-03-26 23:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981200') HTTP/1.1" 204 0
2026-03-26 23:00:19 [ayvens.be] INFO: Found listing with ID: 1981201
2026-03-26 23:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981201%27 HTTP/1.1" 200 None
2026-03-26 23:00:19 [ayvens.be] INFO: Scrape type for 1981201: 2
2026-03-26 23:00:19 [ayvens.be] INFO: Extracting data for car ID: 1981201
2026-03-26 23:00:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cfb5dfb7-32a9-5b22-ac1f-7d343fecb5a6 with identifier: 1981201
2026-03-26 23:00:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cfb5dfb7-32a9-5b22-ac1f-7d343fecb5a6 with scrape type 2
2026-03-26 23:00:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cfb5dfb7-32a9-5b22-ac1f-7d343fecb5a6 with scrape type 2
2026-03-26 23:00:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: cfb5dfb7-32a9-5b22-ac1f-7d343fecb5a6, identifier: 1981201
2026-03-26 23:00:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: cfb5dfb7-32a9-5b22-ac1f-7d343fecb5a6 with identifier: 1981201
2026-03-26 23:00:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: cfb5dfb7-32a9-5b22-ac1f-7d343fecb5a6 with identifier: 1981201
2026-03-26 23:00:19 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: cfb5dfb7-32a9-5b22-ac1f-7d343fecb5a6 with identifier: 1981201 to the API
2026-03-26 23:00:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:00:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:00:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'cfb5dfb7-32a9-5b22-ac1f-7d343fecb5a6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'V60 - 2018',
 'odometer': 80523,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO V60 - 2018 2.0 T6 AWD PHEV Inscription Expression',
 'transmission': 'automatic',
 'trim': '2.0 T6 AWD PHEV Inscription Expression',
 'vin': None,
 'year': 2021}
2026-03-26 23:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981201%27 HTTP/1.1" 200 None
2026-03-26 23:00:19 [ayvens.be] INFO: Saving data for 1981201: {'auction_closing_time': 1774855800.0, 'created_time': 1774392446.749302, 'last_price_update_time': 1774566019.943152}
2026-03-26 23:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981201') HTTP/1.1" 204 0
2026-03-26 23:00:19 [ayvens.be] INFO: Found listing with ID: 1981202
2026-03-26 23:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981202%27 HTTP/1.1" 200 None
2026-03-26 23:00:19 [ayvens.be] INFO: Scrape type for 1981202: 2
2026-03-26 23:00:19 [ayvens.be] INFO: Extracting data for car ID: 1981202
2026-03-26 23:00:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d04fe0eb-3956-5e57-bdbc-cf8f45ac5cf8 with identifier: 1981202
2026-03-26 23:00:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d04fe0eb-3956-5e57-bdbc-cf8f45ac5cf8 with scrape type 2
2026-03-26 23:00:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d04fe0eb-3956-5e57-bdbc-cf8f45ac5cf8 with scrape type 2
2026-03-26 23:00:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d04fe0eb-3956-5e57-bdbc-cf8f45ac5cf8, identifier: 1981202
2026-03-26 23:00:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d04fe0eb-3956-5e57-bdbc-cf8f45ac5cf8 with identifier: 1981202
2026-03-26 23:00:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d04fe0eb-3956-5e57-bdbc-cf8f45ac5cf8 with identifier: 1981202
2026-03-26 23:00:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d04fe0eb-3956-5e57-bdbc-cf8f45ac5cf8 with identifier: 1981202 to the API
2026-03-26 23:00:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:00:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:00:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'electric',
 'id': 'd04fe0eb-3956-5e57-bdbc-cf8f45ac5cf8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'IX3',
 'odometer': 79813,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW IX3 80KWH AUTO',
 'transmission': 'automatic',
 'trim': '80KWH AUTO',
 'vin': None,
 'year': 2021}
2026-03-26 23:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981202%27 HTTP/1.1" 200 None
2026-03-26 23:00:20 [ayvens.be] INFO: Saving data for 1981202: {'auction_closing_time': 1774855800.0, 'created_time': 1774392448.046199, 'last_price_update_time': 1774566020.354819}
2026-03-26 23:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981202') HTTP/1.1" 204 0
2026-03-26 23:00:20 [ayvens.be] INFO: Found listing with ID: 1981203
2026-03-26 23:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981203%27 HTTP/1.1" 200 None
2026-03-26 23:00:20 [ayvens.be] INFO: Scrape type for 1981203: 2
2026-03-26 23:00:20 [ayvens.be] INFO: Extracting data for car ID: 1981203
2026-03-26 23:00:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 005dbb32-469c-5d45-ba42-34d252124796 with identifier: 1981203
2026-03-26 23:00:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 005dbb32-469c-5d45-ba42-34d252124796 with scrape type 2
2026-03-26 23:00:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 005dbb32-469c-5d45-ba42-34d252124796 with scrape type 2
2026-03-26 23:00:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 005dbb32-469c-5d45-ba42-34d252124796, identifier: 1981203
2026-03-26 23:00:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 005dbb32-469c-5d45-ba42-34d252124796 with identifier: 1981203
2026-03-26 23:00:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 005dbb32-469c-5d45-ba42-34d252124796 with identifier: 1981203
2026-03-26 23:00:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 005dbb32-469c-5d45-ba42-34d252124796 with identifier: 1981203 to the API
2026-03-26 23:00:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:00:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:00:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '005dbb32-469c-5d45-ba42-34d252124796',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'C-CLASS BREAK',
 'odometer': 149159,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ C-CLASS BREAK 2.0 C 300 E BUSINESS SOLUTION AUTO',
 'transmission': 'automatic',
 'trim': '2.0 C 300 E BUSINESS SOLUTION AUTO',
 'vin': None,
 'year': 2020}
2026-03-26 23:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981203%27 HTTP/1.1" 200 None
2026-03-26 23:00:21 [ayvens.be] INFO: Saving data for 1981203: {'auction_closing_time': 1774855800.0, 'created_time': 1774392450.357066, 'last_price_update_time': 1774566021.673335}
2026-03-26 23:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981203') HTTP/1.1" 204 0
2026-03-26 23:00:21 [ayvens.be] INFO: Found listing with ID: 1981204
2026-03-26 23:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981204%27 HTTP/1.1" 200 None
2026-03-26 23:00:21 [ayvens.be] INFO: Scrape type for 1981204: 2
2026-03-26 23:00:21 [ayvens.be] INFO: Extracting data for car ID: 1981204
2026-03-26 23:00:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a976dcd-9bb9-53e0-8d92-ebc8af6a984d with identifier: 1981204
2026-03-26 23:00:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a976dcd-9bb9-53e0-8d92-ebc8af6a984d with scrape type 2
2026-03-26 23:00:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4a976dcd-9bb9-53e0-8d92-ebc8af6a984d with scrape type 2
2026-03-26 23:00:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 4a976dcd-9bb9-53e0-8d92-ebc8af6a984d, identifier: 1981204
2026-03-26 23:00:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 4a976dcd-9bb9-53e0-8d92-ebc8af6a984d with identifier: 1981204
2026-03-26 23:00:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 4a976dcd-9bb9-53e0-8d92-ebc8af6a984d with identifier: 1981204
2026-03-26 23:00:21 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 4a976dcd-9bb9-53e0-8d92-ebc8af6a984d with identifier: 1981204 to the API
2026-03-26 23:00:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:00:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:00:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'electric',
 'id': '4a976dcd-9bb9-53e0-8d92-ebc8af6a984d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q4 E-TRON',
 'odometer': 77490,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q4 E-TRON BEV 82KWH 40 ADVANCED AUTO',
 'transmission': 'automatic',
 'trim': 'BEV 82KWH 40 ADVANCED AUTO',
 'vin': None,
 'year': 2022}
2026-03-26 23:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981204%27 HTTP/1.1" 200 None
2026-03-26 23:00:22 [ayvens.be] INFO: Saving data for 1981204: {'auction_closing_time': 1774855800.0, 'created_time': 1774392451.848277, 'last_price_update_time': 1774566022.079364}
2026-03-26 23:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981204') HTTP/1.1" 204 0
2026-03-26 23:00:22 [ayvens.be] INFO: Found listing with ID: 1981205
2026-03-26 23:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981205%27 HTTP/1.1" 200 None
2026-03-26 23:00:22 [ayvens.be] INFO: Scrape type for 1981205: 2
2026-03-26 23:00:22 [ayvens.be] INFO: Extracting data for car ID: 1981205
2026-03-26 23:00:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 928ce10f-74ef-57ff-b729-f4a26d193dc0 with identifier: 1981205
2026-03-26 23:00:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 928ce10f-74ef-57ff-b729-f4a26d193dc0 with scrape type 2
2026-03-26 23:00:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 928ce10f-74ef-57ff-b729-f4a26d193dc0 with scrape type 2
2026-03-26 23:00:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 928ce10f-74ef-57ff-b729-f4a26d193dc0, identifier: 1981205
2026-03-26 23:00:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 928ce10f-74ef-57ff-b729-f4a26d193dc0 with identifier: 1981205
2026-03-26 23:00:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 928ce10f-74ef-57ff-b729-f4a26d193dc0 with identifier: 1981205
2026-03-26 23:00:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 928ce10f-74ef-57ff-b729-f4a26d193dc0 with identifier: 1981205 to the API
2026-03-26 23:00:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:00:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:00:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '928ce10f-74ef-57ff-b729-f4a26d193dc0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'HYUNDAI',
 'model': 'TUCSON',
 'odometer': 96704,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'HYUNDAI TUCSON 1.6 T-GDI HYBRID FEEL AUTO',
 'transmission': 'automatic',
 'trim': '1.6 T-GDI HYBRID FEEL AUTO',
 'vin': None,
 'year': 2021}
2026-03-26 23:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981205%27 HTTP/1.1" 200 None
2026-03-26 23:00:22 [ayvens.be] INFO: Saving data for 1981205: {'auction_closing_time': 1774855800.0, 'created_time': 1774392453.19435, 'last_price_update_time': 1774566022.500458}
2026-03-26 23:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981205') HTTP/1.1" 204 0
2026-03-26 23:00:22 [ayvens.be] INFO: Found listing with ID: 1981206
2026-03-26 23:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981206%27 HTTP/1.1" 200 None
2026-03-26 23:00:22 [ayvens.be] INFO: Scrape type for 1981206: 2
2026-03-26 23:00:22 [ayvens.be] INFO: Extracting data for car ID: 1981206
2026-03-26 23:00:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2681e870-05d3-5d78-8689-4aa49350be88 with identifier: 1981206
2026-03-26 23:00:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2681e870-05d3-5d78-8689-4aa49350be88 with scrape type 2
2026-03-26 23:00:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2681e870-05d3-5d78-8689-4aa49350be88 with scrape type 2
2026-03-26 23:00:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 2681e870-05d3-5d78-8689-4aa49350be88, identifier: 1981206
2026-03-26 23:00:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 2681e870-05d3-5d78-8689-4aa49350be88 with identifier: 1981206
2026-03-26 23:00:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 2681e870-05d3-5d78-8689-4aa49350be88 with identifier: 1981206
2026-03-26 23:00:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 2681e870-05d3-5d78-8689-4aa49350be88 with identifier: 1981206 to the API
2026-03-26 23:00:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:00:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:00:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '2681e870-05d3-5d78-8689-4aa49350be88',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 45482,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T4 RECHARGE GEARTR. INSCRIPTION EXPR',
 'transmission': 'automatic',
 'trim': '1.5 T4 RECHARGE GEARTR. INSCRIPTION EXPR',
 'vin': None,
 'year': 2022}
2026-03-26 23:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981206%27 HTTP/1.1" 200 None
2026-03-26 23:00:22 [ayvens.be] INFO: Saving data for 1981206: {'auction_closing_time': 1774855800.0, 'created_time': 1774392455.145681, 'last_price_update_time': 1774566022.897567}
2026-03-26 23:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981206') HTTP/1.1" 204 0
2026-03-26 23:00:22 [ayvens.be] INFO: Found listing with ID: 1981207
2026-03-26 23:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981207%27 HTTP/1.1" 200 None
2026-03-26 23:00:22 [ayvens.be] INFO: Scrape type for 1981207: 2
2026-03-26 23:00:22 [ayvens.be] INFO: Extracting data for car ID: 1981207
2026-03-26 23:00:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c4510b0a-1cbc-5e8a-8d83-d53fc2273850 with identifier: 1981207
2026-03-26 23:00:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4510b0a-1cbc-5e8a-8d83-d53fc2273850 with scrape type 2
2026-03-26 23:00:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c4510b0a-1cbc-5e8a-8d83-d53fc2273850 with scrape type 2
2026-03-26 23:00:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c4510b0a-1cbc-5e8a-8d83-d53fc2273850, identifier: 1981207
2026-03-26 23:00:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c4510b0a-1cbc-5e8a-8d83-d53fc2273850 with identifier: 1981207
2026-03-26 23:00:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c4510b0a-1cbc-5e8a-8d83-d53fc2273850 with identifier: 1981207
2026-03-26 23:00:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c4510b0a-1cbc-5e8a-8d83-d53fc2273850 with identifier: 1981207 to the API
2026-03-26 23:00:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:00:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:00:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'electric',
 'id': 'c4510b0a-1cbc-5e8a-8d83-d53fc2273850',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'IX3',
 'odometer': 94084,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW IX3 80KWH AUTO',
 'transmission': 'automatic',
 'trim': '80KWH AUTO',
 'vin': None,
 'year': 2021}
2026-03-26 23:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981207%27 HTTP/1.1" 200 None
2026-03-26 23:00:24 [ayvens.be] INFO: Saving data for 1981207: {'auction_closing_time': 1774855800.0, 'created_time': 1774392457.061012, 'last_price_update_time': 1774566024.227067}
2026-03-26 23:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981207') HTTP/1.1" 204 0
2026-03-26 23:00:24 [ayvens.be] INFO: Found listing with ID: 1981208
2026-03-26 23:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981208%27 HTTP/1.1" 200 None
2026-03-26 23:00:24 [ayvens.be] INFO: Scrape type for 1981208: 2
2026-03-26 23:00:24 [ayvens.be] INFO: Extracting data for car ID: 1981208
2026-03-26 23:00:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 283ccbef-d068-51ad-a5a8-b2001efa15e6 with identifier: 1981208
2026-03-26 23:00:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 283ccbef-d068-51ad-a5a8-b2001efa15e6 with scrape type 2
2026-03-26 23:00:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 283ccbef-d068-51ad-a5a8-b2001efa15e6 with scrape type 2
2026-03-26 23:00:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 283ccbef-d068-51ad-a5a8-b2001efa15e6, identifier: 1981208
2026-03-26 23:00:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 283ccbef-d068-51ad-a5a8-b2001efa15e6 with identifier: 1981208
2026-03-26 23:00:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 283ccbef-d068-51ad-a5a8-b2001efa15e6 with identifier: 1981208
2026-03-26 23:00:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 283ccbef-d068-51ad-a5a8-b2001efa15e6 with identifier: 1981208 to the API
2026-03-26 23:00:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:00:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:00:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '283ccbef-d068-51ad-a5a8-b2001efa15e6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '2-serie',
 'odometer': 150247,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 2-serie 2.0 218DA (100KW) GRAN COUPE',
 'transmission': 'automatic',
 'trim': '2.0 218DA (100KW) GRAN COUPE',
 'vin': None,
 'year': 2021}
2026-03-26 23:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981208%27 HTTP/1.1" 200 None
2026-03-26 23:00:24 [ayvens.be] INFO: Saving data for 1981208: {'auction_closing_time': 1774855800.0, 'created_time': 1774392459.272674, 'last_price_update_time': 1774566024.65579}
2026-03-26 23:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981208') HTTP/1.1" 204 0
2026-03-26 23:00:24 [ayvens.be] INFO: Found listing with ID: 1981209
2026-03-26 23:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981209%27 HTTP/1.1" 200 None
2026-03-26 23:00:24 [ayvens.be] INFO: Scrape type for 1981209: 2
2026-03-26 23:00:24 [ayvens.be] INFO: Extracting data for car ID: 1981209
2026-03-26 23:00:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a007cff-3ab3-5401-9d18-ffd29573a611 with identifier: 1981209
2026-03-26 23:00:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a007cff-3ab3-5401-9d18-ffd29573a611 with scrape type 2
2026-03-26 23:00:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8a007cff-3ab3-5401-9d18-ffd29573a611 with scrape type 2
2026-03-26 23:00:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 8a007cff-3ab3-5401-9d18-ffd29573a611, identifier: 1981209
2026-03-26 23:00:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 8a007cff-3ab3-5401-9d18-ffd29573a611 with identifier: 1981209
2026-03-26 23:00:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 8a007cff-3ab3-5401-9d18-ffd29573a611 with identifier: 1981209
2026-03-26 23:00:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 8a007cff-3ab3-5401-9d18-ffd29573a611 with identifier: 1981209 to the API
2026-03-26 23:00:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:00:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:00:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '8a007cff-3ab3-5401-9d18-ffd29573a611',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 119243,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 1.5 XDRIVE25E (162KW)',
 'transmission': 'automatic',
 'trim': '1.5 XDRIVE25E (162KW)',
 'vin': None,
 'year': 2021}
2026-03-26 23:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981209%27 HTTP/1.1" 200 None
2026-03-26 23:00:25 [ayvens.be] INFO: Saving data for 1981209: {'auction_closing_time': 1774855800.0, 'created_time': 1774392460.549924, 'last_price_update_time': 1774566025.099073}
2026-03-26 23:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981209') HTTP/1.1" 204 0
2026-03-26 23:00:25 [ayvens.be] INFO: Found listing with ID: 1981210
2026-03-26 23:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981210%27 HTTP/1.1" 200 None
2026-03-26 23:00:25 [ayvens.be] INFO: Scrape type for 1981210: 2
2026-03-26 23:00:25 [ayvens.be] INFO: Extracting data for car ID: 1981210
2026-03-26 23:00:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6928d62f-759b-5f8e-a563-9425c1dcbdf1 with identifier: 1981210
2026-03-26 23:00:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6928d62f-759b-5f8e-a563-9425c1dcbdf1 with scrape type 2
2026-03-26 23:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6928d62f-759b-5f8e-a563-9425c1dcbdf1 with scrape type 2
2026-03-26 23:00:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 6928d62f-759b-5f8e-a563-9425c1dcbdf1, identifier: 1981210
2026-03-26 23:00:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 6928d62f-759b-5f8e-a563-9425c1dcbdf1 with identifier: 1981210
2026-03-26 23:00:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 6928d62f-759b-5f8e-a563-9425c1dcbdf1 with identifier: 1981210
2026-03-26 23:00:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 6928d62f-759b-5f8e-a563-9425c1dcbdf1 with identifier: 1981210 to the API
2026-03-26 23:00:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:00:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:00:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'electric',
 'id': '6928d62f-759b-5f8e-a563-9425c1dcbdf1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'EQC',
 'odometer': 104505,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ EQC BEV 80KWH EQC 400 4M BUSINESS SOL AMG',
 'transmission': 'automatic',
 'trim': 'BEV 80KWH EQC 400 4M BUSINESS SOL AMG',
 'vin': None,
 'year': 2022}
2026-03-26 23:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981210%27 HTTP/1.1" 200 None
2026-03-26 23:00:25 [ayvens.be] INFO: Saving data for 1981210: {'auction_closing_time': 1774855800.0, 'created_time': 1774392462.23734, 'last_price_update_time': 1774566025.523533}
2026-03-26 23:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981210') HTTP/1.1" 204 0
2026-03-26 23:00:25 [ayvens.be] INFO: Found listing with ID: 1981211
2026-03-26 23:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981211%27 HTTP/1.1" 200 None
2026-03-26 23:00:25 [ayvens.be] INFO: Scrape type for 1981211: 2
2026-03-26 23:00:25 [ayvens.be] INFO: Extracting data for car ID: 1981211
2026-03-26 23:00:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9e7d8078-cf36-5dd2-bd67-3145a3dbb424 with identifier: 1981211
2026-03-26 23:00:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e7d8078-cf36-5dd2-bd67-3145a3dbb424 with scrape type 2
2026-03-26 23:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9e7d8078-cf36-5dd2-bd67-3145a3dbb424 with scrape type 2
2026-03-26 23:00:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 9e7d8078-cf36-5dd2-bd67-3145a3dbb424, identifier: 1981211
2026-03-26 23:00:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 9e7d8078-cf36-5dd2-bd67-3145a3dbb424 with identifier: 1981211
2026-03-26 23:00:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 9e7d8078-cf36-5dd2-bd67-3145a3dbb424 with identifier: 1981211
2026-03-26 23:00:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 9e7d8078-cf36-5dd2-bd67-3145a3dbb424 with identifier: 1981211 to the API
2026-03-26 23:00:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:00:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:00:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '9e7d8078-cf36-5dd2-bd67-3145a3dbb424',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'OCTAVIA COMBI',
 'odometer': 145571,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA OCTAVIA COMBI 2.0 CRTDI 85KW DSG7 CLEVER',
 'transmission': 'automatic',
 'trim': '2.0 CRTDI 85KW DSG7 CLEVER',
 'vin': None,
 'year': 2021}
2026-03-26 23:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981211%27 HTTP/1.1" 200 None
2026-03-26 23:00:26 [ayvens.be] INFO: Saving data for 1981211: {'auction_closing_time': 1774855800.0, 'created_time': 1774392464.538009, 'last_price_update_time': 1774566026.881594}
2026-03-26 23:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981211') HTTP/1.1" 204 0
2026-03-26 23:00:27 [ayvens.be] INFO: Found listing with ID: 1981212
2026-03-26 23:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981212%27 HTTP/1.1" 200 None
2026-03-26 23:00:27 [ayvens.be] INFO: Scrape type for 1981212: 2
2026-03-26 23:00:27 [ayvens.be] INFO: Extracting data for car ID: 1981212
2026-03-26 23:00:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4958349f-6e0c-51eb-a850-148d060247e2 with identifier: 1981212
2026-03-26 23:00:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4958349f-6e0c-51eb-a850-148d060247e2 with scrape type 2
2026-03-26 23:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4958349f-6e0c-51eb-a850-148d060247e2 with scrape type 2
2026-03-26 23:00:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 4958349f-6e0c-51eb-a850-148d060247e2, identifier: 1981212
2026-03-26 23:00:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 4958349f-6e0c-51eb-a850-148d060247e2 with identifier: 1981212
2026-03-26 23:00:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 4958349f-6e0c-51eb-a850-148d060247e2 with identifier: 1981212
2026-03-26 23:00:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 4958349f-6e0c-51eb-a850-148d060247e2 with identifier: 1981212 to the API
2026-03-26 23:00:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:00:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:00:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '4958349f-6e0c-51eb-a850-148d060247e2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A4',
 'odometer': 179602,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A4 2.0 35 TDI 120KW S TR BUSINESS EDITION',
 'transmission': 'automatic',
 'trim': '2.0 35 TDI 120KW S TR BUSINESS EDITION',
 'vin': None,
 'year': 2020}
2026-03-26 23:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981212%27 HTTP/1.1" 200 None
2026-03-26 23:00:27 [ayvens.be] INFO: Saving data for 1981212: {'auction_closing_time': 1774855800.0, 'created_time': 1774392465.853319, 'last_price_update_time': 1774566027.37818}
2026-03-26 23:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981212') HTTP/1.1" 204 0
2026-03-26 23:00:27 [ayvens.be] INFO: Found listing with ID: 1981213
2026-03-26 23:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981213%27 HTTP/1.1" 200 None
2026-03-26 23:00:27 [ayvens.be] INFO: Scrape type for 1981213: 2
2026-03-26 23:00:27 [ayvens.be] INFO: Extracting data for car ID: 1981213
2026-03-26 23:00:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dfb6b5ed-1ad9-5ae6-b2b7-0db2a5974b56 with identifier: 1981213
2026-03-26 23:00:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dfb6b5ed-1ad9-5ae6-b2b7-0db2a5974b56 with scrape type 2
2026-03-26 23:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dfb6b5ed-1ad9-5ae6-b2b7-0db2a5974b56 with scrape type 2
2026-03-26 23:00:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: dfb6b5ed-1ad9-5ae6-b2b7-0db2a5974b56, identifier: 1981213
2026-03-26 23:00:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: dfb6b5ed-1ad9-5ae6-b2b7-0db2a5974b56 with identifier: 1981213
2026-03-26 23:00:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: dfb6b5ed-1ad9-5ae6-b2b7-0db2a5974b56 with identifier: 1981213
2026-03-26 23:00:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: dfb6b5ed-1ad9-5ae6-b2b7-0db2a5974b56 with identifier: 1981213 to the API
2026-03-26 23:00:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:00:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:00:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'dfb6b5ed-1ad9-5ae6-b2b7-0db2a5974b56',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A-CLASS',
 'odometer': 92742,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ A-CLASS 1.3 A 250 E DCT BUSINESS SOLUTION',
 'transmission': 'automatic',
 'trim': '1.3 A 250 E DCT BUSINESS SOLUTION',
 'vin': None,
 'year': 2021}
2026-03-26 23:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981213%27 HTTP/1.1" 200 None
2026-03-26 23:00:27 [ayvens.be] INFO: Saving data for 1981213: {'auction_closing_time': 1774855800.0, 'created_time': 1774392467.524694, 'last_price_update_time': 1774566027.817594}
2026-03-26 23:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981213') HTTP/1.1" 204 0
2026-03-26 23:00:27 [ayvens.be] INFO: Found listing with ID: 1981214
2026-03-26 23:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981214%27 HTTP/1.1" 200 None
2026-03-26 23:00:27 [ayvens.be] INFO: Scrape type for 1981214: 2
2026-03-26 23:00:27 [ayvens.be] INFO: Extracting data for car ID: 1981214
2026-03-26 23:00:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ccef6b72-81c5-575a-82e1-8e8a07591d49 with identifier: 1981214
2026-03-26 23:00:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ccef6b72-81c5-575a-82e1-8e8a07591d49 with scrape type 2
2026-03-26 23:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ccef6b72-81c5-575a-82e1-8e8a07591d49 with scrape type 2
2026-03-26 23:00:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: ccef6b72-81c5-575a-82e1-8e8a07591d49, identifier: 1981214
2026-03-26 23:00:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: ccef6b72-81c5-575a-82e1-8e8a07591d49 with identifier: 1981214
2026-03-26 23:00:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: ccef6b72-81c5-575a-82e1-8e8a07591d49 with identifier: 1981214
2026-03-26 23:00:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: ccef6b72-81c5-575a-82e1-8e8a07591d49 with identifier: 1981214 to the API
2026-03-26 23:00:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:00:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:00:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'color': 'SAPHIRSCHWARZ METALLIC',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'ccef6b72-81c5-575a-82e1-8e8a07591d49',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 108361,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 1.5 SDRIVE16DA',
 'transmission': 'automatic',
 'trim': '1.5 SDRIVE16DA',
 'vin': None,
 'year': 2022}
2026-03-26 23:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981214%27 HTTP/1.1" 200 None
2026-03-26 23:00:28 [ayvens.be] INFO: Saving data for 1981214: {'auction_closing_time': 1774855800.0, 'created_time': 1774392470.370417, 'last_price_update_time': 1774566028.215772}
2026-03-26 23:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981214') HTTP/1.1" 204 0
2026-03-26 23:00:28 [ayvens.be] INFO: Found listing with ID: 1981215
2026-03-26 23:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981215%27 HTTP/1.1" 200 None
2026-03-26 23:00:28 [ayvens.be] INFO: Scrape type for 1981215: 2
2026-03-26 23:00:28 [ayvens.be] INFO: Extracting data for car ID: 1981215
2026-03-26 23:00:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fbc014a8-d2c4-5088-9e89-c21108672e4c with identifier: 1981215
2026-03-26 23:00:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fbc014a8-d2c4-5088-9e89-c21108672e4c with scrape type 2
2026-03-26 23:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fbc014a8-d2c4-5088-9e89-c21108672e4c with scrape type 2
2026-03-26 23:00:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: fbc014a8-d2c4-5088-9e89-c21108672e4c, identifier: 1981215
2026-03-26 23:00:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: fbc014a8-d2c4-5088-9e89-c21108672e4c with identifier: 1981215
2026-03-26 23:00:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: fbc014a8-d2c4-5088-9e89-c21108672e4c with identifier: 1981215
2026-03-26 23:00:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: fbc014a8-d2c4-5088-9e89-c21108672e4c with identifier: 1981215 to the API
2026-03-26 23:00:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:00:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:00:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'fbc014a8-d2c4-5088-9e89-c21108672e4c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A5 SPORTBACK DIESEL - 2020',
 'odometer': 129280,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-06',
 'seats_number': 4,
 'seller_name': None,
 'title': 'AUDI A5 SPORTBACK DIESEL - 2020 35 TDi Business Edition Advanced S '
          'tron.',
 'transmission': 'automatic',
 'trim': '35 TDi Business Edition Advanced S tron.',
 'vin': None,
 'year': 2020}
2026-03-26 23:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981215%27 HTTP/1.1" 200 None
2026-03-26 23:00:28 [ayvens.be] INFO: Saving data for 1981215: {'auction_closing_time': 1774855800.0, 'created_time': 1774392471.77565, 'last_price_update_time': 1774566028.610876}
2026-03-26 23:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981215') HTTP/1.1" 204 0
2026-03-26 23:00:28 [ayvens.be] INFO: Found listing with ID: 1981216
2026-03-26 23:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981216%27 HTTP/1.1" 200 None
2026-03-26 23:00:28 [ayvens.be] INFO: Scrape type for 1981216: 2
2026-03-26 23:00:28 [ayvens.be] INFO: Extracting data for car ID: 1981216
2026-03-26 23:00:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c718578a-7a51-5762-83df-cab4e808162f with identifier: 1981216
2026-03-26 23:00:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c718578a-7a51-5762-83df-cab4e808162f with scrape type 2
2026-03-26 23:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c718578a-7a51-5762-83df-cab4e808162f with scrape type 2
2026-03-26 23:00:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c718578a-7a51-5762-83df-cab4e808162f, identifier: 1981216
2026-03-26 23:00:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c718578a-7a51-5762-83df-cab4e808162f with identifier: 1981216
2026-03-26 23:00:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c718578a-7a51-5762-83df-cab4e808162f with identifier: 1981216
2026-03-26 23:00:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c718578a-7a51-5762-83df-cab4e808162f with identifier: 1981216 to the API
2026-03-26 23:00:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:00:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:00:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'c718578a-7a51-5762-83df-cab4e808162f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A4',
 'odometer': 110037,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A4 2.0 30 TDI 100KW S TR ATTRACTION B.E.',
 'transmission': 'automatic',
 'trim': '2.0 30 TDI 100KW S TR ATTRACTION B.E.',
 'vin': None,
 'year': 2022}
2026-03-26 23:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981216%27 HTTP/1.1" 200 None
2026-03-26 23:00:29 [ayvens.be] INFO: Saving data for 1981216: {'auction_closing_time': 1774855800.0, 'created_time': 1774392473.436078, 'last_price_update_time': 1774566029.67554}
2026-03-26 23:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981216') HTTP/1.1" 204 0
2026-03-26 23:00:29 [ayvens.be] INFO: Found listing with ID: 1981217
2026-03-26 23:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981217%27 HTTP/1.1" 200 None
2026-03-26 23:00:29 [ayvens.be] INFO: Scrape type for 1981217: 2
2026-03-26 23:00:29 [ayvens.be] INFO: Extracting data for car ID: 1981217
2026-03-26 23:00:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 856191d6-dee9-53b1-8504-abc7615c1d43 with identifier: 1981217
2026-03-26 23:00:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 856191d6-dee9-53b1-8504-abc7615c1d43 with scrape type 2
2026-03-26 23:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 856191d6-dee9-53b1-8504-abc7615c1d43 with scrape type 2
2026-03-26 23:00:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 856191d6-dee9-53b1-8504-abc7615c1d43, identifier: 1981217
2026-03-26 23:00:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 856191d6-dee9-53b1-8504-abc7615c1d43 with identifier: 1981217
2026-03-26 23:00:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 856191d6-dee9-53b1-8504-abc7615c1d43 with identifier: 1981217
2026-03-26 23:00:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 856191d6-dee9-53b1-8504-abc7615c1d43 with identifier: 1981217 to the API
2026-03-26 23:00:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:00:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:00:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '856191d6-dee9-53b1-8504-abc7615c1d43',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A-CLASS',
 'odometer': 79568,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ A-CLASS 1.3 A 250 E DCT BUSINESS SOLUTION',
 'transmission': 'automatic',
 'trim': '1.3 A 250 E DCT BUSINESS SOLUTION',
 'vin': None,
 'year': 2022}
2026-03-26 23:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981217%27 HTTP/1.1" 200 None
2026-03-26 23:00:30 [ayvens.be] INFO: Saving data for 1981217: {'auction_closing_time': 1774855800.0, 'created_time': 1774392477.219672, 'last_price_update_time': 1774566030.197091}
2026-03-26 23:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981217') HTTP/1.1" 204 0
2026-03-26 23:00:30 [ayvens.be] INFO: Found listing with ID: 1981218
2026-03-26 23:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981218%27 HTTP/1.1" 200 None
2026-03-26 23:00:30 [ayvens.be] INFO: Scrape type for 1981218: 2
2026-03-26 23:00:30 [ayvens.be] INFO: Extracting data for car ID: 1981218
2026-03-26 23:00:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b5ecc8af-05b8-5f20-b299-a2ada04e59d3 with identifier: 1981218
2026-03-26 23:00:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5ecc8af-05b8-5f20-b299-a2ada04e59d3 with scrape type 2
2026-03-26 23:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b5ecc8af-05b8-5f20-b299-a2ada04e59d3 with scrape type 2
2026-03-26 23:00:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b5ecc8af-05b8-5f20-b299-a2ada04e59d3, identifier: 1981218
2026-03-26 23:00:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b5ecc8af-05b8-5f20-b299-a2ada04e59d3 with identifier: 1981218
2026-03-26 23:00:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b5ecc8af-05b8-5f20-b299-a2ada04e59d3 with identifier: 1981218
2026-03-26 23:00:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b5ecc8af-05b8-5f20-b299-a2ada04e59d3 with identifier: 1981218 to the API
2026-03-26 23:00:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:00:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:00:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'b5ecc8af-05b8-5f20-b299-a2ada04e59d3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 167242,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T5 PHEV Inscription',
 'transmission': 'automatic',
 'trim': '1.5 T5 PHEV Inscription',
 'vin': None,
 'year': 2020}
2026-03-26 23:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981218%27 HTTP/1.1" 200 None
2026-03-26 23:00:30 [ayvens.be] INFO: Saving data for 1981218: {'auction_closing_time': 1774855800.0, 'created_time': 1774392476.430579, 'last_price_update_time': 1774566030.59571}
2026-03-26 23:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981218') HTTP/1.1" 204 0
2026-03-26 23:00:30 [ayvens.be] INFO: Found listing with ID: 1981219
2026-03-26 23:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981219%27 HTTP/1.1" 200 None
2026-03-26 23:00:30 [ayvens.be] INFO: Scrape type for 1981219: 2
2026-03-26 23:00:30 [ayvens.be] INFO: Extracting data for car ID: 1981219
2026-03-26 23:00:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2fbc8b75-4f57-51c8-a86c-9d7fb2d17d9b with identifier: 1981219
2026-03-26 23:00:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2fbc8b75-4f57-51c8-a86c-9d7fb2d17d9b with scrape type 2
2026-03-26 23:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2fbc8b75-4f57-51c8-a86c-9d7fb2d17d9b with scrape type 2
2026-03-26 23:00:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 2fbc8b75-4f57-51c8-a86c-9d7fb2d17d9b, identifier: 1981219
2026-03-26 23:00:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 2fbc8b75-4f57-51c8-a86c-9d7fb2d17d9b with identifier: 1981219
2026-03-26 23:00:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 2fbc8b75-4f57-51c8-a86c-9d7fb2d17d9b with identifier: 1981219
2026-03-26 23:00:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 2fbc8b75-4f57-51c8-a86c-9d7fb2d17d9b with identifier: 1981219 to the API
2026-03-26 23:00:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:00:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:00:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '2fbc8b75-4f57-51c8-a86c-9d7fb2d17d9b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3 Sportback',
 'odometer': 61187,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 Sportback 1.4 45 TFSI E S TRONIC',
 'transmission': 'automatic',
 'trim': '1.4 45 TFSI E S TRONIC',
 'vin': None,
 'year': 2022}
2026-03-26 23:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981219%27 HTTP/1.1" 200 None
2026-03-26 23:00:30 [ayvens.be] INFO: Saving data for 1981219: {'auction_closing_time': 1774855800.0, 'created_time': 1774392478.182956, 'last_price_update_time': 1774566030.989554}
2026-03-26 23:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981219') HTTP/1.1" 204 0
2026-03-26 23:00:31 [ayvens.be] INFO: Found listing with ID: 1981220
2026-03-26 23:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981220%27 HTTP/1.1" 200 None
2026-03-26 23:00:31 [ayvens.be] INFO: Scrape type for 1981220: 2
2026-03-26 23:00:31 [ayvens.be] INFO: Extracting data for car ID: 1981220
2026-03-26 23:00:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ee77feb-c3bf-5ec4-9a5f-80b82c7c7453 with identifier: 1981220
2026-03-26 23:00:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ee77feb-c3bf-5ec4-9a5f-80b82c7c7453 with scrape type 2
2026-03-26 23:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1ee77feb-c3bf-5ec4-9a5f-80b82c7c7453 with scrape type 2
2026-03-26 23:00:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 1ee77feb-c3bf-5ec4-9a5f-80b82c7c7453, identifier: 1981220
2026-03-26 23:00:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 1ee77feb-c3bf-5ec4-9a5f-80b82c7c7453 with identifier: 1981220
2026-03-26 23:00:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 1ee77feb-c3bf-5ec4-9a5f-80b82c7c7453 with identifier: 1981220
2026-03-26 23:00:31 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 1ee77feb-c3bf-5ec4-9a5f-80b82c7c7453 with identifier: 1981220 to the API
2026-03-26 23:00:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:00:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:00:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '1ee77feb-c3bf-5ec4-9a5f-80b82c7c7453',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': 'EXPERT',
 'odometer': 63765,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-13',
 'seats_number': 2,
 'seller_name': None,
 'title': 'PEUGEOT EXPERT 1.5 BLUEHDI 120 S&S STANDARD PREMIUM',
 'transmission': 'manual',
 'trim': '1.5 BLUEHDI 120 S&S STANDARD PREMIUM',
 'vin': None,
 'year': 2023}
2026-03-26 23:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981220%27 HTTP/1.1" 200 None
2026-03-26 23:00:31 [ayvens.be] INFO: Saving data for 1981220: {'auction_closing_time': 1774855800.0, 'created_time': 1774392480.091277, 'last_price_update_time': 1774566031.720717}
2026-03-26 23:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981220') HTTP/1.1" 204 0
2026-03-26 23:00:31 [ayvens.be] INFO: Found listing with ID: 1981221
2026-03-26 23:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981221%27 HTTP/1.1" 200 None
2026-03-26 23:00:31 [ayvens.be] INFO: Scrape type for 1981221: 2
2026-03-26 23:00:31 [ayvens.be] INFO: Extracting data for car ID: 1981221
2026-03-26 23:00:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d63efcb-7417-5059-ac68-bf58c9cb6092 with identifier: 1981221
2026-03-26 23:00:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d63efcb-7417-5059-ac68-bf58c9cb6092 with scrape type 2
2026-03-26 23:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9d63efcb-7417-5059-ac68-bf58c9cb6092 with scrape type 2
2026-03-26 23:00:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 9d63efcb-7417-5059-ac68-bf58c9cb6092, identifier: 1981221
2026-03-26 23:00:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 9d63efcb-7417-5059-ac68-bf58c9cb6092 with identifier: 1981221
2026-03-26 23:00:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 9d63efcb-7417-5059-ac68-bf58c9cb6092 with identifier: 1981221
2026-03-26 23:00:31 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 9d63efcb-7417-5059-ac68-bf58c9cb6092 with identifier: 1981221 to the API
2026-03-26 23:00:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:00:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:00:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '9d63efcb-7417-5059-ac68-bf58c9cb6092',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 80974,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T4 PHEV INSCRIPTION EXPR. DCT',
 'transmission': 'automatic',
 'trim': '1.5 T4 PHEV INSCRIPTION EXPR. DCT',
 'vin': None,
 'year': 2022}
2026-03-26 23:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981221%27 HTTP/1.1" 200 None
2026-03-26 23:00:32 [ayvens.be] INFO: Saving data for 1981221: {'auction_closing_time': 1774855800.0, 'created_time': 1774392481.056499, 'last_price_update_time': 1774566032.133784}
2026-03-26 23:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981221') HTTP/1.1" 204 0
2026-03-26 23:00:32 [ayvens.be] INFO: Found listing with ID: 1981222
2026-03-26 23:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981222%27 HTTP/1.1" 200 None
2026-03-26 23:00:32 [ayvens.be] INFO: Scrape type for 1981222: 2
2026-03-26 23:00:32 [ayvens.be] INFO: Extracting data for car ID: 1981222
2026-03-26 23:00:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c8afef5-b3db-5cb5-89c6-a53c9ea23064 with identifier: 1981222
2026-03-26 23:00:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c8afef5-b3db-5cb5-89c6-a53c9ea23064 with scrape type 2
2026-03-26 23:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3c8afef5-b3db-5cb5-89c6-a53c9ea23064 with scrape type 2
2026-03-26 23:00:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 3c8afef5-b3db-5cb5-89c6-a53c9ea23064, identifier: 1981222
2026-03-26 23:00:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 3c8afef5-b3db-5cb5-89c6-a53c9ea23064 with identifier: 1981222
2026-03-26 23:00:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 3c8afef5-b3db-5cb5-89c6-a53c9ea23064 with identifier: 1981222
2026-03-26 23:00:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 3c8afef5-b3db-5cb5-89c6-a53c9ea23064 with identifier: 1981222 to the API
2026-03-26 23:00:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:00:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:00:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '3c8afef5-b3db-5cb5-89c6-a53c9ea23064',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'XCEED',
 'odometer': 73652,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA XCEED 1.6 GDI PHEV DCT BUSINESS LINE',
 'transmission': 'automatic',
 'trim': '1.6 GDI PHEV DCT BUSINESS LINE',
 'vin': None,
 'year': 2021}
2026-03-26 23:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981222%27 HTTP/1.1" 200 None
2026-03-26 23:00:32 [ayvens.be] INFO: Saving data for 1981222: {'auction_closing_time': 1774855800.0, 'created_time': 1774392483.082696, 'last_price_update_time': 1774566032.515909}
2026-03-26 23:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981222') HTTP/1.1" 204 0
2026-03-26 23:00:32 [ayvens.be] INFO: Found listing with ID: 1981223
2026-03-26 23:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981223%27 HTTP/1.1" 200 None
2026-03-26 23:00:32 [ayvens.be] INFO: Scrape type for 1981223: 2
2026-03-26 23:00:32 [ayvens.be] INFO: Extracting data for car ID: 1981223
2026-03-26 23:00:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d40f18b1-eb43-5300-84a5-8ae362c6f8eb with identifier: 1981223
2026-03-26 23:00:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d40f18b1-eb43-5300-84a5-8ae362c6f8eb with scrape type 2
2026-03-26 23:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d40f18b1-eb43-5300-84a5-8ae362c6f8eb with scrape type 2
2026-03-26 23:00:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d40f18b1-eb43-5300-84a5-8ae362c6f8eb, identifier: 1981223
2026-03-26 23:00:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d40f18b1-eb43-5300-84a5-8ae362c6f8eb with identifier: 1981223
2026-03-26 23:00:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d40f18b1-eb43-5300-84a5-8ae362c6f8eb with identifier: 1981223
2026-03-26 23:00:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d40f18b1-eb43-5300-84a5-8ae362c6f8eb with identifier: 1981223 to the API
2026-03-26 23:00:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:00:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:00:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'd40f18b1-eb43-5300-84a5-8ae362c6f8eb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1 - 2019',
 'odometer': 121909,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 - 2019 1.5iA xDrive25e PHEV OPF',
 'transmission': 'automatic',
 'trim': '1.5iA xDrive25e PHEV OPF',
 'vin': None,
 'year': 2021}
2026-03-26 23:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981223%27 HTTP/1.1" 200 None
2026-03-26 23:00:32 [ayvens.be] INFO: Saving data for 1981223: {'auction_closing_time': 1774855800.0, 'created_time': 1774392484.637299, 'last_price_update_time': 1774566032.99607}
2026-03-26 23:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981223') HTTP/1.1" 204 0
2026-03-26 23:00:33 [ayvens.be] INFO: Found listing with ID: 1981224
2026-03-26 23:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981224%27 HTTP/1.1" 200 None
2026-03-26 23:00:33 [ayvens.be] INFO: Scrape type for 1981224: 2
2026-03-26 23:00:33 [ayvens.be] INFO: Extracting data for car ID: 1981224
2026-03-26 23:00:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 91167241-1ce0-532b-91ad-1de2768d8ed7 with identifier: 1981224
2026-03-26 23:00:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91167241-1ce0-532b-91ad-1de2768d8ed7 with scrape type 2
2026-03-26 23:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 91167241-1ce0-532b-91ad-1de2768d8ed7 with scrape type 2
2026-03-26 23:00:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 91167241-1ce0-532b-91ad-1de2768d8ed7, identifier: 1981224
2026-03-26 23:00:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 91167241-1ce0-532b-91ad-1de2768d8ed7 with identifier: 1981224
2026-03-26 23:00:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 91167241-1ce0-532b-91ad-1de2768d8ed7 with identifier: 1981224
2026-03-26 23:00:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 91167241-1ce0-532b-91ad-1de2768d8ed7 with identifier: 1981224 to the API
2026-03-26 23:00:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:00:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:00:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '91167241-1ce0-532b-91ad-1de2768d8ed7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'OCTAVIA COMBI',
 'odometer': 97086,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA OCTAVIA COMBI 1.0 TSI 81KW AMBITION',
 'transmission': 'manual',
 'trim': '1.0 TSI 81KW AMBITION',
 'vin': None,
 'year': 2021}
2026-03-26 23:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981224%27 HTTP/1.1" 200 None
2026-03-26 23:00:33 [ayvens.be] INFO: Saving data for 1981224: {'auction_closing_time': 1774855800.0, 'created_time': 1774392487.685204, 'last_price_update_time': 1774566033.38651}
2026-03-26 23:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981224') HTTP/1.1" 204 0
2026-03-26 23:00:33 [ayvens.be] INFO: Found listing with ID: 1981225
2026-03-26 23:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981225%27 HTTP/1.1" 200 None
2026-03-26 23:00:33 [ayvens.be] INFO: Scrape type for 1981225: 2
2026-03-26 23:00:33 [ayvens.be] INFO: Extracting data for car ID: 1981225
2026-03-26 23:00:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 107c88f6-ede3-5766-9ff9-509e0ef77cd0 with identifier: 1981225
2026-03-26 23:00:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 107c88f6-ede3-5766-9ff9-509e0ef77cd0 with scrape type 2
2026-03-26 23:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 107c88f6-ede3-5766-9ff9-509e0ef77cd0 with scrape type 2
2026-03-26 23:00:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 107c88f6-ede3-5766-9ff9-509e0ef77cd0, identifier: 1981225
2026-03-26 23:00:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 107c88f6-ede3-5766-9ff9-509e0ef77cd0 with identifier: 1981225
2026-03-26 23:00:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 107c88f6-ede3-5766-9ff9-509e0ef77cd0 with identifier: 1981225
2026-03-26 23:00:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 107c88f6-ede3-5766-9ff9-509e0ef77cd0 with identifier: 1981225 to the API
2026-03-26 23:00:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:00:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:00:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '107c88f6-ede3-5766-9ff9-509e0ef77cd0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 79160,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 2.0 XDRIVE20I AUTO 4WD',
 'transmission': 'automatic',
 'trim': '2.0 XDRIVE20I AUTO 4WD',
 'vin': None,
 'year': 2022}
2026-03-26 23:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981225%27 HTTP/1.1" 200 None
2026-03-26 23:00:33 [ayvens.be] INFO: Saving data for 1981225: {'auction_closing_time': 1774855800.0, 'created_time': 1774392491.442542, 'last_price_update_time': 1774566033.77532}
2026-03-26 23:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981225') HTTP/1.1" 204 0
2026-03-26 23:00:33 [ayvens.be] INFO: Found listing with ID: 1981226
2026-03-26 23:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981226%27 HTTP/1.1" 200 None
2026-03-26 23:00:33 [ayvens.be] INFO: Scrape type for 1981226: 2
2026-03-26 23:00:33 [ayvens.be] INFO: Extracting data for car ID: 1981226
2026-03-26 23:00:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 490c4e0d-78be-583b-a19e-db898b47043b with identifier: 1981226
2026-03-26 23:00:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 490c4e0d-78be-583b-a19e-db898b47043b with scrape type 2
2026-03-26 23:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 490c4e0d-78be-583b-a19e-db898b47043b with scrape type 2
2026-03-26 23:00:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 490c4e0d-78be-583b-a19e-db898b47043b, identifier: 1981226
2026-03-26 23:00:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 490c4e0d-78be-583b-a19e-db898b47043b with identifier: 1981226
2026-03-26 23:00:33 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 23:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 23:00:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 490c4e0d-78be-583b-a19e-db898b47043b with identifier: 1981226
2026-03-26 23:00:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 490c4e0d-78be-583b-a19e-db898b47043b with identifier: 1981226 to the API
2026-03-26 23:00:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:00:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:00:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '490c4e0d-78be-583b-a19e-db898b47043b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'Passat',
 'odometer': 218512,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN Passat 1.6 CR TDi Comfortline Business DSG STOCK',
 'transmission': 'automatic',
 'trim': '1.6 CR TDi Comfortline Business DSG STOCK',
 'vin': None,
 'year': 2019}
2026-03-26 23:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981226%27 HTTP/1.1" 200 None
2026-03-26 23:00:34 [ayvens.be] INFO: Saving data for 1981226: {'auction_closing_time': 1774855800.0, 'created_time': 1774392492.46014, 'last_price_update_time': 1774566034.17816}
2026-03-26 23:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981226') HTTP/1.1" 204 0
2026-03-26 23:00:34 [ayvens.be] INFO: Found listing with ID: 1978467
2026-03-26 23:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978467%27 HTTP/1.1" 200 None
2026-03-26 23:00:34 [ayvens.be] INFO: Scrape type for 1978467: 2
2026-03-26 23:00:34 [ayvens.be] INFO: Extracting data for car ID: 1978467
2026-03-26 23:00:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d0e3722-8fdf-5a4b-bc93-12c345f69aab with identifier: 1978467
2026-03-26 23:00:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d0e3722-8fdf-5a4b-bc93-12c345f69aab with scrape type 2
2026-03-26 23:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2d0e3722-8fdf-5a4b-bc93-12c345f69aab with scrape type 2
2026-03-26 23:00:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 2d0e3722-8fdf-5a4b-bc93-12c345f69aab, identifier: 1978467
2026-03-26 23:00:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 2d0e3722-8fdf-5a4b-bc93-12c345f69aab with identifier: 1978467
2026-03-26 23:00:34 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 23:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 23:00:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 2d0e3722-8fdf-5a4b-bc93-12c345f69aab with identifier: 1978467
2026-03-26 23:00:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 2d0e3722-8fdf-5a4b-bc93-12c345f69aab with identifier: 1978467 to the API
2026-03-26 23:00:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:00:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:00:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 97,
 'color': 'MOONDUST SILVER',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'petrol',
 'id': '2d0e3722-8fdf-5a4b-bc93-12c345f69aab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'FOCUS - 2018',
 'odometer': 91431,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD FOCUS - 2018 1.0 EcoBoost ST-Line Business Winter',
 'transmission': 'manual',
 'trim': '1.0 EcoBoost ST-Line Business Winter',
 'vin': None,
 'year': 2020}
2026-03-26 23:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978467%27 HTTP/1.1" 200 None
2026-03-26 23:00:34 [ayvens.be] INFO: Saving data for 1978467: {'auction_closing_time': 1774854000.0, 'created_time': 1774305925.581173, 'last_price_update_time': 1774566034.582654}
2026-03-26 23:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978467') HTTP/1.1" 204 0
2026-03-26 23:00:34 [ayvens.be] INFO: Found listing with ID: 1978468
2026-03-26 23:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978468%27 HTTP/1.1" 200 None
2026-03-26 23:00:34 [ayvens.be] INFO: Scrape type for 1978468: 2
2026-03-26 23:00:34 [ayvens.be] INFO: Extracting data for car ID: 1978468
2026-03-26 23:00:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fcbbd5ce-3466-53ba-b6a6-629a539f7f4c with identifier: 1978468
2026-03-26 23:00:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fcbbd5ce-3466-53ba-b6a6-629a539f7f4c with scrape type 2
2026-03-26 23:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fcbbd5ce-3466-53ba-b6a6-629a539f7f4c with scrape type 2
2026-03-26 23:00:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: fcbbd5ce-3466-53ba-b6a6-629a539f7f4c, identifier: 1978468
2026-03-26 23:00:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: fcbbd5ce-3466-53ba-b6a6-629a539f7f4c with identifier: 1978468
2026-03-26 23:00:34 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 23:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 23:00:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: fcbbd5ce-3466-53ba-b6a6-629a539f7f4c with identifier: 1978468
2026-03-26 23:00:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: fcbbd5ce-3466-53ba-b6a6-629a539f7f4c with identifier: 1978468 to the API
2026-03-26 23:00:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:00:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:00:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'color': 'BLEU BOUTASQUE',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'petrol',
 'id': 'fcbbd5ce-3466-53ba-b6a6-629a539f7f4c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '5008 - 2017',
 'odometer': 112390,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-14',
 'seats_number': 7,
 'seller_name': None,
 'title': 'PEUGEOT 5008 - 2017 1.2 PureTech Allure (EU6.2)',
 'transmission': 'automatic',
 'trim': '1.2 PureTech Allure (EU6.2)',
 'vin': None,
 'year': 2019}
2026-03-26 23:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978468%27 HTTP/1.1" 200 None
2026-03-26 23:00:34 [ayvens.be] INFO: Saving data for 1978468: {'auction_closing_time': 1774854000.0, 'created_time': 1774305929.210301, 'last_price_update_time': 1774566034.990994}
2026-03-26 23:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978468') HTTP/1.1" 204 0
2026-03-26 23:00:35 [ayvens.be] INFO: Found listing with ID: 1978469
2026-03-26 23:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978469%27 HTTP/1.1" 200 None
2026-03-26 23:00:35 [ayvens.be] INFO: Scrape type for 1978469: 2
2026-03-26 23:00:35 [ayvens.be] INFO: Extracting data for car ID: 1978469
2026-03-26 23:00:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f79cc47e-5142-5c31-ba8a-5fe779924ecb with identifier: 1978469
2026-03-26 23:00:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f79cc47e-5142-5c31-ba8a-5fe779924ecb with scrape type 2
2026-03-26 23:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f79cc47e-5142-5c31-ba8a-5fe779924ecb with scrape type 2
2026-03-26 23:00:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f79cc47e-5142-5c31-ba8a-5fe779924ecb, identifier: 1978469
2026-03-26 23:00:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f79cc47e-5142-5c31-ba8a-5fe779924ecb with identifier: 1978469
2026-03-26 23:00:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f79cc47e-5142-5c31-ba8a-5fe779924ecb with identifier: 1978469
2026-03-26 23:00:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f79cc47e-5142-5c31-ba8a-5fe779924ecb with identifier: 1978469 to the API
2026-03-26 23:00:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:00:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:00:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 98,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': 'f79cc47e-5142-5c31-ba8a-5fe779924ecb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A3 SEDAN DIESEL - 2020',
 'odometer': 57850,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A3 SEDAN DIESEL - 2020 35 TDi S line S tronic',
 'transmission': 'automatic',
 'trim': '35 TDi S line S tronic',
 'vin': None,
 'year': 2020}
2026-03-26 23:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978469%27 HTTP/1.1" 200 None
2026-03-26 23:00:35 [ayvens.be] INFO: Saving data for 1978469: {'auction_closing_time': 1774854000.0, 'created_time': 1774305928.180435, 'last_price_update_time': 1774566035.397118}
2026-03-26 23:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978469') HTTP/1.1" 204 0
2026-03-26 23:00:35 [ayvens.be] INFO: Found listing with ID: 1978470
2026-03-26 23:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978470%27 HTTP/1.1" 200 None
2026-03-26 23:00:35 [ayvens.be] INFO: Scrape type for 1978470: 2
2026-03-26 23:00:35 [ayvens.be] INFO: Extracting data for car ID: 1978470
2026-03-26 23:00:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30fcdcad-20a5-54b7-a6bd-ebd58bdc4301 with identifier: 1978470
2026-03-26 23:00:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30fcdcad-20a5-54b7-a6bd-ebd58bdc4301 with scrape type 2
2026-03-26 23:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 30fcdcad-20a5-54b7-a6bd-ebd58bdc4301 with scrape type 2
2026-03-26 23:00:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 30fcdcad-20a5-54b7-a6bd-ebd58bdc4301, identifier: 1978470
2026-03-26 23:00:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 30fcdcad-20a5-54b7-a6bd-ebd58bdc4301 with identifier: 1978470
2026-03-26 23:00:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 30fcdcad-20a5-54b7-a6bd-ebd58bdc4301 with identifier: 1978470
2026-03-26 23:00:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 30fcdcad-20a5-54b7-a6bd-ebd58bdc4301 with identifier: 1978470 to the API
2026-03-26 23:00:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:00:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:00:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 160,
 'color': 'BLANC',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '30fcdcad-20a5-54b7-a6bd-ebd58bdc4301',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'FIAT',
 'model': 'DUCATO 35 FOURGON LWB DSL - 20',
 'odometer': 116151,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-11',
 'seats_number': None,
 'seller_name': None,
 'title': 'FIAT DUCATO 35 FOURGON LWB DSL - 20 2.0 Mjet L3H2 (EU6)',
 'transmission': 'manual',
 'trim': '2.0 Mjet L3H2 (EU6)',
 'vin': None,
 'year': 2018}
2026-03-26 23:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978470%27 HTTP/1.1" 200 None
2026-03-26 23:00:35 [ayvens.be] INFO: Saving data for 1978470: {'auction_closing_time': 1774854000.0, 'created_time': 1774305930.007406, 'last_price_update_time': 1774566035.771492}
2026-03-26 23:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978470') HTTP/1.1" 204 0
2026-03-26 23:00:35 [ayvens.be] INFO: Found listing with ID: 1978471
2026-03-26 23:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978471%27 HTTP/1.1" 200 None
2026-03-26 23:00:35 [ayvens.be] INFO: Scrape type for 1978471: 2
2026-03-26 23:00:35 [ayvens.be] INFO: Extracting data for car ID: 1978471
2026-03-26 23:00:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dbb8849a-6dd2-5d69-9764-d04ef9128f8f with identifier: 1978471
2026-03-26 23:00:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dbb8849a-6dd2-5d69-9764-d04ef9128f8f with scrape type 2
2026-03-26 23:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dbb8849a-6dd2-5d69-9764-d04ef9128f8f with scrape type 2
2026-03-26 23:00:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: dbb8849a-6dd2-5d69-9764-d04ef9128f8f, identifier: 1978471
2026-03-26 23:00:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: dbb8849a-6dd2-5d69-9764-d04ef9128f8f with identifier: 1978471
2026-03-26 23:00:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: dbb8849a-6dd2-5d69-9764-d04ef9128f8f with identifier: 1978471
2026-03-26 23:00:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: dbb8849a-6dd2-5d69-9764-d04ef9128f8f with identifier: 1978471 to the API
2026-03-26 23:00:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:00:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:00:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'petrol',
 'id': 'dbb8849a-6dd2-5d69-9764-d04ef9128f8f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A4 AVANT - 2020',
 'odometer': 70409,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A4 AVANT - 2020 35 TFSI S tronic',
 'transmission': 'automatic',
 'trim': '35 TFSI S tronic',
 'vin': None,
 'year': 2019}
2026-03-26 23:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978471%27 HTTP/1.1" 200 None
2026-03-26 23:00:36 [ayvens.be] INFO: Saving data for 1978471: {'auction_closing_time': 1774854000.0, 'created_time': 1774305931.892437, 'last_price_update_time': 1774566036.176958}
2026-03-26 23:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978471') HTTP/1.1" 204 0
2026-03-26 23:00:36 [ayvens.be] INFO: Found listing with ID: 1978472
2026-03-26 23:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978472%27 HTTP/1.1" 200 None
2026-03-26 23:00:36 [ayvens.be] INFO: Scrape type for 1978472: 2
2026-03-26 23:00:36 [ayvens.be] INFO: Extracting data for car ID: 1978472
2026-03-26 23:00:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 809bf565-ad99-5a94-b968-77e20618ac73 with identifier: 1978472
2026-03-26 23:00:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 809bf565-ad99-5a94-b968-77e20618ac73 with scrape type 2
2026-03-26 23:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 809bf565-ad99-5a94-b968-77e20618ac73 with scrape type 2
2026-03-26 23:00:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 809bf565-ad99-5a94-b968-77e20618ac73, identifier: 1978472
2026-03-26 23:00:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 809bf565-ad99-5a94-b968-77e20618ac73 with identifier: 1978472
2026-03-26 23:00:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 809bf565-ad99-5a94-b968-77e20618ac73 with identifier: 1978472
2026-03-26 23:00:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 809bf565-ad99-5a94-b968-77e20618ac73 with identifier: 1978472 to the API
2026-03-26 23:00:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:00:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:00:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '809bf565-ad99-5a94-b968-77e20618ac73',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'SPORTAGE',
 'odometer': 47854,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA SPORTAGE 1.6 CRDI 136 MHEV BUSINESS LINE DCT',
 'transmission': 'automatic',
 'trim': '1.6 CRDI 136 MHEV BUSINESS LINE DCT',
 'vin': None,
 'year': 2021}
2026-03-26 23:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978472%27 HTTP/1.1" 200 None
2026-03-26 23:00:36 [ayvens.be] INFO: Saving data for 1978472: {'auction_closing_time': 1774854000.0, 'created_time': 1774305933.047169, 'last_price_update_time': 1774566036.569066}
2026-03-26 23:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978472') HTTP/1.1" 204 0
2026-03-26 23:00:36 [ayvens.be] INFO: Found listing with ID: 1978473
2026-03-26 23:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978473%27 HTTP/1.1" 200 None
2026-03-26 23:00:36 [ayvens.be] INFO: Scrape type for 1978473: 2
2026-03-26 23:00:36 [ayvens.be] INFO: Extracting data for car ID: 1978473
2026-03-26 23:00:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aa21bee0-3dc1-5a55-90e0-bcd5cce74cb5 with identifier: 1978473
2026-03-26 23:00:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa21bee0-3dc1-5a55-90e0-bcd5cce74cb5 with scrape type 2
2026-03-26 23:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aa21bee0-3dc1-5a55-90e0-bcd5cce74cb5 with scrape type 2
2026-03-26 23:00:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: aa21bee0-3dc1-5a55-90e0-bcd5cce74cb5, identifier: 1978473
2026-03-26 23:00:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: aa21bee0-3dc1-5a55-90e0-bcd5cce74cb5 with identifier: 1978473
2026-03-26 23:00:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: aa21bee0-3dc1-5a55-90e0-bcd5cce74cb5 with identifier: 1978473
2026-03-26 23:00:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: aa21bee0-3dc1-5a55-90e0-bcd5cce74cb5 with identifier: 1978473 to the API
2026-03-26 23:00:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:00:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:00:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'petrol',
 'id': 'aa21bee0-3dc1-5a55-90e0-bcd5cce74cb5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'CLIO',
 'odometer': 65370,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT CLIO 1.0 TCE 90 EVOLUTION',
 'transmission': 'manual',
 'trim': '1.0 TCE 90 EVOLUTION',
 'vin': None,
 'year': 2022}
2026-03-26 23:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978473%27 HTTP/1.1" 200 None
2026-03-26 23:00:36 [ayvens.be] INFO: Saving data for 1978473: {'auction_closing_time': 1774854000.0, 'created_time': 1774305934.763122, 'last_price_update_time': 1774566036.951617}
2026-03-26 23:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978473') HTTP/1.1" 204 0
2026-03-26 23:00:37 [ayvens.be] INFO: Found listing with ID: 1978474
2026-03-26 23:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978474%27 HTTP/1.1" 200 None
2026-03-26 23:00:37 [ayvens.be] INFO: Scrape type for 1978474: 2
2026-03-26 23:00:37 [ayvens.be] INFO: Extracting data for car ID: 1978474
2026-03-26 23:00:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 896ef9b3-abd7-55d8-baba-f01b99006ee0 with identifier: 1978474
2026-03-26 23:00:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 896ef9b3-abd7-55d8-baba-f01b99006ee0 with scrape type 2
2026-03-26 23:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 896ef9b3-abd7-55d8-baba-f01b99006ee0 with scrape type 2
2026-03-26 23:00:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 896ef9b3-abd7-55d8-baba-f01b99006ee0, identifier: 1978474
2026-03-26 23:00:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 896ef9b3-abd7-55d8-baba-f01b99006ee0 with identifier: 1978474
2026-03-26 23:00:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 896ef9b3-abd7-55d8-baba-f01b99006ee0 with identifier: 1978474
2026-03-26 23:00:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 896ef9b3-abd7-55d8-baba-f01b99006ee0 with identifier: 1978474 to the API
2026-03-26 23:00:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:00:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:00:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '896ef9b3-abd7-55d8-baba-f01b99006ee0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q5 SPORTBACK',
 'odometer': 210743,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q5 SPORTBACK 2.0 35 TDI S TRONIC BUS.ED.ADV.',
 'transmission': 'automatic',
 'trim': '2.0 35 TDI S TRONIC BUS.ED.ADV.',
 'vin': None,
 'year': 2021}
2026-03-26 23:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978474%27 HTTP/1.1" 200 None
2026-03-26 23:00:37 [ayvens.be] INFO: Saving data for 1978474: {'auction_closing_time': 1774854000.0, 'created_time': 1774305936.608962, 'last_price_update_time': 1774566037.44518}
2026-03-26 23:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978474') HTTP/1.1" 204 0
2026-03-26 23:00:37 [ayvens.be] INFO: Found listing with ID: 1978475
2026-03-26 23:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978475%27 HTTP/1.1" 200 None
2026-03-26 23:00:37 [ayvens.be] INFO: Scrape type for 1978475: 2
2026-03-26 23:00:37 [ayvens.be] INFO: Extracting data for car ID: 1978475
2026-03-26 23:00:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 606ca47f-f13e-5794-8919-5c666f0653e3 with identifier: 1978475
2026-03-26 23:00:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 606ca47f-f13e-5794-8919-5c666f0653e3 with scrape type 2
2026-03-26 23:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 606ca47f-f13e-5794-8919-5c666f0653e3 with scrape type 2
2026-03-26 23:00:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 606ca47f-f13e-5794-8919-5c666f0653e3, identifier: 1978475
2026-03-26 23:00:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 606ca47f-f13e-5794-8919-5c666f0653e3 with identifier: 1978475
2026-03-26 23:00:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 606ca47f-f13e-5794-8919-5c666f0653e3 with identifier: 1978475
2026-03-26 23:00:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 606ca47f-f13e-5794-8919-5c666f0653e3 with identifier: 1978475 to the API
2026-03-26 23:00:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:00:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:00:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '606ca47f-f13e-5794-8919-5c666f0653e3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'CITROAu2039N',
 'model': 'C4',
 'odometer': 148256,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROAu2039N C4 1.5 BLUEHDI 130 S&S SHINE AUTO',
 'transmission': 'automatic',
 'trim': '1.5 BLUEHDI 130 S&S SHINE AUTO',
 'vin': None,
 'year': 2022}
2026-03-26 23:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978475%27 HTTP/1.1" 200 None
2026-03-26 23:00:37 [ayvens.be] INFO: Saving data for 1978475: {'auction_closing_time': 1774854000.0, 'created_time': 1774305938.424594, 'last_price_update_time': 1774566037.82327}
2026-03-26 23:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978475') HTTP/1.1" 204 0
2026-03-26 23:00:37 [ayvens.be] INFO: Found listing with ID: 1978476
2026-03-26 23:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978476%27 HTTP/1.1" 200 None
2026-03-26 23:00:37 [ayvens.be] INFO: Scrape type for 1978476: 2
2026-03-26 23:00:37 [ayvens.be] INFO: Extracting data for car ID: 1978476
2026-03-26 23:00:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8303c6eb-cc26-557c-b7c8-1758d5f61559 with identifier: 1978476
2026-03-26 23:00:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8303c6eb-cc26-557c-b7c8-1758d5f61559 with scrape type 2
2026-03-26 23:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8303c6eb-cc26-557c-b7c8-1758d5f61559 with scrape type 2
2026-03-26 23:00:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 8303c6eb-cc26-557c-b7c8-1758d5f61559, identifier: 1978476
2026-03-26 23:00:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 8303c6eb-cc26-557c-b7c8-1758d5f61559 with identifier: 1978476
2026-03-26 23:00:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 8303c6eb-cc26-557c-b7c8-1758d5f61559 with identifier: 1978476
2026-03-26 23:00:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 8303c6eb-cc26-557c-b7c8-1758d5f61559 with identifier: 1978476 to the API
2026-03-26 23:00:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:00:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:00:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '8303c6eb-cc26-557c-b7c8-1758d5f61559',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 252773,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 1.5 SDRIVE16D',
 'transmission': 'manual',
 'trim': '1.5 SDRIVE16D',
 'vin': None,
 'year': 2021}
2026-03-26 23:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978476%27 HTTP/1.1" 200 None
2026-03-26 23:00:38 [ayvens.be] INFO: Saving data for 1978476: {'auction_closing_time': 1774854000.0, 'created_time': 1774305940.149589, 'last_price_update_time': 1774566038.253751}
2026-03-26 23:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978476') HTTP/1.1" 204 0
2026-03-26 23:00:38 [ayvens.be] INFO: Found listing with ID: 1978477
2026-03-26 23:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978477%27 HTTP/1.1" 200 None
2026-03-26 23:00:38 [ayvens.be] INFO: Scrape type for 1978477: 2
2026-03-26 23:00:38 [ayvens.be] INFO: Extracting data for car ID: 1978477
2026-03-26 23:00:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f10caeb8-09ba-5c58-a982-0d21ea9ebaea with identifier: 1978477
2026-03-26 23:00:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f10caeb8-09ba-5c58-a982-0d21ea9ebaea with scrape type 2
2026-03-26 23:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f10caeb8-09ba-5c58-a982-0d21ea9ebaea with scrape type 2
2026-03-26 23:00:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f10caeb8-09ba-5c58-a982-0d21ea9ebaea, identifier: 1978477
2026-03-26 23:00:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f10caeb8-09ba-5c58-a982-0d21ea9ebaea with identifier: 1978477
2026-03-26 23:00:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f10caeb8-09ba-5c58-a982-0d21ea9ebaea with identifier: 1978477
2026-03-26 23:00:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f10caeb8-09ba-5c58-a982-0d21ea9ebaea with identifier: 1978477 to the API
2026-03-26 23:00:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:00:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:00:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': 'f10caeb8-09ba-5c58-a982-0d21ea9ebaea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS MAXI DIESEL',
 'odometer': 40529,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-20',
 'seats_number': None,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS MAXI DIESEL Lot 1.3 RENAULT KANGOO EXPRESS '
          'Maxi 1.5 dCi Blue Confort',
 'transmission': 'manual',
 'trim': 'Lot 1.3 RENAULT KANGOO EXPRESS Maxi 1.5 dCi Blue Confort',
 'vin': None,
 'year': 2020}
2026-03-26 23:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978477%27 HTTP/1.1" 200 None
2026-03-26 23:00:38 [ayvens.be] INFO: Saving data for 1978477: {'auction_closing_time': 1774854000.0, 'created_time': 1774305941.620308, 'last_price_update_time': 1774566038.647228}
2026-03-26 23:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978477') HTTP/1.1" 204 0
2026-03-26 23:00:38 [ayvens.be] INFO: Found listing with ID: 1978478
2026-03-26 23:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978478%27 HTTP/1.1" 200 None
2026-03-26 23:00:38 [ayvens.be] INFO: Scrape type for 1978478: 2
2026-03-26 23:00:38 [ayvens.be] INFO: Extracting data for car ID: 1978478
2026-03-26 23:00:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0a9dda7-405b-5886-9d69-96d02d20f488 with identifier: 1978478
2026-03-26 23:00:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0a9dda7-405b-5886-9d69-96d02d20f488 with scrape type 2
2026-03-26 23:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c0a9dda7-405b-5886-9d69-96d02d20f488 with scrape type 2
2026-03-26 23:00:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c0a9dda7-405b-5886-9d69-96d02d20f488, identifier: 1978478
2026-03-26 23:00:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c0a9dda7-405b-5886-9d69-96d02d20f488 with identifier: 1978478
2026-03-26 23:00:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c0a9dda7-405b-5886-9d69-96d02d20f488 with identifier: 1978478
2026-03-26 23:00:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c0a9dda7-405b-5886-9d69-96d02d20f488 with identifier: 1978478 to the API
2026-03-26 23:00:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:00:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:00:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': 'c0a9dda7-405b-5886-9d69-96d02d20f488',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A6 AVANT',
 'odometer': 87601,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A6 AVANT 2.0 TDI 35 S TRONIC BUSINESS EDITION',
 'transmission': 'automatic',
 'trim': '2.0 TDI 35 S TRONIC BUSINESS EDITION',
 'vin': None,
 'year': 2021}
2026-03-26 23:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978478%27 HTTP/1.1" 200 None
2026-03-26 23:00:39 [ayvens.be] INFO: Saving data for 1978478: {'auction_closing_time': 1774854000.0, 'created_time': 1774305943.707778, 'last_price_update_time': 1774566039.044959}
2026-03-26 23:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978478') HTTP/1.1" 204 0
2026-03-26 23:00:39 [ayvens.be] INFO: Found listing with ID: 1978479
2026-03-26 23:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978479%27 HTTP/1.1" 200 None
2026-03-26 23:00:39 [ayvens.be] INFO: Scrape type for 1978479: 2
2026-03-26 23:00:39 [ayvens.be] INFO: Extracting data for car ID: 1978479
2026-03-26 23:00:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cfb7fe50-46a0-518d-a563-078b2e772404 with identifier: 1978479
2026-03-26 23:00:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cfb7fe50-46a0-518d-a563-078b2e772404 with scrape type 2
2026-03-26 23:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cfb7fe50-46a0-518d-a563-078b2e772404 with scrape type 2
2026-03-26 23:00:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: cfb7fe50-46a0-518d-a563-078b2e772404, identifier: 1978479
2026-03-26 23:00:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: cfb7fe50-46a0-518d-a563-078b2e772404 with identifier: 1978479
2026-03-26 23:00:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: cfb7fe50-46a0-518d-a563-078b2e772404 with identifier: 1978479
2026-03-26 23:00:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: cfb7fe50-46a0-518d-a563-078b2e772404 with identifier: 1978479 to the API
2026-03-26 23:00:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:00:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:00:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.3L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'petrol',
 'id': 'cfb7fe50-46a0-518d-a563-078b2e772404',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLA',
 'odometer': 121907,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLA 1.3 CLA 250 E BUSINESS SOLUTION DCT',
 'transmission': 'automatic',
 'trim': '1.3 CLA 250 E BUSINESS SOLUTION DCT',
 'vin': None,
 'year': 2022}
2026-03-26 23:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978479%27 HTTP/1.1" 200 None
2026-03-26 23:00:39 [ayvens.be] INFO: Saving data for 1978479: {'auction_closing_time': 1774854000.0, 'created_time': 1774305945.941173, 'last_price_update_time': 1774566039.435486}
2026-03-26 23:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978479') HTTP/1.1" 204 0
2026-03-26 23:00:39 [ayvens.be] INFO: Found listing with ID: 1978480
2026-03-26 23:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978480%27 HTTP/1.1" 200 None
2026-03-26 23:00:39 [ayvens.be] INFO: Scrape type for 1978480: 2
2026-03-26 23:00:39 [ayvens.be] INFO: Extracting data for car ID: 1978480
2026-03-26 23:00:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43f5599f-eec1-560c-89df-9f0e076c42f2 with identifier: 1978480
2026-03-26 23:00:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43f5599f-eec1-560c-89df-9f0e076c42f2 with scrape type 2
2026-03-26 23:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 43f5599f-eec1-560c-89df-9f0e076c42f2 with scrape type 2
2026-03-26 23:00:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 43f5599f-eec1-560c-89df-9f0e076c42f2, identifier: 1978480
2026-03-26 23:00:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 43f5599f-eec1-560c-89df-9f0e076c42f2 with identifier: 1978480
2026-03-26 23:00:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 43f5599f-eec1-560c-89df-9f0e076c42f2 with identifier: 1978480
2026-03-26 23:00:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 43f5599f-eec1-560c-89df-9f0e076c42f2 with identifier: 1978480 to the API
2026-03-26 23:00:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:00:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:00:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'petrol',
 'id': '43f5599f-eec1-560c-89df-9f0e076c42f2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3 SPORTBACK',
 'odometer': 61067,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 SPORTBACK 1.4 45 TFSI E S TRONIC',
 'transmission': 'automatic',
 'trim': '1.4 45 TFSI E S TRONIC',
 'vin': None,
 'year': 2022}
2026-03-26 23:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978480%27 HTTP/1.1" 200 None
2026-03-26 23:00:39 [ayvens.be] INFO: Saving data for 1978480: {'auction_closing_time': 1774854000.0, 'created_time': 1774305948.115122, 'last_price_update_time': 1774566039.806956}
2026-03-26 23:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978480') HTTP/1.1" 204 0
2026-03-26 23:00:39 [ayvens.be] INFO: Found listing with ID: 1978481
2026-03-26 23:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978481%27 HTTP/1.1" 200 None
2026-03-26 23:00:39 [ayvens.be] INFO: Scrape type for 1978481: 2
2026-03-26 23:00:39 [ayvens.be] INFO: Extracting data for car ID: 1978481
2026-03-26 23:00:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36c3b6e2-0c48-590c-ba3d-0250e1b9d928 with identifier: 1978481
2026-03-26 23:00:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36c3b6e2-0c48-590c-ba3d-0250e1b9d928 with scrape type 2
2026-03-26 23:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 36c3b6e2-0c48-590c-ba3d-0250e1b9d928 with scrape type 2
2026-03-26 23:00:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 36c3b6e2-0c48-590c-ba3d-0250e1b9d928, identifier: 1978481
2026-03-26 23:00:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 36c3b6e2-0c48-590c-ba3d-0250e1b9d928 with identifier: 1978481
2026-03-26 23:00:39 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 23:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 23:00:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 36c3b6e2-0c48-590c-ba3d-0250e1b9d928 with identifier: 1978481
2026-03-26 23:00:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 36c3b6e2-0c48-590c-ba3d-0250e1b9d928 with identifier: 1978481 to the API
2026-03-26 23:00:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:00:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:00:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'IJSWIT',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '36c3b6e2-0c48-590c-ba3d-0250e1b9d928',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS MAXI DSL - 2013',
 'odometer': 211793,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-20',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS MAXI DSL - 2013 1.5 dCi Energy Grand Confort',
 'transmission': 'manual',
 'trim': '1.5 dCi Energy Grand Confort',
 'vin': None,
 'year': 2018}
2026-03-26 23:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978481%27 HTTP/1.1" 200 None
2026-03-26 23:00:40 [ayvens.be] INFO: Saving data for 1978481: {'auction_closing_time': 1774854000.0, 'created_time': 1774305949.317347, 'last_price_update_time': 1774566040.205389}
2026-03-26 23:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978481') HTTP/1.1" 204 0
2026-03-26 23:00:40 [ayvens.be] INFO: Found listing with ID: 1978482
2026-03-26 23:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978482%27 HTTP/1.1" 200 None
2026-03-26 23:00:40 [ayvens.be] INFO: Scrape type for 1978482: 2
2026-03-26 23:00:40 [ayvens.be] INFO: Extracting data for car ID: 1978482
2026-03-26 23:00:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6be95bf-6e0a-5d91-b5bd-437f53dde13f with identifier: 1978482
2026-03-26 23:00:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6be95bf-6e0a-5d91-b5bd-437f53dde13f with scrape type 2
2026-03-26 23:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e6be95bf-6e0a-5d91-b5bd-437f53dde13f with scrape type 2
2026-03-26 23:00:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e6be95bf-6e0a-5d91-b5bd-437f53dde13f, identifier: 1978482
2026-03-26 23:00:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e6be95bf-6e0a-5d91-b5bd-437f53dde13f with identifier: 1978482
2026-03-26 23:00:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e6be95bf-6e0a-5d91-b5bd-437f53dde13f with identifier: 1978482
2026-03-26 23:00:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e6be95bf-6e0a-5d91-b5bd-437f53dde13f with identifier: 1978482 to the API
2026-03-26 23:00:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:00:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:00:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': 'e6be95bf-6e0a-5d91-b5bd-437f53dde13f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT 2T 350M FOU MWB HR DSL',
 'odometer': 166861,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-17',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FORD TRANSIT 2T 350M FOU MWB HR DSL 2.0 TDCi L2H2 Trend STOCK',
 'transmission': 'manual',
 'trim': '2.0 TDCi L2H2 Trend STOCK',
 'vin': None,
 'year': 2018}
2026-03-26 23:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978482%27 HTTP/1.1" 200 None
2026-03-26 23:00:40 [ayvens.be] INFO: Saving data for 1978482: {'auction_closing_time': 1774854000.0, 'created_time': 1774305952.067454, 'last_price_update_time': 1774566040.589395}
2026-03-26 23:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978482') HTTP/1.1" 204 0
2026-03-26 23:00:40 [ayvens.be] INFO: Found listing with ID: 1978483
2026-03-26 23:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978483%27 HTTP/1.1" 200 None
2026-03-26 23:00:40 [ayvens.be] INFO: Scrape type for 1978483: 2
2026-03-26 23:00:40 [ayvens.be] INFO: Extracting data for car ID: 1978483
2026-03-26 23:00:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 51d90862-96e7-5f12-9a7a-52f62015120b with identifier: 1978483
2026-03-26 23:00:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 51d90862-96e7-5f12-9a7a-52f62015120b with scrape type 2
2026-03-26 23:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 51d90862-96e7-5f12-9a7a-52f62015120b with scrape type 2
2026-03-26 23:00:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 51d90862-96e7-5f12-9a7a-52f62015120b, identifier: 1978483
2026-03-26 23:00:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 51d90862-96e7-5f12-9a7a-52f62015120b with identifier: 1978483
2026-03-26 23:00:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 51d90862-96e7-5f12-9a7a-52f62015120b with identifier: 1978483
2026-03-26 23:00:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 51d90862-96e7-5f12-9a7a-52f62015120b with identifier: 1978483 to the API
2026-03-26 23:00:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:00:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:00:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '51d90862-96e7-5f12-9a7a-52f62015120b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 173398,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 1.5 BLUEHDI S&S EAT8 ALLURE PACK',
 'transmission': 'automatic',
 'trim': '1.5 BLUEHDI S&S EAT8 ALLURE PACK',
 'vin': None,
 'year': 2022}
2026-03-26 23:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978483%27 HTTP/1.1" 200 None
2026-03-26 23:00:40 [ayvens.be] INFO: Saving data for 1978483: {'auction_closing_time': 1774854000.0, 'created_time': 1774305953.430147, 'last_price_update_time': 1774566040.968086}
2026-03-26 23:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978483') HTTP/1.1" 204 0
2026-03-26 23:00:40 [ayvens.be] INFO: Found listing with ID: 1978484
2026-03-26 23:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978484%27 HTTP/1.1" 200 None
2026-03-26 23:00:41 [ayvens.be] INFO: Scrape type for 1978484: 2
2026-03-26 23:00:41 [ayvens.be] INFO: Extracting data for car ID: 1978484
2026-03-26 23:00:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 21561285-2e69-59fd-90f0-2bc2813b1502 with identifier: 1978484
2026-03-26 23:00:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21561285-2e69-59fd-90f0-2bc2813b1502 with scrape type 2
2026-03-26 23:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 21561285-2e69-59fd-90f0-2bc2813b1502 with scrape type 2
2026-03-26 23:00:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 21561285-2e69-59fd-90f0-2bc2813b1502, identifier: 1978484
2026-03-26 23:00:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 21561285-2e69-59fd-90f0-2bc2813b1502 with identifier: 1978484
2026-03-26 23:00:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 21561285-2e69-59fd-90f0-2bc2813b1502 with identifier: 1978484
2026-03-26 23:00:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 21561285-2e69-59fd-90f0-2bc2813b1502 with identifier: 1978484 to the API
2026-03-26 23:00:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:00:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:00:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '21561285-2e69-59fd-90f0-2bc2813b1502',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': 'RIFTER',
 'odometer': 158748,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT RIFTER 1.5 BLUEHDI 75KW S-S ACTIVE',
 'transmission': 'manual',
 'trim': '1.5 BLUEHDI 75KW S-S ACTIVE',
 'vin': None,
 'year': 2020}
2026-03-26 23:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978484%27 HTTP/1.1" 200 None
2026-03-26 23:00:41 [ayvens.be] INFO: Saving data for 1978484: {'auction_closing_time': 1774854000.0, 'created_time': 1774305955.090734, 'last_price_update_time': 1774566041.376791}
2026-03-26 23:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978484') HTTP/1.1" 204 0
2026-03-26 23:00:41 [ayvens.be] INFO: Found listing with ID: 1978485
2026-03-26 23:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978485%27 HTTP/1.1" 200 None
2026-03-26 23:00:41 [ayvens.be] INFO: Scrape type for 1978485: 2
2026-03-26 23:00:41 [ayvens.be] INFO: Extracting data for car ID: 1978485
2026-03-26 23:00:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b98d3af-5ca9-5501-8411-b1ccc14a16db with identifier: 1978485
2026-03-26 23:00:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b98d3af-5ca9-5501-8411-b1ccc14a16db with scrape type 2
2026-03-26 23:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2b98d3af-5ca9-5501-8411-b1ccc14a16db with scrape type 2
2026-03-26 23:00:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 2b98d3af-5ca9-5501-8411-b1ccc14a16db, identifier: 1978485
2026-03-26 23:00:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 2b98d3af-5ca9-5501-8411-b1ccc14a16db with identifier: 1978485
2026-03-26 23:00:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 2b98d3af-5ca9-5501-8411-b1ccc14a16db with identifier: 1978485
2026-03-26 23:00:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 2b98d3af-5ca9-5501-8411-b1ccc14a16db with identifier: 1978485 to the API
2026-03-26 23:00:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:00:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:00:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '2b98d3af-5ca9-5501-8411-b1ccc14a16db',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'CITROAu2039N',
 'model': 'BERLINGO',
 'odometer': 65651,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-28',
 'seats_number': 2,
 'seller_name': None,
 'title': 'CITROAu2039N BERLINGO 1.5 BLUEHDI 100 XL HEAVY CLUB',
 'transmission': 'manual',
 'trim': '1.5 BLUEHDI 100 XL HEAVY CLUB',
 'vin': None,
 'year': 2022}
2026-03-26 23:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978485%27 HTTP/1.1" 200 None
2026-03-26 23:00:41 [ayvens.be] INFO: Saving data for 1978485: {'auction_closing_time': 1774854000.0, 'created_time': 1774306012.091532, 'last_price_update_time': 1774566041.868682}
2026-03-26 23:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978485') HTTP/1.1" 204 0
2026-03-26 23:00:41 [ayvens.be] INFO: Found listing with ID: 1978486
2026-03-26 23:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978486%27 HTTP/1.1" 200 None
2026-03-26 23:00:41 [ayvens.be] INFO: Scrape type for 1978486: 2
2026-03-26 23:00:41 [ayvens.be] INFO: Extracting data for car ID: 1978486
2026-03-26 23:00:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 80e3f8c3-b697-5f49-bf6f-69f4cccef89c with identifier: 1978486
2026-03-26 23:00:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80e3f8c3-b697-5f49-bf6f-69f4cccef89c with scrape type 2
2026-03-26 23:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 80e3f8c3-b697-5f49-bf6f-69f4cccef89c with scrape type 2
2026-03-26 23:00:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 80e3f8c3-b697-5f49-bf6f-69f4cccef89c, identifier: 1978486
2026-03-26 23:00:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 80e3f8c3-b697-5f49-bf6f-69f4cccef89c with identifier: 1978486
2026-03-26 23:00:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 80e3f8c3-b697-5f49-bf6f-69f4cccef89c with identifier: 1978486
2026-03-26 23:00:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 80e3f8c3-b697-5f49-bf6f-69f4cccef89c with identifier: 1978486 to the API
2026-03-26 23:00:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:00:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:00:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '80e3f8c3-b697-5f49-bf6f-69f4cccef89c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 45712,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-10',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-03-26 23:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978486%27 HTTP/1.1" 200 None
2026-03-26 23:00:42 [ayvens.be] INFO: Saving data for 1978486: {'auction_closing_time': 1774854000.0, 'created_time': 1774306009.399741, 'last_price_update_time': 1774566042.241498}
2026-03-26 23:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978486') HTTP/1.1" 204 0
2026-03-26 23:00:42 [ayvens.be] INFO: Found listing with ID: 1978487
2026-03-26 23:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978487%27 HTTP/1.1" 200 None
2026-03-26 23:00:42 [ayvens.be] INFO: Scrape type for 1978487: 2
2026-03-26 23:00:42 [ayvens.be] INFO: Extracting data for car ID: 1978487
2026-03-26 23:00:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 33674112-cc7a-512a-a6d5-c1ed38fe95c9 with identifier: 1978487
2026-03-26 23:00:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33674112-cc7a-512a-a6d5-c1ed38fe95c9 with scrape type 2
2026-03-26 23:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 33674112-cc7a-512a-a6d5-c1ed38fe95c9 with scrape type 2
2026-03-26 23:00:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 33674112-cc7a-512a-a6d5-c1ed38fe95c9, identifier: 1978487
2026-03-26 23:00:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 33674112-cc7a-512a-a6d5-c1ed38fe95c9 with identifier: 1978487
2026-03-26 23:00:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 33674112-cc7a-512a-a6d5-c1ed38fe95c9 with identifier: 1978487
2026-03-26 23:00:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 33674112-cc7a-512a-a6d5-c1ed38fe95c9 with identifier: 1978487 to the API
2026-03-26 23:00:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:00:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:00:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '33674112-cc7a-512a-a6d5-c1ed38fe95c9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'GRAND TOURNEO CONNECT',
 'odometer': 181137,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD GRAND TOURNEO CONNECT 1.5 TDCI 88KW TITANIUM',
 'transmission': 'manual',
 'trim': '1.5 TDCI 88KW TITANIUM',
 'vin': None,
 'year': 2021}
2026-03-26 23:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978487%27 HTTP/1.1" 200 None
2026-03-26 23:00:42 [ayvens.be] INFO: Saving data for 1978487: {'auction_closing_time': 1774854000.0, 'created_time': 1774306010.505855, 'last_price_update_time': 1774566042.639648}
2026-03-26 23:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978487') HTTP/1.1" 204 0
2026-03-26 23:00:42 [ayvens.be] INFO: Found listing with ID: 1978488
2026-03-26 23:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978488%27 HTTP/1.1" 200 None
2026-03-26 23:00:42 [ayvens.be] INFO: Scrape type for 1978488: 2
2026-03-26 23:00:42 [ayvens.be] INFO: Extracting data for car ID: 1978488
2026-03-26 23:00:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 566d6efa-4328-52e0-adc7-a57383e86ce1 with identifier: 1978488
2026-03-26 23:00:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 566d6efa-4328-52e0-adc7-a57383e86ce1 with scrape type 2
2026-03-26 23:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 566d6efa-4328-52e0-adc7-a57383e86ce1 with scrape type 2
2026-03-26 23:00:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 566d6efa-4328-52e0-adc7-a57383e86ce1, identifier: 1978488
2026-03-26 23:00:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 566d6efa-4328-52e0-adc7-a57383e86ce1 with identifier: 1978488
2026-03-26 23:00:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 566d6efa-4328-52e0-adc7-a57383e86ce1 with identifier: 1978488
2026-03-26 23:00:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 566d6efa-4328-52e0-adc7-a57383e86ce1 with identifier: 1978488 to the API
2026-03-26 23:00:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:00:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:00:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '566d6efa-4328-52e0-adc7-a57383e86ce1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 92937,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-12',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-03-26 23:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978488%27 HTTP/1.1" 200 None
2026-03-26 23:00:43 [ayvens.be] INFO: Saving data for 1978488: {'auction_closing_time': 1774854000.0, 'created_time': 1774306008.670182, 'last_price_update_time': 1774566043.016241}
2026-03-26 23:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978488') HTTP/1.1" 204 0
2026-03-26 23:00:43 [ayvens.be] INFO: Found listing with ID: 1978489
2026-03-26 23:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978489%27 HTTP/1.1" 200 None
2026-03-26 23:00:43 [ayvens.be] INFO: Scrape type for 1978489: 2
2026-03-26 23:00:43 [ayvens.be] INFO: Extracting data for car ID: 1978489
2026-03-26 23:00:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 222e6fe1-a081-58dd-a757-065567ce6ac2 with identifier: 1978489
2026-03-26 23:00:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 222e6fe1-a081-58dd-a757-065567ce6ac2 with scrape type 2
2026-03-26 23:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 222e6fe1-a081-58dd-a757-065567ce6ac2 with scrape type 2
2026-03-26 23:00:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 222e6fe1-a081-58dd-a757-065567ce6ac2, identifier: 1978489
2026-03-26 23:00:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 222e6fe1-a081-58dd-a757-065567ce6ac2 with identifier: 1978489
2026-03-26 23:00:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 222e6fe1-a081-58dd-a757-065567ce6ac2 with identifier: 1978489
2026-03-26 23:00:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 222e6fe1-a081-58dd-a757-065567ce6ac2 with identifier: 1978489 to the API
2026-03-26 23:00:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:00:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:00:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '222e6fe1-a081-58dd-a757-065567ce6ac2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'ASTRA SPORTS TOURER DIESEL - 2',
 'odometer': 141412,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL ASTRA SPORTS TOURER DIESEL - 2 1.5 Turbo D Edition S-S',
 'transmission': 'manual',
 'trim': '1.5 Turbo D Edition S-S',
 'vin': None,
 'year': 2020}
2026-03-26 23:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978489%27 HTTP/1.1" 200 None
2026-03-26 23:00:43 [ayvens.be] INFO: Saving data for 1978489: {'auction_closing_time': 1774854000.0, 'created_time': 1774306002.407456, 'last_price_update_time': 1774566043.40204}
2026-03-26 23:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978489') HTTP/1.1" 204 0
2026-03-26 23:00:43 [ayvens.be] INFO: Found listing with ID: 1978490
2026-03-26 23:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978490%27 HTTP/1.1" 200 None
2026-03-26 23:00:43 [ayvens.be] INFO: Scrape type for 1978490: 2
2026-03-26 23:00:43 [ayvens.be] INFO: Extracting data for car ID: 1978490
2026-03-26 23:00:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dbbf4d8f-b0d6-5bc9-9293-153e375f0ae6 with identifier: 1978490
2026-03-26 23:00:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dbbf4d8f-b0d6-5bc9-9293-153e375f0ae6 with scrape type 2
2026-03-26 23:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dbbf4d8f-b0d6-5bc9-9293-153e375f0ae6 with scrape type 2
2026-03-26 23:00:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: dbbf4d8f-b0d6-5bc9-9293-153e375f0ae6, identifier: 1978490
2026-03-26 23:00:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: dbbf4d8f-b0d6-5bc9-9293-153e375f0ae6 with identifier: 1978490
2026-03-26 23:00:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: dbbf4d8f-b0d6-5bc9-9293-153e375f0ae6 with identifier: 1978490
2026-03-26 23:00:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: dbbf4d8f-b0d6-5bc9-9293-153e375f0ae6 with identifier: 1978490 to the API
2026-03-26 23:00:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:00:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:00:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': 'dbbf4d8f-b0d6-5bc9-9293-153e375f0ae6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'INSIGNIA SPORTS TOURER',
 'odometer': 87815,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL INSIGNIA SPORTS TOURER 1.5 TURBO D 90KW S-S BUSINESS ELEGANCE',
 'transmission': 'manual',
 'trim': '1.5 TURBO D 90KW S-S BUSINESS ELEGANCE',
 'vin': None,
 'year': 2021}
2026-03-26 23:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978490%27 HTTP/1.1" 200 None
2026-03-26 23:00:43 [ayvens.be] INFO: Saving data for 1978490: {'auction_closing_time': 1774854000.0, 'created_time': 1774306001.139824, 'last_price_update_time': 1774566043.788384}
2026-03-26 23:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978490') HTTP/1.1" 204 0
2026-03-26 23:00:43 [ayvens.be] INFO: Found listing with ID: 1978491
2026-03-26 23:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978491%27 HTTP/1.1" 200 None
2026-03-26 23:00:43 [ayvens.be] INFO: Scrape type for 1978491: 2
2026-03-26 23:00:43 [ayvens.be] INFO: Extracting data for car ID: 1978491
2026-03-26 23:00:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 785f66e5-e9cb-545f-9a3e-df3ed0688872 with identifier: 1978491
2026-03-26 23:00:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 785f66e5-e9cb-545f-9a3e-df3ed0688872 with scrape type 2
2026-03-26 23:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 785f66e5-e9cb-545f-9a3e-df3ed0688872 with scrape type 2
2026-03-26 23:00:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 785f66e5-e9cb-545f-9a3e-df3ed0688872, identifier: 1978491
2026-03-26 23:00:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 785f66e5-e9cb-545f-9a3e-df3ed0688872 with identifier: 1978491
2026-03-26 23:00:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 785f66e5-e9cb-545f-9a3e-df3ed0688872 with identifier: 1978491
2026-03-26 23:00:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 785f66e5-e9cb-545f-9a3e-df3ed0688872 with identifier: 1978491 to the API
2026-03-26 23:00:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:00:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:00:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '785f66e5-e9cb-545f-9a3e-df3ed0688872',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'CITROAu2039N',
 'model': 'BERLINGO',
 'odometer': 40369,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-16',
 'seats_number': 2,
 'seller_name': None,
 'title': 'CITROAu2039N BERLINGO 1.5 BLUEHDI 100 XL HEAVY CLUB',
 'transmission': 'manual',
 'trim': '1.5 BLUEHDI 100 XL HEAVY CLUB',
 'vin': None,
 'year': 2022}
2026-03-26 23:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978491%27 HTTP/1.1" 200 None
2026-03-26 23:00:44 [ayvens.be] INFO: Saving data for 1978491: {'auction_closing_time': 1774854000.0, 'created_time': 1774305998.944648, 'last_price_update_time': 1774566044.172791}
2026-03-26 23:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978491') HTTP/1.1" 204 0
2026-03-26 23:00:44 [ayvens.be] INFO: Found listing with ID: 1978492
2026-03-26 23:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978492%27 HTTP/1.1" 200 None
2026-03-26 23:00:44 [ayvens.be] INFO: Scrape type for 1978492: 2
2026-03-26 23:00:44 [ayvens.be] INFO: Extracting data for car ID: 1978492
2026-03-26 23:00:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36c1d133-eb00-5228-a9ff-4bc35b8ef9d1 with identifier: 1978492
2026-03-26 23:00:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36c1d133-eb00-5228-a9ff-4bc35b8ef9d1 with scrape type 2
2026-03-26 23:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 36c1d133-eb00-5228-a9ff-4bc35b8ef9d1 with scrape type 2
2026-03-26 23:00:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 36c1d133-eb00-5228-a9ff-4bc35b8ef9d1, identifier: 1978492
2026-03-26 23:00:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 36c1d133-eb00-5228-a9ff-4bc35b8ef9d1 with identifier: 1978492
2026-03-26 23:00:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 36c1d133-eb00-5228-a9ff-4bc35b8ef9d1 with identifier: 1978492
2026-03-26 23:00:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 36c1d133-eb00-5228-a9ff-4bc35b8ef9d1 with identifier: 1978492 to the API
2026-03-26 23:00:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:00:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:00:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '36c1d133-eb00-5228-a9ff-4bc35b8ef9d1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '1 SERIES HATCH',
 'odometer': 112992,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1 SERIES HATCH 1.5 116D (85KW)',
 'transmission': 'manual',
 'trim': '1.5 116D (85KW)',
 'vin': None,
 'year': 2023}
2026-03-26 23:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978492%27 HTTP/1.1" 200 None
2026-03-26 23:00:44 [ayvens.be] INFO: Saving data for 1978492: {'auction_closing_time': 1774854000.0, 'created_time': 1774305964.996659, 'last_price_update_time': 1774566044.564823}
2026-03-26 23:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978492') HTTP/1.1" 204 0
2026-03-26 23:00:44 [ayvens.be] INFO: Found listing with ID: 1978493
2026-03-26 23:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978493%27 HTTP/1.1" 200 None
2026-03-26 23:00:44 [ayvens.be] INFO: Scrape type for 1978493: 2
2026-03-26 23:00:44 [ayvens.be] INFO: Extracting data for car ID: 1978493
2026-03-26 23:00:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 55067381-fc8f-534d-b377-5c6ce1942d59 with identifier: 1978493
2026-03-26 23:00:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55067381-fc8f-534d-b377-5c6ce1942d59 with scrape type 2
2026-03-26 23:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 55067381-fc8f-534d-b377-5c6ce1942d59 with scrape type 2
2026-03-26 23:00:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 55067381-fc8f-534d-b377-5c6ce1942d59, identifier: 1978493
2026-03-26 23:00:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 55067381-fc8f-534d-b377-5c6ce1942d59 with identifier: 1978493
2026-03-26 23:00:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 55067381-fc8f-534d-b377-5c6ce1942d59 with identifier: 1978493
2026-03-26 23:00:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 55067381-fc8f-534d-b377-5c6ce1942d59 with identifier: 1978493 to the API
2026-03-26 23:00:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:00:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:00:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '55067381-fc8f-534d-b377-5c6ce1942d59',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '3 DIESEL - 2019',
 'odometer': 136511,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3 DIESEL - 2019 318 dA AdBlue',
 'transmission': 'automatic',
 'trim': '318 dA AdBlue',
 'vin': None,
 'year': 2020}
2026-03-26 23:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978493%27 HTTP/1.1" 200 None
2026-03-26 23:00:45 [ayvens.be] INFO: Saving data for 1978493: {'auction_closing_time': 1774854000.0, 'created_time': 1774305997.51264, 'last_price_update_time': 1774566045.024873}
2026-03-26 23:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978493') HTTP/1.1" 204 0
2026-03-26 23:00:45 [ayvens.be] INFO: Found listing with ID: 1978494
2026-03-26 23:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978494%27 HTTP/1.1" 200 None
2026-03-26 23:00:45 [ayvens.be] INFO: Scrape type for 1978494: 2
2026-03-26 23:00:45 [ayvens.be] INFO: Extracting data for car ID: 1978494
2026-03-26 23:00:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 33fd3e14-efe3-5867-9ca3-466efb909f0f with identifier: 1978494
2026-03-26 23:00:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33fd3e14-efe3-5867-9ca3-466efb909f0f with scrape type 2
2026-03-26 23:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 33fd3e14-efe3-5867-9ca3-466efb909f0f with scrape type 2
2026-03-26 23:00:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 33fd3e14-efe3-5867-9ca3-466efb909f0f, identifier: 1978494
2026-03-26 23:00:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 33fd3e14-efe3-5867-9ca3-466efb909f0f with identifier: 1978494
2026-03-26 23:00:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 33fd3e14-efe3-5867-9ca3-466efb909f0f with identifier: 1978494
2026-03-26 23:00:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 33fd3e14-efe3-5867-9ca3-466efb909f0f with identifier: 1978494 to the API
2026-03-26 23:00:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:00:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:00:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '33fd3e14-efe3-5867-9ca3-466efb909f0f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'ARTEON DIESEL',
 'odometer': 132078,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN ARTEON DIESEL 2.0 TDi SCR R-Line (EU6.2) STOCK',
 'transmission': 'manual',
 'trim': '2.0 TDi SCR R-Line (EU6.2) STOCK',
 'vin': None,
 'year': 2018}
2026-03-26 23:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978494%27 HTTP/1.1" 200 None
2026-03-26 23:00:45 [ayvens.be] INFO: Saving data for 1978494: {'auction_closing_time': 1774854000.0, 'created_time': 1774305967.956642, 'last_price_update_time': 1774566045.423126}
2026-03-26 23:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978494') HTTP/1.1" 204 0
2026-03-26 23:00:45 [ayvens.be] INFO: Found listing with ID: 1978495
2026-03-26 23:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978495%27 HTTP/1.1" 200 None
2026-03-26 23:00:45 [ayvens.be] INFO: Scrape type for 1978495: 2
2026-03-26 23:00:45 [ayvens.be] INFO: Extracting data for car ID: 1978495
2026-03-26 23:00:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a5c48fa-a2b8-5cd7-9e4a-ff3b7ab5310f with identifier: 1978495
2026-03-26 23:00:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a5c48fa-a2b8-5cd7-9e4a-ff3b7ab5310f with scrape type 2
2026-03-26 23:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0a5c48fa-a2b8-5cd7-9e4a-ff3b7ab5310f with scrape type 2
2026-03-26 23:00:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 0a5c48fa-a2b8-5cd7-9e4a-ff3b7ab5310f, identifier: 1978495
2026-03-26 23:00:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 0a5c48fa-a2b8-5cd7-9e4a-ff3b7ab5310f with identifier: 1978495
2026-03-26 23:00:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 0a5c48fa-a2b8-5cd7-9e4a-ff3b7ab5310f with identifier: 1978495
2026-03-26 23:00:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 0a5c48fa-a2b8-5cd7-9e4a-ff3b7ab5310f with identifier: 1978495 to the API
2026-03-26 23:00:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:00:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:00:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '0a5c48fa-a2b8-5cd7-9e4a-ff3b7ab5310f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 152046,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 2008 1.5 BLUEHDI 81KW S-S GT',
 'transmission': 'manual',
 'trim': '1.5 BLUEHDI 81KW S-S GT',
 'vin': None,
 'year': 2021}
2026-03-26 23:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978495%27 HTTP/1.1" 200 None
2026-03-26 23:00:45 [ayvens.be] INFO: Saving data for 1978495: {'auction_closing_time': 1774854000.0, 'created_time': 1774305996.455177, 'last_price_update_time': 1774566045.929245}
2026-03-26 23:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978495') HTTP/1.1" 204 0
2026-03-26 23:00:46 [ayvens.be] INFO: Found listing with ID: 1978496
2026-03-26 23:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978496%27 HTTP/1.1" 200 None
2026-03-26 23:00:46 [ayvens.be] INFO: Scrape type for 1978496: 2
2026-03-26 23:00:46 [ayvens.be] INFO: Extracting data for car ID: 1978496
2026-03-26 23:00:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9be2b3d3-d960-5423-8807-a83eafa5bf3b with identifier: 1978496
2026-03-26 23:00:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9be2b3d3-d960-5423-8807-a83eafa5bf3b with scrape type 2
2026-03-26 23:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9be2b3d3-d960-5423-8807-a83eafa5bf3b with scrape type 2
2026-03-26 23:00:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 9be2b3d3-d960-5423-8807-a83eafa5bf3b, identifier: 1978496
2026-03-26 23:00:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 9be2b3d3-d960-5423-8807-a83eafa5bf3b with identifier: 1978496
2026-03-26 23:00:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 9be2b3d3-d960-5423-8807-a83eafa5bf3b with identifier: 1978496
2026-03-26 23:00:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 9be2b3d3-d960-5423-8807-a83eafa5bf3b with identifier: 1978496 to the API
2026-03-26 23:00:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:00:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:00:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'petrol',
 'id': '9be2b3d3-d960-5423-8807-a83eafa5bf3b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3 SPORTBACK',
 'odometer': 161718,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 SPORTBACK 1.5 35 TFSI S TRONIC',
 'transmission': 'automatic',
 'trim': '1.5 35 TFSI S TRONIC',
 'vin': None,
 'year': 2020}
2026-03-26 23:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978496%27 HTTP/1.1" 200 None
2026-03-26 23:00:46 [ayvens.be] INFO: Saving data for 1978496: {'auction_closing_time': 1774854000.0, 'created_time': 1774305993.517572, 'last_price_update_time': 1774566046.394731}
2026-03-26 23:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978496') HTTP/1.1" 204 0
2026-03-26 23:00:46 [ayvens.be] INFO: Found listing with ID: 1978497
2026-03-26 23:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978497%27 HTTP/1.1" 200 None
2026-03-26 23:00:46 [ayvens.be] INFO: Scrape type for 1978497: 2
2026-03-26 23:00:46 [ayvens.be] INFO: Extracting data for car ID: 1978497
2026-03-26 23:00:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f29ab27-6670-5485-8d26-306227526cd3 with identifier: 1978497
2026-03-26 23:00:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f29ab27-6670-5485-8d26-306227526cd3 with scrape type 2
2026-03-26 23:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8f29ab27-6670-5485-8d26-306227526cd3 with scrape type 2
2026-03-26 23:00:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 8f29ab27-6670-5485-8d26-306227526cd3, identifier: 1978497
2026-03-26 23:00:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 8f29ab27-6670-5485-8d26-306227526cd3 with identifier: 1978497
2026-03-26 23:00:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 8f29ab27-6670-5485-8d26-306227526cd3 with identifier: 1978497
2026-03-26 23:00:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 8f29ab27-6670-5485-8d26-306227526cd3 with identifier: 1978497 to the API
2026-03-26 23:00:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:00:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:00:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'petrol',
 'id': '8f29ab27-6670-5485-8d26-306227526cd3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF VARIANT VIII',
 'odometer': 162602,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF VARIANT VIII 1.5 ETSI 96KW DSG LIFE',
 'transmission': 'automatic',
 'trim': '1.5 ETSI 96KW DSG LIFE',
 'vin': None,
 'year': 2022}
2026-03-26 23:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978497%27 HTTP/1.1" 200 None
2026-03-26 23:00:46 [ayvens.be] INFO: Saving data for 1978497: {'auction_closing_time': 1774854000.0, 'created_time': 1774305989.041022, 'last_price_update_time': 1774566046.823509}
2026-03-26 23:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978497') HTTP/1.1" 204 0
2026-03-26 23:00:46 [ayvens.be] INFO: Found listing with ID: 1978498
2026-03-26 23:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978498%27 HTTP/1.1" 200 None
2026-03-26 23:00:46 [ayvens.be] INFO: Scrape type for 1978498: 2
2026-03-26 23:00:46 [ayvens.be] INFO: Extracting data for car ID: 1978498
2026-03-26 23:00:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5cd7b9ee-cd1e-52de-8a13-1fdf116b9cb5 with identifier: 1978498
2026-03-26 23:00:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5cd7b9ee-cd1e-52de-8a13-1fdf116b9cb5 with scrape type 2
2026-03-26 23:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5cd7b9ee-cd1e-52de-8a13-1fdf116b9cb5 with scrape type 2
2026-03-26 23:00:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 5cd7b9ee-cd1e-52de-8a13-1fdf116b9cb5, identifier: 1978498
2026-03-26 23:00:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 5cd7b9ee-cd1e-52de-8a13-1fdf116b9cb5 with identifier: 1978498
2026-03-26 23:00:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 5cd7b9ee-cd1e-52de-8a13-1fdf116b9cb5 with identifier: 1978498
2026-03-26 23:00:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 5cd7b9ee-cd1e-52de-8a13-1fdf116b9cb5 with identifier: 1978498 to the API
2026-03-26 23:00:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:00:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:00:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '5cd7b9ee-cd1e-52de-8a13-1fdf116b9cb5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '508 SW DIESEL - 2018',
 'odometer': 164918,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 508 SW DIESEL - 2018 1.5 BlueHDi Active S&S',
 'transmission': 'automatic',
 'trim': '1.5 BlueHDi Active S&S',
 'vin': None,
 'year': 2019}
2026-03-26 23:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978498%27 HTTP/1.1" 200 None
2026-03-26 23:00:47 [ayvens.be] INFO: Saving data for 1978498: {'auction_closing_time': 1774854000.0, 'created_time': 1774305972.480469, 'last_price_update_time': 1774566047.21051}
2026-03-26 23:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978498') HTTP/1.1" 204 0
2026-03-26 23:00:47 [ayvens.be] INFO: Found listing with ID: 1978499
2026-03-26 23:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978499%27 HTTP/1.1" 200 None
2026-03-26 23:00:47 [ayvens.be] INFO: Scrape type for 1978499: 2
2026-03-26 23:00:47 [ayvens.be] INFO: Extracting data for car ID: 1978499
2026-03-26 23:00:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5968da5-a67d-559a-b39a-6df374c8874a with identifier: 1978499
2026-03-26 23:00:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5968da5-a67d-559a-b39a-6df374c8874a with scrape type 2
2026-03-26 23:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f5968da5-a67d-559a-b39a-6df374c8874a with scrape type 2
2026-03-26 23:00:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f5968da5-a67d-559a-b39a-6df374c8874a, identifier: 1978499
2026-03-26 23:00:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f5968da5-a67d-559a-b39a-6df374c8874a with identifier: 1978499
2026-03-26 23:00:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f5968da5-a67d-559a-b39a-6df374c8874a with identifier: 1978499
2026-03-26 23:00:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f5968da5-a67d-559a-b39a-6df374c8874a with identifier: 1978499 to the API
2026-03-26 23:00:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:00:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:00:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': 'f5968da5-a67d-559a-b39a-6df374c8874a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'FOCUS CLIPPER',
 'odometer': 241984,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD FOCUS CLIPPER 1.5 ECOBLUE 85KW ST-LINE AUTO',
 'transmission': 'automatic',
 'trim': '1.5 ECOBLUE 85KW ST-LINE AUTO',
 'vin': None,
 'year': 2023}
2026-03-26 23:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978499%27 HTTP/1.1" 200 None
2026-03-26 23:00:47 [ayvens.be] INFO: Saving data for 1978499: {'auction_closing_time': 1774854000.0, 'created_time': 1774305987.735549, 'last_price_update_time': 1774566047.588805}
2026-03-26 23:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978499') HTTP/1.1" 204 0
2026-03-26 23:00:47 [ayvens.be] INFO: Found listing with ID: 1978500
2026-03-26 23:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978500%27 HTTP/1.1" 200 None
2026-03-26 23:00:47 [ayvens.be] INFO: Scrape type for 1978500: 2
2026-03-26 23:00:47 [ayvens.be] INFO: Extracting data for car ID: 1978500
2026-03-26 23:00:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60b24981-ee9c-5f7d-83b3-a07ef1a2a44e with identifier: 1978500
2026-03-26 23:00:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60b24981-ee9c-5f7d-83b3-a07ef1a2a44e with scrape type 2
2026-03-26 23:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 60b24981-ee9c-5f7d-83b3-a07ef1a2a44e with scrape type 2
2026-03-26 23:00:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 60b24981-ee9c-5f7d-83b3-a07ef1a2a44e, identifier: 1978500
2026-03-26 23:00:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 60b24981-ee9c-5f7d-83b3-a07ef1a2a44e with identifier: 1978500
2026-03-26 23:00:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 60b24981-ee9c-5f7d-83b3-a07ef1a2a44e with identifier: 1978500
2026-03-26 23:00:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 60b24981-ee9c-5f7d-83b3-a07ef1a2a44e with identifier: 1978500 to the API
2026-03-26 23:00:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:00:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:00:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '60b24981-ee9c-5f7d-83b3-a07ef1a2a44e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '5008',
 'odometer': 148389,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 5008 1.5 BLUEHDI 130 AUTO ACTIVE',
 'transmission': 'automatic',
 'trim': '1.5 BLUEHDI 130 AUTO ACTIVE',
 'vin': None,
 'year': 2020}
2026-03-26 23:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978500%27 HTTP/1.1" 200 None
2026-03-26 23:00:47 [ayvens.be] INFO: Saving data for 1978500: {'auction_closing_time': 1774854000.0, 'created_time': 1774305986.559407, 'last_price_update_time': 1774566047.9754}
2026-03-26 23:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978500') HTTP/1.1" 204 0
2026-03-26 23:00:47 [ayvens.be] INFO: Found listing with ID: 1978501
2026-03-26 23:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978501%27 HTTP/1.1" 200 None
2026-03-26 23:00:48 [ayvens.be] INFO: Scrape type for 1978501: 2
2026-03-26 23:00:48 [ayvens.be] INFO: Extracting data for car ID: 1978501
2026-03-26 23:00:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6e09cf8b-cc7f-50c5-93b3-18a06f65586b with identifier: 1978501
2026-03-26 23:00:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e09cf8b-cc7f-50c5-93b3-18a06f65586b with scrape type 2
2026-03-26 23:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6e09cf8b-cc7f-50c5-93b3-18a06f65586b with scrape type 2
2026-03-26 23:00:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 6e09cf8b-cc7f-50c5-93b3-18a06f65586b, identifier: 1978501
2026-03-26 23:00:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 6e09cf8b-cc7f-50c5-93b3-18a06f65586b with identifier: 1978501
2026-03-26 23:00:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 6e09cf8b-cc7f-50c5-93b3-18a06f65586b with identifier: 1978501
2026-03-26 23:00:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 6e09cf8b-cc7f-50c5-93b3-18a06f65586b with identifier: 1978501 to the API
2026-03-26 23:00:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:00:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:00:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '6e09cf8b-cc7f-50c5-93b3-18a06f65586b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3 SPORTBACK DIESEL',
 'odometer': 206442,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 SPORTBACK DIESEL 35 TDi Business Edition S tronic',
 'transmission': 'automatic',
 'trim': '35 TDi Business Edition S tronic',
 'vin': None,
 'year': 2020}
2026-03-26 23:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978501%27 HTTP/1.1" 200 None
2026-03-26 23:00:48 [ayvens.be] INFO: Saving data for 1978501: {'auction_closing_time': 1774854000.0, 'created_time': 1774305986.20933, 'last_price_update_time': 1774566048.366594}
2026-03-26 23:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978501') HTTP/1.1" 204 0
2026-03-26 23:00:48 [ayvens.be] INFO: Found listing with ID: 1978502
2026-03-26 23:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978502%27 HTTP/1.1" 200 None
2026-03-26 23:00:48 [ayvens.be] INFO: Scrape type for 1978502: 2
2026-03-26 23:00:48 [ayvens.be] INFO: Extracting data for car ID: 1978502
2026-03-26 23:00:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 98fa9be1-2572-5c51-9f7f-a10a53b6d94e with identifier: 1978502
2026-03-26 23:00:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98fa9be1-2572-5c51-9f7f-a10a53b6d94e with scrape type 2
2026-03-26 23:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 98fa9be1-2572-5c51-9f7f-a10a53b6d94e with scrape type 2
2026-03-26 23:00:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 98fa9be1-2572-5c51-9f7f-a10a53b6d94e, identifier: 1978502
2026-03-26 23:00:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 98fa9be1-2572-5c51-9f7f-a10a53b6d94e with identifier: 1978502
2026-03-26 23:00:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 98fa9be1-2572-5c51-9f7f-a10a53b6d94e with identifier: 1978502
2026-03-26 23:00:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 98fa9be1-2572-5c51-9f7f-a10a53b6d94e with identifier: 1978502 to the API
2026-03-26 23:00:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:00:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:00:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '3.2L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '98fa9be1-2572-5c51-9f7f-a10a53b6d94e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'RANGER DOUBLE CAB - 2015',
 'odometer': 249231,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD RANGER DOUBLE CAB - 2015 3.2 TDCi Wildtrak STOCK',
 'transmission': 'automatic',
 'trim': '3.2 TDCi Wildtrak STOCK',
 'vin': None,
 'year': 2018}
2026-03-26 23:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978502%27 HTTP/1.1" 200 None
2026-03-26 23:00:48 [ayvens.be] INFO: Saving data for 1978502: {'auction_closing_time': 1774854000.0, 'created_time': 1774305984.438999, 'last_price_update_time': 1774566048.752166}
2026-03-26 23:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978502') HTTP/1.1" 204 0
2026-03-26 23:00:48 [ayvens.be] INFO: Found listing with ID: 1978503
2026-03-26 23:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978503%27 HTTP/1.1" 200 None
2026-03-26 23:00:48 [ayvens.be] INFO: Scrape type for 1978503: 2
2026-03-26 23:00:48 [ayvens.be] INFO: Extracting data for car ID: 1978503
2026-03-26 23:00:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3650d538-54de-5675-abe8-1a8e3d40dcb4 with identifier: 1978503
2026-03-26 23:00:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3650d538-54de-5675-abe8-1a8e3d40dcb4 with scrape type 2
2026-03-26 23:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3650d538-54de-5675-abe8-1a8e3d40dcb4 with scrape type 2
2026-03-26 23:00:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 3650d538-54de-5675-abe8-1a8e3d40dcb4, identifier: 1978503
2026-03-26 23:00:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 3650d538-54de-5675-abe8-1a8e3d40dcb4 with identifier: 1978503
2026-03-26 23:00:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 3650d538-54de-5675-abe8-1a8e3d40dcb4 with identifier: 1978503
2026-03-26 23:00:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 3650d538-54de-5675-abe8-1a8e3d40dcb4 with identifier: 1978503 to the API
2026-03-26 23:00:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:00:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:00:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'petrol',
 'id': '3650d538-54de-5675-abe8-1a8e3d40dcb4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'MEGANE GRANDTOUR - 2016',
 'odometer': 179004,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-05-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT MEGANE GRANDTOUR - 2016 1.33 TCe Corporate Edition GPF '
          '(Fleet)',
 'transmission': 'manual',
 'trim': '1.33 TCe Corporate Edition GPF (Fleet)',
 'vin': None,
 'year': 2020}
2026-03-26 23:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978503%27 HTTP/1.1" 200 None
2026-03-26 23:00:49 [ayvens.be] INFO: Saving data for 1978503: {'auction_closing_time': 1774854000.0, 'created_time': 1774305978.22046, 'last_price_update_time': 1774566049.123526}
2026-03-26 23:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978503') HTTP/1.1" 204 0
2026-03-26 23:00:49 [ayvens.be] INFO: Found listing with ID: 1978504
2026-03-26 23:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978504%27 HTTP/1.1" 200 None
2026-03-26 23:00:49 [ayvens.be] INFO: Scrape type for 1978504: 2
2026-03-26 23:00:49 [ayvens.be] INFO: Extracting data for car ID: 1978504
2026-03-26 23:00:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b3d3b41a-5d5a-5c2a-b915-f10d14e3761a with identifier: 1978504
2026-03-26 23:00:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3d3b41a-5d5a-5c2a-b915-f10d14e3761a with scrape type 2
2026-03-26 23:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b3d3b41a-5d5a-5c2a-b915-f10d14e3761a with scrape type 2
2026-03-26 23:00:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b3d3b41a-5d5a-5c2a-b915-f10d14e3761a, identifier: 1978504
2026-03-26 23:00:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b3d3b41a-5d5a-5c2a-b915-f10d14e3761a with identifier: 1978504
2026-03-26 23:00:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b3d3b41a-5d5a-5c2a-b915-f10d14e3761a with identifier: 1978504
2026-03-26 23:00:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b3d3b41a-5d5a-5c2a-b915-f10d14e3761a with identifier: 1978504 to the API
2026-03-26 23:00:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:00:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:00:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b3d3b41a-5d5a-5c2a-b915-f10d14e3761a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'CITROAu2039N',
 'model': 'BERLINGO',
 'odometer': 47706,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-13',
 'seats_number': 2,
 'seller_name': None,
 'title': 'CITROAu2039N BERLINGO 1.5 BLUEHDI 100 XL HEAVY CONTROL',
 'transmission': 'manual',
 'trim': '1.5 BLUEHDI 100 XL HEAVY CONTROL',
 'vin': None,
 'year': 2021}
2026-03-26 23:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978504%27 HTTP/1.1" 200 None
2026-03-26 23:00:49 [ayvens.be] INFO: Saving data for 1978504: {'auction_closing_time': 1774854000.0, 'created_time': 1774305983.222158, 'last_price_update_time': 1774566049.52164}
2026-03-26 23:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978504') HTTP/1.1" 204 0
2026-03-26 23:00:49 [ayvens.be] INFO: Found listing with ID: 1978505
2026-03-26 23:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978505%27 HTTP/1.1" 200 None
2026-03-26 23:00:49 [ayvens.be] INFO: Scrape type for 1978505: 2
2026-03-26 23:00:49 [ayvens.be] INFO: Extracting data for car ID: 1978505
2026-03-26 23:00:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 406397f1-cca0-5b08-9891-053ec738b4c6 with identifier: 1978505
2026-03-26 23:00:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 406397f1-cca0-5b08-9891-053ec738b4c6 with scrape type 2
2026-03-26 23:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 406397f1-cca0-5b08-9891-053ec738b4c6 with scrape type 2
2026-03-26 23:00:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 406397f1-cca0-5b08-9891-053ec738b4c6, identifier: 1978505
2026-03-26 23:00:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 406397f1-cca0-5b08-9891-053ec738b4c6 with identifier: 1978505
2026-03-26 23:00:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 406397f1-cca0-5b08-9891-053ec738b4c6 with identifier: 1978505
2026-03-26 23:00:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 406397f1-cca0-5b08-9891-053ec738b4c6 with identifier: 1978505 to the API
2026-03-26 23:00:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:00:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:00:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.3L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '406397f1-cca0-5b08-9891-053ec738b4c6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'NV400',
 'odometer': 99981,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-21',
 'seats_number': 3,
 'seller_name': None,
 'title': 'NISSAN NV400 2.3 DCI 135 L3H2 3.5T ACENTA',
 'transmission': 'manual',
 'trim': '2.3 DCI 135 L3H2 3.5T ACENTA',
 'vin': None,
 'year': 2020}
2026-03-26 23:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978505%27 HTTP/1.1" 200 None
2026-03-26 23:00:49 [ayvens.be] INFO: Saving data for 1978505: {'auction_closing_time': 1774854000.0, 'created_time': 1774305980.737247, 'last_price_update_time': 1774566049.925204}
2026-03-26 23:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978505') HTTP/1.1" 204 0
2026-03-26 23:00:49 [ayvens.be] INFO: Found listing with ID: 1978506
2026-03-26 23:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978506%27 HTTP/1.1" 200 None
2026-03-26 23:00:49 [ayvens.be] INFO: Scrape type for 1978506: 2
2026-03-26 23:00:49 [ayvens.be] INFO: Extracting data for car ID: 1978506
2026-03-26 23:00:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 67b55a3b-5d0d-522f-b0c3-516eb74e55cb with identifier: 1978506
2026-03-26 23:00:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67b55a3b-5d0d-522f-b0c3-516eb74e55cb with scrape type 2
2026-03-26 23:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 67b55a3b-5d0d-522f-b0c3-516eb74e55cb with scrape type 2
2026-03-26 23:00:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 67b55a3b-5d0d-522f-b0c3-516eb74e55cb, identifier: 1978506
2026-03-26 23:00:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 67b55a3b-5d0d-522f-b0c3-516eb74e55cb with identifier: 1978506
2026-03-26 23:00:50 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 23:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 23:00:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 67b55a3b-5d0d-522f-b0c3-516eb74e55cb with identifier: 1978506
2026-03-26 23:00:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 67b55a3b-5d0d-522f-b0c3-516eb74e55cb with identifier: 1978506 to the API
2026-03-26 23:00:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:00:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:00:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'color': 'BANQUISE WHITE GLOSS',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '67b55a3b-5d0d-522f-b0c3-516eb74e55cb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'CITROAu2039N',
 'model': 'JUMPY',
 'odometer': 51490,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-28',
 'seats_number': 2,
 'seller_name': None,
 'title': 'CITROAu2039N JUMPY 1.5 BLUEHDI 75KW S-S XL CONTROL',
 'transmission': 'manual',
 'trim': '1.5 BLUEHDI 75KW S-S XL CONTROL',
 'vin': None,
 'year': 2021}
2026-03-26 23:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978506%27 HTTP/1.1" 200 None
2026-03-26 23:00:50 [ayvens.be] INFO: Saving data for 1978506: {'auction_closing_time': 1774854000.0, 'created_time': 1774305982.460874, 'last_price_update_time': 1774566050.312659}
2026-03-26 23:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978506') HTTP/1.1" 204 0
2026-03-26 23:00:50 [ayvens.be] INFO: Found listing with ID: 1978507
2026-03-26 23:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978507%27 HTTP/1.1" 200 None
2026-03-26 23:00:50 [ayvens.be] INFO: Scrape type for 1978507: 2
2026-03-26 23:00:50 [ayvens.be] INFO: Extracting data for car ID: 1978507
2026-03-26 23:00:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 264afb82-f54a-51f0-ba3b-45f0345ece79 with identifier: 1978507
2026-03-26 23:00:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 264afb82-f54a-51f0-ba3b-45f0345ece79 with scrape type 2
2026-03-26 23:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 264afb82-f54a-51f0-ba3b-45f0345ece79 with scrape type 2
2026-03-26 23:00:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 264afb82-f54a-51f0-ba3b-45f0345ece79, identifier: 1978507
2026-03-26 23:00:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 264afb82-f54a-51f0-ba3b-45f0345ece79 with identifier: 1978507
2026-03-26 23:00:50 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 23:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 23:00:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 264afb82-f54a-51f0-ba3b-45f0345ece79 with identifier: 1978507
2026-03-26 23:00:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 264afb82-f54a-51f0-ba3b-45f0345ece79 with identifier: 1978507 to the API
2026-03-26 23:00:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:00:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:00:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'color': 'REFLEX SILVER METALLIC',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '264afb82-f54a-51f0-ba3b-45f0345ece79',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'CADDY MAXI VAN DIESEL - 2015',
 'odometer': 160987,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-06',
 'seats_number': 2,
 'seller_name': None,
 'title': 'VOLKSWAGEN CADDY MAXI VAN DIESEL - 2015 2.0 CR TDi SCR (EU6) STOCK',
 'transmission': 'manual',
 'trim': '2.0 CR TDi SCR (EU6) STOCK',
 'vin': None,
 'year': 2019}
2026-03-26 23:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978507%27 HTTP/1.1" 200 None
2026-03-26 23:00:50 [ayvens.be] INFO: Saving data for 1978507: {'auction_closing_time': 1774854000.0, 'created_time': 1774305985.112254, 'last_price_update_time': 1774566050.860288}
2026-03-26 23:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978507') HTTP/1.1" 204 0
2026-03-26 23:00:50 [ayvens.be] INFO: Found listing with ID: 1978508
2026-03-26 23:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978508%27 HTTP/1.1" 200 None
2026-03-26 23:00:50 [ayvens.be] INFO: Scrape type for 1978508: 2
2026-03-26 23:00:50 [ayvens.be] INFO: Extracting data for car ID: 1978508
2026-03-26 23:00:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2810f775-462c-5d0f-94cf-d0c91b6abcc0 with identifier: 1978508
2026-03-26 23:00:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2810f775-462c-5d0f-94cf-d0c91b6abcc0 with scrape type 2
2026-03-26 23:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2810f775-462c-5d0f-94cf-d0c91b6abcc0 with scrape type 2
2026-03-26 23:00:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 2810f775-462c-5d0f-94cf-d0c91b6abcc0, identifier: 1978508
2026-03-26 23:00:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 2810f775-462c-5d0f-94cf-d0c91b6abcc0 with identifier: 1978508
2026-03-26 23:00:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 2810f775-462c-5d0f-94cf-d0c91b6abcc0 with identifier: 1978508
2026-03-26 23:00:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 2810f775-462c-5d0f-94cf-d0c91b6abcc0 with identifier: 1978508 to the API
2026-03-26 23:00:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:00:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:00:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '2810f775-462c-5d0f-94cf-d0c91b6abcc0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TRANSPORTER',
 'odometer': 136038,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-17',
 'seats_number': 2,
 'seller_name': None,
 'title': 'VOLKSWAGEN TRANSPORTER 2.0CRTDI SCR 81KW BMT SWB 2.8T',
 'transmission': 'manual',
 'trim': '2.0CRTDI SCR 81KW BMT SWB 2.8T',
 'vin': None,
 'year': 2021}
2026-03-26 23:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978508%27 HTTP/1.1" 200 None
2026-03-26 23:00:51 [ayvens.be] INFO: Saving data for 1978508: {'auction_closing_time': 1774854000.0, 'created_time': 1774305988.681362, 'last_price_update_time': 1774566051.263606}
2026-03-26 23:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978508') HTTP/1.1" 204 0
2026-03-26 23:00:51 [ayvens.be] INFO: Found listing with ID: 1978509
2026-03-26 23:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978509%27 HTTP/1.1" 200 None
2026-03-26 23:00:51 [ayvens.be] INFO: Scrape type for 1978509: 2
2026-03-26 23:00:51 [ayvens.be] INFO: Extracting data for car ID: 1978509
2026-03-26 23:00:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36aec582-042b-575e-a443-7a97cbbb0314 with identifier: 1978509
2026-03-26 23:00:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36aec582-042b-575e-a443-7a97cbbb0314 with scrape type 2
2026-03-26 23:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 36aec582-042b-575e-a443-7a97cbbb0314 with scrape type 2
2026-03-26 23:00:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 36aec582-042b-575e-a443-7a97cbbb0314, identifier: 1978509
2026-03-26 23:00:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 36aec582-042b-575e-a443-7a97cbbb0314 with identifier: 1978509
2026-03-26 23:00:51 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 23:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 23:00:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 36aec582-042b-575e-a443-7a97cbbb0314 with identifier: 1978509
2026-03-26 23:00:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 36aec582-042b-575e-a443-7a97cbbb0314 with identifier: 1978509 to the API
2026-03-26 23:00:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:00:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:00:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '36aec582-042b-575e-a443-7a97cbbb0314',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A6 DIESEL - 2018',
 'odometer': 181024,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A6 DIESEL - 2018 35 TDi Business Edition S tronic',
 'transmission': 'automatic',
 'trim': '35 TDi Business Edition S tronic',
 'vin': None,
 'year': 2020}
2026-03-26 23:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978509%27 HTTP/1.1" 200 None
2026-03-26 23:00:51 [ayvens.be] INFO: Saving data for 1978509: {'auction_closing_time': 1774854000.0, 'created_time': 1774305991.977314, 'last_price_update_time': 1774566051.669704}
2026-03-26 23:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978509') HTTP/1.1" 204 0
2026-03-26 23:00:51 [ayvens.be] INFO: Found listing with ID: 1978510
2026-03-26 23:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978510%27 HTTP/1.1" 200 None
2026-03-26 23:00:51 [ayvens.be] INFO: Scrape type for 1978510: 2
2026-03-26 23:00:51 [ayvens.be] INFO: Extracting data for car ID: 1978510
2026-03-26 23:00:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b7a7ae1-577b-511e-bd30-b9db7a61d7ae with identifier: 1978510
2026-03-26 23:00:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b7a7ae1-577b-511e-bd30-b9db7a61d7ae with scrape type 2
2026-03-26 23:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3b7a7ae1-577b-511e-bd30-b9db7a61d7ae with scrape type 2
2026-03-26 23:00:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 3b7a7ae1-577b-511e-bd30-b9db7a61d7ae, identifier: 1978510
2026-03-26 23:00:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 3b7a7ae1-577b-511e-bd30-b9db7a61d7ae with identifier: 1978510
2026-03-26 23:00:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 3b7a7ae1-577b-511e-bd30-b9db7a61d7ae with identifier: 1978510
2026-03-26 23:00:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 3b7a7ae1-577b-511e-bd30-b9db7a61d7ae with identifier: 1978510 to the API
2026-03-26 23:00:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:00:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:00:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'color': 'BLANC',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '3b7a7ae1-577b-511e-bd30-b9db7a61d7ae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS MAXI DIESEL',
 'odometer': 63627,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-15',
 'seats_number': None,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS MAXI DIESEL Lot 1.3 RENAULT KANGOO EXPRESS '
          'Maxi 1.5 dCi Blue Confort',
 'transmission': 'manual',
 'trim': 'Lot 1.3 RENAULT KANGOO EXPRESS Maxi 1.5 dCi Blue Confort',
 'vin': None,
 'year': 2020}
2026-03-26 23:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978510%27 HTTP/1.1" 200 None
2026-03-26 23:00:52 [ayvens.be] INFO: Saving data for 1978510: {'auction_closing_time': 1774854000.0, 'created_time': 1774305993.91192, 'last_price_update_time': 1774566052.034899}
2026-03-26 23:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978510') HTTP/1.1" 204 0
2026-03-26 23:00:52 [ayvens.be] INFO: Found listing with ID: 1978511
2026-03-26 23:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978511%27 HTTP/1.1" 200 None
2026-03-26 23:00:52 [ayvens.be] INFO: Scrape type for 1978511: 2
2026-03-26 23:00:52 [ayvens.be] INFO: Extracting data for car ID: 1978511
2026-03-26 23:00:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 841305e5-c403-5982-9930-f2997b99b443 with identifier: 1978511
2026-03-26 23:00:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 841305e5-c403-5982-9930-f2997b99b443 with scrape type 2
2026-03-26 23:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 841305e5-c403-5982-9930-f2997b99b443 with scrape type 2
2026-03-26 23:00:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 841305e5-c403-5982-9930-f2997b99b443, identifier: 1978511
2026-03-26 23:00:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 841305e5-c403-5982-9930-f2997b99b443 with identifier: 1978511
2026-03-26 23:00:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 841305e5-c403-5982-9930-f2997b99b443 with identifier: 1978511
2026-03-26 23:00:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 841305e5-c403-5982-9930-f2997b99b443 with identifier: 1978511 to the API
2026-03-26 23:00:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:00:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:00:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'color': 'BLANC',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '841305e5-c403-5982-9930-f2997b99b443',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS MAXI DIESEL',
 'odometer': 67436,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-16',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS MAXI DIESEL Lot 1.3 RENAULT KANGOO EXPRESS '
          'Maxi 1.5 dCi Blue Confort',
 'transmission': 'manual',
 'trim': 'Lot 1.3 RENAULT KANGOO EXPRESS Maxi 1.5 dCi Blue Confort',
 'vin': None,
 'year': 2020}
2026-03-26 23:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978511%27 HTTP/1.1" 200 None
2026-03-26 23:00:52 [ayvens.be] INFO: Saving data for 1978511: {'auction_closing_time': 1774854000.0, 'created_time': 1774305995.04962, 'last_price_update_time': 1774566052.424636}
2026-03-26 23:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978511') HTTP/1.1" 204 0
2026-03-26 23:00:52 [ayvens.be] INFO: Found listing with ID: 1978512
2026-03-26 23:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978512%27 HTTP/1.1" 200 None
2026-03-26 23:00:52 [ayvens.be] INFO: Scrape type for 1978512: 2
2026-03-26 23:00:52 [ayvens.be] INFO: Extracting data for car ID: 1978512
2026-03-26 23:00:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9829e9fa-2169-5fb1-8ddb-3215804f70dd with identifier: 1978512
2026-03-26 23:00:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9829e9fa-2169-5fb1-8ddb-3215804f70dd with scrape type 2
2026-03-26 23:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9829e9fa-2169-5fb1-8ddb-3215804f70dd with scrape type 2
2026-03-26 23:00:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 9829e9fa-2169-5fb1-8ddb-3215804f70dd, identifier: 1978512
2026-03-26 23:00:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 9829e9fa-2169-5fb1-8ddb-3215804f70dd with identifier: 1978512
2026-03-26 23:00:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 9829e9fa-2169-5fb1-8ddb-3215804f70dd with identifier: 1978512
2026-03-26 23:00:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 9829e9fa-2169-5fb1-8ddb-3215804f70dd with identifier: 1978512 to the API
2026-03-26 23:00:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:00:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:00:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'IJSWIT',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '9829e9fa-2169-5fb1-8ddb-3215804f70dd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS MAXI DSL - 2013',
 'odometer': 103547,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-08',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS MAXI DSL - 2013 1.5 dCi Energy Confort',
 'transmission': 'manual',
 'trim': '1.5 dCi Energy Confort',
 'vin': None,
 'year': 2018}
2026-03-26 23:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978512%27 HTTP/1.1" 200 None
2026-03-26 23:00:55 [ayvens.be] INFO: Saving data for 1978512: {'auction_closing_time': 1774854000.0, 'created_time': 1774305999.296069, 'last_price_update_time': 1774566055.868727}
2026-03-26 23:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978512') HTTP/1.1" 204 0
2026-03-26 23:00:55 [ayvens.be] INFO: Found listing with ID: 1978513
2026-03-26 23:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978513%27 HTTP/1.1" 200 None
2026-03-26 23:00:55 [ayvens.be] INFO: Scrape type for 1978513: 2
2026-03-26 23:00:55 [ayvens.be] INFO: Extracting data for car ID: 1978513
2026-03-26 23:00:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa4f9804-d955-5197-b2eb-cc47ae31219b with identifier: 1978513
2026-03-26 23:00:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa4f9804-d955-5197-b2eb-cc47ae31219b with scrape type 2
2026-03-26 23:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fa4f9804-d955-5197-b2eb-cc47ae31219b with scrape type 2
2026-03-26 23:00:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: fa4f9804-d955-5197-b2eb-cc47ae31219b, identifier: 1978513
2026-03-26 23:00:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: fa4f9804-d955-5197-b2eb-cc47ae31219b with identifier: 1978513
2026-03-26 23:00:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: fa4f9804-d955-5197-b2eb-cc47ae31219b with identifier: 1978513
2026-03-26 23:00:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: fa4f9804-d955-5197-b2eb-cc47ae31219b with identifier: 1978513 to the API
2026-03-26 23:00:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:00:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:00:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 159,
 'color': 'BLANC',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': 'fa4f9804-d955-5197-b2eb-cc47ae31219b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': 'BOXER 335 FOURGON LWB DSL - 20',
 'odometer': 134594,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-11',
 'seats_number': 3,
 'seller_name': None,
 'title': 'PEUGEOT BOXER 335 FOURGON LWB DSL - 20 2.0 BlueHDi L3H2 Premium S&S '
          'STOCK',
 'transmission': 'manual',
 'trim': '2.0 BlueHDi L3H2 Premium S&S STOCK',
 'vin': None,
 'year': 2018}
2026-03-26 23:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978513%27 HTTP/1.1" 200 None
2026-03-26 23:00:56 [ayvens.be] INFO: Saving data for 1978513: {'auction_closing_time': 1774854000.0, 'created_time': 1774306000.783743, 'last_price_update_time': 1774566056.273457}
2026-03-26 23:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978513') HTTP/1.1" 204 0
2026-03-26 23:00:56 [ayvens.be] INFO: Found listing with ID: 1978514
2026-03-26 23:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978514%27 HTTP/1.1" 200 None
2026-03-26 23:00:56 [ayvens.be] INFO: Scrape type for 1978514: 2
2026-03-26 23:00:56 [ayvens.be] INFO: Extracting data for car ID: 1978514
2026-03-26 23:00:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 53ec3909-cd1c-501e-97b6-5b22c83a5f97 with identifier: 1978514
2026-03-26 23:00:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53ec3909-cd1c-501e-97b6-5b22c83a5f97 with scrape type 2
2026-03-26 23:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 53ec3909-cd1c-501e-97b6-5b22c83a5f97 with scrape type 2
2026-03-26 23:00:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 53ec3909-cd1c-501e-97b6-5b22c83a5f97, identifier: 1978514
2026-03-26 23:00:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 53ec3909-cd1c-501e-97b6-5b22c83a5f97 with identifier: 1978514
2026-03-26 23:00:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 53ec3909-cd1c-501e-97b6-5b22c83a5f97 with identifier: 1978514
2026-03-26 23:00:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 53ec3909-cd1c-501e-97b6-5b22c83a5f97 with identifier: 1978514 to the API
2026-03-26 23:00:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:00:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:00:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '53ec3909-cd1c-501e-97b6-5b22c83a5f97',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS DSL - 2013',
 'odometer': 127138,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-10',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS DSL - 2013 1.5 Blue dCi Grand Confort '
          '(EU6d-TEMP)',
 'transmission': 'manual',
 'trim': '1.5 Blue dCi Grand Confort (EU6d-TEMP)',
 'vin': None,
 'year': 2020}
2026-03-26 23:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978514%27 HTTP/1.1" 200 None
2026-03-26 23:00:56 [ayvens.be] INFO: Saving data for 1978514: {'auction_closing_time': 1774854000.0, 'created_time': 1774306007.979295, 'last_price_update_time': 1774566056.662922}
2026-03-26 23:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978514') HTTP/1.1" 204 0
2026-03-26 23:00:56 [ayvens.be] INFO: Found listing with ID: 1978515
2026-03-26 23:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978515%27 HTTP/1.1" 200 None
2026-03-26 23:00:56 [ayvens.be] INFO: Scrape type for 1978515: 2
2026-03-26 23:00:56 [ayvens.be] INFO: Extracting data for car ID: 1978515
2026-03-26 23:00:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eeb3a64f-dbc5-5cef-b489-e4111fa7369b with identifier: 1978515
2026-03-26 23:00:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eeb3a64f-dbc5-5cef-b489-e4111fa7369b with scrape type 2
2026-03-26 23:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eeb3a64f-dbc5-5cef-b489-e4111fa7369b with scrape type 2
2026-03-26 23:00:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: eeb3a64f-dbc5-5cef-b489-e4111fa7369b, identifier: 1978515
2026-03-26 23:00:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: eeb3a64f-dbc5-5cef-b489-e4111fa7369b with identifier: 1978515
2026-03-26 23:00:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: eeb3a64f-dbc5-5cef-b489-e4111fa7369b with identifier: 1978515
2026-03-26 23:00:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: eeb3a64f-dbc5-5cef-b489-e4111fa7369b with identifier: 1978515 to the API
2026-03-26 23:00:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:00:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:00:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': 'eeb3a64f-dbc5-5cef-b489-e4111fa7369b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'V60 DIESEL - 2018',
 'odometer': 212523,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO V60 DIESEL - 2018 2.0 D3 Momentum Pro Geartronic',
 'transmission': 'automatic',
 'trim': '2.0 D3 Momentum Pro Geartronic',
 'vin': None,
 'year': 2020}
2026-03-26 23:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978515%27 HTTP/1.1" 200 None
2026-03-26 23:00:57 [ayvens.be] INFO: Saving data for 1978515: {'auction_closing_time': 1774854000.0, 'created_time': 1774306007.623923, 'last_price_update_time': 1774566057.101039}
2026-03-26 23:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978515') HTTP/1.1" 204 0
2026-03-26 23:00:57 [ayvens.be] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 900
2026-03-26 23:00:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-26 23:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-03-26 23:00:58 [ayvens.be] INFO: Found listing with ID: 1978516
2026-03-26 23:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978516%27 HTTP/1.1" 200 None
2026-03-26 23:00:58 [ayvens.be] INFO: Scrape type for 1978516: 2
2026-03-26 23:00:58 [ayvens.be] INFO: Extracting data for car ID: 1978516
2026-03-26 23:00:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30ad7341-5bb4-5f55-a82c-22c04d424124 with identifier: 1978516
2026-03-26 23:00:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30ad7341-5bb4-5f55-a82c-22c04d424124 with scrape type 2
2026-03-26 23:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 30ad7341-5bb4-5f55-a82c-22c04d424124 with scrape type 2
2026-03-26 23:00:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 30ad7341-5bb4-5f55-a82c-22c04d424124, identifier: 1978516
2026-03-26 23:00:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 30ad7341-5bb4-5f55-a82c-22c04d424124 with identifier: 1978516
2026-03-26 23:00:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 30ad7341-5bb4-5f55-a82c-22c04d424124 with identifier: 1978516
2026-03-26 23:00:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 30ad7341-5bb4-5f55-a82c-22c04d424124 with identifier: 1978516 to the API
2026-03-26 23:00:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:00:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:00:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '30ad7341-5bb4-5f55-a82c-22c04d424124',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'T-ROC',
 'odometer': 174253,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN T-ROC 2.0 TDI 85KW STYLE',
 'transmission': 'manual',
 'trim': '2.0 TDI 85KW STYLE',
 'vin': None,
 'year': 2021}
2026-03-26 23:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978516%27 HTTP/1.1" 200 None
2026-03-26 23:00:59 [ayvens.be] INFO: Saving data for 1978516: {'auction_closing_time': 1774854000.0, 'created_time': 1774306005.759274, 'last_price_update_time': 1774566059.227099}
2026-03-26 23:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978516') HTTP/1.1" 204 0
2026-03-26 23:00:59 [ayvens.be] INFO: Found listing with ID: 1978517
2026-03-26 23:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978517%27 HTTP/1.1" 200 None
2026-03-26 23:00:59 [ayvens.be] INFO: Scrape type for 1978517: 2
2026-03-26 23:00:59 [ayvens.be] INFO: Extracting data for car ID: 1978517
2026-03-26 23:00:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0280571-db56-5f74-9f1d-4dda9eb6af60 with identifier: 1978517
2026-03-26 23:00:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0280571-db56-5f74-9f1d-4dda9eb6af60 with scrape type 2
2026-03-26 23:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c0280571-db56-5f74-9f1d-4dda9eb6af60 with scrape type 2
2026-03-26 23:00:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c0280571-db56-5f74-9f1d-4dda9eb6af60, identifier: 1978517
2026-03-26 23:00:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c0280571-db56-5f74-9f1d-4dda9eb6af60 with identifier: 1978517
2026-03-26 23:00:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c0280571-db56-5f74-9f1d-4dda9eb6af60 with identifier: 1978517
2026-03-26 23:00:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c0280571-db56-5f74-9f1d-4dda9eb6af60 with identifier: 1978517 to the API
2026-03-26 23:00:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:00:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:00:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.3L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': 'c0280571-db56-5f74-9f1d-4dda9eb6af60',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'MASTER 35 LWB DSL - 2014',
 'odometer': 74808,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-20',
 'seats_number': 7,
 'seller_name': None,
 'title': 'RENAULT MASTER 35 LWB DSL - 2014 2.3 dCi 35 L3H1 STOCK',
 'transmission': 'manual',
 'trim': '2.3 dCi 35 L3H1 STOCK',
 'vin': None,
 'year': 2018}
2026-03-26 23:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978517%27 HTTP/1.1" 200 None
2026-03-26 23:00:59 [ayvens.be] INFO: Saving data for 1978517: {'auction_closing_time': 1774854000.0, 'created_time': 1774306010.844703, 'last_price_update_time': 1774566059.623485}
2026-03-26 23:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978517') HTTP/1.1" 204 0
2026-03-26 23:00:59 [ayvens.be] INFO: Found listing with ID: 1978518
2026-03-26 23:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978518%27 HTTP/1.1" 200 None
2026-03-26 23:00:59 [ayvens.be] INFO: Scrape type for 1978518: 2
2026-03-26 23:00:59 [ayvens.be] INFO: Extracting data for car ID: 1978518
2026-03-26 23:00:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e4a439d-7fba-5427-8975-2743b5f404ea with identifier: 1978518
2026-03-26 23:00:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e4a439d-7fba-5427-8975-2743b5f404ea with scrape type 2
2026-03-26 23:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5e4a439d-7fba-5427-8975-2743b5f404ea with scrape type 2
2026-03-26 23:00:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 5e4a439d-7fba-5427-8975-2743b5f404ea, identifier: 1978518
2026-03-26 23:00:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 5e4a439d-7fba-5427-8975-2743b5f404ea with identifier: 1978518
2026-03-26 23:00:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 5e4a439d-7fba-5427-8975-2743b5f404ea with identifier: 1978518
2026-03-26 23:00:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 5e4a439d-7fba-5427-8975-2743b5f404ea with identifier: 1978518 to the API
2026-03-26 23:00:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:01:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:01:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '5e4a439d-7fba-5427-8975-2743b5f404ea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': 'PARTNER',
 'odometer': 60841,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-28',
 'seats_number': 2,
 'seller_name': None,
 'title': 'PEUGEOT PARTNER 1.5 BHDI L2 HEAVY 75KW PREMIUM',
 'transmission': 'manual',
 'trim': '1.5 BHDI L2 HEAVY 75KW PREMIUM',
 'vin': None,
 'year': 2022}
2026-03-26 23:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978518%27 HTTP/1.1" 200 None
2026-03-26 23:01:00 [ayvens.be] INFO: Saving data for 1978518: {'auction_closing_time': 1774854000.0, 'created_time': 1774306039.188929, 'last_price_update_time': 1774566060.136178}
2026-03-26 23:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978518') HTTP/1.1" 204 0
2026-03-26 23:01:00 [ayvens.be] INFO: Found listing with ID: 1978519
2026-03-26 23:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978519%27 HTTP/1.1" 200 None
2026-03-26 23:01:00 [ayvens.be] INFO: Scrape type for 1978519: 2
2026-03-26 23:01:00 [ayvens.be] INFO: Extracting data for car ID: 1978519
2026-03-26 23:01:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 32f2c5d7-05a7-5ac7-9808-a1ed87f59377 with identifier: 1978519
2026-03-26 23:01:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32f2c5d7-05a7-5ac7-9808-a1ed87f59377 with scrape type 2
2026-03-26 23:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 32f2c5d7-05a7-5ac7-9808-a1ed87f59377 with scrape type 2
2026-03-26 23:01:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 32f2c5d7-05a7-5ac7-9808-a1ed87f59377, identifier: 1978519
2026-03-26 23:01:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 32f2c5d7-05a7-5ac7-9808-a1ed87f59377 with identifier: 1978519
2026-03-26 23:01:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 32f2c5d7-05a7-5ac7-9808-a1ed87f59377 with identifier: 1978519
2026-03-26 23:01:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 32f2c5d7-05a7-5ac7-9808-a1ed87f59377 with identifier: 1978519 to the API
2026-03-26 23:01:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:01:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:01:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '32f2c5d7-05a7-5ac7-9808-a1ed87f59377',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 68596,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-14',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-03-26 23:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978519%27 HTTP/1.1" 200 None
2026-03-26 23:01:00 [ayvens.be] INFO: Saving data for 1978519: {'auction_closing_time': 1774854000.0, 'created_time': 1774306014.883411, 'last_price_update_time': 1774566060.522292}
2026-03-26 23:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978519') HTTP/1.1" 204 0
2026-03-26 23:01:00 [ayvens.be] INFO: Found listing with ID: 1978520
2026-03-26 23:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978520%27 HTTP/1.1" 200 None
2026-03-26 23:01:00 [ayvens.be] INFO: Scrape type for 1978520: 2
2026-03-26 23:01:00 [ayvens.be] INFO: Extracting data for car ID: 1978520
2026-03-26 23:01:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 417a8c56-af9b-521e-b580-3853cf048285 with identifier: 1978520
2026-03-26 23:01:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 417a8c56-af9b-521e-b580-3853cf048285 with scrape type 2
2026-03-26 23:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 417a8c56-af9b-521e-b580-3853cf048285 with scrape type 2
2026-03-26 23:01:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 417a8c56-af9b-521e-b580-3853cf048285, identifier: 1978520
2026-03-26 23:01:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 417a8c56-af9b-521e-b580-3853cf048285 with identifier: 1978520
2026-03-26 23:01:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 417a8c56-af9b-521e-b580-3853cf048285 with identifier: 1978520
2026-03-26 23:01:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 417a8c56-af9b-521e-b580-3853cf048285 with identifier: 1978520 to the API
2026-03-26 23:01:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:01:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:01:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '417a8c56-af9b-521e-b580-3853cf048285',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': 'PARTNER',
 'odometer': 70125,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-03',
 'seats_number': 2,
 'seller_name': None,
 'title': 'PEUGEOT PARTNER 1.5 BHDI L2 HEAVY 75KW PREMIUM',
 'transmission': 'manual',
 'trim': '1.5 BHDI L2 HEAVY 75KW PREMIUM',
 'vin': None,
 'year': 2022}
2026-03-26 23:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978520%27 HTTP/1.1" 200 None
2026-03-26 23:01:00 [ayvens.be] INFO: Saving data for 1978520: {'auction_closing_time': 1774854000.0, 'created_time': 1774306037.541312, 'last_price_update_time': 1774566060.967357}
2026-03-26 23:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978520') HTTP/1.1" 204 0
2026-03-26 23:01:00 [ayvens.be] INFO: Found listing with ID: 1978521
2026-03-26 23:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978521%27 HTTP/1.1" 200 None
2026-03-26 23:01:01 [ayvens.be] INFO: Scrape type for 1978521: 2
2026-03-26 23:01:01 [ayvens.be] INFO: Extracting data for car ID: 1978521
2026-03-26 23:01:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e5f14ab2-e5b0-5112-9c0c-5c37fef1f5e2 with identifier: 1978521
2026-03-26 23:01:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5f14ab2-e5b0-5112-9c0c-5c37fef1f5e2 with scrape type 2
2026-03-26 23:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e5f14ab2-e5b0-5112-9c0c-5c37fef1f5e2 with scrape type 2
2026-03-26 23:01:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e5f14ab2-e5b0-5112-9c0c-5c37fef1f5e2, identifier: 1978521
2026-03-26 23:01:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e5f14ab2-e5b0-5112-9c0c-5c37fef1f5e2 with identifier: 1978521
2026-03-26 23:01:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e5f14ab2-e5b0-5112-9c0c-5c37fef1f5e2 with identifier: 1978521
2026-03-26 23:01:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e5f14ab2-e5b0-5112-9c0c-5c37fef1f5e2 with identifier: 1978521 to the API
2026-03-26 23:01:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:01:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:01:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': 'e5f14ab2-e5b0-5112-9c0c-5c37fef1f5e2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A6 AVANT DIESEL - 2018',
 'odometer': 177788,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A6 AVANT DIESEL - 2018 35 TDi Business Edition Sport S tronic',
 'transmission': 'automatic',
 'trim': '35 TDi Business Edition Sport S tronic',
 'vin': None,
 'year': 2020}
2026-03-26 23:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978521%27 HTTP/1.1" 200 None
2026-03-26 23:01:01 [ayvens.be] INFO: Saving data for 1978521: {'auction_closing_time': 1774854000.0, 'created_time': 1774306022.959733, 'last_price_update_time': 1774566061.364709}
2026-03-26 23:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978521') HTTP/1.1" 204 0
2026-03-26 23:01:01 [ayvens.be] INFO: Found listing with ID: 1978522
2026-03-26 23:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978522%27 HTTP/1.1" 200 None
2026-03-26 23:01:01 [ayvens.be] INFO: Scrape type for 1978522: 2
2026-03-26 23:01:01 [ayvens.be] INFO: Extracting data for car ID: 1978522
2026-03-26 23:01:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ac3d0d6-67e5-51de-9d44-61670661c6f7 with identifier: 1978522
2026-03-26 23:01:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ac3d0d6-67e5-51de-9d44-61670661c6f7 with scrape type 2
2026-03-26 23:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2ac3d0d6-67e5-51de-9d44-61670661c6f7 with scrape type 2
2026-03-26 23:01:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 2ac3d0d6-67e5-51de-9d44-61670661c6f7, identifier: 1978522
2026-03-26 23:01:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 2ac3d0d6-67e5-51de-9d44-61670661c6f7 with identifier: 1978522
2026-03-26 23:01:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 2ac3d0d6-67e5-51de-9d44-61670661c6f7 with identifier: 1978522
2026-03-26 23:01:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 2ac3d0d6-67e5-51de-9d44-61670661c6f7 with identifier: 1978522 to the API
2026-03-26 23:01:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:01:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:01:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '2ac3d0d6-67e5-51de-9d44-61670661c6f7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': 'EXPERT FOURGON MWB DSL - 2016',
 'odometer': 103529,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-12',
 'seats_number': 3,
 'seller_name': None,
 'title': 'PEUGEOT EXPERT FOURGON MWB DSL - 2016 2.0 BlueHDi L3 Long Premium '
          'S&S STOCK',
 'transmission': 'manual',
 'trim': '2.0 BlueHDi L3 Long Premium S&S STOCK',
 'vin': None,
 'year': 2017}
2026-03-26 23:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978522%27 HTTP/1.1" 200 None
2026-03-26 23:01:01 [ayvens.be] INFO: Saving data for 1978522: {'auction_closing_time': 1774854000.0, 'created_time': 1774306020.045803, 'last_price_update_time': 1774566061.764909}
2026-03-26 23:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978522') HTTP/1.1" 204 0
2026-03-26 23:01:01 [ayvens.be] INFO: Found listing with ID: 1978523
2026-03-26 23:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978523%27 HTTP/1.1" 200 None
2026-03-26 23:01:01 [ayvens.be] INFO: Scrape type for 1978523: 2
2026-03-26 23:01:01 [ayvens.be] INFO: Extracting data for car ID: 1978523
2026-03-26 23:01:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 621c8a2c-56ec-533e-8c87-ae145ea4084a with identifier: 1978523
2026-03-26 23:01:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 621c8a2c-56ec-533e-8c87-ae145ea4084a with scrape type 2
2026-03-26 23:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 621c8a2c-56ec-533e-8c87-ae145ea4084a with scrape type 2
2026-03-26 23:01:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 621c8a2c-56ec-533e-8c87-ae145ea4084a, identifier: 1978523
2026-03-26 23:01:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 621c8a2c-56ec-533e-8c87-ae145ea4084a with identifier: 1978523
2026-03-26 23:01:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 621c8a2c-56ec-533e-8c87-ae145ea4084a with identifier: 1978523
2026-03-26 23:01:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 621c8a2c-56ec-533e-8c87-ae145ea4084a with identifier: 1978523 to the API
2026-03-26 23:01:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:01:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:01:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'IJSWIT',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '621c8a2c-56ec-533e-8c87-ae145ea4084a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS MAXI DSL - 2013',
 'odometer': 137312,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-19',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS MAXI DSL - 2013 1.5 dCi Energy Grand Confort',
 'transmission': 'manual',
 'trim': '1.5 dCi Energy Grand Confort',
 'vin': None,
 'year': 2018}
2026-03-26 23:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978523%27 HTTP/1.1" 200 None
2026-03-26 23:01:02 [ayvens.be] INFO: Saving data for 1978523: {'auction_closing_time': 1774854000.0, 'created_time': 1774306019.346682, 'last_price_update_time': 1774566062.146148}
2026-03-26 23:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978523') HTTP/1.1" 204 0
2026-03-26 23:01:02 [ayvens.be] INFO: Found listing with ID: 1978524
2026-03-26 23:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978524%27 HTTP/1.1" 200 None
2026-03-26 23:01:02 [ayvens.be] INFO: Scrape type for 1978524: 2
2026-03-26 23:01:02 [ayvens.be] INFO: Extracting data for car ID: 1978524
2026-03-26 23:01:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ede80ffc-fa67-520c-8216-015908eb4f94 with identifier: 1978524
2026-03-26 23:01:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ede80ffc-fa67-520c-8216-015908eb4f94 with scrape type 2
2026-03-26 23:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ede80ffc-fa67-520c-8216-015908eb4f94 with scrape type 2
2026-03-26 23:01:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: ede80ffc-fa67-520c-8216-015908eb4f94, identifier: 1978524
2026-03-26 23:01:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: ede80ffc-fa67-520c-8216-015908eb4f94 with identifier: 1978524
2026-03-26 23:01:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: ede80ffc-fa67-520c-8216-015908eb4f94 with identifier: 1978524
2026-03-26 23:01:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: ede80ffc-fa67-520c-8216-015908eb4f94 with identifier: 1978524 to the API
2026-03-26 23:01:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:01:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:01:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'color': 'BLANC NACRE',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ede80ffc-fa67-520c-8216-015908eb4f94',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '5008 DIESEL - 2017',
 'odometer': 145157,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-05',
 'seats_number': 7,
 'seller_name': None,
 'title': 'PEUGEOT 5008 DIESEL - 2017 1.5 BlueHDi Allure (EU6.2) STOCK',
 'transmission': 'manual',
 'trim': '1.5 BlueHDi Allure (EU6.2) STOCK',
 'vin': None,
 'year': 2019}
2026-03-26 23:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978524%27 HTTP/1.1" 200 None
2026-03-26 23:01:02 [ayvens.be] INFO: Saving data for 1978524: {'auction_closing_time': 1774854000.0, 'created_time': 1774306022.124021, 'last_price_update_time': 1774566062.537668}
2026-03-26 23:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978524') HTTP/1.1" 204 0
2026-03-26 23:01:02 [ayvens.be] INFO: Found listing with ID: 1978525
2026-03-26 23:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978525%27 HTTP/1.1" 200 None
2026-03-26 23:01:02 [ayvens.be] INFO: Scrape type for 1978525: 2
2026-03-26 23:01:02 [ayvens.be] INFO: Extracting data for car ID: 1978525
2026-03-26 23:01:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c162cd1b-f0a8-5d66-aa9d-858044663a69 with identifier: 1978525
2026-03-26 23:01:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c162cd1b-f0a8-5d66-aa9d-858044663a69 with scrape type 2
2026-03-26 23:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c162cd1b-f0a8-5d66-aa9d-858044663a69 with scrape type 2
2026-03-26 23:01:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c162cd1b-f0a8-5d66-aa9d-858044663a69, identifier: 1978525
2026-03-26 23:01:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c162cd1b-f0a8-5d66-aa9d-858044663a69 with identifier: 1978525
2026-03-26 23:01:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c162cd1b-f0a8-5d66-aa9d-858044663a69 with identifier: 1978525
2026-03-26 23:01:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c162cd1b-f0a8-5d66-aa9d-858044663a69 with identifier: 1978525 to the API
2026-03-26 23:01:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:01:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:01:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': 'c162cd1b-f0a8-5d66-aa9d-858044663a69',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS MAXI DIESEL',
 'odometer': 100509,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-14',
 'seats_number': None,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS MAXI DIESEL Lot 1.3 RENAULT KANGOO EXPRESS '
          'Maxi 1.5 dCi Blue Confort',
 'transmission': 'manual',
 'trim': 'Lot 1.3 RENAULT KANGOO EXPRESS Maxi 1.5 dCi Blue Confort',
 'vin': None,
 'year': 2020}
2026-03-26 23:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978525%27 HTTP/1.1" 200 None
2026-03-26 23:01:02 [ayvens.be] INFO: Saving data for 1978525: {'auction_closing_time': 1774854000.0, 'created_time': 1774306024.823426, 'last_price_update_time': 1774566062.955655}
2026-03-26 23:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978525') HTTP/1.1" 204 0
2026-03-26 23:01:02 [ayvens.be] INFO: Found listing with ID: 1978526
2026-03-26 23:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978526%27 HTTP/1.1" 200 None
2026-03-26 23:01:03 [ayvens.be] INFO: Scrape type for 1978526: 2
2026-03-26 23:01:03 [ayvens.be] INFO: Extracting data for car ID: 1978526
2026-03-26 23:01:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b7fc583-cd99-5b42-b0df-f3c3aa4d6cf7 with identifier: 1978526
2026-03-26 23:01:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b7fc583-cd99-5b42-b0df-f3c3aa4d6cf7 with scrape type 2
2026-03-26 23:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7b7fc583-cd99-5b42-b0df-f3c3aa4d6cf7 with scrape type 2
2026-03-26 23:01:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 7b7fc583-cd99-5b42-b0df-f3c3aa4d6cf7, identifier: 1978526
2026-03-26 23:01:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 7b7fc583-cd99-5b42-b0df-f3c3aa4d6cf7 with identifier: 1978526
2026-03-26 23:01:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 7b7fc583-cd99-5b42-b0df-f3c3aa4d6cf7 with identifier: 1978526
2026-03-26 23:01:03 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 7b7fc583-cd99-5b42-b0df-f3c3aa4d6cf7 with identifier: 1978526 to the API
2026-03-26 23:01:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:01:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:01:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '7b7fc583-cd99-5b42-b0df-f3c3aa4d6cf7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT 2T 350L FOU LWB HR DSL',
 'odometer': 1,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-05-19',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FORD TRANSIT 2T 350L FOU LWB HR DSL 2.0 TDCi L3H2 Trend',
 'transmission': 'automatic',
 'trim': '2.0 TDCi L3H2 Trend',
 'vin': None,
 'year': 2020}
2026-03-26 23:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978526%27 HTTP/1.1" 200 None
2026-03-26 23:01:03 [ayvens.be] INFO: Saving data for 1978526: {'auction_closing_time': 1774854000.0, 'created_time': 1774306032.150657, 'last_price_update_time': 1774566063.362607}
2026-03-26 23:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978526') HTTP/1.1" 204 0
2026-03-26 23:01:03 [ayvens.be] INFO: Found listing with ID: 1978527
2026-03-26 23:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978527%27 HTTP/1.1" 200 None
2026-03-26 23:01:03 [ayvens.be] INFO: Scrape type for 1978527: 2
2026-03-26 23:01:03 [ayvens.be] INFO: Extracting data for car ID: 1978527
2026-03-26 23:01:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 74ae79bb-c687-5941-80f0-bb5bc5a8f0e8 with identifier: 1978527
2026-03-26 23:01:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74ae79bb-c687-5941-80f0-bb5bc5a8f0e8 with scrape type 2
2026-03-26 23:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 74ae79bb-c687-5941-80f0-bb5bc5a8f0e8 with scrape type 2
2026-03-26 23:01:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 74ae79bb-c687-5941-80f0-bb5bc5a8f0e8, identifier: 1978527
2026-03-26 23:01:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 74ae79bb-c687-5941-80f0-bb5bc5a8f0e8 with identifier: 1978527
2026-03-26 23:01:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 74ae79bb-c687-5941-80f0-bb5bc5a8f0e8 with identifier: 1978527
2026-03-26 23:01:03 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 74ae79bb-c687-5941-80f0-bb5bc5a8f0e8 with identifier: 1978527 to the API
2026-03-26 23:01:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:01:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:01:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '74ae79bb-c687-5941-80f0-bb5bc5a8f0e8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A4 AVANT',
 'odometer': 133993,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A4 AVANT 2.0 35 TDI 120KW S TR S LINE BUSINESS ED',
 'transmission': 'automatic',
 'trim': '2.0 35 TDI 120KW S TR S LINE BUSINESS ED',
 'vin': None,
 'year': 2020}
2026-03-26 23:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978527%27 HTTP/1.1" 200 None
2026-03-26 23:01:03 [ayvens.be] INFO: Saving data for 1978527: {'auction_closing_time': 1774854000.0, 'created_time': 1774306027.420883, 'last_price_update_time': 1774566063.768687}
2026-03-26 23:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978527') HTTP/1.1" 204 0
2026-03-26 23:01:03 [ayvens.be] INFO: Found listing with ID: 1978528
2026-03-26 23:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978528%27 HTTP/1.1" 200 None
2026-03-26 23:01:03 [ayvens.be] INFO: Scrape type for 1978528: 2
2026-03-26 23:01:03 [ayvens.be] INFO: Extracting data for car ID: 1978528
2026-03-26 23:01:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 85a756ef-87cd-5fbf-967b-f33557744fc5 with identifier: 1978528
2026-03-26 23:01:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85a756ef-87cd-5fbf-967b-f33557744fc5 with scrape type 2
2026-03-26 23:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 85a756ef-87cd-5fbf-967b-f33557744fc5 with scrape type 2
2026-03-26 23:01:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 85a756ef-87cd-5fbf-967b-f33557744fc5, identifier: 1978528
2026-03-26 23:01:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 85a756ef-87cd-5fbf-967b-f33557744fc5 with identifier: 1978528
2026-03-26 23:01:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 85a756ef-87cd-5fbf-967b-f33557744fc5 with identifier: 1978528
2026-03-26 23:01:03 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 85a756ef-87cd-5fbf-967b-f33557744fc5 with identifier: 1978528 to the API
2026-03-26 23:01:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:01:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:01:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '85a756ef-87cd-5fbf-967b-f33557744fc5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 54570,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-04',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-03-26 23:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978528%27 HTTP/1.1" 200 None
2026-03-26 23:01:04 [ayvens.be] INFO: Saving data for 1978528: {'auction_closing_time': 1774854000.0, 'created_time': 1774306029.160378, 'last_price_update_time': 1774566064.179319}
2026-03-26 23:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978528') HTTP/1.1" 204 0
2026-03-26 23:01:04 [ayvens.be] INFO: Found listing with ID: 1978529
2026-03-26 23:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978529%27 HTTP/1.1" 200 None
2026-03-26 23:01:04 [ayvens.be] INFO: Scrape type for 1978529: 2
2026-03-26 23:01:04 [ayvens.be] INFO: Extracting data for car ID: 1978529
2026-03-26 23:01:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce6f2a4e-0964-55ca-a00b-00998c38e97b with identifier: 1978529
2026-03-26 23:01:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce6f2a4e-0964-55ca-a00b-00998c38e97b with scrape type 2
2026-03-26 23:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ce6f2a4e-0964-55ca-a00b-00998c38e97b with scrape type 2
2026-03-26 23:01:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: ce6f2a4e-0964-55ca-a00b-00998c38e97b, identifier: 1978529
2026-03-26 23:01:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: ce6f2a4e-0964-55ca-a00b-00998c38e97b with identifier: 1978529
2026-03-26 23:01:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: ce6f2a4e-0964-55ca-a00b-00998c38e97b with identifier: 1978529
2026-03-26 23:01:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: ce6f2a4e-0964-55ca-a00b-00998c38e97b with identifier: 1978529 to the API
2026-03-26 23:01:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:01:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:01:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ce6f2a4e-0964-55ca-a00b-00998c38e97b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 212761,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 2008 1.5 BLUEHDI 81KW S-S ACTIVE',
 'transmission': 'manual',
 'trim': '1.5 BLUEHDI 81KW S-S ACTIVE',
 'vin': None,
 'year': 2021}
2026-03-26 23:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978529%27 HTTP/1.1" 200 None
2026-03-26 23:01:04 [ayvens.be] INFO: Saving data for 1978529: {'auction_closing_time': 1774854000.0, 'created_time': 1774306031.397081, 'last_price_update_time': 1774566064.650289}
2026-03-26 23:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978529') HTTP/1.1" 204 0
2026-03-26 23:01:04 [ayvens.be] INFO: Found listing with ID: 1978530
2026-03-26 23:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978530%27 HTTP/1.1" 200 None
2026-03-26 23:01:04 [ayvens.be] INFO: Scrape type for 1978530: 2
2026-03-26 23:01:04 [ayvens.be] INFO: Extracting data for car ID: 1978530
2026-03-26 23:01:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 63a7700a-9aab-5b25-81db-fb8e247c112d with identifier: 1978530
2026-03-26 23:01:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63a7700a-9aab-5b25-81db-fb8e247c112d with scrape type 2
2026-03-26 23:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 63a7700a-9aab-5b25-81db-fb8e247c112d with scrape type 2
2026-03-26 23:01:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 63a7700a-9aab-5b25-81db-fb8e247c112d, identifier: 1978530
2026-03-26 23:01:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 63a7700a-9aab-5b25-81db-fb8e247c112d with identifier: 1978530
2026-03-26 23:01:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 63a7700a-9aab-5b25-81db-fb8e247c112d with identifier: 1978530
2026-03-26 23:01:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 63a7700a-9aab-5b25-81db-fb8e247c112d with identifier: 1978530 to the API
2026-03-26 23:01:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:01:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:01:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'petrol',
 'id': '63a7700a-9aab-5b25-81db-fb8e247c112d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'MULTIVAN',
 'odometer': 124374,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-16',
 'seats_number': 7,
 'seller_name': None,
 'title': 'VOLKSWAGEN MULTIVAN 1.4 EHYBRID PHEV DSG ENERGETIC',
 'transmission': 'automatic',
 'trim': '1.4 EHYBRID PHEV DSG ENERGETIC',
 'vin': None,
 'year': 2022}
2026-03-26 23:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978530%27 HTTP/1.1" 200 None
2026-03-26 23:01:05 [ayvens.be] INFO: Saving data for 1978530: {'auction_closing_time': 1774854000.0, 'created_time': 1774306033.824887, 'last_price_update_time': 1774566065.031553}
2026-03-26 23:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978530') HTTP/1.1" 204 0
2026-03-26 23:01:05 [ayvens.be] INFO: Found listing with ID: 1978531
2026-03-26 23:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978531%27 HTTP/1.1" 200 None
2026-03-26 23:01:05 [ayvens.be] INFO: Scrape type for 1978531: 2
2026-03-26 23:01:05 [ayvens.be] INFO: Extracting data for car ID: 1978531
2026-03-26 23:01:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73c85626-29d2-535a-8e62-d33afc1b51be with identifier: 1978531
2026-03-26 23:01:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73c85626-29d2-535a-8e62-d33afc1b51be with scrape type 2
2026-03-26 23:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 73c85626-29d2-535a-8e62-d33afc1b51be with scrape type 2
2026-03-26 23:01:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 73c85626-29d2-535a-8e62-d33afc1b51be, identifier: 1978531
2026-03-26 23:01:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 73c85626-29d2-535a-8e62-d33afc1b51be with identifier: 1978531
2026-03-26 23:01:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 73c85626-29d2-535a-8e62-d33afc1b51be with identifier: 1978531
2026-03-26 23:01:05 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 73c85626-29d2-535a-8e62-d33afc1b51be with identifier: 1978531 to the API
2026-03-26 23:01:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:01:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:01:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '73c85626-29d2-535a-8e62-d33afc1b51be',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TRANSPORTER 1400 FOU LWB DSL -',
 'odometer': 212303,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-08',
 'seats_number': 3,
 'seller_name': None,
 'title': 'VOLKSWAGEN TRANSPORTER 1400 FOU LWB DSL - 2.0 TDi SCR 4Motion BMT '
          'DSG',
 'transmission': 'automatic',
 'trim': '2.0 TDi SCR 4Motion BMT DSG',
 'vin': None,
 'year': 2019}
2026-03-26 23:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978531%27 HTTP/1.1" 200 None
2026-03-26 23:01:05 [ayvens.be] INFO: Saving data for 1978531: {'auction_closing_time': 1774854000.0, 'created_time': 1774306035.537882, 'last_price_update_time': 1774566065.421008}
2026-03-26 23:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978531') HTTP/1.1" 204 0
2026-03-26 23:01:05 [ayvens.be] INFO: Found listing with ID: 1978532
2026-03-26 23:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978532%27 HTTP/1.1" 200 None
2026-03-26 23:01:05 [ayvens.be] INFO: Scrape type for 1978532: 2
2026-03-26 23:01:05 [ayvens.be] INFO: Extracting data for car ID: 1978532
2026-03-26 23:01:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f78ca9b8-6ba8-5b62-a87e-d07ef5e0df5f with identifier: 1978532
2026-03-26 23:01:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f78ca9b8-6ba8-5b62-a87e-d07ef5e0df5f with scrape type 2
2026-03-26 23:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f78ca9b8-6ba8-5b62-a87e-d07ef5e0df5f with scrape type 2
2026-03-26 23:01:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f78ca9b8-6ba8-5b62-a87e-d07ef5e0df5f, identifier: 1978532
2026-03-26 23:01:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f78ca9b8-6ba8-5b62-a87e-d07ef5e0df5f with identifier: 1978532
2026-03-26 23:01:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f78ca9b8-6ba8-5b62-a87e-d07ef5e0df5f with identifier: 1978532
2026-03-26 23:01:05 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f78ca9b8-6ba8-5b62-a87e-d07ef5e0df5f with identifier: 1978532 to the API
2026-03-26 23:01:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:01:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:01:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': 'f78ca9b8-6ba8-5b62-a87e-d07ef5e0df5f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'CITROAu2039N',
 'model': 'BERLINGO',
 'odometer': 36721,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-11',
 'seats_number': 2,
 'seller_name': None,
 'title': 'CITROAu2039N BERLINGO 1.5 BLUEHDI 100 XL HEAVY CLUB',
 'transmission': 'manual',
 'trim': '1.5 BLUEHDI 100 XL HEAVY CLUB',
 'vin': None,
 'year': 2022}
2026-03-26 23:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978532%27 HTTP/1.1" 200 None
2026-03-26 23:01:05 [ayvens.be] INFO: Saving data for 1978532: {'auction_closing_time': 1774854000.0, 'created_time': 1774306036.684049, 'last_price_update_time': 1774566065.814211}
2026-03-26 23:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978532') HTTP/1.1" 204 0
2026-03-26 23:01:05 [ayvens.be] INFO: Found listing with ID: 1978542
2026-03-26 23:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978542%27 HTTP/1.1" 200 None
2026-03-26 23:01:05 [ayvens.be] INFO: Scrape type for 1978542: 0
2026-03-26 23:01:05 [ayvens.be] INFO: Found listing with ID: 1978543
2026-03-26 23:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978543%27 HTTP/1.1" 200 None
2026-03-26 23:01:05 [ayvens.be] INFO: Scrape type for 1978543: 0
2026-03-26 23:01:05 [ayvens.be] INFO: Found listing with ID: 1978544
2026-03-26 23:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978544%27 HTTP/1.1" 200 None
2026-03-26 23:01:05 [ayvens.be] INFO: Scrape type for 1978544: 0
2026-03-26 23:01:05 [ayvens.be] INFO: Found listing with ID: 1978545
2026-03-26 23:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978545%27 HTTP/1.1" 200 None
2026-03-26 23:01:05 [ayvens.be] INFO: Scrape type for 1978545: 0
2026-03-26 23:01:05 [ayvens.be] INFO: Found listing with ID: 1978546
2026-03-26 23:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978546%27 HTTP/1.1" 200 None
2026-03-26 23:01:05 [ayvens.be] INFO: Scrape type for 1978546: 0
2026-03-26 23:01:05 [ayvens.be] INFO: Found listing with ID: 1978547
2026-03-26 23:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978547%27 HTTP/1.1" 200 None
2026-03-26 23:01:05 [ayvens.be] INFO: Scrape type for 1978547: 0
2026-03-26 23:01:05 [ayvens.be] INFO: Found listing with ID: 1978548
2026-03-26 23:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978548%27 HTTP/1.1" 200 None
2026-03-26 23:01:05 [ayvens.be] INFO: Scrape type for 1978548: 0
2026-03-26 23:01:05 [ayvens.be] INFO: Found listing with ID: 1978549
2026-03-26 23:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978549%27 HTTP/1.1" 200 None
2026-03-26 23:01:06 [ayvens.be] INFO: Scrape type for 1978549: 0
2026-03-26 23:01:06 [ayvens.be] INFO: Found listing with ID: 1978550
2026-03-26 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978550%27 HTTP/1.1" 200 None
2026-03-26 23:01:06 [ayvens.be] INFO: Scrape type for 1978550: 0
2026-03-26 23:01:06 [ayvens.be] INFO: Found listing with ID: 1978551
2026-03-26 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978551%27 HTTP/1.1" 200 None
2026-03-26 23:01:06 [ayvens.be] INFO: Scrape type for 1978551: 0
2026-03-26 23:01:06 [ayvens.be] INFO: Found listing with ID: 1978552
2026-03-26 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978552%27 HTTP/1.1" 200 None
2026-03-26 23:01:06 [ayvens.be] INFO: Scrape type for 1978552: 0
2026-03-26 23:01:06 [ayvens.be] INFO: Found listing with ID: 1978553
2026-03-26 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978553%27 HTTP/1.1" 200 None
2026-03-26 23:01:06 [ayvens.be] INFO: Scrape type for 1978553: 0
2026-03-26 23:01:06 [ayvens.be] INFO: Found listing with ID: 1978554
2026-03-26 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978554%27 HTTP/1.1" 200 None
2026-03-26 23:01:06 [ayvens.be] INFO: Scrape type for 1978554: 0
2026-03-26 23:01:06 [ayvens.be] INFO: Found listing with ID: 1978555
2026-03-26 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978555%27 HTTP/1.1" 200 None
2026-03-26 23:01:06 [ayvens.be] INFO: Scrape type for 1978555: 0
2026-03-26 23:01:06 [ayvens.be] INFO: Found listing with ID: 1978556
2026-03-26 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978556%27 HTTP/1.1" 200 None
2026-03-26 23:01:06 [ayvens.be] INFO: Scrape type for 1978556: 0
2026-03-26 23:01:06 [ayvens.be] INFO: Found listing with ID: 1978557
2026-03-26 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978557%27 HTTP/1.1" 200 None
2026-03-26 23:01:06 [ayvens.be] INFO: Scrape type for 1978557: 0
2026-03-26 23:01:06 [ayvens.be] INFO: Found listing with ID: 1978558
2026-03-26 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978558%27 HTTP/1.1" 200 None
2026-03-26 23:01:06 [ayvens.be] INFO: Scrape type for 1978558: 0
2026-03-26 23:01:06 [ayvens.be] INFO: Found listing with ID: 1978559
2026-03-26 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978559%27 HTTP/1.1" 200 None
2026-03-26 23:01:06 [ayvens.be] INFO: Scrape type for 1978559: 0
2026-03-26 23:01:06 [ayvens.be] INFO: Found listing with ID: 1978560
2026-03-26 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978560%27 HTTP/1.1" 200 None
2026-03-26 23:01:06 [ayvens.be] INFO: Scrape type for 1978560: 0
2026-03-26 23:01:06 [ayvens.be] INFO: Found listing with ID: 1978561
2026-03-26 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978561%27 HTTP/1.1" 200 None
2026-03-26 23:01:06 [ayvens.be] INFO: Scrape type for 1978561: 0
2026-03-26 23:01:06 [ayvens.be] INFO: Found listing with ID: 1978562
2026-03-26 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978562%27 HTTP/1.1" 200 None
2026-03-26 23:01:06 [ayvens.be] INFO: Scrape type for 1978562: 0
2026-03-26 23:01:06 [ayvens.be] INFO: Found listing with ID: 1978563
2026-03-26 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978563%27 HTTP/1.1" 200 None
2026-03-26 23:01:06 [ayvens.be] INFO: Scrape type for 1978563: 0
2026-03-26 23:01:06 [ayvens.be] INFO: Found listing with ID: 1978564
2026-03-26 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978564%27 HTTP/1.1" 200 None
2026-03-26 23:01:06 [ayvens.be] INFO: Scrape type for 1978564: 0
2026-03-26 23:01:06 [ayvens.be] INFO: Found listing with ID: 1978565
2026-03-26 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978565%27 HTTP/1.1" 200 None
2026-03-26 23:01:06 [ayvens.be] INFO: Scrape type for 1978565: 0
2026-03-26 23:01:06 [ayvens.be] INFO: Found listing with ID: 1978566
2026-03-26 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978566%27 HTTP/1.1" 200 None
2026-03-26 23:01:06 [ayvens.be] INFO: Scrape type for 1978566: 0
2026-03-26 23:01:06 [ayvens.be] INFO: Found listing with ID: 1978567
2026-03-26 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978567%27 HTTP/1.1" 200 None
2026-03-26 23:01:06 [ayvens.be] INFO: Scrape type for 1978567: 0
2026-03-26 23:01:06 [ayvens.be] INFO: Found listing with ID: 1978568
2026-03-26 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978568%27 HTTP/1.1" 200 None
2026-03-26 23:01:06 [ayvens.be] INFO: Scrape type for 1978568: 0
2026-03-26 23:01:06 [ayvens.be] INFO: Found listing with ID: 1978569
2026-03-26 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978569%27 HTTP/1.1" 200 None
2026-03-26 23:01:06 [ayvens.be] INFO: Scrape type for 1978569: 0
2026-03-26 23:01:06 [ayvens.be] INFO: Found listing with ID: 1978570
2026-03-26 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978570%27 HTTP/1.1" 200 None
2026-03-26 23:01:06 [ayvens.be] INFO: Scrape type for 1978570: 0
2026-03-26 23:01:06 [ayvens.be] INFO: Found listing with ID: 1978571
2026-03-26 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978571%27 HTTP/1.1" 200 None
2026-03-26 23:01:06 [ayvens.be] INFO: Scrape type for 1978571: 0
2026-03-26 23:01:06 [ayvens.be] INFO: Found listing with ID: 1978572
2026-03-26 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978572%27 HTTP/1.1" 200 None
2026-03-26 23:01:06 [ayvens.be] INFO: Scrape type for 1978572: 0
2026-03-26 23:01:06 [ayvens.be] INFO: Found listing with ID: 1977588
2026-03-26 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977588%27 HTTP/1.1" 200 None
2026-03-26 23:01:06 [ayvens.be] INFO: Scrape type for 1977588: 2
2026-03-26 23:01:06 [ayvens.be] INFO: Extracting data for car ID: 1977588
2026-03-26 23:01:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: abb2b1fe-1187-5175-98ae-c32eb513fadd with identifier: 1977588
2026-03-26 23:01:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item abb2b1fe-1187-5175-98ae-c32eb513fadd with scrape type 2
2026-03-26 23:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item abb2b1fe-1187-5175-98ae-c32eb513fadd with scrape type 2
2026-03-26 23:01:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: abb2b1fe-1187-5175-98ae-c32eb513fadd, identifier: 1977588
2026-03-26 23:01:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: abb2b1fe-1187-5175-98ae-c32eb513fadd with identifier: 1977588
2026-03-26 23:01:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: abb2b1fe-1187-5175-98ae-c32eb513fadd with identifier: 1977588
2026-03-26 23:01:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: abb2b1fe-1187-5175-98ae-c32eb513fadd with identifier: 1977588 to the API
2026-03-26 23:01:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:01:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:01:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'abb2b1fe-1187-5175-98ae-c32eb513fadd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF VIII',
 'odometer': 48824,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF VIII 1.0 TSI 81KW ACTIVE',
 'transmission': 'manual',
 'trim': '1.0 TSI 81KW ACTIVE',
 'vin': None,
 'year': 2021}
2026-03-26 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977588%27 HTTP/1.1" 200 None
2026-03-26 23:01:06 [ayvens.be] INFO: Saving data for 1977588: {'auction_closing_time': 1774600200.0, 'created_time': 1774306041.233719, 'last_price_update_time': 1774566066.869225}
2026-03-26 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977588') HTTP/1.1" 204 0
2026-03-26 23:01:06 [ayvens.be] INFO: Found listing with ID: 1977589
2026-03-26 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977589%27 HTTP/1.1" 200 None
2026-03-26 23:01:06 [ayvens.be] INFO: Scrape type for 1977589: 2
2026-03-26 23:01:06 [ayvens.be] INFO: Extracting data for car ID: 1977589
2026-03-26 23:01:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5bd88324-1259-50cd-b0e6-dc66d9bc91ca with identifier: 1977589
2026-03-26 23:01:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5bd88324-1259-50cd-b0e6-dc66d9bc91ca with scrape type 2
2026-03-26 23:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5bd88324-1259-50cd-b0e6-dc66d9bc91ca with scrape type 2
2026-03-26 23:01:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 5bd88324-1259-50cd-b0e6-dc66d9bc91ca, identifier: 1977589
2026-03-26 23:01:07 [scrapy.extensions.logstats] INFO: Crawled 11 pages (at 1 pages/min), scraped 793 items (at 109 items/min)
2026-03-26 23:01:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 182MiB
2026-03-26 23:01:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 5bd88324-1259-50cd-b0e6-dc66d9bc91ca with identifier: 1977589
2026-03-26 23:01:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 5bd88324-1259-50cd-b0e6-dc66d9bc91ca with identifier: 1977589
2026-03-26 23:01:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 5bd88324-1259-50cd-b0e6-dc66d9bc91ca with identifier: 1977589 to the API
2026-03-26 23:01:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:01:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:01:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '5bd88324-1259-50cd-b0e6-dc66d9bc91ca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT 2T 350M FOU MWB HR DSL',
 'odometer': 138981,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-10',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FORD TRANSIT 2T 350M FOU MWB HR DSL 2.0 TDCi L2H2 Trend',
 'transmission': 'manual',
 'trim': '2.0 TDCi L2H2 Trend',
 'vin': None,
 'year': 2018}
2026-03-26 23:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977589%27 HTTP/1.1" 200 None
2026-03-26 23:01:07 [ayvens.be] INFO: Saving data for 1977589: {'auction_closing_time': 1774600200.0, 'created_time': 1774306043.050818, 'last_price_update_time': 1774566067.345836}
2026-03-26 23:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977589') HTTP/1.1" 204 0
2026-03-26 23:01:07 [ayvens.be] INFO: Found listing with ID: 1977590
2026-03-26 23:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977590%27 HTTP/1.1" 200 None
2026-03-26 23:01:07 [ayvens.be] INFO: Scrape type for 1977590: 2
2026-03-26 23:01:07 [ayvens.be] INFO: Extracting data for car ID: 1977590
2026-03-26 23:01:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 932666f8-0f6a-5088-b3d6-cbe5b8a89457 with identifier: 1977590
2026-03-26 23:01:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 932666f8-0f6a-5088-b3d6-cbe5b8a89457 with scrape type 2
2026-03-26 23:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 932666f8-0f6a-5088-b3d6-cbe5b8a89457 with scrape type 2
2026-03-26 23:01:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 932666f8-0f6a-5088-b3d6-cbe5b8a89457, identifier: 1977590
2026-03-26 23:01:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 932666f8-0f6a-5088-b3d6-cbe5b8a89457 with identifier: 1977590
2026-03-26 23:01:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 932666f8-0f6a-5088-b3d6-cbe5b8a89457 with identifier: 1977590
2026-03-26 23:01:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 932666f8-0f6a-5088-b3d6-cbe5b8a89457 with identifier: 1977590 to the API
2026-03-26 23:01:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:01:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:01:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '932666f8-0f6a-5088-b3d6-cbe5b8a89457',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO',
 'odometer': 51223,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT KANGOO 1.3 TCE 130 TECHNO',
 'transmission': 'manual',
 'trim': '1.3 TCE 130 TECHNO',
 'vin': None,
 'year': 2023}
2026-03-26 23:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977590%27 HTTP/1.1" 200 None
2026-03-26 23:01:07 [ayvens.be] INFO: Saving data for 1977590: {'auction_closing_time': 1774600200.0, 'created_time': 1774306042.219191, 'last_price_update_time': 1774566067.73741}
2026-03-26 23:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977590') HTTP/1.1" 204 0
2026-03-26 23:01:07 [ayvens.be] INFO: Found listing with ID: 1977591
2026-03-26 23:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977591%27 HTTP/1.1" 200 None
2026-03-26 23:01:07 [ayvens.be] INFO: Scrape type for 1977591: 2
2026-03-26 23:01:07 [ayvens.be] INFO: Extracting data for car ID: 1977591
2026-03-26 23:01:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34d4de2a-4015-517f-96a4-5e1712ae4e3c with identifier: 1977591
2026-03-26 23:01:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34d4de2a-4015-517f-96a4-5e1712ae4e3c with scrape type 2
2026-03-26 23:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 34d4de2a-4015-517f-96a4-5e1712ae4e3c with scrape type 2
2026-03-26 23:01:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 34d4de2a-4015-517f-96a4-5e1712ae4e3c, identifier: 1977591
2026-03-26 23:01:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 34d4de2a-4015-517f-96a4-5e1712ae4e3c with identifier: 1977591
2026-03-26 23:01:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 34d4de2a-4015-517f-96a4-5e1712ae4e3c with identifier: 1977591
2026-03-26 23:01:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 34d4de2a-4015-517f-96a4-5e1712ae4e3c with identifier: 1977591 to the API
2026-03-26 23:01:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:01:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:01:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '34d4de2a-4015-517f-96a4-5e1712ae4e3c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '508 DIESEL - 2018',
 'odometer': 171581,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 508 DIESEL - 2018 1.5 BlueHDi Allure S&S',
 'transmission': 'automatic',
 'trim': '1.5 BlueHDi Allure S&S',
 'vin': None,
 'year': 2019}
2026-03-26 23:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977591%27 HTTP/1.1" 200 None
2026-03-26 23:01:08 [ayvens.be] INFO: Saving data for 1977591: {'auction_closing_time': 1774600200.0, 'created_time': 1774306044.059916, 'last_price_update_time': 1774566068.149471}
2026-03-26 23:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977591') HTTP/1.1" 204 0
2026-03-26 23:01:08 [ayvens.be] INFO: Found listing with ID: 1977592
2026-03-26 23:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977592%27 HTTP/1.1" 200 None
2026-03-26 23:01:08 [ayvens.be] INFO: Scrape type for 1977592: 2
2026-03-26 23:01:08 [ayvens.be] INFO: Extracting data for car ID: 1977592
2026-03-26 23:01:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d850c4ed-2023-5c25-a4d6-4cd243c4fccc with identifier: 1977592
2026-03-26 23:01:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d850c4ed-2023-5c25-a4d6-4cd243c4fccc with scrape type 2
2026-03-26 23:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d850c4ed-2023-5c25-a4d6-4cd243c4fccc with scrape type 2
2026-03-26 23:01:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d850c4ed-2023-5c25-a4d6-4cd243c4fccc, identifier: 1977592
2026-03-26 23:01:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d850c4ed-2023-5c25-a4d6-4cd243c4fccc with identifier: 1977592
2026-03-26 23:01:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d850c4ed-2023-5c25-a4d6-4cd243c4fccc with identifier: 1977592
2026-03-26 23:01:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d850c4ed-2023-5c25-a4d6-4cd243c4fccc with identifier: 1977592 to the API
2026-03-26 23:01:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:01:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:01:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'd850c4ed-2023-5c25-a4d6-4cd243c4fccc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'LEON ST',
 'odometer': 64414,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT LEON ST 1.5 TSI 130 MOVE!',
 'transmission': 'manual',
 'trim': '1.5 TSI 130 MOVE!',
 'vin': None,
 'year': 2021}
2026-03-26 23:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977592%27 HTTP/1.1" 200 None
2026-03-26 23:01:08 [ayvens.be] INFO: Saving data for 1977592: {'auction_closing_time': 1774600200.0, 'created_time': 1774306045.966308, 'last_price_update_time': 1774566068.547116}
2026-03-26 23:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977592') HTTP/1.1" 204 0
2026-03-26 23:01:08 [ayvens.be] INFO: Found listing with ID: 1977593
2026-03-26 23:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977593%27 HTTP/1.1" 200 None
2026-03-26 23:01:08 [ayvens.be] INFO: Scrape type for 1977593: 2
2026-03-26 23:01:08 [ayvens.be] INFO: Extracting data for car ID: 1977593
2026-03-26 23:01:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e90ffccc-9938-5977-bc0e-6e08036ae069 with identifier: 1977593
2026-03-26 23:01:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e90ffccc-9938-5977-bc0e-6e08036ae069 with scrape type 2
2026-03-26 23:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e90ffccc-9938-5977-bc0e-6e08036ae069 with scrape type 2
2026-03-26 23:01:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e90ffccc-9938-5977-bc0e-6e08036ae069, identifier: 1977593
2026-03-26 23:01:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e90ffccc-9938-5977-bc0e-6e08036ae069 with identifier: 1977593
2026-03-26 23:01:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e90ffccc-9938-5977-bc0e-6e08036ae069 with identifier: 1977593
2026-03-26 23:01:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e90ffccc-9938-5977-bc0e-6e08036ae069 with identifier: 1977593 to the API
2026-03-26 23:01:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:01:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:01:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'e90ffccc-9938-5977-bc0e-6e08036ae069',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF VII - 2017',
 'odometer': 77662,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF VII - 2017 1.0 TSI IQ.Drive OPF (EU6.2) STOCK',
 'transmission': 'manual',
 'trim': '1.0 TSI IQ.Drive OPF (EU6.2) STOCK',
 'vin': None,
 'year': 2020}
2026-03-26 23:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977593%27 HTTP/1.1" 200 None
2026-03-26 23:01:08 [ayvens.be] INFO: Saving data for 1977593: {'auction_closing_time': 1774600200.0, 'created_time': 1774306047.666412, 'last_price_update_time': 1774566068.963287}
2026-03-26 23:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977593') HTTP/1.1" 204 0
2026-03-26 23:01:08 [ayvens.be] INFO: Found listing with ID: 1977594
2026-03-26 23:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977594%27 HTTP/1.1" 200 None
2026-03-26 23:01:09 [ayvens.be] INFO: Scrape type for 1977594: 2
2026-03-26 23:01:09 [ayvens.be] INFO: Extracting data for car ID: 1977594
2026-03-26 23:01:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a96b1911-50f3-590a-a4ec-e5a03ecf00e9 with identifier: 1977594
2026-03-26 23:01:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a96b1911-50f3-590a-a4ec-e5a03ecf00e9 with scrape type 2
2026-03-26 23:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a96b1911-50f3-590a-a4ec-e5a03ecf00e9 with scrape type 2
2026-03-26 23:01:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a96b1911-50f3-590a-a4ec-e5a03ecf00e9, identifier: 1977594
2026-03-26 23:01:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a96b1911-50f3-590a-a4ec-e5a03ecf00e9 with identifier: 1977594
2026-03-26 23:01:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a96b1911-50f3-590a-a4ec-e5a03ecf00e9 with identifier: 1977594
2026-03-26 23:01:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a96b1911-50f3-590a-a4ec-e5a03ecf00e9 with identifier: 1977594 to the API
2026-03-26 23:01:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:01:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:01:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'a96b1911-50f3-590a-a4ec-e5a03ecf00e9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'OCTAVIA COMBI',
 'odometer': 74135,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA OCTAVIA COMBI 1.5 TSI ACT 110KW DSG7 STYLE',
 'transmission': 'automatic',
 'trim': '1.5 TSI ACT 110KW DSG7 STYLE',
 'vin': None,
 'year': 2021}
2026-03-26 23:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977594%27 HTTP/1.1" 200 None
2026-03-26 23:01:09 [ayvens.be] INFO: Saving data for 1977594: {'auction_closing_time': 1774600200.0, 'created_time': 1774306048.761324, 'last_price_update_time': 1774566069.505516}
2026-03-26 23:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977594') HTTP/1.1" 204 0
2026-03-26 23:01:09 [ayvens.be] INFO: Found listing with ID: 1977595
2026-03-26 23:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977595%27 HTTP/1.1" 200 None
2026-03-26 23:01:09 [ayvens.be] INFO: Scrape type for 1977595: 2
2026-03-26 23:01:09 [ayvens.be] INFO: Extracting data for car ID: 1977595
2026-03-26 23:01:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d0f10890-fbfa-5c4d-bf38-f27198dee1ba with identifier: 1977595
2026-03-26 23:01:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0f10890-fbfa-5c4d-bf38-f27198dee1ba with scrape type 2
2026-03-26 23:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d0f10890-fbfa-5c4d-bf38-f27198dee1ba with scrape type 2
2026-03-26 23:01:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d0f10890-fbfa-5c4d-bf38-f27198dee1ba, identifier: 1977595
2026-03-26 23:01:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d0f10890-fbfa-5c4d-bf38-f27198dee1ba with identifier: 1977595
2026-03-26 23:01:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d0f10890-fbfa-5c4d-bf38-f27198dee1ba with identifier: 1977595
2026-03-26 23:01:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d0f10890-fbfa-5c4d-bf38-f27198dee1ba with identifier: 1977595 to the API
2026-03-26 23:01:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:01:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:01:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'd0f10890-fbfa-5c4d-bf38-f27198dee1ba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A3 SPORTBACK',
 'odometer': 89450,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A3 SPORTBACK 1.4 40 TFSI E S TRONIC SPORTB ATTRACTION',
 'transmission': 'automatic',
 'trim': '1.4 40 TFSI E S TRONIC SPORTB ATTRACTION',
 'vin': None,
 'year': 2023}
2026-03-26 23:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977595%27 HTTP/1.1" 200 None
2026-03-26 23:01:09 [ayvens.be] INFO: Saving data for 1977595: {'auction_closing_time': 1774600200.0, 'created_time': 1774306051.293206, 'last_price_update_time': 1774566069.974163}
2026-03-26 23:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977595') HTTP/1.1" 204 0
2026-03-26 23:01:10 [ayvens.be] INFO: Found listing with ID: 1977596
2026-03-26 23:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977596%27 HTTP/1.1" 200 None
2026-03-26 23:01:10 [ayvens.be] INFO: Scrape type for 1977596: 2
2026-03-26 23:01:10 [ayvens.be] INFO: Extracting data for car ID: 1977596
2026-03-26 23:01:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e37963a9-72b0-56df-9d20-931da101e100 with identifier: 1977596
2026-03-26 23:01:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e37963a9-72b0-56df-9d20-931da101e100 with scrape type 2
2026-03-26 23:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e37963a9-72b0-56df-9d20-931da101e100 with scrape type 2
2026-03-26 23:01:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e37963a9-72b0-56df-9d20-931da101e100, identifier: 1977596
2026-03-26 23:01:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e37963a9-72b0-56df-9d20-931da101e100 with identifier: 1977596
2026-03-26 23:01:10 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 23:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 23:01:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e37963a9-72b0-56df-9d20-931da101e100 with identifier: 1977596
2026-03-26 23:01:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e37963a9-72b0-56df-9d20-931da101e100 with identifier: 1977596 to the API
2026-03-26 23:01:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:01:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:01:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'color': 'GRIS MOUSSON',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'diesel',
 'id': 'e37963a9-72b0-56df-9d20-931da101e100',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A3 SPORTBACK DIESEL - 2017',
 'odometer': 99196,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A3 SPORTBACK DIESEL - 2017 35 TDi Business Ed. Sport S '
          'tr.(EU6d-T.) STOCK',
 'transmission': 'automatic',
 'trim': '35 TDi Business Ed. Sport S tr.(EU6d-T.) STOCK',
 'vin': None,
 'year': 2020}
2026-03-26 23:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977596%27 HTTP/1.1" 200 None
2026-03-26 23:01:10 [ayvens.be] INFO: Saving data for 1977596: {'auction_closing_time': 1774600200.0, 'created_time': 1774306052.808567, 'last_price_update_time': 1774566070.457911}
2026-03-26 23:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977596') HTTP/1.1" 204 0
2026-03-26 23:01:10 [ayvens.be] INFO: Found listing with ID: 1977597
2026-03-26 23:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977597%27 HTTP/1.1" 200 None
2026-03-26 23:01:10 [ayvens.be] INFO: Scrape type for 1977597: 2
2026-03-26 23:01:10 [ayvens.be] INFO: Extracting data for car ID: 1977597
2026-03-26 23:01:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4bce7930-7026-5318-9fe3-ebf52b3266a2 with identifier: 1977597
2026-03-26 23:01:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4bce7930-7026-5318-9fe3-ebf52b3266a2 with scrape type 2
2026-03-26 23:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4bce7930-7026-5318-9fe3-ebf52b3266a2 with scrape type 2
2026-03-26 23:01:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 4bce7930-7026-5318-9fe3-ebf52b3266a2, identifier: 1977597
2026-03-26 23:01:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 4bce7930-7026-5318-9fe3-ebf52b3266a2 with identifier: 1977597
2026-03-26 23:01:10 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 23:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 23:01:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 4bce7930-7026-5318-9fe3-ebf52b3266a2 with identifier: 1977597
2026-03-26 23:01:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 4bce7930-7026-5318-9fe3-ebf52b3266a2 with identifier: 1977597 to the API
2026-03-26 23:01:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:01:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:01:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'MYTHOSZWART METAALKLEUR',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'electric',
 'id': '4bce7930-7026-5318-9fe3-ebf52b3266a2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'E-TRON SPORTBACK',
 'odometer': 62593,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI E-TRON SPORTBACK BEV 95KWH 55 QUATTRO S-LINE',
 'transmission': 'automatic',
 'trim': 'BEV 95KWH 55 QUATTRO S-LINE',
 'vin': None,
 'year': 2023}
2026-03-26 23:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977597%27 HTTP/1.1" 200 None
2026-03-26 23:01:10 [ayvens.be] INFO: Saving data for 1977597: {'auction_closing_time': 1774600200.0, 'created_time': 1774306053.788242, 'last_price_update_time': 1774566070.957933}
2026-03-26 23:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977597') HTTP/1.1" 204 0
2026-03-26 23:01:10 [ayvens.be] INFO: Found listing with ID: 1977598
2026-03-26 23:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977598%27 HTTP/1.1" 200 None
2026-03-26 23:01:10 [ayvens.be] INFO: Scrape type for 1977598: 2
2026-03-26 23:01:10 [ayvens.be] INFO: Extracting data for car ID: 1977598
2026-03-26 23:01:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7f49b01-1325-5392-9f15-deff8c69e130 with identifier: 1977598
2026-03-26 23:01:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7f49b01-1325-5392-9f15-deff8c69e130 with scrape type 2
2026-03-26 23:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f7f49b01-1325-5392-9f15-deff8c69e130 with scrape type 2
2026-03-26 23:01:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f7f49b01-1325-5392-9f15-deff8c69e130, identifier: 1977598
2026-03-26 23:01:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f7f49b01-1325-5392-9f15-deff8c69e130 with identifier: 1977598
2026-03-26 23:01:11 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 23:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 23:01:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f7f49b01-1325-5392-9f15-deff8c69e130 with identifier: 1977598
2026-03-26 23:01:11 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f7f49b01-1325-5392-9f15-deff8c69e130 with identifier: 1977598 to the API
2026-03-26 23:01:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:01:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:01:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'color': 'ARTENSE GRIJS',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'f7f49b01-1325-5392-9f15-deff8c69e130',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 53762,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 2008 1.2 PURETECH 96KW S-S AUTO GT PACK',
 'transmission': 'automatic',
 'trim': '1.2 PURETECH 96KW S-S AUTO GT PACK',
 'vin': None,
 'year': 2021}
2026-03-26 23:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977598%27 HTTP/1.1" 200 None
2026-03-26 23:01:11 [ayvens.be] INFO: Saving data for 1977598: {'auction_closing_time': 1774600200.0, 'created_time': 1774306055.985428, 'last_price_update_time': 1774566071.52908}
2026-03-26 23:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977598') HTTP/1.1" 204 0
2026-03-26 23:01:11 [ayvens.be] INFO: Found listing with ID: 1977599
2026-03-26 23:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977599%27 HTTP/1.1" 200 None
2026-03-26 23:01:11 [ayvens.be] INFO: Scrape type for 1977599: 2
2026-03-26 23:01:11 [ayvens.be] INFO: Extracting data for car ID: 1977599
2026-03-26 23:01:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d482a2f-1d47-5029-ac61-56fc91746d15 with identifier: 1977599
2026-03-26 23:01:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d482a2f-1d47-5029-ac61-56fc91746d15 with scrape type 2
2026-03-26 23:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6d482a2f-1d47-5029-ac61-56fc91746d15 with scrape type 2
2026-03-26 23:01:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 6d482a2f-1d47-5029-ac61-56fc91746d15, identifier: 1977599
2026-03-26 23:01:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 6d482a2f-1d47-5029-ac61-56fc91746d15 with identifier: 1977599
2026-03-26 23:01:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 6d482a2f-1d47-5029-ac61-56fc91746d15 with identifier: 1977599
2026-03-26 23:01:11 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 6d482a2f-1d47-5029-ac61-56fc91746d15 with identifier: 1977599 to the API
2026-03-26 23:01:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:01:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:01:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 213,
 'color': 'WIT',
 'currency': 'EUR',
 'doors_number': 2,
 'engine': '2.1L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '6d482a2f-1d47-5029-ac61-56fc91746d15',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'Sprinter',
 'odometer': 57018,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-09',
 'seats_number': 3,
 'seller_name': None,
 'title': 'MERCEDES-BENZ Sprinter 314 2.1 BlueTEC A1 (EU6)',
 'transmission': 'manual',
 'trim': '314 2.1 BlueTEC A1 (EU6)',
 'vin': None,
 'year': 2018}
2026-03-26 23:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977599%27 HTTP/1.1" 200 None
2026-03-26 23:01:11 [ayvens.be] INFO: Saving data for 1977599: {'auction_closing_time': 1774600200.0, 'created_time': 1774306057.470995, 'last_price_update_time': 1774566071.968805}
2026-03-26 23:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977599') HTTP/1.1" 204 0
2026-03-26 23:01:12 [ayvens.be] INFO: Found listing with ID: 1977600
2026-03-26 23:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977600%27 HTTP/1.1" 200 None
2026-03-26 23:01:12 [ayvens.be] INFO: Scrape type for 1977600: 2
2026-03-26 23:01:12 [ayvens.be] INFO: Extracting data for car ID: 1977600
2026-03-26 23:01:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2af76393-e37f-5faf-b1cf-9c20ca7639fc with identifier: 1977600
2026-03-26 23:01:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2af76393-e37f-5faf-b1cf-9c20ca7639fc with scrape type 2
2026-03-26 23:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2af76393-e37f-5faf-b1cf-9c20ca7639fc with scrape type 2
2026-03-26 23:01:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 2af76393-e37f-5faf-b1cf-9c20ca7639fc, identifier: 1977600
2026-03-26 23:01:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 2af76393-e37f-5faf-b1cf-9c20ca7639fc with identifier: 1977600
2026-03-26 23:01:12 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 23:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 23:01:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 2af76393-e37f-5faf-b1cf-9c20ca7639fc with identifier: 1977600
2026-03-26 23:01:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 2af76393-e37f-5faf-b1cf-9c20ca7639fc with identifier: 1977600 to the API
2026-03-26 23:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:01:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:01:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 156,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 2,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '2af76393-e37f-5faf-b1cf-9c20ca7639fc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'C-Klasse Cabrio',
 'odometer': 144788,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-19',
 'seats_number': 4,
 'seller_name': None,
 'title': 'MERCEDES-BENZ C-Klasse Cabrio C 200 4-Matic Mild Hybrid',
 'transmission': 'automatic',
 'trim': 'C 200 4-Matic Mild Hybrid',
 'vin': None,
 'year': 2019}
2026-03-26 23:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977600%27 HTTP/1.1" 200 None
2026-03-26 23:01:12 [ayvens.be] INFO: Saving data for 1977600: {'auction_closing_time': 1774600200.0, 'created_time': 1774306058.958671, 'last_price_update_time': 1774566072.459912}
2026-03-26 23:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977600') HTTP/1.1" 204 0
2026-03-26 23:01:12 [ayvens.be] INFO: Found listing with ID: 1977601
2026-03-26 23:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977601%27 HTTP/1.1" 200 None
2026-03-26 23:01:12 [ayvens.be] INFO: Scrape type for 1977601: 2
2026-03-26 23:01:12 [ayvens.be] INFO: Extracting data for car ID: 1977601
2026-03-26 23:01:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f56df818-8bf0-5f81-a7da-fe9cad171e2e with identifier: 1977601
2026-03-26 23:01:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f56df818-8bf0-5f81-a7da-fe9cad171e2e with scrape type 2
2026-03-26 23:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f56df818-8bf0-5f81-a7da-fe9cad171e2e with scrape type 2
2026-03-26 23:01:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f56df818-8bf0-5f81-a7da-fe9cad171e2e, identifier: 1977601
2026-03-26 23:01:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f56df818-8bf0-5f81-a7da-fe9cad171e2e with identifier: 1977601
2026-03-26 23:01:12 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 23:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 23:01:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f56df818-8bf0-5f81-a7da-fe9cad171e2e with identifier: 1977601
2026-03-26 23:01:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f56df818-8bf0-5f81-a7da-fe9cad171e2e with identifier: 1977601 to the API
2026-03-26 23:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:01:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:01:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'color': 'DEEP BLACK METALLIC',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'f56df818-8bf0-5f81-a7da-fe9cad171e2e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'T-CROSS',
 'odometer': 62743,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN T-CROSS 1.0 TSI Life OPF',
 'transmission': 'manual',
 'trim': '1.0 TSI Life OPF',
 'vin': None,
 'year': 2021}
2026-03-26 23:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977601%27 HTTP/1.1" 200 None
2026-03-26 23:01:12 [ayvens.be] INFO: Saving data for 1977601: {'auction_closing_time': 1774600200.0, 'created_time': 1774306060.155854, 'last_price_update_time': 1774566072.869914}
2026-03-26 23:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977601') HTTP/1.1" 204 0
2026-03-26 23:01:12 [ayvens.be] INFO: Found listing with ID: 1977602
2026-03-26 23:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977602%27 HTTP/1.1" 200 None
2026-03-26 23:01:12 [ayvens.be] INFO: Scrape type for 1977602: 2
2026-03-26 23:01:12 [ayvens.be] INFO: Extracting data for car ID: 1977602
2026-03-26 23:01:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2941fa4c-aec4-50a6-98af-7473d002cb85 with identifier: 1977602
2026-03-26 23:01:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2941fa4c-aec4-50a6-98af-7473d002cb85 with scrape type 2
2026-03-26 23:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2941fa4c-aec4-50a6-98af-7473d002cb85 with scrape type 2
2026-03-26 23:01:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 2941fa4c-aec4-50a6-98af-7473d002cb85, identifier: 1977602
2026-03-26 23:01:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 2941fa4c-aec4-50a6-98af-7473d002cb85 with identifier: 1977602
2026-03-26 23:01:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 2941fa4c-aec4-50a6-98af-7473d002cb85 with identifier: 1977602
2026-03-26 23:01:13 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 2941fa4c-aec4-50a6-98af-7473d002cb85 with identifier: 1977602 to the API
2026-03-26 23:01:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:01:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:01:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '2941fa4c-aec4-50a6-98af-7473d002cb85',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'PASSAT',
 'odometer': 44418,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN PASSAT 1.5 TSI ELEGANCE BUSINESS',
 'transmission': 'manual',
 'trim': '1.5 TSI ELEGANCE BUSINESS',
 'vin': None,
 'year': 2022}
2026-03-26 23:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977602%27 HTTP/1.1" 200 None
2026-03-26 23:01:13 [ayvens.be] INFO: Saving data for 1977602: {'auction_closing_time': 1774600200.0, 'created_time': 1774306061.734184, 'last_price_update_time': 1774566073.265853}
2026-03-26 23:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977602') HTTP/1.1" 204 0
2026-03-26 23:01:13 [ayvens.be] INFO: Found listing with ID: 1977603
2026-03-26 23:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977603%27 HTTP/1.1" 200 None
2026-03-26 23:01:13 [ayvens.be] INFO: Scrape type for 1977603: 2
2026-03-26 23:01:13 [ayvens.be] INFO: Extracting data for car ID: 1977603
2026-03-26 23:01:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a835356a-e1ff-5562-82aa-d8865b27de10 with identifier: 1977603
2026-03-26 23:01:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a835356a-e1ff-5562-82aa-d8865b27de10 with scrape type 2
2026-03-26 23:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a835356a-e1ff-5562-82aa-d8865b27de10 with scrape type 2
2026-03-26 23:01:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a835356a-e1ff-5562-82aa-d8865b27de10, identifier: 1977603
2026-03-26 23:01:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a835356a-e1ff-5562-82aa-d8865b27de10 with identifier: 1977603
2026-03-26 23:01:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a835356a-e1ff-5562-82aa-d8865b27de10 with identifier: 1977603
2026-03-26 23:01:13 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a835356a-e1ff-5562-82aa-d8865b27de10 with identifier: 1977603 to the API
2026-03-26 23:01:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:01:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:01:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'diesel',
 'id': 'a835356a-e1ff-5562-82aa-d8865b27de10',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q5 DIESEL - 2017',
 'odometer': 118295,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q5 DIESEL - 2017 40 TDi Quattro Business Ed.Sport S tr.',
 'transmission': 'automatic',
 'trim': '40 TDi Quattro Business Ed.Sport S tr.',
 'vin': None,
 'year': 2020}
2026-03-26 23:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977603%27 HTTP/1.1" 200 None
2026-03-26 23:01:13 [ayvens.be] INFO: Saving data for 1977603: {'auction_closing_time': 1774600200.0, 'created_time': 1774306063.588895, 'last_price_update_time': 1774566073.64757}
2026-03-26 23:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977603') HTTP/1.1" 204 0
2026-03-26 23:01:13 [ayvens.be] INFO: Found listing with ID: 1977604
2026-03-26 23:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977604%27 HTTP/1.1" 200 None
2026-03-26 23:01:13 [ayvens.be] INFO: Scrape type for 1977604: 2
2026-03-26 23:01:13 [ayvens.be] INFO: Extracting data for car ID: 1977604
2026-03-26 23:01:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a6f24ed-99e1-5ec3-9106-1655f246e37e with identifier: 1977604
2026-03-26 23:01:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a6f24ed-99e1-5ec3-9106-1655f246e37e with scrape type 2
2026-03-26 23:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7a6f24ed-99e1-5ec3-9106-1655f246e37e with scrape type 2
2026-03-26 23:01:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 7a6f24ed-99e1-5ec3-9106-1655f246e37e, identifier: 1977604
2026-03-26 23:01:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 7a6f24ed-99e1-5ec3-9106-1655f246e37e with identifier: 1977604
2026-03-26 23:01:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 7a6f24ed-99e1-5ec3-9106-1655f246e37e with identifier: 1977604
2026-03-26 23:01:13 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 7a6f24ed-99e1-5ec3-9106-1655f246e37e with identifier: 1977604 to the API
2026-03-26 23:01:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:01:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:01:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '7a6f24ed-99e1-5ec3-9106-1655f246e37e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X2',
 'odometer': 138907,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X2 2.0iA sDrive20 OPF',
 'transmission': 'automatic',
 'trim': '2.0iA sDrive20 OPF',
 'vin': None,
 'year': 2020}
2026-03-26 23:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977604%27 HTTP/1.1" 200 None
2026-03-26 23:01:14 [ayvens.be] INFO: Saving data for 1977604: {'auction_closing_time': 1774600200.0, 'created_time': 1774306066.166069, 'last_price_update_time': 1774566074.026542}
2026-03-26 23:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977604') HTTP/1.1" 204 0
2026-03-26 23:01:14 [ayvens.be] INFO: Found listing with ID: 1977605
2026-03-26 23:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977605%27 HTTP/1.1" 200 None
2026-03-26 23:01:14 [ayvens.be] INFO: Scrape type for 1977605: 2
2026-03-26 23:01:14 [ayvens.be] INFO: Extracting data for car ID: 1977605
2026-03-26 23:01:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 75c18e68-edc9-57f6-9299-53c5e886f251 with identifier: 1977605
2026-03-26 23:01:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75c18e68-edc9-57f6-9299-53c5e886f251 with scrape type 2
2026-03-26 23:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 75c18e68-edc9-57f6-9299-53c5e886f251 with scrape type 2
2026-03-26 23:01:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 75c18e68-edc9-57f6-9299-53c5e886f251, identifier: 1977605
2026-03-26 23:01:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 75c18e68-edc9-57f6-9299-53c5e886f251 with identifier: 1977605
2026-03-26 23:01:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 75c18e68-edc9-57f6-9299-53c5e886f251 with identifier: 1977605
2026-03-26 23:01:14 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 75c18e68-edc9-57f6-9299-53c5e886f251 with identifier: 1977605 to the API
2026-03-26 23:01:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:01:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:01:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '75c18e68-edc9-57f6-9299-53c5e886f251',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 109624,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T4 RECHARGE GEARTR. INSCRIPTION EXPR',
 'transmission': 'automatic',
 'trim': '1.5 T4 RECHARGE GEARTR. INSCRIPTION EXPR',
 'vin': None,
 'year': 2021}
2026-03-26 23:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977605%27 HTTP/1.1" 200 None
2026-03-26 23:01:14 [ayvens.be] INFO: Saving data for 1977605: {'auction_closing_time': 1774600200.0, 'created_time': 1774306067.417949, 'last_price_update_time': 1774566074.45664}
2026-03-26 23:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977605') HTTP/1.1" 204 0
2026-03-26 23:01:14 [ayvens.be] INFO: Found listing with ID: 1977606
2026-03-26 23:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977606%27 HTTP/1.1" 200 None
2026-03-26 23:01:14 [ayvens.be] INFO: Scrape type for 1977606: 2
2026-03-26 23:01:14 [ayvens.be] INFO: Extracting data for car ID: 1977606
2026-03-26 23:01:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8eb65c18-35ff-5232-bfe6-c831d5449f2f with identifier: 1977606
2026-03-26 23:01:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8eb65c18-35ff-5232-bfe6-c831d5449f2f with scrape type 2
2026-03-26 23:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8eb65c18-35ff-5232-bfe6-c831d5449f2f with scrape type 2
2026-03-26 23:01:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 8eb65c18-35ff-5232-bfe6-c831d5449f2f, identifier: 1977606
2026-03-26 23:01:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 8eb65c18-35ff-5232-bfe6-c831d5449f2f with identifier: 1977606
2026-03-26 23:01:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 8eb65c18-35ff-5232-bfe6-c831d5449f2f with identifier: 1977606
2026-03-26 23:01:14 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 8eb65c18-35ff-5232-bfe6-c831d5449f2f with identifier: 1977606 to the API
2026-03-26 23:01:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:01:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:01:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '8eb65c18-35ff-5232-bfe6-c831d5449f2f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'B-CLASS',
 'odometer': 102353,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ B-CLASS 1.3 B 180 BUSINESS SOLUTION',
 'transmission': 'manual',
 'trim': '1.3 B 180 BUSINESS SOLUTION',
 'vin': None,
 'year': 2022}
2026-03-26 23:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977606%27 HTTP/1.1" 200 None
2026-03-26 23:01:14 [ayvens.be] INFO: Saving data for 1977606: {'auction_closing_time': 1774600200.0, 'created_time': 1774306068.461204, 'last_price_update_time': 1774566074.850662}
2026-03-26 23:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977606') HTTP/1.1" 204 0
2026-03-26 23:01:14 [ayvens.be] INFO: Found listing with ID: 1977607
2026-03-26 23:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977607%27 HTTP/1.1" 200 None
2026-03-26 23:01:14 [ayvens.be] INFO: Scrape type for 1977607: 2
2026-03-26 23:01:14 [ayvens.be] INFO: Extracting data for car ID: 1977607
2026-03-26 23:01:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 040d6a37-0b66-560e-b090-0f631aedcd26 with identifier: 1977607
2026-03-26 23:01:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 040d6a37-0b66-560e-b090-0f631aedcd26 with scrape type 2
2026-03-26 23:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 040d6a37-0b66-560e-b090-0f631aedcd26 with scrape type 2
2026-03-26 23:01:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 040d6a37-0b66-560e-b090-0f631aedcd26, identifier: 1977607
2026-03-26 23:01:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 040d6a37-0b66-560e-b090-0f631aedcd26 with identifier: 1977607
2026-03-26 23:01:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 040d6a37-0b66-560e-b090-0f631aedcd26 with identifier: 1977607
2026-03-26 23:01:15 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 040d6a37-0b66-560e-b090-0f631aedcd26 with identifier: 1977607 to the API
2026-03-26 23:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:01:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:01:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '040d6a37-0b66-560e-b090-0f631aedcd26',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '508',
 'odometer': 174382,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 508 1.5 BLUEHDI 130 S&S AUTO GT PACK',
 'transmission': 'automatic',
 'trim': '1.5 BLUEHDI 130 S&S AUTO GT PACK',
 'vin': None,
 'year': 2021}
2026-03-26 23:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977607%27 HTTP/1.1" 200 None
2026-03-26 23:01:15 [ayvens.be] INFO: Saving data for 1977607: {'auction_closing_time': 1774600200.0, 'created_time': 1774306071.071824, 'last_price_update_time': 1774566075.249741}
2026-03-26 23:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977607') HTTP/1.1" 204 0
2026-03-26 23:01:15 [ayvens.be] INFO: Found listing with ID: 1977608
2026-03-26 23:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977608%27 HTTP/1.1" 200 None
2026-03-26 23:01:15 [ayvens.be] INFO: Scrape type for 1977608: 2
2026-03-26 23:01:15 [ayvens.be] INFO: Extracting data for car ID: 1977608
2026-03-26 23:01:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 260a2c51-3acb-5bbf-942b-982a18ca0c65 with identifier: 1977608
2026-03-26 23:01:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 260a2c51-3acb-5bbf-942b-982a18ca0c65 with scrape type 2
2026-03-26 23:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 260a2c51-3acb-5bbf-942b-982a18ca0c65 with scrape type 2
2026-03-26 23:01:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 260a2c51-3acb-5bbf-942b-982a18ca0c65, identifier: 1977608
2026-03-26 23:01:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 260a2c51-3acb-5bbf-942b-982a18ca0c65 with identifier: 1977608
2026-03-26 23:01:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 260a2c51-3acb-5bbf-942b-982a18ca0c65 with identifier: 1977608
2026-03-26 23:01:15 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 260a2c51-3acb-5bbf-942b-982a18ca0c65 with identifier: 1977608 to the API
2026-03-26 23:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:01:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:01:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '260a2c51-3acb-5bbf-942b-982a18ca0c65',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '3-serie',
 'odometer': 63063,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3-serie 2.0 316DA (90KW) BERLINE',
 'transmission': 'automatic',
 'trim': '2.0 316DA (90KW) BERLINE',
 'vin': None,
 'year': 2022}
2026-03-26 23:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977608%27 HTTP/1.1" 200 None
2026-03-26 23:01:15 [ayvens.be] INFO: Saving data for 1977608: {'auction_closing_time': 1774600200.0, 'created_time': 1774306072.397655, 'last_price_update_time': 1774566075.64978}
2026-03-26 23:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977608') HTTP/1.1" 204 0
2026-03-26 23:01:15 [ayvens.be] INFO: Found listing with ID: 1977609
2026-03-26 23:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977609%27 HTTP/1.1" 200 None
2026-03-26 23:01:15 [ayvens.be] INFO: Scrape type for 1977609: 2
2026-03-26 23:01:15 [ayvens.be] INFO: Extracting data for car ID: 1977609
2026-03-26 23:01:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 37431d50-cf72-5885-afd9-523d39342c72 with identifier: 1977609
2026-03-26 23:01:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 37431d50-cf72-5885-afd9-523d39342c72 with scrape type 2
2026-03-26 23:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 37431d50-cf72-5885-afd9-523d39342c72 with scrape type 2
2026-03-26 23:01:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 37431d50-cf72-5885-afd9-523d39342c72, identifier: 1977609
2026-03-26 23:01:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 37431d50-cf72-5885-afd9-523d39342c72 with identifier: 1977609
2026-03-26 23:01:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 37431d50-cf72-5885-afd9-523d39342c72 with identifier: 1977609
2026-03-26 23:01:15 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 37431d50-cf72-5885-afd9-523d39342c72 with identifier: 1977609 to the API
2026-03-26 23:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:01:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:01:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'electric',
 'id': '37431d50-cf72-5885-afd9-523d39342c72',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'E-NIRO',
 'odometer': 55590,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA E-NIRO 64 kWh More',
 'transmission': 'automatic',
 'trim': '64 kWh More',
 'vin': None,
 'year': 2020}
2026-03-26 23:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977609%27 HTTP/1.1" 200 None
2026-03-26 23:01:16 [ayvens.be] INFO: Saving data for 1977609: {'auction_closing_time': 1774600200.0, 'created_time': 1774306073.918109, 'last_price_update_time': 1774566076.068865}
2026-03-26 23:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977609') HTTP/1.1" 204 0
2026-03-26 23:01:16 [ayvens.be] INFO: Found listing with ID: 1977610
2026-03-26 23:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977610%27 HTTP/1.1" 200 None
2026-03-26 23:01:16 [ayvens.be] INFO: Scrape type for 1977610: 2
2026-03-26 23:01:16 [ayvens.be] INFO: Extracting data for car ID: 1977610
2026-03-26 23:01:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dba49b41-167c-5510-a7f6-344af3ca5feb with identifier: 1977610
2026-03-26 23:01:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dba49b41-167c-5510-a7f6-344af3ca5feb with scrape type 2
2026-03-26 23:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dba49b41-167c-5510-a7f6-344af3ca5feb with scrape type 2
2026-03-26 23:01:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: dba49b41-167c-5510-a7f6-344af3ca5feb, identifier: 1977610
2026-03-26 23:01:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: dba49b41-167c-5510-a7f6-344af3ca5feb with identifier: 1977610
2026-03-26 23:01:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: dba49b41-167c-5510-a7f6-344af3ca5feb with identifier: 1977610
2026-03-26 23:01:16 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: dba49b41-167c-5510-a7f6-344af3ca5feb with identifier: 1977610 to the API
2026-03-26 23:01:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:01:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:01:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'diesel',
 'id': 'dba49b41-167c-5510-a7f6-344af3ca5feb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC60 DIESEL - 2017',
 'odometer': 205744,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC60 DIESEL - 2017 2.0 D4 Momentum Pro Geartronic AdBlue',
 'transmission': 'automatic',
 'trim': '2.0 D4 Momentum Pro Geartronic AdBlue',
 'vin': None,
 'year': 2019}
2026-03-26 23:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977610%27 HTTP/1.1" 200 None
2026-03-26 23:01:16 [ayvens.be] INFO: Saving data for 1977610: {'auction_closing_time': 1774600200.0, 'created_time': 1774306075.481879, 'last_price_update_time': 1774566076.562793}
2026-03-26 23:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977610') HTTP/1.1" 204 0
2026-03-26 23:01:16 [ayvens.be] INFO: Found listing with ID: 1977611
2026-03-26 23:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977611%27 HTTP/1.1" 200 None
2026-03-26 23:01:16 [ayvens.be] INFO: Scrape type for 1977611: 2
2026-03-26 23:01:16 [ayvens.be] INFO: Extracting data for car ID: 1977611
2026-03-26 23:01:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 898dea59-cd2d-56de-8a0c-7be8a52134c9 with identifier: 1977611
2026-03-26 23:01:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 898dea59-cd2d-56de-8a0c-7be8a52134c9 with scrape type 2
2026-03-26 23:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 898dea59-cd2d-56de-8a0c-7be8a52134c9 with scrape type 2
2026-03-26 23:01:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 898dea59-cd2d-56de-8a0c-7be8a52134c9, identifier: 1977611
2026-03-26 23:01:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 898dea59-cd2d-56de-8a0c-7be8a52134c9 with identifier: 1977611
2026-03-26 23:01:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 898dea59-cd2d-56de-8a0c-7be8a52134c9 with identifier: 1977611
2026-03-26 23:01:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 898dea59-cd2d-56de-8a0c-7be8a52134c9 with identifier: 1977611 to the API
2026-03-26 23:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:01:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:01:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '898dea59-cd2d-56de-8a0c-7be8a52134c9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 135672,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 2008 1.5 BLUEHDI 81KW S-S ACTIVE',
 'transmission': 'manual',
 'trim': '1.5 BLUEHDI 81KW S-S ACTIVE',
 'vin': None,
 'year': 2021}
2026-03-26 23:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977611%27 HTTP/1.1" 200 None
2026-03-26 23:01:17 [ayvens.be] INFO: Saving data for 1977611: {'auction_closing_time': 1774600200.0, 'created_time': 1774306077.471025, 'last_price_update_time': 1774566077.207841}
2026-03-26 23:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977611') HTTP/1.1" 204 0
2026-03-26 23:01:17 [ayvens.be] INFO: Found listing with ID: 1977612
2026-03-26 23:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977612%27 HTTP/1.1" 200 None
2026-03-26 23:01:17 [ayvens.be] INFO: Scrape type for 1977612: 2
2026-03-26 23:01:17 [ayvens.be] INFO: Extracting data for car ID: 1977612
2026-03-26 23:01:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0042e16-49d4-5186-91df-19abf8b1b381 with identifier: 1977612
2026-03-26 23:01:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0042e16-49d4-5186-91df-19abf8b1b381 with scrape type 2
2026-03-26 23:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a0042e16-49d4-5186-91df-19abf8b1b381 with scrape type 2
2026-03-26 23:01:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a0042e16-49d4-5186-91df-19abf8b1b381, identifier: 1977612
2026-03-26 23:01:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a0042e16-49d4-5186-91df-19abf8b1b381 with identifier: 1977612
2026-03-26 23:01:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a0042e16-49d4-5186-91df-19abf8b1b381 with identifier: 1977612
2026-03-26 23:01:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a0042e16-49d4-5186-91df-19abf8b1b381 with identifier: 1977612 to the API
2026-03-26 23:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:01:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:01:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'a0042e16-49d4-5186-91df-19abf8b1b381',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3 Sportback',
 'odometer': 61897,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 Sportback 1.4 45 TFSI E S TRONIC',
 'transmission': 'automatic',
 'trim': '1.4 45 TFSI E S TRONIC',
 'vin': None,
 'year': 2022}
2026-03-26 23:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977612%27 HTTP/1.1" 200 None
2026-03-26 23:01:17 [ayvens.be] INFO: Saving data for 1977612: {'auction_closing_time': 1774600200.0, 'created_time': 1774306079.344922, 'last_price_update_time': 1774566077.60644}
2026-03-26 23:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977612') HTTP/1.1" 204 0
2026-03-26 23:01:17 [ayvens.be] INFO: Found listing with ID: 1977613
2026-03-26 23:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977613%27 HTTP/1.1" 200 None
2026-03-26 23:01:17 [ayvens.be] INFO: Scrape type for 1977613: 2
2026-03-26 23:01:17 [ayvens.be] INFO: Extracting data for car ID: 1977613
2026-03-26 23:01:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 660c9326-32a1-5c05-955c-dfcb85917614 with identifier: 1977613
2026-03-26 23:01:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 660c9326-32a1-5c05-955c-dfcb85917614 with scrape type 2
2026-03-26 23:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 660c9326-32a1-5c05-955c-dfcb85917614 with scrape type 2
2026-03-26 23:01:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 660c9326-32a1-5c05-955c-dfcb85917614, identifier: 1977613
2026-03-26 23:01:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 660c9326-32a1-5c05-955c-dfcb85917614 with identifier: 1977613
2026-03-26 23:01:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 660c9326-32a1-5c05-955c-dfcb85917614 with identifier: 1977613
2026-03-26 23:01:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 660c9326-32a1-5c05-955c-dfcb85917614 with identifier: 1977613 to the API
2026-03-26 23:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:01:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:01:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'electric',
 'id': '660c9326-32a1-5c05-955c-dfcb85917614',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'TESLA',
 'model': 'MODEL 3',
 'odometer': 107231,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TESLA MODEL 3 BEV 75KWH LONG RANGE DUAL MOTOR 4WD AUTO',
 'transmission': 'automatic',
 'trim': 'BEV 75KWH LONG RANGE DUAL MOTOR 4WD AUTO',
 'vin': None,
 'year': 2022}
2026-03-26 23:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977613%27 HTTP/1.1" 200 None
2026-03-26 23:01:17 [ayvens.be] INFO: Saving data for 1977613: {'auction_closing_time': 1774600200.0, 'created_time': 1774306079.898043, 'last_price_update_time': 1774566077.996439}
2026-03-26 23:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977613') HTTP/1.1" 204 0
2026-03-26 23:01:18 [ayvens.be] INFO: Found listing with ID: 1977614
2026-03-26 23:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977614%27 HTTP/1.1" 200 None
2026-03-26 23:01:18 [ayvens.be] INFO: Scrape type for 1977614: 2
2026-03-26 23:01:18 [ayvens.be] INFO: Extracting data for car ID: 1977614
2026-03-26 23:01:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c7cf7938-333f-5878-9a82-a92f0466ca26 with identifier: 1977614
2026-03-26 23:01:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7cf7938-333f-5878-9a82-a92f0466ca26 with scrape type 2
2026-03-26 23:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c7cf7938-333f-5878-9a82-a92f0466ca26 with scrape type 2
2026-03-26 23:01:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c7cf7938-333f-5878-9a82-a92f0466ca26, identifier: 1977614
2026-03-26 23:01:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c7cf7938-333f-5878-9a82-a92f0466ca26 with identifier: 1977614
2026-03-26 23:01:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c7cf7938-333f-5878-9a82-a92f0466ca26 with identifier: 1977614
2026-03-26 23:01:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c7cf7938-333f-5878-9a82-a92f0466ca26 with identifier: 1977614 to the API
2026-03-26 23:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:01:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:01:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'c7cf7938-333f-5878-9a82-a92f0466ca26',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 132687,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T4 RECHARGE GEARTRONIC R-DESIGN',
 'transmission': 'automatic',
 'trim': '1.5 T4 RECHARGE GEARTRONIC R-DESIGN',
 'vin': None,
 'year': 2021}
2026-03-26 23:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977614%27 HTTP/1.1" 200 None
2026-03-26 23:01:18 [ayvens.be] INFO: Saving data for 1977614: {'auction_closing_time': 1774600200.0, 'created_time': 1774306082.02561, 'last_price_update_time': 1774566078.430753}
2026-03-26 23:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977614') HTTP/1.1" 204 0
2026-03-26 23:01:18 [ayvens.be] INFO: Found listing with ID: 1977615
2026-03-26 23:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977615%27 HTTP/1.1" 200 None
2026-03-26 23:01:18 [ayvens.be] INFO: Scrape type for 1977615: 2
2026-03-26 23:01:18 [ayvens.be] INFO: Extracting data for car ID: 1977615
2026-03-26 23:01:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0cd0f094-d194-52c0-8bec-863643a930fd with identifier: 1977615
2026-03-26 23:01:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0cd0f094-d194-52c0-8bec-863643a930fd with scrape type 2
2026-03-26 23:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0cd0f094-d194-52c0-8bec-863643a930fd with scrape type 2
2026-03-26 23:01:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 0cd0f094-d194-52c0-8bec-863643a930fd, identifier: 1977615
2026-03-26 23:01:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 0cd0f094-d194-52c0-8bec-863643a930fd with identifier: 1977615
2026-03-26 23:01:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 0cd0f094-d194-52c0-8bec-863643a930fd with identifier: 1977615
2026-03-26 23:01:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 0cd0f094-d194-52c0-8bec-863643a930fd with identifier: 1977615 to the API
2026-03-26 23:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:01:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:01:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '0cd0f094-d194-52c0-8bec-863643a930fd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLASSE A DIESEL (W177)',
 'odometer': 145148,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLASSE A DIESEL (W177) A 180 d Business Solution',
 'transmission': 'automatic',
 'trim': 'A 180 d Business Solution',
 'vin': None,
 'year': 2020}
2026-03-26 23:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977615%27 HTTP/1.1" 200 None
2026-03-26 23:01:18 [ayvens.be] INFO: Saving data for 1977615: {'auction_closing_time': 1774600200.0, 'created_time': 1774306083.961453, 'last_price_update_time': 1774566078.824255}
2026-03-26 23:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977615') HTTP/1.1" 204 0
2026-03-26 23:01:18 [ayvens.be] INFO: Found listing with ID: 1977616
2026-03-26 23:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977616%27 HTTP/1.1" 200 None
2026-03-26 23:01:18 [ayvens.be] INFO: Scrape type for 1977616: 2
2026-03-26 23:01:18 [ayvens.be] INFO: Extracting data for car ID: 1977616
2026-03-26 23:01:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cff5db06-d1e9-56ee-834a-4d8989a81150 with identifier: 1977616
2026-03-26 23:01:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cff5db06-d1e9-56ee-834a-4d8989a81150 with scrape type 2
2026-03-26 23:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cff5db06-d1e9-56ee-834a-4d8989a81150 with scrape type 2
2026-03-26 23:01:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: cff5db06-d1e9-56ee-834a-4d8989a81150, identifier: 1977616
2026-03-26 23:01:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: cff5db06-d1e9-56ee-834a-4d8989a81150 with identifier: 1977616
2026-03-26 23:01:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: cff5db06-d1e9-56ee-834a-4d8989a81150 with identifier: 1977616
2026-03-26 23:01:19 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: cff5db06-d1e9-56ee-834a-4d8989a81150 with identifier: 1977616 to the API
2026-03-26 23:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:01:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:01:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'diesel',
 'id': 'cff5db06-d1e9-56ee-834a-4d8989a81150',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'RANGER',
 'odometer': 131945,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD RANGER 2.0 BIT 156KW 4WD D-CAB WILDTRAK AUTO',
 'transmission': 'automatic',
 'trim': '2.0 BIT 156KW 4WD D-CAB WILDTRAK AUTO',
 'vin': None,
 'year': 2022}
2026-03-26 23:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977616%27 HTTP/1.1" 200 None
2026-03-26 23:01:19 [ayvens.be] INFO: Saving data for 1977616: {'auction_closing_time': 1774600200.0, 'created_time': 1774306085.891845, 'last_price_update_time': 1774566079.212406}
2026-03-26 23:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977616') HTTP/1.1" 204 0
2026-03-26 23:01:19 [ayvens.be] INFO: Found listing with ID: 1977617
2026-03-26 23:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977617%27 HTTP/1.1" 200 None
2026-03-26 23:01:19 [ayvens.be] INFO: Scrape type for 1977617: 2
2026-03-26 23:01:19 [ayvens.be] INFO: Extracting data for car ID: 1977617
2026-03-26 23:01:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f4b029cf-ea7c-5649-ad7e-c5b21adfef70 with identifier: 1977617
2026-03-26 23:01:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4b029cf-ea7c-5649-ad7e-c5b21adfef70 with scrape type 2
2026-03-26 23:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f4b029cf-ea7c-5649-ad7e-c5b21adfef70 with scrape type 2
2026-03-26 23:01:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f4b029cf-ea7c-5649-ad7e-c5b21adfef70, identifier: 1977617
2026-03-26 23:01:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f4b029cf-ea7c-5649-ad7e-c5b21adfef70 with identifier: 1977617
2026-03-26 23:01:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f4b029cf-ea7c-5649-ad7e-c5b21adfef70 with identifier: 1977617
2026-03-26 23:01:19 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f4b029cf-ea7c-5649-ad7e-c5b21adfef70 with identifier: 1977617 to the API
2026-03-26 23:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:01:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:01:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'electric',
 'id': 'f4b029cf-ea7c-5649-ad7e-c5b21adfef70',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'MUSTANG MACH-E',
 'odometer': 151650,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD MUSTANG MACH-E BEV 99KWH 216KW EXTENDED RANGE RWD',
 'transmission': 'automatic',
 'trim': 'BEV 99KWH 216KW EXTENDED RANGE RWD',
 'vin': None,
 'year': 2022}
2026-03-26 23:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977617%27 HTTP/1.1" 200 None
2026-03-26 23:01:19 [ayvens.be] INFO: Saving data for 1977617: {'auction_closing_time': 1774600200.0, 'created_time': 1774306086.945757, 'last_price_update_time': 1774566079.620181}
2026-03-26 23:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977617') HTTP/1.1" 204 0
2026-03-26 23:01:19 [ayvens.be] INFO: Found listing with ID: 1977618
2026-03-26 23:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977618%27 HTTP/1.1" 200 None
2026-03-26 23:01:19 [ayvens.be] INFO: Scrape type for 1977618: 2
2026-03-26 23:01:19 [ayvens.be] INFO: Extracting data for car ID: 1977618
2026-03-26 23:01:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 328e7d27-a6ce-5f45-b17c-b9a4da4041ac with identifier: 1977618
2026-03-26 23:01:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 328e7d27-a6ce-5f45-b17c-b9a4da4041ac with scrape type 2
2026-03-26 23:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 328e7d27-a6ce-5f45-b17c-b9a4da4041ac with scrape type 2
2026-03-26 23:01:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 328e7d27-a6ce-5f45-b17c-b9a4da4041ac, identifier: 1977618
2026-03-26 23:01:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 328e7d27-a6ce-5f45-b17c-b9a4da4041ac with identifier: 1977618
2026-03-26 23:01:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 328e7d27-a6ce-5f45-b17c-b9a4da4041ac with identifier: 1977618
2026-03-26 23:01:19 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 328e7d27-a6ce-5f45-b17c-b9a4da4041ac with identifier: 1977618 to the API
2026-03-26 23:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:01:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:01:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '328e7d27-a6ce-5f45-b17c-b9a4da4041ac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'POLO DIESEL - 2018',
 'odometer': 101835,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN POLO DIESEL - 2018 1.6 TDi SCR Comfortline (EU6.2) STOCK',
 'transmission': 'manual',
 'trim': '1.6 TDi SCR Comfortline (EU6.2) STOCK',
 'vin': None,
 'year': 2019}
2026-03-26 23:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977618%27 HTTP/1.1" 200 None
2026-03-26 23:01:20 [ayvens.be] INFO: Saving data for 1977618: {'auction_closing_time': 1774600200.0, 'created_time': 1774306088.303919, 'last_price_update_time': 1774566080.024217}
2026-03-26 23:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977618') HTTP/1.1" 204 0
2026-03-26 23:01:20 [ayvens.be] INFO: Found listing with ID: 1977619
2026-03-26 23:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977619%27 HTTP/1.1" 200 None
2026-03-26 23:01:20 [ayvens.be] INFO: Scrape type for 1977619: 2
2026-03-26 23:01:20 [ayvens.be] INFO: Extracting data for car ID: 1977619
2026-03-26 23:01:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8adeea2f-7916-56ea-a4b6-a301ec72b012 with identifier: 1977619
2026-03-26 23:01:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8adeea2f-7916-56ea-a4b6-a301ec72b012 with scrape type 2
2026-03-26 23:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8adeea2f-7916-56ea-a4b6-a301ec72b012 with scrape type 2
2026-03-26 23:01:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 8adeea2f-7916-56ea-a4b6-a301ec72b012, identifier: 1977619
2026-03-26 23:01:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 8adeea2f-7916-56ea-a4b6-a301ec72b012 with identifier: 1977619
2026-03-26 23:01:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 8adeea2f-7916-56ea-a4b6-a301ec72b012 with identifier: 1977619
2026-03-26 23:01:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 8adeea2f-7916-56ea-a4b6-a301ec72b012 with identifier: 1977619 to the API
2026-03-26 23:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:01:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:01:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '8adeea2f-7916-56ea-a4b6-a301ec72b012',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3',
 'odometer': 36989,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 1.4 45 TFSI E S TRONIC S LINE',
 'transmission': 'automatic',
 'trim': '1.4 45 TFSI E S TRONIC S LINE',
 'vin': None,
 'year': 2022}
2026-03-26 23:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977619%27 HTTP/1.1" 200 None
2026-03-26 23:01:20 [ayvens.be] INFO: Saving data for 1977619: {'auction_closing_time': 1774600200.0, 'created_time': 1774306089.702715, 'last_price_update_time': 1774566080.448395}
2026-03-26 23:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977619') HTTP/1.1" 204 0
2026-03-26 23:01:20 [ayvens.be] INFO: Found listing with ID: 1977620
2026-03-26 23:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977620%27 HTTP/1.1" 200 None
2026-03-26 23:01:20 [ayvens.be] INFO: Scrape type for 1977620: 2
2026-03-26 23:01:20 [ayvens.be] INFO: Extracting data for car ID: 1977620
2026-03-26 23:01:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4e4ced7-c0d3-519f-83af-10ab6ba84912 with identifier: 1977620
2026-03-26 23:01:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4e4ced7-c0d3-519f-83af-10ab6ba84912 with scrape type 2
2026-03-26 23:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b4e4ced7-c0d3-519f-83af-10ab6ba84912 with scrape type 2
2026-03-26 23:01:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b4e4ced7-c0d3-519f-83af-10ab6ba84912, identifier: 1977620
2026-03-26 23:01:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b4e4ced7-c0d3-519f-83af-10ab6ba84912 with identifier: 1977620
2026-03-26 23:01:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b4e4ced7-c0d3-519f-83af-10ab6ba84912 with identifier: 1977620
2026-03-26 23:01:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b4e4ced7-c0d3-519f-83af-10ab6ba84912 with identifier: 1977620 to the API
2026-03-26 23:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:01:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:01:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'b4e4ced7-c0d3-519f-83af-10ab6ba84912',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A3 SPORTBACK',
 'odometer': 44894,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A3 SPORTBACK 1.4 40 TFSI E S TRONIC S LINE SPORTBACK',
 'transmission': 'automatic',
 'trim': '1.4 40 TFSI E S TRONIC S LINE SPORTBACK',
 'vin': None,
 'year': 2021}
2026-03-26 23:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977620%27 HTTP/1.1" 200 None
2026-03-26 23:01:20 [ayvens.be] INFO: Saving data for 1977620: {'auction_closing_time': 1774600200.0, 'created_time': 1774306091.653171, 'last_price_update_time': 1774566080.842128}
2026-03-26 23:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977620') HTTP/1.1" 204 0
2026-03-26 23:01:20 [ayvens.be] INFO: Found listing with ID: 1977621
2026-03-26 23:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977621%27 HTTP/1.1" 200 None
2026-03-26 23:01:20 [ayvens.be] INFO: Scrape type for 1977621: 2
2026-03-26 23:01:20 [ayvens.be] INFO: Extracting data for car ID: 1977621
2026-03-26 23:01:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1c5d34e1-90e0-5364-948b-2d3368cc1c27 with identifier: 1977621
2026-03-26 23:01:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c5d34e1-90e0-5364-948b-2d3368cc1c27 with scrape type 2
2026-03-26 23:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1c5d34e1-90e0-5364-948b-2d3368cc1c27 with scrape type 2
2026-03-26 23:01:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 1c5d34e1-90e0-5364-948b-2d3368cc1c27, identifier: 1977621
2026-03-26 23:01:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 1c5d34e1-90e0-5364-948b-2d3368cc1c27 with identifier: 1977621
2026-03-26 23:01:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 1c5d34e1-90e0-5364-948b-2d3368cc1c27 with identifier: 1977621
2026-03-26 23:01:21 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 1c5d34e1-90e0-5364-948b-2d3368cc1c27 with identifier: 1977621 to the API
2026-03-26 23:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:01:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:01:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '1c5d34e1-90e0-5364-948b-2d3368cc1c27',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '308',
 'odometer': 50647,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 308 1.2 PURETECH 96KW S-S ALLURE PACK',
 'transmission': 'manual',
 'trim': '1.2 PURETECH 96KW S-S ALLURE PACK',
 'vin': None,
 'year': 2020}
2026-03-26 23:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977621%27 HTTP/1.1" 200 None
2026-03-26 23:01:21 [ayvens.be] INFO: Saving data for 1977621: {'auction_closing_time': 1774600200.0, 'created_time': 1774306092.658344, 'last_price_update_time': 1774566081.219669}
2026-03-26 23:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977621') HTTP/1.1" 204 0
2026-03-26 23:01:21 [ayvens.be] INFO: Found listing with ID: 1977622
2026-03-26 23:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977622%27 HTTP/1.1" 200 None
2026-03-26 23:01:21 [ayvens.be] INFO: Scrape type for 1977622: 2
2026-03-26 23:01:21 [ayvens.be] INFO: Extracting data for car ID: 1977622
2026-03-26 23:01:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17482517-12b1-53dd-8638-ca59e46bd45c with identifier: 1977622
2026-03-26 23:01:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17482517-12b1-53dd-8638-ca59e46bd45c with scrape type 2
2026-03-26 23:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 17482517-12b1-53dd-8638-ca59e46bd45c with scrape type 2
2026-03-26 23:01:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 17482517-12b1-53dd-8638-ca59e46bd45c, identifier: 1977622
2026-03-26 23:01:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 17482517-12b1-53dd-8638-ca59e46bd45c with identifier: 1977622
2026-03-26 23:01:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 17482517-12b1-53dd-8638-ca59e46bd45c with identifier: 1977622
2026-03-26 23:01:21 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 17482517-12b1-53dd-8638-ca59e46bd45c with identifier: 1977622 to the API
2026-03-26 23:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:01:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:01:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '17482517-12b1-53dd-8638-ca59e46bd45c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC60',
 'odometer': 115692,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC60 2.0 T6 PHEV INSCRIPTION EXPR. AUTO 4WD',
 'transmission': 'automatic',
 'trim': '2.0 T6 PHEV INSCRIPTION EXPR. AUTO 4WD',
 'vin': None,
 'year': 2022}
2026-03-26 23:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977622%27 HTTP/1.1" 200 None
2026-03-26 23:01:21 [ayvens.be] INFO: Saving data for 1977622: {'auction_closing_time': 1774600200.0, 'created_time': 1774306095.365105, 'last_price_update_time': 1774566081.70483}
2026-03-26 23:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977622') HTTP/1.1" 204 0
2026-03-26 23:01:21 [ayvens.be] INFO: Found listing with ID: 1977623
2026-03-26 23:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977623%27 HTTP/1.1" 200 None
2026-03-26 23:01:21 [ayvens.be] INFO: Scrape type for 1977623: 2
2026-03-26 23:01:21 [ayvens.be] INFO: Extracting data for car ID: 1977623
2026-03-26 23:01:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 395845a7-e6de-568b-922f-6834cd836242 with identifier: 1977623
2026-03-26 23:01:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 395845a7-e6de-568b-922f-6834cd836242 with scrape type 2
2026-03-26 23:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 395845a7-e6de-568b-922f-6834cd836242 with scrape type 2
2026-03-26 23:01:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 395845a7-e6de-568b-922f-6834cd836242, identifier: 1977623
2026-03-26 23:01:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 395845a7-e6de-568b-922f-6834cd836242 with identifier: 1977623
2026-03-26 23:01:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 395845a7-e6de-568b-922f-6834cd836242 with identifier: 1977623
2026-03-26 23:01:21 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 395845a7-e6de-568b-922f-6834cd836242 with identifier: 1977623 to the API
2026-03-26 23:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:01:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:01:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '395845a7-e6de-568b-922f-6834cd836242',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X3',
 'odometer': 159350,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X3 2.0 XDRIVE30E (120KW) AUTO',
 'transmission': 'automatic',
 'trim': '2.0 XDRIVE30E (120KW) AUTO',
 'vin': None,
 'year': 2021}
2026-03-26 23:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977623%27 HTTP/1.1" 200 None
2026-03-26 23:01:22 [ayvens.be] INFO: Saving data for 1977623: {'auction_closing_time': 1774600200.0, 'created_time': 1774306096.610145, 'last_price_update_time': 1774566082.095386}
2026-03-26 23:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977623') HTTP/1.1" 204 0
2026-03-26 23:01:22 [ayvens.be] INFO: Found listing with ID: 1977624
2026-03-26 23:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977624%27 HTTP/1.1" 200 None
2026-03-26 23:01:22 [ayvens.be] INFO: Scrape type for 1977624: 2
2026-03-26 23:01:22 [ayvens.be] INFO: Extracting data for car ID: 1977624
2026-03-26 23:01:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9098dd5f-54ad-563a-b02b-c3e0efe05603 with identifier: 1977624
2026-03-26 23:01:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9098dd5f-54ad-563a-b02b-c3e0efe05603 with scrape type 2
2026-03-26 23:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9098dd5f-54ad-563a-b02b-c3e0efe05603 with scrape type 2
2026-03-26 23:01:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 9098dd5f-54ad-563a-b02b-c3e0efe05603, identifier: 1977624
2026-03-26 23:01:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 9098dd5f-54ad-563a-b02b-c3e0efe05603 with identifier: 1977624
2026-03-26 23:01:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 9098dd5f-54ad-563a-b02b-c3e0efe05603 with identifier: 1977624
2026-03-26 23:01:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 9098dd5f-54ad-563a-b02b-c3e0efe05603 with identifier: 1977624 to the API
2026-03-26 23:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:01:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:01:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '9098dd5f-54ad-563a-b02b-c3e0efe05603',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'MICRA',
 'odometer': 35503,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN MICRA 1.0 IG-T ACENTA',
 'transmission': 'manual',
 'trim': '1.0 IG-T ACENTA',
 'vin': None,
 'year': 2022}
2026-03-26 23:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977624%27 HTTP/1.1" 200 None
2026-03-26 23:01:22 [ayvens.be] INFO: Saving data for 1977624: {'auction_closing_time': 1774600200.0, 'created_time': 1774306098.176585, 'last_price_update_time': 1774566082.652302}
2026-03-26 23:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977624') HTTP/1.1" 204 0
2026-03-26 23:01:22 [ayvens.be] INFO: Found listing with ID: 1977625
2026-03-26 23:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977625%27 HTTP/1.1" 200 None
2026-03-26 23:01:22 [ayvens.be] INFO: Scrape type for 1977625: 2
2026-03-26 23:01:22 [ayvens.be] INFO: Extracting data for car ID: 1977625
2026-03-26 23:01:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0cae6efa-1e19-5809-96ef-b55cab49d096 with identifier: 1977625
2026-03-26 23:01:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0cae6efa-1e19-5809-96ef-b55cab49d096 with scrape type 2
2026-03-26 23:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0cae6efa-1e19-5809-96ef-b55cab49d096 with scrape type 2
2026-03-26 23:01:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 0cae6efa-1e19-5809-96ef-b55cab49d096, identifier: 1977625
2026-03-26 23:01:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 0cae6efa-1e19-5809-96ef-b55cab49d096 with identifier: 1977625
2026-03-26 23:01:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 0cae6efa-1e19-5809-96ef-b55cab49d096 with identifier: 1977625
2026-03-26 23:01:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 0cae6efa-1e19-5809-96ef-b55cab49d096 with identifier: 1977625 to the API
2026-03-26 23:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:01:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:01:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.1L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '0cae6efa-1e19-5809-96ef-b55cab49d096',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'SPRINTER 300 FOU LWB DSL - 201',
 'odometer': 97532,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-27',
 'seats_number': 3,
 'seller_name': None,
 'title': 'MERCEDES-BENZ SPRINTER 300 FOU LWB DSL - 201 314 2.1 CDI L3H2 RWD '
          'Functional',
 'transmission': 'manual',
 'trim': '314 2.1 CDI L3H2 RWD Functional',
 'vin': None,
 'year': 2020}
2026-03-26 23:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977625%27 HTTP/1.1" 200 None
2026-03-26 23:01:23 [ayvens.be] INFO: Saving data for 1977625: {'auction_closing_time': 1774600200.0, 'created_time': 1774306099.785612, 'last_price_update_time': 1774566083.076692}
2026-03-26 23:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977625') HTTP/1.1" 204 0
2026-03-26 23:01:23 [ayvens.be] INFO: Found listing with ID: 1977626
2026-03-26 23:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977626%27 HTTP/1.1" 200 None
2026-03-26 23:01:23 [ayvens.be] INFO: Scrape type for 1977626: 2
2026-03-26 23:01:23 [ayvens.be] INFO: Extracting data for car ID: 1977626
2026-03-26 23:01:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4571c8eb-bd65-57af-a509-c1147d519ef0 with identifier: 1977626
2026-03-26 23:01:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4571c8eb-bd65-57af-a509-c1147d519ef0 with scrape type 2
2026-03-26 23:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4571c8eb-bd65-57af-a509-c1147d519ef0 with scrape type 2
2026-03-26 23:01:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 4571c8eb-bd65-57af-a509-c1147d519ef0, identifier: 1977626
2026-03-26 23:01:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 4571c8eb-bd65-57af-a509-c1147d519ef0 with identifier: 1977626
2026-03-26 23:01:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 4571c8eb-bd65-57af-a509-c1147d519ef0 with identifier: 1977626
2026-03-26 23:01:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 4571c8eb-bd65-57af-a509-c1147d519ef0 with identifier: 1977626 to the API
2026-03-26 23:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:01:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:01:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '4571c8eb-bd65-57af-a509-c1147d519ef0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': "CEE'D",
 'odometer': 52057,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-25',
 'seats_number': 5,
 'seller_name': None,
 'title': "KIA CEE'D 1.0 T-GDI PULSE",
 'transmission': 'manual',
 'trim': '1.0 T-GDI PULSE',
 'vin': None,
 'year': 2022}
2026-03-26 23:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977626%27 HTTP/1.1" 200 None
2026-03-26 23:01:23 [ayvens.be] INFO: Saving data for 1977626: {'auction_closing_time': 1774600200.0, 'created_time': 1774306101.028811, 'last_price_update_time': 1774566083.492873}
2026-03-26 23:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977626') HTTP/1.1" 204 0
2026-03-26 23:01:23 [ayvens.be] INFO: Found listing with ID: 1977627
2026-03-26 23:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977627%27 HTTP/1.1" 200 None
2026-03-26 23:01:23 [ayvens.be] INFO: Scrape type for 1977627: 2
2026-03-26 23:01:23 [ayvens.be] INFO: Extracting data for car ID: 1977627
2026-03-26 23:01:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62d43feb-66a5-5782-affb-8345854bfbde with identifier: 1977627
2026-03-26 23:01:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62d43feb-66a5-5782-affb-8345854bfbde with scrape type 2
2026-03-26 23:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 62d43feb-66a5-5782-affb-8345854bfbde with scrape type 2
2026-03-26 23:01:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 62d43feb-66a5-5782-affb-8345854bfbde, identifier: 1977627
2026-03-26 23:01:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 62d43feb-66a5-5782-affb-8345854bfbde with identifier: 1977627
2026-03-26 23:01:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 62d43feb-66a5-5782-affb-8345854bfbde with identifier: 1977627
2026-03-26 23:01:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 62d43feb-66a5-5782-affb-8345854bfbde with identifier: 1977627 to the API
2026-03-26 23:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:01:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:01:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '62d43feb-66a5-5782-affb-8345854bfbde',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'MINI',
 'model': 'COUNTRYMAN',
 'odometer': 64632,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI COUNTRYMAN 1.5 COOPER S E 4WD AUTO',
 'transmission': 'automatic',
 'trim': '1.5 COOPER S E 4WD AUTO',
 'vin': None,
 'year': 2021}
2026-03-26 23:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977627%27 HTTP/1.1" 200 None
2026-03-26 23:01:23 [ayvens.be] INFO: Saving data for 1977627: {'auction_closing_time': 1774600200.0, 'created_time': 1774306103.643748, 'last_price_update_time': 1774566083.880374}
2026-03-26 23:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977627') HTTP/1.1" 204 0
2026-03-26 23:01:23 [ayvens.be] INFO: Found listing with ID: 1977628
2026-03-26 23:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977628%27 HTTP/1.1" 200 None
2026-03-26 23:01:23 [ayvens.be] INFO: Scrape type for 1977628: 2
2026-03-26 23:01:23 [ayvens.be] INFO: Extracting data for car ID: 1977628
2026-03-26 23:01:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c2c941d7-d350-5adb-8ad0-3b8b1dda6c70 with identifier: 1977628
2026-03-26 23:01:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2c941d7-d350-5adb-8ad0-3b8b1dda6c70 with scrape type 2
2026-03-26 23:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c2c941d7-d350-5adb-8ad0-3b8b1dda6c70 with scrape type 2
2026-03-26 23:01:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c2c941d7-d350-5adb-8ad0-3b8b1dda6c70, identifier: 1977628
2026-03-26 23:01:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c2c941d7-d350-5adb-8ad0-3b8b1dda6c70 with identifier: 1977628
2026-03-26 23:01:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c2c941d7-d350-5adb-8ad0-3b8b1dda6c70 with identifier: 1977628
2026-03-26 23:01:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c2c941d7-d350-5adb-8ad0-3b8b1dda6c70 with identifier: 1977628 to the API
2026-03-26 23:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:01:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:01:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'c2c941d7-d350-5adb-8ad0-3b8b1dda6c70',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'KAROQ',
 'odometer': 59595,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA KAROQ 1.5 TSI 110KW CLEVER+',
 'transmission': 'manual',
 'trim': '1.5 TSI 110KW CLEVER+',
 'vin': None,
 'year': 2022}
2026-03-26 23:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977628%27 HTTP/1.1" 200 None
2026-03-26 23:01:24 [ayvens.be] INFO: Saving data for 1977628: {'auction_closing_time': 1774600200.0, 'created_time': 1774306104.818584, 'last_price_update_time': 1774566084.323837}
2026-03-26 23:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977628') HTTP/1.1" 204 0
2026-03-26 23:01:24 [ayvens.be] INFO: Found listing with ID: 1977629
2026-03-26 23:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977629%27 HTTP/1.1" 200 None
2026-03-26 23:01:24 [ayvens.be] INFO: Scrape type for 1977629: 2
2026-03-26 23:01:24 [ayvens.be] INFO: Extracting data for car ID: 1977629
2026-03-26 23:01:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 04681dfe-2f8c-578e-8116-eed572210b54 with identifier: 1977629
2026-03-26 23:01:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 04681dfe-2f8c-578e-8116-eed572210b54 with scrape type 2
2026-03-26 23:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 04681dfe-2f8c-578e-8116-eed572210b54 with scrape type 2
2026-03-26 23:01:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 04681dfe-2f8c-578e-8116-eed572210b54, identifier: 1977629
2026-03-26 23:01:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 04681dfe-2f8c-578e-8116-eed572210b54 with identifier: 1977629
2026-03-26 23:01:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 04681dfe-2f8c-578e-8116-eed572210b54 with identifier: 1977629
2026-03-26 23:01:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 04681dfe-2f8c-578e-8116-eed572210b54 with identifier: 1977629 to the API
2026-03-26 23:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:01:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:01:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '04681dfe-2f8c-578e-8116-eed572210b54',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'B-CLASS',
 'odometer': 49804,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ B-CLASS 1.3 B 180 BUSINESS SOLUTION',
 'transmission': 'manual',
 'trim': '1.3 B 180 BUSINESS SOLUTION',
 'vin': None,
 'year': 2022}
2026-03-26 23:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977629%27 HTTP/1.1" 200 None
2026-03-26 23:01:24 [ayvens.be] INFO: Saving data for 1977629: {'auction_closing_time': 1774600200.0, 'created_time': 1774306106.15014, 'last_price_update_time': 1774566084.715711}
2026-03-26 23:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977629') HTTP/1.1" 204 0
2026-03-26 23:01:24 [ayvens.be] INFO: Found listing with ID: 1977630
2026-03-26 23:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977630%27 HTTP/1.1" 200 None
2026-03-26 23:01:24 [ayvens.be] INFO: Scrape type for 1977630: 2
2026-03-26 23:01:24 [ayvens.be] INFO: Extracting data for car ID: 1977630
2026-03-26 23:01:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 91e98abb-e4ba-5a6c-a670-45271e3f4d8b with identifier: 1977630
2026-03-26 23:01:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91e98abb-e4ba-5a6c-a670-45271e3f4d8b with scrape type 2
2026-03-26 23:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 91e98abb-e4ba-5a6c-a670-45271e3f4d8b with scrape type 2
2026-03-26 23:01:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 91e98abb-e4ba-5a6c-a670-45271e3f4d8b, identifier: 1977630
2026-03-26 23:01:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 91e98abb-e4ba-5a6c-a670-45271e3f4d8b with identifier: 1977630
2026-03-26 23:01:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 91e98abb-e4ba-5a6c-a670-45271e3f4d8b with identifier: 1977630
2026-03-26 23:01:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 91e98abb-e4ba-5a6c-a670-45271e3f4d8b with identifier: 1977630 to the API
2026-03-26 23:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:01:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:01:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '3.0L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '91e98abb-e4ba-5a6c-a670-45271e3f4d8b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'IVECO',
 'model': 'DAILY',
 'odometer': 164400,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-18',
 'seats_number': 2,
 'seller_name': None,
 'title': 'IVECO DAILY IVECO Daily 50C18H V-P-3.0 Turbo (4100)',
 'transmission': 'manual',
 'trim': 'IVECO Daily 50C18H V-P-3.0 Turbo (4100)',
 'vin': None,
 'year': 2019}
2026-03-26 23:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977630%27 HTTP/1.1" 200 None
2026-03-26 23:01:25 [ayvens.be] INFO: Saving data for 1977630: {'auction_closing_time': 1774600200.0, 'created_time': 1774306107.42825, 'last_price_update_time': 1774566085.105766}
2026-03-26 23:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977630') HTTP/1.1" 204 0
2026-03-26 23:01:25 [ayvens.be] INFO: Found listing with ID: 1977631
2026-03-26 23:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977631%27 HTTP/1.1" 200 None
2026-03-26 23:01:25 [ayvens.be] INFO: Scrape type for 1977631: 2
2026-03-26 23:01:25 [ayvens.be] INFO: Extracting data for car ID: 1977631
2026-03-26 23:01:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe5789cb-bdae-502d-981e-e67eb4c6ad8f with identifier: 1977631
2026-03-26 23:01:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe5789cb-bdae-502d-981e-e67eb4c6ad8f with scrape type 2
2026-03-26 23:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fe5789cb-bdae-502d-981e-e67eb4c6ad8f with scrape type 2
2026-03-26 23:01:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: fe5789cb-bdae-502d-981e-e67eb4c6ad8f, identifier: 1977631
2026-03-26 23:01:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: fe5789cb-bdae-502d-981e-e67eb4c6ad8f with identifier: 1977631
2026-03-26 23:01:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: fe5789cb-bdae-502d-981e-e67eb4c6ad8f with identifier: 1977631
2026-03-26 23:01:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: fe5789cb-bdae-502d-981e-e67eb4c6ad8f with identifier: 1977631 to the API
2026-03-26 23:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:01:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:01:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'fe5789cb-bdae-502d-981e-e67eb4c6ad8f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 105463,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T2 MOMENTUM PRO',
 'transmission': 'manual',
 'trim': '1.5 T2 MOMENTUM PRO',
 'vin': None,
 'year': 2022}
2026-03-26 23:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977631%27 HTTP/1.1" 200 None
2026-03-26 23:01:25 [ayvens.be] INFO: Saving data for 1977631: {'auction_closing_time': 1774600200.0, 'created_time': 1774306109.425923, 'last_price_update_time': 1774566085.489764}
2026-03-26 23:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977631') HTTP/1.1" 204 0
2026-03-26 23:01:25 [ayvens.be] INFO: Found listing with ID: 1977632
2026-03-26 23:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977632%27 HTTP/1.1" 200 None
2026-03-26 23:01:25 [ayvens.be] INFO: Scrape type for 1977632: 2
2026-03-26 23:01:25 [ayvens.be] INFO: Extracting data for car ID: 1977632
2026-03-26 23:01:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3db717a7-54d5-52a2-9622-9c38b840ce30 with identifier: 1977632
2026-03-26 23:01:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3db717a7-54d5-52a2-9622-9c38b840ce30 with scrape type 2
2026-03-26 23:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3db717a7-54d5-52a2-9622-9c38b840ce30 with scrape type 2
2026-03-26 23:01:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 3db717a7-54d5-52a2-9622-9c38b840ce30, identifier: 1977632
2026-03-26 23:01:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 3db717a7-54d5-52a2-9622-9c38b840ce30 with identifier: 1977632
2026-03-26 23:01:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 3db717a7-54d5-52a2-9622-9c38b840ce30 with identifier: 1977632
2026-03-26 23:01:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 3db717a7-54d5-52a2-9622-9c38b840ce30 with identifier: 1977632 to the API
2026-03-26 23:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:01:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:01:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '3db717a7-54d5-52a2-9622-9c38b840ce30',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'PUMA',
 'odometer': 78533,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD PUMA 1.0 ECOBOOST MHEV 92KW TITANIUM',
 'transmission': 'manual',
 'trim': '1.0 ECOBOOST MHEV 92KW TITANIUM',
 'vin': None,
 'year': 2021}
2026-03-26 23:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977632%27 HTTP/1.1" 200 None
2026-03-26 23:01:25 [ayvens.be] INFO: Saving data for 1977632: {'auction_closing_time': 1774600200.0, 'created_time': 1774306111.757229, 'last_price_update_time': 1774566085.891971}
2026-03-26 23:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977632') HTTP/1.1" 204 0
2026-03-26 23:01:26 [ayvens.be] INFO: Found listing with ID: 1977633
2026-03-26 23:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977633%27 HTTP/1.1" 200 None
2026-03-26 23:01:26 [ayvens.be] INFO: Scrape type for 1977633: 2
2026-03-26 23:01:26 [ayvens.be] INFO: Extracting data for car ID: 1977633
2026-03-26 23:01:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1be1016-d29e-54f5-bd1a-d0214c12115e with identifier: 1977633
2026-03-26 23:01:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1be1016-d29e-54f5-bd1a-d0214c12115e with scrape type 2
2026-03-26 23:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a1be1016-d29e-54f5-bd1a-d0214c12115e with scrape type 2
2026-03-26 23:01:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a1be1016-d29e-54f5-bd1a-d0214c12115e, identifier: 1977633
2026-03-26 23:01:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a1be1016-d29e-54f5-bd1a-d0214c12115e with identifier: 1977633
2026-03-26 23:01:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a1be1016-d29e-54f5-bd1a-d0214c12115e with identifier: 1977633
2026-03-26 23:01:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a1be1016-d29e-54f5-bd1a-d0214c12115e with identifier: 1977633 to the API
2026-03-26 23:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:01:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:01:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'a1be1016-d29e-54f5-bd1a-d0214c12115e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 75629,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 1.2 PURETECH 96KW S&S AUTO ACTIVE PACK',
 'transmission': 'automatic',
 'trim': '1.2 PURETECH 96KW S&S AUTO ACTIVE PACK',
 'vin': None,
 'year': 2022}
2026-03-26 23:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977633%27 HTTP/1.1" 200 None
2026-03-26 23:01:26 [ayvens.be] INFO: Saving data for 1977633: {'auction_closing_time': 1774600200.0, 'created_time': 1774306112.985921, 'last_price_update_time': 1774566086.418209}
2026-03-26 23:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977633') HTTP/1.1" 204 0
2026-03-26 23:01:26 [ayvens.be] INFO: Found listing with ID: 1977634
2026-03-26 23:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977634%27 HTTP/1.1" 200 None
2026-03-26 23:01:26 [ayvens.be] INFO: Scrape type for 1977634: 2
2026-03-26 23:01:26 [ayvens.be] INFO: Extracting data for car ID: 1977634
2026-03-26 23:01:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18014459-f58b-5111-9c13-67b4c82529c1 with identifier: 1977634
2026-03-26 23:01:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18014459-f58b-5111-9c13-67b4c82529c1 with scrape type 2
2026-03-26 23:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 18014459-f58b-5111-9c13-67b4c82529c1 with scrape type 2
2026-03-26 23:01:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 18014459-f58b-5111-9c13-67b4c82529c1, identifier: 1977634
2026-03-26 23:01:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 18014459-f58b-5111-9c13-67b4c82529c1 with identifier: 1977634
2026-03-26 23:01:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 18014459-f58b-5111-9c13-67b4c82529c1 with identifier: 1977634
2026-03-26 23:01:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 18014459-f58b-5111-9c13-67b4c82529c1 with identifier: 1977634 to the API
2026-03-26 23:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:01:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:01:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'electric',
 'id': '18014459-f58b-5111-9c13-67b4c82529c1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'MUSTANG MACH-E',
 'odometer': 131896,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD MUSTANG MACH-E BEV 99KWH 216KW EXTENDED RANGE RWD',
 'transmission': 'automatic',
 'trim': 'BEV 99KWH 216KW EXTENDED RANGE RWD',
 'vin': None,
 'year': 2022}
2026-03-26 23:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977634%27 HTTP/1.1" 200 None
2026-03-26 23:01:26 [ayvens.be] INFO: Saving data for 1977634: {'auction_closing_time': 1774600200.0, 'created_time': 1774306114.134582, 'last_price_update_time': 1774566086.792586}
2026-03-26 23:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977634') HTTP/1.1" 204 0
2026-03-26 23:01:26 [ayvens.be] INFO: Found listing with ID: 1977635
2026-03-26 23:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977635%27 HTTP/1.1" 200 None
2026-03-26 23:01:26 [ayvens.be] INFO: Scrape type for 1977635: 2
2026-03-26 23:01:26 [ayvens.be] INFO: Extracting data for car ID: 1977635
2026-03-26 23:01:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 71985439-3ef0-5027-9dad-d60a2915edf4 with identifier: 1977635
2026-03-26 23:01:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71985439-3ef0-5027-9dad-d60a2915edf4 with scrape type 2
2026-03-26 23:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 71985439-3ef0-5027-9dad-d60a2915edf4 with scrape type 2
2026-03-26 23:01:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 71985439-3ef0-5027-9dad-d60a2915edf4, identifier: 1977635
2026-03-26 23:01:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 71985439-3ef0-5027-9dad-d60a2915edf4 with identifier: 1977635
2026-03-26 23:01:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 71985439-3ef0-5027-9dad-d60a2915edf4 with identifier: 1977635
2026-03-26 23:01:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 71985439-3ef0-5027-9dad-d60a2915edf4 with identifier: 1977635 to the API
2026-03-26 23:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:01:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:01:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '71985439-3ef0-5027-9dad-d60a2915edf4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A6 DIESEL - 2018',
 'odometer': 191014,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A6 DIESEL - 2018 30 TDi Business Edition S tronic',
 'transmission': 'automatic',
 'trim': '30 TDi Business Edition S tronic',
 'vin': None,
 'year': 2020}
2026-03-26 23:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977635%27 HTTP/1.1" 200 None
2026-03-26 23:01:27 [ayvens.be] INFO: Saving data for 1977635: {'auction_closing_time': 1774600200.0, 'created_time': 1774306116.570474, 'last_price_update_time': 1774566087.216021}
2026-03-26 23:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977635') HTTP/1.1" 204 0
2026-03-26 23:01:27 [ayvens.be] INFO: Found listing with ID: 1977636
2026-03-26 23:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977636%27 HTTP/1.1" 200 None
2026-03-26 23:01:27 [ayvens.be] INFO: Scrape type for 1977636: 2
2026-03-26 23:01:27 [ayvens.be] INFO: Extracting data for car ID: 1977636
2026-03-26 23:01:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e5fb78d-d2d1-5307-ae51-85f87434b7c1 with identifier: 1977636
2026-03-26 23:01:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e5fb78d-d2d1-5307-ae51-85f87434b7c1 with scrape type 2
2026-03-26 23:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0e5fb78d-d2d1-5307-ae51-85f87434b7c1 with scrape type 2
2026-03-26 23:01:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 0e5fb78d-d2d1-5307-ae51-85f87434b7c1, identifier: 1977636
2026-03-26 23:01:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 0e5fb78d-d2d1-5307-ae51-85f87434b7c1 with identifier: 1977636
2026-03-26 23:01:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 0e5fb78d-d2d1-5307-ae51-85f87434b7c1 with identifier: 1977636
2026-03-26 23:01:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 0e5fb78d-d2d1-5307-ae51-85f87434b7c1 with identifier: 1977636 to the API
2026-03-26 23:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:01:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:01:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '0e5fb78d-d2d1-5307-ae51-85f87434b7c1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT 2T 350M FOU MWB HR DSL',
 'odometer': 49405,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-17',
 'seats_number': 2,
 'seller_name': None,
 'title': 'FORD TRANSIT 2T 350M FOU MWB HR DSL 2.0 TDCi L2H2 Trend',
 'transmission': 'manual',
 'trim': '2.0 TDCi L2H2 Trend',
 'vin': None,
 'year': 2018}
2026-03-26 23:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977636%27 HTTP/1.1" 200 None
2026-03-26 23:01:27 [ayvens.be] INFO: Saving data for 1977636: {'auction_closing_time': 1774600200.0, 'created_time': 1774306117.805193, 'last_price_update_time': 1774566087.623825}
2026-03-26 23:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977636') HTTP/1.1" 204 0
2026-03-26 23:01:27 [ayvens.be] INFO: Found listing with ID: 1977637
2026-03-26 23:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977637%27 HTTP/1.1" 200 None
2026-03-26 23:01:27 [ayvens.be] INFO: Scrape type for 1977637: 2
2026-03-26 23:01:27 [ayvens.be] INFO: Extracting data for car ID: 1977637
2026-03-26 23:01:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 33c9a9fb-7084-50f0-a4e6-835fba729daa with identifier: 1977637
2026-03-26 23:01:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33c9a9fb-7084-50f0-a4e6-835fba729daa with scrape type 2
2026-03-26 23:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 33c9a9fb-7084-50f0-a4e6-835fba729daa with scrape type 2
2026-03-26 23:01:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 33c9a9fb-7084-50f0-a4e6-835fba729daa, identifier: 1977637
2026-03-26 23:01:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 33c9a9fb-7084-50f0-a4e6-835fba729daa with identifier: 1977637
2026-03-26 23:01:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 33c9a9fb-7084-50f0-a4e6-835fba729daa with identifier: 1977637
2026-03-26 23:01:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 33c9a9fb-7084-50f0-a4e6-835fba729daa with identifier: 1977637 to the API
2026-03-26 23:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:01:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:01:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '33c9a9fb-7084-50f0-a4e6-835fba729daa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '3 DIESEL - 2019',
 'odometer': 161246,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3 DIESEL - 2019 320 d AdBlue',
 'transmission': 'manual',
 'trim': '320 d AdBlue',
 'vin': None,
 'year': 2019}
2026-03-26 23:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977637%27 HTTP/1.1" 200 None
2026-03-26 23:01:28 [ayvens.be] INFO: Saving data for 1977637: {'auction_closing_time': 1774600200.0, 'created_time': 1774306120.415893, 'last_price_update_time': 1774566088.012482}
2026-03-26 23:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977637') HTTP/1.1" 204 0
2026-03-26 23:01:28 [ayvens.be] INFO: Found listing with ID: 1977638
2026-03-26 23:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977638%27 HTTP/1.1" 200 None
2026-03-26 23:01:28 [ayvens.be] INFO: Scrape type for 1977638: 2
2026-03-26 23:01:28 [ayvens.be] INFO: Extracting data for car ID: 1977638
2026-03-26 23:01:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2bc1ac4d-b143-5693-b563-12d0a0856b05 with identifier: 1977638
2026-03-26 23:01:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2bc1ac4d-b143-5693-b563-12d0a0856b05 with scrape type 2
2026-03-26 23:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2bc1ac4d-b143-5693-b563-12d0a0856b05 with scrape type 2
2026-03-26 23:01:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 2bc1ac4d-b143-5693-b563-12d0a0856b05, identifier: 1977638
2026-03-26 23:01:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 2bc1ac4d-b143-5693-b563-12d0a0856b05 with identifier: 1977638
2026-03-26 23:01:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 2bc1ac4d-b143-5693-b563-12d0a0856b05 with identifier: 1977638
2026-03-26 23:01:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 2bc1ac4d-b143-5693-b563-12d0a0856b05 with identifier: 1977638 to the API
2026-03-26 23:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:01:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:01:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'electric',
 'id': '2bc1ac4d-b143-5693-b563-12d0a0856b05',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'EQA',
 'odometer': 118853,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ EQA BEV 67KWH EQA 250 BUSINESS SOLUTION LUX',
 'transmission': 'automatic',
 'trim': 'BEV 67KWH EQA 250 BUSINESS SOLUTION LUX',
 'vin': None,
 'year': 2021}
2026-03-26 23:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977638%27 HTTP/1.1" 200 None
2026-03-26 23:01:28 [ayvens.be] INFO: Saving data for 1977638: {'auction_closing_time': 1774600200.0, 'created_time': 1774306122.016568, 'last_price_update_time': 1774566088.383886}
2026-03-26 23:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977638') HTTP/1.1" 204 0
2026-03-26 23:01:28 [ayvens.be] INFO: Found listing with ID: 1977639
2026-03-26 23:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977639%27 HTTP/1.1" 200 None
2026-03-26 23:01:28 [ayvens.be] INFO: Scrape type for 1977639: 2
2026-03-26 23:01:28 [ayvens.be] INFO: Extracting data for car ID: 1977639
2026-03-26 23:01:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc5cdb25-68db-5ba3-961f-cd9e53bc0ef3 with identifier: 1977639
2026-03-26 23:01:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc5cdb25-68db-5ba3-961f-cd9e53bc0ef3 with scrape type 2
2026-03-26 23:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dc5cdb25-68db-5ba3-961f-cd9e53bc0ef3 with scrape type 2
2026-03-26 23:01:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: dc5cdb25-68db-5ba3-961f-cd9e53bc0ef3, identifier: 1977639
2026-03-26 23:01:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: dc5cdb25-68db-5ba3-961f-cd9e53bc0ef3 with identifier: 1977639
2026-03-26 23:01:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: dc5cdb25-68db-5ba3-961f-cd9e53bc0ef3 with identifier: 1977639
2026-03-26 23:01:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: dc5cdb25-68db-5ba3-961f-cd9e53bc0ef3 with identifier: 1977639 to the API
2026-03-26 23:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:01:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:01:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'dc5cdb25-68db-5ba3-961f-cd9e53bc0ef3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'Golf',
 'odometer': 164501,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN Golf 1.5 TGI TRENDLINE DSG',
 'transmission': 'automatic',
 'trim': '1.5 TGI TRENDLINE DSG',
 'vin': None,
 'year': 2019}
2026-03-26 23:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977639%27 HTTP/1.1" 200 None
2026-03-26 23:01:28 [ayvens.be] INFO: Saving data for 1977639: {'auction_closing_time': 1774600200.0, 'created_time': 1774306123.612035, 'last_price_update_time': 1774566088.75801}
2026-03-26 23:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977639') HTTP/1.1" 204 0
2026-03-26 23:01:28 [ayvens.be] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 1000
2026-03-26 23:01:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-26 23:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-03-26 23:01:31 [ayvens.be] INFO: Found listing with ID: 1977640
2026-03-26 23:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977640%27 HTTP/1.1" 200 None
2026-03-26 23:01:31 [ayvens.be] INFO: Scrape type for 1977640: 2
2026-03-26 23:01:31 [ayvens.be] INFO: Extracting data for car ID: 1977640
2026-03-26 23:01:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c610f8e2-beb2-57b7-a175-40a50bb05d37 with identifier: 1977640
2026-03-26 23:01:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c610f8e2-beb2-57b7-a175-40a50bb05d37 with scrape type 2
2026-03-26 23:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c610f8e2-beb2-57b7-a175-40a50bb05d37 with scrape type 2
2026-03-26 23:01:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c610f8e2-beb2-57b7-a175-40a50bb05d37, identifier: 1977640
2026-03-26 23:01:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c610f8e2-beb2-57b7-a175-40a50bb05d37 with identifier: 1977640
2026-03-26 23:01:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c610f8e2-beb2-57b7-a175-40a50bb05d37 with identifier: 1977640
2026-03-26 23:01:31 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c610f8e2-beb2-57b7-a175-40a50bb05d37 with identifier: 1977640 to the API
2026-03-26 23:01:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:01:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:01:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'diesel',
 'id': 'c610f8e2-beb2-57b7-a175-40a50bb05d37',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '508',
 'odometer': 113575,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 508 1.5 BLUEHDI 130 S&S AUTO ALLURE',
 'transmission': 'automatic',
 'trim': '1.5 BLUEHDI 130 S&S AUTO ALLURE',
 'vin': None,
 'year': 2021}
2026-03-26 23:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977640%27 HTTP/1.1" 200 None
2026-03-26 23:01:31 [ayvens.be] INFO: Saving data for 1977640: {'auction_closing_time': 1774600200.0, 'created_time': 1774306125.152589, 'last_price_update_time': 1774566091.99975}
2026-03-26 23:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977640') HTTP/1.1" 204 0
2026-03-26 23:01:32 [ayvens.be] INFO: Found listing with ID: 1977641
2026-03-26 23:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977641%27 HTTP/1.1" 200 None
2026-03-26 23:01:32 [ayvens.be] INFO: Scrape type for 1977641: 2
2026-03-26 23:01:32 [ayvens.be] INFO: Extracting data for car ID: 1977641
2026-03-26 23:01:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b03aecc3-08a0-538e-8586-940b044c7f49 with identifier: 1977641
2026-03-26 23:01:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b03aecc3-08a0-538e-8586-940b044c7f49 with scrape type 2
2026-03-26 23:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b03aecc3-08a0-538e-8586-940b044c7f49 with scrape type 2
2026-03-26 23:01:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b03aecc3-08a0-538e-8586-940b044c7f49, identifier: 1977641
2026-03-26 23:01:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b03aecc3-08a0-538e-8586-940b044c7f49 with identifier: 1977641
2026-03-26 23:01:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b03aecc3-08a0-538e-8586-940b044c7f49 with identifier: 1977641
2026-03-26 23:01:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b03aecc3-08a0-538e-8586-940b044c7f49 with identifier: 1977641 to the API
2026-03-26 23:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:01:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:01:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'diesel',
 'id': 'b03aecc3-08a0-538e-8586-940b044c7f49',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 43010,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-10',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 80 GRAND CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 80 GRAND CONFORT',
 'vin': None,
 'year': 2020}
2026-03-26 23:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977641%27 HTTP/1.1" 200 None
2026-03-26 23:01:32 [ayvens.be] INFO: Saving data for 1977641: {'auction_closing_time': 1774600200.0, 'created_time': 1774306127.212522, 'last_price_update_time': 1774566092.382821}
2026-03-26 23:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977641') HTTP/1.1" 204 0
2026-03-26 23:01:32 [ayvens.be] INFO: Found listing with ID: 1977642
2026-03-26 23:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977642%27 HTTP/1.1" 200 None
2026-03-26 23:01:32 [ayvens.be] INFO: Scrape type for 1977642: 2
2026-03-26 23:01:32 [ayvens.be] INFO: Extracting data for car ID: 1977642
2026-03-26 23:01:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6eb3d18-d773-5789-bae6-90b5a76843b4 with identifier: 1977642
2026-03-26 23:01:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6eb3d18-d773-5789-bae6-90b5a76843b4 with scrape type 2
2026-03-26 23:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e6eb3d18-d773-5789-bae6-90b5a76843b4 with scrape type 2
2026-03-26 23:01:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e6eb3d18-d773-5789-bae6-90b5a76843b4, identifier: 1977642
2026-03-26 23:01:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e6eb3d18-d773-5789-bae6-90b5a76843b4 with identifier: 1977642
2026-03-26 23:01:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e6eb3d18-d773-5789-bae6-90b5a76843b4 with identifier: 1977642
2026-03-26 23:01:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e6eb3d18-d773-5789-bae6-90b5a76843b4 with identifier: 1977642 to the API
2026-03-26 23:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:01:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:01:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'e6eb3d18-d773-5789-bae6-90b5a76843b4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X2',
 'odometer': 76532,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X2 1.5 SDRIVE18I 100KW',
 'transmission': 'manual',
 'trim': '1.5 SDRIVE18I 100KW',
 'vin': None,
 'year': 2022}
2026-03-26 23:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977642%27 HTTP/1.1" 200 None
2026-03-26 23:01:32 [ayvens.be] INFO: Saving data for 1977642: {'auction_closing_time': 1774600200.0, 'created_time': 1774306128.101279, 'last_price_update_time': 1774566092.837779}
2026-03-26 23:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977642') HTTP/1.1" 204 0
2026-03-26 23:01:32 [ayvens.be] INFO: Found listing with ID: 1977643
2026-03-26 23:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977643%27 HTTP/1.1" 200 None
2026-03-26 23:01:32 [ayvens.be] INFO: Scrape type for 1977643: 2
2026-03-26 23:01:32 [ayvens.be] INFO: Extracting data for car ID: 1977643
2026-03-26 23:01:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0fd093f2-9a35-53a6-be04-9222e5ec0ff6 with identifier: 1977643
2026-03-26 23:01:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0fd093f2-9a35-53a6-be04-9222e5ec0ff6 with scrape type 2
2026-03-26 23:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0fd093f2-9a35-53a6-be04-9222e5ec0ff6 with scrape type 2
2026-03-26 23:01:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 0fd093f2-9a35-53a6-be04-9222e5ec0ff6, identifier: 1977643
2026-03-26 23:01:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 0fd093f2-9a35-53a6-be04-9222e5ec0ff6 with identifier: 1977643
2026-03-26 23:01:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 0fd093f2-9a35-53a6-be04-9222e5ec0ff6 with identifier: 1977643
2026-03-26 23:01:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 0fd093f2-9a35-53a6-be04-9222e5ec0ff6 with identifier: 1977643 to the API
2026-03-26 23:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:01:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:01:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '0fd093f2-9a35-53a6-be04-9222e5ec0ff6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A5 SPORTBACK',
 'odometer': 64402,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-10',
 'seats_number': 4,
 'seller_name': None,
 'title': 'AUDI A5 SPORTBACK 2.0 35 TFSI S TRONIC BUS. ED. ATTRACTION',
 'transmission': 'automatic',
 'trim': '2.0 35 TFSI S TRONIC BUS. ED. ATTRACTION',
 'vin': None,
 'year': 2022}
2026-03-26 23:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977643%27 HTTP/1.1" 200 None
2026-03-26 23:01:33 [ayvens.be] INFO: Saving data for 1977643: {'auction_closing_time': 1774600200.0, 'created_time': 1774306129.637529, 'last_price_update_time': 1774566093.230402}
2026-03-26 23:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977643') HTTP/1.1" 204 0
2026-03-26 23:01:33 [ayvens.be] INFO: Found listing with ID: 1977644
2026-03-26 23:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977644%27 HTTP/1.1" 200 None
2026-03-26 23:01:33 [ayvens.be] INFO: Scrape type for 1977644: 2
2026-03-26 23:01:33 [ayvens.be] INFO: Extracting data for car ID: 1977644
2026-03-26 23:01:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 914b0f3b-2e2f-5dad-bb98-58fa8eea90bd with identifier: 1977644
2026-03-26 23:01:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 914b0f3b-2e2f-5dad-bb98-58fa8eea90bd with scrape type 2
2026-03-26 23:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 914b0f3b-2e2f-5dad-bb98-58fa8eea90bd with scrape type 2
2026-03-26 23:01:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 914b0f3b-2e2f-5dad-bb98-58fa8eea90bd, identifier: 1977644
2026-03-26 23:01:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 914b0f3b-2e2f-5dad-bb98-58fa8eea90bd with identifier: 1977644
2026-03-26 23:01:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 914b0f3b-2e2f-5dad-bb98-58fa8eea90bd with identifier: 1977644
2026-03-26 23:01:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 914b0f3b-2e2f-5dad-bb98-58fa8eea90bd with identifier: 1977644 to the API
2026-03-26 23:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:01:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:01:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '914b0f3b-2e2f-5dad-bb98-58fa8eea90bd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'OCTAVIA COMBI',
 'odometer': 62021,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA OCTAVIA COMBI 1.0 TSI MHEV 81KW DSG CLEVER+',
 'transmission': 'automatic',
 'trim': '1.0 TSI MHEV 81KW DSG CLEVER+',
 'vin': None,
 'year': 2023}
2026-03-26 23:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977644%27 HTTP/1.1" 200 None
2026-03-26 23:01:33 [ayvens.be] INFO: Saving data for 1977644: {'auction_closing_time': 1774600200.0, 'created_time': 1774306131.140362, 'last_price_update_time': 1774566093.702326}
2026-03-26 23:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977644') HTTP/1.1" 204 0
2026-03-26 23:01:33 [ayvens.be] INFO: Found listing with ID: 1977645
2026-03-26 23:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977645%27 HTTP/1.1" 200 None
2026-03-26 23:01:33 [ayvens.be] INFO: Scrape type for 1977645: 2
2026-03-26 23:01:33 [ayvens.be] INFO: Extracting data for car ID: 1977645
2026-03-26 23:01:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 814d2c36-6229-5ab3-b05a-23a12b4c94ff with identifier: 1977645
2026-03-26 23:01:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 814d2c36-6229-5ab3-b05a-23a12b4c94ff with scrape type 2
2026-03-26 23:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 814d2c36-6229-5ab3-b05a-23a12b4c94ff with scrape type 2
2026-03-26 23:01:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 814d2c36-6229-5ab3-b05a-23a12b4c94ff, identifier: 1977645
2026-03-26 23:01:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 814d2c36-6229-5ab3-b05a-23a12b4c94ff with identifier: 1977645
2026-03-26 23:01:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 814d2c36-6229-5ab3-b05a-23a12b4c94ff with identifier: 1977645
2026-03-26 23:01:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 814d2c36-6229-5ab3-b05a-23a12b4c94ff with identifier: 1977645 to the API
2026-03-26 23:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:01:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:01:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '814d2c36-6229-5ab3-b05a-23a12b4c94ff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT 2T 350M FOU MWB HR DSL',
 'odometer': 89692,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-13',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FORD TRANSIT 2T 350M FOU MWB HR DSL 2.0 TDCi L2H2 Trend',
 'transmission': 'manual',
 'trim': '2.0 TDCi L2H2 Trend',
 'vin': None,
 'year': 2019}
2026-03-26 23:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977645%27 HTTP/1.1" 200 None
2026-03-26 23:01:34 [ayvens.be] INFO: Saving data for 1977645: {'auction_closing_time': 1774600200.0, 'created_time': 1774306132.78185, 'last_price_update_time': 1774566094.09781}
2026-03-26 23:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977645') HTTP/1.1" 204 0
2026-03-26 23:01:34 [ayvens.be] INFO: Found listing with ID: 1977646
2026-03-26 23:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977646%27 HTTP/1.1" 200 None
2026-03-26 23:01:34 [ayvens.be] INFO: Scrape type for 1977646: 2
2026-03-26 23:01:34 [ayvens.be] INFO: Extracting data for car ID: 1977646
2026-03-26 23:01:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1569a679-9137-588f-9b01-c3bb9afa5b34 with identifier: 1977646
2026-03-26 23:01:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1569a679-9137-588f-9b01-c3bb9afa5b34 with scrape type 2
2026-03-26 23:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1569a679-9137-588f-9b01-c3bb9afa5b34 with scrape type 2
2026-03-26 23:01:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 1569a679-9137-588f-9b01-c3bb9afa5b34, identifier: 1977646
2026-03-26 23:01:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 1569a679-9137-588f-9b01-c3bb9afa5b34 with identifier: 1977646
2026-03-26 23:01:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 1569a679-9137-588f-9b01-c3bb9afa5b34 with identifier: 1977646
2026-03-26 23:01:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 1569a679-9137-588f-9b01-c3bb9afa5b34 with identifier: 1977646 to the API
2026-03-26 23:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:01:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:01:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '1569a679-9137-588f-9b01-c3bb9afa5b34',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT 2T 350M FOU MWB HR DSL',
 'odometer': 58869,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-13',
 'seats_number': 2,
 'seller_name': None,
 'title': 'FORD TRANSIT 2T 350M FOU MWB HR DSL 2.0 TDCi L2H2 Trend',
 'transmission': 'manual',
 'trim': '2.0 TDCi L2H2 Trend',
 'vin': None,
 'year': 2019}
2026-03-26 23:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977646%27 HTTP/1.1" 200 None
2026-03-26 23:01:34 [ayvens.be] INFO: Saving data for 1977646: {'auction_closing_time': 1774600200.0, 'created_time': 1774306134.614206, 'last_price_update_time': 1774566094.485148}
2026-03-26 23:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977646') HTTP/1.1" 204 0
2026-03-26 23:01:34 [ayvens.be] INFO: Found listing with ID: 1977647
2026-03-26 23:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977647%27 HTTP/1.1" 200 None
2026-03-26 23:01:34 [ayvens.be] INFO: Scrape type for 1977647: 2
2026-03-26 23:01:34 [ayvens.be] INFO: Extracting data for car ID: 1977647
2026-03-26 23:01:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6205baa6-9762-57bd-b12c-8ce1b3efbec2 with identifier: 1977647
2026-03-26 23:01:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6205baa6-9762-57bd-b12c-8ce1b3efbec2 with scrape type 2
2026-03-26 23:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6205baa6-9762-57bd-b12c-8ce1b3efbec2 with scrape type 2
2026-03-26 23:01:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 6205baa6-9762-57bd-b12c-8ce1b3efbec2, identifier: 1977647
2026-03-26 23:01:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 6205baa6-9762-57bd-b12c-8ce1b3efbec2 with identifier: 1977647
2026-03-26 23:01:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 6205baa6-9762-57bd-b12c-8ce1b3efbec2 with identifier: 1977647
2026-03-26 23:01:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 6205baa6-9762-57bd-b12c-8ce1b3efbec2 with identifier: 1977647 to the API
2026-03-26 23:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:01:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:01:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '6205baa6-9762-57bd-b12c-8ce1b3efbec2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'CRAFTER 50A FOURGON LWB HR DSL',
 'odometer': 137528,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-24',
 'seats_number': 2,
 'seller_name': None,
 'title': 'VOLKSWAGEN CRAFTER 50A FOURGON LWB HR DSL 2.0 TDI',
 'transmission': 'automatic',
 'trim': '2.0 TDI',
 'vin': None,
 'year': 2020}
2026-03-26 23:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977647%27 HTTP/1.1" 200 None
2026-03-26 23:01:34 [ayvens.be] INFO: Saving data for 1977647: {'auction_closing_time': 1774600200.0, 'created_time': 1774306136.152125, 'last_price_update_time': 1774566094.92403}
2026-03-26 23:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977647') HTTP/1.1" 204 0
2026-03-26 23:01:34 [ayvens.be] INFO: Found listing with ID: 1977648
2026-03-26 23:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977648%27 HTTP/1.1" 200 None
2026-03-26 23:01:34 [ayvens.be] INFO: Scrape type for 1977648: 2
2026-03-26 23:01:34 [ayvens.be] INFO: Extracting data for car ID: 1977648
2026-03-26 23:01:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2401b826-b801-509d-8e4b-bbef750b2607 with identifier: 1977648
2026-03-26 23:01:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2401b826-b801-509d-8e4b-bbef750b2607 with scrape type 2
2026-03-26 23:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2401b826-b801-509d-8e4b-bbef750b2607 with scrape type 2
2026-03-26 23:01:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 2401b826-b801-509d-8e4b-bbef750b2607, identifier: 1977648
2026-03-26 23:01:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 2401b826-b801-509d-8e4b-bbef750b2607 with identifier: 1977648
2026-03-26 23:01:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 2401b826-b801-509d-8e4b-bbef750b2607 with identifier: 1977648
2026-03-26 23:01:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 2401b826-b801-509d-8e4b-bbef750b2607 with identifier: 1977648 to the API
2026-03-26 23:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:01:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:01:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '2401b826-b801-509d-8e4b-bbef750b2607',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'CRAFTER 35 FOURGON MWB HR DSL',
 'odometer': 238611,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-14',
 'seats_number': 3,
 'seller_name': None,
 'title': 'VOLKSWAGEN CRAFTER 35 FOURGON MWB HR DSL 2.0 CR TDi L3H3 4Motion '
          'Automatic-8',
 'transmission': 'automatic',
 'trim': '2.0 CR TDi L3H3 4Motion Automatic-8',
 'vin': None,
 'year': 2020}
2026-03-26 23:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977648%27 HTTP/1.1" 200 None
2026-03-26 23:01:35 [ayvens.be] INFO: Saving data for 1977648: {'auction_closing_time': 1774600200.0, 'created_time': 1774306137.615192, 'last_price_update_time': 1774566095.336839}
2026-03-26 23:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977648') HTTP/1.1" 204 0
2026-03-26 23:01:35 [ayvens.be] INFO: Found listing with ID: 1977649
2026-03-26 23:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977649%27 HTTP/1.1" 200 None
2026-03-26 23:01:35 [ayvens.be] INFO: Scrape type for 1977649: 2
2026-03-26 23:01:35 [ayvens.be] INFO: Extracting data for car ID: 1977649
2026-03-26 23:01:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b0d5eedb-6a3c-5a54-9ef0-8a5769f54e37 with identifier: 1977649
2026-03-26 23:01:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0d5eedb-6a3c-5a54-9ef0-8a5769f54e37 with scrape type 2
2026-03-26 23:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b0d5eedb-6a3c-5a54-9ef0-8a5769f54e37 with scrape type 2
2026-03-26 23:01:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b0d5eedb-6a3c-5a54-9ef0-8a5769f54e37, identifier: 1977649
2026-03-26 23:01:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b0d5eedb-6a3c-5a54-9ef0-8a5769f54e37 with identifier: 1977649
2026-03-26 23:01:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b0d5eedb-6a3c-5a54-9ef0-8a5769f54e37 with identifier: 1977649
2026-03-26 23:01:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b0d5eedb-6a3c-5a54-9ef0-8a5769f54e37 with identifier: 1977649 to the API
2026-03-26 23:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:01:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:01:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'diesel',
 'id': 'b0d5eedb-6a3c-5a54-9ef0-8a5769f54e37',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLA - Klasse',
 'odometer': 170952,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLA - Klasse 2.0 CLA 200 D BUSINESS SOLUTION DCT',
 'transmission': 'automatic',
 'trim': '2.0 CLA 200 D BUSINESS SOLUTION DCT',
 'vin': None,
 'year': 2021}
2026-03-26 23:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977649%27 HTTP/1.1" 200 None
2026-03-26 23:01:35 [ayvens.be] INFO: Saving data for 1977649: {'auction_closing_time': 1774600200.0, 'created_time': 1774306140.052591, 'last_price_update_time': 1774566095.7328}
2026-03-26 23:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977649') HTTP/1.1" 204 0
2026-03-26 23:01:35 [ayvens.be] INFO: Found listing with ID: 1977650
2026-03-26 23:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977650%27 HTTP/1.1" 200 None
2026-03-26 23:01:35 [ayvens.be] INFO: Scrape type for 1977650: 2
2026-03-26 23:01:35 [ayvens.be] INFO: Extracting data for car ID: 1977650
2026-03-26 23:01:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab1fe6c5-66ec-5a2f-bc3a-5a14b01ab519 with identifier: 1977650
2026-03-26 23:01:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab1fe6c5-66ec-5a2f-bc3a-5a14b01ab519 with scrape type 2
2026-03-26 23:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ab1fe6c5-66ec-5a2f-bc3a-5a14b01ab519 with scrape type 2
2026-03-26 23:01:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: ab1fe6c5-66ec-5a2f-bc3a-5a14b01ab519, identifier: 1977650
2026-03-26 23:01:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: ab1fe6c5-66ec-5a2f-bc3a-5a14b01ab519 with identifier: 1977650
2026-03-26 23:01:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: ab1fe6c5-66ec-5a2f-bc3a-5a14b01ab519 with identifier: 1977650
2026-03-26 23:01:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: ab1fe6c5-66ec-5a2f-bc3a-5a14b01ab519 with identifier: 1977650 to the API
2026-03-26 23:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:01:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:01:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.3L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'ab1fe6c5-66ec-5a2f-bc3a-5a14b01ab519',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLA',
 'odometer': 84901,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLA 1.3 CLA 180 AMG LINE DCT',
 'transmission': 'automatic',
 'trim': '1.3 CLA 180 AMG LINE DCT',
 'vin': None,
 'year': 2022}
2026-03-26 23:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977650%27 HTTP/1.1" 200 None
2026-03-26 23:01:36 [ayvens.be] INFO: Saving data for 1977650: {'auction_closing_time': 1774600200.0, 'created_time': 1774306142.548573, 'last_price_update_time': 1774566096.120394}
2026-03-26 23:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977650') HTTP/1.1" 204 0
2026-03-26 23:01:36 [ayvens.be] INFO: Found listing with ID: 1977651
2026-03-26 23:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977651%27 HTTP/1.1" 200 None
2026-03-26 23:01:36 [ayvens.be] INFO: Scrape type for 1977651: 2
2026-03-26 23:01:36 [ayvens.be] INFO: Extracting data for car ID: 1977651
2026-03-26 23:01:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4371569f-bc3c-5de1-936c-0c8550d1ac98 with identifier: 1977651
2026-03-26 23:01:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4371569f-bc3c-5de1-936c-0c8550d1ac98 with scrape type 2
2026-03-26 23:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4371569f-bc3c-5de1-936c-0c8550d1ac98 with scrape type 2
2026-03-26 23:01:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 4371569f-bc3c-5de1-936c-0c8550d1ac98, identifier: 1977651
2026-03-26 23:01:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 4371569f-bc3c-5de1-936c-0c8550d1ac98 with identifier: 1977651
2026-03-26 23:01:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 4371569f-bc3c-5de1-936c-0c8550d1ac98 with identifier: 1977651
2026-03-26 23:01:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 4371569f-bc3c-5de1-936c-0c8550d1ac98 with identifier: 1977651 to the API
2026-03-26 23:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:01:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:01:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '4371569f-bc3c-5de1-936c-0c8550d1ac98',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '308 SW',
 'odometer': 92220,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 308 SW 1.5 BLUEHDI 96KW S-S AUTO ACTIVE PACK',
 'transmission': 'automatic',
 'trim': '1.5 BLUEHDI 96KW S-S AUTO ACTIVE PACK',
 'vin': None,
 'year': 2023}
2026-03-26 23:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977651%27 HTTP/1.1" 200 None
2026-03-26 23:01:36 [ayvens.be] INFO: Saving data for 1977651: {'auction_closing_time': 1774600200.0, 'created_time': 1774306143.447302, 'last_price_update_time': 1774566096.523678}
2026-03-26 23:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977651') HTTP/1.1" 204 0
2026-03-26 23:01:36 [ayvens.be] INFO: Found listing with ID: 1977652
2026-03-26 23:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977652%27 HTTP/1.1" 200 None
2026-03-26 23:01:36 [ayvens.be] INFO: Scrape type for 1977652: 2
2026-03-26 23:01:36 [ayvens.be] INFO: Extracting data for car ID: 1977652
2026-03-26 23:01:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5eb65bea-c7a6-59ea-821b-c1f675131729 with identifier: 1977652
2026-03-26 23:01:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5eb65bea-c7a6-59ea-821b-c1f675131729 with scrape type 2
2026-03-26 23:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5eb65bea-c7a6-59ea-821b-c1f675131729 with scrape type 2
2026-03-26 23:01:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 5eb65bea-c7a6-59ea-821b-c1f675131729, identifier: 1977652
2026-03-26 23:01:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 5eb65bea-c7a6-59ea-821b-c1f675131729 with identifier: 1977652
2026-03-26 23:01:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 5eb65bea-c7a6-59ea-821b-c1f675131729 with identifier: 1977652
2026-03-26 23:01:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 5eb65bea-c7a6-59ea-821b-c1f675131729 with identifier: 1977652 to the API
2026-03-26 23:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:01:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:01:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '5eb65bea-c7a6-59ea-821b-c1f675131729',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A-CLASS',
 'odometer': 83843,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ A-CLASS 1.5  A 180 D BUSINESS SOLUTION ESSENTIAL',
 'transmission': 'manual',
 'trim': '1.5  A 180 D BUSINESS SOLUTION ESSENTIAL',
 'vin': None,
 'year': 2021}
2026-03-26 23:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977652%27 HTTP/1.1" 200 None
2026-03-26 23:01:36 [ayvens.be] INFO: Saving data for 1977652: {'auction_closing_time': 1774600200.0, 'created_time': 1774306145.64127, 'last_price_update_time': 1774566096.9603}
2026-03-26 23:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977652') HTTP/1.1" 204 0
2026-03-26 23:01:36 [ayvens.be] INFO: Found listing with ID: 1977653
2026-03-26 23:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977653%27 HTTP/1.1" 200 None
2026-03-26 23:01:37 [ayvens.be] INFO: Scrape type for 1977653: 2
2026-03-26 23:01:37 [ayvens.be] INFO: Extracting data for car ID: 1977653
2026-03-26 23:01:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 71f81a0e-a421-5d81-a66c-c31ca3add5c4 with identifier: 1977653
2026-03-26 23:01:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71f81a0e-a421-5d81-a66c-c31ca3add5c4 with scrape type 2
2026-03-26 23:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 71f81a0e-a421-5d81-a66c-c31ca3add5c4 with scrape type 2
2026-03-26 23:01:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 71f81a0e-a421-5d81-a66c-c31ca3add5c4, identifier: 1977653
2026-03-26 23:01:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 71f81a0e-a421-5d81-a66c-c31ca3add5c4 with identifier: 1977653
2026-03-26 23:01:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 71f81a0e-a421-5d81-a66c-c31ca3add5c4 with identifier: 1977653
2026-03-26 23:01:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 71f81a0e-a421-5d81-a66c-c31ca3add5c4 with identifier: 1977653 to the API
2026-03-26 23:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:01:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:01:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '71f81a0e-a421-5d81-a66c-c31ca3add5c4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 97378,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T2 INSCRIPTION AUTO',
 'transmission': 'automatic',
 'trim': '1.5 T2 INSCRIPTION AUTO',
 'vin': None,
 'year': 2022}
2026-03-26 23:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977653%27 HTTP/1.1" 200 None
2026-03-26 23:01:37 [ayvens.be] INFO: Saving data for 1977653: {'auction_closing_time': 1774600200.0, 'created_time': 1774306146.908984, 'last_price_update_time': 1774566097.767296}
2026-03-26 23:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977653') HTTP/1.1" 204 0
2026-03-26 23:01:37 [ayvens.be] INFO: Found listing with ID: 1977654
2026-03-26 23:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977654%27 HTTP/1.1" 200 None
2026-03-26 23:01:37 [ayvens.be] INFO: Scrape type for 1977654: 2
2026-03-26 23:01:37 [ayvens.be] INFO: Extracting data for car ID: 1977654
2026-03-26 23:01:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d73573a-a368-5a86-899a-67b284d5eac9 with identifier: 1977654
2026-03-26 23:01:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d73573a-a368-5a86-899a-67b284d5eac9 with scrape type 2
2026-03-26 23:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3d73573a-a368-5a86-899a-67b284d5eac9 with scrape type 2
2026-03-26 23:01:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 3d73573a-a368-5a86-899a-67b284d5eac9, identifier: 1977654
2026-03-26 23:01:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 3d73573a-a368-5a86-899a-67b284d5eac9 with identifier: 1977654
2026-03-26 23:01:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 3d73573a-a368-5a86-899a-67b284d5eac9 with identifier: 1977654
2026-03-26 23:01:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 3d73573a-a368-5a86-899a-67b284d5eac9 with identifier: 1977654 to the API
2026-03-26 23:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:01:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:01:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '3d73573a-a368-5a86-899a-67b284d5eac9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLASS A (W177)',
 'odometer': 53660,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLASS A (W177) A 160 Business Solution',
 'transmission': 'manual',
 'trim': 'A 160 Business Solution',
 'vin': None,
 'year': 2021}
2026-03-26 23:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977654%27 HTTP/1.1" 200 None
2026-03-26 23:01:38 [ayvens.be] INFO: Saving data for 1977654: {'auction_closing_time': 1774600200.0, 'created_time': 1774306148.67269, 'last_price_update_time': 1774566098.953719}
2026-03-26 23:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977654') HTTP/1.1" 204 0
2026-03-26 23:01:39 [ayvens.be] INFO: Found listing with ID: 1977655
2026-03-26 23:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977655%27 HTTP/1.1" 200 None
2026-03-26 23:01:39 [ayvens.be] INFO: Scrape type for 1977655: 2
2026-03-26 23:01:39 [ayvens.be] INFO: Extracting data for car ID: 1977655
2026-03-26 23:01:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fda391cb-dd87-5c47-bb85-a53130a04133 with identifier: 1977655
2026-03-26 23:01:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fda391cb-dd87-5c47-bb85-a53130a04133 with scrape type 2
2026-03-26 23:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fda391cb-dd87-5c47-bb85-a53130a04133 with scrape type 2
2026-03-26 23:01:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: fda391cb-dd87-5c47-bb85-a53130a04133, identifier: 1977655
2026-03-26 23:01:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: fda391cb-dd87-5c47-bb85-a53130a04133 with identifier: 1977655
2026-03-26 23:01:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: fda391cb-dd87-5c47-bb85-a53130a04133 with identifier: 1977655
2026-03-26 23:01:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: fda391cb-dd87-5c47-bb85-a53130a04133 with identifier: 1977655 to the API
2026-03-26 23:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 23:01:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 23:01:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'fda391cb-dd87-5c47-bb85-a53130a04133',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 104044,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 1.5 SDRIVE18IA (100KW)',
 'transmission': 'automatic',
 'trim': '1.5 SDRIVE18IA (100KW)',
 'vin': None,
 'year': 2022}
2026-03-26 23:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977655%27 HTTP/1.1" 200 None
2026-03-26 23:01:40 [ayvens.be] INFO: Saving data for 1977655: {'auction_closing_time': 1774600200.0, 'created_time': 1774306150.08875, 'last_price_update_time': 1774566100.001586}
2026-03-26 23:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977655') HTTP/1.1" 204 0
2026-03-26 23:01:40 [ayvens.be] INFO: Found listing with ID: 1977656
2026-03-26 23:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977656%27 HTTP/1.1" 200 None
2026-03-26 23:01:40 [ayvens.be] INFO: Scrape type for 1977656: 0
2026-03-26 23:01:40 [ayvens.be] INFO: Found listing with ID: 1977657
2026-03-26 23:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977657%27 HTTP/1.1" 200 None
2026-03-26 23:01:40 [ayvens.be] INFO: Scrape type for 1977657: 0
2026-03-26 23:01:40 [ayvens.be] INFO: Found listing with ID: 1977658
2026-03-26 23:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977658%27 HTTP/1.1" 200 None
2026-03-26 23:01:40 [ayvens.be] INFO: Scrape type for 1977658: 0
2026-03-26 23:01:40 [ayvens.be] INFO: Found listing with ID: 1977659
2026-03-26 23:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977659%27 HTTP/1.1" 200 None
2026-03-26 23:01:40 [ayvens.be] INFO: Scrape type for 1977659: 0
2026-03-26 23:01:40 [ayvens.be] INFO: Found listing with ID: 1977660
2026-03-26 23:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977660%27 HTTP/1.1" 200 None
2026-03-26 23:01:40 [ayvens.be] INFO: Scrape type for 1977660: 0
2026-03-26 23:01:40 [ayvens.be] INFO: Found listing with ID: 1977661
2026-03-26 23:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977661%27 HTTP/1.1" 200 None
2026-03-26 23:01:40 [ayvens.be] INFO: Scrape type for 1977661: 0
2026-03-26 23:01:40 [ayvens.be] INFO: Found listing with ID: 1977662
2026-03-26 23:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977662%27 HTTP/1.1" 200 None
2026-03-26 23:01:40 [ayvens.be] INFO: Scrape type for 1977662: 0
2026-03-26 23:01:40 [ayvens.be] INFO: Found listing with ID: 1977663
2026-03-26 23:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977663%27 HTTP/1.1" 200 None
2026-03-26 23:01:40 [ayvens.be] INFO: Scrape type for 1977663: 0
2026-03-26 23:01:40 [ayvens.be] INFO: Found listing with ID: 1977664
2026-03-26 23:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977664%27 HTTP/1.1" 200 None
2026-03-26 23:01:40 [ayvens.be] INFO: Scrape type for 1977664: 0
2026-03-26 23:01:40 [ayvens.be] INFO: Found listing with ID: 1977665
2026-03-26 23:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977665%27 HTTP/1.1" 200 None
2026-03-26 23:01:40 [ayvens.be] INFO: Scrape type for 1977665: 0
2026-03-26 23:01:40 [ayvens.be] INFO: Found listing with ID: 1977666
2026-03-26 23:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977666%27 HTTP/1.1" 200 None
2026-03-26 23:01:40 [ayvens.be] INFO: Scrape type for 1977666: 0
2026-03-26 23:01:40 [ayvens.be] INFO: Found listing with ID: 1977667
2026-03-26 23:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977667%27 HTTP/1.1" 200 None
2026-03-26 23:01:40 [ayvens.be] INFO: Scrape type for 1977667: 0
2026-03-26 23:01:40 [ayvens.be] INFO: Found listing with ID: 1977668
2026-03-26 23:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977668%27 HTTP/1.1" 200 None
2026-03-26 23:01:40 [ayvens.be] INFO: Scrape type for 1977668: 0
2026-03-26 23:01:40 [ayvens.be] INFO: Found listing with ID: 1977669
2026-03-26 23:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977669%27 HTTP/1.1" 200 None
2026-03-26 23:01:40 [ayvens.be] INFO: Scrape type for 1977669: 0
2026-03-26 23:01:40 [ayvens.be] INFO: Found listing with ID: 1977670
2026-03-26 23:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977670%27 HTTP/1.1" 200 None
2026-03-26 23:01:40 [ayvens.be] INFO: Scrape type for 1977670: 0
2026-03-26 23:01:40 [ayvens.be] INFO: Found listing with ID: 1977671
2026-03-26 23:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977671%27 HTTP/1.1" 200 None
2026-03-26 23:01:40 [ayvens.be] INFO: Scrape type for 1977671: 0
2026-03-26 23:01:40 [ayvens.be] INFO: Found listing with ID: 1977672
2026-03-26 23:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977672%27 HTTP/1.1" 200 None
2026-03-26 23:01:40 [ayvens.be] INFO: Scrape type for 1977672: 0
2026-03-26 23:01:40 [ayvens.be] INFO: Found listing with ID: 1977673
2026-03-26 23:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977673%27 HTTP/1.1" 200 None
2026-03-26 23:01:40 [ayvens.be] INFO: Scrape type for 1977673: 0
2026-03-26 23:01:40 [ayvens.be] INFO: Found listing with ID: 1977674
2026-03-26 23:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977674%27 HTTP/1.1" 200 None
2026-03-26 23:01:40 [ayvens.be] INFO: Scrape type for 1977674: 0
2026-03-26 23:01:40 [ayvens.be] INFO: Found listing with ID: 1977675
2026-03-26 23:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977675%27 HTTP/1.1" 200 None
2026-03-26 23:01:40 [ayvens.be] INFO: Scrape type for 1977675: 0
2026-03-26 23:01:40 [ayvens.be] INFO: Found listing with ID: 1977676
2026-03-26 23:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977676%27 HTTP/1.1" 200 None
2026-03-26 23:01:40 [ayvens.be] INFO: Scrape type for 1977676: 0
2026-03-26 23:01:40 [ayvens.be] INFO: Found listing with ID: 1977677
2026-03-26 23:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977677%27 HTTP/1.1" 200 None
2026-03-26 23:01:40 [ayvens.be] INFO: Scrape type for 1977677: 0
2026-03-26 23:01:40 [ayvens.be] INFO: Found listing with ID: 1977678
2026-03-26 23:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977678%27 HTTP/1.1" 200 None
2026-03-26 23:01:40 [ayvens.be] INFO: Scrape type for 1977678: 0
2026-03-26 23:01:40 [ayvens.be] INFO: Found listing with ID: 1977679
2026-03-26 23:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977679%27 HTTP/1.1" 200 None
2026-03-26 23:01:40 [ayvens.be] INFO: Scrape type for 1977679: 0
2026-03-26 23:01:40 [ayvens.be] INFO: Found listing with ID: 1977680
2026-03-26 23:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977680%27 HTTP/1.1" 200 None
2026-03-26 23:01:40 [ayvens.be] INFO: Scrape type for 1977680: 0
2026-03-26 23:01:40 [ayvens.be] INFO: Found listing with ID: 1977681
2026-03-26 23:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977681%27 HTTP/1.1" 200 None
2026-03-26 23:01:40 [ayvens.be] INFO: Scrape type for 1977681: 0
2026-03-26 23:01:40 [ayvens.be] INFO: Found listing with ID: 1977682
2026-03-26 23:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977682%27 HTTP/1.1" 200 None
2026-03-26 23:01:40 [ayvens.be] INFO: Scrape type for 1977682: 0
2026-03-26 23:01:40 [ayvens.be] INFO: Found listing with ID: 1977683
2026-03-26 23:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977683%27 HTTP/1.1" 200 None
2026-03-26 23:01:40 [ayvens.be] INFO: Scrape type for 1977683: 0
2026-03-26 23:01:40 [ayvens.be] INFO: Found listing with ID: 1977684
2026-03-26 23:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977684%27 HTTP/1.1" 200 None
2026-03-26 23:01:40 [ayvens.be] INFO: Scrape type for 1977684: 0
2026-03-26 23:01:40 [ayvens.be] INFO: Found listing with ID: 1977685
2026-03-26 23:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977685%27 HTTP/1.1" 200 None
2026-03-26 23:01:40 [ayvens.be] INFO: Scrape type for 1977685: 0
2026-03-26 23:01:40 [ayvens.be] INFO: Found listing with ID: 1977686
2026-03-26 23:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977686%27 HTTP/1.1" 200 None
2026-03-26 23:01:40 [ayvens.be] INFO: Scrape type for 1977686: 0
2026-03-26 23:01:40 [ayvens.be] INFO: Found listing with ID: 1977687
2026-03-26 23:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977687%27 HTTP/1.1" 200 None
2026-03-26 23:01:40 [ayvens.be] INFO: Scrape type for 1977687: 0
2026-03-26 23:01:40 [ayvens.be] INFO: Found listing with ID: 1977688
2026-03-26 23:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977688%27 HTTP/1.1" 200 None
2026-03-26 23:01:40 [ayvens.be] INFO: Scrape type for 1977688: 0
2026-03-26 23:01:40 [ayvens.be] INFO: Found listing with ID: 1977689
2026-03-26 23:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977689%27 HTTP/1.1" 200 None
2026-03-26 23:01:40 [ayvens.be] INFO: Scrape type for 1977689: 0
2026-03-26 23:01:40 [ayvens.be] INFO: Found listing with ID: 1977690
2026-03-26 23:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977690%27 HTTP/1.1" 200 None
2026-03-26 23:01:40 [ayvens.be] INFO: Scrape type for 1977690: 0
2026-03-26 23:01:40 [ayvens.be] INFO: Found listing with ID: 1977691
2026-03-26 23:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977691%27 HTTP/1.1" 200 None
2026-03-26 23:01:40 [ayvens.be] INFO: Scrape type for 1977691: 0
2026-03-26 23:01:40 [ayvens.be] INFO: Found listing with ID: 1977692
2026-03-26 23:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977692%27 HTTP/1.1" 200 None
2026-03-26 23:01:40 [ayvens.be] INFO: Scrape type for 1977692: 0
2026-03-26 23:01:40 [ayvens.be] INFO: Found listing with ID: 1977693
2026-03-26 23:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977693%27 HTTP/1.1" 200 None
2026-03-26 23:01:40 [ayvens.be] INFO: Scrape type for 1977693: 0
2026-03-26 23:01:40 [ayvens.be] INFO: Found listing with ID: 1977694
2026-03-26 23:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977694%27 HTTP/1.1" 200 None
2026-03-26 23:01:40 [ayvens.be] INFO: Scrape type for 1977694: 0
2026-03-26 23:01:40 [ayvens.be] INFO: Found listing with ID: 1977695
2026-03-26 23:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977695%27 HTTP/1.1" 200 None
2026-03-26 23:01:40 [ayvens.be] INFO: Scrape type for 1977695: 0
2026-03-26 23:01:40 [ayvens.be] INFO: Found listing with ID: 1977696
2026-03-26 23:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977696%27 HTTP/1.1" 200 None
2026-03-26 23:01:40 [ayvens.be] INFO: Scrape type for 1977696: 0
2026-03-26 23:01:40 [ayvens.be] INFO: Found listing with ID: 1977697
2026-03-26 23:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977697%27 HTTP/1.1" 200 None
2026-03-26 23:01:40 [ayvens.be] INFO: Scrape type for 1977697: 0
2026-03-26 23:01:40 [ayvens.be] INFO: Found listing with ID: 1977698
2026-03-26 23:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977698%27 HTTP/1.1" 200 None
2026-03-26 23:01:40 [ayvens.be] INFO: Scrape type for 1977698: 0
2026-03-26 23:01:40 [ayvens.be] INFO: Found listing with ID: 1977699
2026-03-26 23:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977699%27 HTTP/1.1" 200 None
2026-03-26 23:01:40 [ayvens.be] INFO: Scrape type for 1977699: 0
2026-03-26 23:01:40 [ayvens.be] INFO: Found listing with ID: 1977700
2026-03-26 23:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977700%27 HTTP/1.1" 200 None
2026-03-26 23:01:40 [ayvens.be] INFO: Scrape type for 1977700: 0
2026-03-26 23:01:40 [ayvens.be] INFO: Found listing with ID: 1977701
2026-03-26 23:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977701%27 HTTP/1.1" 200 None
2026-03-26 23:01:40 [ayvens.be] INFO: Scrape type for 1977701: 0
2026-03-26 23:01:40 [ayvens.be] INFO: Found listing with ID: 1977702
2026-03-26 23:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977702%27 HTTP/1.1" 200 None
2026-03-26 23:01:40 [ayvens.be] INFO: Scrape type for 1977702: 0
2026-03-26 23:01:40 [ayvens.be] INFO: Found listing with ID: 1977703
2026-03-26 23:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977703%27 HTTP/1.1" 200 None
2026-03-26 23:01:40 [ayvens.be] INFO: Scrape type for 1977703: 0
2026-03-26 23:01:40 [ayvens.be] INFO: Found listing with ID: 1977704
2026-03-26 23:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977704%27 HTTP/1.1" 200 None
2026-03-26 23:01:40 [ayvens.be] INFO: Scrape type for 1977704: 0
2026-03-26 23:01:40 [ayvens.be] INFO: Found listing with ID: 1977705
2026-03-26 23:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977705%27 HTTP/1.1" 200 None
2026-03-26 23:01:40 [ayvens.be] INFO: Scrape type for 1977705: 0
2026-03-26 23:01:40 [ayvens.be] INFO: Found listing with ID: 1977706
2026-03-26 23:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977706%27 HTTP/1.1" 200 None
2026-03-26 23:01:40 [ayvens.be] INFO: Scrape type for 1977706: 0
2026-03-26 23:01:40 [ayvens.be] INFO: Found listing with ID: 1977707
2026-03-26 23:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977707%27 HTTP/1.1" 200 None
2026-03-26 23:01:41 [ayvens.be] INFO: Scrape type for 1977707: 0
2026-03-26 23:01:41 [ayvens.be] INFO: Found listing with ID: 1977708
2026-03-26 23:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977708%27 HTTP/1.1" 200 None
2026-03-26 23:01:41 [ayvens.be] INFO: Scrape type for 1977708: 0
2026-03-26 23:01:41 [ayvens.be] INFO: Found listing with ID: 1977709
2026-03-26 23:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977709%27 HTTP/1.1" 200 None
2026-03-26 23:01:41 [ayvens.be] INFO: Scrape type for 1977709: 0
2026-03-26 23:01:41 [ayvens.be] INFO: Found listing with ID: 1977710
2026-03-26 23:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977710%27 HTTP/1.1" 200 None
2026-03-26 23:01:41 [ayvens.be] INFO: Scrape type for 1977710: 0
2026-03-26 23:01:41 [ayvens.be] INFO: Found listing with ID: 1977711
2026-03-26 23:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977711%27 HTTP/1.1" 200 None
2026-03-26 23:01:41 [ayvens.be] INFO: Scrape type for 1977711: 0
2026-03-26 23:01:41 [ayvens.be] INFO: Found listing with ID: 1977712
2026-03-26 23:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977712%27 HTTP/1.1" 200 None
2026-03-26 23:01:41 [ayvens.be] INFO: Scrape type for 1977712: 0
2026-03-26 23:01:41 [ayvens.be] INFO: Found listing with ID: 1977713
2026-03-26 23:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977713%27 HTTP/1.1" 200 None
2026-03-26 23:01:41 [ayvens.be] INFO: Scrape type for 1977713: 0
2026-03-26 23:01:41 [ayvens.be] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 1100
2026-03-26 23:01:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-26 23:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-03-26 23:01:49 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-26 23:01:49 [ayvens.be] INFO: ayvens.be Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 1, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 58, <ScrapeType.BATCH_SKIPPED: 5>: 0}
2026-03-26 23:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 23:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20last_price_update_time%20lt%201774134109 HTTP/1.1" 200 None
2026-03-26 23:01:49 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (860 items) in: file:///var/lib/scrapyd/items/sourcing_v2/ayvens.be/task_34_2026-03-26T22_45_00.jl
2026-03-26 23:01:49 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 2196033,
 'downloader/request_count': 4723,
 'downloader/request_method_count/GET': 4711,
 'downloader/request_method_count/POST': 12,
 'downloader/response_bytes': 2555290493,
 'downloader/response_count': 4723,
 'downloader/response_status_count/200': 4723,
 'elapsed_time_seconds': 1002.500533,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 3, 26, 23, 1, 49, 358762, tzinfo=datetime.timezone.utc),
 'item_scraped_count': 860,
 'log_count/DEBUG': 41975,
 'log_count/INFO': 43945,
 'memusage/max': 191668224,
 'memusage/startup': 148017152,
 'photo_download_count': 4710,
 'playwright/context_count': 1,
 'playwright/context_count/max_concurrent': 1,
 'playwright/context_count/persistent/False': 1,
 'playwright/context_count/remote/False': 1,
 'playwright/page_count': 1,
 'playwright/page_count/max_concurrent': 1,
 'playwright/request_count': 139,
 'playwright/request_count/aborted': 13,
 'playwright/request_count/method/GET': 135,
 'playwright/request_count/method/POST': 4,
 'playwright/request_count/navigation': 2,
 'playwright/request_count/resource_type/document': 2,
 'playwright/request_count/resource_type/fetch': 6,
 'playwright/request_count/resource_type/font': 16,
 'playwright/request_count/resource_type/image': 28,
 'playwright/request_count/resource_type/script': 81,
 'playwright/request_count/resource_type/stylesheet': 1,
 'playwright/request_count/resource_type/xhr': 5,
 'playwright/response_count': 122,
 'playwright/response_count/method/GET': 119,
 'playwright/response_count/method/POST': 3,
 'playwright/response_count/resource_type/document': 2,
 'playwright/response_count/resource_type/fetch': 5,
 'playwright/response_count/resource_type/font': 16,
 'playwright/response_count/resource_type/image': 14,
 'playwright/response_count/resource_type/script': 80,
 'playwright/response_count/resource_type/stylesheet': 1,
 'playwright/response_count/resource_type/xhr': 4,
 'request_depth_max': 12,
 'response_received_count': 13,
 'scheduler/dequeued': 4723,
 'scheduler/dequeued/memory': 4723,
 'scheduler/enqueued': 4723,
 'scheduler/enqueued/memory': 4723,
 'scrape_type/new': 471,
 'scrape_type/price_update': 389,
 'scrape_type/skipped': 214,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 12,
 'scrapy-zyte-api/error_ratio': 0.0,
 'scrapy-zyte-api/errors': 0,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 3.622216221449586,
 'scrapy-zyte-api/mean_response_seconds': 3.7409890357327336,
 'scrapy-zyte-api/processed': 12,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 12,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 12,
 'scrapy-zyte-api/request_args/httpRequestBody': 12,
 'scrapy-zyte-api/request_args/httpRequestMethod': 12,
 'scrapy-zyte-api/request_args/httpResponseBody': 12,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 12,
 'scrapy-zyte-api/request_args/url': 12,
 'scrapy-zyte-api/status_codes/200': 12,
 'scrapy-zyte-api/success': 12,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'start_time': datetime.datetime(2026, 3, 26, 22, 45, 6, 858229, tzinfo=datetime.timezone.utc)}
2026-03-26 23:01:49 [scrapy.core.engine] INFO: Spider closed (finished)